基于P2P的空间数据操作分布技术研究

分布在不同节点的空间数据库通过P2P协作共同完成复杂的空间应用任务。提出一种基于P2P的空间数据操作分布的引擎设计:引擎根据空间应用任务的解析,在P2P网络中动态地选择最佳的执行引擎,通过P2P的消息和通信机制进行协作,共同完成复杂的空间计算和空间查询任务。P2P的执行机制避免了集中式执行引擎带来的网络拥塞和单点失效问题,提高了空间数据资源和计算资源协作的可靠性和可用性。     

空间数据计算模式分析与应用

随着传感器和其他数据采集技术的不断进步以及对地观测网络的建设和启动,空间数据的高性能处理和分析成为摆在地学工作者面前的瓶颈。本文以此为出发点,按照不同地学领域(陆地、大气、海洋)的空间数据载体的形态的不同,将空间数据划分为反映固态基质信息的陆地空间数据,反映液态基质信息的陆地水文空间数据,反映液态基质信息的海洋流体空间数据和反映气态基质信息的大气流体空间数据四类,并对每类数据的最小单元问题进行了初步的分析。本文详细阐述了地学空间计算的涵义,并根据计算行为模式及计算的侧重点的不同,将地学计算过程分为深度计算过程与主动计算过程(即“数据→特征→知识”的一般计算过程),并就此进行了阐释。以基于特征的遥感信息提取和目标识别工作为例,对上述理论进行了说明和验证。最后对空间数据计算模式相关问题进行了总结,并对以后的研究做了展望。     

南极中山站全天信息采集系统

南极高原拥有独特的天文观测优势,为了对南极中山站夜天文观测条件进行实测研究,中国科学院云南天文台专门研制了一套具有耐低温、自动除雪除霜等适应南极气候特征的全自动全天信息采集系统,该系统可以提供实时的全天云量、天光背景和全天图像,并将信息推送到网页实时显示。介绍了系统的研制及为适应南极气候进行的耐低温实验,统计分析了中山站2016~2017年的全天信息数据,结果显示,中山站2016和2017年的可观测时间为772.21 h和437.38 h,可观测夜数为93 d和51 d,天光背景最大真实值为22.05 Mag/arcsec 2,年平均气温为-10.6℃,最高气温19.1℃,最低气温为-44℃,2016年平均相对湿度为55.2%。     

大型GNSS观测网的并行计算

CGCS2000精化及其全球拓展需要采用最新的模型,处理长期积累的大型GNSS观测网数据,大型GNSS网联合、快速和协同解算是空间基准精化、维持与服务的重要技术方向.在大数据技术背景下,以并行计算、云计算为代表的高性能计算技术逐渐成为大规模数据处理的首选方法.针对海量、多源、异构GNSS数据在解算处理与平差分析等方面面...     

基于GPU加速的Boussinesq类波浪传播变形数值模型

Boussinesq波浪模型是一类相位解析模型,在时域内求解需要较高的空间和时间分辨率以保证计算精度。为提高计算效率,有必要针对该类模型开展并行算法的研究。与传统的中央处理器(CPU)相比,图形处理器(GPU)有大量的运算器,可显著提高计算效率。基于统一计算设备架构CUDA C语言和图形处理器,实现了Boussinesq模型的并行运算。将本模型的计算结果同CPU数值模拟结果和解析解相比较,发现得到的结果基本一致。同时也比较了CPU端与GPU端的计算效率,结果表明,GPU数值模型的计算效率有明显提升,并且伴随数值网格的增多,提升效果更为明显。     

New formulae for capacity energy-based assessment of liquefaction triggering

Abstract

Liquefaction of loose saturated soil deposits is a hazardous type of ground failure occurring under earthquake excitations. Therefore, an accurate estimation of liquefaction potential is extremely important in geotechnical engineering. In the current study, a new model is proposed which estimates the level of strain energy needed for liquefaction initiation. A compiled database containing cyclic tests gathered from previously published works was used to develop new models to predict liquefaction potential. M5′ algorithm was used to find the best correlation between parameters. It was shown that not only the derived formulas are acceptably accurate but also they feature a very simple structure in comparison with available formulas in the literature. The proposed equations are accurate, physically sound and uncomplicated. Furthermore, safety factors were given for different levels of risk, which can be useful for engineering practice. In addition, the influence of different predictors on the liquefaction potential was evaluated and also the significance of input variables was assessed via sensitivity analysis. Finally, a new model was introduced for preliminary estimation of liquefaction potential.     

A hierarchical indexing strategy for optimizing Apache Spark with HDFS to efficiently query big geospatial raster data

ABSTRACT

Earth observations and model simulations are generating big multidimensional array-based raster data. However, it is difficult to efficiently query these big raster data due to the inconsistency among the geospatial raster data model, distributed physical data storage model, and the data pipeline in distributed computing frameworks. To efficiently process big geospatial data, this paper proposes a three-layer hierarchical indexing strategy to optimize Apache Spark with Hadoop Distributed File System (HDFS) from the following aspects: (1) improve I/O efficiency by adopting the chunking data structure; (2) keep the workload balance and high data locality by building the global index (k-d tree); (3) enable Spark and HDFS to natively support geospatial raster data formats (e.g., HDF4, NetCDF4, GeoTiff) by building the local index (hash table); (4) index the in-memory data to further improve geospatial data queries; (5) develop a data repartition strategy to tune the query parallelism while keeping high data locality. The above strategies are implemented by developing the customized RDDs, and evaluated by comparing the performance with that of Spark SQL and SciSpark. The proposed indexing strategy can be applied to other distributed frameworks or cloud-based computing systems to natively support big geospatial data query with high efficiency.     

大面积硅微条探测器在轨数据压缩算法的设计与实现

硅微条探测器具有位置分辨高、响应快、低噪声、低功耗等优点,广泛应用在各大加速器试验中,测量粒子径迹.新世纪以来,逐渐应用于空间探测领域.计划中的"悟空"2号暗物质粒子探测卫星的硅微条探测器将至数十万计,将产生海量的原始数据.如何实现探测器快速实时的数据压缩,是其需要解决的一大难题.立足于面向空间应用的硅微条探测器在轨实时压缩算法,算法采用FPGA (Field-programmable Gate Array)搭建流水线结构的方式实现,在提高系统集成度、节省逻辑资源的同时,批量数据处理时最高可将数据压缩率提升至38.4 M通道/s.算法结构具有通用性,设计思想和方案将为"悟空"2号的径迹探测器的研制提供参考.     

结合云计算与大数据的出租房消防安全监管GIS

我国城镇化进程和经济发展效果卓著,但消防建设规划与城市扩张发展之间并不协调。虽然现有研究已经运用GIS技术到消防安全监管当中,但依然存在信息联动性不强,可视化程度低的问题。为此,本文基于地理信息系统技术对城市开发区内地理信息数据、多源多时态遥感及航空影像、巡查数据、出租房数据等进行有效整合完善,以建立时空地理信息大数据。笔者利用虚拟化、云计算等技术建立出租房消防安全动态监管平台。此平台为管理部门提供了基于地理信息的决策支持,提升了出租房管理的高效性和科学性。系统的建成和应用对我国的出租房管理信息化工作的开展具有重要意义。     

Parallelization of the flow-path network model using a particle-set strategy

High-performance simulation of flow dynamics remains a major challenge in the use of physical-based, fully distributed hydrologic models. Parallel computing has been widely used to overcome efficiency limitation by partitioning a basin into sub-basins and executing calculations among multiple processors. However, existing partition-based parallelization strategies are still hampered by the dependency between inter-connected sub-basins. This study proposed a particle-set strategy to parallelize the flow-path network (FPN) model for achieving higher performance in the simulation of flow dynamics. The FPN model replaced the hydrological calculations on sub-basins with the movements of water packages along the upstream and downstream flow paths. Unlike previous partition-based task decomposition approaches, the proposed particle-set strategy decomposes the computational workload by randomly allocating runoff particles to concurrent computing processors. Simulation experiments of the flow routing process were undertaken to validate the developed particle-set FPN model. The outcomes of hourly outlet discharges were compared with field gauged records, and up to 128 computing processors were tested to explore its speedup capability in parallel computing. The experimental results showed that the proposed framework can achieve similar prediction accuracy and parallel efficiency to that of the Triangulated Irregular Network (TIN)-based Real-Time Integrated Basin Simulator (tRIBS).