P2P环境中的全局空间数据目录研究

P2P计算通过大量自治的节点协作共享资源与计算,为空间数据和空间操作的分布提供了新的分布式计算模式。分布在不同Peer上的空间数据库节点通过P2P协作构成一个超级全局空间数据库,全局空间数据目录是P2P环境下快速定位空间数据资源和空间计算节点的关键技术。Peer数据库节点的数据模式、元数据、资源状态参数等抽象为一系列关键词集合。全局目录基于Peer空间数据库节点的外包矩形进行动态聚类并建立P2P环境下的空间索引,支持Peer空间数据库节点的动态加入和退出,支持复杂空间查询和关键词查询。该文给出了全局空间数据目录的组织模型、P2P空间数据索引及空间资源发现算法。     

面向问题的空间应用表达与实现

讨论空间应用的一种面向问题的表达方法与实现机制。为解决空间应用的描述问题,在建立时空一体化空间数据模型基础上,定义了对SQL进行扩展的时空复合查询语言,实现了对空间应用问题的非过程化描述;研究复杂空间应用的表达问题,讨论时空复合查询语言的限制,并在语言中引入流机制,通过空间应用问题的组合实现更为复杂的空间应用,并支持空间数据分布式计算;最后给出若干空间应用实例及其面向问题的表达。     

基于P2P的空间数据操作分布技术研究

分布在不同节点的空间数据库通过P2P协作共同完成复杂的空间应用任务。提出一种基于P2P的空间数据操作分布的引擎设计:引擎根据空间应用任务的解析,在P2P网络中动态地选择最佳的执行引擎,通过P2P的消息和通信机制进行协作,共同完成复杂的空间计算和空间查询任务。P2P的执行机制避免了集中式执行引擎带来的网络拥塞和单点失效问题,提高了空间数据资源和计算资源协作的可靠性和可用性。     

空间数据计算模式分析与应用

随着传感器和其他数据采集技术的不断进步以及对地观测网络的建设和启动,空间数据的高性能处理和分析成为摆在地学工作者面前的瓶颈。本文以此为出发点,按照不同地学领域(陆地、大气、海洋)的空间数据载体的形态的不同,将空间数据划分为反映固态基质信息的陆地空间数据,反映液态基质信息的陆地水文空间数据,反映液态基质信息的海洋流体空间数据和反映气态基质信息的大气流体空间数据四类,并对每类数据的最小单元问题进行了初步的分析。本文详细阐述了地学空间计算的涵义,并根据计算行为模式及计算的侧重点的不同,将地学计算过程分为深度计算过程与主动计算过程(即“数据→特征→知识”的一般计算过程),并就此进行了阐释。以基于特征的遥感信息提取和目标识别工作为例,对上述理论进行了说明和验证。最后对空间数据计算模式相关问题进行了总结,并对以后的研究做了展望。     

A hierarchical indexing strategy for optimizing Apache Spark with HDFS to efficiently query big geospatial raster data

ABSTRACT

Earth observations and model simulations are generating big multidimensional array-based raster data. However, it is difficult to efficiently query these big raster data due to the inconsistency among the geospatial raster data model, distributed physical data storage model, and the data pipeline in distributed computing frameworks. To efficiently process big geospatial data, this paper proposes a three-layer hierarchical indexing strategy to optimize Apache Spark with Hadoop Distributed File System (HDFS) from the following aspects: (1) improve I/O efficiency by adopting the chunking data structure; (2) keep the workload balance and high data locality by building the global index (k-d tree); (3) enable Spark and HDFS to natively support geospatial raster data formats (e.g., HDF4, NetCDF4, GeoTiff) by building the local index (hash table); (4) index the in-memory data to further improve geospatial data queries; (5) develop a data repartition strategy to tune the query parallelism while keeping high data locality. The above strategies are implemented by developing the customized RDDs, and evaluated by comparing the performance with that of Spark SQL and SciSpark. The proposed indexing strategy can be applied to other distributed frameworks or cloud-based computing systems to natively support big geospatial data query with high efficiency.     

Satellite image analysis using crowdsourcing data for collaborative mapping: current and opportunities

ABSTRACT

Researchers are continually finding new applications of satellite images because of the growing number of high-resolution images with wide spatial coverage. However, the cost of these images is sometimes high, and their temporal resolution is relatively coarse. Crowdsourcing is an increasingly common source of data that takes advantage of local stakeholder knowledge and that provides a higher frequency of data. The complementarity of these two data sources suggests there is great potential for mutually beneficial integration. Unfortunately, there are still important gaps in crowdsourced satellite image analysis by means of crowdsourcing in areas such as land cover classification and emergency management. In this paper, we summarize recent efforts, and discuss the challenges and prospects of satellite image analysis for geospatial applications using crowdsourcing. Crowdsourcing can be used to improve satellite image analysis and satellite images can be used to organize crowdsourced efforts for collaborative mapping.     

基于GPU加速的Boussinesq类波浪传播变形数值模型

Boussinesq波浪模型是一类相位解析模型,在时域内求解需要较高的空间和时间分辨率以保证计算精度。为提高计算效率,有必要针对该类模型开展并行算法的研究。与传统的中央处理器(CPU)相比,图形处理器(GPU)有大量的运算器,可显著提高计算效率。基于统一计算设备架构CUDA C语言和图形处理器,实现了Boussinesq模型的并行运算。将本模型的计算结果同CPU数值模拟结果和解析解相比较,发现得到的结果基本一致。同时也比较了CPU端与GPU端的计算效率,结果表明,GPU数值模型的计算效率有明显提升,并且伴随数值网格的增多,提升效果更为明显。     

New formulae for capacity energy-based assessment of liquefaction triggering

Abstract

Liquefaction of loose saturated soil deposits is a hazardous type of ground failure occurring under earthquake excitations. Therefore, an accurate estimation of liquefaction potential is extremely important in geotechnical engineering. In the current study, a new model is proposed which estimates the level of strain energy needed for liquefaction initiation. A compiled database containing cyclic tests gathered from previously published works was used to develop new models to predict liquefaction potential. M5′ algorithm was used to find the best correlation between parameters. It was shown that not only the derived formulas are acceptably accurate but also they feature a very simple structure in comparison with available formulas in the literature. The proposed equations are accurate, physically sound and uncomplicated. Furthermore, safety factors were given for different levels of risk, which can be useful for engineering practice. In addition, the influence of different predictors on the liquefaction potential was evaluated and also the significance of input variables was assessed via sensitivity analysis. Finally, a new model was introduced for preliminary estimation of liquefaction potential.     

发展地理学视角下中国多维贫困测度及时空交互特征

探索贫困监测评估指标体系及区域间贫困时空交互动态特征对当前中国可持续减贫研究具有重要意义。基于发展地理学视角,引入面板向量自回归（PVAR）模型并结合人类发展分析路径与SDGs全球指标框架识别影响中国贫困的致贫和减贫因素,以此测度多维贫困指数,进而采用探索性时空数据分析（ESTDA）方法揭示多维贫困的时空交互特征。结果表明:① 中国当前贫困监测评估的致贫因子包括农作物受灾比和社会总抚养比,减贫因子则涉及人均GDP、人均社会保障支出、人均公共卫生支出、每万人医院数、新型农村合作医疗参合率、植被覆盖率、人均教育支出、高校数量、人均科学研究与试验发展支出、人均文化事业经费。② 2007—2017年中国省域收入贫困、健康贫困、文化贫困及多维贫困状况得到显著改善,全国综合贫困程度年均下降5.67%,部分省域的不同维度贫困内部出现差异化。③ 研究期内省域间多维贫困局域空间格局表现为较强的空间动态性,并呈现由东部向中、西部增大的变化态势;省域间多维贫困指数随时间演变呈现强的空间依赖关系,形成以西北和东北为高值区向四周递减的变化格局。④ 邻接省域多维贫困交互的时空网络以负向关联为主,仅有陕西与河南、陕西与宁夏、青海与甘肃、湖北与安徽、四川与贵州、海南与广东形成空间上较强的减贫协同关系。研究成果对当前中国精准扶贫战略实施尤其是2020年后预防返贫具有重要的参考价值。     

波段选择协同表达高光谱异常探测算法

高光谱遥感影像具有光谱分辨率极高的特点,承载了大量可区分不同类型地物的诊断性光谱信息以及区分亚类相似地物之间细微差别的光谱信息,在目标探测领域具有独特的优势。与此同时,高光谱遥感影像也带来了数据维数高、邻近波段之间存在大量冗余信息的问题,高维度的数据结构往往使得高光谱影像异常目标类和背景类之间的可分性降低。为了缓解上述问题,本文提出了一种基于波段选择的协同表达高光谱异常探测算法。首先,使用最优聚类框架对高光谱波段进行选择,获得一组波段子集来表示原有的全部波段,使得高光谱影像异常目标类与背景类之间的可分性增强。然后使用协同表达对影像上的像元进行重建,由于异常目标类和背景类之间的可分性增强,对异常目标像元进行协同表达时将会得到更大的残差,异常目标像元的输出值增大,可以更好地实现异常目标和背景类的分离。本文使用了3组高光谱影像数据进行异常目标探测实验,实验结果表明,该方法与其他现有高光谱异常目标探测算法对比,曲线下面积AUC(Area Under Curve)值更高,可以更好地实现异常目标与背景分离,能够更有效地对高光谱影像进行异常目标探测。