A machine learning approach for predicting computational intensity and domain decomposition in parallel geoprocessing

ABSTRACT

High performance computing is required for fast geoprocessing of geospatial big data. Using spatial domains to represent computational intensity (CIT) and domain decomposition for parallelism are prominent strategies when designing parallel geoprocessing applications. Traditional domain decomposition is limited in evaluating the computational intensity, which often results in load imbalance and poor parallel performance. From the data science perspective, machine learning from Artificial Intelligence (AI) shows promise for better CIT evaluation. This paper proposes a machine learning approach for predicting computational intensity, followed by an optimized domain decomposition, which divides the spatial domain into balanced subdivisions based on the predicted CIT to achieve better parallel performance. The approach provides a reference framework on how various machine learning methods including feature selection and model training can be used in predicting computational intensity and optimizing parallel geoprocessing against different cases. Some comparative experiments between the approach and traditional methods were performed using the two cases, DEM generation from point clouds and spatial intersection on vector data. The results not only demonstrate the advantage of the approach, but also provide hints on how traditional GIS computation can be improved by the AI machine learning.     

GDJ人卫目视观测数据采集和处理系统的研制

本文介绍了ＧＤＪ跟踪打印经纬仪在人造卫星的观测中如何应用计算机对多圈卫星的目视观测资料进行实时采集、处理等工作过程的原理和方法。     

Use of multi‐platform,multi‐temporal remote‐sensing data for calibration of a distributed hydrological model: an application in the Arno basin,Italy

Images from satellite platforms are a valid aid in order to obtain distributed information about hydrological surface states and parameters needed in calibration and validation of the water balance and flood forecasting. Remotely sensed data are easily available on large areas and with a frequency compatible with land cover changes. In this paper, remotely sensed images from different types of sensor have been utilized as a support to the calibration of the distributed hydrological model MOBIDIC, currently used in the experimental system of flood forecasting of the Arno River Basin Authority. Six radar images from ERS‐2 synthetic aperture radar (SAR) sensors (three for summer 2002 and three for spring–summer 2003) have been utilized and a relationship between soil saturation indexes and backscatter coefficient from SAR images has been investigated. Analysis has been performed only on pixels with meagre or no vegetation cover, in order to legitimize the assumption that water content of the soil is the main variable that influences the backscatter coefficient. Such pixels have been obtained by considering vegetation indexes (NDVI) and land cover maps produced by optical sensors (Landsat‐ETM). In order to calibrate the soil moisture model based on information provided by SAR images, an optimization algorithm has been utilized to minimize the regression error between saturation indexes from model and SAR data and error between measured and modelled discharge flows. Utilizing this procedure, model parameters that rule soil moisture fluxes have been calibrated, obtaining not only a good match with remotely sensed data, but also an enhancement of model performance in flow prediction with respect to a previous calibration with river discharge data only. Copyright © 2006 John Wiley & Sons, Ltd.     

基于分布式水文模拟的三峡区间洪水预报(Ⅰ)——模型构建及验证

长江三峡区间因暴雨形成的洪水峰高量大,对三峡水库的防洪安全和运行调度的影响很大.本论文依据三峡地区的地形地貌特征,采用基于GIS的机理性分布式水文模型,来模拟三峡区间入库洪水,以尽量减少洪水预报中的不确定性.利用近期建成的78个自动雨量站网监测的小时降雨信息作为模型的输入,对模型参数进行了率定和验证,结果表明:大多数洪水过程的模拟精度较好,但也有的模拟结果较差,其中降雨信息缺失是洪水预报不确定性的主要来源.     

东营城区高精度三维地震采集方法研究

根据东营城区内建筑物较多，环境干扰较大，地下构造复杂，断裂非常发育，目的层埋藏深，资料信噪比较低的特点，以地震老资料和钻井资料为基础，建立地震地质模型，利用射线追踪技术选取合适的观测系统参数。充分利用卫星数字地图，没计了灵活多变的观测系统，采用可控震源与炸药震源配合使用方法，及时对城区内地下面元的覆盖次数、方位角和炮检距的分布进行质量监控，利用现场处理系统对资料进行及时分析，提高了地震资料品质。所获得的东营城区高精度三维地震采集资料显示，其浅中层分辨率和中深层信噪比都有了明显改善，取得了良好的地质效果。     

Application of the first internal transcribed spacer(ITS-1) of ribosomal DNA as a molecular marker to population analysis in farrer''s scallop Chlamys farreri

Sequence variation of the first internal transcribed spacer of ribosomal DNA （ ITS - 1 ） was examined and its application to the study of genetic variation was explored in four populations of farter＇ s scallop Chlamys farreri. ITS - 1 fragments, with a length of about 300 bp,of 78 individuals collected from Dalian, Qingdao, Yantai in China and Korea respectively were amplified via PCR, cloned and sequenced. Intra-genomic variation was examined by sequencing several clones of single individuals. Alignment and polymorphism analysis detected 44 haplotypes and 50 polymorphic sites which consist of 30 substitutions and 20 indels, indicating a high level of polymorphisms. Sequence analysis also showed a very low level of intra-individual variation. All these features validated the feasibility of application of ITS - 1 fragment to population analysis. Polymorphism analysis showed that the Korea sample has the richest genetic variation, followed by Yantai and Qingdao samples. AMOVA （analysis of molecular variance） showed that the majority （96.26%） of genetic variation was distributed within populations and 3.74% resulted from among populations, but with P 〈 0.05 （ = 0.042）, indicating that the populations in this study have significant divergence. This output was basically concordant with the result arising from RAPD data and different from that from mitochondrial 16S rDNA sequence data. Discussion on this inconsistency was made accordingly.     

遥感和GIS支持下的分布式融雪径流过程模拟研究

基于遥感(RS)和地理信息系统(GIS)技术,设计和构建了一个分布式融雪径流模型,整个分布式融雪径流过程的模拟计算基于能量平衡和水量平衡,由分布式栅格融雪过程、分布式栅格产流过程以及分布式栅格汇流过程组成,融雪以及产汇流过程全部基于栅格尺度,全面实现了融雪过程的分布式模拟.分布式栅格融雪过程中对"度日法"加以改进,引入了"单元时段"的概念,从而得到了"度分融雪模型";针对融雪过程中颇为复杂的冻融反复性难题,提出了旨在解释积雪冻融反复性物理机制的"冻融系数"的重要概念,对于准确把握融雪过程的物理机制具有重要意义.同时基于GIS开发了分布式融雪径流模拟系统,为分布式融雪径流模型的运行提供了平台和技术支持,二者均为融雪洪水预警决策支持系统的核心模块部分.基于由MODlS等遥感数据得到的积雪信息、地表温度等下垫面信息,基础地理信息数据如DEM及其空间分析数据和大量野外同步观测数据(积雪信息、气象数据),对典型研究区新疆军塘湖流域2006年春季典型融雪期(2006-03-06,11:00-2006-03-10,11:00)内的洪水过程进行了模拟,模拟结果精度较高,平均精度0.82,达到了融雪洪水预警预报的业务需求标准.     

空间信息网格中远程空间连接查询的优化

随着空间信息网格的建设,网格平台上管理的空间信息资源越来越丰富,这促进了空间信息网格中空间数据分布式查询的应用需求,而在分布式空间查询中,空间连接查询操作往往成为性能的瓶颈.根据空间信息的特点,通过利用网格计算资源来优化空间连接查询的执行.首先基于网格服务构建网格平台分布式空间数据查询软件结构,通过设计远程空间连接执行服务利用网格平台中的计算资源;根据空间信息的特点.采用基于Kd-Tree空间分区并行连接的方法提高远程空间数据连接操作执行效率,并给出了远程空间连接执行的查询代价模型;然后根据连接代价模型设计了远程空间连接查询执行计划优化生成算法;最后总结了本文工作并探讨了下一步研究方向.