基于Python的“地理处理”并行方案

在传统方式下,ArcGIS地理处理工具的执行过程不能充分利用高性能多核计算机的全部运算能力处理日益增加的地理数据,导致数据处理效率低下。本文在分析地理处理工具特点的基础上,充分利用Python语言的并行编程特点,构建具有通用性的地理处理任务并行运行解决方案。结合ArcGIS软件自身的特质,有效解决了并行运行所带来的数据竞争、数据共享与进程通讯等问题,达到了一定硬件环境条件下ArcGIS工具执行效率最大化的目的。通过典型地理处理任务中不同运行方式效率的对比测试与分析,证明了并行运行的有效性。

Parallel Geoprocessing Execution Scheme Based on Python

The traditional executive mode of ArcGIS geoprocessing tool could not make full use of the computing power of current HPC,which caused the inefficiency in GIS data processing.In this paper,a general scheme,which was powered by the Python parallel programming technology was built to use the whole computing power based on the analysis of GP tool.With the solution of data contention,data sharing and inter-process communication,as well as the combination with the trait of ArcGIS,the scheme could maximize the execution efficiency under the giving hardware condition.The contrast test of four executive modes in one typical geoprocessing task was carried,which validated the effectiveness of parallel execution scheme.