山东省地质资料集成与应用研究

地质资料是极其宝贵的信息资源,也是开展地质工作的重要基础,利用大数据、云计算等技术,对地质成果资料进行集成与应用,有助于发挥地质成果资料的最大效能。通过全面系统收集山东省所有地质资料成果数据、成果图件、相关科研报告和地质论文,进行纸质资料扫描建库,利用ETL工具完成多源异构地质资料数据整合,完成山东省地质资料成果集成工作;研发"地质资料数据服务系统",实现地质资料共享应用,系统结合云平台的设计思路,采用SOA架构,基于Hadoop和Spark进行搭建,支持数据库、文件等多源数据导入,提供地质资料空间数据查询检索、资料数据统计、空间分析、数据发布等功能,为不同专题的地质系统产品提供基础服务。地质资料数据服务系统为建立山东省"地质云"奠定基础。

Study on Integration and Application of Geological Data in Shandong Province

Geological data is not only rare information resource, but also the basis for carrying out geological work. Based on big data and cloud computing technology, integration and application of geological data have been carried out. It can elaborate the best efficiency of geological information. Through systematic and comprehensive collection of all kinds of geological data, achievements, maps, related scientific research reports and geological papers of Shandong province, paper data scanning database construction has been carried out. Based on ETL tools, integration of multi-source heterogeneous geological data can be realized, and geological data and geological achievements can be collected. Study and development on the "service system of geological data" can realize the sharing of geological information. This systm is set up combining with the design idea of cloud platform, using SOA, and based on Hadoop and Spark. It can support multi-source data import of database and files, provide spatial data query, data statistics, spatial analysis, data release and other functions, and provide basic services for products of different special geological system. Geological data service system lays the foundation for the establishment of "geological cloud" in Shandong province.