Hadoop环境下基于SparkSQL海量自动站数据查询统计初探

在Hadoop分布式计算和存储架构下,自定义ETL数据清洗规则将海量自动站小时单站文件按所属年和站号合并为大文件流转存储至HDFS中,并运用SparkSQL并行计算框架进行统计处理生成常用气象要素日统计值。结果表明,数据处理和获取时效较关系型数据库方式有显著提升。采用SparkSQL并行计算框架对多气象要素多站点和长时间序列进行数据统计处理查询均能达到秒级别响应,并随着统计站点数的不断增加和时间跨度的延长其优势更为明显,能更高效地支撑此类气象数据服务,为海量气象数据处理从关系型数据库到大数据分布式架构的转换处理提供了新思路。     

电子信息系统防雷分单元防护思想简析

由于各种行业、各个电子信息系统的多样性、复杂性,其防雷设计往往很难做到合理、全面和完整。在十一届全运会防雷工程实践过程中,采用“分单元防护思想”对场馆及运动员村电子信息系统进行雷电防护,解决了电子信息系统综合雷电防护工程中漏防、重复防护或错防的问题。     

IKONOS影像在矿山环境遥感监测中的应用——以白银煤矿区为例

选取以地下开采方式为主的白银煤矿区为研究区,以IKONOS卫星影像数据为主要信息源,在遥感解译与野外验证的基础上,对研究区内矿山环境的现状进行了分析。研究表明IKONOS融合图像对于煤矿区的监测效果理想,较好地实现了对矿业活动占地情况、矿山地质灾害以及矿山周边环境的监测。     

中国上市公司的时空变化及机制研究

针对在中国地区发展不均衡的态势下,上市公司分布格局时空演变问题,该文对2009-2017年中国大陆各省上市公司的数量和总资产采用Local Moran’s I指数与Getis-Ord Gi*统计量进行研究,分析了中国大陆上市公司的空间分布格局和时间演变趋势,总结出中国上市公司相关指标的高值聚集和高低聚集分布格局、热点区域及其经济辐射能力。并且以北京、上海和广东为热点区域典型代表,从上市公司产业结构和区域经济发展两方面对时空变化机制的成因进行深入探讨。     

论环境流场切应变率对台风移动的作用

利用浅水波正压环境流场切应变率对台风移动的影响，得到的结果是：在环境流场切应变率空间不均匀条件下，正切应变率引起的台风偏差路径比负切应变率引起的偏差路径要长，特别在正切应变率的区域，正切应变率要比相对涡度梯度对台风移动有更大的影响。     

盆地模拟技术中的化学动力学生烃模型与应用

油气地表化探数据的失真(特别是数据中的高值失真点)直接影响到化探异常圈定。本文根据油气地表化探数据的分布特点，利用概率统计原理，提出一种适合油气化探资料前期处理的失真数据的概率判定方法和处理手段，在对实际资料的应用中，取得了良好的效果。     

Defining the range of ecological shelter zones in the shore zone of Three Gorges Reservoir,China

To maintaining a health ecological environment in Three Gorges Reservoir (TGR) area, ecological shelter zones (ESZ) need to be built in the TGR shore zone urgently. Based on the implication and function of ESZ, this study first analyzed the relationships amongst three subsystems of the TGR area, including the upstream production-living land, the downstream reservoir water body, and the ESZ. Then a simple and practical hydrological environment model for controlling the eutrophication of the TGR water body was constructed to determine ESZ range of TGR. Additionally, based on the pollutant degradation efficiency of ESZ and the assimilative capacity of reservoir water body, a raster reverse tracking method was proposed to determine the range of ESZ. Thirdly, take Yangdu town in Zhongxian county as a typical region, the ESZ range under three scenarios of different rainfall intensity, degradation efficiency and inflow water quality that corresponding to the three decisive factors of defining ESZ range were discussed. Finally, the statistical laws of the ESZ’s width at each boundary points were discussed to facilitate the ESZ construction projects, and selected standardized rate at 70, 90, and 99 % were labelled as “General”, “Good” and “Excellent” level to represent the performance of the width of the ESZ range. In conclusion, it suggest “Good” level width as basic width of ESZ, and additionally a special protection zone should be put on upstream environment for the extreme large width at the boundary points.     

Seismic fracture evaluation of diaphragm joints in welded beam-to-box column moment connections

Steel box columns are widely used in steel building structures in Taiwan due to their dual strong axes. To transfer the beam-end moment to the column, diaphragm plates of the same thickness and elevations as the beam flanges are usually welded inside the box column. The electro-slag welding (ESW) process is widely used to connect the diaphragms to the column flanges in Taiwan because of its convenience and efficiency. However, ESW may increase the hardness of the welds and heat-affected zones (HAZs), while reducing the Charpy-V notch strength in the HAZ. This situation can cause premature fracture of the diaphragm-to-column flange welds before a large plastic rotation is developed in the beam-to-box column joints. To quantify the critical eccentricity and the effectiveness of fracture prediction, this study uses fracture prediction models and finite element model (FEM) analysis to correlate the test results. In this study, two beam-to-box column connection subassembly tests are conducted with different loading protocols and ESW chamber shapes. To implement a fracture prediction model, the material parameters are established from circumferential notched tensile tests and FEM analysis. Test results indicate that the fracture instances can be predicted on the basis of the cumulative plastic deformation in the HAZs. Analytical results indicate that fracture instances and locations are sensitive to the relative locations of the ESW joints and beam flange. Tests also confirm that the possible fracture of the diaphragm-to-column flange joints can be mitigated by enlarging the chamber of the ESW joint.     

二郎山公路隧道岩爆特征与预测研究

根据二郎山公路隧道施工中记录的200多次岩爆资料,总结隧道的岩爆特征,并采用"地质超前预报法"和"σθ/Rb判据现场测定预测法"两种方法,对岩爆预测问题进行有益探讨.     

Simulation of spatially correlated earthquake ground motions for engineering purposes

A new model to simulate spatially correlated earthquake ground motions is developed. In the model, the main factors that characterize three distinct effects of spatial variability, namely, the incoherency effect, the wave-passage effect and the site-response effect, are taken into account, and corresponding terms/parameters are incorporated into the well known model of uniform ground motions. Some of these terms/parameters can be determined by the root operation, and others can be calculated directly. The proposed model is fi rst verif ied theoretically, and examples of ground motion simulations are provided as a further illustration. It is proven that the ensemble expected value and the ensemble auto-/cross-spectral density functions of the simulated ground motions are identical to the target spectral density functions. The proposed model can also be used to simulate other correlated stochastic processes, such as wave and wind loads.