Hadoop环境下基于SparkSQL海量自动站数据查询统计初探

在Hadoop分布式计算和存储架构下,自定义ETL数据清洗规则将海量自动站小时单站文件按所属年和站号合并为大文件流转存储至HDFS中,并运用SparkSQL并行计算框架进行统计处理生成常用气象要素日统计值。结果表明,数据处理和获取时效较关系型数据库方式有显著提升。采用SparkSQL并行计算框架对多气象要素多站点和长时间序列进行数据统计处理查询均能达到秒级别响应,并随着统计站点数的不断增加和时间跨度的延长其优势更为明显,能更高效地支撑此类气象数据服务,为海量气象数据处理从关系型数据库到大数据分布式架构的转换处理提供了新思路。     

未来东北地区农业气候资源的时空演变特征

研究采用NorESM1-M模式输出的气候情景资料驱动农业生态区模型,分析了21世纪中期在RCP 2.6和RCP8.5典型浓度路径下的东北区域气候资源变化。研究表明:在RCP2.6、RCP8.5两种气候变化情景下,东北区域年平均气温呈现升高趋势,≥10℃积温所反映的热量条件得到显著改善,以黑龙江省和辽中南积温的增加最为明显;受气温升高影响,2050s参考作物蒸散普遍增加。区域内降水总量略有增加,东北西部干旱地区状况略有改善,东部地区更加湿润;趋于暖湿的气候促使作物生长季延长,到21世纪中期,全区最长增加12.4天。     

超声波测风仪风速的不同算法误差分析

超声波测风仪与气象业务用风向标测风仪相比具有诸多优势,可为气象业务中风向风速观测急需解决的较多问题提供解决方案。为促成超声波风速仪尽早在气象部门业务应用,同时解决资料同化等问题,研究和选择适用于超声波测风仪的风速平均(平滑)算法显得极为重要。为此,从超声波测风仪测量原理出发,介绍了超声波测风仪获取数据的特点;利用台站获取的超声波测风仪风速的秒数据,采用不同时段、不同平均(平滑)方法,计算风速多种形式的平均值,通过统计、分析和比较,获得了标量和矢量不同算法下风速平均值的特性差异及其之间的误差,进一步验证了标量平均大于矢量平均的结论。通过对超声波测风仪的风速算法研究及其误差分析,对减小因算法带来的风速测量误差提供方法,同时探讨了超声波测风仪在气象业务使用的可能和方向。     

放牧对浑善达克沙地丘间低地植被群落及土壤的影响

为探究放牧对丘间低地植被群落及土壤的影响,分析了浑善达克沙地丘间低地在重度和轻度放牧下植被的地上生物量、物种重要值、物种丰富度、Shannon-Wiener多样性指数、Pielou均匀度指数、Simpson生态优势度指数及0~10 cm土壤中黏粒、粉粒、砂粒、有机碳和全氮含量。结果表明：（1）植被地上生物量、土壤黏粒、粉粒、砂粒、土壤有机碳和全氮含量在不同放牧程度下存在极显著差异（P<0.01）,物种丰富度、Shannon-Wiener多样性指数和Pielou均匀度指数在不同放牧程度下差异不显著（P>0.05）,Simpson生态优势度指数在不同放牧程度下差异显著（P<0.05）。（2）放牧区植被以禾本科为主,禾本科植被地上生物量占整个植被群落的54.88%~57.76%;重度放牧区植被地上生物量为63.59 g·m^-2,比轻度放牧区低26.61%。（3）羊草（Leymus chinensis）和狗尾草（Setaria viridis）是放牧区的优势种,其重要值依次为14.16%（重度放牧区）和19.10%（轻度放牧区）、13.40%（重度放牧区）和15.42%（轻度放牧区）,重度放牧下雾滨藜（Bassia dasyphylla）、克氏针茅（Stipa krylovii）和猪毛蒿（Artemisia scoparia）的重要值较显著高于轻度放牧区,而羊草则低于轻度放牧区。（4）重度放牧加剧了土壤沙漠化,使砂粒含量增加,草地生产力下降,土壤有机碳和全氮含量降低。     

浅谈测绘监理在第三次国土调查中的运用 ——以益阳市第三次国土调查监理为例

从1988年建设部颁布《关于开展建设监理工作的通知》算起,在我国工程建设领域推行工程监理制度已有三十多年历史.工程监理在工程建设过程中发挥了重要作用,我国目前在工程领域建立了完善的监理法规及标准体系,形成了较为完整的工程监理机制.但在测绘领域,全面推行测绘监理仍尚需时日,有待健全.湖南省各市州第三次国土调查项目引入了监...     

Methods Comparison for Microsatellite Marker Development： Different Isolation Methods, Different Yield Efficiency

Microsatellite markers have become one kind of the most important molecular tools used in various researches. A large number of microsatellite markers are required for the whole genome survey in the fields of molecular ecology, quantitative genetics and genomics. Therefore, it is extremely necessary to select several versatile, low-cost, efficient and time- and labor-saving methods to develop a large panel of microsatellite markers. In this study, we used Zhikong scallop (Chlamys farreri) as the target species to compare the efficiency of the five methods derived from three strategies for microsatellite marker development. The results showed that the strategy of constructing small insert genomic DNA library resulted in poor efficiency, while the microsatellite-enriched strategy highly improved the isolation efficiency. Although the mining public database strategy is time- and cost-saving, it is difficult to obtain a large number of microsatellite markers, mainly due to the limited sequence data of non-model species deposited in public databases. Based on the results in this study, we recommend two methods, microsatellite-enriched library construction method and FIASCO-colony hybridization method, for large-scale microsatellite marker development. Both methods were derived from the mi-crosatellite-enriched strategy. The experimental results obtained from Zhikong scallop also provide the reference for microsatellite marker development in other species with large genomes.     

BTEX异常对海域油气藏指示作用的研究

常规的油气化探方法一般是应用烷烃类作为油气勘探的基本指标,但是烷烃类易受人类活动和生物活动的干扰,使常规的化探技术在油气勘探中一直受到限制。人们开始考虑采用直接的生物标记化合物来预测油气藏,如芳烃系列中的苯系化合物苯(benzene)、甲苯(toluene)、乙苯(ethylbenzene)、二甲苯(xylem),简称BTEX。国内外研究表明,BTEX基本不受人类活动和生物活动的干扰,对油气藏具有良好的指示作用。依据南海某区的实测资料,采用自主研发的油气化探可视化评价软件进行数据处理,剥离背景异常,圈出有效的BTEX异常,并与靶区地层剖面进行了对比,结果证实了BTEX对海域油气藏具有良好的指示作用。     

钻井柱状图可视化查询系统的设计与实现

钻井柱状图是石油行业勘探开发最常用的一种图件。为了开发出灵活通用的钻井柱状图制作软件,为可视化分析提供良好基础,提出了“两库四类三层”系统设计方案,应用COM思想和模板定制技术,采用C#．net语言从底层进行了软件实现,所开发的软件模块具备一定的独立性和较好的通用性。     

Hematological changes in white spot syndrome virus-infected shrimp, Fenneropenaeus chinensis (Osbeck)

The pathological changes of hemocytes in the haemolymph and hepatopancreas were examined in experimentally and naturally WSSV (white spot syndrome virus) infected Fenneropenaeus chinensis. The results showed that the pathological manifestations of hemocytes were similar among moribund shrimps infected via injection, feeding and by nature. Firstly, the total hemocyte counts (THCs) in WSSV-infected shrimp were significantly lower than those in healthy shrimp. Secondly, necrotic, broken and disintegrated cells were often observed, and a typical hematolysis was present in the haemolymph smear of WSSV-infected shrimp. Thirdly, necrosis and typical apoptosis of hemocytes were detected with TEM in the peripheral haemolymph of WSSV-infected shrimp. Hyalinocytes and semi-granulocytes with masses of WSSVs in their nuclei often appeared, whereas no granular hemocytes with WSSV were found in the hepatopancreas of moribund infected shrimps. All our results supported that hemocytes were the main target cells of WSSV, and hyalinocytes and semigranular hemocytes seemed to be more favorable for WSSV infection in F. chinensis.