基于Spark Streaming的实时流数据处理模型化研究与实现

通过研究与分析,选取Spark Streaming技术实现对P实时流数据的处理.同时,研究出一套模型化的方式,实现动态装配软件的执行过程;并通过具体的实例展示了两者结合后,在数据处理的易用性、性能及吞吐量方面,都得到了大幅提升.     

遵义市冬末初春两次寒潮降雪天气过程对比分析

利用Micaps常规观测资料、NCEP/NCAR再分析资料、区域站加密观测资料,对遵义市2016年3月8—9日(过程Ⅰ)和2017年2月21—22日(过程Ⅱ)的两次寒潮降雪天气过程进行对比分析。结果表明:(1)500 h Pa横槽转竖和低槽东移是两次寒潮爆发的重要引导系统,过程Ⅰ属于横槽转竖型寒潮天气过程,过程Ⅱ寒潮属小槽发展型。(2)地面冷高压中心强度(冷源)及南下速度是预报寒潮的关键。(3)700 h Pa切变影响与降雪时段对应较好,在今后降雪预报中应作为重要影响系统加以关注。(4)湿层深厚,整层水汽含量高为降雪的显著特征。(5)有无融化层和融化层厚薄应作为降雪预报温度条件的关注重点。     

PolarGlobe: A web-wide virtual globe system for visualizing multidimensional,time-varying,big climate data

The increasing research interest in global climate change and the rise of the public awareness have generated a significant demand for new tools to support effective visualization of big climate data in a cyber environment such that anyone from any location with an Internet connection and a web browser can easily view and comprehend the data. In response to the demand, this paper introduces a new web-based platform for visualizing multidimensional, time-varying climate data on a virtual globe. The web-based platform is built upon a virtual globe system Cesium, which is open-source, highly extendable and capable of being easily integrated into a web environment. The emerging WebGL technique is adapted to support interactive rendering of 3D graphics with hardware graphics acceleration. To address the challenges of transmitting and visualizing voluminous, complex climate data over the Internet to support real-time visualization, we develop a stream encoding and transmission strategy based on video-compression techniques. This strategy allows dynamic provision of scientific data in different precisions to balance the needs for scientific analysis and visualization cost. Approaches to represent, encode and decode processed data are also introduced in detail to show the operational workflow. Finally, we conduct several experiments to demonstrate the performance of the proposed strategy under different network conditions. A prototype, PolarGlobe, has been developed to visualize climate data in the Arctic regions from multiple angles.     

黄河口清水沟流路的河床演变及其影响

黄河口清水沟流路先后经历了游荡型,顺直型和弯曲型和河床演变阶段。与此同时,河流的冲淤变化经历了摆动淤积,造床冲刷和延伸淤积三个阶段,这些变化对河床纵剖面,水位和险情带来了某些较深刻的影响。     

Zn, Pb, Cu and As distribution patterns in overbank and medium-order stream sediment samples: their use in exploration and environmental geochemistry

Overbank and medium-order stream sediment samples were collected in Belgium and Luxembourg from 66 sampling locations (area of about 33,000 km²) and analysed for major and trace elements among which Zn, Pb, Cu and As. At each sampling location large bulk samples were taken, namely in the lower (normally at ≥1.5 m depth, over an interval of about 20–40 cm) and upper (normally upper 5–25 cm) parts of the overbank profiles and from the stream sediments. Furthermore, at a number of these sites, a detailed geochemical analysis of vertical overbank sediment profiles (sampling intervals of 10–20 cm) was subsequently carried out to unravel element variations through time and to help in the overall evaluation. For most sampled sections evidences such as ¹⁴C-dating and the absence of anthropogenic particles point towards a pre-industrial and often pristine origin of the lower overbank sediment samples. From the latter bulk samples, mean background concentrations were deduced. They reveal the existence of significant differences between the northern and southern part of Belgium (incl. Luxembourg) which relate to the difference in geological substrate. In the north dominantly non-lithified Quaternary and Tertiary sands, marls and clays occur while in the south Palaeozoic sandstones, shales and carbonate rocks outcrop. Consequently separate mean background values were calculated for the two areas. In the southern study area, some anomalous metal concentrations have been recorded in pre-industrial sediments. They are derived from mineralised Palaeozoic rocks, a feature which could be of interest for base metal exploration. In the upper overbank and stream sediments, in general, higher heavy metal and As contents were recorded with highest values in areas with metal mining, metal melting and cokes treatment industries. By comparing the trace element concentrations of the upper overbank or stream sediment samples with the concentrations detected in the lower overbank samples at each of the sampling locations, and by evaluating the vertical distribution patterns where available, the degree of pollution of the alluvial plain and the present-day stream sediments can be assessed. From this exercise, it is clear that highest pollution occurs in the northern part of Belgium, which relates to its high population density and industrial development.     

Towards a quantitative model of downstream dilution of point source geochemical anomalies

The quantitative relation between point source soil geochemical anomalies and their response in stream sediments is linked through the concept of productivity (area × concentration). The equation proposed by Hawkes in 1976 is shown to be a subset of a wider range of equations proposed by Russian workers. These workers introduced two coefficients to account for the contrasting behaviour of different elements and the position of the soil anomaly within the drainage catchment. The calculation of these coefficients requires a series of samples downstream from the ending of anomalous soil input. The concept of productivity has particular application where multiple samples and anomalies are present in catchments. Plotting of productivity allows the discrimination of anomalous areas not detectable from raw element concentrations. The usefulness of these techniques is demonstrated from a small detailed stream sediment survey in NW Scotland. Dispersion from a gossan shows deviation from the Hawkes equation with the result that detailed sampling is required to detect soil anomalies. Plotting productivity allows the detection at the base of major slopes of anomalies that are diluted by upslope sediment.     

Wood and sediment storage and dynamics in river corridors

Large wood along rivers influences entrainment, transport, and storage of mineral sediment and particulate organic matter. We review how wood alters sediment dynamics and explore patterns among volumes of in‐stream wood, sediment storage, and residual pools for dispersed pieces of wood, logjams, and beaver dams. We hypothesized that: volume of sediment per unit area of channel stored in association with wood is inversely proportional to drainage area; the form of sediment storage changes downstream; sediment storage correlates with wood load; the residual volume of pools created in association with wood correlates inversely with drainage area; and volume of sediment stored behind beaver dams correlates with pond area. Lack of data from larger drainage areas limits tests of these hypotheses, but the analyses suggest that sediment volume correlates positively with drainage area and wood volume. The form of sediment storage in relation to wood appears to change downstream, with wedges of sediment upstream from jammed steps most prevalent in small, steep channels and more dispersed sediment storage in lower gradient channels. Pool volume correlates positively with wood volume and negatively with channel gradient. Sediment volume correlates well with beaver pond area. More abundant in‐stream wood and beaver populations present historically equated to greater sediment storage within river corridors and greater residual pool volume. One implication of these changes is that protecting and re‐introducing wood and beavers can be used to restore rivers. This review of the existing literature on wood and sediment dynamics highlights the lack of studies on larger rivers. Copyright © 2016 John Wiley & Sons, Ltd.     

A multicatchment analysis of headwater and downstream temperature effects from contemporary forest harvesting

Stream temperature is a key physical water‐quality parameter, controlling many biological, chemical, and physical processes in aquatic ecosystems. Maintenance of cool stream temperatures during summer is critical for high‐quality aquatic habitat. As such, transmission of warm water from small, nonfish‐bearing headwater streams after forest harvesting could cause warming in downstream fish‐bearing stream reaches with negative consequences. In this study, we evaluate (a) the effects of contemporary forest management practices on stream temperature in small, headwater streams, (b) the transmission of thermal signals from headwater reaches after harvesting to downstream fish‐bearing reaches, and (c) the relative role of lithology and forest management practices in influencing differential thermal responses in both the headwater and downstream reaches. We measured summer stream temperatures both preharvest and postharvest at 29 sites—12 upstream sites (4 reference, 8 harvested) and 17 downstream sites (5 reference, 12 harvested)—across 3 paired watershed studies in western Oregon. The 7‐day moving average of daily maximum stream temperature (T_7DAYMAX) was greater during the postharvest period relative to the preharvest period at 7 of the 8 harvested upstream sites. Although the T_7DAYMAX was generally warmer in the downstream direction at most of the stream reaches during both the preharvest and postharvest period, there was no evidence for additional downstream warming related to the harvesting activity. Rather, the T_7DAYMAX cooled rapidly as stream water flowed into forested reaches ~370–1,420 m downstream of harvested areas. Finally, the magnitude of effects of contemporary forest management practices on stream temperature increased with the proportion of catchment underlain by more resistant lithology at both the headwater and downstream sites, reducing the potential for the cooling influence of groundwater.     

冕洞与太阳风高速流关系的统计研究:到达时间、持续时间和峰值强度

冕洞是太阳风高速流的源区.当冕洞出现在中低纬区域时,太阳风高速流会扫过地球并引发地球空间环境扰动,如地磁暴和高能电子暴等.在太阳活动周下降年和低年,这种类型的扰动占据主导地位.因此,冕洞高速流的到达时间、峰值时间、峰值强度和持续时间等,是空间天气预报的重要内容.本文基于2010年5月到2016年12月的SDO/AIA太阳极紫外图像以及1AU处ACE和WIND卫星的太阳风观测数据,确定了160个冕洞-太阳风高速流事件,定量计算了他们的特征参数,包括冕洞与太阳风高速流的开始时间、峰值时间、峰值强度和结束时间,分析了各个特征参数的分布规律,对冕洞-高速流之间的关系进行了统计研究,并提出了一种新的预报方法,为基于冕洞成像观测的太阳风高速流的精准预报提供了依据.     

Modelling regional effects of artificial groundwater recharge in a multilayer aquifer characterized by perched water tables

This paper presents an approach to estimate the effects of a managed recharge experiment in a multilayer aquifer characterized by the presence of perched water tables in the Medina del Campo groundwater body, Douro basin, central Spain. A numerical model was developed to evaluate the effect of artificial recharge on the shallow sector of a regional-scale aquifer and on formerly active wetlands. The model was developed in the Visual MODFLOW Pro v.2011.1 environment in order to represent and analyse the regional impact of this artificial recharge event. Results suggest that the assumption of a single perched system may prove useful in regional contexts where data is limited. From a study site perspective, managed recharge is observed to increase shallow storage along the riverbanks, which is considered valuable for environmental purposes. However, downstream wetlands are unlikely to experience a significant recovery. Furthermore, only a small percentage of artificial recharge is expected to reach the deep regional aquifer. This method can be exported to settings characterized by the presence of perched aquifers and associated groundwater dependent ecosystems.