| MapReduce在气象数据传输时效统计中的应用 |
| |
| 引用本文： | 赵文芳,刘旭林,桑雪竹,王鳞春.MapReduce在气象数据传输时效统计中的应用[J].南京气象学院学报,2018,10(2):238-243. |
| |
| 作者姓名： | 赵文芳 刘旭林 桑雪竹 王鳞春 |
| |
| 作者单位： | 北京市气象信息中心, 北京, 100089,北京市气象探测中心, 北京, 100089,北京市气象信息中心, 北京, 100089,内蒙古气象信息中心, 呼和浩特, 010051 |
| |
| 基金项目： | 公益性行业（气象）科研专项（GYHY201206031） |
| |
| 摘 要： | 气象数据的传输时效保障已成为探测和信息部门的重要工作之一，快速统计各类数据到报率和及时率成为一项迫切需求.基于MapReduce编程模型设计了各类数据到报率和及时率的算法，在Hadoop平台上利用该算法实现了各类数据的逐日到报率和及时率的统计，选择文本方式和Sequence File方式作为MapReduce计算模型的输入数据源进行对比试验.试验结果表明，Sequence File作为数据源能更好地提升MapReduce并行运算的性能.
|
| 关 键 词： | MapReduce 数据传输 时效 到报率 及时率 |
| 收稿时间： | 2016/4/8 0:00:00 |
Application of MapReduce in the statistic of meteorological data transferring efficiency |
| |
| ZHAO Wenfang,LIU Xulin,SANG Xuezhu and WANG Linchun.Application of MapReduce in the statistic of meteorological data transferring efficiency[J].Journal of Nanjing Institute of Meteorology,2018,10(2):238-243. |
| |
| Authors: | ZHAO Wenfang LIU Xulin SANG Xuezhu and WANG Linchun |
| |
| Institution: | Beijing Meteorological Information Center, Beijing 100089,Beijing Meteorological Observation Center, Beijing 100089,Beijing Meteorological Information Center, Beijing 100089 and Inner Mongolia Meteorological Information Center, Hohhot 010051 |
| |
| Abstract: | The rapid statistic of the efficiency of meteorological data transferring has become a pressing need for information center of Beijing Meteorological Bureau.In order to improve the transferring efficiency of meteorological data, an algorithm was designed based on MapReduce model for statistics of the arriving ratio and timely rate of meteorological data.The algorithm was then realized on Hadoop platform and comparative experiments were done using text file and Sequence File as input source data.Results show that the MapReduce-based algorithm performs better with Sequence File data.Compared with traditional statistic processes, the proposed algorithm is high in effectiveness and simple in process flow, thus is feasible and applicable for statistic of meteorological data transferring efficiency. |
| |
| Keywords: | MapReduce data transferring efficiency arriving ratio timely rate |
|
| 点击此处可从《南京气象学院学报》浏览原始摘要信息 |
| 点击此处可从《南京气象学院学报》下载免费的PDF全文 |
|
