| 一种基于分布式的雷达拼图处理系统框架 |
| |
| 引用本文： | 胡鹏宇,陈传雷,徐爽,严俊,侯婉婷.一种基于分布式的雷达拼图处理系统框架[J].气象科技,2022,50(5):630-635. |
| |
| 作者姓名： | 胡鹏宇 陈传雷 徐爽 严俊 侯婉婷 |
| |
| 作者单位： | 辽宁省气象灾害监测预警中心，沈阳 110166;辽宁省沈阳市气象局，沈阳 110168 |
| |
| 基金项目： | 辽宁省气象局科学技术项目(202204和2021SXB02)；沈阳市气象局科学技术项目(SY202102)共同资助 |
| |
| 摘 要： | 以TITAN(Thunderstorm Identification Tracking Analysis and Nowcasting)系统为基础框架,通过引入大数据处理技术,对系统中各个模块间的通信机制、数据处理和存储方式进行优化,结合中国气象科学研究院的雷达数据质量控制方法和高效的雷达数据解析和拼图方式,实现了辽宁省及周边地区10部雷达的同步观测和雷达组网拼图处理系统的实时运行和雷达产品的按需定制。该拼图处理系统能够实现雷达数据的流式传输;通过Kafka(分布式发布订阅消息系统)实现雷达数据的分布式处理;并通过采用Cassandra数据库存储,提高雷达数据存储的稳定性。
|
| 关 键 词： | 雷达拼图 流传输 Kafka分布式数据处理 |
| 收稿时间： | 2021/8/4 0:00:00 |
| 修稿时间： | 2022/4/28 0:00:00 |
A Radar Mosaic Framework Based on Kafka Distributed System |
| |
| HU Pengyu,CHEN Chuanlei,XU Shuang,YAN Jun,HOU Wanting.A Radar Mosaic Framework Based on Kafka Distributed System[J].Meteorological Science and Technology,2022,50(5):630-635. |
| |
| Authors: | HU Pengyu CHEN Chuanlei XU Shuang YAN Jun HOU Wanting |
| |
| Institution: | Liaoning Meteorological Disaster Monitoring and Early Warning Centre, Shenyang 110166;Shenyang Meteorological Administration, Shenyang 110168 |
| |
| Abstract: | Taking the TITAN system as the basic framework, by introducing big data processing technology, the communication mechanism, data processing and storage pattern are optimized. Based on the support of radar synchronous observation and real time transmission technology, a radar mosaic system for the ten radars in Liaoning Province and surrounding areas is developed. This radar synchronous observation and mosaic system can realize the streaming transmission of radar data. The distributed radar data processing is realized through the Kafka distributed system, and the stability of radar data storage is improved by using the Cassandra database. |
| |
| Keywords: | radar mosaic streaming transmission Kafka distributed system |
| 本文献已被 维普 等数据库收录！ |
| 点击此处可从《气象科技》浏览原始摘要信息 |
| 点击此处可从《气象科技》下载免费的PDF全文 |
|
