基于消息的气象数据处理系统运维自动化初探

目前气象大数据云平台(天擎)系统庞大且数据种类繁多,而现有的监控止步于数据消息积压后的告警。本文通过jQuery技术研究Rabbit消息,在消息粒度上获取消息积压信息,实现自动处理相应数据的解码程序,开拓了自动运维业务,在一定程度上减轻了运维压力,提高工作效率。尤其在长时间没有收到消息告警时,缩短排查故障时间。对于省级自动化运维,具有较强的参考和推广价值。

First Exploration on Message-Based Data Processing System Of Meteorological Data

At present, the Tianqing system is huge and has a wide variety of data, and the existing monitoring is limited to the alarm after the backlog of data messages. This paper studies Rabbit messages through jQuery technology, obtains the message backlog information at the message granularity, realizes the decoding program that automatically processes the corresponding data, develops the automatic operation and maintenance business, reduces the operation and maintenance pressure to a certain extent, and improves the work efficiency. Especially when no message alarm is received for a long time, the troubleshooting time is shortened. For provincial automatic operation and maintenance, it has strong reference and promotion value.