Comparison of Statistical Post-Processing Methods for Probabilistic Wind Speed Forecasting

In this study, the statistical post-processing methods that include bias-corrected and probabilistic forecasts of wind speed measured in PyeongChang, which is scheduled to host the 2018 Winter Olympics, are compared and analyzed to provide more accurate weather information. The six post-processing methods used in this study are as follows: mean bias-corrected forecast, mean and variance bias-corrected forecast, decaying averaging forecast, mean absolute bias-corrected forecast, and the alternative implementations of ensemble model output statistics (EMOS) and Bayesian model averaging (BMA) models, which are EMOS and BMA exchangeable models by assuming exchangeable ensemble members and simplified version of EMOS and BMA models. Observations for wind speed were obtained from the 26 stations in PyeongChang and 51 ensemble member forecasts derived from the European Centre for Medium-Range Weather Forecasts (ECMWF Directorate, 2012) that were obtained between 1 May 2013 and 18 March 2016. Prior to applying the post-processing methods, reliability analysis was conducted by using rank histograms to identify the statistical consistency of ensemble forecast and corresponding observations. Based on the results of our study, we found that the prediction skills of probabilistic forecasts of EMOS and BMA models were superior to the biascorrected forecasts in terms of deterministic prediction, whereas in probabilistic prediction, BMA models showed better prediction skill than EMOS. Even though the simplified version of BMA model exhibited best prediction skill among the mentioned six methods, the results showed that the differences of prediction skills between the versions of EMOS and BMA were negligible.     

Comparison of projection skills of deterministic ensemble methods using pseudo-simulation data generated from multivariate Gaussian distribution

The projection skills of five ensemble methods were analyzed according to simulation skills, training period, and ensemble members, using 198 sets of pseudo-simulation data (PSD) produced by random number generation assuming the simulated temperature of regional climate models. The PSD sets were classified into 18 categories according to the relative magnitude of bias, variance ratio, and correlation coefficient, where each category had 11 sets (including 1 truth set) with 50 samples. The ensemble methods used were as follows: equal weighted averaging without bias correction (EWA_NBC), EWA with bias correction (EWA_WBC), weighted ensemble averaging based on root mean square errors and correlation (WEA_RAC), WEA based on the Taylor score (WEA_Tay), and multivariate linear regression (Mul_Reg). The projection skills of the ensemble methods improved generally as compared with the best member for each category. However, their projection skills are significantly affected by the simulation skills of the ensemble member. The weighted ensemble methods showed better projection skills than non-weighted methods, in particular, for the PSD categories having systematic biases and various correlation coefficients. The EWA_NBC showed considerably lower projection skills than the other methods, in particular, for the PSD categories with systematic biases. Although Mul_Reg showed relatively good skills, it showed strong sensitivity to the PSD categories, training periods, and number of members. On the other hand, the WEA_Tay and WEA_RAC showed relatively superior skills in both the accuracy and reliability for all the sensitivity experiments. This indicates that WEA_Tay and WEA_RAC are applicable even for simulation data with systematic biases, a short training period, and a small number of ensemble members.     

基于TIGGE多模式集合的24小时气温BMA 概率预报

利用TIGGE(THORPEX Interactive Grand Global Ensemble)单中心集合预报系统(ECMWF、United Kingdom Meteorological Office、China Meteorological Administration和NCEP)以及由此所构成的多中心模式超级集合预报系统24小时地面日均气温预报,结合淮河流域地面观测率定贝叶斯模型平均(Bayesian model averaging,BMA)参数,从而建立地面日均气温BMA概率预报模型.由此针对淮河流域进行地面日均气温BMA概率预报及其检验与评估,结果表明BMA模型比原始集合预报效果好;单中心的BMA概率预报都有较好的预报效果,其中ECMWF最好.多中心模式超级集合比单中心BMA概率预报效果更好,采用可替换原则比普通的多中心模式超级集合BMA模型计算量小,且在上述BMA集合预报系统中效果最好.它与原始集合预报相比其平均绝对误差减少近7%,其连续等级概率评分提高近10%.基于采用可替换原则的多中心模式超级集合BMA概率预报,针对研究区域提出了极端高温预警方案,这对防范高温天气有着重要意义.     

Development of the Expert Seasonal Prediction System: an Application for the Seasonal Outlook in Korea

An Expert Seasonal Prediction System for operational Seasonal Outlook (ESPreSSO) is developed based on the APEC Climate Center (APCC) Multi-Model Ensemble (MME) dynamical prediction and expert-guided statistical downscaling techniques. Dynamical models have improved to provide meaningful seasonal prediction, and their prediction skills are further improved by various ensemble and downscaling techniques. However, experienced scientists and forecasters make subjective correction for the operational seasonal outlook due to limited prediction skills and biases of dynamical models. Here, a hybrid seasonal prediction system that grafts experts’ knowledge and understanding onto dynamical MME prediction is developed to guide operational seasonal outlook in Korea. The basis dynamical prediction is based on the APCC MME, which are statistically mapped onto the station-based observations by experienced experts. Their subjective selection undergoes objective screening and quality control to generate final seasonal outlook products after physical ensemble averaging. The prediction system is constructed based on 23-year training period of 1983–2005, and its performance and stability are assessed for the independent 11-year prediction period of 2006–2016. The results show that the ESPreSSO has reliable and stable prediction skill suitable for operational use.     

集合模式定量降水预报的统计后处理技术研究综述

集合数值模式预报已在定量降水预报业务中广泛应用,以获得预报不确定性、最可能预报结果以及极端天气预警。由于集合系统的数值模式不完善,且不能提供所有的不确定性信息,常表现出系统性偏差以及欠离散或过离散（如对于多模式集合）。为此,需要发展统计后处理技术,在尽量保持集合预报解析度的条件下,提高预报的技巧和可靠性。近年来,各种集合预报统计后处理技术得到快速发展。针对定量降水预报,依据技术方法的途径和成熟度将后处理研究归纳为3方面进行总结,包括:（1）不基于统计模型的非参数化后处理,包括集合定量降水预报偏差订正、多成员或模式信息集成以及基于空间分析的对流尺度模式后处理;（2）基于概率分布统计模型的参数化后处理,包括集合模式输出统计和贝叶斯模型平均两种方法框架;（3）考虑预报量的时间、空间和多变量间依赖关系或结构的处理方法,包括参数化和经验连接概率法。最后,讨论发展统计后处理技术需要关注的问题,包括考虑不同来源、不同尺度的多模式信息集成;提供高质量、高分辨率的降水分析资料;发展再预报技术扩充训练样本;基于不同的订正目的和应用场景来使用不同的后处理技术;发展面向海量预报数据、捕捉极端降水以及考虑预报量结构的新技术。      

东亚地区冬季地面气温延伸期概率预报研究

利用TIGGE资料中的ECMWF、NCEP、UKMO三个中心集合预报系统以及由此构成的多中心集合预报系统所提供的地面2 m气温10~15 d延伸期集合预报产品,建立贝叶斯模式平均(Bayesian Model Averaging,BMA)概率预报模型,对东亚地区冬季地面气温进行延伸期概率预报研究。采用距平相关系数、均方根误差、布莱尔评分、等级概率评分等指标分别对BMA确定性结果与概率预报进行评估。结果表明,BMA方法明显地改进了原始集合预报结果,预报技巧优于原始集合预报,且多中心BMA预报优于单中心BMA预报,最佳滑动训练期取35 d。BMA预报为气温的延伸期概率预报提供了更合理的概率分布,定量描述了预报的不确定性。     

Comparison of prediction performance using statistical postprocessing methods

As the 2018 Winter Olympics are to be held in Pyeongchang, both general weather information on Pyeongchang and specific weather information on this region, which can affect game operation and athletic performance, are required. An ensemble prediction system has been applied to provide more accurate weather information, but it has bias and dispersion due to the limitations and uncertainty of its model. In this study, homogeneous and nonhomogeneous regression models as well as Bayesian model averaging (BMA) were used to reduce the bias and dispersion existing in ensemble prediction and to provide probabilistic forecast. Prior to applying the prediction methods, reliability of the ensemble forecasts was tested by using a rank histogram and a residualquantile-quantile plot to identify the ensemble forecasts and the corresponding verifications. The ensemble forecasts had a consistent positive bias, indicating over-forecasting, and were under-dispersed. To correct such biases, statistical post-processing methods were applied using fixed and sliding windows. The prediction skills of methods were compared by using the mean absolute error, root mean square error, continuous ranked probability score, and continuous ranked probability skill score. Under the fixed window, BMA exhibited better prediction skill than the other methods in most observation station. Under the sliding window, on the other hand, homogeneous and non-homogeneous regression models with positive regression coefficients exhibited better prediction skill than BMA. In particular, the homogeneous regression model with positive regression coefficients exhibited the best prediction skill.     

NINO3.4指数的多模式集合预报方法

基于贝叶斯模式平均方法(Bayesian Model Averaging),发展了一个NINO3.4指数的多模式客观权重集合预报方法(简称OBJ)。该方法基于训练期内单个模式的预报结果,用线性回归订正单个预报的偏差,依据模式的预报效果估计单个模式的权重。利用2002年2月—2015年10月美国哥伦比亚大学国际气候与社会研究所(IRI)提供的7个单一模式对NINO3.4指数的预报结果进行OBJ试验,并采用均方根误差对多模式集合平均预报(简称ENS)和OBJ的预报结果进行检验和评估。结果表明,ENS的预报效果优于7个单一模式的预报效果,而OBJ预报效果优于ENS预报效果,其NINO3.4指数的均方根误差比ENS方法降低了4%。将单一模式预报结果按时间划分为训练期和预报期,利用独立样本估计OBJ的参数并进行预报试验,这些试验也表明,OBJ能进一步提高预报精度。      

地面气象要素多模式集成预报研究进展

目前,集合预报已成为天气预报业务的主要支撑。然而,由于数值模式本身的限制与不完善以及集合系统存在初值扰动、集合大小等方面的局限,常存在预报偏差。不同预报模式通常具有不同的物理过程参数化方案、初始条件等,导致其预报能力各有不同。为此,如何纠正预报偏差以及如何充分有效地利用不同模式的预报信息以获得更加准确的天气预报广受关注。近年来,利用统计理论与预报诊断,基于多个集合预报系统的多模式集成预报技术得到快速发展,已成为有效消除预报偏差从而提高天气预报技巧的一种统计后处理方法。针对气温、降水和风3个最基本的地面气象要素,首先依据预报形式将应用范围较广的简单集合平均、消除偏差集合平均、超级集合、贝叶斯模式平均、集合模式输出统计等加权或等权平均多模式集成技术,分成确定性预报和概率预报两大类,并做系统介绍。最后,讨论使用和发展多模式集成技术需要关注的问题,包括考虑参与集成的模式个数、发展降水及风速分级预报模型和发展基于机器学习的多模式集成新技术。     

CMIP5多模式对东亚地区地面气温年际变率的回报研究

对CMIP5全球气候模式中年代际回报试验的气温资料及其简单集合平均(Multi-model ensemble mean,EMN)和贝叶斯模式平均的结果(Bayesian Model Averaging,BMA)进行经验正交函数(Empirical Orthogonal Function,EOF)分解和Morlet小波分析,检验评估各个模式及其EMN和BMA对东亚地面气温的方差、气温时空分布特征及周期变化的回报能力。结果表明,10个模式、EMN、BMA都能很好地回报出1981—2010年东亚地面气温的方差分布,其中BMA回报效果最好。EOF分析表明,BMA能较好地回报出东亚地面气温第一模态的时空分布。MIROC5能较好地回报出第二模态的趋势变化,但却不能回报出气温的年际变率。绝大多数模式和EMN、BMA虽然能回报出东亚地面气温的变化趋势,但是对气温年际变率的回报仍然是比较困难的。CMCC-CM对气温变化主模态的3~5 a的周期变化特征回报效果最好,和NCEP资料的结果最为接近。     

Assessment of the APCC coupled MME suite in predicting the distinctive climate impacts of two flavors of ENSO during boreal winter

Forecast skill of the APEC Climate Center (APCC) Multi-Model Ensemble (MME) seasonal forecast system in predicting two main types of El Niño-Southern Oscillation (ENSO), namely canonical (or cold tongue) and Modoki ENSO, and their regional climate impacts is assessed for boreal winter. The APCC MME is constructed by simple composite of ensemble forecasts from five independent coupled ocean-atmosphere climate models. Based on a hindcast set targeting boreal winter prediction for the period 1982–2004, we show that the MME can predict and discern the important differences in the patterns of tropical Pacific sea surface temperature anomaly between the canonical and Modoki ENSO one and four month ahead. Importantly, the four month lead MME beats the persistent forecast. The MME reasonably predicts the distinct impacts of the canonical ENSO, including the strong winter monsoon rainfall over East Asia, the below normal rainfall and above normal temperature over Australia, the anomalously wet conditions across the south and cold conditions over the whole area of USA, and the anomalously dry conditions over South America. However, there are some limitations in capturing its regional impacts, especially, over Australasia and tropical South America at a lead time of one and four months. Nonetheless, forecast skills for rainfall and temperature over East Asia and North America during ENSO Modoki are comparable to or slightly higher than those during canonical ENSO events.     

基于CMIP6模式优化集合平均预估21世纪全球陆地生态系统总初级生产力变化

利用国际耦合模式比较计划第六阶段(CMIP6)中18个地球系统模式总初级生产力(GPP)模拟数据,基于传统的多模式集合平均(MME)和可靠集合平均方法(REA),在4个未来情景(SSP1-2.6,SSP2-4.5,SSP3-7.0和SSP5-8.5)下预估了21世纪全球陆地生态系统GPP的变化量,并分析了GPP变化的驱动因子。研究结果表明：在4个未来情景下,基于REA方法预估的全球陆地生态系统年GPP在未来时期(2068—2100年)比历史时期(1982—2014年)分别增长了(14.85±3.32)、(28.43±4.97)、(37.66±7.61)和(45.89±9.21)Pg C,其增量大小和不确定性都明显低于MME方法。在4个情景下,大气CO₂浓度增长对GPP变化的贡献最大,基于REA方法计算的贡献占比分别为140%、137%、115%和75%;除SSP5-8.5(24%)外,其他情景下升温均导致全球陆地生态系统GPP降低(-42%、-37%、-16%),部分抵消了CO₂施肥效应的正面贡献。温度的影响存在纬度差异：升温在低纬度地区对GPP有负向贡献,在中高纬度地区为正向贡献。降水和辐射变化对GPP变化的贡献相对较小。     

Simulation of tropical cyclone activity over the western North Pacific based on CMIP5 models

Based on the Coupled Model Inter-comparison Project 5 (CMIP5) models, the tropical cyclone (TC) activity in the summers of 1965–2005 over the western North Pacific (WNP) is simulated by a TC dynamically downscaling system. In consideration of diversity among climate models, Bayesian model averaging (BMA) and equal-weighed model averaging (EMA) methods are applied to produce the ensemble large-scale environmental factors of the CMIP5 model outputs. The environmental factors generated by BMA and EMA methods are compared, as well as the corresponding TC simulations by the downscaling system. Results indicate that BMA method shows a significant advantage over the EMA. In addition, impacts of model selections on BMA method are examined. To each factor, ten models with better performance are selected from 30 CMIP5 models and then conduct BMA, respectively. As a consequence, the ensemble environmental factors and simulated TC activity are similar with the results from the 30 models’ BMA, which verifies the BMA method can afford corresponding weight for each model in the ensemble based on the model’s predictive skill. Thereby, the existence of poor performance models will not particularly affect the BMA effectiveness and the ensemble outcomes are improved. Finally, based upon the BMA method and downscaling system, we analyze the sensitivity of TC activity to three important environmental factors, i.e., sea surface temperature (SST), large-scale steering flow, and vertical wind shear. Among three factors, SST and large-scale steering flow greatly affect TC tracks, while average intensity distribution is sensitive to all three environmental factors. Moreover, SST and vertical wind shear jointly play a critical role in the inter-annual variability of TC lifetime maximum intensity and frequency of intense TCs.     

基于BMA方法的地面气温的10～15 d延伸期概率预报研究

利用TIGGE资料提供的欧洲中期天气预报中心(ECMWF)、美国国家环境预报中心(NCEP)、英国气象局(UKMO)三个预报中心2013年6月1日至8月31日的地面2 m气温10~15 d预报资料,对延伸期地面气温进行贝叶斯模式平均(Bayesian Model Averaging,BMA)预报试验。结果表明,BMA方法的预报效果随训练期长度而改变,训练期长度为30 d时预报效果最优。BMA方法可提供全概率密度函数,定量描述预报不确定性的大小,且陆地上预报不确定性大于海洋上的预报不确定性,高纬度地区预报不确定性大于低纬度地区的预报不确定性。利用CRPS评分对BMA概率预报技巧进行评估,发现预报技巧随预报时效的延长降低,且预报技巧在海洋上优于陆地、低纬度地区优于高纬度地区。此外,3 d、5 d和7 d滑动平均的预报值反映某些天气过程的平均要素预报,对于提高10~15 d延伸期概率预报技巧有一定效果,且滑动天数越长,预报效果越好。     

国家气候中心多模式解释应用集成预测

多模式集合和降尺度技术是提升模式预测能力的有效工具。该文对国家气候中心多模式解释应用集成预测 (MODES) 技术与业务应用现状进行了综合介绍。MODES采用欧洲中期天气预报中心、东京气候中心、美国国家环境预报中心和中国气象局国家气候中心4个气候业务季节预测模式输出场,利用EOF迭代、变形的典型相关分析、最优子集回归和高相关回归集成4种统计降尺度方法以及等权平均、经典超级集合等集成方法进行全国月及季节降水和气温预测。目前对MODES进行了夏季回报检验和约1年的实时业务应用。回报检验和业务应用表明,MODES对气温有较好的预测能力 (月预测平均PS评分为76),对降水有一定预测技巧 (月预测平均PS评分为68),具有短期气候预测业务应用价值。     

基于局地增长模培育法的对流可分辨尺度WRF模式对河南“21·7”特大暴雨的预报评估

基于WRF(Weather Research and Forecasting)模式,选取河南“21·7”特大暴雨事件,采用局地增长模培育法(Local Breeding Growth Mode,LBGM)生成对流尺度集合预报系统,在此基础上对24 h累积降水量进行SAL(Structure,Amplitude and Location)检验,结合预报成功指数(Threat Score,TS)、公平成功指数(Equitable Threat Score,ETS)评分等评分结果进行对比分析,综合评估集合预报成员的预报效果,表明:1)基于局地增长模培育法生成初始扰动的集合预报系统成员对于强降水预报有一定优势,在降水强度和位置的预报上与实况较接近;2)经检验,成员e003的TS和ETS评分在20日00时—21日00时(北京时,下同)和21日08时—22日08时两个强降水时段内表现最佳,并在SAL检验中对应较好的降雨强度A和雨区位置L,而成员e008暴雨TS、ETS评分最低,对应SAL检验中具有一定的位置偏差,即TS、ETS评分和SAL检验之间存在相关性,将二者有机结合,可以为业务工作中定量评估模式降水预报效果提供参考;3)通过对比整体评分表现较好的成员e003和较差的成员e008,两者预报的位势高度场与ERA5(ECMWF reanalysis v5,ERA5)再分析资料之间的差值,可以验证降水预报误差主要源于对低涡系统的预报偏差,同时预报评分较好的成员其位势高度偏差较小,综合评估效果更佳。     

Statistical Downscaling Prediction of Summer Precipitation in Southeastern China

A statistical downscaling approach based on multiple-linear-regression (MLR) for the prediction of summer precipitation anomaly in southeastern China was established, which was based on the outputs of seven operational dynamical models of Development of a European Multi-model Ensemble System for Seasonal to Interannual Prediction (DEMETER) and observed data. It was found that the anomaly correlation coefficients (ACCs) spatial pattern of June-July-August (JJA) precipitation over southeastern China between the seven models and the observation were increased significantly; especially in the central and the northeastern areas, the ACCs were all larger than 0.42 (above 95% level) and 0.53 (above 99% level). Meanwhile, the root-mean-square errors (RMSE) were reduced in each model along with the multi-model ensemble (MME) for some of the stations in the northeastern area; additionally, the value of RMSE difference between before and after downscaling at some stations were larger than 1 mm d-1. Regionally averaged JJA rainfall anomaly temporal series of the downscaling scheme can capture the main characteristics of observation, while the correlation coefficients (CCs) between the temporal variations of the observation and downscaling results varied from 0.52 to 0.69 with corresponding variations from -0.27 to 0.22 for CCs between the observation and outputs of the models.     

Predictability of the East Asian winter monsoon interannual variability as indicated by the DEMETER CGCMS

The interannual variability of East Asian winter monsoon(EAWM) circulation from the Development of a European Multi-Model Ensemble(MME) System for Seasonal to Inter-Annual Prediction(DEMETER) hindcasts was evaluated against observation reanalysis data.We evaluated the DEMETER coupled general circulation models(CGCMs)’ retrospective prediction of the typical EAWM and its associated atmospheric circulation.Results show that the EAWM can be reasonably predicted with statistically significant accuracy,yet the major bias of the hindcast models is the underestimation of the related anomalies.The temporal correlation coefficient(TCC) of the MME-produced EAWM index,defined as the first EOF mode of 850hPa air temperature within the EAWM domain(20-60 N,90-150 E),was 0.595.This coefficient was higher than those of the corresponding individual models(range:0.39-0.51) for the period 1969-2001;this result indicates the advantage of the super-ensemble approach.This study also showed that the ensemble models can reasonably reproduce the major modes and their interannual variabilities for sea level pressure,geopotential height,surface air temperature,and wind fields in Eurasia.Therefore,the prediction of EAWM interannual variability is feasible using multimodel ensemble systems and that they may also reveal the associated mechanisms of the EAWM interannual variability.     

2009年夏季西太平洋台风路径和强度的多模式集成预报

基于TIGGE资料中的中国气象局、欧洲中期天气预报中心、日本气象厅和英国气象局等四个中心的2009年5月1日-8月31日台风预报资料,利用多模式集合平均、消除偏差集合平均和加权消除偏差集合平均等方法,对2009年8月1-31日预报期的西太平洋的台风路径和强度(中心气压)进行24～ 72 h预报时效的多模式集成预报,并对0907号台风“天鹅”和0908号台风“莫拉克”进行个例分析.结果表明:各中心对于不同时效的预报,预报技巧有明显差异.消除偏差集合平均与加权消除偏差集合平均显著地减小了预报误差,预报效果优于最好的单个中心预报和多模式集合平均.对于24 ～ 72 h预报,加权消除偏差集合平均方法始终表现出最好的预报性能.     

基于CMIP5资料的东亚夏季环流的BMA预测研究

利用CMIP5的17个全球气候系统模式对500 hPa位势高度场的年代际回报结果,采用距平相关系数、均方根误差、平均绝对误差及连续等级概率评分4种指标,评估了贝叶斯模式平均(Bayesian model average,BMA)预报方法对东亚夏季环流的回报能力,并与最优单模式MIROC5和多模式简单集合平均结果进行了比较。结果表明,BMA方法对东亚夏季500 hPa位势高度场的回报效果是最好的,优于最优单模式MIROC5和简单集合平均的回报结果。BMA模型能产生高集中度的概率密度函数,并包含了多模式集成回报不确定性的定量估计。此外,BMA方法对西太平洋副热带高压的年际变率也有较好的回报效果,对西太平洋副热带高压的预报,选取60~70%概率下的结果更为合理。