STUDY OF THE MODIFICATION OF MULTI-MODEL ENSEMBLE SCHEMES FOR TROPICAL CYCLONE FORECASTS

This study investigates multi-model ensemble forecasts of track and intensity of tropical cyclones over the western Pacific, based on forecast outputs from the China Meteorological Administration, European Centre for Medium-Range Weather Forecasts, Japan Meteorological Agency and National Centers for Environmental Prediction in the THORPEX Interactive Grand Global Ensemble (TIGGE) datasets. The multi-model ensemble schemes, namely the bias-removed ensemble mean (BREM) and superensemble (SUP), are compared with the ensemble mean (EMN) and single-model forecasts. Moreover, a new model bias estimation scheme is investigated and applied to the BREM and SUP schemes. The results showed that, compared with single-model forecasts and EMN, the multi-model ensembles of the BREM and SUP schemes can have smaller errors in most cases. However, there were also circumstances where BREM was less skillful than EMN, indicating that using a time-averaged error as model bias is not optimal. A new model bias estimation scheme of the biweight mean is introduced. Through minimizing the negative influence of singular errors, this scheme can obtain a more accurate model bias estimation and improve the BREM forecast skill. The application of the biweight mean in the bias calculation of SUP also resulted in improved skill. The results indicate that the modification of multi-model ensemble schemes through this bias estimation method is feasible.     

短期集合降水概率预报试验

以MM5模式作为试验模式, 通过选取不同的物理过程参数化方案产生8个集合成员, 分别用平均法、相关法和Rank法对2001年11月至2002年5月期间的22个降水个例进行短期集合降水概率预报试验。试验结果显示对小雨—大暴雨6类降水的概率预报, Rank法的综合预报效果明显好于相关法和平均法, 相关法的综合预报效果与平均法基本相同; 无论从均方误差角度还是从命中率和假警报率的相对大小角度, 对小雨、中雨、大雨和暴雨各量级以上降水的概率预报, Rank法的平均预报效果是三种方法中最好的, 相关法的平均预报效果与平均法相同; Rank法好于平均法的平均幅度从均方误差角度较大, 从命中率和假警报率的相对大小角度则较小。平均而言, 三种方法对各量级以上降水的概率预报都是有技巧预报, 对量级小的降水的概率预报技巧高于对量级大的降水的概率预报技巧。     

基于TIGGE资料的地面气温多模式超级集合预报

基于TIGGE资料, 采用均方根误差分别对欧洲中期天气预报中心、日本气象厅、美国国家环境预报中心和英国气象局4个中心集合预报的地面气温场集合平均结果进行检验评估, 比较各中心地面气温的预报效果。并利用超级集合、多模式集合平均和消除偏差集合平均3种方法对4个中心的地面气温预报进行集成, 同时对预报结果进行分析。结果表明: 2007年夏季日本气象厅与欧洲中期天气预报中心在北半球大部分地区预报效果最好, 各中心在不同地区预报效果不同。超级集合与消除偏差集合平均降低了预报误差, 预报效果优于最好的单个中心预报和多模式集合平均。对于较长的预报时效, 消除偏差集合平均表现出了更好的预报性能。     

Probabilistic prediction of Indian summer monsoon rainfall using global climate models

Probabilistic seasonal predictions of rainfall that incorporate proper uncertainties are essential for climate risk management. In this study, three different multi-model ensemble (MME) approaches are used to generate probabilistic seasonal hindcasts of the Indian summer monsoon rainfall based on a set of eight global climate models for the 1982–2009 period. The three MME approaches differ in their calculation of spread of the forecast distribution, treated as a Gaussian, while all three use the simple multi-model subdivision average to define the mean of the forecast distribution. The first two approaches use the within-ensemble spread and error residuals of ensemble mean hindcasts, respectively, to compute the variance of the forecast distribution. The third approach makes use of the correlation between the ensemble mean hindcasts and the observations to define the spread using a signal-to-noise ratio. Hindcasts are verified against high-resolution gridded rainfall data from India Meteorological Department in terms of meteorological subdivision spatial averages. The use of correlation for calculating the spread provides better skill than the other two methods in terms of rank probability skill score. In order to further improve the skill, an additional method has been used to generate multi-model probabilistic predictions based on simple averaging of tercile category probabilities from individual models. It is also noted that when such a method is used, skill of probabilistic forecasts is improved as compared with using the multi-model ensemble mean to define the mean of the forecast distribution and then probabilities are estimated. However, skill of the probabilistic predictions of the Indian monsoon rainfall is too low.     

A convection-allowing ensemble forecast based on the breeding growth mode and associated optimization of precipitation forecast

A convection-allowing ensemble forecast experiment on a squall line was conducted based on the breeding growth mode (BGM). Meanwhile, the probability matched mean (PMM) and neighborhood ensemble probability (NEP) methods were used to optimize the associated precipitation forecast. The ensemble forecast predicted the precipitation tendency accurately, which was closer to the observation than in the control forecast. For heavy rainfall, the precipitation center produced by the ensemble forecast was also better. The Fractions Skill Score (FSS) results indicated that the ensemble mean was skillful in light rainfall, while the PMM produced better probability distribution of precipitation for heavy rainfall. Preliminary results demonstrated that convection-allowing ensemble forecast could improve precipitation forecast skill through providing valuable probability forecasts. It is necessary to employ new methods, such as the PMM and NEP, to generate precipitation probability forecasts. Nonetheless, the lack of spread and the overprediction of precipitation by the ensemble members are still problems that need to be solved.     

长江流域夏季降水的贝叶斯多模式集合概率预测

A Bayesian probabilistic prediction scheme of the Yangtze River Valley (YRV) summer rainfall is proposed to combine forecast information from multi-model ensemble dataset provided by ENSEMBLES project.Due to the low forecast skill of rainfall in dynamic models,the time series of regressed YRV summer rainfall are selected as ensemble members in the new scheme,instead of commonly-used YRV summer rainfall simulated by models.Each time series of regressed YRV summer rainfall is derived from a simple linear regression.The predictor in each simple linear regression is the skillfully simulated circulation or surface temperature factor which is highly linear with the observed YRV summer rainfall in the training set.The high correlation between the ensemble mean of these regressed YRV summer rainfall and observation benefit extracting more sample information from the ensemble system.The results show that the cross-validated skill of the new scheme over the period of 1960 to 2002 is much higher than equally-weighted ensemble,multiple linear regression,and Bayesian ensemble with simulated YRV summer rainfall as ensemble members.In addition,the new scheme is also more skillful than reference forecasts (random forecast at a 0.01 significance level for ensemble mean and climatology forecast for probability density function).     

Improving Multi-Model Ensemble Forecasts of Tropical Cyclone Intensity Using Bayesian Model Averaging

This paper proposes a method for multi-model ensemble forecasting based on Bayesian model averaging (BMA), aiming to improve the accuracy of tropical cyclone (TC) intensity forecasts, especially forecasts of minimum surface pressure at the cyclone center (P_min). The multi-model ensemble comprises three operational forecast models: the Global Forecast System (GFS) of NCEP, the Hurricane Weather Research and Forecasting (HWRF) models of NCEP, and the Integrated Forecasting System (IFS) of ECMWF. The mean of a predictive distribution is taken as the BMA forecast. In this investigation, bias correction of the minimum surface pressure was applied at each forecast lead time, and the distribution (or probability density function, PDF) of P_min was used and transformed. Based on summer season forecasts for three years, we found that the intensity errors in TC forecast from the three models varied significantly. The HWRF had a much smaller intensity error for short lead-time forecasts. To demonstrate the proposed methodology, cross validation was implemented to ensure more efficient use of the sample data and more reliable testing. Comparative analysis shows that BMA for this three-model ensemble, after bias correction and distribution transformation, provided more accurate forecasts than did the best of the ensemble members (HWRF), with a 5%–7% decrease in root-mean-square error on average. BMA also outperformed the multi-model ensemble, and it produced “predictive variance” that represented the forecast uncertainty of the member models. In a word, the BMA method used in the multi-model ensemble forecasting was successful in TC intensity forecasts, and it has the potential to be applied to routine operational forecasting.     

基于集合成员订正的强降水多模式集成预报

基于TIGGE资料集下欧洲中期天气预报中心（ECMWF）、日本气象厅（JMA）、英国气象局（UKMO）、美国国家环境预报中心（NCEP）和中国气象局（CMA）5个气象预报中心2016年5月1日—8月31日中国地区逐日起报预报时效为24~168 h的24 h累积降水量集合预报的结果,对各个集合预报成员进行了频率匹配法的订正,并对订正前后的多模式集成预报效果进行评估。结果表明:采用频率匹配法订正后的降水预报,有效改善了集合平均预报中强降水（日降水量25 mm以上）预报由平滑作用产生的量级偏小现象,使预报的降水量级更接近实况,但对降水落区预报改进不明显。基于卡尔曼滤波技术的集成预报效果优于基于线性回归的超级集合预报和消除偏差集合平均预报,对强降水落区的预报较单模式更优。基于集合成员订正的降水多模式集成预报在强降水的落区预报和降水中心的量级预报更接近实况,效果优于原始多模式集成预报与单模式结果。     

Ensemble Forecast： A New Approach to Uncertainty and Predictability

Ensemble techniques have been used to generate daily numerical weather forecasts since the 1990s in numerical centers around the world due to the increase in computation ability. One of the main purposes of numerical ensemble forecasts is to try to assimilate the initial uncertainty （initial error） and the forecast uncertainty （forecast error） by applying either the initial perturbation method or the multi-model/multiphysics method. In fact, the mean of an ensemble forecast offers a better forecast than a deterministic （or control） forecast after a short lead time （3-5 days） for global modelling applications. There is about a 1-2-day improvement in the forecast skill when using an ensemble mean instead of a single forecast for longer lead-time. The skillful forecast （65% and above of an anomaly correlation） could be extended to 8 days （or longer） by present-day ensemble forecast systems. Furthermore, ensemble forecasts can deliver a probabilistic forecast to the users, which is based on the probability density function （PDF） instead of a single-value forecast from a traditional deterministic system. It has long been recognized that the ensemble forecast not only improves our weather forecast predictability but also offers a remarkable forecast for the future uncertainty, such as the relative measure of predictability （RMOP） and probabilistic quantitative precipitation forecast （PQPF）. Not surprisingly, the success of the ensemble forecast and its wide application greatly increase the confidence of model developers and research communities.     

中国区域降水偏差订正的初步研究

基于中国气象局公共气象服务中心提供的降水预报资料,利用频率匹配法和阈值法对2015年全年的降水预报进行偏差订正并对订正后的结果进行检验。结果表明:(1)偏差订正可显著减少集成系统降水预报的小雨空报现象,改善"有雨或无雨"的定性预报性能,提高集成系统的晴雨预报准确率。(2)订正后降水量级大小更接近实况降水,并且集成系统预报的平均绝对误差和面积偏差(干偏差或湿偏差)均有所降低。(3)偏差订正对降水预报的改善程度与系统本身预报性能有关,系统本身预报误差越大,订正效果越好。     

最优子集回归方法在季节气候预测中的应用

利用DEMETER计划多个模式的模拟资料研究1959～2001年多模式集合预报的季节降水在中国区域的表现, 并结合最优子集回归(OSR)方法对中国区域的季节降水进行降尺度预报, 比较其与多模式集合预报的技巧。研究表明: 多个单模式在中国区域对季节降水的模拟性能普遍较差, 多元线性回归(MLR)集合的预报技巧不如集合平均(EM)。利用OSR方法进行降尺度预报可以极大改善中国区域季节降水的预报技巧。夏季, 降水距平相关系数(ACC)在长江以南、西藏以及内蒙古中部等地区提高很显著, ACC在中国区域的平均达到0.29, 明显高于多模式集合平均与多元线性回归集合。冬季, OSR方法可以改善多模式集合在中国北方地区较低的预报技巧。概率Brier技巧评分(BSS)也表明了OSR方法对季节降水预报的改善。需要说明的是, 虽然OSR方法在中国区域能明显提高季节降水的预报技巧, 但是其选取的预报因子与中国区域季节降水的物理机制问题仍有待于进一步的研究。     

Seasonal climate prediction for South America with FSU Multi-model Synthetic Superensemble algorithm

Summary Objective combination schemes of predictions from different models have been applied to seasonal climate forecasts. These schemes are successful in producing a deterministic forecast superior to individual member models and better than the multi-model ensemble mean forecast. Recently, a variant of the conventional superensemble formulation was created to improve skills for seasonal climate forecasts, the Florida State University (FSU) Synthetic Superensemble. The idea of the synthetic algorithm is to generate a new data set from the predicted multimodel datasets for multiple linear regression. The synthetic data is created from the original dataset by finding a consistent spatial pattern between the observed analysis and the forecast data set. This procedure is a multiple linear regression problem in EOF space. The main contribution this paper is to discuss the feasibility of seasonal prediction based on the synthetic superensemble approach and to demonstrate that the use of this method in coupled models dataset can reduce the errors of seasonal climate forecasts over South America. In this study, a suite of FSU coupled atmospheric oceanic models was used. In evaluation the results from the FSU synthetic superensemble demonstrate greater skill for most of the variables tested here. The forecast produced by the proposed method out performs other conventional forecasts. These results suggest that the methodology and database employed are able to improve seasonal climate prediction over South America when compared to the use of single climate models or from the conventional ensemble averaging. The results show that anomalous conditions simulated over South America are reasonably realistic. The negative (positive) precipitation anomalies for the summer monsoon season of 1997/98 (2001/02) were predicted by Synthetic Superensemble formulation quite well. In summary, the forecast produced by the Synthetic Superensemble approach outperforms the other conventional forecasts.     

2010年8月环流形势的多模式超级集合预报

利用多模式超级集合预报法,以欧洲中期天气预报中心、日本气象厅、德国气象局、中国气象局和中国空军气象中心共5个决定性7 d预报产品为集合成员,对2010年8月500 hPa高度场和850 hPa温度场分别进行固定训练期和滑动训练期超级集合预报。采用均方根误差和相关系数对超级集合预报、单一模式预报和简单集合平均预报进行对比检验,同时对各预报结果的均方根误差空间分布进行对比分析。结果表明:超级集合预报在所有预报结果中最佳,且滑动集合预报对8月后期时段预报要略好于固定集合预报,两者预报效果均好于参与集合预报的各模式,也好于集合平均预报。但随着预报时效的延长,集合平均预报的优势也随之提升。从预报结果均方根误差的空间分布可知,多模式超级集合预报相比于单一模式预报效果提高的区域,500 hPa位势高度场主要位于印度半岛、印度洋、青藏高原及以西地区,而850 hPa温度场则主要位于蒙古、青藏高原、中国新疆及以西地区。     

Comparison of Statistical Post-Processing Methods for Probabilistic Wind Speed Forecasting

In this study, the statistical post-processing methods that include bias-corrected and probabilistic forecasts of wind speed measured in PyeongChang, which is scheduled to host the 2018 Winter Olympics, are compared and analyzed to provide more accurate weather information. The six post-processing methods used in this study are as follows: mean bias-corrected forecast, mean and variance bias-corrected forecast, decaying averaging forecast, mean absolute bias-corrected forecast, and the alternative implementations of ensemble model output statistics (EMOS) and Bayesian model averaging (BMA) models, which are EMOS and BMA exchangeable models by assuming exchangeable ensemble members and simplified version of EMOS and BMA models. Observations for wind speed were obtained from the 26 stations in PyeongChang and 51 ensemble member forecasts derived from the European Centre for Medium-Range Weather Forecasts (ECMWF Directorate, 2012) that were obtained between 1 May 2013 and 18 March 2016. Prior to applying the post-processing methods, reliability analysis was conducted by using rank histograms to identify the statistical consistency of ensemble forecast and corresponding observations. Based on the results of our study, we found that the prediction skills of probabilistic forecasts of EMOS and BMA models were superior to the biascorrected forecasts in terms of deterministic prediction, whereas in probabilistic prediction, BMA models showed better prediction skill than EMOS. Even though the simplified version of BMA model exhibited best prediction skill among the mentioned six methods, the results showed that the differences of prediction skills between the versions of EMOS and BMA were negligible.     

区域集合预报系统2 m温度预报的校准技术

采用非齐次高斯回归 (NGR) 技术对国家气象中心区域集合预报系统的2 m温度预报结果开展了一阶偏差和二阶离散度的校准研究。对预报结果比较详尽的检验分析表明:校准后的2 m温度预报可靠性和预报技巧均显著提高,表现为校准后集合预报成员的均方根误差与离散度更为接近;原Talagrand直方图中的“L”形分布现象得到有效改善;Brier评分、最小连续分级概率评分 (CRPS) 明显减小,相对作用特征 (ROC) 面积增大,说明校准后的2 m温度预报表现出更好的预报技能。此外,NGR技术与自适应误差订正技术的对比试验表明,NGR在消除集合平均偏差和提高集合离散度两个方面均有优势。     

Assessment of probability multimodel seasonal forecast based on the APCC model data

The probability multimodel forecast system based on the Asia-Pacific Economic Cooperation Climate Center (APCC) model data is verified. The winter and summer seasonal mean fields T ₈₅₀ and precipitation seasonal totals are estimated. To combine the models into a multimodel ensemble, the probability forecast is calculated for each of single models first, and then these forecasts are combined using the total probability formula. It is shown that the multimodel forecast is considerably more skilful than the single-model forecasts. The forecast quality is higher in the tropics compared to the mid- and high latitudes. The multimodel ensemble temperature forecasts outperform the random and climate forecasts for Northern Eurasia in the above- and below-normal categories. Precipitation forecast is less successful. For winter, the combination of single-model ensembles provides the precipitation forecast skill exceeding that of the random forecast for both Northern Eurasia and European Russia.     

A hybrid approach to improving the skills of seasonal climate outlook at the regional scale

A hybrid seasonal forecasting approach was generated by the National Centers for Environmental Prediction operational Climate Forecast System (CFS) and its nesting Climate extension of Weather Research and Forecasting (CWRF) model to improve forecasting skill over the United States. Skills for the three summers of 2011–2013 were evaluated regarding location, timing, magnitude, and frequency. Higher spatial pattern correlation coefficients showed that the hybrid approach substantially improved summer mean precipitation and 2-m temperature geographical distributions compared with the results of the CFS and CWRF models. The area mean temporal correlation coefficients demonstrated that the hybrid approach also consistently improved the timing prediction skills for both variables. In general, the smaller root mean square errors indicated that the hybrid approach reduced the magnitude of the biases for both precipitation and temperature. The greatest improvements were achieved when the individual models had similar skills. The comparison with a North American multi-model ensemble further proved the feasibility of improving real-time seasonal forecast skill by using the hybrid approach, especially for heavy rain forecasting. Based on the complementary advantages of CFS the global model and CWRF the nesting regional model, the hybrid approach showed a substantial enhancement over CFS real-time forecasts during the summer. Future works are needed for further improving the quality of the hybrid approach through CWRF’s optimized physics ensemble, which has been proven to be feasible and reliable.     

数值模式的热带气旋强度预报订正及其集成应用

提供热带气旋强度预报产品的业务数值天气预报模式有很多,并已表现出一定的预报技巧,为提高对模式热带气旋强度预报产品的定量应用能力,分析2010—2012年7个业务数值模式的西北太平洋热带气旋强度预报,发现预报误差不仅受到模式热带气旋初始强度误差的显著影响,还与热带气旋及其所处环境的初始状况有密切关系,包括热带气旋初始强度、尺度、移速、环境气压、环境风切变、热带气旋发展潜势等。根据这些因子与各模式热带气旋强度预报误差之间的相关性,采用逐步回归方法建立热带气旋强度预报误差的统计预估模型,并通过逐个热带气旋滚动式建模来进行独立样本检验。检验结果表明,基于误差预估的模式订正预报比模式直接输出的热带气旋强度预报有显著改进,在此基础上建立的热带气旋强度多模式集成预报方案相对气候持续性预报方法在12 h有28%的正技巧,在24—72 h则稳定在15%—20%,具有业务参考价值。     

Evaluation of the ENSEMBLES multi-model seasonal forecasts of Indian summer monsoon variability

The performance of the new multi-model seasonal prediction system developed in the frame work of the ENSEMBLES EU project for the seasonal forecasts of India summer monsoon variability is compared with the results from the previous EU project, DEMETER. We have considered the results of six participating ocean-atmosphere coupled models with 9 ensemble members each for the common period of 1960–2005 with May initial conditions. The ENSEMBLES multi-model ensemble (MME) results show systematic biases in the representation of mean monsoon seasonal rainfall over the Indian region, which are similar to that of DEMETER. The ENSEMBLES coupled models are characterized by an excessive oceanic forcing on the atmosphere over the equatorial Indian Ocean. The skill of the seasonal forecasts of Indian summer monsoon rainfall by the ENSEMBLES MME has however improved significantly compared to the DEMETER MME. Its performance in the drought years like 1972, 1974, 1982 and the excess year of 1961 was in particular better than the DEMETER MME. The ENSEMBLES MME could not capture the recent weakening of the ENSO-Indian monsoon relationship resulting in a decrease in the prediction skill compared to the “perfect model” skill during the recent years. The ENSEMBLES MME however correctly captures the north Atlantic-Indian monsoon teleconnections, which are independent of ENSO.     

Calibrated multi-model ensemble summer temperature predictions over Italy

A statistical calibration scheme is applied to multi-model global seasonal ensemble reforecasts in order to predict the interannual variability of summer averaged surface maximum temperature over Italy. In some cases, this technique is shown to be able to improve the skill scores of the seasonal predictions during the last 35 years, with respect to the direct model output (DMO), using seasonal predictions initialised 1 month before the beginning of the season. It is shown that the presence of some skill in the DMO multi-model predictions is mostly due to the correct prediction of the observed secular trends in maximum temperature, and, partly, to the correct prediction of outliers, in particular, of the summer of 2003. At the same time, while the removal of trends produces a small reduction of skill in both the raw and calibrated predictions, the removal of outliers improves the performance of the calibration scheme. Once all trends and outliers are removed, the DMO predictions have no skill, while the calibrated predictions still present a detectable skill. The improvement introduced by the calibration are shown to be statistically significant by applying resampling techniques. It is shown that the reason of this partial success is linked to the fact that although the models present several shortcomings, some models can capture the existence of a weak large-scale signal, possibly linked with the presence of a summer teleconnection between the equatorial Pacific and Europe, with a spatial pattern substantially different from that associated with the temperature secular trend. The teleconnection is associated with a modulation of the quasi-stationary barotropic eddies in the Northern Hemisphere extra-tropics.