Preliminary Comparison of the CMA, ECMWF, NCEP, and JMA Ensemble Prediction Systems

Based on The Observing System Research and Predictability Experiment (THORPEX) Interactive Grand Global Ensemble (TIGGE) dataset,using various verification methods,the performances of four typical ense...     

基于TIGGE多模式集合的24小时气温BMA 概率预报

利用TIGGE(THORPEX Interactive Grand Global Ensemble)单中心集合预报系统(ECMWF、United Kingdom Meteorological Office、China Meteorological Administration和NCEP)以及由此所构成的多中心模式超级集合预报系统24小时地面日均气温预报,结合淮河流域地面观测率定贝叶斯模型平均(Bayesian model averaging,BMA)参数,从而建立地面日均气温BMA概率预报模型.由此针对淮河流域进行地面日均气温BMA概率预报及其检验与评估,结果表明BMA模型比原始集合预报效果好;单中心的BMA概率预报都有较好的预报效果,其中ECMWF最好.多中心模式超级集合比单中心BMA概率预报效果更好,采用可替换原则比普通的多中心模式超级集合BMA模型计算量小,且在上述BMA集合预报系统中效果最好.它与原始集合预报相比其平均绝对误差减少近7%,其连续等级概率评分提高近10%.基于采用可替换原则的多中心模式超级集合BMA概率预报,针对研究区域提出了极端高温预警方案,这对防范高温天气有着重要意义.     

中国夏季降水多模式集成概率预报研究

基于TIGGE资料中的中国气象局（CMA）、欧洲中期天气预报中心（ECMWF）、日本气象厅（JMA）、美国国家环境预报中心（NCEP）以及英国气象局（UKMO）五个中心2007-2011年5月25日-8月31日中国地区逐日12-36 h、36-60 h、60-84 h、84-108 h、108-132 h与132-156 h累积降水集合预报资料,分别利用PoorMan （POOL）和多模式消除偏差（MBRE）两种方法对2011年各中心降水概率预报进行集成,并采用RPS和BS评分方法对预报效果进行评估。结果表明,对于12-156 h逐24 h累积降水量概率预报,多模式集成预报效果优于单模式预报效果,且多模式消除偏差概率预报效果最好;针对小雨、中雨以及大雨以上降水,PoorMan和MBRE概率预报较单中心预报效果均有提高,MBRE概率预报效果优于PoorMan方法。     

Synoptic Verification of Medium-Extended-Range Forecasts of the Northwest Pacific Subtropical High and South Asian High Based on Multi-Center TIGGE Data

Synoptic verification of medium-extended-range forecasts of the Northwest Pacific subtropical high （NWPSH） and South Asian high （SAH） is performed for the summers of 2010-2012 using TIGGE data from four operational centers at the CMA,ECMWF,JMA,and NCEP.The overall activities of the NW-PSH and SAH are examined along with their local characteristics such as the spatial coverage of each high in the East Asian key area （10°-40°N,105°-130°E）,the mean position of the ridge of each high over 110°-122.5°E,the westward extent of the NWPSH ridge,and the eastward extent of the SAH ridge.Focus on the NWPSH and SAH is justified because these two systems have pronounced influences on the summertime persistent heavy rainfall in China.Although the overall activities of both highs are reproduced reasonably well in the TIGGE data,their spatial coverages are reduced in the East Asian key area and both of them are weaker compared with observations.On average,their ridges shift more northward relative to observations.The NWPSH ridge is less westward while the SAH ridge is generally more eastward early in the forecast but too westward later in the forecast.The JMA ensemble prediction system （EPS） produces the best mediumrange （1-10 days） forecasts of the NWPSH based on these metrics,while the ECMWF EPS produces the best medium-range forecasts of the SAH and the most reliable extended-range （11-15 days） forecasts of both highs.Forecasts of the spatial coverage of both highs in the East Asian key area and the mean positions of the ridges are generally valid out to lead times of 7-12 days.By contrast,forecasts of the longitudinal extent of the ridges are typically only valid to lead times of 5-7 days.All the four operational centers＇ models produce excellent forecasts of the mean zonal position of the SAH ridge.The ensemble mean forecast is more reliable than the control forecast over the areas where the NWPSH （20°-30°N,135°-165°E） and SAH （23°-30°N,70°-100°E） are most active.Forecasts of both highs have advantages and disadvantages in the peripheral areas away from their respective center of high activity.     

Evaluation of a Regional Ensemble Data Assimilation System for Typhoon Prediction

An ensemble Kalman filter (EnKF) combined with the Advanced Research Weather Research and Forecasting model (WRF) is cycled and evaluated for western North Pacific (WNP) typhoons of year 2016. Conventional in situ data, radiance observations, and tropical cyclone (TC) minimum sea level pressure (SLP) are assimilated every 6 h using an 80-member ensemble. For all TC categories, the 6-h ensemble priors from the WRF/EnKF system have an appropriate amount of variance for TC tracks but have insufficient variance for TC intensity. The 6-h ensemble priors from the WRF/EnKF system tend to overestimate the intensity for weak storms but underestimate the intensity for strong storms. The 5-d deterministic forecasts launched from the ensemble mean analyses of WRF/EnKF are compared to the NCEP and ECMWF operational control forecasts. Results show that the WRF/EnKF forecasts generally have larger track errors than the NCEP and ECMWF forecasts for all TC categories because the regional simulation cannot represent the large-scale environment better than the global simulation. The WRF/EnKF forecasts produce smaller intensity errors and biases than the NCEP and ECMWF forecasts for typhoons, but the opposite is true for tropical storms and severe tropical storms. The 5-d ensemble forecasts from the WRF/EnKF system for seven typhoon cases show appropriate variance for TC track and intensity with short forecast lead times but have insufficient spread with long forecast lead times. The WRF/EnKF system provides better ensemble forecasts and higher predictability for TC intensity than the NCEP and ECMWF ensemble forecasts.     

Evaluation of Tropical Cyclone Intensity Forecasts from Five Global EnsemblePrediction Systems During 2015-2019

This study presented an evaluation of tropical cyclone (TC) intensity forecasts from five global ensemble prediction systems (EPSs) during 2015-2019 in the western North Pacific region. Notable error features include the underestimation of the TC intensity by ensemble mean forecast and the under-dispersion of the probability forecasts.The root mean square errors (brier scores) of the ensemble mean (probability forecasts) generally decrease consecutively at long lead times during the five years, but fluctuate between certain values at short lead times.Positive forecast skill appeared in the most recent two years (2018-2019) at 120 h or later as compared with the climatology forecasts. However, there is no obvious improvement for the intensity change forecasts during the 5-yearperiod, with abrupt intensity change remaining a big challenge. The probability forecasts show no skill for strongTCs at all the lead times. Among the five EPSs, ECMWF-EPS ranks the best for the intensity forecast, while NCEP-GEFS ranks the best for the intensity change forecast, according to the evaluation for ensemble mean and dispersion. As for the other probability forecast evaluation, ECMWF-EPS ranks the best at lead times shorter than 72 h, while NCEP-GEFS ranks the best later on.     

两个集合预报系统对秦岭及周边降水预报性能对比

利用欧洲中期天气预报中心 (ECMWF)、美国大气环境预报中心 (NCEP) 集合预报系统 (EPS) 降水量预报资料,CMORPH (NOAA Climate Prediction Center Morphing Method) 卫星与全国3万个自动气象站降水量融合资料,基于技巧评分、ROC (relative operating characteristic) 分析等方法,对比两个集合预报系统对秦岭及周边地区的降水预报性能。结果表明:两个系统均能较好表现降水量的空间形态,对于不同量级降水,ECMWF集合预报系统0~240 h控制及扰动预报优于NCEP集合预报系统,但NCEP集合预报系统264~360 h预报时效整体表现更好; ECMWF集合预报系统0~120 h大雨集合平均优于NCEP集合预报系统,两个系统集合平均的预报技巧整体低于其控制及扰动成员预报,这种现象ECMWF集合预报系统表现更为显著; ECMWF集合预报系统降水预报概率优于NCEP集合预报系统。ROC分析显示,随着预报概率的增大,ECMWF集合预报系统在命中率略微下降的情况下,显著减小了空报率,NCEP集合预报系统则表现出高空报、高命中率。     

基于TIGGE资料的东亚地面气温预报的不一致性研究

基于TIGGE资料中欧洲中期天气预报中心(ECMWF)、美国国家环境预报中心(NCEP)和中国气象局(CMA)3个集合预报系统的地面气温集合预报资料,运用跳跃指数研究了3个集合预报系统中东亚地面气温的控制预报及集合平均预报的不一致性。结果表明,各个集合预报系统地面气温预报的时间平均不一致性指数差异较大。ECM WF时间不一致性指数最小,NCEP次之,CM A最大。另外NCEP的控制预报、ECM WF的控制预报和集合平均预报,这三者的时间平均不一致性指数随预报时效延长而增加,且集合平均预报一致性优于控制预报。而对于CMA预报的不一致性,无论是控制预报还是集合平均预报总体上都稳定地保持在较高的水平。此外,ECMWF的地面气温冬(夏)季预报的不一致性相对较强(弱),且单点跳跃随预报时效延长变化不明显,而控制预报和集合平均预报的异号两点跳跃以及三点跳跃出现的频率总体上随预报时效延长略有增加。     

基于TIGGE资料的沂沭河流域6小时降水集合预报能力分析

全球多模式集合预报(TIGGE)资料为发展局地水文风险预报方法提供了新基础。对不同预报系统的集合预报资料进行评价与对比,可为综合应用多源资料实现超集合预报提供参考。本文以沂沭河流域内10个站点观测降水作为参照,对2007～2010年7、8、9月中BABJ(北京)、ECMF(欧洲)、EGRR(英国)、RJTD(日本)和KWBC(美国NCEP)五种预报模式的6h集合预报降水做了相关系数、均方根误差、Nash效率系数、TS评分(风险评分)和Brier评分等定量评估和对比。对于各模式集合平均预报,EGRR表现最好,4日预见期内的相关系数达0.48,Nash系数为0.21,BABJ最差,其他三模式预报能力相当。对于确定的控制性预报,4日预见期内RJTD表现最优,相关系数为0.19,Nash系数为0.13,其次为BABJ和EGRR。各模式集合平均与控制性预报相比,预报能力都占绝对优势,而多模式集合平均其预报能力又强于任何单模式集合平均。在4日预见期内,多模式平均的相关系数达0.49,Nash系数达0.24。在不同百分位阈值下TS评分和Brier评分也表明了类似的各模式评比结果,但多模式平均虽然在较低阈值下评分较优,但不占据绝对优势。各中心资料均具有一个随预见时长增加的稳定衰减期,其中EGRR衰减期最长(达9天)且最为稳定,而其他资料则存在不同稳定程度的衰减,稳定衰减期都能持续4天以上。各中心资料对较大降水的预报还存在各自不同的系统性偏差。     

MULTIMODEL CONSENSUS FORECASTING OF LOW TEMPERATURE AND ICY WEATHER OVER CENTRAL AND SOUTHERN CHINA IN EARLY 2008

Based on the daily mean temperature and 24-h accumulated total precipitation over central and southern China, the features and the possible causes of the extreme weather events with low temperature and icing conditions,which occurred in the southern part of China during early 2008, are investigated in this study. In addition, multimodel consensus forecasting experiments are conducted by using the ensemble forecasts of ECMWF, JMA, NCEP and CMA taken from the TIGGE archives. Results show that more than a third of the stations in the southern part of China were covered by the extremely abundant precipitation with a 50-a return period, and extremely low temperature with a 50-a return period occurred in the Guizhou and western Hunan province as well. For the 24- to 216-h surface temperature forecasts, the bias-removed multimodel ensemble mean with running training period(R-BREM) has the highest forecast skill of all individual models and multimodel consensus techniques. Taking the RMSEs of the ECMWF 96-h forecasts as the criterion, the forecast time of the surface temperature may be prolonged to 192 h over the southeastern coast of China by using the R-BREM technique. For the sprinkle forecasts over central and southern China, the R-BREM technique has the best performance in terms of threat scores(TS) for the 24- to 192-h forecasts except for the 72-h forecasts among all individual models and multimodel consensus techniques. For the moderate rain, the forecast skill of the R-BREM technique is superior to those of individual models and multimodel ensemble mean.     

基于卡尔曼滤波的中国区域气温和降水的多模式集成预报

利用TIGGE资料集下欧洲中期天气预报中心(ECMWF)、日本气象厅(JMA)、美国国家环境预报中心(NCEP)、中国气象局(CMA)和英国气象局(UKMO)5个模式预报的结果,对基于卡尔曼滤波的气温和降水的多模式集成预报进行研究。结果表明,卡尔曼滤波方法的预报效果优于消除偏差集合平均(BREM)和单模式的预报,但是对于地面气温和降水,其预报效果也存在一定的差异。在中国区域2 m气温的预报中,卡尔曼滤波的预报结果最优。而对于24 h累积降水预报,尽管卡尔曼滤波在所有量级下的TS评分均优于BREM,但随着预报时效增加,其在大雨及以上量级的TS评分跟最佳单模式UKMO预报相当,改进效果不明显。卡尔曼滤波在地面气温和24 h累积降水每个预报时效下的均方根误差均最优,预报效果更佳且稳定。     

西北太平洋台风在S2S时间尺度预报效果评估

使用世界气象组织季节内至季节尺度（Subseasonal to Seasonal, S2S）预测项目数据库评估了多个集合预报系统在S2S时间尺度对台风的预报能力。评估的时间段为1999—2010年期间每年5月1日—10月31日。为评估S2S时间尺度台风的预报技巧,使用了台风密集度来描述台风的生成及移动状况。台风密集度定义为一段时间内500 km范围内台风出现的概率。台风密集度由6个S2S集合预报系统后报结果计算得出,它们分别由BoM、CMA、ECMWF、JMA、CNRM和NCEP开发使用。这6个预报系统台风密集度的预报技巧评分表明,当预报时效为11~30天时,ECMWF预报系统的评分为正值,比基于气候状态的参考预报能略好地预报台风。      

北半球中纬度地区地面气温的超级集合预报

基于TIGGE资料中的ECMWF、JMA、NCEP和UKMO四个中心2007年6月1日-8月31日北半球中纬度地区地面气温24～168 h集合预报资料,分别利用固定训练期超级集合(SUP, Superensemble)和滑动训练期超级集合(R-SUP, Running Training Period Superensemble )对2007年8月8-31日预报期24 d进行超级集合预报试验.采用均方根误差对预报结果进行检验评估,比较了两种超级集合方法与最好的单个中心模式预报、多模式集合平均的预报效果.结果表明,SUP预报有效降低了预报误差,24～144 h的预报效果优于多模式集合平均(EMN, Ensemble Mean)和最好的单个中心预报,168 h的预报效果略差于EMN.R-SUP预报进一步改善了预报效果.对于24～168 h的预报,R-SUP预报效果都要优于EMN.尤其对于168 h的预报,R-SUP改进了预报效果,优于EMN.     

基于TIGGE资料的地面气温多模式超级集合预报

基于TIGGE资料, 采用均方根误差分别对欧洲中期天气预报中心、日本气象厅、美国国家环境预报中心和英国气象局4个中心集合预报的地面气温场集合平均结果进行检验评估, 比较各中心地面气温的预报效果。并利用超级集合、多模式集合平均和消除偏差集合平均3种方法对4个中心的地面气温预报进行集成, 同时对预报结果进行分析。结果表明: 2007年夏季日本气象厅与欧洲中期天气预报中心在北半球大部分地区预报效果最好, 各中心在不同地区预报效果不同。超级集合与消除偏差集合平均降低了预报误差, 预报效果优于最好的单个中心预报和多模式集合平均。对于较长的预报时效, 消除偏差集合平均表现出了更好的预报性能。     

基于TIGGE资料的地面气温和降水的多模式集成预报

利用TIGGE资料集下中国气象局(CMA)、欧洲中期天气预报中心(ECMWF)、日本气象厅(JMA)、美国国家环境预报中心(NCEP)和英国气象局(UKMO)5个中心集合预报结果,对多模式集成预报方法进行讨论。结果表明,多模式集成方法的预报效果优于单个中心的预报,但对于不同预报要素多模式集成方法的适用性存在差异。滑动训练期超级集合(R-SUP)对北半球地面气温的改进效果最优,但此方法对降水场的改进效果并不理想。在北半球中低纬24 h累积降水的回报试验中,消除偏差(BREM)的结果优于单个中心的预报,且此方法预报结果稳定。进一步利用滑动训练期消除偏差(R-BREM)集合平均对2008年1月中国南方极端雨雪冰冻过程进行多模式集成预报试验,结果表明,在固定误差范围内,R-BREM将中国南方大部分地区的地面气温预报时效由最优数值预报中心的96 h延长至192 h,且除个别时效外,小雨、中雨的TS评分得到明显提高。     

西北太平洋(含南海)热带气旋路径集成预报分析

基于2004—2009 年中国中央气象台、日本气象厅、美国联合台风警报中心、欧洲中心对西北太平洋和南海编号热带气旋主客观预报资料,利用算术平均、多元回归以及历史平均误差等三种集成方法,建立了热带气旋路径集成预报业务化系统。通过2007—2009 年的业务运行结果分析发现,欧洲中心客观预报参与的24、48 和72 h 集成比主观预报三个成员集成预报水平分别提高约2%、3%～5%和3%～5%,减小误差2.5 km左右、6～9 km 和10～12 km。技巧分析发现,24～72 h 集成预报有正技巧,多元回归集成技巧相对稍低,而算术平均和以各成员平均误差的平方倒数为权重系数的集成技巧对于各集成成员来说技巧差异不大。96 h 集成预报对欧洲中心的客观预报没有正技巧。      

2010年8月环流形势的多模式超级集合预报

利用多模式超级集合预报法,以欧洲中期天气预报中心、日本气象厅、德国气象局、中国气象局和中国空军气象中心共5个决定性7 d预报产品为集合成员,对2010年8月500 hPa高度场和850 hPa温度场分别进行固定训练期和滑动训练期超级集合预报。采用均方根误差和相关系数对超级集合预报、单一模式预报和简单集合平均预报进行对比检验,同时对各预报结果的均方根误差空间分布进行对比分析。结果表明:超级集合预报在所有预报结果中最佳,且滑动集合预报对8月后期时段预报要略好于固定集合预报,两者预报效果均好于参与集合预报的各模式,也好于集合平均预报。但随着预报时效的延长,集合平均预报的优势也随之提升。从预报结果均方根误差的空间分布可知,多模式超级集合预报相比于单一模式预报效果提高的区域,500 hPa位势高度场主要位于印度半岛、印度洋、青藏高原及以西地区,而850 hPa温度场则主要位于蒙古、青藏高原、中国新疆及以西地区。     

东亚地区冬季地面气温延伸期概率预报研究

利用TIGGE资料中的ECMWF、NCEP、UKMO三个中心集合预报系统以及由此构成的多中心集合预报系统所提供的地面2 m气温10~15 d延伸期集合预报产品,建立贝叶斯模式平均(Bayesian Model Averaging,BMA)概率预报模型,对东亚地区冬季地面气温进行延伸期概率预报研究。采用距平相关系数、均方根误差、布莱尔评分、等级概率评分等指标分别对BMA确定性结果与概率预报进行评估。结果表明,BMA方法明显地改进了原始集合预报结果,预报技巧优于原始集合预报,且多中心BMA预报优于单中心BMA预报,最佳滑动训练期取35 d。BMA预报为气温的延伸期概率预报提供了更合理的概率分布,定量描述了预报的不确定性。     

Ensemble mean forecast skill and applications with the T213 ensemble prediction system

Ensemble forecasting has become the prevailing method in current operational weather forecasting. Although ensemble mean forecast skill has been studied for many ensemble prediction systems(EPSs) and different cases, theoretical analysis regarding ensemble mean forecast skill has rarely been investigated, especially quantitative analysis without any assumptions of ensemble members. This paper investigates fundamental questions about the ensemble mean, such as the advantage of the ensemble mean over individual members, the potential skill of the ensemble mean, and the skill gain of the ensemble mean with increasing ensemble size. The average error coefficient between each pair of ensemble members is the most important factor in ensemble mean forecast skill, which determines the mean-square error of ensemble mean forecasts and the skill gain with increasing ensemble size. More members are useful if the errors of the members have lower correlations with each other, and vice versa. The theoretical investigation in this study is verified by application with the T213 EPS. A typical EPS has an average error coefficient of between 0.5 and 0.8; the 15-member T213 EPS used here reaches a saturation degree of 95%(i.e., maximum 5% skill gain by adding new members with similar skill to the existing members) for 1–10-day lead time predictions, as far as the mean-square error is concerned.