广东省ECMWF降水集合预报统计量的检验与分析

利用欧洲中期天气预报中心(ECMWF)的降水集合预报历史资料,对广东省86个地面气象站进行分级统计检验,分析集合统计量产品的预报效果。评分结果表明,降水量级越大,确定性预报与集合产品TS越低,对应最优分位数越高;对于冬季暴雨与前汛期晴雨,集合预报产品效果较好,TS分别达到0.50和0.66,对于前汛期暴雨效果则较差,TS在0.10左右。随着预报时效增加,集合预报TS逐渐减小,预报时效72 h,前汛期集合TS下降幅度较大;预报时效72 h,后汛期集合TS下降幅度较大。对于冬季和后汛期暴雨,集合预报相对于确定性预报有明显优势,并且预报时效越长,集合TS增幅越大。对于站点降水,在广东省东部和西南部沿海地区,确定性预报对暴雨的预报能力比较欠缺,而集合预报能显著改善这些地区的暴雨预报,部分站点的TS增幅能够达到0.20以上。     

ECMWF降水相态预报产品(PTYPE)应用和检验

运用我国2016—2018年三个冬半年(10月至次年3月)地面2515个站的天气现象观测资料,对ECMWF(European Centre for Medium-Range Weather Forecasts)的降水相态预报产品(PTYPE)(分为雨、雨夹雪、雪和冻雨四类)进行了系统性的检验评估,包括细网格确定性模式预报产品和集合预报系统概率预报产品。结果显示,ECMWF的确定性预报产品对四类降水相态的正确率普遍达到90%以上,对降雨和降雪的TS评分也较高,冻雨次之,雨夹雪的TS评分较低,预报能力有限。确定性模式对我国雨雪分界线的预报,普遍存在短期位置略偏南、中期随时效延长越来越偏北的误差特点,且对雨夹雪的预报范围明显偏小,对冻雨的预报范围明显偏大。集合预报系统从概率的角度一定程度上弥补了确定性模式的上述误差。对概率预报的检验结果显示,集合预报系统降雨概率普遍偏低,降雪概率短期偏高、中期偏低,而雨夹雪和冻雨概率普遍偏低,但是都有一定的预报技巧。集合预报系统相对于确定性模式的优势,降雨体现在较小花费损失比事件的预报上,降雪体现在较大花费损失比事件的预报上。对雨夹雪和冻雨,相对于确定性模式,集合预报系统体现出了显著的优势,尤其是冻雨,集合预报系统的优势更加明显。     

ENSO集合预报系统的检验评价

讨论了一个热带太平洋海气耦合集合预报系统集合预报的检验问题。该集合预报系统模式为一个中等复杂程度的耦合模式,其中大气部分为统计模式,海洋部分为动力模式。初始扰动利用集合Kalman滤波同化得到,模式误差扰动由一个一阶马尔可夫随机微分方程生成,预报集合样本为100个。利用1995~2005年的观测资料进行了确定性预报检验,包括相关系数和均方根误差。在概率预报检验方面,包括Talagrand概率分布、离散度、Brier评分(BS)、命中率以及空报率的统计检验,并且根据检验结果对预报系统进行了初步评价。确定性检验表明,集合样本均值的预报水平在热带中太平洋区域要高于热带东太平洋和沿岸区域。同时概率预报检验结果表明,集合预报系统有较高的概率预报技巧,对确定性预报是一个完善和补充。     

WRF集合预报对济南暴雨过程的检验与分析

为了将WRF集合预报更好地应用于济南大城市精细化预报,提高暴雨预报准确率,利用2013—2014年汛期济南龟山观测站和市区及历城区36个区域自动观测站的降水资料,检验WRF集合预报24h确定性降水量对暴雨的TS评分、空报率、漏报率以及平均绝对误差和均方根误差,并且检验24h暴雨概率的可信度。2013年和2014年的空报率和漏报率均较高,2013年暴雨预报TS评分明显好于2014年。确定性预报24h降水量达到30mm以上,且天气形势和各物理量满足产生暴雨的条件时,可考虑预报暴雨;低层湿度大时确定性降水最易出现暴雨空报;24h暴雨概率预报对济南局地性较强的暴雨有较好的指示意义。     

“集合统计量集成法”在湖北短期暴雨预报中的应用研究

利用2013年11月—2014年11月ECMWF全球集合预报的51个成员降水预报资料和湖北省78个国家气象站逐日降水实况,对集合平均值、分位值、概率匹配平均值、众数(Mode值)等10种集合统计量在湖北省不同预报分区内的降水预报效果分别进行检验评估。在此基础上,采用在不同降水量级上选取TS评分最优的集合统计量的原则,设计出适用湖北降水预报的最佳集合统计量集成方案,并检验了该方法在2015年和2016年6—8月湖北降水预报的应用效果。结果表明:将集合统计量集成法应用于湖北降水预报时,集合统计量集成方案应随着预报分区的改变而改变;改进后的ECMWF集合统计量集成方案对湖北72 h内大雨及以上降水预报的TS评分均有不同程度的提高,且空报率和漏报率总体上有所降低;与ECMWF确定性预报相比,ECMWF集合统计量集成预报产品对湖北24 h内各降水量级的预报均优于ECMWF确定性预报,且对湖北72 h内的暴雨预报准确率均高于ECMWF确定性预报。     

青藏高原东侧"2003.8.28"暴雨的集合预报试验

利用MM5模式和国家气象中心的T213模式的预报资料,通过研究非绝热物理过程参数化方案对高原东侧"2003.8.28"暴雨数值预报的影响特征,进行了多物理模式集合预报试验,为开展青藏高原东侧集合预报扰动技术研究进行了试验.试验结果表明,模式物理参数化方案对中尺度降水预报结果有明显影响,包括局地降水强度、空间分布型态、时间演变特征等.随着模式分辨率的提高,积云对流参数化方案将增加小雨量级降水区域,产生一些虚假降水,就现阶段模式水平而言,高分辨率集合预报应重点发展考虑强降水预报不确定性的集合预报模式系统.多物理模式集合预报的初步试验结果表明,高分辨率集合预报可以改进单一确定性预报结果不稳定的缺点,为强降水灾害性天气预报提供有价值的预报信息.     

粤港澳大湾区汛期降水的多模式集成预报方法的评估检验

基于欧洲中期天气预报中心(ECMWF)、中国气象局(CMA)、日本气象厅(JMA)、美国国家环境预报中心(NCEP)、英国气象局(UKMO)五个模式集成的交互式全球大集合预报系统（THORPEXInteractiveGrandGlobalEnsemble,简称TIGGE）资料集的确定性预报、集合预报以及地面降水观测数据,采用多模式集成平均(EMN)、消除偏差集成平均(BREM)、滑动训练期超级集合方法（R_SUP）对2018年华南汛期（4—9月）粤港澳大湾区的降水预报开展了评估检验。总体而言,多模式集成预报方法在大湾区前汛期降水预报的均方根误差平均比后汛期高2mm;多模式集成预报方法的预报能力在前汛期随着预报时效的延长而呈持续下降趋势,后汛期则表现为短期（24~72h）下降、中期（72~168h）持续平稳的变化特点。与预先的假设差异主要表现在：对前、后汛期的降水预报综合表现最好的均是数学原理相对简单的EMN,而BREM和R_SUP的空间平均评分指标则稍差,但其在降水落区预报中仍有较好的预报技巧。     

基于重组降水集合预报的洪水概率预报

采用条件亚正态模型方法,生成了具有包含不同可能性的降水集合预报。为了保持各子流域降水集合预报变量之间的空间相关性,采用集合预报重组方法对降水集合预报进行重新排列。使用重组后的降水集合预报驱动水文模型,实现了淮河上游大坡岭-息县、淮河上游息县-王家坝和汝河-洪河上游3个子流域的12次洪水过程的洪水概率预报,并对1988年9月7日和1991年7月31日两次洪水概率预报进行个例分析。结果表明:相对于单一确定性预报,通过条件亚正态分布模型生成降水集合预报后,再经过Schaake洗牌法空间相关性重新组合的降水集合预报,捕捉洪峰出现时间和流量的能力更强。对洪水概率预报来说,降水概率预报更能达到对未来的水文事件进行最大可能估计的目的,并尽可能综合了降水预报不确定性因素,同时也说明维持变量原有的空间相关特征对于降水概率预报具有重要意义。     

山东WRF集合预报系统对“麦德姆”台风预报检验

2014年第10号台风“麦德姆”登陆北上,对山东造成较大的影响。此文对业务上常用的各种数值模式对于“麦德姆”台风的预报情况进行了对比检验,重点检验了山东WRF集合预报系统对此次台风的预报性能。结果表明,山东WRF集合预报系统对于此次台风预报具有较高的参考价值。WRF确定性预报台风路径预报类似EC细网格预报,在23日20时以前预报较好,23日20时后预报最好的为T639。WRF集合预报对于台风路径预报具有较好的指示意义。WRF确定性预报02时、14时更新预报效果好于其前面6h起报结果,体现了HYBRID-3DVAR集合混合同化对于改进预报效果的作用。通过中尺度模式与其外层全球背景场模式预报对比发现,由于中尺度模式具有自身的物理参数化方案和同化系统,其对于台风路径的预报效果可以显著优于其全球背景场模式。WRF确定性预报对于“麦德姆”台风降水预报与实况最为接近。对于台风大风预报,WRF集合预报最大值最好。     

黄淮地区夏季日降水分区概率预报方法研究

利用我国黄淮地区1961—2010年50年6—8月的日降水资料,采用REOF和t检验的方法,将中国黄淮地区夏季降水分成Ⅰ—Ⅴ区。5个区域进行差异性t检验表明5个区域之间（彼此）差异显著,说明了区域划分的正确性。在此基础上利用1999—2007年6—8月站点日降水资料以及CFSv2模式后预报的日降水资料建立了5个区域内共5个代表站点的夏季日降水概率预报方程,并进行了确定性、概率性预报检验和业务试用检验。对各区域内5个代表站日降水量的确定性预报检验表明：Logistic回归降水概率预报方程的TS评分要高于CFSv2模式预报和T213的集合预报平均,空报率也低于CFSv2模式预报和T213集合预报平均,但是漏报率却略高。各区域代表站日降水量的概率预报Brier评分检验表明：Brier评分均不超过0.2,大大低于T213集合预报所得概率预报的Brier评分分值,说明本文Logistic回归方程的概率预报较为可靠。Brier技巧评分表明：Logistic回归降水概率预报方程各站的BSS技巧评分都大于0.0,说明各站的预报技巧高于检验样本气候概率的预报技巧,且高于T213集合预报的Brier技巧评分,说明在分区基础上建立Logistic回归降水概率预报方程的方法是有预报意义的。     

A CRPS-Based Spatial Technique for the Verification of Ensemble Precipitation Forecasts

Traditional precipitation skill scores are affected by the well-known“double penalty”problem caused by the slight spatial or temporal mismatches between forecasts and observations. The fuzzy (neighborhood) method has been proposed for deterministic simulations and shown some ability to solve this problem. The increasing resolution of ensemble forecasts of precipitation means that they now have similar problems as deterministic forecasts. We developed an ensemble precipitation verification skill score, i.e., the Spatial Continuous Ranked Probability Score (SCRPS), and used it to extend spatial verification from deterministic into ensemble forecasts. The SCRPS is a spatial technique based on the Continuous Ranked Probability Score (CRPS) and the fuzzy method. A fast binomial random variation generator was used to obtain random indexes based on the climatological mean observed frequency, which were then used in the reference score to calculate the skill score of the SCRPS. The verification results obtained using daily forecast products from the ECMWF ensemble forecasts and quantitative precipitation estimation products from the OPERA datasets during June-August 2018 shows that the spatial score is not affected by the number of ensemble forecast members and that a consistent assessment can be obtained. The score can reflect the performance of ensemble forecasts in modeling precipitation and thus can be widely used.     

A convection-allowing ensemble forecast based on the breeding growth mode and associated optimization of precipitation forecast

A convection-allowing ensemble forecast experiment on a squall line was conducted based on the breeding growth mode (BGM). Meanwhile, the probability matched mean (PMM) and neighborhood ensemble probability (NEP) methods were used to optimize the associated precipitation forecast. The ensemble forecast predicted the precipitation tendency accurately, which was closer to the observation than in the control forecast. For heavy rainfall, the precipitation center produced by the ensemble forecast was also better. The Fractions Skill Score (FSS) results indicated that the ensemble mean was skillful in light rainfall, while the PMM produced better probability distribution of precipitation for heavy rainfall. Preliminary results demonstrated that convection-allowing ensemble forecast could improve precipitation forecast skill through providing valuable probability forecasts. It is necessary to employ new methods, such as the PMM and NEP, to generate precipitation probability forecasts. Nonetheless, the lack of spread and the overprediction of precipitation by the ensemble members are still problems that need to be solved.     

Using the fractions skill score to assess the relationship between an ensemble QPF spread and skill

The numerical weather prediction model LM COSMO was employed to study the regional ensemble forecast of convective precipitation. The relationship between ensemble spread and ensemble skill and the possibility of estimating ensemble skill on the basis of ensemble spread were investigated. Five convective events that produced heavy local rainfall in the Czech Republic were studied. The LM COSMO was run with a horizontal resolution of 2.8 km and an ensemble of 13 forecasts was created by modifying the initial and boundary conditions. Forecasts were verified by gauge-adjusted radar-based rainfalls. Ensemble skill and ensemble spread were determined using the Fractions Skill Score (FSS), which depended on the scale of the elementary area and on a precipitation threshold. The spread represents the differences between the control forecast and the forecasts provided by each ensemble member, while the skill evaluates the difference between the precipitation forecast and radar-based rainfalls. In this study, the ensemble skill is estimated on the basis of the ensemble spread. The numerical experiments used the FSS-based skill and spread values related to four events to estimate the skill–spread relationship. The relationship was applied to a fifth event to estimate the QPF ensemble skill given the ensemble FSS-based spread. The evaluation was performed separately for 1, 3, and 6 h rainfalls using various threshold values and scales. The absolute frequencies of the differences between diagnostic and prognostic FSS-based skill show that all of the distributions have means and medians close to zero and that the interquartile ranges are between 0.10 and 0.30. The results indicate that 67% of all the fitted FSS-skill values were within 0.15 of the true values. One of five events showed a marked overestimation of the prognostic FSS-skill so that only 39% of skill values were fitted. At the other four events, the 75% of predicted FSS-skill values were in the range of 0.15 of the diagnosed FSS-skill. The results appear to be encouraging; however, tests with more extended data are needed to confirm the potential of the technique.     

Assessing Hourly Precipitation Forecast Skill with the Fractions Skill Score

Statistical methods for category (yes/no) forecasts, such as the Threat Score, are typically used in the verification of precipitation forecasts. However, these standard methods are affected by the so-called “double-penalty” problem caused by slight displacements in either space or time with respect to the observations. Spatial techniques have recently been developed to help solve this problem. The fractions skill score (FSS), a neighborhood spatial verification method, directly compares the fractional coverage of events in windows surrounding the observations and forecasts. We applied the FSS to hourly precipitation verification by taking hourly forecast products from the GRAPES (Global/Regional Assimilation Prediction System) regional model and quantitative precipitation estimation products from the National Meteorological Information Center of China during July and August 2016, and investigated the difference between these results and those obtained with the traditional category score. We found that the model spin-up period affected the assessment of stability. Systematic errors had an insignificant role in the fraction Brier score and could be ignored. The dispersion of observations followed a diurnal cycle and the standard deviation of the forecast had a similar pattern to the reference maximum of the fraction Brier score. The coefficient of the forecasts and the observations is similar to the FSS; that is, the FSS may be a useful index that can be used to indicate correlation. Compared with the traditional skill score, the FSS has obvious advantages in distinguishing differences in precipitation time series, especially in the assessment of heavy rainfall.     

华南区域高分辨率数值模式前汛期预报初步评估

基于华南地区自动站逐小时观测资料, 采用传统站点评分、邻域法等评估华南区域高分辨率数值模式(包括GRAPES_GZ_R 1 km模式和GRAPES_GZ 3 km模式)对降水、地面温度和风场等要素的预报能力。结果表明: GRAPES_GZ_R 1 km模式的降水预报技巧优于GRAPES_GZ 3 km模式, 模式预报以正偏差为主。对于不同起报时间的预报, 00时(世界时, 下同)起报的预报效果优于12时。GRAPES_GZ_R 1 km模式的TS评分是GRAPES_GZ 3 km模式的两倍以上, 对不同降水阈值的评分均较高。分数技巧评分(FSS)显示GRAPES_GZ_R 1 km模式6 h累计降水预报在0.1 mm、1 mm及5 mm以上的降水均可达到最低预报技巧尺度, 对所检验降水对象的空间位置把握能力更好。2 m气温和10 m风速检验结果表明两个模式均能较好把握广东省温度的分布特征, GRAPES_GZ_R 1 km模式对2 m气温预报结果优于GRAPES_GZ 3 km模式, 预报绝对误差更小; 两个模式对风速的预报整体偏强, 预报偏差在1~4 m/s之间, 但相比之下GRAPES_GZ 3 km模式在风场预报上表现更好。GRAPES_GZ_R 1 km模式的2 m气温和10 m风速预报偏差随降水过程存在明显波动, 强降水过后温度预报整体偏低, 风速预报偏强, 在模式产品订正、使用等需要考虑模式对主要天气系统的预报情况。总的来说, GRAPES_GZ_R 1 km模式的预报产品具有较好的参考价值。      

基于时空不确定性的对流尺度集合预报效果评估检验

针对对流尺度天气系统的高度非线性特征和高分辨率模式预报结果存在时、空不确定性现象,以及当前邻域概率法主要考虑高分辨率预报结果的空间位移误差,而不能有效解决预报结果存在时间超前与滞后问题,将时间因素引入到邻域概率法中,结合一次强飑线过程进行对流尺度集合预报试验,并基于改进后的新型邻域概率法与分数技巧评分,对降水预报进行了不同时、空尺度的效果评估检验。结果表明:（1）邻域集合概率法和概率匹配平均法在极端降水的分数技巧评分远高于传统集合平均,弥补了集合平均对极端降水预报能力偏低的缺陷。（2）对于此类飑线过程的对流尺度天气系统而言,邻域半径为15—45 km的空间尺度能够改善降水位移误差的空间不确定性,并使其预报效果达到最优,其中15—30 km的邻域半径对于尺度更小的大量级降水事件预报能力更强。（3）对流尺度降水预报考虑时间尺度与降水强度存在着对应关系,不同时间尺度可以捕获到不同量级降水的时间不确定性。同时,时间尺度与空间尺度对于降水预报效果的影响是相互关联的。（4）改进的邻域概率法能够同时体现高分辨率模式预报结果在对流尺度降水事件上存在的时、空不确定性,实现了对流尺度降水在时、空尺度上的综合评估,并能为不同量级降水提供与其时、空尺度相匹配的概率预报结果。      

中国夏季降水多模式集成概率预报研究

基于TIGGE资料中的中国气象局（CMA）、欧洲中期天气预报中心（ECMWF）、日本气象厅（JMA）、美国国家环境预报中心（NCEP）以及英国气象局（UKMO）五个中心2007-2011年5月25日-8月31日中国地区逐日12-36 h、36-60 h、60-84 h、84-108 h、108-132 h与132-156 h累积降水集合预报资料,分别利用PoorMan （POOL）和多模式消除偏差（MBRE）两种方法对2011年各中心降水概率预报进行集成,并采用RPS和BS评分方法对预报效果进行评估。结果表明,对于12-156 h逐24 h累积降水量概率预报,多模式集成预报效果优于单模式预报效果,且多模式消除偏差概率预报效果最好;针对小雨、中雨以及大雨以上降水,PoorMan和MBRE概率预报较单中心预报效果均有提高,MBRE概率预报效果优于PoorMan方法。     

INTEGRATED FRACTIONS SKILL SCORE FOR THE ASSESSMENT OF PRECIPITATION

Traditional skill scores (e.g., the threat score) used in the high-resolution verification of precipitation are affected by a “double penalty” caused by slight spatial or temporal displacements, which can lead to misleading evaluations. The fractions skill score (FSS) is a popular spatial verificaiton measure that can be used to solve these problems. It can determine useful and skillful scores by neighborhood analysis, which can be used to monitor the performance of operational forecasts. However, the FSS provides different scores at each spatial scale and it is difficult to obtain a definite score for the assessment of precipitation to analyze the temporal variabilities of daily forecasts. We previously reported a modified FSS assessment method and showed that a particular analysis scale had a significant advantage in the verification of operational forecasts of precipitation. To compensate for the lack of artificial definition in the analysis scale, we report here a new integrated score that satisfies a Gaussian weight function to average the FSS over all scales. We describe the advantages of the new score in the verification of forecasts of daily and hourly precipitation, taking forecast products from the GRAPES regional model and quantitative precipitation estimation products from the National Meteorological Information Center during June and July 2017 and investigating the differences between these results and those obtained with the traditional category score. We found that a value of 0.5 can be used as a standard for the skillful FSS in the forecast of heavy rainfall. The integrated score can maintain all the advantages seen in previous studies in the verification of daily and hourly precipitation and show excellent application prospects. The long-term verification including different seasons also find that the score can effectively improve the identification characteristics of the assessment.     

公里级CMA_MESO模式FSS评分技术研究

本文研究计算CMA_MESO模式预报降水FSS（Fractions Skill Score）评分时,当其水平分辨率与观测降水不一致时,采取两种匹配方式统一分辨率,分析这两种方式得到的FSS评分结果是否有差异。针对3 km分辨率CMA_MESO模式6 h累积降水,选取5 km分辨率的观测降水,分别采取预报降水匹配观测降水分辨率,以及观测降水匹配预报降水分辨率两种方式,选择4种邻域尺度：5、25、51和105 km;4种降水阈值：0.1、4、13和25 mm,得到两组不同预报时效的FSS评分。通过分析发现：两组FSS评分结果没有显著差异。研究结果表明,当CMA_MESO模式预报降水水平分辨率与观测降水不一致时,可以将预报降水匹配到观测降水格点场,也可以将观测降水匹配到预报降水格点场,两种匹配方式对FSS评分结果没有影响。     

三种高分辨率格点降水预报检验方法的对比

客观有效的评估高分辨率模式格点降水的预报能力,不仅是模式发展中的基础问题,而且直接关系到目前中国气象局主推的格点天气预报业务。以ECMWF(European Centre for Medium-Range Weather Forecasts)模式高分辨率降水格点预报资料、CMORPH(NOAA Climate Prediction Center Morphing Method)卫星与全国3×104个自动观测站的逐时降水量融合资料为基础,选择2015年6~8月55个降水个例,研究传统检验方法、面向对象MODE(Method for Object-based Diagnostic Evaluation)方法、以及邻域法在高分辨率格点降水预报检验中的适用性及优缺点,以期为高分辨率格点降水的预报性能评估提供参考。主要结论如下:(1)尽管点对点的传统方法在高分辨率格点降水检验中存在一定的局限,但传统方法能够在空间上表现高分辨率格点降水预报技巧的地域性差异,在时间上刻画预报的整体性能,对高分辨率格点预报性能评估仍然具有重要的适用价值;(2)邻域法的显著优点在于一方面能够通过变换邻域窗获得不同空间尺度上的传统预报技巧,另一方面独有的FSS(Fractions Skill Score)技巧评分能够表现预报相对于观测降水在格点数量上的比值,结合FSS和不同邻域窗上的传统技巧评分,可以判别在多大空间尺度上能够获得较好的预报技巧;(3)MODE方法在变换卷积半径的基础上提取降水对象,基于降水对象不仅能统计模式的传统技巧评分和预报性能的尺度变化,还可以表现降水对象的质心距离、轴角、面积、强度、综合收益、位移距离等多种属性,这些属性首先为用户提供了模式预报性能的多视角表现,其次从侧面定量描述了模式对天气系统发展快慢、槽脊强弱等预报误差,具有独特的优势,但如何应用对象属性来提高实际的预报能力还存在一些困难。