一种求解条件非线性最优扰动的快速算法及其在台风目标观测中的初步检验

条件非线性最优扰动(CNOP)是Mu等2003年提出的一个新的理论方法,它是线性奇异向量在非线性情形的推广,克服了线性奇异向量不能代表非线性系统最快发展扰动的缺陷,成为非线性系统可预报性和敏感性等研究新的有效工具.然而,由于以往CNOP的求解需要采用伴随技术,计算量相当巨大,限制了该方法的推广应用.为了克服这一困难,本文基于经验正交分解(EOF),提出了一种求解CNOP的快速算法,利用GRAPES区域业务预报模式实现了CNOP快速计算,并在台风"麦莎"的目标观测研究中得到初步检验,通过观测系统模拟实验(OSSE)检验了该方法确定敏感性区域(瞄准区)的有效性和可行性.试验结果表明,用快速算法求解的CNOP,其净能量随时间快速地发展,而且发展呈非线性.在台风"麦莎"个例的目标观测试验中,用快速算法得到的预报时间为24 h的CNOP可以有效地识别瞄准区,并通过瞄准区内初值的改善,可明显减少目标区域(检验区)内24 h累计降水预报误差.尤其,累计降水预报的这种改进效果能够延伸到更长时间(如72 h),尽管检验时间是设在第24小时.进一步分析发现,24 h累计降水预报误差的减少是通过利用瞄准区内改善的初值改进初始时刻台风暖心结构、高空相对涡度以及水汽条件等而得以实现的.     

Applications of Conditional Nonlinear Optimal Perturbation in Predictability Study and Sensitivity Analysis of Weather and Climate

Considering the limitation of the linear theory of singular vector (SV), the authors and their collaborators proposed conditional nonlinear optimal perturbation (CNOP) and then applied it in the predictability study and the sensitivity analysis of weather and climate system. To celebrate the 20th anniversary of Chinese National Committee for World Climate Research Programme (WCRP), this paper is devoted to reviewing the main results of these studies. First, CNOP represents the initial perturbation that has largest nonlinear evolution at prediction time, which is different from linear singular vector (LSV) for the large magnitude of initial perturbation or/and the long optimization time interval. Second, CNOP, rather than linear singular vector (LSV), represents the initial anomaly that evolves into ENSO events most probably. It is also the CNOP that induces the most prominent seasonal variation of error growth for ENSO predictability; furthermore, CNOP was applied to investigate the decadal variability of ENSO asymmetry. It is demonstrated that the changing nonlinearity causes the change of ENSO asymmetry. Third, in the studies of the sensitivity and stability of ocean’s thermohaline circulation (THC), the nonlinear asymmetric response of THC to finite amplitude of initial perturbations was revealed by CNOP. Through this approach the passive mechanism of decadal variation of THC was demonstrated; Also the authors studies the instability and sensitivity analysis of grassland ecosystem by using CNOP and show the mechanism of the transitions between the grassland and desert states. Finally, a detailed discussion on the results obtained by CNOP suggests the applicability of CNOP in predictability studies and sensitivity analysis.     

Optimal Initial Error Growth in the Prediction of the Kuroshio Large Meander Based on a High-resolution Regional Ocean Model

Based on the high-resolution Regional Ocean Modeling System(ROMS) and the conditional nonlinear optimal perturbation(CNOP) method, this study explored the effects of optimal initial errors on the prediction of the Kuroshio large meander(LM) path, and the growth mechanism of optimal initial errors was revealed. For each LM event, two types of initial error(denoted as CNOP1 and CNOP2) were obtained. Their large amplitudes were found located mainly in the upper 2500 m in the upstream region of the LM, i.e., southeast of Kyushu. Furthermore, we analyzed the patterns and nonlinear evolution of the two types of CNOP. We found CNOP1 tends to strengthen the LM path through southwestward extension. Conversely,CNOP2 has almost the opposite pattern to CNOP1, and it tends to weaken the LM path through northeastward contraction.The growth mechanism of optimal initial errors was clarified through eddy-energetics analysis. The results indicated that energy from the background field is transferred to the error field because of barotropic and baroclinic instabilities. Thus, it is inferred that both barotropic and baroclinic processes play important roles in the growth of CNOP-type optimal initial errors.     

The Impact of Moist Physics on the Sensitive Area Identification for Heavy Rainfall Associated Weather Systems

The impact of moist physics on the sensitive areas identified by conditional nonlinear optimal perturbation(CNOP)is examined based on four typical heavy rainfall cases in northern China through performing numerical experiments with and without moist physics.Results show that the CNOP with moist physics identifies sensitive areas corresponding to both the lower-(850?700 hPa)and upper-level(300?100 hPa)weather systems,while the CNOP without moist physics fails to capture the sensitive areas at lower levels.The reasons for the CNOP peaking at different levels can be explained in both algorithm and physics aspects.Firstly,the gradient of the cost function with respect to initial perturbations peaks at the upper level without moist physics which results in the upper-level peak of the CNOP,while it peaks at both the upper and lower levels with moist physics which results in both the upper-and lower-level peaks of the CNOP.Secondly,the upper-level sensitive area is associated with high baroclinicity,and these dynamic features can be captured by both CNOPs with and without moist physics.The lower-level sensitive area is associated with moist processes,and this thermodynamic feature can be captured only by the CNOP with moist physics.This result demonstrates the important contribution of the initial error of lower-level systems that are related to water vapor transportation to the forecast error of heavy rainfall associated weather systems,which could be an important reference for heavy rainfall observation targeting.     

Nonlinearity and Finite-Time Instability in a T21L3 Quasigeostrophic Model

In this paper,a nonlinear optimization method is used to explore the finite-time instability of the atmospheric circulation with a three-level quasigeostrophic model under the framework of the conditional nonlinear optimal perturbation (CNOP).As a natural generalization of linear singular vector (SV),CNOP is defined as an initial perturbation that makes the cost function the maximum at a prescribed forecast time under certain physical constraint conditions.Special attentions are paid to the different structures and energy evolutions of the optimal perturbations.The results show that the most instable region of the global atmospheric circulation lies in the midlatitude Eurasian continent.More specially,SV and CNOP in the total energy norm with an optimization time of 2 days both present localness:they are mainly located in the midlatitude Asian continent and its east coast.With extension of the optimization time,SVs are more upstream and less localized in the zonal direction,and CNOPs differ essentially from SVs with broader zonal and meridional coverages; as a result,CNOPs acquire larger kinetic and available potential energy amplifications than SVs in the nonlinear model at the corresponding optimization time.For the climatological wintertime flow,it is seen that the baroclinic terms remain small over the entire time evolution,and the energy production comes essentially from the eddy kinetic energy,which is induced by the horizontal shear of the basic flow.In addition,the effects of SVs and CNOPs on the Eurasian atmospheric circulation are explored.The results show that the weather systems over the Eurasian continent in the perturbed fields by CNOPs are stronger than those by SVs at the optimization time.This reveals that the CNOP method is better in evaluating the instability of the atmospheric circulation while the SV method underestimates the possibility of extreme weather events.     

遗传算法求解最大预报误差的可行性研究

利用条件非线性最优扰动（conditional nonlinear optimal perturbation,CNOP）可以实现最大预报误差的上界估计。CNOP通常由基于梯度信息的约束优化算法进行求解,且其中的梯度信息由伴随模式提供。然而当非线性模式中含不连续＂开关＂时,传统伴随方法不能为优化过程提供正确的梯度方向,从而导致优化失败。为此,采用自适应变异和混合交叉的遗传算法,联赛选择机制和小生境技术的约束处理方法来求解最大预报误差上界。为检验新方法的有效性,以修改的Lorenz模型作为预报模式,对3个初始态分别用新方法和传统伴随方法进行比较,数值试验结果显示新方法求解出的最大预报误差的上界更加精确。     

Exploring the phase-strength asymmetry of the North Atlantic Oscillation using conditional nonlinear optimal perturbation

Negative-phase North Atlantic Oscillation(NAO) events are generally stronger than positive-phase ones, i.e., there is a phase-strength asymmetry of the NAO. In this work, we explore this asymmetry of the NAO using the conditional nonlinear optimal perturbation(CNOP) method with a three-level global quasi-geostrophic spectral model. It is shown that, with winter climatological flow forcing, the CNOP method identifies the perturbations triggering the strongest NAO event under a given initial constraint. Meanwhile, the phase-strength asymmetry characteristics of the NAO can be revealed. By comparing with linear results, we find that the process of perturbation self-interaction promotes the onset of negative NAO events, which is much stronger than during positive NAO onset. Results are obtained separately using the climatological and zonal-mean flows in boreal winter(December–February) 1979–2006 as the initial basic state. We conclude, based on the fact that NAO onset is a nonlinear initial-value problem, that phase-strength asymmetry is an intrinsic characteristic of the NAO.     

Algorithm Studies on How to Obtain a Conditional Nonlinear Optimal Perturbation (CNOP)

The conditional nonlinear optimal perturbation (CNOP), which is a nonlinear generalization of the linear singular vector (LSV), is applied in important problems of atmospheric and oceanic sciences, including ENSO predictability, targeted observations, and ensemble forecast. In this study, we investigate the computational cost of obtaining the CNOP by several methods. Differences and similarities, in terms of the computational error and cost in obtaining the CNOP, are compared among the sequential quadratic programming (SQP) algorithm, the limited memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) algorithm, and the spectral projected gradients (SPG2) algorithm. A theoretical grassland ecosystem model and the classical Lorenz model are used as examples. Numerical results demonstrate that the computational error is acceptable with all three algorithms. The computational cost to obtain the CNOP is reduced by using the SQP algorithm. The experimental results also reveal that the L-BFGS algorithm is the most effective algorithm among the three optimization algorithms for obtaining the CNOP. The numerical results suggest a new approach and algorithm for obtaining the CNOP for a large-scale optimization problem.     

An Adjoint-Free CNOP–4DVar Hybrid Method for Identifying Sensitive Areas in Targeted Observations: Method Formulation and Preliminary Evaluation

This paper proposes a hybrid method, called CNOP–4 DVar, for the identification of sensitive areas in targeted observations, which takes the advantages of both the conditional nonlinear optimal perturbation(CNOP) and four-dimensional variational assimilation(4 DVar) methods. The proposed CNOP–4 DVar method is capable of capturing the most sensitive initial perturbation(IP), which causes the greatest perturbation growth at the time of verification; it can also identify sensitive areas by evaluating their assimilation effects for eliminating the most sensitive IP. To alleviate the dependence of the CNOP–4 DVar method on the adjoint model, which is inherited from the adjoint-based approach, we utilized two adjointfree methods, NLS-CNOP and NLS-4 DVar, to solve the CNOP and 4 DVar sub-problems, respectively. A comprehensive performance evaluation for the proposed CNOP–4 DVar method and its comparison with the CNOP and CNOP–ensemble transform Kalman filter(ETKF) methods based on 10 000 observing system simulation experiments on the shallow-water equation model are also provided. The experimental results show that the proposed CNOP–4 DVar method performs better than the CNOP–ETKF method and substantially better than the CNOP method.     

伴随敏感性方法、第一奇异向量方法以及条件非线性最优扰动方法在台风目标观测敏感区识别中的比较研究

本文通过深入分析伴随敏感性（ADS）方法、第一奇异向量（LSV）方法、以及条件非线性最优扰动（CNOP）方法在目标观测敏感区识别方面的原理,提出了非线性程度的概念和计算方法,考察了转向型和直线型台风的非线性程度,分析了上述三种方法在不同非线性程度下识别的敏感区的异同,同时对比了转向型和直线型台风的敏感区的差异,并通过敏感性试验探讨了在不同非线性程度下以及在转向型与直线型台风中,预报对敏感区内初值的敏感性程度,进而探讨台风目标观测在不同情况下的有效性。结果表明,转向型台风的非线性程度差别比较大,或者特别强,或者特别弱;而直线型台风非线性程度居中,不同台风个例之间的非线性程度差别较小。对于非线性较弱的台风,三种方法识别的敏感区较为相似,而对于非线性较强的台风,LSV方法与ADS方法识别的敏感区较为相似,但是与CNOP方法识别的敏感区具有较大的差别。对于转向型台风,敏感区主要位于行进路径的右前方,而对于直线型台风,敏感区主要位于初始台风位置的后方。敏感性试验表明,不论台风非线性强弱,转向还是直行,CNOP敏感区内的随机扰动发展最大,而LSV敏感区内叠加的随机扰动发展次之,ADS敏感区内叠加的扰动发展最小;此外,非线性弱的台风,扰动的发展大于非线性强的台风的扰动的发展,表明非线性弱的台风预报受初值影响更大,目标观测的效果可能会更明显。     

A Preliminary Application of the Differential Evolution Algorithm to Calculate the CNOP

A projected skill is adopted by use of the differential evolution （DE） algorithm to calculate a conditional nonlinear optimal perturbation （CNOP）. The CNOP is the maximal value of a constrained optimization problem with a constraint condition, such as a ball constraint. The success of the DE algorithm lies in its ability to handle a non-differentiable and nonlinear cost function. In this study, the DE algorithm and the traditional optimization algorithms used to obtain the CNOPs are compared by analyzing a theoretical grassland ecosystem model and a dynamic global vegetation model. This study shows that the CNOPs generated by the DE algorithm are similar to those by the sequential quadratic programming （SQP） algorithm and the spectral projected gradients （SPG2） algorithm. If the cost function is non-differentiable, the CNOPs could also be caught with the DE algorithm. The numerical results suggest the DE algorithm can be employed to calculate the CNOP, especially when the cost function is non-differentiable.     

Role of Parameter Errors in the Spring Predictability Barrier for ENSO Events in the Zebiak–Cane Model

ABSTRACT The impact of both initial and parameter errors on the spring predictability barrier （SPB） is investigated using the Zebiak Cane model （ZC model）. Previous studies have shown that initial errors contribute more to the SPB than parameter errors in the ZC model. Although parameter errors themselves are less important, there is a possibility that nonlinear interactions can occur between the two types of errors, leading to larger prediction errors compared with those induced by initial errors alone. In this case, the impact of parameter errors cannot be overlooked. In the present paper, the optimal combination of these two types of errors [i.e., conditional nonlinear optimal perturbation （CNOP） errors] is calculated to investigate whether this optimal error combination may cause a more notable SPB phenomenon than that caused by initial errors alone. Using the CNOP approach, the CNOP errors and CNOP-I errors （optimal errors when only initial errors are considered） are calculated and then three aspects of error growth are compared： （1） the tendency of the seasonal error growth; （2） the prediction error of the sea surface temperature anomaly; and （3） the pattern of error growth. All three aspects show that the CNOP errors do not cause a more significant SPB than the CNOP-I errors. Therefore, this result suggests that we could improve the prediction of the E1 Nifio during spring by simply focusing on reducing the initial errors in this model.     

THE EFFECTIVENESS OF GENETIC ALGORITHM IN CAPTURING CONDITIONAL NONLINEAR OPTIMAL PERTURBATION WITH PARAMETERIZATION "ON-OFF" SWITCHES INCLUDED BY A MODEL

In the typhoon adaptive observation based on conditional nonlinear optimal perturbation (CNOP), the ‘on-off’ switch caused by moist physical parameterization in prediction models prevents the conventional adjoint method from providing correct gradient during the optimization process. To address this problem, the capture of CNOP, when the on-off switches are included in models, is treated as non-smooth optimization in this study, and the genetic algorithm (GA) is introduced. After detailed algorithm procedur...     

条件非线性最优扰动方法在黑潮目标观测研究中的应用

对近年来利用条件非线性最优扰动（Conditional Nonlinear Optimal Perturbation,CNOP）方法开展的黑潮目标观测研究进行了总结,主要包括日本南部黑潮路径变异的目标观测研究、黑潮延伸体模态转变的目标观测研究和源区黑潮流量变化的目标观测研究。通过计算这些事件的CNOP型扰动,发现这些事件的CNOP型扰动具有局地特征,可以作为实施目标观测的敏感区。理想回报试验结果表明,如果在由CNOP方法识别的敏感区内实施目标观测,则会大幅度提高上述事件的预报技巧。     

Inducing Unstable Grassland Equilibrium States Due to Nonlinear Optimal Patterns of Initial and Parameter Perturbations: Theoretical Models

Due to uncertainties in initial conditions and parameters,the stability and uncertainty of grassland ecosystem simulations using ecosystem models are issues of concern.Our objective is to determine the types and patterns of initial and parameter perturbations that yield the greatest instability and uncertainty in simulated grassland ecosystems using theoretical models.We used a nonlinear optimization approach,i.e.,a conditional nonlinear optimal perturbation related to initial and parameter perturbations (CNOP) approach,in our work.Numerical results indicated that the CNOP showed a special and nonlinear optimal pattern when the initial state variables and multiple parameters were considered simultaneously.A visibly different complex optimal pattern characterizing the CNOPs was obtained by choosing different combinations of initial state variables and multiple parameters in different physical processes.We propose that the grassland modeled ecosystem caused by the CNOP-type perturbation is unstable and exhibits two aspects:abrupt change and the time needed for the abrupt change from a grassland equilibrium state to a desert equilibrium state when the initial state variables and multiple parameters are considered simultaneously.We compared these findings with results affected by the CNOPs obtained by considering only uncertainties in initial state variables and in a single parameter.The numerical results imply that the nonlinear optimal pattern of initial perturbations and parameter perturbations,especially for more parameters or when special parameters are involved,plays a key role in determining stabilities and uncertainties associated with a simulated or predicted grassland ecosystem.     

The Impact of Horizontal Resolution on the CNOP and on Its Identified Sensitive Areas for Tropical Cyclone Predictions

In this study,the impacts of horizontal resolution on the conditional nonlinear optimal perturbation (CNOP) and on its identified sensitive areas were investigated for tropical cyclone predictions.Three resolutions,30 km,60 km,and 120 km,were studied for three tropical cyclones,TC Mindulle (2004),TC Meari (2004),and TC Matsa (2005).Results show that CNOP may present different structures with different resolutions,and the major parts of CNOP become increasingly localized with increased horizontal resolution.CNOP produces spiral and baroclinic structures,which partially account for its rapid amplification.The differences in CNOP structures result in different sensitive areas,but there are common areas for the CNOP-identified sensitive areas at various resolutions,and the size of the common areas is different from case to case.Generally,the forecasts benefit more from the reduction of the initial errors in the sensitive areas identified using higher resolutions than those using lower resolutions.However,the largest improvement of the forecast can be obtained at the resolution that is not the highest for some cases.In addition,the sensitive areas identified at lower resolutions are also helpful for improving the forecast with a finer resolution,but the sensitive areas identified at the same resolution as the forecast would be the most beneficial.     

CONDITIONAL NONLINEAR OPTIMAL PERTURBATIONS: APPLICATION IN TROPICAL CYCLONE FORECASTS

Considering the feature of tropical cyclones (TCs) that strong positive vorticity exists in the lower layers of troposphere, this study proposed to use vorticity at 850 hPa as cost function to find the conditional nonlinear optimal perturbation (CNOP), which was largely different from those previous studies using total energy of perturbed forecast variables. The CNOP was obtained by an ensemble-based approach. All of the sensitive areas determined by CNOP with vorticity at 850 hPa as cost function for the three cases were located over the TC core region and its vicinity. The impact of the CNOP-based adaptive observations on TC forecasts was evaluated with three cases via observational system simulation experiments (OSSEs). Results showed obvious improvements in TC intensity or track forecasts due to the CNOP-based adaptive observations, which were related to the main error source of the verification area, i.e., intensity error or location error.     

INTELLIGENT ALGORITHMS FOR SOLVING CNOP AND THEIR APPLICATIONS IN ENSO PREDICTABILITY AND TROPICAL CYCLONE ADAPTIVE OBSERVATIONS

Some intelligent algorithms (IAs) proposed by us, including swarm IAs and single individual IAs, have been applied to the Zebiak-Cane (ZC) model to solve conditional nonlinear optimal perturbation (CNOP) for studying El Ni?o – Southern Oscillation (ENSO) predictability. Compared to the adjoint-based method (the ADJ-method), which is referred to as a benchmark, these IAs can achieve approximate CNOP results in terms of magnitudes and patterns. Using IAs to solve CNOP can avoid the use of an adjoint model and widen the application of CNOP in numerical climate and weather modeling. Of the proposed swarm IAs, PCA-based particle swarm optimization (PPSO) obtains CNOPs with the best patterns and the best stability. Of the proposed single individual IAs, continuous tabu search algorithm with sine maps and staged strategy (CTS-SS) has the highest efficiency. In this paper, we compare the validity, stability and efficiency of parallel PPSO and CTS-SS using these two IAs to solve CNOP in the ZC model for studying ENSO predictability. The experimental results show that CTS-SS outperforms parallel PPSO except with respect to stability. At the same time, we are also concerned with whether these two IAs can effectively solve CNOP when applied to more complicated models. Taking the sensitive areas identification of tropical cyclone adaptive observations as an example and using the fifth-generation mesoscale model (MM5), we design some experiments. The experimental results demonstrate that each of these two IAs can effectively solve CNOP and that parallel PPSO has a higher efficiency than CTS-SS. We also provide some suggestions on how to choose a suitable IA to solve CNOP for different models.     

A Fast Algorithm for Solving CNOP and Associated Target Observation Tests

Conditional Nonlinear Optimal Perturbation （CNOP） is a new method proposed by Mu et al. in 2003, which generalizes the linear singular vector （LSV） to include nonlinearity. It has become a powerful tool for studying predictability and sensitivity among other issues in nonlinear systems. This is because the CNOP is able to represent, while the LSV is unable to deal with, the fastest developing perturbation in a nonlinear system. The wide application of this new method, however, has been limited due to its large computational cost related to the use of an adjoint technique. In order to greatly reduce the computational cost, we hereby propose a fast algorithm for solving the CNOP based on the empirical orthogonal function （EOF）. The algorithm is tested in target observation experiments of Typhoon Matsa using the Global/Regional Assimilation and PrEdiction System （GRAPES）, an operational regional forecast model of China. The effectivity and feasibility of the algorithm to determine the sensitivity （target） area is evaluated through two observing system simulation experiments （OSSEs）. The results, as expected, show that the energy of the CNOP solved by the new algorithm develops quickly and nonlinearly. The sensitivity area is effectively identified with the CNOP from the new algorithm, using 24 h as the prediction time window. The 24-h accumulated rainfall prediction errors （ARPEs） in the verification region are reduced significantly compared with the ＂true state,＂ when the initial conditions （ICs） in the sensitivity area are replaced with the ＂observations.＂ The decrease of the ARPEs can be achieved for even longer prediction times （e.g., 72 h）. Further analyses reveal that the decrease of the 24-h ARPEs in the verification region is attributable to improved simulations of the typhoon＇s initial warm-core, upper level relative vorticity, water vapor conditions, etc., as a result of the updated ICs in the sensitivity area.     

A New Approach for Parameter Optimization in Land Surface Model

In this study,a new parameter optimization method was used to investigate the expansion of conditional nonlinear optimal perturbation (CNOP) in a land surface model (LSM) using long-term enhanced field observations at Tongyu station in Jilin Province,China,combined with a sophisticated LSM (common land model,CoLM).Tongyu station is a reference site of the international Coordinated Energy and Water Cycle Observations Project (CEOP) that has studied semiarid regions that have undergone desertification,salination,and degradation since late 1960s.In this study,three key land-surface parameters,namely,soil color,proportion of sand or clay in soil,and leaf-area index were chosen as parameters to be optimized.Our study comprised three experiments:First,a single-parameter optimization was performed,while the second and third experiments performed triple-and six-parameter optimizations,respectively.Notable improvements in simulating sensible heat flux (SH),latent heat flux (LH),soil temperature (TS),and moisture (MS) at shallow layers were achieved using the optimized parameters.The multiple-parameter optimization experiments performed better than the single-parameter experminent.All results demonstrate that the CNOP method can be used to optimize expanded parameters in an LSM.Moreover,clear mathematical meaning,simple design structure,and rapid computability give this method great potential for further application to parameter optimization in LSMs.