Climate of Russia in the 21st century. Part 3. Future climate changes calculated with an ensemble of coupled atmosphere-ocean general circulation CMIP3 models

Probable climate changes in Russia in the 21st century are considered based on the results of global climate simulations with an ensemble of coupled atmosphere-ocean CMIP3 models. The future changes in the surface air temperature, atmospheric pressure, cloud amount, atmospheric precipitation, snow cover, soil water content, and annual runoff in Russia and some of its regions in the early, middle, and late 21st century are analyzed using the A2 scenario of the greenhouse gas and aerosol emission. Future changes in the yearly highest and lowest surface air temperatures and in summer precipitation of high intensity are estimated for Russia. Possible oscillations of the Caspian Sea level associated with the expected global climate warming are estimated. In addition to the estimates of the ensemble mean changes in climatic characteristics, the information about standard deviations and statistical significance of the corresponding climate changes is given.     

CMIP5多模式对阿留申低压气候特征的模拟检验与预估

利用观测的海温资料和海平面气压资料,检验了CMIP5(Coupled Model Intercomparison Project 5,CMIP5)多模式对阿留申低压(Aleutian Low,AL)特征指数的时空分布和变化的模拟能力;从AL周期及变化趋势等方面,分析了CMIP5模式预估的未来AL的变化特征。结果表明,CMIP5模式及其集合平均能够很好地模拟AL的环流结构,对AL的气候态有着较强的模拟能力,尤其是模式对于东太平洋海表温度的模拟能力直接影响其对于AL的模拟效果。模式的集合平均对变率强度的模拟偏强,且对于变率的模拟效果逊于对气候态的模拟。22个模式中的16个模式能模拟出AL强度指数的年代际变化周期,对年代际周期有着较好的刻画能力。Historical试验下对于AL的变化趋势存在着较大的不确定性,而相对于两种不同排放情景,随着排放的增加,AL更加偏北,强度增强,年际、年代际周期变得更加显著。在两种排放情景下模式的集合平均以及多数模式模拟出AL有着向北和增强的趋势。     

CMIP5模式对中国东北气候模拟能力的评估

利用CN05观测资料和参与IPCC第五次评估报告的45个全球气候系统模式的模拟结果,分析了新一代全球气候模式对中国东北三省(1961~2005年)气温和降水的模拟能力。结果表明:1)绝大多数模式都能较好地模拟出研究区内显著增温的趋势,对气温的年际变化模拟能力则相对有限;2)所有模式均能很好地再现气温气候态的空间分布特征,且多模式集合模拟结果优于绝大多数单个模式,空间相关系数达到了0.96;3)对于降水的模拟结果,模式间差异较大,多模式集合能较好地再现其空间分布规律(空间相关系数为0.86),对降水年际变化及线性变化趋势的模拟能力则较差。总体来说,多模式集合对东北气候的时空变化特征具有一定的模拟能力,且对气温模拟效果优于降水,对空间分布的模拟能力优于时间变化。     

CMIP5多模式对东亚地区地面气温年际变率的回报研究

对CMIP5全球气候模式中年代际回报试验的气温资料及其简单集合平均(Multi-model ensemble mean,EMN)和贝叶斯模式平均的结果(Bayesian Model Averaging,BMA)进行经验正交函数(Empirical Orthogonal Function,EOF)分解和Morlet小波分析,检验评估各个模式及其EMN和BMA对东亚地面气温的方差、气温时空分布特征及周期变化的回报能力。结果表明,10个模式、EMN、BMA都能很好地回报出1981—2010年东亚地面气温的方差分布,其中BMA回报效果最好。EOF分析表明,BMA能较好地回报出东亚地面气温第一模态的时空分布。MIROC5能较好地回报出第二模态的趋势变化,但却不能回报出气温的年际变率。绝大多数模式和EMN、BMA虽然能回报出东亚地面气温的变化趋势,但是对气温年际变率的回报仍然是比较困难的。CMCC-CM对气温变化主模态的3~5 a的周期变化特征回报效果最好,和NCEP资料的结果最为接近。     

CMIP5模式对中国年平均气温模拟及其与CMIP3模式的比较

利用CRUT3v和CN05两套观测资料,评估25个CMIP5模式对1906-2005年中国年平均气温变化的模拟能力,并与CMIP3模式对比。结果表明：1906-2005年中国平均温升速率为0.84℃/100a,CMIP5多模式集合平均模拟的增温率为0.77℃/100a。模式对20世纪后期温升模拟好于前期,仅有两个模式能模拟中国20世纪40年代异常增暖。模式对气温气候态空间分布模拟较好,但在中国西部地区存在最大模拟冷偏差和不确定性。1961-1999年,中国北方增暖大于南方。多模式集合平均可以较好地模拟气温变化线性趋势的空间分布,但对南北气温变化趋势的差异模拟过小。总体说来,在中国平均气温变化趋势、气温气候态空间分布和气温变化趋势空间分布三方面,CMIP5模式都较CMIP3模式有所提高。     

Assessment of different metrics for physical climate feedbacks

We quantify the feedbacks from the physical climate system on the radiative forcing for idealized climate simulations using four different methods. The results differ between the methods and differences are largest for the cloud feedback. The spatial and temporal variability of each feedback is used to estimate the averaging scale necessary to satisfy the feedback concept of one constant global mean value. We find that the year-to-year variability, combined with the methodological differences, in estimates of the feedback strength from a single model is comparable to the model-to-model spread in feedback strength of the CMIP3 ensemble. The strongest spatial and temporal variability is in the short-wave component of the cloud feedback. In our simulations, where many sources of natural variability are neglected, long-term averages are necessary to get reliable feedback estimates. Considering the large natural variability and relatively small forcing present in the real world, as compared to the forcing imposed by doubling CO₂ concentrations in the simulations, implies that using observations to constrain feedbacks is a challenging task and requires reliable long-term measurements.     

An analysis of global model projections over Italy, with particular attention to the Italian Greater Alpine Region (GAR)

This study surveys the most recent projections of future climate change provided by 20 Atmospheric-Ocean General Circulation Models (AOGCMs) participating in the Coupled Model Intercomparison Project 3 (CMIP3) with focus on the Italian region and in particular on the Italian Greater Alpine Region (GAR). We analyze historical and future simulations of monthly-mean surface air temperature (T) and total precipitation (P). We first compare simulated T and P from the AOGCMs with observations over Italy for the period 1951–2000, using bias indices as a metric for estimating the performance of each model. Using these bias indices and different ensemble averaging methods, we construct ensemble mean projections of future climate change over these regions under three different IPCC emission scenarios (A2, A1B, and B1). We find that the emissions pathway chosen has a greater impact on future simulated climate than the criteria used to obtain the ensemble means. Across all averaging methods and emission scenarios, the models project annual mean increase in T of 2–4°C over the period 1990–2100, with more pronounced increases in summer and warming of similar magnitude at high and low elevations areas (according to a threshold of 400 m). The models project decreases in annual-mean P over this same time period both over the Italian and GAR regions. This decrease is more pronounced over Italy, since a small increase in precipitation over the GAR is projected in the winter season.     

Evaluation of the performance of CMIP5 and CMIP6 models in simulating the South Pacific Quadrupole-ENSO relationship

先前的观测研究表明,南太平洋四极子海温模态(SPQ)可以有效地作为ENSO的前兆信号.本文利用20个CMIP6模式及其对应的20个先前的CMIP5模式的工业化前气候模拟试验数据,评估和比较了CMIP6以及CMIP5模式对SPQ与ENSO的关系的模拟能力.结果表明,大多数CMIP5和CMIP6模式可以合理地模拟SPQ的基...     

Climate model dependence and the replicate Earth paradigm

Multi-model ensembles are commonly used in climate prediction to create a set of independent estimates, and so better gauge the likelihood of particular outcomes and better quantify prediction uncertainty. Yet researchers share literature, datasets and model code—to what extent do different simulations constitute independent estimates? What is the relationship between model performance and independence? We show that error correlation provides a natural empirical basis for defining model dependence and derive a weighting strategy that accounts for dependence in experiments where the multi-model mean would otherwise be used. We introduce the “replicate Earth” ensemble interpretation framework, based on theoretically derived statistical relationships between ensembles of perfect models (replicate Earths) and observations. We transform an ensemble of (imperfect) climate projections into an ensemble whose mean and variance have the same statistical relationship to observations as an ensemble of replicate Earths. The approach can be used with multi-model ensembles that have varying numbers of simulations from different models, accounting for model dependence. We use HadCRUT3 data and the CMIP3 models to show that in out of sample tests, the transformed ensemble has an ensemble mean with significantly lower error and much flatter rank frequency histograms than the original ensemble.     

Projected increased risk of water deficit over major West African river basins under future climates

Despite decades of research, large multi-model uncertainty remains about the Earth’s equilibrium climate sensitivity to carbon dioxide forcing as inferred from state-of-the-art Earth system models (ESMs). Statistical treatments of multi-model uncertainties are often limited to simple ESM averaging approaches. Sometimes models are weighted by how well they reproduce historical climate observations. Here, we propose a novel approach to multi-model combination and uncertainty quantification. Rather than averaging a discrete set of models, our approach samples from a continuous distribution over a reduced space of simple model parameters. We fit the free parameters of a reduced-order climate model to the output of each member of the multi-model ensemble. The reduced-order parameter estimates are then combined using a hierarchical Bayesian statistical model. The result is a multi-model distribution of reduced-model parameters, including climate sensitivity. In effect, the multi-model uncertainty problem within an ensemble of ESMs is converted to a parametric uncertainty problem within a reduced model. The multi-model distribution can then be updated with observational data, combining two independent lines of evidence. We apply this approach to 24 model simulations of global surface temperature and net top-of-atmosphere radiation response to abrupt quadrupling of carbon dioxide, and four historical temperature data sets. Our reduced order model is a 2-layer energy balance model. We present probability distributions of climate sensitivity based on (1) the multi-model ensemble alone and (2) the multi-model ensemble and observations.     

Transient climate changes in a perturbed parameter ensemble of emissions-driven earth system model simulations

We describe results from a 57-member ensemble of transient climate change simulations, featuring simultaneous perturbations to 54 parameters in the atmosphere, ocean, sulphur cycle and terrestrial ecosystem components of an earth system model (ESM). These emissions-driven simulations are compared against the CMIP3 multi-model ensemble of physical climate system models, used extensively to inform previous assessments of regional climate change, and also against emissions-driven simulations from ESMs contributed to the CMIP5 archive. Members of our earth system perturbed parameter ensemble (ESPPE) are competitive with CMIP3 and CMIP5 models in their simulations of historical climate. In particular, they perform reasonably well in comparison with HadGEM2-ES, a more sophisticated and expensive earth system model contributed to CMIP5. The ESPPE therefore provides a computationally cost-effective tool to explore interactions between earth system processes. In response to a non-intervention emissions scenario, the ESPPE simulates distributions of future regional temperature change characterised by wide ranges, and warm shifts, compared to those of CMIP3 models. These differences partly reflect the uncertain influence of global carbon cycle feedbacks in the ESPPE. In addition, the regional effects of interactions between different earth system feedbacks, particularly involving physical and ecosystem processes, shift and widen the ESPPE spread in normalised patterns of surface temperature and precipitation change in many regions. Significant differences from CMIP3 also arise from the use of parametric perturbations (rather than a multimodel ensemble) to represent model uncertainties, and this is also the case when ESPPE results are compared against parallel emissions-driven simulations from CMIP5 ESMs. When driven by an aggressive mitigation scenario, the ESPPE and HadGEM2-ES reveal significant but uncertain impacts in limiting temperature increases during the second half of the twenty-first century. Emissions-driven simulations create scope for development of errors in properties that were previously prescribed in coupled ocean–atmosphere models, such as historical CO₂ concentrations and vegetation distributions. In this context, historical intra-ensemble variations in the airborne fraction of CO₂ emissions, and in summer soil moisture in northern hemisphere continental regions, are shown to be potentially useful constraints, subject to uncertainties in the relevant observations. Our results suggest that future climate-related risks can be assessed more comprehensively by updating projection methodologies to support formal combination of emissions-driven perturbed parameter and multi-model earth system model simulations with suitable observational constraints. This would provide scenarios underpinned by a more complete representation of the chain of uncertainties from anthropogenic emissions to future climate outcomes.     

Simulation of tropical cyclone activity over the western North Pacific based on CMIP5 models

Based on the Coupled Model Inter-comparison Project 5 (CMIP5) models, the tropical cyclone (TC) activity in the summers of 1965–2005 over the western North Pacific (WNP) is simulated by a TC dynamically downscaling system. In consideration of diversity among climate models, Bayesian model averaging (BMA) and equal-weighed model averaging (EMA) methods are applied to produce the ensemble large-scale environmental factors of the CMIP5 model outputs. The environmental factors generated by BMA and EMA methods are compared, as well as the corresponding TC simulations by the downscaling system. Results indicate that BMA method shows a significant advantage over the EMA. In addition, impacts of model selections on BMA method are examined. To each factor, ten models with better performance are selected from 30 CMIP5 models and then conduct BMA, respectively. As a consequence, the ensemble environmental factors and simulated TC activity are similar with the results from the 30 models’ BMA, which verifies the BMA method can afford corresponding weight for each model in the ensemble based on the model’s predictive skill. Thereby, the existence of poor performance models will not particularly affect the BMA effectiveness and the ensemble outcomes are improved. Finally, based upon the BMA method and downscaling system, we analyze the sensitivity of TC activity to three important environmental factors, i.e., sea surface temperature (SST), large-scale steering flow, and vertical wind shear. Among three factors, SST and large-scale steering flow greatly affect TC tracks, while average intensity distribution is sensitive to all three environmental factors. Moreover, SST and vertical wind shear jointly play a critical role in the inter-annual variability of TC lifetime maximum intensity and frequency of intense TCs.     

Future Precipitation Extremes in China under Climate Change and Their Physical Quantification Based on a Regional Climate Model and CMIP5 Model Simulations

The atmospheric water holding capacity will increase with temperature according to Clausius-Clapeyron scaling and affects precipitation.The rates of change in future precipitation extremes are quantified with changes in surface air temperature.Precipitation extremes in China are determined for the 21st century in six simulations using a regional climate model,RegCM4,and 17 global climate models that participated in CMIP5.First,we assess the performance of the CMIP5 models and RCM runs in their simulation of extreme precipitation for the current period(RF:1982-2001).The CMIP5 models and RCM results can capture the spatial variations of precipitation extremes,as well as those based on observations:OBS and XPP.Precipitation extremes over four subregions in China are predicted to increase in the mid-future(MF:2039-58)and far-future(FF:2079-98)relative to those for the RF period based on both the CMIP5 ensemble mean and RCM ensemble mean.The secular trends in the extremes of the CMIP5 models are predicted to increase from 2008 to 2058,and the RCM results show higher interannual variability relative to that of the CMIP5 models.Then,we quantify the increasing rates of change in precipitation extremes in the MF and FF periods in the subregions of China with the changes in surface air temperature.Finally,based on the water vapor equation,changes in precipitation extremes in China for the MF and FF periods are found to correlate positively with changes in the atmospheric vertical wind multiplied by changes in surface specific humidity(significant at the p<0.1 level).     

An evaluation of the CMIP3 and CMIP5 simulations in their skill of simulating the spatial structure of SST variability

The natural sea surface temperature (SST) variability in the global oceans is evaluated in simulations of the Climate Model Intercomparison Project Phase 3 (CMIP3) and CMIP5 models. In this evaluation, we examine how well the spatial structure of the SST variability matches between the observations and simulations on the basis of their leading empirical orthogonal functions-modes. Here we focus on the high-pass filter monthly mean time scales and the longer 5 years running mean time scales. We will compare the models and observations against simple null hypotheses, such as isotropic diffusion (red noise) or a slab ocean model, to illustrate the models skill in simulating realistic patterns of variability. Some models show good skill in simulating the observed spatial structure of the SST variability in the tropical domains and less so in the extra-tropical domains. However, most models show substantial deviations from the observations and from each other in most domains and particularly in the North Atlantic and Southern Ocean on the longer (5 years running mean) time scale. In many cases the simple spatial red noise null hypothesis is closer to the observed structure than most models, despite the fact that the observed SST variability shows significant deviations from this simple spatial red noise null hypothesis. The CMIP models tend to largely overestimate the effective spatial number degrees of freedom and simulate too strongly localized patterns of SST variability at the wrong locations with structures that are different from the observed. However, the CMIP5 ensemble shows some improvement over the CMIP3 ensemble, mostly in the tropical domains. Further, the spatial structure of the SST modes of the CMIP3 and CMIP5 super ensemble is more realistic than any single model, if the relative explained variances of these modes are scaled by the observed eigenvalues.     

Emulating AOGCM results using simple climate models

Three simple climate models (SCMs) are calibrated using simulations from atmosphere ocean general circulation models (AOGCMs). In addition to using two conventional SCMs, results from a third simpler model developed specifically for this study are obtained. An easy to implement and comprehensive iterative procedure is applied that optimises the SCM emulation of global-mean surface temperature and total ocean heat content, and, if available in the SCM, of surface temperature over land, over the ocean and in both hemispheres, and of the global-mean ocean temperature profile. The method gives best-fit estimates as well as uncertainty intervals for the different SCM parameters. For the calibration, AOGCM simulations with two different types of forcing scenarios are used: pulse forcing simulations performed with 2 AOGCMs and gradually changing forcing simulations from 15 AOGCMs obtained within the framework of the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. The method is found to work well. For all possible combinations of SCMs and AOGCMs the emulation of AOGCM results could be improved. The obtained SCM parameters depend both on the AOGCM data and the type of forcing scenario. SCMs with a poor representation of the atmosphere thermal inertia are better able to emulate AOGCM results from gradually changing forcing than from pulse forcing simulations. Correct simultaneous emulation of both atmospheric temperatures and the ocean temperature profile by the SCMs strongly depends on the representation of the temperature gradient between the atmosphere and the mixed layer. Introducing climate sensitivities that are dependent on the forcing mechanism in the SCMs allows the emulation of AOGCM responses to carbon dioxide and solar insolation forcings equally well. Also, some SCM parameters are found to be very insensitive to the fitting, and the reduction of their uncertainty through the fitting procedure is only marginal, while other parameters change considerably. The very simple SCM is found to reproduce the AOGCM results as well as the other two comparably more sophisticated SCMs.     

Assessment of indices of temperature extremes simulated by multiple CMIP5 models over China

Given that climate extremes in China might have serious regional and global consequences, an increasing number of studies are examining temperature extremes in China using the Coupled Model Intercomparison Project Phase 5 (CMIP5) models. This paper investigates recent changes in temperature extremes in China using 25 state-of-the-art global climate models participating in CMIP5. Thirteen indices that represent extreme temperature events were chosen and derived by daily maximum and minimum temperatures, including those representing the intensity (absolute indices and threshold indices), duration (duration indices), and frequency (percentile indices) of extreme temperature. The overall performance of each model is summarized by a "portrait" diagram based on relative root-mean-square error, which is the RMSE relative to the median RMSE of all models, revealing the multi-model ensemble simulation to be better than individual model for most indices. Compared with observations, the models are able to capture the main features of the spatial distribution of extreme temperature during 1986-2005. Overall, the CMIP5 models are able to depict the observed indices well, and the spatial structure of the ensemble result is better for threshold indices than frequency indices. The spread amongst the CMIP5 models in different subregions for intensity indices is small and the median CMIP5 is close to observations; however, for the duration and frequency indices there can be wide disagreement regarding the change between models and observations in some regions. The model ensemble also performs well in reproducing the observational trend of temperature extremes. All absolute indices increase over China during 1961-2005.     

CMIP3及CMIP5模式对冬季和春季北极涛动变率模拟的比较

结合NCEP再分析资料,评估了28个参加第五次耦合模式比较计划（CMIP5）的耦合模式对1950-2000年冬、春季北极涛动（AO）变率的模拟能力,并与CMIP3模式模拟结果进行了对比。结果表明,尽管CMIP5模式没能模拟出冬、春季AO指数前30年处于显著的负位相期而后20年处于显著的正位相期的特征,但是基本能够模拟出冬、春季AO指数1950-2000年显著的增强趋势以及振荡周期,多模式集合改进了模拟效果。同样,CMIP3模式没能模拟出冬、春季AO指数前30年处于显著的负位相而后20年处于显著的正位相的特征,而且1950-2000年冬、春季AO指数的增强趋势在CMIP3模式模拟结果中也没有表现出来,多模式集合没有改进模式模拟效果。不仅如此,CMIP3模式对AO指数的长期变化周期模拟不好,只是模拟出了冬季周期为2～3 a的振荡,没有模拟出春季AO指数的4～5 a振荡周期。尽管CMIP5模式对冬、春季AO指数的模拟能力还不够理想,没有完全模拟出AO指数的变化特征,但是相对于CMIP3模式,无论是对AO指数变化趋势的模拟还是对其变化周期的模拟,CMIP5模式都有所提高。     

Uncertainty estimation of the global temperature trends for multiple radiosondes, reanalyses, and CMIP3/IPCC climate model simulations

Based on three groups of datasets that include radiosondes, reanalyses, and climate model simulations (e.g., Coupled Model Intercomparison Project, CMIP3) from 1979 to 2008, the interannual variability, global temperature trends, and their uncertainty using ensemble spread among intra-group and inter-group datasets have been discussed. The results show that the interannual temperature variability increased from the troposphere to stratosphere, and the maximum occurs around 50?hPa. The CMIP3 climate models have the largest discrepancy in the stratosphere. The intra-group correlations at 500?hPa generally show high similarity within each data group while the inter-group correlations between reanalyses and the CMIP3 climate model simulations indicate lesser similarity. In contrast, the inter-group correlation at 50?hPa is improved except with the Japanese 25-year Reanalysis Project (JRA-25) dataset, and the Twentieth Century Reanalysis (20CR) reanalysis shows a weak cross correlation. The global temperature trends are highly dependent on the individual data sources. Compared to the radiosondes, the reanalyses show a large ensemble spread of trends in the stratosphere, and the CMIP3 climate model simulations have a large ensemble spread in the height of the crossover point where tropospheric warming changes into stratospheric cooling. The largest ensemble spread among the reanalyses in the stratosphere is mainly from the large discrepancy in the JRA-25 reanalysis after 1998 and a relatively weak anomaly in the 20CR before 1986. The largest ensemble spread among the CMIP3 climate models in the troposphere is related to the influence of both volcanic eruptions and El Ni?o/La Ni?a–Southern Oscillation events. The strong anomalies corresponding to the volcanic eruptions of El Chichon in 1982 and Mt Pinatubo in 1991 are clearly identified in the stratosphere. These volcanic eruptions reduced the warming in the troposphere and strengthened the cooling in the stratosphere during the most recent 30?years.     

20个CMIP5模式对中亚地区年平均气温模拟能力评估

利用CMIP5中20个模式的历史模拟结果和英国东英格利亚大学CRU观测数据,采用泰勒图、趋势分析、滑动平均和EOF等方法从气候态和气候变率两方面检验各个模式对中亚年平均气温的模拟能力。结果表明：各模式能较好地模拟1951—2005年中亚地区显著增温趋势和年平均气温的空间分布特点,尤其是高、低值中心和等值线数值分布。泰勒图分析显示,大部分模式的均方根误差在0.5左右,空间相关系数在0.85～0.90之间,标准差在0.5～1.0之间。EOF分析结果表明,模式集合平均能够较好地表现出中亚气温一致升高以及南北反位相波动这两个主要模态的时空变化特征。     

ENSO representation in climate models: from CMIP3 to CMIP5

We analyse the ability of CMIP3 and CMIP5 coupled ocean–atmosphere general circulation models (CGCMs) to simulate the tropical Pacific mean state and El Niño-Southern Oscillation (ENSO). The CMIP5 multi-model ensemble displays an encouraging 30 % reduction of the pervasive cold bias in the western Pacific, but no quantum leap in ENSO performance compared to CMIP3. CMIP3 and CMIP5 can thus be considered as one large ensemble (CMIP3 + CMIP5) for multi-model ENSO analysis. The too large diversity in CMIP3 ENSO amplitude is however reduced by a factor of two in CMIP5 and the ENSO life cycle (location of surface temperature anomalies, seasonal phase locking) is modestly improved. Other fundamental ENSO characteristics such as central Pacific precipitation anomalies however remain poorly represented. The sea surface temperature (SST)-latent heat flux feedback is slightly improved in the CMIP5 ensemble but the wind-SST feedback is still underestimated by 20–50 % and the shortwave-SST feedbacks remain underestimated by a factor of two. The improvement in ENSO amplitudes might therefore result from error compensations. The ability of CMIP models to simulate the SST-shortwave feedback, a major source of erroneous ENSO in CGCMs, is further detailed. In observations, this feedback is strongly nonlinear because the real atmosphere switches from subsident (positive feedback) to convective (negative feedback) regimes under the effect of seasonal and interannual variations. Only one-third of CMIP3 + CMIP5 models reproduce this regime shift, with the other models remaining locked in one of the two regimes. The modelled shortwave feedback nonlinearity increases with ENSO amplitude and the amplitude of this feedback in the spring strongly relates with the models ability to simulate ENSO phase locking. In a final stage, a subset of metrics is proposed in order to synthesize the ability of each CMIP3 and CMIP5 models to simulate ENSO main characteristics and key atmospheric feedbacks.