基于局域化EnKF同时同化地下水水流和溶质运移数据的渗透系数场识别研究

局域化改进集合卡尔曼滤波（EnKF）可以克服EnKF方法在使用小集合时,对参数识别精度较低的缺陷,其能同化 地下水位观测数据有效识别渗透系数场。实际工作中,溶质运移数据也较容易获得。崔凯鹏（2013）尝试增加溶质运移 数据以改进只同化水流数据对渗透系数的估计结果,但是精度提高有限。本文在其基础上修改模型,进一步增加溶质注 入井,探究同时同化水头和溶质运移数据,对渗透系数场识别效果,之后对比了局域化EnKF与非局域化EnKF参数识别结 果,并分析了溶质影响范围与参数识别的关系。结果表明：同时同化溶质运移和水头资料,比同化单一种类观测数据识别 的渗透系数精度更高;相同实现数目下,局域化EnKF比EnKF对渗透系数场的估计结果与真实场更为接近;仅考虑溶质影 响范围内的渗透系数,同化水头数据在最后时刻参数识别结果好于同化溶质运移数据参数识别结果,但差别不大。     

非线性滤波方法与陆面数据同化

陆面数据同化研究近几年成为地球科学研究的新兴领域,其中以非线性滤波为代表的数据同化方法发展迅速并得到了广泛应用。在贝叶斯理论框架内,从递推贝叶斯估计理论的角度系统地分析了扩展卡尔曼滤波、无迹卡尔曼滤波、集合卡尔曼滤波、SIR粒子滤波等非线性滤波方法的异同;针对应用比较广泛的集合卡尔曼滤波和SIR粒子滤波应用中存在的问题,论述了几种提高滤波性能的实用方法,如协方差矩阵的Localization方法、协方差矩阵的Inflation方法、双集合卡尔曼滤波方法、扰动集合、扰动大气驱动和模型参数、平方根集合卡尔曼滤波以及粒子滤波算法的改进等。最后总结讨论了各种非线性滤波方法应用中的特点、难点以及各种算法在陆面数据同化中的应用前景和发展方向。     

EnKF同化的背景误差协方差矩阵局地化对比研究

在集合数据同化中,背景场误差的协方差估计特别重要。通常有限个成员的集合在估计背景误差协方差矩阵时会引入伪相关,从而造成协方差被低估、滤波发散。虽然协方差膨胀的经验性方法能一定程度缓解协方差被低估的问题,但不能消除协方差的伪相关问题。因此,结合EnKF方案探讨2种消除伪相关的局地化方法(协方差局地化方法和局地分析方法),分析这2种局地化方法对背景误差协方差矩阵、增益矩阵、集合转换矩阵以及同化结果的影响。实验结果表明:局地化方法不仅能消除背景误差协方差矩阵的伪相关,还可以增加背景误差协方差矩阵的秩;在"弱"同化强度下,2种局地化方法的增益矩阵和集合转换矩阵相等;随着同化强度的增大,增益矩阵和集合转换矩阵的差异会变大;在不同的同化强度下,2种局地化方法各具特色,相对而言,协方差局地化方法在更新集合均值和集合扰动上具有较强的鲁棒性。研究结论有助于背景场误差协方差的精细分析和估计。     

Sage自适应滤波在航空重力数据处理的应用

航空重力测量数据存在大量的干扰噪声,卡尔曼滤波是消除干扰、获得高精度重力异常的一种滤波方法。针对标准卡尔曼滤波精度依赖于先验量测噪声统计信息的问题,以Sage-Husa自适应卡尔曼滤波算法为基础,结合固定区间平滑,设计了量测噪声自适应的卡尔曼平滑滤波器,利用卡尔曼滤波及自适应卡尔曼平滑滤波对模型数据进行了滤波试验。试验结果说明,固定区间平滑的应用可以消除因滤波器未收敛造成的滤波误差,当量测噪声信息不明时,量测噪声自适应卡尔曼滤波器能够获得准确的滤波结果,其滤波精度高于标准卡尔曼滤波器。     

一种新的耦合模糊控制局地化的同化方法

由于在数据同化过程中远距离的观测与同化状态之间存在着虚假相关,局地化方法受到广泛关注。同时,在集合数目较少的同化情况下,观测数据难以得到有效利用,使得同化效果欠佳。因此,提出了一种新的模糊控制局地化同化方法,通过模糊控制算法判断观测点与状态更新点之间的距离,构造观测位置模糊权重。利用非线性Lorenz-96模型,比较分析模糊控制局地化同化(FLETKF)算法与模糊控制同化(FETKF)方法、局地化分析同化(LETKF)算法和集合转换卡尔曼滤波(ETKF)算法在非线性强迫参数变化时的性能,同时探讨了4种算法在不同强度下的优劣。研究结果表明,新方法能够获得更有效的观测权重,避免了远距离观测与状态变量之间的虚假相关,减小由于观测数据难以得到有效利用而带来的误差,在不同观测误差协方差情况下,随着集合数的增加,4种算法中FLETKF能够保持较好的鲁棒性,在观测误差协方差较大时,FLETKF方法的均方根误差(RMSE)相对FETKF方法的RMSE值减小98.2%,提高了同化精度,但在同化所需时间上,由于模糊控制局地化同化方法在判断观测点与状态更新点之间的距离,构造观测位置等价权重需要较长的额外时间,因此,并行计算的性能需进一步研究。     

两种耦合模糊控制的局地化方法研究

在集合数据同化过程中,由于远距离的观测与同化状态之间存在着虚假相关,局地化方法受到广泛关注.此外,由于集合数的限制,容易引起欠采样和协方差被低估等现象,使得滤波效果欠佳.因此,提出模糊控制算法,模糊控制算法主要用于判断观测点与状态更新点之间的距离来匹配相应的观测权重,进而调整局地化系数来更新背景误差协方差和观测误差协方差矩阵,从而得到有效的状态估计.基于背景误差协方差局地化方法和观测误差协方差局地化方法,耦合模糊控制,形成了新的算法—模糊控制的背景误差协方差局地化方法和模糊控制的观测误差协方差局地化方法.利用Lorenz-96模型,在小集合数和局地化半径下,得出模糊控制的背景误差协方差局地化方法和模糊控制的观测误差协方差局地化方法有较好的同化性能.通过分析泰勒图谱甄别出新算法与观测点具有高度的相关性以及较小的空间变异性.最后,在不同维数的模糊控制器下,新算法的有效性进一步得到验证.为今后数据同化误差处理方面提供了良好的研究平台.     

水动力学模型与集合卡尔曼滤波耦合的实时校正多变量分析方法

为减少非恒定水流计算中的不确定性,在水流随机运动系统状态空间模型基础上,应用集合卡尔曼滤波(EnKF)技术建立了非恒定水流分析的实时更新(校正)方法。该方法适用于非线性的随机微分方程,过程和观测噪声可以是非正态分布。同时,为充分利用水位、流量等误差量级相差巨大的观测中所蕴含的有效信息,导出了EnKF多变量分析格式。以明渠单峰洪水过程的合成数据为例,考察了运用建立的实时更新方法分析预报一维洪水演进的性能。重点对比了采用不同精度等级下的水位和流量观测资料进行滤波的效果。在中国现行标准规定的允许观测误差范围内,以水位观测进行一维洪水动力学模型的滤波分析可有效地控制误差、估计流量、识别水流运动系统状态。长江干流清溪场至万县江段实际洪水计算还证实:该方法通过插入即时观测,可实时更新模型状态,给出与实际更为接近的计算。     

Chebyshev低通滤波器在位场数据波数域导数换算中的应用

导数换算作为常用的位场数据处理手段具有重要的物理意义。由于实际测量误差和噪声的影响,波数域导数换算存在计算过程不稳定、求导结果精度差的问题。为了降低噪声干扰,提高导数计算精度,提出了在波数域常规导数算子基础上附加Chebyshev低通滤波器的任意阶导数换算方法。通过分析该滤波器的滤波特性,并结合位场异常径向平均功率谱曲线特征,确定了Chebyshev低通滤波法的滤波参数,减少了人为因素对求导结果的干扰。二度体和三度体模型试验表明,与其他3种方法(常规FFT(fast Fourier transformation)法、向上延拓法和ISVD(integrated second vertical derivative)法)相比,该方法计算的导数与理论值的均方根误差最小,求导结果精度较高。在虎林盆地布格重力异常数据处理中,利用该方法计算的垂向二阶导数受噪声干扰小,结果可靠性较高,依此划分出的8条大断裂和11条小断裂在以往研究中均得到证实。     

土壤水分同化系统的敏感性试验研究

利用1998年7月6日至8月9日青藏高原GAME-Tibet试验区MS3608站点的4cm、20cm和100cm的土壤水分观测数据同化SiB2模型输出的表层、根区和深层土壤水分,探讨了一个基于集合卡尔曼滤波和简单生物圈模型的单点土壤水分同化方案。分析和评价了集合大小、同化周期、模型误差、背景场误差以及观测误差对同化系统性能的影响。结果表明:①增加集合数目可以减小土壤水分同化系统的误差,但同时又降低了运行效率;②对于集合卡尔曼滤波,初始场的估计是否准确对同化系统性能影响不大;③模型误差和观测误差的准确估计可以提高土壤水分的估计精度;④利用数据同化的方法对土壤水分的估计有显著提高。     

基于EnKF融合地球物理数据刻画含水层非均质性

含水层非均质性的刻画是模拟地下水中污染物运移的关键。以渗透系数为研究对象,构建了综合集合卡尔曼滤波方法、有效电阻率模型与地下水运移模型的同化框架,通过融合地球物理观测数据与污染物浓度观测数据来推估渗透系数的空间分布。基于理想算例,验证了该同化框架刻画含水层非均质渗透系数场的有效性,并针对不同初始参数信息与观测类型对比了耦合与非耦合水文地球物理方法的适用性。研究结果表明:基于集合卡尔曼滤波方法同化多种类型的观测数据,可有效地推估非均质参数空间分布。当初始信息较准确时,耦合方法的参数推估精度更高;初始信息存在偏差时,非耦合方法有更好的同化效果。由于非耦合方法计算成本较低且对初始信息缺失时适用性更强,在实际应用中可先基于非耦合方法初步估计参数,再利用耦合方法进一步提高参数推估精度。融合多种类型观测数据可有效提高参数推估效果。     

Improving the Ensemble Estimate of the Kalman Gain by Bootstrap Sampling

Using a small ensemble size in the ensemble Kalman filter methodology is efficient for updating numerical reservoir models but can result in poor updates following spurious correlations between observations and model variables. The most common approach for reducing the effect of spurious correlations on model updates is multiplication of the estimated covariance by a tapering function that eliminates all correlations beyond a prespecified distance. Distance-dependent tapering is not always appropriate, however. In this paper, we describe efficient methods for discriminating between the real and the spurious correlations in the Kalman gain matrix by using the bootstrap method to assess the confidence level of each element from the Kalman gain matrix. The new method is tested on a small linear problem, and on a water flooding reservoir history matching problem. For the water flooding example, a small ensemble size of 30 was used to compute the Kalman gain in both the screened EnKF and standard EnKF methods. The new method resulted in significantly smaller root mean squared errors of the estimated model parameters and greater variability in the final updated ensemble.     

Cross-covariances and localization for EnKF in multiphase flow data assimilation

The ensemble Kalman filter has been successfully applied for data assimilation in very large models, including those in reservoir simulation and weather. Two problems become critical in a standard implementation of the ensemble Kalman filter, however, when the ensemble size is small. The first is that the ensemble approximation to cross-covariances of model and state variables to data can indicate the presence of correlations that are not real. These spurious correlations give rise to model or state variable updates in regions that should not be updated. The second problem is that the number of degrees of freedom in the ensemble is only as large as the size of the ensemble, so the assimilation of large amounts of precise, independent data is impossible. Localization of the Kalman gain is almost universal in the weather community, but applications of localization for the ensemble Kalman filter in porous media flow have been somewhat rare. It has been shown, however, that localization of updates to regions of non-zero sensitivity or regions of non-zero cross-covariance improves the performance of the EnKF when the ensemble size is small. Localization is necessary for assimilation of large amounts of independent data. The problem is to define appropriate localization functions for different types of data and different types of variables. We show that the knowledge of sensitivity alone is not sufficient for determination of the region of localization. The region depends also on the prior covariance for model variables and on the past history of data assimilation. Although the goal is to choose localization functions that are large enough to include the true region of non-zero cross-covariance, for EnKF applications, the choice of localization function needs to balance the harm done by spurious covariance resulting from small ensembles and the harm done by excluding real correlations. In this paper, we focus on the distance-based localization and provide insights for choosing suitable localization functions for data assimilation in multiphase flow problems. In practice, we conclude that it is reasonable to choose localization functions based on well patterns, that localization function should be larger than regions of non-zero sensitivity and should extend beyond a single well pattern.     

Groundwater parameter estimation using the ensemble Kalman filter with localization

The ensemble Kalman filter (EnKF), an efficient data assimilation method showing advantages in many numerical experiments, is deficient when used in approximating covariance from an ensemble of small size. Implicit localization is used to add distance-related weight to covariance and filter spurious correlations which weaken the EnKF??s capability to estimate uncertainty correctly. The effect of this kind of localization is studied in two-dimensional (2D) and three-dimensional (3D) synthetic cases. It is found that EnKF with localization can capture reliably both the mean and variance of the hydraulic conductivity field with higher efficiency; it can also greatly stabilize the assimilation process as a small-size ensemble is used. Sensitivity experiments are conducted to explore the effect of localization function format and filter lengths. It is suggested that too long or too short filter lengths will prevent implicit localization from modifying the covariance appropriately. Steep localization functions will greatly disturb local dynamics like the 0-1 function even if the function is continuous; four relatively gentle localization functions succeed in avoiding obvious disturbance to the system and improve estimation. As the degree of localization of the L function increases, the parameter sensitivity becomes weak, making parameter selection easier, but more information may be lost in the assimilation process.     

Improved initial ensemble generation coupled with ensemble square root filters and inflation to estimate uncertainty

The performance of the Ensemble Kalman Filter method (EnKF) depends on the sample size compared to the dimension of the parameters space. In real applications insufficient sampling may result in spurious correlations which reduce the accuracy of the filter with a strong underestimation of the uncertainty. Covariance localization and inflation are common solutions to these problems. The Ensemble Square Root Filters (ESRF) is also better to estimate uncertainty with respect to the EnKF. In this work we propose a method that limits the consequences of sampling errors by means of a convenient generation of the initial ensemble. This regeneration is based on a Stationary Orthogonal-Base Representation (SOBR) obtained via a singular value decomposition of a stationary covariance matrix estimated from the ensemble. The technique is tested on a 2D single phase reservoir and compared with the other common techniques. The evaluation is based on a reference solution obtained with a very large ensemble (one million members) which remove the spurious correlations. The example gives evidence that the SOBR technique is a valid alternative to reduce the effect of sampling error. In addition, when the SOBR method is applied in combination with the ESRF and inflation, it gives the best performance in terms of uncertainty estimation and oil production forecast.     

Fast linearized forecasts for subsurface flow data assimilation with ensemble Kalman filter

Ensemble methods present a practical framework for parameter estimation, performance prediction, and uncertainty quantification in subsurface flow and transport modeling. In particular, the ensemble Kalman filter (EnKF) has received significant attention for its promising performance in calibrating heterogeneous subsurface flow models. Since an ensemble of model realizations is used to compute the statistical moments needed to perform the EnKF updates, large ensemble sizes are needed to provide accurate updates and uncertainty assessment. However, for realistic problems that involve large-scale models with computationally demanding flow simulation runs, the EnKF implementation is limited to small-sized ensembles. As a result, spurious numerical correlations can develop and lead to inaccurate EnKF updates, which tend to underestimate or even eliminate the ensemble spread. Ad hoc practical remedies, such as localization, local analysis, and covariance inflation schemes, have been developed and applied to reduce the effect of sampling errors due to small ensemble sizes. In this paper, a fast linear approximate forecast method is proposed as an alternative approach to enable the use of large ensemble sizes in operational settings to obtain more improved sample statistics and EnKF updates. The proposed method first clusters a large number of initial geologic model realizations into a small number of groups. A representative member from each group is used to run a full forward flow simulation. The flow predictions for the remaining realizations in each group are approximated by a linearization around the full simulation results of the representative model (centroid) of the respective cluster. The linearization can be performed using either adjoint-based or ensemble-based gradients. Results from several numerical experiments with two-phase and three-phase flow systems in this paper suggest that the proposed method can be applied to improve the EnKF performance in large-scale problems where the number of full simulation is constrained.     

Combining sensitivities and prior information for covariance localization in the ensemble Kalman filter for petroleum reservoir applications

Sampling errors can severely degrade the reliability of estimates of conditional means and uncertainty quantification obtained by the application of the ensemble Kalman filter (EnKF) for data assimilation. A standard recommendation for reducing the spurious correlations and loss of variance due to sampling errors is to use covariance localization. In distance-based localization, the prior (forecast) covariance matrix at each data assimilation step is replaced with the Schur product of a correlation matrix with compact support and the forecast covariance matrix. The most important decision to be made in this localization procedure is the choice of the critical length(s) used to generate this correlation matrix. Here, we give a simple argument that the appropriate choice of critical length(s) should be based both on the underlying principal correlation length(s) of the geological model and the range of the sensitivity matrices. Based on this result, we implement a procedure for covariance localization and demonstrate with a set of distinctive reservoir history-matching examples that this procedure yields improved results over the standard EnKF implementation and over covariance localization with other choices of critical length.     

评估集合卡曼滤波反演土壤湿度廓线的性能

集合卡曼滤波由于易于使用而被广泛地应用到陆面数据同化研究中,它是建立在模型为线性、误差为正态分布的假设上,而实际土壤湿度方程是高度非线性的,并且当土壤过干或过湿时会发生样本偏斜.为了全面评估它在同化表层土壤湿度观测来反演土壤湿度廓线的性能,特引入不需要上述假设的采样重要性重采样粒子滤波,比较非线性和偏斜性对同化算法的影响.结果显示:不管是小样本还是大样本,集合卡曼滤波都能快速、准确地逼近样本均值,而粒子滤波只有在大样本时才能缓慢地趋近;此外,集合卡曼滤波的粒子边缘概率密度及其偏度和峰度与粒子滤波完全不同,前者粒子虽不完全满足正态分布,但始终为单峰状态,而后者粒子随同化推进经历了单峰到双峰再到单峰的变化.     

The temperature-based localization for the application of EnKF on automatic history matching of the SAGD process

The ensemble Kalman filter (EnKF) has been successfully applied to data assimilation in steam-assisted gravity drainage (SAGD) process, but applications of localization for the EnKF in the SAGD process have not been studied. Distance-based localization has been reported to be very efficient for assimilation of large amounts of independent data with a small ensemble in water flooding process, but it is not applicable to the SAGD process, since in the SAGD process, oil is produced mainly from the transition zone steam chamber to cold oil instead of the regions around the producer. As the oil production rate is mainly affected by the temperature distribution in the transition zone, temperature-based localization was proposed for automatic history matching of the SAGD process. The regions of the localization function were determined through sensitivity analysis by using a large ensemble with 1000 members. The sensitivity analysis indicated that the regions of cross-correlations between oil production and state variables are much wider than the correlations between production data and model variables. To choose localization regions that are large enough to include the true regions of non-zero cross-covariance, the localization function is defined based on the regions of non-zero covariances of production data to state variables. The non-zero covariances between production data and state variables are distributed in accordance with the steam chamber. This makes the definition of a universal localization function for different state variables easier. Based on the cross-correlation analysis, the temperature range in which oil production is contributed is determined, and beyond or below this range, the localization function reduces from one, and at the critical temperature or steam temperature, the localization function reduces to zero. The temperature-based localization function was obtained through modifying the distance-based localization function. Localization is applied to covariance of data with permeability, saturation, and temperature, as well as the covariance of data with data. A small ensemble (10 ensemble members) was employed in several case studies. Without localization, the variability in the ensemble collapsed very quickly and lost the ability to assimilate later data. The mean variance of model variables dropped dramatically by 95 %, and there was almost no variability in ensemble forecasts, while the prediction was far from the reference with data mismatch keeping up at a high level. At least 50 ensemble members are needed to keep the qualities of matches and forecasts, which significantly increases the computation time. The EnKF with temperature-based localization is able to avoid the collapse of ensemble variability with a small ensemble (10 members), which saves the computation time and gives better history match and prediction results.     

Multiscale ensemble filtering for reservoir engineering applications

Reservoir management requires periodic updates of the simulation models using the production data available over time. Traditionally, validation of reservoir models with production data is done using a history matching process. Uncertainties in the data, as well as in the model, lead to a nonunique history matching inverse problem. It has been shown that the ensemble Kalman filter (EnKF) is an adequate method for predicting the dynamics of the reservoir. The EnKF is a sequential Monte-Carlo approach that uses an ensemble of reservoir models. For realistic, large-scale applications, the ensemble size needs to be kept small due to computational inefficiency. Consequently, the error space is not well covered (poor cross-correlation matrix approximations) and the updated parameter field becomes scattered and loses important geological features (for example, the contact between high- and low-permeability values). The prior geological knowledge present in the initial time is not found anymore in the final updated parameter. We propose a new approach to overcome some of the EnKF limitations. This paper shows the specifications and results of the ensemble multiscale filter (EnMSF) for automatic history matching. EnMSF replaces, at each update time, the prior sample covariance with a multiscale tree. The global dependence is preserved via the parent–child relation in the tree (nodes at the adjacent scales). After constructing the tree, the Kalman update is performed. The properties of the EnMSF are presented here with a 2D, two-phase (oil and water) small twin experiment, and the results are compared to the EnKF. The advantages of using EnMSF are localization in space and scale, adaptability to prior information, and efficiency in case many measurements are available. These advantages make the EnMSF a practical tool for many data assimilation problems.     

An efficient matrix-free algorithm for the ensemble Kalman filter

In this work, we present an efficient matrix-free ensemble Kalman filter (EnKF) algorithm for the assimilation of large data sets. The EnKF has increasingly become an essential tool for data assimilation of numerical models. It is an attractive assimilation method because it can evolve the model covariance matrix for a non-linear model, through the use of an ensemble of model states, and it is easy to implement for any numerical model. Nevertheless, the computational cost of the EnKF can increase significantly for cases involving the assimilation of large data sets. As more data become available for assimilation, a potential bottleneck in most EnKF algorithms involves the operation of the Kalman gain matrix. To reduce the complexity and cost of assimilating large data sets, a matrix-free EnKF algorithm is proposed. The algorithm uses an efficient matrix-free linear solver, based on the Sherman–Morrison formulas, to solve the implicit linear system within the Kalman gain matrix and compute the analysis. Numerical experiments with a two-dimensional shallow water model on the sphere are presented, where results show the matrix-free implementation outperforming an singular value decomposition-based implementation in computational time.