Multiscale ensemble filtering for reservoir engineering applications

Reservoir management requires periodic updates of the simulation models using the production data available over time. Traditionally, validation of reservoir models with production data is done using a history matching process. Uncertainties in the data, as well as in the model, lead to a nonunique history matching inverse problem. It has been shown that the ensemble Kalman filter (EnKF) is an adequate method for predicting the dynamics of the reservoir. The EnKF is a sequential Monte-Carlo approach that uses an ensemble of reservoir models. For realistic, large-scale applications, the ensemble size needs to be kept small due to computational inefficiency. Consequently, the error space is not well covered (poor cross-correlation matrix approximations) and the updated parameter field becomes scattered and loses important geological features (for example, the contact between high- and low-permeability values). The prior geological knowledge present in the initial time is not found anymore in the final updated parameter. We propose a new approach to overcome some of the EnKF limitations. This paper shows the specifications and results of the ensemble multiscale filter (EnMSF) for automatic history matching. EnMSF replaces, at each update time, the prior sample covariance with a multiscale tree. The global dependence is preserved via the parent–child relation in the tree (nodes at the adjacent scales). After constructing the tree, the Kalman update is performed. The properties of the EnMSF are presented here with a 2D, two-phase (oil and water) small twin experiment, and the results are compared to the EnKF. The advantages of using EnMSF are localization in space and scale, adaptability to prior information, and efficiency in case many measurements are available. These advantages make the EnMSF a practical tool for many data assimilation problems.     

Comparing the adaptive Gaussian mixture filter with the ensemble Kalman filter on synthetic reservoir models

Over the last years, the ensemble Kalman filter (EnKF) has become a very popular tool for history matching petroleum reservoirs. EnKF is an alternative to more traditional history matching techniques as it is computationally fast and easy to implement. Instead of seeking one best model estimate, EnKF is a Monte Carlo method that represents the solution with an ensemble of state vectors. Lately, several ensemble-based methods have been proposed to improve upon the solution produced by EnKF. In this paper, we compare EnKF with one of the most recently proposed methods, the adaptive Gaussian mixture filter (AGM), on a 2D synthetic reservoir and the Punq-S3 test case. AGM was introduced to loosen up the requirement of a Gaussian prior distribution as implicitly formulated in EnKF. By combining ideas from particle filters with EnKF, AGM extends the low-rank kernel particle Kalman filter. The simulation study shows that while both methods match the historical data well, AGM is better at preserving the geostatistics of the prior distribution. Further, AGM also produces estimated fields that have a higher empirical correlation with the reference field than the corresponding fields obtained with EnKF.     

评估集合卡曼滤波反演土壤湿度廓线的性能

集合卡曼滤波由于易于使用而被广泛地应用到陆面数据同化研究中,它是建立在模型为线性、误差为正态分布的假设上,而实际土壤湿度方程是高度非线性的,并且当土壤过干或过湿时会发生样本偏斜.为了全面评估它在同化表层土壤湿度观测来反演土壤湿度廓线的性能,特引入不需要上述假设的采样重要性重采样粒子滤波,比较非线性和偏斜性对同化算法的影响.结果显示:不管是小样本还是大样本,集合卡曼滤波都能快速、准确地逼近样本均值,而粒子滤波只有在大样本时才能缓慢地趋近;此外,集合卡曼滤波的粒子边缘概率密度及其偏度和峰度与粒子滤波完全不同,前者粒子虽不完全满足正态分布,但始终为单峰状态,而后者粒子随同化推进经历了单峰到双峰再到单峰的变化.     

Application of the EnKF and Localization to Automatic History Matching of Facies Distribution and Production Data

The performance of the ensemble Kalman filter (EnKF) for continuous updating of facies location and boundaries in a reservoir model based on production and facies data for a 3D synthetic problem is presented. The occurrence of the different facies types is treated as a random process and the initial distribution was obtained by truncating a bi-Gaussian random field. Because facies data are highly non-Gaussian, re-parameterization was necessary in order to use the EnKF algorithm for data assimilation; two Gaussian random fields are updated in lieu of the static facies parameters. The problem of history matching applied to facies is difficult due to (1) constraints to facies observations at wells are occasionally violated when productions data are assimilated; (2) excessive reduction of variance seems to be a bigger problem with facies than with Gaussian random permeability and porosity fields; and (3) the relationship between facies variables and data is so highly non-linear that the final facies field does not always honor early production data well. Consequently three issues are investigated in this work. Is it possible to iteratively enforce facies constraints when updates due to production data have caused them to be violated? Can localization of adjustments be used for facies to prevent collapse of the variance during the data-assimilation period? Is a forecast from the final state better than a forecast from time zero using the final parameter fields?To investigate these issues, a 3D reservoir simulation model is coupled with the EnKF technique for data assimilation. One approach to enforcing the facies constraint is continuous iteration on all available data, which may lead to inconsistent model states, incorrect weighting of the production data and incorrect adjustment of the state vector. A sequential EnKF where the dynamic and static data are assimilated sequentially is presented and this approach seems to have solved the highlighted problems above. When the ensemble size is small compared to the number of independent data, the localized adjustment of the state vector is a very important technique that may be used to mitigate loss of rank in the ensemble. Implementing a distance-based localization of the facies adjustment appears to mitigate the problem of variance deficiency in the ensembles by ensuring that sufficient variability in the ensemble is maintained throughout the data assimilation period. Finally, when data are assimilated without localization, the prediction results appear to be independent of the starting point. When localization is applied, it is better to predict from the start using the final parameter field rather than continue from the final state.     

A comparison between a Monte Carlo implementation of retrospective optimal interpolation and an ensemble Kalman filter in nonlinear dynamics

To more correctly estimate the error covariance of an evolved state of a nonlinear dynamical system, the second and higher-order moments of the prior error need to be known. Retrospective optimal interpolation (ROI) may require relatively less information on the higher-order moments of the prior errors than an ensemble Kalman filter (EnKF) because it uses the initial conditions as the background states instead of forecasts. Analogous to the extension of a Kalman filter into an EnKF, an ensemble retrospective optimal interpolation (EnROI) technique was derived using the Monte Carlo method from ROI. In contrast to the deterministic version of ROI, the background error covariance is represented by a background ensemble in EnROI. By sequentially applying EnROI to a moving limited analysis window and exploiting the forecast from the average of the background ensemble of EnROI as a guess field, the computation costs for EnROI can be reduced. In the numerical experiment using a Lorenz-96 model and a Model-III of Lorenz with a perfect-model assumption, the cost-effectiveness of the suboptimal version of EnROI is demonstrated to be superior to that of EnKF using perturbed observations.     

Ensemble filter methods with perturbed observations applied to nonlinear problems

The ensemble Kalman filter (EnKF) has been shown repeatedly to be an effective method for data assimilation in large-scale problems, including those in petroleum engineering. Data assimilation for multiphase flow in porous media is particularly difficult, however, because the relationships between model variables (e.g., permeability and porosity) and observations (e.g., water cut and gas–oil ratio) are highly nonlinear. Because of the linear approximation in the update step and the use of a limited number of realizations in an ensemble, the EnKF has a tendency to systematically underestimate the variance of the model variables. Various approaches have been suggested to reduce the magnitude of this problem, including the application of ensemble filter methods that do not require perturbations to the observed data. On the other hand, iterative least-squares data assimilation methods with perturbations of the observations have been shown to be fairly robust to nonlinearity in the data relationship. In this paper, we present EnKF with perturbed observations as a square root filter in an enlarged state space. By imposing second-order-exact sampling of the observation errors and independence constraints to eliminate the cross-covariance with predicted observation perturbations, we show that it is possible in linear problems to obtain results from EnKF with observation perturbations that are equivalent to ensemble square-root filter results. Results from a standard EnKF, EnKF with second-order-exact sampling of measurement errors that satisfy independence constraints (EnKF (SIC)), and an ensemble square-root filter (ETKF) are compared on various test problems with varying degrees of nonlinearity and dimensions. The first test problem is a simple one-variable quadratic model in which the nonlinearity of the observation operator is varied over a wide range by adjusting the magnitude of the coefficient of the quadratic term. The second problem has increased observation and model dimensions to test the EnKF (SIC) algorithm. The third test problem is a two-dimensional, two-phase reservoir flow problem in which permeability and porosity of every grid cell (5,000 model parameters) are unknown. The EnKF (SIC) and the mean-preserving ETKF (SRF) give similar results when applied to linear problems, and both are better than the standard EnKF. Although the ensemble methods are expected to handle the forecast step well in nonlinear problems, the estimates of the mean and the variance from the analysis step for all variants of ensemble filters are also surprisingly good, with little difference between ensemble methods when applied to nonlinear problems.     

Improved initial sampling for the ensemble Kalman filter

In this paper, we discuss several possible approaches to improving the performance of the ensemble Kalman filter (EnKF) through improved sampling of the initial ensemble. Each of the approaches addresses a different limitation of the standard method. All methods, however, attempt to make the results from a small ensemble as reliable as possible. The validity and usefulness of each method for creating the initial ensemble is based on three criteria: (1) does the sampling result in unbiased Monte Carlo estimates for nonlinear flow problems, (2) does the sampling reduce the variability of estimates compared to ensembles of realizations from the prior, and (3) does the sampling improve the performance of the EnKF? In general, we conclude that the use of dominant eigenvectors ensures the orthogonality of the generated realizations, but results in biased forecasts of the fractional flow of water. We show that the addition of high frequencies from remaining eigenvectors can be used to remove the bias without affecting the orthogonality of the realizations, but the method did not perform significantly better than standard Monte Carlo sampling. It was possible to identify an appropriate importance weighting to reduce the variance in estimates of the fractional flow of water, but it does not appear to be possible to use the importance weighted realizations in standard EnKF when the data relationship is nonlinear. The biggest improvement came from use of the pseudo-data with corrections to the variance of the actual observations.     

基于集合卡尔曼平滑算法的土壤水分同化

为研究观测资料稀少情况下土壤质地及有机质对土壤水分同化的影响,发展了集合卡尔曼平滑(Ensemble Kalman Smooth, EnKS)的土壤水分同化方案。利用黑河上游阿柔冻融观测站2008年6月1日至10月29日的观测数据,使用EnKS算法将表层土壤水分观测数据同化到简单生物圈模型(Simple Biosphere Model 2, SiB2)中,分析不同方案对土壤水分估计的影响,并与集合卡尔曼滤波算法(EnKF)的结果进行比较。研究结果表明,土壤质地和有机质对表层土壤水分模拟结果影响最大而对深层的影响相对较小;利用EnKF和EnKS算法同化表层土壤水分观测数据,均能够显著提高表层和根区土壤水分估计的精度,EnKS算法的精度略高于EnKF且所受土壤质地和有机质的影响小于EnKF;当观测数据稀少时,EnKS算法仍然可以得到较高精度的土壤水分估计。     

Multimodal ensemble Kalman filtering using Gaussian mixture models

In this paper we present an extension of the ensemble Kalman filter (EnKF) specifically designed for multimodal systems. EnKF data assimilation scheme is less accurate when it is used to approximate systems with multimodal distribution such as reservoir facies models. The algorithm is based on the assumption that both prior and posterior distribution can be approximated by Gaussian mixture and it is validated by the introduction of the concept of finite ensemble representation. The effectiveness of the approach is shown with two applications. The first example is based on Lorenz model. In the second example, the proposed methodology combined with a localization technique is used to update a 2D reservoir facies models. Both applications give evidence of an improved performance of the proposed method respect to the EnKF.     

基于集合卡尔曼滤波的多相流模型参数估计——以室内二维砂箱中重质非水相污染物入渗为例

重质非水相有机污染物(DNAPL)泄漏到地下后,其运移与分布特征受渗透率非均质性影响显著。为刻画DNAPL污染源区结构特征,需进行参数估计以描述水文地质参数的非均质性。本研究构建了基于集合卡尔曼滤波方法(EnKF)与多相流运移模型的同化方案,通过融合DNAPL饱和度观测数据推估非均质介质渗透率空间分布。通过二维砂箱实际与理想算例,验证了同化方法的推估效果,并探讨了不同因素对同化的影响。研究结果表明:基于EnKF方法同化饱和度观测资料可有效地推估非均质渗透率场;参数推估精度随观测时空密度的增大而提高;观测点位置分布对同化效果有所影响,布置在污染集中区域的观测数据对于参数估计具有较高的数据价值。     

Continuous Facies Updating Using the Ensemble Kalman Filter and the Level Set Method

We present a methodology based on the ensemble Kalman filter (EnKF) and the level set method for the continuous model updating of geological facies with respect to production data. Geological facies are modeled using an implicit surface representation and conditioned to production data using the ensemble Kalman filter. The methodology is based on Gaussian random fields used to deform the facies boundaries. The Gaussian random fields are used as the model parameter vector to be updated sequentially within the EnKF when new measurements are available. We show the successful application of the methodology to two synthetic reservoir models.     

Sampling error distribution for the ensemble Kalman filter update step

In recent years, data assimilation techniques have been applied to an increasingly wider specter of problems. Monte Carlo variants of the Kalman filter, in particular, the ensemble Kalman filter (EnKF), have gained significant popularity. EnKF is used for a wide variety of applications, among them for updating reservoir simulation models. EnKF is a Monte Carlo method, and its reliability depends on the actual size of the sample. In applications, a moderately sized sample (40–100 members) is used for computational convenience. Problems due to the resulting Monte Carlo effects require a more thorough analysis of the EnKF. Earlier we presented a method for the assessment of the error emerging at the EnKF update step (Kovalenko et al., SIAM J Matrix Anal Appl, in press). A particular energy norm of the EnKF error after a single update step was studied. The energy norm used to assess the error is hard to interpret. In this paper, we derive the distribution of the Euclidean norm of the sampling error under the same assumptions as before, namely normality of the forecast distribution and negligibility of the observation error. The distribution depends on the ensemble size, the number and spatial arrangement of the observations, and the prior covariance. The distribution is used to study the error propagation in a single update step on several synthetic examples. The examples illustrate the changes in reliability of the EnKF, when the parameters governing the error distribution vary.     

Ensemble-Based Seismic and Production Data Assimilation Using Selection Kalman Model

Data assimilation in reservoir modeling often involves model variables that are multimodal, such as porosity and permeability. Well established data assimilation methods such as ensemble Kalman filter and ensemble smoother approaches, are based on Gaussian assumptions that are not applicable to multimodal random variables. The selection ensemble smoother is introduced as an alternative to traditional ensemble methods. In the proposed method, the prior distribution of the model variables, for example the porosity field, is a selection-Gaussian distribution, which allows modeling of the multimodal behavior of the posterior ensemble. The proposed approach is applied for validation on a two-dimensional synthetic channelized reservoir. In the application, an unknown reservoir model of porosity and permeability is estimated from the measured data. Seismic and production data are assumed to be repeatedly measured in time and the reservoir model is updated every time new data are assimilated. The example shows that the selection ensemble Kalman model improves the characterisation of the bimodality of the model parameters compared to the results of the ensemble smoother.

     

Improving the Ensemble Estimate of the Kalman Gain by Bootstrap Sampling

Using a small ensemble size in the ensemble Kalman filter methodology is efficient for updating numerical reservoir models but can result in poor updates following spurious correlations between observations and model variables. The most common approach for reducing the effect of spurious correlations on model updates is multiplication of the estimated covariance by a tapering function that eliminates all correlations beyond a prespecified distance. Distance-dependent tapering is not always appropriate, however. In this paper, we describe efficient methods for discriminating between the real and the spurious correlations in the Kalman gain matrix by using the bootstrap method to assess the confidence level of each element from the Kalman gain matrix. The new method is tested on a small linear problem, and on a water flooding reservoir history matching problem. For the water flooding example, a small ensemble size of 30 was used to compute the Kalman gain in both the screened EnKF and standard EnKF methods. The new method resulted in significantly smaller root mean squared errors of the estimated model parameters and greater variability in the final updated ensemble.     

Ensemble Kalman filtering with shrinkage regression techniques

The classical ensemble Kalman filter (EnKF) is known to underestimate the prediction uncertainty. This can potentially lead to low forecast precision and an ensemble collapsing into a single realisation. In this paper, we present alternative EnKF updating schemes based on shrinkage methods known from multivariate linear regression. These methods reduce the effects caused by collinear ensemble members and have the same computational properties as the fastest EnKF algorithms previously suggested. In addition, the importance of model selection and validation for prediction purposes is investigated, and a model selection scheme based on cross-validation is introduced. The classical EnKF scheme is compared with the suggested procedures on two-toy examples and one synthetic reservoir case study. Significant improvements are seen, both in terms of forecast precision and prediction uncertainty estimates.     

Non-parametric Bayesian networks for parameter estimation in reservoir simulation: a graphical take on the ensemble Kalman filter (part I)

Reservoir simulation models are used both in the development of new fields and in developed fields where production forecasts are needed for investment decisions. When simulating a reservoir, one must account for the physical and chemical processes taking place in the subsurface. Rock and fluid properties are crucial when describing the flow in porous media. In this paper, the authors are concerned with estimating the permeability field of a reservoir. The problem of estimating model parameters such as permeability is often referred to as a history-matching problem in reservoir engineering. Currently, one of the most widely used methodologies which address the history-matching problem is the ensemble Kalman filter (EnKF). EnKF is a Monte Carlo implementation of the Bayesian update problem. Nevertheless, the EnKF methodology has certain limitations that encourage the search for an alternative method.For this reason, a new approach based on graphical models is proposed and studied. In particular, the graphical model chosen for this purpose is a dynamic non-parametric Bayesian network (NPBN). This is the first attempt to approach a history-matching problem in reservoir simulation using a NPBN-based method. A two-phase, two-dimensional flow model was implemented for a synthetic reservoir simulation exercise, and initial results are shown. The methods’ performances are evaluated and compared. This paper features a completely novel approach to history matching and constitutes only the first part (part I) of a more detailed investigation. For these reasons (novelty and incompleteness), many questions are left open and a number of recommendations are formulated, to be investigated in part II of the same paper.     

不同滤波算法在土壤湿度同化中的应用

为研究不同滤波算法在土壤湿度同化中的有效性,以及土壤湿度模拟结果对模型参数的敏感性,结合简单生物圈模型SiB2,设置敏感性实验,探求土壤饱和水力传导度对土壤湿度模拟结果的影响;并在此基础上,采用集合卡尔曼滤波（EnKF）、无迹卡尔曼滤波（UKF）和无迹粒子滤波（UPF）开展土壤湿度实时同化实验。结果表明：土壤饱和水力传导度能显著影响土壤湿度模拟精度;利用EnKF、UKF、UPF同化站点观测数据,均能改善土壤湿度模拟结果;3种同化方法在不同土壤层的同化效果不同,在土壤表层,EnKF的有效性优于UKF和UPF,在根域层和土壤深层,3种滤波方法有效性在降雨前后相差较大。因此,针对性地选择同化方法,是提高土壤湿度模拟精度的有效手段。     

An efficient matrix-free algorithm for the ensemble Kalman filter

In this work, we present an efficient matrix-free ensemble Kalman filter (EnKF) algorithm for the assimilation of large data sets. The EnKF has increasingly become an essential tool for data assimilation of numerical models. It is an attractive assimilation method because it can evolve the model covariance matrix for a non-linear model, through the use of an ensemble of model states, and it is easy to implement for any numerical model. Nevertheless, the computational cost of the EnKF can increase significantly for cases involving the assimilation of large data sets. As more data become available for assimilation, a potential bottleneck in most EnKF algorithms involves the operation of the Kalman gain matrix. To reduce the complexity and cost of assimilating large data sets, a matrix-free EnKF algorithm is proposed. The algorithm uses an efficient matrix-free linear solver, based on the Sherman–Morrison formulas, to solve the implicit linear system within the Kalman gain matrix and compute the analysis. Numerical experiments with a two-dimensional shallow water model on the sphere are presented, where results show the matrix-free implementation outperforming an singular value decomposition-based implementation in computational time.