Variogram Fitting by Generalized Least Squares Using an Explicit Formula for the Covariance Structure

In the context of spatial statistics, the classical variogram estimator proposed by Matheron can be written as a quadratic form of the observations. If data are Gaussian with constant mean, then the correlation between the classical variogram estimator at two different lags is a function of the spatial design matrix and the variance matrix. When data are independent with unidimensional and regular support, an explicit formula for this correlation is available. The same is true for a multidimensional and regular support as can be shown by using Kronecker products of matrices. As variogram fitting is a crucial stage for correct spatial prediction, it is proposed to use a generalized least squares method with an explicit formula for the covariance structure (GLSE). A good approximation of the covariance structure is achieved by taking account of the explicit formula for the correlation in the independent situation. Simulations are carried out with several types of underlying variograms, as well as with outliers in the data. Results show that this technique (GLSE), combined with a robust estimator of the variogram, improves the fit significantly.     

Some Results on the Spatial Breakdown Point of Robust Point Estimates of the Variogram

The effect of outliers on estimates of the variogram depends on how they are distributed in space. The ‘spatial breakdown point’ is the largest proportion of observations which can be drawn from some arbitrary contaminating process without destroying a robust variogram estimator, when they are arranged in the most damaging spatial pattern. A numerical method is presented to find the spatial breakdown point for any sample array in two dimensions or more. It is shown by means of some examples that such a numerical approach is needed to determine the spatial breakdown point for two or more dimensions, even on a regular square sample grid, since previous conjectures about the spatial breakdown point in two dimensions do not hold. The ‘average spatial breakdown point’ has been used as a basis for practical guidelines on the intensity of contaminating processes that can be tolerated by robust variogram estimators. It is the largest proportion of contaminating observations in a data set such that the breakdown point of the variance estimator used to obtain point estimates of the variogram is not exceeded by the expected proportion of contaminated pairs of observations over any lag. In this paper the behaviour of the average spatial breakdown point is investigated for cases where the contaminating process is spatially dependent. It is shown that in two dimensions the average spatial breakdown point is 0.25. Finally, the ‘empirical spatial breakdown point’, a tool for the exploratory analysis of spatial data thought to contain outliers, is introduced and demonstrated using data on metal content in the soils of Sheffield, England. The empirical spatial breakdown point of a particular data set can be used to indicate whether the distribution of possible contaminants is likely to undermine a robust variogram estimator.     

Combining Robustness with Efficiency in?the?Estimation of the Variogram

In the present paper, we propose a new method for the estimation of the variogram, which combines robustness with efficiency under intrinsic stationary geostatistical processes. The method starts by using a robust estimator to obtain discrete estimates of the variogram and control atypical observations that may exist. When the number of points used in the fit of a model is the same as the number of parameters, ordinary least squares and generalized least squares are asymptotically equivalent. Therefore, the next step is to fit the variogram by ordinary least squares, using just a few discrete estimates. The procedure is then repeated several times with different subsets of points and this produces a sequence of variogram estimates. The final estimate is the median of the multiple estimates of the variogram parameters. The suggested estimator will be called multiple variograms estimator. This procedure assures a global robust estimator, which is more efficient than other robust proposals. Under the assumed dependence structure, we prove that the multiple variograms estimator is consistent and asymptotically normally distributed. A simulation study confirms that the new method has several advantages when compared with other current methods.     

Spatial Breakdown Point of Variogram Estimators

In the context of robust statistics, the breakdown point of an estimator is an important feature of reliability. It measures the highest fraction of contamination in the data that an estimator can support before being destroyed. In geostatistics, variogram estimators are based on measurements taken at various spatial locations. The classical notion of breakdown point needs to be extended to a spatial one, depending on the construction of most unfavorable configurations of perturbation. Explicit upper and lower bounds are available for the spatial breakdown point in the regular unidimensional case. The difficulties arising in the multidimensional case are presented on an easy example in IR² , as well as some simulations on irregular grids. In order to study the global effects of perturbations on variogram estimators, further simulations are carried out on data located on a regular or irregular bidimensional grid. Results show that if variogram estimation is performed with a 50% classical breakdown point scale estimator, the number of initial data likely to be contaminated before destruction of the estimator is roughly 30% on average. Theoretical results confirm the previous statement on data in IR^d , d 1.     

Robust kriging—A proposal

Geological data frequently have a heavy-tailed normal-in-the-middle distribution, which gives rise to grade distributions that appear to be normal except for the occurrence of a few outliers. This same situation also applies to log-transformed data to which lognormal kriging is to be applied. For such data, linear kriging is nonrobust in that (1)kriged estimates tend to infinity as the outliers do, and (2)it is also not minimum mean squared error. The more general nonlinear method of disjunctive kriging is even more nonrobust, computationally more laborious, and in the end need not produce better practical answers. We propose a robust kriging method for such nearly normal data based on linear kriging of an editing of the data. It is little more laborious than conventional linear kriging and, used in conjunction with a robust estimator of the variogram, provides good protection against the effects of data outliers. The method is also applicable to time series analysis.     

Studies of the effects of outliers and data transformation on variogram estimates for a base metal and a gold ore body

Variograms for gold and lead values from the Loraine and Prieska mines, respectively, indicate that data outliers can seriously distort and/or mask the real variogram patterns. Studies show that this problem is best overcome for these mines by logarithmic transformation of the data, and/or a suitable screening out of such outliers, and/or more robust variogram estimation procedures; the benefits are particularly significant when the basic data is limited.     

The Correlation Structure of Matheron's Classical Variogram Estimator Under Elliptically Contoured Distributions

The classical variogram estimator proposed by Matheron can be written as a quadratic form of the observations. When data have an elliptically contoured distribution with constant mean, the correlation between the classical variogram estimator at two different lags is a function of the spatial design matrix, the covariance matrix, and the kurtosis. Several specific cases are studied closely. A subclass of elliptically contoured distributions with a particular family of covariance matrices is shown to possess exactly the same correlation structure for the classical variogram estimator as the multivariate independent Gaussian distribution. The consequences on variogram fitting by generalized least squares are discussed.     

The Correlation Structure of Matheron's Classical Variogram Estimator Under Elliptically Contoured Distributions

The classical variogram estimator proposed by Matheron can be written as a quadratic form of the observations. When data have an elliptically contoured distribution with constant mean, the correlation between the classical variogram estimator at two different lags is a function of the spatial design matrix, the covariance matrix, and the kurtosis. Several specific cases are studied closely. A subclass of elliptically contoured distributions with a particular family of covariance matrices is shown to possess exactly the same correlation structure for the classical variogram estimator as the multivariate independent Gaussian distribution. The consequences on variogram fitting by generalized least squares are discussed.     

Inner product matrices, kriging, and nonparametric estimation of variogram

Two important problems in the practical implementation of kriging are: (1) estimation of the variogram, and (2) estimation of the prediction error. In this paper, a nonparametric estimator of the variogram to circumvent the problem of the precise choice of a variogram model is proposed. Using orthogonal decomposition of the kriging predictor and the prediction error, a method for selecting, what may be considered, a statistical neighborhood is suggested. The prediction error estimates based on this scheme, in fact, reflects the true prediction error, thus leading to proper coverage for the corresponding prediction interval. By simulations and a reanalysis of published data, it is shown that the proposals made in this paper are useful in practice.     

A Simple and Robust Lognormal Estimator

In an open pit mine, the selection of blocks for mill feed necessitates the use of a conditionally unbiased estimator not only to maximize profits, but also to predict precisely the grades at the mill. Estimation of blocks usually is done using a series of blasthole assays on a regular grid. In many instances, the blasthole grades show a lognormal-like distribution. This study examines an estimator based on the hypothesis of bilognormality between the true block grade and the estimate obtained using the blastholes. The properties of the estimator are established and the estimator is proven to be conditionally unbiased. It is almost as precise as the lognormal kriging estimator when the points are multilognormal. However, it is more precise than lognormal krigings when only univariate lognormality is present or when the distribution is not exactly lognormal. The estimator also is shown to be robust to errors in the specifications of the variogram model or of the expectation of Z. Contrary to lognormal krigings, the estimator does only a slight correction to the original estimate obtained using the blastholes assays.     

储量的地质统计学估计及其与传统计算法比较

概述了克里格法应用于北方某煤矿的储量计算结果,并将其与传统方法的计算结果进行比较,说明了该法的应用价值。      

Some aspects of transformations of compositional data and the identification of outliers

The statistical analysis of compositional data is based on determining an appropriate transformation from the simplex to real space. Possible transfonnations and outliers strongly interact: parameters of transformations may be influenced particularly by outliers, and the result of goodness-of-fit tests will reflect their presence. Thus, the identification of outliers in compositional datasets and the selection of an appropriate transformation of the same data, are problems that cannot be separated. A robust method for outlier detection together with the likelihood of transformed data is presented as a first approach to solve those problems when the additive-logratio and multivariate Box-Cox transformations are used. Three examples illustrate the proposed methodology.     

Notes on the robustness of the kriging system

The robustness of the kriging system with respect to uncertainty of the theoretical variogram is investigated. Inequalities for possible changes of the kriging estimator and the estimation variance are derived. Results of a numerical study show that changes of kriging weights can be predicted partly with the help of the maximal kriging weight.     

Robustness of variograms and conditioning of kriging matrices

Current ideas of robustness in geostatistics concentrate upon estimation of the experimental variogram. However, predictive algorithms can be very sensitive to small perturbations in data or in the variogram model as well. To quantify this notion of robustness, nearness of variogram models is defined. Closeness of two variogram models is reflected in the sensitivity of their corresponding kriging estimators. The condition number of kriging matrices is shown to play a central role. Various examples are given. The ideas are used to analyze more complex universal kriging systems.Research performed while on leave at Centre de Geóstatistique et de Morphologie Mathématique, Fontainebleau.     

M-Estimator of the drift coefficients in a spatial linear model

Kriging as an interpolation method, uses as predictor a linear function of the observations, minimizing the mean squared prediction error or estimation variance. Under multivariate normality assumptions, the given predictor is the best unbiased predictor, and will be vulnerable to outliers. To overcome this problem, a robust weighted estimator of the drift model coefficients is proposed, where unequally spaced data may be weighted through the tile areas of the Dirichlet tessellation.     

A Robust Multiquadric Method for Digital Elevation Model Construction

The multiquadric method (MQ) with high interpolation accuracy has been widely used for interpolating spatial data. However, MQ is an exact interpolation method, which is improper to interpolate noisy sampling data. Although the least squares MQ (LSMQ) has the ability to smooth out sampling errors, it is inherently not robust to outliers due to the least squares criterion in estimating the weights of sampling knots. In order to reduce the impact of outliers on the accuracy of digital elevation models (DEMs), a robust method of MQ (MQ-R) has been developed. MQ-R includes two independent procedures: knot selection and the solution of the system of linear equations. The two independent procedures were respectively achieved by the space-filling design and the least absolute deviation, both of which are very robust to outliers. Gaussian synthetic surface, which is subject to a series of errors with different distributions, was employed to compare the performance of MQ-R with that of LSMQ. Results indicate that LSMQ is seriously affected by outliers, whereas MQ-R performs well in resisting outliers, and can construct satisfactory surfaces even though the data are contaminated by severe outliers. A real-world example of DEM construction was employed to evaluate the robustness of MQ-R, LSMQ, and the classical interpolation methods including inverse distance weighting method, thin plate spline, and ANUDEM. Results showed that compared with the classical methods, MQ-R has the highest accuracy in terms of root mean square error. In conclusion, when sampling data is subject to outliers, MQ-R can be considered as an alternative method for DEM construction.     

BLP approach for the estimation of variogram parameters

Variograms of hydrologic characteristics are usually obtained by estimating the experimental variogram for distinct lag classes by commonly used estimators and fitting a suitable function to these estimates. However, these estimators may fail the conditionally positive-definite property and the better results for the statistics of cross-validation, which are two essential conditions for choosing a valid variogram model. To satisfy these two conditions, a multi-objective bilevel programming estimator (MOBLP) which is based on the process of cross-validation has been developed for better estimate of variogram parameters. This model is illustrated with some rainfall data from Luan River Basin in China. The case study demonstrated that MOBLP is an effective way to achieve a valid variogram model.     

An application of the deterministic variogram to design-based variance estimation

When estimating the mean value of a variable, or the total amount of a resource, within a specified region it is desirable to report an estimated standard error for the resulting estimate. If the sample sites are selected according to a probability sampling design, it usually is possible to construct an appropriate design-based standard error estimate. One exception is systematic sampling for which no such standard error estimator exists. However, a slight modification of systematic sampling, termed 2-step tessellation stratified (2TS) sampling, does permit the estimation of design-based standard errors. This paper develops a design-based standard error estimator for 2TS sampling. It is shown that the Taylor series approximation to the variance of the sample mean under 2TS sampling may be expressed in terms of either a deterministic variogram or a deterministic covariance function. Variance estimation then can be approached through the estimation of a variogram or a covariance function. The resulting standard error estimators are compared to some more traditional variance estimators through a simulation study. The simulation results show that estimators based on the new approach may perform better than traditional variance estimators.     

Fitting matrix-valued variogram models by simultaneous diagonalization (Part II: Application)

As an application, we demonstrate a proposed variogram modeling scheme using a spatial data set. Because the scheme relies on a procedure for simultaneously diagonalizing several matrices, we briefly describe the FG and least-squares algorithms. The model obtained by our scheme is used to cokrige the data. In addition, the proposed scheme is compared to more traditional methods.