On the condition number of covariance matrices in kriging, estimation, and simulation of random fields

The numerical stability of linear systems arising in kriging, estimation, and simulation of random fields, is studied analytically and numerically. In the state-space formulation of kriging, as developed here, the stability of the kriging system depends on the condition number of the prior, stationary covariance matrix. The same is true for conditional random field generation by the superposition method, which is based on kriging, and the multivariate Gaussian method, which requires factoring a covariance matrix. A large condition number corresponds to an ill-conditioned, numerically unstable system. In the case of stationary covariance matrices and uniform grids, as occurs in kriging of uniformly sampled data, the degree of ill-conditioning generally increases indefinitely with sampling density and, to a limit, with domain size. The precise behavior is, however, highly sensitive to the underlying covariance model. Detailed analytical and numerical results are given for five one-dimensional covariance models: (1) hole-exponential, (2) exponential, (3) linear-exponential, (4) hole-Gaussian, and (5) Gaussian. This list reflects an approximate ranking of the models, from best to worst conditioned. The methods developed in this work can be used to analyze other covariance models. Examples of such representative analyses, conducted in this work, include the spherical and periodic hole-effect (hole-sinusoidal) covariance models. The effect of small-scale variability (nugget) is addressed and extensions to irregular sampling schemes and higher dimensional spaces are discussed.