通用EIV平差模型及其加权整体最小二乘估计

以平差基本理论为基础,提出了EIV(errors-in-variables)平差模型的通用形式,涵盖了间接平差、条件平差、附有参数的条件平差及附有限制条件的间接平差等基本EIV模型形式。基于整体最小二乘估计准则,研究了通用EIV模型的加权整体最小二乘算法,并推导了估计结果的近似精度公式。通用EIV模型及其整体最小二乘算法是对EIV模型估计理论的进一步完善,统一的整体最小二乘算法有利于软件的编程实现,有助于推动EIV模型估计理论的应用。     

Weighted total least squares: necessary and sufficient conditions, fixed and random parameters

A standard errors-in-variables (EIV) model refers to a Gauss–Markov model with an uncertain model matrix from a geodetic perspective. Least squares within the EIV model is usually called the total least squares (TLS) technique because of its symmetrical adjustment. However, the solutions and computational advantages of the weighted TLS problem with a general weight matrix (WTLS) are mostly unknown. In this study, the WTLS problem was solved using three different approaches: iterative methods based on the normal equation, the iteratively linearized Gauss–Helmert model with algebraic Jacobian matrices, and numerical analysis. Furthermore, sufficient conditions for WTLS optimization were investigated systematically as proposed solutions yield only necessary conditions for optimality. A WTLS solution was considered to treat random parameters within the EIV model. Last, applications to test these novel algorithms are presented.     

基于EIV模型的稳健估计

EIV（error-in-variables）模型同时考虑观测向量和系数矩阵的误差,自提出以来便得到广泛应用。目前针对EIV模型的整体最小二乘解法（TLS）假设观测值仅含有偶然误差,当观测值存在粗差时其解并不是最优的。文中通过选定合适的权函数,结合加权整体最小二乘迭代算法,导出基于EIV模型的稳健整体最小二乘迭代解法（RTLS）。线性拟合实验表明,文中方法能对粗差进行定位,且估计量受粗差影响较小,具有稳健性。     

加权整体最小二乘EIV模型与算法——与"加权整体最小二乘EIO模型与算法"一文的讨论

加权整体最小二乘方法是一种能同时顾及EIV（errors-in-variables）模型中系数矩阵和观测向量误差的参数估计方法。根据不同的应用场景,EIV模型则表现出不同的结构特征。"加权整体最小二乘EIO模型与算法"一文采用EIO模型处理EIV模型中的结构化问题^*。为了将其与现有方法进行对比,本文罗列出4种处理EIV模型结构特征的方法,并归纳了8种参数估计公式。同时从精度评定的角度讨论了整体最小二乘解的一阶及更高阶精度近似评定方法。需要强调的是,针对EIV模型及其参数估计理论可以从函数模型、随机模型和参数估计方法3个方面展开研究,但各方法殊途同归。     

加权总体最小二乘的效率优化算法

加权总体最小二乘法是理论上估计EIV模型参数相对严密的方法,其迭代过程中涉及的矩阵运算较为耗时,在处理大量级数据时尤其明显。PEIV模型有助于提高加权总体最小二乘法的计算效率。本文基于PEIV模型和经典最小二乘准则给出了一种加权总体最小二乘法算法,算法的推导过程简洁,易于理解,迭代过程中无需重构矩阵,减少了矩阵运算量。最后通过仿真试验验证了算法的可靠性。试验结果表明,本文算法可以取得与现有算法相同的参数估计精度且计算效率更高。     

坐标转换Partial-EIV总体最小二乘方法

在测量数据处理过程中,针对系数矩阵中同时存在随机元素和固定元素的情况,Xu等通过将随机元素分离使EIV模型推广到Partial-EIV模型,并给出基于Partial-EIV模型的总体最小二乘(TLS)算法。文中介绍该算法,并将其应用在平面及空间的坐标转换中,通过与最小二乘(LS)、总体最小二乘(TLS)及加权总体最小二乘(WTLS)方法的比较和分析,验证该算法有效性。     

二维直角建筑物规则化的加权总体最小二乘平差方法

针对基于遥感数据的二维建筑物的直角化问题,以建筑物边界点的坐标为观测值,以顾及边界正交限制条件的直线斜率和截距为参数,建立附有限制条件的变量误差（errors-in-variables,EIV）模型。考虑观测向量和设计矩阵相关的情况,给出了增广设计矩阵的协方差阵的计算方法,推导了附限制条件的通用加权总体最小二乘（weighted total least squares,WTLS）平差算法,以及近似精度评定算法和仅含二次型限制条件的WTLS平差方法。理论和算例分析表明,在建筑物重建问题中,附有限制条件的EIV模型比经典附有限制条件的Gauss-Helmert模型易于构建,所提的WTLS算法快速收敛速度快,对拓展WTLS平差方法的应用具有理论与实践意义。     

基于改进目标函数的partial EIV模型WTLS估计的新算法

针对部分变量误差（partial EIV）模型的加权整体最小二乘（weighted total least squares,WTLS）估值的计算需要多次迭代且效率低下的情况,根据加权LS（least square）原理,通过改进目标函数,并运用矩阵微分运算以及矩阵反演变换,提出了一种计算partial EIV模型WTLS估值的新算法。算例计算结果表明,新算法具有迭代次数少、计算效率高等优点。     

Effects of errors-in-variables on weighted least squares estimation

Although total least squares (TLS) is more rigorous than the weighted least squares (LS) method to estimate the parameters in an errors-in-variables (EIV) model, it is computationally much more complicated than the weighted LS method. For some EIV problems, the TLS and weighted LS methods have been shown to produce practically negligible differences in the estimated parameters. To understand under what conditions we can safely use the usual weighted LS method, we systematically investigate the effects of the random errors of the design matrix on weighted LS adjustment. We derive the effects of EIV on the estimated quantities of geodetic interest, in particular, the model parameters, the variance–covariance matrix of the estimated parameters and the variance of unit weight. By simplifying our bias formulae, we can readily show that the corresponding statistical results obtained by Hodges and Moore (Appl Stat 21:185–195, 1972) and Davies and Hutton (Biometrika 62:383–391, 1975) are actually the special cases of our study. The theoretical analysis of bias has shown that the effect of random matrix on adjustment depends on the design matrix itself, the variance–covariance matrix of its elements and the model parameters. Using the derived formulae of bias, we can remove the effect of the random matrix from the weighted LS estimate and accordingly obtain the bias-corrected weighted LS estimate for the EIV model. We derive the bias of the weighted LS estimate of the variance of unit weight. The random errors of the design matrix can significantly affect the weighted LS estimate of the variance of unit weight. The theoretical analysis successfully explains all the anomalously large estimates of the variance of unit weight reported in the geodetic literature. We propose bias-corrected estimates for the variance of unit weight. Finally, we analyze two examples of coordinate transformation and climate change, which have shown that the bias-corrected weighted LS method can perform numerically as well as the weighted TLS method.     

部分变量误差模型的整体抗差最小二乘估计

部分变量误差模型(partial EIV model)的加权整体最小二乘(weighted total least-squares,WTLS)估计不具备抵御粗差的能力。鉴于粗差可能同时出现在观测值和系数矩阵中,本文在提出部分变量误差模型WTLS估计的两步迭代解法的基础上,运用抗差M估计的等价权方法,发展了一种整体抗差最小二乘(TRLS)估计方法,并采用一致最大功效统计量确定降权因子。针对WTLS估计两步迭代解法的特点,设计了两个不同的降权方案:第1个方案是在估计系数矩阵元素时,不对观测值降权,仅对系数矩阵降权;第2个方案是在估计系数矩阵元素时,既对系数矩阵降权,同时也对观测值降权。通过对模拟2D仿射变换和线性拟合实例进行计算和分析,结果表明第1方案优于第2方案,并且优于基于残差和验后单位权方差的抗差估计和现有的变量误差模型抗差估计。     

Generalization of total least-squares on example of unweighted and weighted 2D similarity transformation

In this contribution it is shown that the so-called “total least-squares estimate” (TLS) within an errors-in-variables (EIV) model can be identified as a special case of the method of least-squares within the nonlinear Gauss–Helmert model. In contrast to the EIV-model, the nonlinear GH-model does not impose any restrictions on the form of functional relationship between the quantities involved in the model. Even more complex EIV-models, which require specific approaches like “generalized total least-squares” (GTLS) or “structured total least-squares” (STLS), can be treated as nonlinear GH-models without any serious problems. The example of a similarity transformation of planar coordinates shows that the “total least-squares solution” can be obtained easily from a rigorous evaluation of the Gauss–Helmert model. In contrast to weighted TLS, weights can then be introduced without further limitations. Using two numerical examples taken from the literature, these solutions are compared with those obtained from certain specialized TLS approaches.     

基于非线性高斯-赫尔默特模型的混合整体最小二乘估计

针对EIV模型的系数矩阵同时包含固定量和随机量的情况,通过将系数矩阵中的随机量提取出来纳入平差的随机模型,从而将EIV模型表示为非线性高斯-赫尔默特(Gauss-Herlmert,GH)模型形式,推导了混合LS-TLS(least squares-total least squares,LS-TLS)算法及其精度估计公式。算法适用于系数矩阵包含固定列、固定元素和随机元素的一般情况。模拟实例结果表明,混合LS-TLS算法与已有能够解决系数矩阵同时含固定量和随机量的结构性或加权TLS算法的估计结果一致;混合LS-TLS的估计结果统计上要优于LS或TLS估计结果。     

On non-combinatorial weighted total least squares with inequality constraints

Observation systems known as errors-in-variables (EIV) models with model parameters estimated by total least squares (TLS) have been discussed for more than a century, though the terms EIV and TLS were coined much more recently. So far, it has only been shown that the inequality-constrained TLS (ICTLS) solution can be obtained by the combinatorial methods, assuming that the weight matrices of observations involved in the data vector and the data matrix are identity matrices. Although the previous works test all combinations of active sets or solution schemes in a clear way, some aspects have received little or no attention such as admissible weights, solution characteristics and numerical efficiency. Therefore, the aim of this study was to adjust the EIV model, subject to linear inequality constraints. In particular, (1) This work deals with a symmetrical positive-definite cofactor matrix that could otherwise be quite arbitrary. It also considers cross-correlations between cofactor matrices for the random coefficient matrix and the random observation vector. (2) From a theoretical perspective, we present first-order Karush–Kuhn–Tucker (KKT) necessary conditions and the second-order sufficient conditions of the inequality-constrained weighted TLS (ICWTLS) solution by analytical formulation. (3) From a numerical perspective, an active set method without combinatorial tests as well as a method based on sequential quadratic programming (SQP) is established. By way of applications, computational costs of the proposed algorithms are shown to be significantly lower than the currently existing ICTLS methods. It is also shown that the proposed methods can treat the ICWTLS problem in the case of more general weight matrices. Finally, we study the ICWTLS solution in terms of non-convex weighted TLS contours from a geometrical perspective.     

动态EIV模型及其总体卡尔曼滤波方法

针对求解动态EIV模型时未考虑状态方程中状态转移矩阵误差的问题,本文建立了一种能够同时顾及状态方程和观测方程中各量误差的动态EIV模型。推导了针对该动态EIV模型的总体卡尔曼滤波方法及其近似精度评定公式。对比分析了本文总体卡尔曼滤波方法与已有总体卡尔曼滤波方法及总体最小二乘方法的异同。算例结果表明,本文方法统计上要优于标准卡尔曼滤波方法和已有的总体卡尔曼滤波方法。     

On symmetrical three-dimensional datum conversion

A 3-D similarity transformation is frequently used to convert GPS-WGS84-based coordinates to those in a local datum using a set of control points with coordinate values in both systems. In this application, the Gauss-Markov (GM) model is often employed to represent the problem, and a least-squares approach is used to compute the parameters within the mathematical model. However, the Gauss–Markov model considers the source coordinates in the data matrix (A) as fixed or error-free; this is an imprecise assumption since these coordinates are also measured quantities and include random errors. The errors-in-variables (EIV) model assumes that all the variables in the mathematical model are contaminated by random errors. This model may be solved using the relatively new total least-squares (TLS) estimation technique, introduced in 1980 by Golub and Van Loan. In this paper, the similarity transformation problem is analyzed with respect to the EIV model, and a novel algorithm is described to obtain the transformation parameters. It is proved that even with the EIV model, a closed form Procrustes approach can be employed to obtain the rotation matrix and translation parameters. The transformation scale may be calculated by solving the proper quadratic equation. A numerical example and a practical case study are presented to test this new algorithm and compare the EIV and the GM models.     

线性化通用EIV平差模型的岭估计解法

通用EIV(errors-in-variables)平差模型作为经典平差模型的一般化形式,具有同时顾及多种随机误差的优势. 在通用EIV平差模型加权总体最小二乘(WTLS)的线性化估计基础上,引入正则化准则. 正则化矩阵为单位矩阵时为岭估计,添加目标函数,通过建立拉格朗日目标函数的最小化求解,导出加权通用EIV平差模型对应的岭估计解式,给出了确定岭参数的U曲线法和L曲线法. 计算了通用EIV平差模型的线性化估计、两种岭估计及其对应的方差分量值;验证岭估计对通用EIV模型的线性化估计具有促进性,可减少迭代次数,使得参数方差分量更快趋于平稳,降低参数估计的计算量.      

Total least squares adjustment in partial errors-in-variables models: algorithm and statistical analysis

The weighted total least squares (TLS) method has been developed to deal with observation equations, which are functions of both unknown parameters of interest and other measured data contaminated with random errors. Such an observation model is well known as an errors-in-variables (EIV) model and almost always solved as a nonlinear equality-constrained adjustment problem. We reformulate it as a nonlinear adjustment model without constraints and further extend it to a partial EIV model, in which not all the elements of the design matrix are random. As a result, the total number of unknowns in the normal equations has been significantly reduced. We derive a set of formulae for algorithmic implementation to numerically estimate the unknown model parameters. Since little statistical results about the TLS estimator in the case of finite samples are available, we investigate the statistical consequences of nonlinearity on the nonlinear TLS estimate, including the first order approximation of accuracy, nonlinear confidence region and bias of the nonlinear TLS estimate, and use the bias-corrected residuals to estimate the variance of unit weight.     

PEIV模型WTLS估计的Fisher-Score算法

考虑系数矩阵含非随机元素和不同位置含相同随机元素的结构化特征,PEIV（partial errors-in-variables）模型较一般的EIV模型更为严格。现有PEIV模型加权整体最小二乘（weighted total least squares,WTLS）估计算法需多次迭代,影响计算效率。通过利用观测值误差和系数矩阵误差的统计性质构造非线性目标函数,并以此推导了新的PEIV模型WTLS估计的计算公式,同时设计了相应的Fisher-Score算法。算例分析结果表明,相比较而言,Fisher-Score算法迭代次数较少,计算效率得到大大提升。     

系数矩阵误差对地壳应变参数反演的影响

针对地壳应变参数反演模型中系数矩阵含随机和非随机元素及观测数据存在相关性等情况,以部分变量误差（partial-errors-in-variables,PEIV）模型为基础,采用了地壳应变参数反演的加权总体最小二乘算法,该算法不受系数矩阵和权矩阵结构的限制,能够快速、有效解决系数矩阵含有随机误差的模型问题。结合推导得到的最小二乘改正项公式,对地壳反演模型中坐标点误差对反演参数求解的影响进行了分析。通过对模拟数据和川滇地区的实际数据进行处理,得出系数矩阵误差对地壳应变参数反演的影响主要受GPS站点坐标值量级以及应变参数量级的牵制。