Weighted total least squares: necessary and sufficient conditions, fixed and random parameters

A standard errors-in-variables (EIV) model refers to a Gauss–Markov model with an uncertain model matrix from a geodetic perspective. Least squares within the EIV model is usually called the total least squares (TLS) technique because of its symmetrical adjustment. However, the solutions and computational advantages of the weighted TLS problem with a general weight matrix (WTLS) are mostly unknown. In this study, the WTLS problem was solved using three different approaches: iterative methods based on the normal equation, the iteratively linearized Gauss–Helmert model with algebraic Jacobian matrices, and numerical analysis. Furthermore, sufficient conditions for WTLS optimization were investigated systematically as proposed solutions yield only necessary conditions for optimality. A WTLS solution was considered to treat random parameters within the EIV model. Last, applications to test these novel algorithms are presented.     

基于EIV模型的稳健估计

EIV（error-in-variables）模型同时考虑观测向量和系数矩阵的误差,自提出以来便得到广泛应用。目前针对EIV模型的整体最小二乘解法（TLS）假设观测值仅含有偶然误差,当观测值存在粗差时其解并不是最优的。文中通过选定合适的权函数,结合加权整体最小二乘迭代算法,导出基于EIV模型的稳健整体最小二乘迭代解法（RTLS）。线性拟合实验表明,文中方法能对粗差进行定位,且估计量受粗差影响较小,具有稳健性。     

线性化通用EIV平差模型的岭估计解法

通用EIV(errors-in-variables)平差模型作为经典平差模型的一般化形式,具有同时顾及多种随机误差的优势. 在通用EIV平差模型加权总体最小二乘(WTLS)的线性化估计基础上,引入正则化准则. 正则化矩阵为单位矩阵时为岭估计,添加目标函数,通过建立拉格朗日目标函数的最小化求解,导出加权通用EIV平差模型对应的岭估计解式,给出了确定岭参数的U曲线法和L曲线法. 计算了通用EIV平差模型的线性化估计、两种岭估计及其对应的方差分量值;验证岭估计对通用EIV模型的线性化估计具有促进性,可减少迭代次数,使得参数方差分量更快趋于平稳,降低参数估计的计算量.      

Criteria for internal reliability of linear least squares models

An approach to analysis of internal reliability of linear least squares models is presented. It is based on the relationship between a single observational disturbance, i.e. a gross error or a blunder, and the model response being a certain pattern of distortions in the least squares residuals. Rigorous formulae describing this relationship in terms of internal reliability characteristics are derived both for the models with uncorrelated and correlated observations. A specific case of decorrelated observations is also taken into consideration. Finally, the criteria for the evaluation of the model internal reliability are proposed for all the above cases. It is worth mentioning that the criteria are obtained without resorting to any particular method of statistical testing. The theory is illustrated with two numerical examples, using simple measuring schemes.     

多变量稳健总体最小二乘平差方法

分析指出了在总体最小二乘解下,含有多列独立变量的(以下简称为多变量)变量含误差(errors-invariables,EIV)模型,其各列变量的改正数受对应的参数估值与观测向量先验精度的联合影响,参数估值与观测向量先验精度的乘积越大,则该列变量的改正数越大。因此,现有稳健总体最小二乘方法采用同一个单位权中误差对多变量EIV模型进行降权处理时,会优先对模型中的某一列变量进行降权处理,从而造成平差结果不合理甚至错误,称之为虚假稳健估计现象。鉴于此,提出了多变量稳健总体最小二乘平差方法,并导出了相应的参数估计与精度评定公式。该方法对含有粗差的多变量EIV模型的各列独立变量分别进行降权处理,从而避免虚假稳健估计现象的发生。仿真算例结果表明,当观测值含有粗差时,该方法能够有效避免虚假稳健估计现象的发生,并能够定位出粗差所对应的误差方程;相较于总体最小二乘和稳健最小二乘方法,该方法的参数估计结果更接近真值。     

基于非线性高斯-赫尔默特模型的结构总体最小二乘法

变量误差（error-in-variables,EIV）模型的系数矩阵存在结构特征的情况,并且这种结构特征可以扩展到观测向量中。首先采用变量投影法将系数矩阵的增广矩阵展开成仿射矩阵形式,提取系数矩阵和观测向量中的随机量,并将EIV模型表示为非线性高斯-赫尔默特模型,然后利用非线性最小二乘原理推导了一种结构总体最小二乘法。该算法统一了普通的结构总体最小二乘法、结构数据最小二乘法以及最小二乘法。将该算法应用到真实算例和模拟算例中,两个算例结果表明,该算法与已有能够解决EIV模型结构特征的结构或加权总体最小二乘法估计结果一致,验证了该算法的有效性。同时,该算法对结构特征的提取方式简单、规律性强且易于编程实现;且在算法设计中,把结构总体最小二乘问题转换为附有参数的条件平差问题,即将其纳入到最小二乘平差理论体系,便于其扩展应用。同时对平面拟合问题的误差估计特性进行了定性分析,由分析可知参数的相对大小对估计误差的一致性有直接影响,这说明EIV模型下系数矩阵和观测向量中随机量的估计误差与真误差的一致性关系相对复杂。     

PEIV模型参数估计新算法

PEIV(Partial Errors-In-Variables)模型是EIV模型的扩展,它能解决系数矩阵含有非随机元素或存在结构特性的问题。针对常规PEIV模型算法的复杂性,提出了一种PEIV模型参数估计的新算法。该算法将系数矩阵含误差的元素看成是一类观测值,与平差模型原观测值构成两类观测值,将PEIV平差模型表示为类似于传统的最小二乘间接平差模型,再通过非线性最小二乘平差理论,推导出了算法的迭代公式和精度评定公式。算法迭代格式与间接平差类似,通过算例验证了算法的可行性和正确性。     

动态EIV模型及其总体卡尔曼滤波方法

针对求解动态EIV模型时未考虑状态方程中状态转移矩阵误差的问题,本文建立了一种能够同时顾及状态方程和观测方程中各量误差的动态EIV模型。推导了针对该动态EIV模型的总体卡尔曼滤波方法及其近似精度评定公式。对比分析了本文总体卡尔曼滤波方法与已有总体卡尔曼滤波方法及总体最小二乘方法的异同。算例结果表明,本文方法统计上要优于标准卡尔曼滤波方法和已有的总体卡尔曼滤波方法。     

二维直角建筑物规则化的加权总体最小二乘平差方法

针对基于遥感数据的二维建筑物的直角化问题,以建筑物边界点的坐标为观测值,以顾及边界正交限制条件的直线斜率和截距为参数,建立附有限制条件的变量误差（errors-in-variables,EIV）模型。考虑观测向量和设计矩阵相关的情况,给出了增广设计矩阵的协方差阵的计算方法,推导了附限制条件的通用加权总体最小二乘（weighted total least squares,WTLS）平差算法,以及近似精度评定算法和仅含二次型限制条件的WTLS平差方法。理论和算例分析表明,在建筑物重建问题中,附有限制条件的EIV模型比经典附有限制条件的Gauss-Helmert模型易于构建,所提的WTLS算法快速收敛速度快,对拓展WTLS平差方法的应用具有理论与实践意义。     

部分变量误差模型的整体抗差最小二乘估计

部分变量误差模型(partial EIV model)的加权整体最小二乘(weighted total least-squares,WTLS)估计不具备抵御粗差的能力。鉴于粗差可能同时出现在观测值和系数矩阵中,本文在提出部分变量误差模型WTLS估计的两步迭代解法的基础上,运用抗差M估计的等价权方法,发展了一种整体抗差最小二乘(TRLS)估计方法,并采用一致最大功效统计量确定降权因子。针对WTLS估计两步迭代解法的特点,设计了两个不同的降权方案:第1个方案是在估计系数矩阵元素时,不对观测值降权,仅对系数矩阵降权;第2个方案是在估计系数矩阵元素时,既对系数矩阵降权,同时也对观测值降权。通过对模拟2D仿射变换和线性拟合实例进行计算和分析,结果表明第1方案优于第2方案,并且优于基于残差和验后单位权方差的抗差估计和现有的变量误差模型抗差估计。     

通用EIV平差模型及其加权整体最小二乘估计

以平差基本理论为基础,提出了EIV(errors-in-variables)平差模型的通用形式,涵盖了间接平差、条件平差、附有参数的条件平差及附有限制条件的间接平差等基本EIV模型形式。基于整体最小二乘估计准则,研究了通用EIV模型的加权整体最小二乘算法,并推导了估计结果的近似精度公式。通用EIV模型及其整体最小二乘算法是对EIV模型估计理论的进一步完善,统一的整体最小二乘算法有利于软件的编程实现,有助于推动EIV模型估计理论的应用。     

Solution of the weighted symmetric similarity transformations based on quaternions

A new method through Gauss–Helmert model of adjustment is presented for the solution of the similarity transformations, either 3D or 2D, in the frame of errors-in-variables (EIV) model. EIV model assumes that all the variables in the mathematical model are contaminated by random errors. Total least squares estimation technique may be used to solve the EIV model. Accounting for the heteroscedastic uncertainty both in the target and the source coordinates, that is the more common and general case in practice, leads to a more realistic estimation of the transformation parameters. The presented algorithm can handle the heteroscedastic transformation problems, i.e., positions of the both target and the source points may have full covariance matrices. Therefore, there is no limitation such as the isotropic or the homogenous accuracy for the reference point coordinates. The developed algorithm takes the advantage of the quaternion definition which uniquely represents a 3D rotation matrix. The transformation parameters: scale, translations, and the quaternion (so that the rotation matrix) along with their covariances, are iteratively estimated with rapid convergence. Moreover, prior least squares (LS) estimation of the unknown transformation parameters is not required to start the iterations. We also show that the developed method can also be used to estimate the 2D similarity transformation parameters by simply treating the problem as a 3D transformation problem with zero (0) values assigned for the z-components of both target and source points. The efficiency of the new algorithm is presented with the numerical examples and comparisons with the results of the previous studies which use the same data set. Simulation experiments for the evaluation and comparison of the proposed and the conventional weighted LS (WLS) method is also presented.     

加权整体最小二乘EIV模型与算法——与"加权整体最小二乘EIO模型与算法"一文的讨论

加权整体最小二乘方法是一种能同时顾及EIV（errors-in-variables）模型中系数矩阵和观测向量误差的参数估计方法。根据不同的应用场景,EIV模型则表现出不同的结构特征。"加权整体最小二乘EIO模型与算法"一文采用EIO模型处理EIV模型中的结构化问题^*。为了将其与现有方法进行对比,本文罗列出4种处理EIV模型结构特征的方法,并归纳了8种参数估计公式。同时从精度评定的角度讨论了整体最小二乘解的一阶及更高阶精度近似评定方法。需要强调的是,针对EIV模型及其参数估计理论可以从函数模型、随机模型和参数估计方法3个方面展开研究,但各方法殊途同归。     

Partial EIV模型的解法

提出了一种求解partial errors-in-variables(partial EIV)模型的思路。通过对partial EIV模型的部分元素进行移项,重组成新形式下的平差函数模型,两次运用间接平差原理分别求解平差参数与系数矩阵中的随机元素,把总体最小二乘平差问题转化为最小二乘平差问题,并通过适当变换提高了新解法的收敛速度。最后分别采用实测数据和模拟数据进行验证,求解了本文算法与已有算法的估值结果。算例结果表明,本文算法能取得与已有算法相同的结果,是切实可行的。     

隐式标度因子的总体最小二乘估计方法

分析指出了标度总体最小二乘方法(STLS)存在的问题,提出了一种隐式标度因子的标度总体最小二乘方法(Im STLS)。区别于现有STLS方法在平差准则中引入标度因子,Im STLS方法在EIV函数模型中顾及标度因子,从而解决了现有STLS平差准则形式与标度因子实际表征的平差结果不一致的问题。此外,利用所建函数模型的重构表达式推导的Im STLS估计量及其方差-协方差阵,与经典最小二乘平差理论具有形式同构性。最后,验证了所提方法统一表达LS,DLS和TLS的正确性,并讨论给出了标度因子对平差结果的影响及确定方法。     

加权整体最小二乘EIO模型与算法

构造了加权整体最小二乘EIO(errors-in-observations)模型,只改正独立观测值,观测值协因数阵最简洁,可克服EIV模型缺陷。基于EIO模型推导了参数估计和协因数阵精确迭代算法,实例结果正确,计算效率高。     

An iterative solution of weighted total least-squares adjustment

Total least-squares (TLS) adjustment is used to estimate the parameters in the errors-in-variables (EIV) model. However, its exact solution is rather complicated, and the accuracies of estimated parameters are too difficult to analytically compute. Since the EIV model is essentially a non-linear model, it can be solved according to the theory of non-linear least-squares adjustment. In this contribution, we will propose an iterative method of weighted TLS (WTLS) adjustment to solve EIV model based on Newton–Gauss approach of non-linear weighted least-squares (WLS) adjustment. Then the WLS solution to linearly approximated EIV model is derived and its discrepancy is investigated by comparing with WTLS solution. In addition, a numerical method is developed to compute the unbiased variance component estimate and the covariance matrix of the WTLS estimates. Finally, the real and simulation experiments are implemented to demonstrate the performance and efficiency of the presented iterative method and its linearly approximated version as well as the numerical method. The results show that the proposed iterative method can obtain such good solution as WTLS solution of Schaffrin and Wieser (J Geod 82:415–421, 2008) and the presented numerical method can be reasonably applied to evaluate the accuracy of WTLS solution.     

病态加权总体最小二乘的广义岭估计解法

针对加权情形下的变量误差(EIV)模型,采用广义岭估计法处理总体最小二乘平差的病态性问题. 结合最优化准则和协方差传播率推导了未知参数的改正数求解公式;根据参数估计值的均方误差最小化原理,通过求偏导数列出广义岭估计中岭参数的迭代解式,并讨论了广义岭参数的含义和作用,给出了确定岭参数的L-曲线法. 通过算例比较分析了加权最小二乘估计、总体最小二乘估计、加权最小二乘岭估计、总体最小二乘岭估计、加权最小二乘的广义岭估计和总体最小二乘广义岭估计,叙述了加权总体最小二乘的广义岭估计的优缺点.      

一种相关观测的Partial EIV模型求解方法

Partial errors-in-variables(Partial-EIV)模型作为EIV模型的扩展形式,其构造方式更有规律,解算方法更为简便,能有效应用于实际情况。针对已有Partial EIV模型方法未考虑观测向量和系数矩阵存在相关性这一情况,通过提取观测向量和系数矩阵组成的增广矩阵中非重复出现的随机元素,构建更具一般适用性的Partial EIV模型,在该模型的基础上,将特殊假定条件扩展到不限定观测数据相关性的一般情况,详细推导了观测向量和系数矩阵元素相关且不等精度情况下的加权总体最小二乘方法,通过算例试验,并与目前已有的解决EIV模型相关观测情况下的方法进行了比较分析,研究表明本文方法可以提高计算效率,更具一般性,特别是对于观测向量和系数矩阵中存在常数元素和重复元素的情况。