Image sequence based automatic multi-camera system calibration techniques

An image sequence-based, fully automatic and rather flexible procedure for the calibration of stationary multi-camera systems for 3-D observation of dynamic events is presented and analysed. While conventional close-range camera calibration techniques are either based on a stable point-field with known reference coordinates or on a temporarily stationary point-field with only approximately known 3-D coordinates, which is imaged from different locations and under different orientations with one single camera, the presented technique is based on stationary cameras and moving targets, making use of the image sequence acquisition nature of most solid state cameras. In the simplest version, only one easily detectable marker has to be tracked through image sequences of multiple pre-calibrated cameras, thus avoiding the necessity of homologous feature identification for the establishment of multi-view correspondences; 3-D coordinates of the marker position are not required. This single-marker method does not allow for the determination of the interior orientation. In an extended version allowing for full camera orientation and calibration, a reference bar of known length is moved through object space, with the problem of feature identification and establishment of multi-view correspondences being reduced to the tracking of two targets. The method can only be used with multi-camera systems and is most useful for 3-D motion analysis applications, but may be adapted to a wide range of other applications. The advantages of the method over conventional self-calibration techniques are the trivial establishment of multi-view correspondences, the fact that no temporarily stable target field has to be constructed, and the fact that each camera has to be set up only once. After an explanation of the technique, its performance is examined in detail based on extensive computer simulations, and the practical effectiveness is shown in a pilot study on industrial robot calibration. Based on these studies, recommendations are given concerning the number of reference bar locations, preferable reference bar orientation schemes and the achievable accuracy potential.     

利用天文观测图像对空间碎片目标进行自动识别与追踪

提出了一种利用天文观测手段获取的CCD图像序列对空间碎片进行自动识别和追踪的方法。该方法采用计算机图像处理、图像识别与分析和计算机视觉等相关技术,自动识别出每幅CCD图像中的空间碎片以及背景恒星等空间目标,并定量计算其有关特征;然后根据空间碎片移动较快的特点,在CCD图像序列中结合基于Snake模型的主动轮廓追踪和特征相似性比较两种方法,对其中出现的空间碎片目标进行自动识别和追踪。实验结果显示,该方法能准确地对空间碎片目标进行自动识别和追踪。     

基于GPS的近景测量定位方法研究

本文介绍了基于GPS的近景测量定位方法所需硬件的集成方式及功能,分析了该方法定位的基本原理,并对试验结果进行了分析,验证该方法的可行性及定位精度.利用交向摄影方式,用一台相机,分别在两个摄站点获取同一范围的影像,利用数字罗盘测相机的姿态,GPS测摄站点坐标,利用单片后方交会及像对前方交会解求待定地物点的三维坐标,为不易...     

车载移动测图系统外方位元素标定方法

全景相机因其360°大视场、旋转不变性等优点,逐渐被用于构建车载移动测图系统。标定是保证系统获取精确地理信息数据的重要前提。本文针对全景相机和定位定姿系统(POS)集成的车载移动测图系统,提出一种外方位元素标定的方法。首先,在实际场景中布设高精度已知控制点。其次,构建全景球面模型,将全景影像通过球面投影反变换投影到该球面上,从球面上选择控制点而不是直接从存在扭曲的全景影像上选择控制点并得到其球面坐标。在建立点的相关性之后,结合地理参考绝对定位方程和坐标变换,求得全景相机相对POS的平移与旋转参数。最后,采用本文提出的标定方法,分别选择北京航天城和天津滨海新区进行试验。试验表明,GPS信号良好时,点的绝对定位中误差可达平面10.3cm、高程16.5cm;GPS信号不好时,点的绝对定位中误差为平面35.4cm、高程54.8cm;在较短距离范围内(3km),距离量测相对误差最大为5cm左右,GPS信号对相对量测没有明显影响。     

Object tracking in surveillance video based on Siamese network considering geographical spatiotemporal constraints

Identifying and tracking objects in surveillance videos is an important means of mining information during surveillance. Currently, most object-tracking methods rely only on image features, which cannot accurately express the motion of the tracked object in real geographical scenes and are easily influenced by occlusion and surrounding objects having similar features. However, tracked objects, such as pedestrians and vehicles, usually move in geographical space with fixed patterns of motion, and the motion in a short time is constrained by geographical space and time, the motion trajectory is predictable, and the range of motion is limited. Therefore, based on the SiamFC object tracking framework, this study introduces geographical spatiotemporal constraints into the tracking framework and proposes the GeoSiamFC method. The objective of this is to: (1) construct the mapping relationship between geographical space and image space to solve the problem that the pixel movement within the image after perspective imaging cannot accurately express the motion of the tracked object in a real geographical scene; (2) add candidate search areas according to the predicted trajectory location to correct the tracking errors caused by the occlusion of the object; and (3) focus on the search for the range of motion of the mapped pixel within the image space according to the limited geographical range of motion of the tracked objects in a certain time to reduce the interference of similar objects within the search area. In this study, separate experiments were conducted on a common test dataset using multiple methods to deal with challenges such as occlusion and illumination changes. In addition, a robust test dataset with noise addition and luminance adjustment based on the common test dataset was used. The results show that GeoSiamFC outperforms other object-tracking methods in the common test dataset with a precision score of 0.995 and a success score of 0.756 compared with most other object-tracking algorithms under the base condition of using only shallow networks. Moreover, GeoSiamFC maintained the highest precision score (0.970) and high success score (0.734) in the more challenging robust test dataset as well. The tracking speed of 59 frames per second far exceeds the real-time requirement of 25 FPS. Geographical spatiotemporal constraints were considered to improve tracker performance while providing real-time feedback on the motion trajectory of the target in geographical space. Thus, the proposed method is suitable for real-time tracking of the motion trajectory of a target in real geographical scenes in various surveillance videos.     

机载三线阵CCD摄影中心轨迹及姿态拟合的半参数法

只要给出摄像瞬间摄像中心的位置和摄像平台的姿态，通过机载三线阵CCD获取的影像就可以直接解算地面点坐标。拟合摄像中心的位置函数和摄像平台的姿态函数是机载三线阵CCD摄影测量的最基本问题。针对由GPS／INS得到的摄像平台位置和姿态观测值，提出了半参数拟合法。模拟计算表明，这种方法可以有效地克服对飞行轨迹及姿态的先验数学模型的模型误差，从而达到较高的精度。     

GPS技术的新进展

ＧＰＳ技术虽然已经比较成熟，但近几年来一方面为了满足高精度实时动态定位的需要和对付美国的‘ＡＳ’及‘ＳＡ’政策，在相应的ＧＰＳ硬件和软件方面有不少新的进展；另一方面ＧＰＳ的优点正不断被人们认识，不断地开拓新的应用领域；第三方面的进展是建立了全球性的ＧＰＳ技术服务机构，它向全世界ＧＰＳ用户提供ＧＰＳ精密星历、星钟差、极移、追踪站的动态坐标和观测数据等资料。     

利用GPS精确测定的摄影机坐标和方向

本文论述了在车载或机载摄影测量过程中 ,摄影机坐标和方向的测定方法 ,利用三台GPS接收机测定汽车或飞机在摄影运动过程中的姿态 ,由于摄影机与三台接收机的关系类似一个刚体 ,故可以用空间坐标变换的方法求得摄影机的坐标和方向     

结合图像增强和恢复的增强现实跟踪注册

增强现实中的跟踪注册技术一直是研究的重点和难点，而地下矿道和巷道内亮度低，产生的图像较昏暗，车载相机快速运动和抖动，对传统的基于特征匹配的跟踪注册提出了挑战。本文从提高增强现实中跟踪注册稳健性和精度出发，采用基于Retinex改进的方法增强昏暗图像的亮度，同时利用基于对抗神经网络的方法恢复运动模糊图像。首先提取图像ORB特征，实现初始化；然后根据跟踪特征点的数量，开启图像增强和图像恢复线程，提高特征点提取质量和数量。在数据集和真实模拟场景下的试验结果显示，跟踪精度提高了12%左右，在低亮度和含有轻微模糊的情况下，跟踪注册稳健性也有显著提高。     

利用IRS-P5立体像对快速提取地震灾区震后DEM

针对地震灾区震后DEM数据获取困难的问题,总结出一种较传统方法更加快速便捷的实现途径。利用易测E640GPS接收机和MobileMapper手持接收机采集GPS卫星数据,并对GPS数据进行后差分处理得到控制点坐标,以这些控制点作为IRS-P5立体像对的地面控制点,并根据IRS-P5立体像对生成最终的DEM数据。本文使用这种方法成功获取了控制点并在Envi软件中使用IRS-P5立体像对生成DEM,并对DEM进行精度评价。     

Video camera registration using accumulated co-motion maps

The paper presents a method to register partially overlapping camera-views of scenes where the objects of interest are in motion even if unstructured environment and motion. In a typical outdoor multi-camera system the observed objects might be very different due to the changes in lighting conditions and different camera positions. Hence, static features such as color, shape, and contours cannot be used for camera registration in these cases. Calculation of co-motion statistics, which is followed by outlier rejection and a nonlinear optimization, does the matching. The described robust algorithm finds point correspondences in two camera views (images) without searching for any objects and without tracking any continuous motion. Real-life outdoor experiments demonstrate the feasibility of our approach.     

GPS/GLONASS组合单点定位及精度分析

介绍了基于广播星历的GPS/GLONASS组合导航单点定位的数学模型,分析了组合导航的技术难点。在GPS伪距法单点定位的基础上进行组合导航定位,其中GLONASS卫星坐标运用四阶龙格—库塔(Runge-Kutta)数值积分方法求得,利用一种新的不需要进行轨道拟合的编程方法来进行计算。以IGS跟踪站提供的观测数据为例,分别采用GPS、GLO-NASS和GPS/GLONASS三种方式组合进行伪距法单点定位,同时比较分析了不同权重选择对组合定位精度的影响。     

Geocenter variations derived from a combined processing of LEO- and ground-based GPS observations

GNSS observations provided by the global tracking network of the International GNSS Service (IGS, Dow et al. in J Geod 83(3):191–198, 2009) play an important role in the realization of a unique terrestrial reference frame that is accurate enough to allow a detailed monitoring of the Earth’s system. Combining these ground-based data with GPS observations tracked by high-quality dual-frequency receivers on-board low earth orbiters (LEOs) is a promising way to further improve the realization of the terrestrial reference frame and the estimation of geocenter coordinates, GPS satellite orbits and Earth rotation parameters. To assess the scope of the improvement on the geocenter coordinates, we processed a network of 53 globally distributed and stable IGS stations together with four LEOs (GRACE-A, GRACE-B, OSTM/Jason-2 and GOCE) over a time interval of 3 years (2010–2012). To ensure fully consistent solutions, the zero-difference phase observations of the ground stations and LEOs were processed in a common least-squares adjustment, estimating all the relevant parameters such as GPS and LEO orbits, station coordinates, Earth rotation parameters and geocenter motion. We present the significant impact of the individual LEO and a combination of all four LEOs on the geocenter coordinates. The formal errors are reduced by around 20% due to the inclusion of one LEO into the ground-only solution, while in a solution with four LEOs LEO-specific characteristics are significantly reduced. We compare the derived geocenter coordinates w.r.t. LAGEOS results and external solutions based on GPS and SLR data. We found good agreement in the amplitudes of all components; however, the phases in x- and z-direction do not agree well.     

基于TIN全球选站方法的GPS卫星钟差实时解算

解算所有GPS卫星钟差时要求选用地面跟踪站能够观测到每颗卫星,而组成该网的跟踪站数量对卫星钟差的解算效率有较大影响。跟踪站数量越多,卫星钟差的解算效率就越低,不利于实时应用。本文利用不规则三角网对全球跟踪站进行建模,提出一种新的全球均匀选站方法,并应用于卫星钟差实时解算。试验结果表明:当跟踪站个数达到25个时,卫星钟差解算精度优于0.3 ns,且随着跟踪站的增加,精度无明显提升。此跟踪站分布可作为卫星钟差实时解算的一种选站分布参考。     

区域性跟踪站地心坐标精化方法及定轨试验分析─中国GIG′91和IGS′92会战数据处理分析

本文介绍了中国GIG’91和Epoch’92二次GPS会战的情况,着重分析了GIG’91和Epoch’92会战数据处理的结果。结果证明,利用1－2星期质量良好的数据（含分布均匀的部分全球跟踪站数据）,解算的未知区域性跟踪站地心坐标的重复性可以达到几个厘米,站间基线分量的重复性可以达到10－8或更好。利用中国国内4个跟踪站的数据,由5天轨道弧解算的卫星星历与全球精密星历之差在1－3米水平,平均差一般小于1米。我们的研究证明,参加GPS国际会战,是迅速提高区域性跟踪站地心坐标精度和建立区域性高精度地心坐标框架的有效途径,利用区域性跟踪站可有效地改进GPS卫星轨道的精度,形成全国范围的大尺度的控制,进一步改进GPS测量的精度。     

基于普通数码相机的旋转全景摄影测量方法

普通数码相机固定在高精度旋转平台上可集成为旋转全景相机,水平旋转多位置拍摄,可获取全景影像。给出了旋转全景相机的成像几何关系模型,实现了旋转全景相机的标定,利用稀疏分布的少量控制点（最少3个）,即可解算出平台旋转中心坐标与起始方位角,及每张像片的外方位元素,再利用多站旋转拍摄的影像进行前方交会就可获得物方点坐标。实验结果表明,本文提出的方法在实际摄影测量中可少受视野和控制点数量的限制,通过较少的控制点即可解算出物方点坐标,且测量精度较好。该方法是在困难场景进行近景摄影测量的一种新的有效手段。     

基于左右正射影像的三维量测方法的研究

介绍了利用左右正射影像上高层建筑物存留的投影差,形成立体,在正射影像立体观察的环境下,推导出一套对地物进行三维量测的公式。实验表明,该公式严密准确,不仅可以使用户直观地检查DEM的正确与否,而且可以实时地获取地物的三维坐标,以大大减少用户对于向量的需求。     

多镜头组合式相机的全景SLAM

同步定位与地图构建（simultaneous localization and mapping，SLAM）是摄影测量、计算机视觉和机器人学的研究热点，并广泛应用于移动测图系统、机器人、无人驾驶车等。本文提出一种针对多镜头组合式全景相机的基于特征的SLAM解决方案。首先，本文建立了鱼眼相机的高精度检校模型，以保证鱼眼相机与全景相机之间的高精度坐标转换；然后，将多镜头组合式全景成像模型嵌入SLAM的初始化、局部地图生成、关键帧选取、图优化等各个流程中。此外，考虑全景相机变形大、基线长的不利因素，本文在特征匹配、平差、特征点跟踪等SLAM的各个步骤都进行了针对性改进。本文在两套车载全景数据集共8000余张全景影像上进行试验。结果表明，本文所提出的全景SLAM很好地实现了全景相机的自动定位与地图构建功能，并达到了接近GPS参考的极高定位精度而无须借助GPS/IMU组合导航系统。相对于主流的基于平面相机的各类SLAM系统，如Mono-SLAM、Stereo-SLAM以及RGB-D SLAM，本文提出的全景SLAM可作为良好的补充，并为GPS信号失锁时的传感器定位提供廉价的自动解决方案。     

TJS-2 geostationary satellite orbit determination using onboard GPS measurements

This study analyzes the quality of onboard data of tracking signals from GPS satellites on the far side of the earth and determines the orbit of the geostationary satellite using code and carrier phase observations with 30-h and 3-day orbit arc length. According to the analysis results, the onboard receiver can track 6–8 GPS satellites, and the minimum and maximum carrier to noise spectral densities were 24 and 45 dB-Hz, respectively. For a GPS receiver on a high-altitude platform above the navigation constellations, the blocking of the earth and a weak signal strength usually cause a piece-wise GPS signal tracking and an increase in the number of ambiguity parameters. Individual GPS satellites may be continuously tracked for as little as several minutes and as long as 3 h. Moreover, considering the negative sign of elevation angles reflects the fact that GPS satellites are tracked below the receiver in the study. GPS satellites appear mainly in the elevation angle range of ??53° to ??83°, and dilution of precision values could reach ten or one hundred and more. Also, it is observed that when a signal suffers from atmospheric refraction, other GPS signals tracked simultaneously by the receiver experience strong systematic errors in the code observations. Based on single-frequency code and carrier phase measurements, the mean 3D root mean square (RMS) value of the overlap comparisons between 30-h orbit determination arcs is 2.14 m. However, we found that there were also some biases in the carrier phase residuals, which contributed to poor orbit accuracy. To eliminate the effects of the biases, we established a correction sequence for each GPS satellite. After corrections, the mean 3D RMS was reduced to 0.99 m, representing a 53% improvement.     

机载三线阵CCD摄影测量的直接解算模型与精度分析

机载三线阵CCD摄影测量系统是GPS/INS与三线阵CCD相机联合工作的测量系统.通过GPS/INS给出的投影中心位置、视准轴姿态观测值及三线阵CCD像空间坐标,可以直接计算地面点在物空间的坐标.介绍了直接解算的几何模型,并依据共线方程建立地面点像空间坐标与控制点或同名点物空间坐标的关系,从而把问题归结为间接平差,给出了平差的误差方程.最后对直接解算模型进行了精度分析.