A multi-sensor approach to creating accurate virtual environments

Creating virtual environment models often requires geometric data from range sensors as well as photometric data from CCD cameras. The model must be geometrically correct, visually realistic, and small enough in size to allow real-time rendering. We present an approach based on 3D range sensor data, multiple CCD cameras, and a colour high-resolution digital still camera. The multiple CCD cameras provide images for a photogrammetric bundle adjustment with constraints. The results of the bundle adjustments are used to register the 3D images from the range sensor in one coordinate system. The images from the high-resolution still camera provide the texture for the final model. The paper describes the system, the techniques for the registration of the 3D images, the building of the efficient geometric model, and the registration and integration of the texture with a simplified geometric model.     

Practical Influences of Geometric and Radiometric Image Quality Provided By Different Digital Camera Systems

Imaging systems founded on current digital camera technology are finding widespread use in high precision measurement applications. A single digital CCD camera, or an array of such cameras, equipped with ring lighting equipment is commonly used to acquire imagery of high contrast retroreflective targets placed on the object at discrete locations to signalize points of interest. The precise and accurate measurement of each imaged target location is a fundamental requirement if suitable measurement tolerances are to be obtained. Whilst such systems are undoubtedly capable of producing excellent results, the practical effects of target image quality on the photogrammetric measurement process is in need of careful consideration. This paper revisits some fundamentals of the optical imaging of retrotargets and investigates some abilities of a range of digital camera systems to provide images of retrotargets that are appropriate to the measurement process. Some experimental results are presented including the imaging of planar arrays of differing sized retrotargets at differing angles and exposures and a series of network analyses in which the level of target image intensity has been varied systematically.     

Comparative geometric and radiometric evaluation of mobile phone and still video cameras

This paper examines the potential of mobile phones to be used as front-end sensors for photogrammetric procedures and applications. For this purpose, two mobile phone cameras (Sony Ericsson K750i and Nokia N93) were calibrated over an indoor 3D testfield, using a self-calibrating bundle adjustment. Geometric accuracy tests were carried out in order to evaluate their metric performances and to compare the results with respect to two off-the-shelf digital still video cameras (Sony DSC W100 and Sony DSC F828). The geometric accuracy evaluation comprised an absolute accuracy test, JPEG test and temporal stability test. The radiometric capabilities of all cameras (except that the DSC W100 was replaced with a DSC T100 camera) were also evaluated and compared by carrying out modulation transfer function (MTF) analysis, image noise analysis and an operating range test. Substantial systematic errors were diagnosed in some systems. However, with proper calibration it is believed that these devices can be used for many photogrammetric tasks.     

低成本大视场深度相机阵列系统

在测距传感器不断轻量化、小型化以及室内外地图一体化导航应用的驱动下,三维（3D）室内移动测量成为当今研究和应用的热点,在室内建模、室内定位等新兴领域中的应用越来越广泛。3D室内移动测量系统通常配备激光扫描仪、全景相机、惯性测量单元（inertial measurement unit,IMU）系统和里程计等传感器,虽能实现3D室内点云数据的采集,但其距离传感器-激光扫描仪价格昂贵且便携性较差。彩色深度（RGB depth,RGB-D）相机为低成本3D室内移动测量系统构建提供了新的距离成像传感器选择,但主流型号RGB-D相机视场角小,继而导致数据采集效率远低于传统激光扫描仪,难以做到点云数据的完整覆盖与稳健采集,且易造成同时定位与制图（simultaneous localization and mapping,SLAM）过程中跟踪失败。针对以上问题,构建了一种低成本室内3D移动测量系统采集设备,通过组合多台消费级RGB-D相机构成大视场RGB-D相机阵列,提出了一种阵列RGB-D相机内外参数标定方法,并通过实验检验了设计系统采集的点云数据的精度。     

Sensor modeling,self-calibration and accuracy testing of panoramic cameras and laser scanners

Terrestrial Linear Array CCD-based panoramic cameras have been used for purely imaging purposes, but they also have a high potential for use in high accuracy measurement applications. The imaging geometry and the high information content of those images make them suitable candidates for quantitative image analysis. For that a particular sensor model has to be established and the inherent accuracy potential has to be investigated. We developed a sensor model for terrestrial Linear Array-based panoramic cameras by means of a modified bundle adjustment with additional parameters, which models substantial deviations of a real camera from the ideal one. We used 3D straight-line information in addition to tie points to conduct a full calibration and orientation without control point information. Due to the similarity of the operation of laser scanners to panoramic cameras the sensor model of the panoramic cameras was extended for the self-calibration of laser scanners. We present the joint sensor model for panoramic cameras and laser scanners and the results of self-calibration, which indicate a subpixel accuracy level for such highly dynamic systems. Finally we demonstrate the systems’ accuracy of two typical panoramic cameras in 3D point positioning, using both a minimal number of control points and a free network adjustment. With these new panoramic imaging devices we have additional powerful sensors for image recording and efficient 3D object modeling.     

Photogrammetric modeling of underwater environments

Underwater photogrammetry provides an efficient nondestructive means for measurement in environments with limited accessibility. With the growing use of consumer cameras, its application is becoming easier, thus benefiting a wide variety of disciplines. However, utilizing cameras for underwater photogrammetry poses some nontrivial modeling problems due to refraction effect and the extension of the imaging system into a unit of both the camera and the protecting housing device. This paper studies the effect that the underwater environment has on the photogrammetric process, and proposes a model for describing the geometric distortions and for estimating the additional parameters involved. The proposed model accounts not only for the multimedia effect, but also for inaccuracies related to the setting of the camera and housing device. The paper shows that only a small number of additional parameters is needed to model both elements and to preserve the collinearity relation. The results show that no unique setup is needed for estimating the additional parameters and that the estimation is insensitive to noise or first approximations. Experiments show that high levels of accuracy can be achieved.     

利用信噪比削弱GPS多路径效应的研究

由于多路径误差的非时空相关性,使其成为双差模型中较难解除的误差源。本文利用观测值的信噪比对观测值质量进行评价,通过降低受多路径效应影响的观测值的权重,从而达到削减多路径误差的目的。最后通过实验数据解算结果的重复性验证了此方法的有效性和可靠性。     

GF-1卫星WFV影像几何定位稳定性研究

针对GF-1卫星WFV传感器高分辨率与大视场相结合的特点,本文将ZY-3卫星传感器校正产品作为参考,通过分析同名点对的地理信息,对北京地区WFV传感器4台相机影像相对几何定位精度进行长时间序列评价,分析其误差特征。试验结果表明,单景影像均出现了明显的系统几何定位误差,但是不同时相影像的几何定位误差方向并无明显规律。针对该现象本文基于相机成像原理,从理论上证明了仅利用某一时相影像的有理函数模型补偿参数是无法有效消除其他不同时相影像系统误差的。     

利用激光测距数据处理线阵卫星摄影测量影像

以线阵CCD测量相机为有效载荷的传输型卫星是目前获取影像的有效途径。本文针对两线阵卫星影像摄影测量处理的相关问题,提出将激光测距数据用于相机焦距在轨标定和光束法平差的理论及数学模型,并进行了实验验证。实验表明利用激光测距数据参与两线阵影像处理,能够满足测制1∶10 000比例尺地形图精度要求。     

由小面阵CCD组合构成宽角航空相机

本文研究由多台小面阵CCD相机构建组合式宽角航空相机的新方法———包括由3台或4台相机组合构建的多相机系统结构,由其分离的各影像转换成等效大影像的数学表达;利用室外和室内近景相机检校场对组合相机系统进行高精度检校的内容、解算方法和检校结果;最后给出了以3相机组合系统装备无人驾驶飞行器(UAV II)进行低空摄影的影像成果。     

Principal Point Behaviour and Calibration Parameter Models for Kodak DCS Cameras

Digital still cameras have been widely adopted for close range photogrammetry and machine vision applications. Due to the advantages of onboard storage of digital images, portability and rapid data processing, digital still cameras are rapidly becoming standard equipment for measurement tasks such as industrial metrology and heritage recording. As for any metric application, the accuracy of the derived object data is dependent, amongst many other factors, on the accuracy of the camera calibration. For the vast majority of photogrammetric applications, use of the simple case of a block invariant calibration model comprising the primary physical parameters, including the principal point position, is sufficient. However, cameras designed for photojournalism and domestic use, such as the Kodak DCS420 and 460 cameras, are well known for their calibration instability because the design is based on a 35 mm SLR camera body. In particular, previous research has shown that the principal point location is prone to movement during normal handling of the camera, due to the mounting mechanism of the CCD array. This paper reports on an investigation of the physical behaviour of the principal point location and compares different calibration parameter models for the Kodak DCS420 and DCS460 digital still cameras.     

High Resolution Still Video Camera for Industrial Photogrammetry

Still video cameras are easy to handle, portable, digital image acquisition devices for close range photogrammetry. They allow fast object recording without being connected to a computer. As an example of the new camera type, the high resolution Kodak DCS200 is presented in this paper, combined with the DPA digital photogrammetric station used for image measurement and object reconstruction. The performance of this three dimensional measurement system is illustrated by calibration results as well as applications to high precision dimensional inspection in industry.     

相位法激光测距信号源系统研究

为了使相位式激光测距获得更好的调制信号源,采用了基于单片机控制DDA芯片AD9851产生频率可调,相位可控的信号源,由于DDS具有噪声低,频率分辨率高,易于编程等优点,根据实际需要,通过给AD9851编程获得不同的频率,满足不同距离的测量.由于获得的信号源中存在着高频杂散信号,设计了最接近理想特性的椭圆低通滤波器,并给...     

智能手机移动测量方法的设计与实现

近年来,智能手机在快速的发展过程中逐渐集成了多种传感器,包括位置传感器、磁力计和加速度计等姿态传感器和数码相机等;同时,由于它所具备的体积小、成本低的优点,为实现手机影像移动量测提供了可能。本文通过Android系统平台及智能手机集成的多传感器,提出了一种新型的智能手机影像量测方法。该方法首先对手机相机进行标定获取内方位元素,并进行Android应用程序的开发,在获取影像数据的同时获得手机的位置姿态数据;然后对影像数据进行特征点提取、匹配及错误点删除,并根据位置姿态数据和同名点图像坐标,利用空间前方交会计算目标点的三维坐标;最后通过光束法平差进行整体优化。试验结果表明该方法获取的位置信息可达到较高的精度.     

Photogrammetric Capabilities of the Kodak DC40, DCS420 and DCS460 Digital Cameras

The aim of this study is to assess the impact of sensor size and resolution of different digital camera sensors upon the accuracy and precision of three dimensional data derived by photogrammetry. Kodak DC40, DCS420 and DCS460 digital cameras were used to produce digital images of retroreflective targets in a 4 m three dimensional test field. The image locations of the targeted points were automatically measured using an off the shelf image processing software package. Two different sub-pixel measurement approaches were examined: centre of gravity and weighted mean. From the automated sub-pixel measurement of the targeted points, results indicate that the high resolution DCS460 camera produces optimum results using either the weighted mean or centre of gravity approaches. Although this was perhaps expected, the far lower resolution DC40 camera performed better than was originally anticipated, suggesting potential for the cheaper DC40 for many applications.     

Real-time seismic signal enhancement utilizing a hybrid Rao-Blackwellized particle filter and hidden Markov model filter

This letter outlines a novel and robust algorithm for identifying seismic events within low signal-to-noise ratio (SNR) passive seismic data in real time. Since the event detection problem is a continuous, real-time process which has nonlinear mathematical representations, a Rao-Blackwellized particle filter (RBPF) is utilized. In this algorithm, a jump Markov linear Gaussian system (JMLGS) is defined where changes (i.e., jumps) in the state-space system and measurement equations are due to the occurrences and losses of events within the measurement noise. The RBPF obtains optimal estimates of the possible seismic events by individually weighting and subsequently summing a bank of Kalman filters (KFs). These KFs are specified and updated by samples drawn from a Markov chain distribution which defines the probability of the individual dynamical systems which compose the JMLGS. In addition, a hidden Markov model filter is utilized within the RBPF filter formulation so that real-time estimates of the phase of the seismic event can be obtained. The filter is demonstrated to provide up to an 80-fold improvement in the SNR when processing simulated seismic data with Gauss-Markov measurement noise.     

Indoor and outdoor depth imaging of leaves with time-of-flight and stereo vision sensors: Analysis and comparison

In this article we analyze the response of Time-of-Flight (ToF) cameras (active sensors) for close range imaging under three different illumination conditions and compare the results with stereo vision (passive) sensors. ToF cameras are sensitive to ambient light and have low resolution but deliver high frame rate accurate depth data under suitable conditions. We introduce metrics for performance evaluation over a small region of interest. Based on these metrics, we analyze and compare depth imaging of leaf under indoor (room) and outdoor (shadow and sunlight) conditions by varying exposure times of the sensors. Performance of three different ToF cameras (PMD CamBoard, PMD CamCube and SwissRanger SR4000) is compared against selected stereo-correspondence algorithms (local correlation and graph cuts). PMD CamCube has better cancelation of sunlight, followed by CamBoard, while SwissRanger SR4000 performs poorly under sunlight. Stereo vision is comparatively more robust to ambient illumination and provides high resolution depth data but is constrained by texture of the object along with computational efficiency. Graph cut based stereo correspondence algorithm can better retrieve the shape of the leaves but is computationally much more expensive as compared to local correlation. Finally, we propose a method to increase the dynamic range of ToF cameras for a scene involving both shadow and sunlight exposures at the same time by taking advantage of camera flags (PMD) or confidence matrix (SwissRanger).     

“天绘一号”卫星在轨辐射定标方法

在轨辐射定标包括相对辐射定标和绝对辐射定标, 它是提高遥感数据定量化精度的关键步骤和重要方法。本文阐述了基于均匀场地分区综合的相对辐射定标方法、基于反照率的绝对辐射定标方法及其基本原理, 并首次将其应用于“天绘一号”卫星上的高分辨、多光谱和三线阵相机的辐射定标中。研究结果表明, 相对辐射定标过程去除了卫星图像的条带噪声, 且保存了图像细节;然后, 使用反照率基法, 通过在敦煌场地铺设灰阶靶标, 测量卫星过顶时的地物目标反射率光谱和大气信息, 对“天绘一号”卫星传感器进行了绝对辐射定标;最后, 使用辐射定标结果来反演地物反射率, 与实测的地物反射率相比误差小于5%, 验证了在轨辐射定标系数的有效性。     

基线边长法的高精度三维标定场建立

针对大范围的摄影测量,传统量测相机标定精度有限,本文提出一种高精度、大尺度的三维标定场建立方法。该方法采用稳定性良好的天然大理石作为基础结构,并设计通视良好的角形基准座,采用微米级多路激光测距手段获取点位距离,进而基于测边网平差模型直接建立高精度三维标定场。通过模拟多组近似坐标和距离观测值对该算法进行验证。结果表明,该标定场近似坐标的模拟误差不能超过3 mm,单位权中误差与距离观测值模拟误差相当,距离反算值与理论值偏差的标准差是距离观测值模拟误差的一半,验证了测边网计算模型及程序的正确性。该标定场既可为量测相机提供大尺度标定,也可对激光跟踪仪的测量性能进行不定期检核。     

加速迭代硬阈值ISAR稀疏成像

加速迭代硬阈值(AIHT)作为一种压缩感知(CS)算法,具有计算复杂度低、内存占用小的特点,在较小数目的观测下,经过有限次迭代便能获得较好的重建效果。因此,本文将该算法应用到逆合成孔径雷达(ISAR)稀疏成像,对该方法的具体特征和适用性进行了详细分析。仿真结果表明,在相同信噪比和回波脉冲数条件下,基于AIHT的ISAR成像方法,相比于稀疏贝叶斯算法(SBL),在重建时间上缩短了至少2个量级;相比于迭代加权最小二乘法(IRLS)和平滑l0范数算法,在重建质量上提高了约3倍。经实测数据处理结果验证,在1/4原始脉冲数条件下,该方法仍具有良好的聚焦性能和压低旁瓣效果。