Several strategies on 3D modeling of manmade objects

Several different strategies of 3D modeling are adopted for different kinds of manmade objects. Firstly, for those mammade objects with regular structure, if 2D information is available and elevation information can be obtained conveniently, then 3D modeling of them can be executed directly. Secondly, for those mammade objects with complicated structure comparatively and related stereo images pair can be acquired, in the light of topology-based 3D model we finish 3D modeling of them by integrating automatic and semi-automatic object extraction. Thirdly, for the most complicated objects whose geometrical information cannot be got from stereo images pair completely, we turn to topological 3D model based on CAD.     

Using Stereo Satellite Imagery for Topographic and Transportation Applications: An Accuracy Assessment

The launch of the Very High Resolution (VHR) sensor satellites has paved the way for further exploitation of the capabilities of satellite stereo imaging for many applications. The objective of this paper is to evaluate the level of accuracy that can be achieved by using stereo satellite images for different applications involving significantly different types of terrain. Three mathematical models for satellite sensor modeling are used: Rational Function Model (RFM), 3D polynomial model, and 3D affine model. Three stereo pairs of image datasets are tested from different satellites for different areas: (a) Indian Remote Sensing (IRS)-1D stereo images for topographic mapping and digital terrain elevation modeling for an area in Egypt; (b) IKONOS stereo images for highway alignments extraction in Toronto, Canada; and (c) IKONOS stereo images for topographic mapping and geometric parameter extraction for highway alignments in Hong Kong, China. The accuracy was evaluated by comparing the results of the data extracted using stereo satellite images and those extracted from conventional techniques, including Global Positioning System, field measurements, and aerial photogrammetry. The accuracy of the extracted features was found to be within a pixel-level. The results of this paper should be of interest to professionals from different disciplines exploring the use and accuracy of satellite stereo images for topographic and transportation applications.     

A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs

Photogrammetric methods for dense 3D surface reconstruction are increasingly available to both professional and amateur users who have requirements that span a wide variety of applications. One of the key concerns in choosing an appropriate method is to understand the achievable accuracy and how choices made within the workflow can alter that outcome. In this paper we consider accuracy in two components: the ability to generate a correctly scaled 3D model; and the ability to automatically deliver a high quality data set that provides good agreement to a reference surface. The determination of scale information is particularly important, since a network of images usually only provides angle measurements and thus leads to unscaled geometry. A solution is the introduction of known distances in object space, such as base lines between camera stations or distances between control points. In order to avoid using known object distances, the method presented in this paper exploits a calibrated stereo camera utilizing the calibrated base line information from the camera pair as an observational based geometric constraint. The method provides distance information throughout the object volume by orbiting the object.In order to test the performance of this approach, four topical surface matching methods have been investigated to determine their ability to produce accurate, dense point clouds. The methods include two versions of Semi-Global Matching as well as MicMac and Patch-based Multi-View Stereo (PMVS). These methods are implemented on a set of stereo images captured from four carefully selected objects by using (1) an off-the-shelf low cost 3D camera and (2) a pair of Nikon D700 DSLR cameras rigidly mounted in close proximity to each other. Inter-comparisons demonstrate the subtle differences between each of these permutations. The point clouds are also compared to a dataset obtained with a Nikon MMD laser scanner. Finally, the established process of achieving accurate point clouds from images and known object space distances are compared with the presented strategies.Results from the matching demonstrate that if a good imaging network is provided, using a stereo camera and bundle adjustment with geometric constraints can effectively resolve the scale. Among the strategies for dense 3D reconstruction, using the presented method for solving the scale problem and PMVS on the images captured with two DSLR cameras resulted in a dense point cloud as accurate as the Nikon laser scanner dataset.     

相向飞行全极化SAR图像对建筑物的立体重构

用多方向飞行的全极化SAR图像可能提取特定三维目标的高度与位置信息,进而实现目标物的几何立体重构。全极化SAR图像数据与单极化SAR相比,可以选择多种极化组合数据,提供对于特定目标几何特征敏感的数据类型,通过多方向飞行SAR图像反演该目标或目标群的高度与位置信息。本文用两幅相向飞行的PI-SAR(日本机载极化与干涉SAR,X波段、1.5m分辨率)图像,提取日本仙台电视塔高度、日本东北大学建筑物群的立体重构。     

矢量与栅格集成的三维数据模型

以矿山地质为背景，深入分析三维空间信息系统所涉及到的空间对象以及它们之间的联系，提出了几种新的空间对象类型。探讨用矢量与栅格混合的数据结构，以及面向对象的数据模型来表达各类三维空间对象，以此作为设计和建立三维地理信息系统的基础     

基于RPC的TerraSAR-X影像立体定向平差模型

针对新型高分辨率雷达卫星TerraSAR-X立体像对,本文提出采用基于RPC的平差模型,通过少量的地面控制点来拟合因传感器不稳定、平台星历数据不精确及测距误差引起的影像几何畸变,从而达到精确定向目的.为验证RPC平差模型的适用性,通过在立体成像区域均匀市设人工角反射器点的方法验证其模型精度,并评估了其三维定向平差后的精...     

Stereo analysis of high-resolution SAR images for building height estimation in cases of orthogonal aspect directions

SAR stereo image analysis for 3D information extraction is mostly carried out based on imagery taken under same-side or opposite-side viewing conditions. For urban scenes in practice stereo is up to now usually restricted to the first configuration, because increasing image dissimilarity connected with rising illumination direction differences leads to a lack of suitable features for matching, especially in the case of low or medium resolution data. However, due to two developments SAR stereo from arbitrary viewing conditions becomes an interesting option for urban information extraction. The first one is the availability of airborne sensor systems, which are capable of more flexible data acquisition in comparison to satellite sensors. This flexibility enables multi-aspect analysis of objects in built-up areas for various kinds of purpose, such as building recognition, road network extraction, or traffic monitoring. The second development is the significant improvement of the geometric resolution providing a high level of detail especially of roof features, which can be observed from a wide span of viewpoints. In this paper, high-resolution SAR images of an urban scene are analyzed in order to infer buildings and their height from the different layover effects in views taken from orthogonal aspect angles. High level object matching is proposed that relies on symbolic data, representing suitable features of urban objects. Here, a knowledge-based approach is applied, which is realized by a production system that codes a set of suitable principles of perceptual grouping in its production rules. The images are analyzed separately for the presence of certain object groups and their characteristics frequently appearing on buildings, such as salient rows of point targets, rectangular structures or symmetries. The stereo analysis is then accomplished by means of productions that combine and match these 2D image objects and infer their height by 3D clustering. The approach is tested using real SAR data of an urban scene.     

Data model and visualization of 3D city landscape based on integrated databases

Data acquisition and modeling are the two important, difficult and costful aspects in a Cybercity project. 2D-GIS is mature and can manage a lot of spatial data. Thus 3D-GIS should make the best of data and technology of 2D-GIS. Construction of a useful synthetic environment requires integration of multiple types of information like DEM, texture images and 3D representation of objects such as buildings. In this paper, the method for 3D city landscape data model and visualization based on integrated databases is presented. Since the data volume of raster are very huge, special strategies(for example, pyramid gridded method) must be adopted in order to manage raster data efficiently. Three different methods of data acquisition, the proper data structure and a simple modeling method are presented as well. At last, a pilot project of Shanghai Cybercity is illustrated.     

Absolute geolocation accuracy of high-resolution spotlight TerraSAR-X imagery – validation in Wuhan

TerraSAR-X (TSX) can acquire high-resolution SAR images and due to its high orbit precision as well as its ability to acquire data from different off-nadir viewing angles, the high-precision stereo geolocation can be obtained. In this study, we investigate the absolute geolocation accuracy of TSX high-resolution images in Wuhan, China. We present a direct stereo SAR geolocation method and analyze the 2D and 3D geoposition accuracy of two corner reflectors. The sub-meter localization accuracy was achieved using only atmospheric correction information available in the TSX metadata.     

Data model and visualization of 3D city landscape based on integrated databases

Data acquisition and modeling are the two important, difficult and costful aspects in a Cybercity project. 2D-GIS is mature and can manage a lot of spatial data. Thus 3D-GIS should make the best of data and technology of 2D-GIS. Construction of a useful synthetic environment requires integration of multiple types of information like DEM, texture images and 3D representation of objects such as buildings. In this paper, the method for 3D city landscape data model and visualization based on integrated databases is presented. Since, the data volume of raster are very huge, special strategies (for example, pyramid gridded method) must be adopted in order to manage raster data efficiently. Three different methods of data acquisition, the proper data structure and a simple modeling method are presented as well. At last, a pilot project of Shanghai Cybercity is illustrated.     

基于左右正射影像的三维量测方法的研究

介绍了利用左右正射影像上高层建筑物存留的投影差,形成立体,在正射影像立体观察的环境下,推导出一套对地物进行三维量测的公式。实验表明,该公式严密准确,不仅可以使用户直观地检查DEM的正确与否,而且可以实时地获取地物的三维坐标,以大大减少用户对于向量的需求。     

3D change detection at street level using mobile laser scanning point clouds and terrestrial images

Automatic change detection and geo-database updating in the urban environment are difficult tasks. There has been much research on detecting changes with satellite and aerial images, but studies have rarely been performed at the street level, which is complex in its 3D geometry. Contemporary geo-databases include 3D street-level objects, which demand frequent data updating. Terrestrial images provides rich texture information for change detection, but the change detection with terrestrial images from different epochs sometimes faces problems with illumination changes, perspective distortions and unreliable 3D geometry caused by the lack of performance of automatic image matchers, while mobile laser scanning (MLS) data acquired from different epochs provides accurate 3D geometry for change detection, but is very expensive for periodical acquisition. This paper proposes a new method for change detection at street level by using combination of MLS point clouds and terrestrial images: the accurate but expensive MLS data acquired from an early epoch serves as the reference, and terrestrial images or photogrammetric images captured from an image-based mobile mapping system (MMS) at a later epoch are used to detect the geometrical changes between different epochs. The method will automatically mark the possible changes in each view, which provides a cost-efficient method for frequent data updating. The methodology is divided into several steps. In the first step, the point clouds are recorded by the MLS system and processed, with data cleaned and classified by semi-automatic means. In the second step, terrestrial images or mobile mapping images at a later epoch are taken and registered to the point cloud, and then point clouds are projected on each image by a weighted window based z-buffering method for view dependent 2D triangulation. In the next step, stereo pairs of the terrestrial images are rectified and re-projected between each other to check the geometrical consistency between point clouds and stereo images. Finally, an over-segmentation based graph cut optimization is carried out, taking into account the color, depth and class information to compute the changed area in the image space. The proposed method is invariant to light changes, robust to small co-registration errors between images and point clouds, and can be applied straightforwardly to 3D polyhedral models. This method can be used for 3D street data updating, city infrastructure management and damage monitoring in complex urban scenes.     

Geological study of sedimentary basins using SPOT data

This paper illustrates the benefits of DTMs created from SPOT images for the exploration of sedimentary basins. We chose an example located in the Ebro sedimentary basin in Spain, characterized by good outcropping conditions and slight deformations. The data used consist of a pair of SPOT panchromatic images and a SPOT XS image. The work consists of making up a 3D database, followed by interpretation of stereo pairs computed from orthoimages and the DTM. This interpretation is made on a stereoscopic desk and results in a digital file containing in the form of vectors all the observed faults and lithology. These vectors are then used to make calculations on the geometry of the objects they represent: we demonstrate that we can accurately measure layer directions and dips, sediment thicknesses and fault throws. Synthesis of perspective views made at the same time provide a good understanding of the structures and help to test their geometric consistency. Thus knowledge about relief given by DTMs helps to interpret remote detection images in 3D space, and particularly to accurately quantify the results of this interpretation.     

基于几何元素的三维景观实体建模研究

在分析已有国内外研究成果的基础上 ,提出了基于几何元素的 3DCM空间数据模型。实验证明 ,该模型能较精确地表达 3DCM中各类景观实体及其空间关系。     

SPOT5与ERS-2卫星影像的联合立体定位

本文将SPOT5与ERS-2卫星影像联立构成一组立体像对,并通过立体定位的方式获取了地面点的三维坐标。根据本文立体像对前方交会的特殊几何图形,推导了立体定位理论精度的计算公式,并利用实验验证了公式的正确性,同时分析了影响立体定位精度的主要因素。实验结果表明,联合具有一定重叠度的SPOT5和ERS-2影像进行立体定位具有很强的可行性,其精度已可以满足部分测绘任务的要求。     

Efficient building facade structure extraction method using image-based laser point cloud

Facade structures from three-dimensional (3D) point cloud data (PCD) and two-dimensional (2D) optical images can provide significant information for 3D building modeling. However, a unified data model for integrating 2D imagery pixels and 3D PCD is absent in current methods, leading to a complex implementation process, large calculations, and inefficiency. An efficient facade structure extraction method for building facades is proposed in this study. Based on the conversion matrix, 2D image and 3D PCD information are merged to build an image-based laser point cloud (ILPC) data model first. Second, both the line segment detection and random sample consensus algorithms are improved according to the structure and characteristics of the ILPC data model. Finally, building facade structures are extracted and optimized. Facade structures can be extracted accurately and efficiently by the proposed method, which contains rich information support from the ILPC data model. The proposed method extracts fine building facade structures with accuracy over 0.68 in all experiments and recall up to 0.81, which are better than the Wang method. Extracted structures constitute valuable support for numerous fields, such as 3D building modeling and building information modeling construction.     

3D Motion parameters determination based on binocular sequence images

Exactly capturing three dimensional (3D) motion information of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision system and a method for determining 3D motion parameters of an object from binocular sequence images are introduced. The main steps include camera calibration, the matching of motion and stereo images, 3D feature point correspondences and resolving the motion parameters. Finally, the experimental results of acquiring the motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned method are presented.     

3D road marking reconstruction from street-level calibrated stereo pairs

This paper presents an automatic approach to road marking reconstruction using stereo pairs acquired by a mobile mapping system in a dense urban area. Two types of road markings were studied: zebra crossings (crosswalks) and dashed lines. These two types of road markings consist of strips having known shape and size. These geometric specifications are used to constrain the recognition of strips. In both cases (i.e. zebra crossings and dashed lines), the reconstruction method consists of three main steps. The first step extracts edge points from the left and right images of a stereo pair and computes 3D linked edges using a matching process. The second step comprises a filtering process that uses the known geometric specifications of road marking objects. The goal is to preserve linked edges that can plausibly belong to road markings and to filter others out. The final step uses the remaining linked edges to fit a theoretical model to the data. The method developed has been used for processing a large number of images. Road markings are successfully and precisely reconstructed in dense urban areas under real traffic conditions.     

异源高分辨率光学卫星遥感影像联合定位

本文提出一种基于RFM和投影射线法的异源高分辨率光学卫星遥感影像定位算法:首先利用高分辨率遥感影像RFM正解模型迭代计算其反解模型;接着通过RFM正反解模型构建投影射线,最后采用迭代求取射线交点的方法确定地面三维实际坐标。实验对比结果表明,联合具有一定重叠度的异源高分辨率光学卫星遥感影像进行立体定位具有较强的可行性,并可达到一定的精度。