Change detection on LOD 2 building models with very high resolution spaceborne stereo imagery

Due to the fast development of the urban environment, the need for efficient maintenance and updating of 3D building models is ever increasing. Change detection is an essential step to spot the changed area for data (map/3D models) updating and urban monitoring. Traditional methods based on 2D images are no longer suitable for change detection in building scale, owing to the increased spectral variability of the building roofs and larger perspective distortion of the very high resolution (VHR) imagery. Change detection in 3D is increasingly being investigated using airborne laser scanning data or matched Digital Surface Models (DSM), but rare study has been conducted regarding to change detection on 3D city models with VHR images, which is more informative but meanwhile more complicated. This is due to the fact that the 3D models are abstracted geometric representation of the urban reality, while the VHR images record everything. In this paper, a novel method is proposed to detect changes directly on LOD (Level of Detail) 2 building models with VHR spaceborne stereo images from a different date, with particular focus on addressing the special characteristics of the 3D models. In the first step, the 3D building models are projected onto a raster grid, encoded with building object, terrain object, and planar faces. The DSM is extracted from the stereo imagery by hierarchical semi-global matching (SGM). In the second step, a multi-channel change indicator is extracted between the 3D models and stereo images, considering the inherent geometric consistency (IGC), height difference, and texture similarity for each planar face. Each channel of the indicator is then clustered with the Self-organizing Map (SOM), with “change”, “non-change” and “uncertain change” status labeled through a voting strategy. The “uncertain changes” are then determined with a Markov Random Field (MRF) analysis considering the geometric relationship between faces. In the third step, buildings are extracted combining the multispectral images and the DSM by morphological operators, and the new buildings are determined by excluding the verified unchanged buildings from the second step. Both the synthetic experiment with Worldview-2 stereo imagery and the real experiment with IKONOS stereo imagery are carried out to demonstrate the effectiveness of the proposed method. It is shown that the proposed method can be applied as an effective way to monitoring the building changes, as well as updating 3D models from one epoch to the other.     

3D change detection at street level using mobile laser scanning point clouds and terrestrial images

Automatic change detection and geo-database updating in the urban environment are difficult tasks. There has been much research on detecting changes with satellite and aerial images, but studies have rarely been performed at the street level, which is complex in its 3D geometry. Contemporary geo-databases include 3D street-level objects, which demand frequent data updating. Terrestrial images provides rich texture information for change detection, but the change detection with terrestrial images from different epochs sometimes faces problems with illumination changes, perspective distortions and unreliable 3D geometry caused by the lack of performance of automatic image matchers, while mobile laser scanning (MLS) data acquired from different epochs provides accurate 3D geometry for change detection, but is very expensive for periodical acquisition. This paper proposes a new method for change detection at street level by using combination of MLS point clouds and terrestrial images: the accurate but expensive MLS data acquired from an early epoch serves as the reference, and terrestrial images or photogrammetric images captured from an image-based mobile mapping system (MMS) at a later epoch are used to detect the geometrical changes between different epochs. The method will automatically mark the possible changes in each view, which provides a cost-efficient method for frequent data updating. The methodology is divided into several steps. In the first step, the point clouds are recorded by the MLS system and processed, with data cleaned and classified by semi-automatic means. In the second step, terrestrial images or mobile mapping images at a later epoch are taken and registered to the point cloud, and then point clouds are projected on each image by a weighted window based z-buffering method for view dependent 2D triangulation. In the next step, stereo pairs of the terrestrial images are rectified and re-projected between each other to check the geometrical consistency between point clouds and stereo images. Finally, an over-segmentation based graph cut optimization is carried out, taking into account the color, depth and class information to compute the changed area in the image space. The proposed method is invariant to light changes, robust to small co-registration errors between images and point clouds, and can be applied straightforwardly to 3D polyhedral models. This method can be used for 3D street data updating, city infrastructure management and damage monitoring in complex urban scenes.     

基于MicroStation V8的立体采编系统开发与实现

在VC环境下进行MicroStation的二次开发,实现了一套基于MicroStationⅤ8平台的全数字摄影测量立体采编系统。该系统在核线立体模型建立之后,利用摄影测量基本原理解算三维坐标,直接通过鼠标进行立体切准和量测,实现了面向地物要素的立体采集和立体编辑。     

基于城市航空立体像对的全自动3维建筑物建模

城市建筑物3维建模是虚拟城市建设的关键技术之一。基于大比例尺航空立体像对提出3维建筑物建模方法。首先对2维边缘检测Canny算子进行改进，以期从城市航空影像中检测出较为精确的2维建筑物轮廓线。然后把改进的自适应最小二乘相关算法运用到金字塔匹配算法中，由于金字塔匹配算法中最为关键的问题是误差传递的有效控制，而以往的研究中尽管采用了多咱控制策略但效果不是很好，作者通过提出2种新的误差传播控制策略得到了较高精度的匹配结果。利用匹配生成的高精度3维信息对检测到的2维建筑物轮廓线进行3维插值，获得建筑物的3维信息，由此实现了建筑物3维建模。     

多数据源三维量测技术在输电线路勘测设计中的应用

本文介绍构建以全数字摄影测量、高分辨率遥感卫星影像、地形图等多数据源为基础,通过立体匹配技术生成大场景三维立体量测平台,为输电线路优化选线提供强大的技术支撑,实现输电线路勘测设计作业流程的创新.     

基于面向对象技术的3D量测系统

本文主要阐述可量测立体像对的3D坐标量测系统的设计与实现。由于现存的全数字摄影测量产品要么是价格非常高昂的高端专业设备（一般为具有高端图像卡的工作站），要么是功能受约束的简单设备。本文将说明如何在非高端图形PC设备上，运用面向对象程序设计、软件模块化和硬件无关性等技术实现所要求的立体量测系统功能。     

无缝立体正射影像数据库的概念、原理及其实现

为了充分地开发和利用航空摄影测量所形成的立体模型,在二维无缝正射影像数据库的基础上,提出了无缝立体正射影像数据库的概念,即在摄影测量所形成的区域范围内,利用原始影像、定向参数及DEM,通过数字投影处理的方法,用无缝镶嵌的数字正射影像和立体辅助影像形成对摄影区域范围内无缝立体覆盖,即可以恢复摄影时记录的地形表面和地物碎部的三维信息,又可以通过立体观察设备进行无缝立体观察、浏览量测。为了方便立体观察、高精度立体量测和应用,对数字正射影像、立体辅助影像、像片定向参数及其DEM通过数据库的方式进行管理,形成区域范围内的无缝立体正射影像数据库。试验表明,无缝立体正射影像数据库具有良好的应用价值和应用前景。     

基于GIS平台三维可视化方案设计——以水污染、旅游为例

二维地理信息系统源于20世纪60年代,起源于机助制图,由于二维系统自身因素的限制,它也可以被称为是三维空间平面化的符号表示系统,所以在表达上不如拥有现实感的三维更加直观。当今科技飞速发展,传统的2D系统已经很难满足现代人更直观的视觉需求,而三维系统的建立恰好弥补了二维的不足。本文主要通过建立三维模型,分别研究水井位置、工业设施和地下水体污染轻重的空间关系,景区的三维模型建立,三维场景中表面及矢量要素的立体显示以及DEM、TIN在三维建模的特点。     

An image engineering system for the inspection of transparent construction materials

This article presents a modular photogrammetric recording and image analysis system for inspecting the material characteristics of transparent foils, in particular Ethylen–TetraFluorEthylen-Copolymer (ETFE) foils. The foils are put under increasing air pressure and are observed by a stereo camera system. Determining the time-variable 3D shape of transparent material imposes a number of challenges: especially the automatic point transfer between stereo images and, in temporal domain, from one image pair to the next. We developed an automatic approach that accommodates for these particular circumstances and allows reconstruction of the 3D shape for each epoch as well as determining 3D translation vectors between epochs by feature tracking. Examples including numerical results and accuracy measures prove the applicability of the system.     

基于低空摄影数据的三维校园场景构建

为满足对外展示和发展规划的需要,开发了一套三维漫游展示系统。系统是以Quest3D为平台,利用低空无人机（UAV）航空摄影技术结合三维建模软件（3DsMAX）来构建校园的三维真实场景,最后在多通道环幕（立体）仿真投影系统上进行漫游展示。对其技术关键、基本流程及展示进行了较为详细的阐述,为相关三维虚拟场景构建和展示工作提供了较好的实践参考。     

基于低空航测系统的建筑物三维建模

低空航测系统的研制与应用,开拓了三维城市建模新的技术手段。本文介绍了低空航测系统相应的数据处理软件系统和立体测图软件,并阐述了基于该系统三维城市建筑物纹理的快速获取和利用3DMAX软件的三维建模方法。低空航测技术结合3DMAX三维立体建模软件的城市三维建模,可以为"数字城市"的快速发展开辟一种新的途径。     

Stereo analysis of high-resolution SAR images for building height estimation in cases of orthogonal aspect directions

SAR stereo image analysis for 3D information extraction is mostly carried out based on imagery taken under same-side or opposite-side viewing conditions. For urban scenes in practice stereo is up to now usually restricted to the first configuration, because increasing image dissimilarity connected with rising illumination direction differences leads to a lack of suitable features for matching, especially in the case of low or medium resolution data. However, due to two developments SAR stereo from arbitrary viewing conditions becomes an interesting option for urban information extraction. The first one is the availability of airborne sensor systems, which are capable of more flexible data acquisition in comparison to satellite sensors. This flexibility enables multi-aspect analysis of objects in built-up areas for various kinds of purpose, such as building recognition, road network extraction, or traffic monitoring. The second development is the significant improvement of the geometric resolution providing a high level of detail especially of roof features, which can be observed from a wide span of viewpoints. In this paper, high-resolution SAR images of an urban scene are analyzed in order to infer buildings and their height from the different layover effects in views taken from orthogonal aspect angles. High level object matching is proposed that relies on symbolic data, representing suitable features of urban objects. Here, a knowledge-based approach is applied, which is realized by a production system that codes a set of suitable principles of perceptual grouping in its production rules. The images are analyzed separately for the presence of certain object groups and their characteristics frequently appearing on buildings, such as salient rows of point targets, rectangular structures or symmetries. The stereo analysis is then accomplished by means of productions that combine and match these 2D image objects and infer their height by 3D clustering. The approach is tested using real SAR data of an urban scene.     

城市三维地籍信息化管理模式研究与应用

在我国土地资源利用呈现出立体化发展趋势的大背景下,长春市国土资源局在城区三维地籍数据库建设中提出三维地籍的概念体系,探索三维地籍的管理模式,实现地表、地上、地下空间土地使用权可视化管理。     

利用多源空间数据进行地形的三维变化检测

本文提出了利用空间数据库中已有的DEM、DOM、DLG和新影像进行三维变化检测,在此基础上提取二维变化信息的技术框架。探讨了基于DEM的VLL物方影像匹配方法、多尺度表达的数字高程模型,以及自适应窗口大小和变化阈值的确定等用于三维变化检测的关键技术。这些思想和方法在实验中得到初步证实。     

双状态机的自适应步态检测算法

针对步态检测算法无法适应于不同的运动状态、不同传感器姿态问题,该文提出基于双状态机的自适应步态检测算法,该方法在原算法基础上利用最大整体加速度阈值对状态机进行状态分割,并利用时间阈值和整体加速度阈值对状态机进行二次判断。通过四类步态检测算法的比较实验,常规峰值检测算法、状态机步态检测算法在行人行走状态下步态检测精度均优于99%,而在行人跑步状态和行走+跑步状态的步态检测精度仅为60%和70%,无法适应行人的不同运动状态;本文算法在不同行人运动状态、不同传感器姿态下均具有较强的适应性和可靠的步态检测正确率。     

基于双立体同步摄影的面部三维重建与量测

介绍了利用多台数码相机基于双立体同步摄影的面部三维模型重建与量测系统 ,提出了一种半自动提取格网点的有效方法。实现了无接触、无伤害、快速地获取面部三维数据和面部特征数据 ,为临床诊治提供依据。实验表明 ,系统达到了 0 .5 m m的量测精度 ,完全能满足实际的精度需求。     

基于深度学习的立体影像密集匹配方法综述

三维重建可用于数字高程模型制作、机器人导航、增强现实和自动驾驶等.视差图是三维重建中一种重要的表达方式,而立体密集匹配是使用最广泛的获取视差图的技术.近年来,随着硬件、数据集、算法的发展,基于深度学习的立体匹配方法受到了广泛关注并取得了巨大成功.然而,这些方法通常在近景立体像对中进行测试,很少被用于遥感影像中.回顾了双...     

Several strategies on 3D modeling of manmade objects

Several different strategies of 3D modeling are adopted for different kinds of manmade objects. Firstly, for those mammade objects with regular structure, if 2D information is available and elevation information can be obtained conveniently, then 3D modeling of them can be executed directly. Secondly, for those mammade objects with complicated structure comparatively and related stereo images pair can be acquired, in the light of topology-based 3D model we finish 3D modeling of them by integrating automatic and semi-automatic object extraction. Thirdly, for the most complicated objects whose geometrical information cannot be got from stereo images pair completely, we turn to topological 3D model based on CAD.     

应用地理信息数据构建立体显示

本文结合人眼立体视觉原理与摄影测量理论及计算机图形学的三维可视化理论分析了立体显示与量测的实现原理,并结合C++语言、OpenGL、DirectX图形库进行了验证,并取得了一些效果,为地理信息数据拓展服务提供了一些尝试。     

Using Stereo Satellite Imagery for Topographic and Transportation Applications: An Accuracy Assessment

The launch of the Very High Resolution (VHR) sensor satellites has paved the way for further exploitation of the capabilities of satellite stereo imaging for many applications. The objective of this paper is to evaluate the level of accuracy that can be achieved by using stereo satellite images for different applications involving significantly different types of terrain. Three mathematical models for satellite sensor modeling are used: Rational Function Model (RFM), 3D polynomial model, and 3D affine model. Three stereo pairs of image datasets are tested from different satellites for different areas: (a) Indian Remote Sensing (IRS)-1D stereo images for topographic mapping and digital terrain elevation modeling for an area in Egypt; (b) IKONOS stereo images for highway alignments extraction in Toronto, Canada; and (c) IKONOS stereo images for topographic mapping and geometric parameter extraction for highway alignments in Hong Kong, China. The accuracy was evaluated by comparing the results of the data extracted using stereo satellite images and those extracted from conventional techniques, including Global Positioning System, field measurements, and aerial photogrammetry. The accuracy of the extracted features was found to be within a pixel-level. The results of this paper should be of interest to professionals from different disciplines exploring the use and accuracy of satellite stereo images for topographic and transportation applications.