Visualisation and personalisation of multi-representations city models

ABSTRACT

City models have a wide variety of uses that require different kind of data representation or data models. Having a dynamic model that enables picking the right representations (meshes, volumetric data, point cloud, etc.) can prove useful to adapt an application to each user's needs. In this paper, we present an original method to create personalised visualisations of 3D city models on the fly. By organising the server data in a hierarchy of tiles, we are able to generate personalised models based on the user's preferences. These preferences take the shape of a set of rules that apply to each tile or city object and allow the user to choose which representation of the object to use depending on its position or semantic information (classification, height, etc.). Our method is designed around existing standards, guaranteeing the interoperability of the produced models.     

3D change detection at street level using mobile laser scanning point clouds and terrestrial images

Automatic change detection and geo-database updating in the urban environment are difficult tasks. There has been much research on detecting changes with satellite and aerial images, but studies have rarely been performed at the street level, which is complex in its 3D geometry. Contemporary geo-databases include 3D street-level objects, which demand frequent data updating. Terrestrial images provides rich texture information for change detection, but the change detection with terrestrial images from different epochs sometimes faces problems with illumination changes, perspective distortions and unreliable 3D geometry caused by the lack of performance of automatic image matchers, while mobile laser scanning (MLS) data acquired from different epochs provides accurate 3D geometry for change detection, but is very expensive for periodical acquisition. This paper proposes a new method for change detection at street level by using combination of MLS point clouds and terrestrial images: the accurate but expensive MLS data acquired from an early epoch serves as the reference, and terrestrial images or photogrammetric images captured from an image-based mobile mapping system (MMS) at a later epoch are used to detect the geometrical changes between different epochs. The method will automatically mark the possible changes in each view, which provides a cost-efficient method for frequent data updating. The methodology is divided into several steps. In the first step, the point clouds are recorded by the MLS system and processed, with data cleaned and classified by semi-automatic means. In the second step, terrestrial images or mobile mapping images at a later epoch are taken and registered to the point cloud, and then point clouds are projected on each image by a weighted window based z-buffering method for view dependent 2D triangulation. In the next step, stereo pairs of the terrestrial images are rectified and re-projected between each other to check the geometrical consistency between point clouds and stereo images. Finally, an over-segmentation based graph cut optimization is carried out, taking into account the color, depth and class information to compute the changed area in the image space. The proposed method is invariant to light changes, robust to small co-registration errors between images and point clouds, and can be applied straightforwardly to 3D polyhedral models. This method can be used for 3D street data updating, city infrastructure management and damage monitoring in complex urban scenes.     

Change detection on LOD 2 building models with very high resolution spaceborne stereo imagery

Due to the fast development of the urban environment, the need for efficient maintenance and updating of 3D building models is ever increasing. Change detection is an essential step to spot the changed area for data (map/3D models) updating and urban monitoring. Traditional methods based on 2D images are no longer suitable for change detection in building scale, owing to the increased spectral variability of the building roofs and larger perspective distortion of the very high resolution (VHR) imagery. Change detection in 3D is increasingly being investigated using airborne laser scanning data or matched Digital Surface Models (DSM), but rare study has been conducted regarding to change detection on 3D city models with VHR images, which is more informative but meanwhile more complicated. This is due to the fact that the 3D models are abstracted geometric representation of the urban reality, while the VHR images record everything. In this paper, a novel method is proposed to detect changes directly on LOD (Level of Detail) 2 building models with VHR spaceborne stereo images from a different date, with particular focus on addressing the special characteristics of the 3D models. In the first step, the 3D building models are projected onto a raster grid, encoded with building object, terrain object, and planar faces. The DSM is extracted from the stereo imagery by hierarchical semi-global matching (SGM). In the second step, a multi-channel change indicator is extracted between the 3D models and stereo images, considering the inherent geometric consistency (IGC), height difference, and texture similarity for each planar face. Each channel of the indicator is then clustered with the Self-organizing Map (SOM), with “change”, “non-change” and “uncertain change” status labeled through a voting strategy. The “uncertain changes” are then determined with a Markov Random Field (MRF) analysis considering the geometric relationship between faces. In the third step, buildings are extracted combining the multispectral images and the DSM by morphological operators, and the new buildings are determined by excluding the verified unchanged buildings from the second step. Both the synthetic experiment with Worldview-2 stereo imagery and the real experiment with IKONOS stereo imagery are carried out to demonstrate the effectiveness of the proposed method. It is shown that the proposed method can be applied as an effective way to monitoring the building changes, as well as updating 3D models from one epoch to the other.     

Digital Archiving and On-line Publishing of Old Relief Models

Abstract

Although people rarely think of relief models when speaking about cartographic products, these artefacts are probably the most impressive way of visualizing landscapes. Unlike traditional maps or globes, most relief models are unique, vulnerable hand-made objects. Digital archiving is an important step in their preservation. There are special tools for this task, but these equipments are rather expensive, and libraries or other institutes that usually own these models cannot spend too much. The authors examined various on-line tools to create digital 3D representation of relief models using a set of photographs as source. These tools create point cloud and textured triangle mesh based on matching patterns on the photos. A workflow was developed which uses these web services and produces the digital 3D version of relief models. This paper introduces the method, discusses the details of successful photographing, the possible post-processing of the results. A new web site, using the X3DOM technology to show the digitized models to the general public, is also introduced.     

基于ArcGIS AE与CE的三维数字城市开发

针对三维数字城市建设周期长、数据更新难等问题,本文基于ArcEngine开发组件和CityEngine建模平台,提出了一种二三维数据联动的三维数字城市开发方法。该法首先通过对立面凹凸和顶面简化,利用规则化建模方法构建城市三维模型,然后运用插件技术在ArcEngine中读取三维模型和Geodatabase二维数据,实现城市三维模型场景可视化、空间查询与分析。实验结果表明,本文提出的方法所构建的三维数字城市功能强大,可充分利用已有数据,缩短开发周期,实现二三维数据联动,彻底解决了三维数字城市系统数据更新困难问题。     

City model enrichment

The combination of mobile communication technology with location and orientation aware digital cameras has introduced increasing interest in the exploitation of 3D city models for applications such as augmented reality and automated image captioning. The effectiveness of such applications is, at present, severely limited by the often poor quality of semantic annotation of the 3D models. In this paper, we show how freely available sources of georeferenced Web 2.0 information can be used for automated enrichment of 3D city models. Point referenced names of prominent buildings and landmarks mined from Wikipedia articles and from the OpenStreetMaps digital map and Geonames gazetteer have been matched to the 2D ground plan geometry of a 3D city model. In order to address the ambiguities that arise in the associations between these sources and the city model, we present procedures to merge potentially related buildings and implement fuzzy matching between reference points and building polygons. An experimental evaluation demonstrates the effectiveness of the presented methods.     

基于剖面拓扑推理的三维地质体重建方法

In order to solve the dynamic reconstruction and local updating problem of three-dimensional geological solids, topology reasoning is used for three-dimensional geological modeling. This can advance the level of the corresponding section automation in implementing the 3D geological solid dynamical reconstruction by the construction of and reasoning on topology on the 3D curved surface. This method has been successfully used in the Nanjing city geological modeling and the Zijin gold mine modeling. The results prove that this method adapts to coplanar section and noncoplanar section data, and improves the efficiency of 3D geological modeling.     

Modelling and analysing 3D buildings with a primal/dual data structure

While CityGML permits us to represent 3D city models, its use for applications where spatial analysis and/or real-time modifications are required is limited since at this moment the possibility to store topological relationships between the elements is rather limited and often not exploited. We present in this paper a new topological data structure, the dual half-edge (DHE), which permits us to represent the topology of 3D buildings (including their interiors) and of the surrounding terrain. It is based on the idea of simultaneously storing a graph in 3D space and its dual graph, and to link the two. We propose Euler-type operators for incrementally constructing 3D models (for adding individual edges, faces and volumes to the model while updating the dual structure simultaneously), and we also propose navigation operators to move from a given point to all the connected planes or polyhedra for example. The DHE also permits us to store attributes to any element. We have implemented the DHE and have tested it with different CityGML models. Our technique allows us to handle important query types, for example finding the nearest exterior exit to a given room, as in disaster management planning. As the structure is locally modifiable the model may be adapted whenever a particular pathway is no longer available. The proposed DHE structure adds significant analytic value to the increasingly popular CityGML model.     

Reality-based generation of virtual environments for digital earth

Abstract

Digital Earth essentially consists of 3D and moreD models and attached semantic information (attributes). Techniques for generating such models efficiently are required very urgently. Reality-based 3D modelling using images as prime data source plays an important role in this context. Images contain a wealth of information that can be advantageously used for model generation. Images are increasingly available from satellite, aerial and terrestrial platforms. This contribution briefly describes some of the problems which we encounter if the process of model generation is to be automatised. With the help of some examples from Digital Terrain Model generation, Cultural Heritage and 3D city modelling we show briefly what can be achieved. Special attention is directed towards the use of model helicopters for image data acquisition. Some problems with interactive visualisation are discussed. Also, issues surrounding R&D, professional practice and education are also addressed.     

侧视地图中建筑物轮廓线提取的三维城市模型法

针对城市侧视地图上建筑物轮廓线主要依靠人工交互提取,成本高昂、效率低下且精细度和准确度有限的问题,提出了一种任意视角侧视地图中建筑物轮廓线的自动提取方法。采用深度缓冲区分割算法获取单个建筑物对象的颜色缓冲区,顾及了存在建筑群的情况和建筑物密集区域的遮挡问题,再基于颜色缓冲区追踪建筑物轮廓线。为了保持遮挡一致性且便于匹配提取出的矢量轮廓线与栅格侧视地图,本文还提出了基于投影空间分块加载三维城市模型的方法。最后,以武汉市典型三维城市模型数据为例,证明了该方法的有效性和可靠性。     

从实景三维建模到数字孪生建模

从实景三维建模到数字孪生建模是国家数字经济和智慧社会建设与发展的基本需求。本文探讨了实景三维建模和数字孪生建模的关键技术内涵,介绍了数字乡村、未来社区和智能铁路等典型应用场景。广域范围实景三维建模在低成本高效数据采集和智能化自动化三维精细建模与动态更新方面面临挑战,城市级或重大工程级的数字孪生建模在全要素整体性的表征数据与机理模型集成表达方面还存在关键技术瓶颈。测绘技术亟须多学科交叉融合创新,突破天空地有机协同实时动态获取多细节层级实景三维数据、智能化处理多专业多尺度多模态时空数据、不完备数据条件下复杂场景的三维实体化精细建模、表征数据与机理模型结合的全生命周期数字孪生模型动态构建等核心关键技术,形成通用地理空间智能,实现测绘技术的高质量发展和对经济社会发展不可替代的更有力的基础支撑。     

FORSAT: a 3D forest monitoring system for cover mapping and volumetric 3D change detection

ABSTRACT

A 3D forest monitoring system, called FORSAT (a satellite very high resolution image processing platform for forest assessment), was developed for the extraction of 3D geometric forest information from very high resolution (VHR) satellite imagery and the automatic 3D change detection. FORSAT is composed of two complementary tasks: (1) the geometric and radiometric processing of satellite optical imagery and digital surface model (DSM) reconstruction by using a precise and robust image matching approach specially designed for VHR satellite imagery, (2) 3D surface comparison for change detection. It allows the users to import DSMs, align them using an advanced 3D surface matching approach and calculate the 3D differences and volume changes (together with precision values) between epochs. FORSAT is a single source and flexible forest information solution, allowing expert and non-expert remote sensing users to monitor forests in three and four (time) dimensions. The geometric resolution and thematic content of VHR optical imagery are sufficient for many forest information needs such as deforestation, clear-cut and fire severity mapping. The capacity and benefits of FORSAT, as a forest information system contributing to the sustainable forest management, have been tested and validated in case studies located in Austria, Switzerland and Spain.     

数字地形图更新方法的研究

近年来,城市发展日新月异,现存地形图明显滞后于城市发展,因此地形图动态更新很有必要,于是研究城市基础地形图更新方法有很大的现实意义。本文结合2012-2013年杭州市余杭区地形图动态更新的工程案例,主要研究地形图更新的方法,包含更新的要求、过程、原则、内容、目的和意义,并介绍数字地形图更新过程中存在的问题以及一些注意事项。     

室内三维场景纹理手机图片的自动更新方法

当前室内三维建模的纹理映射工作主要依赖人工完成,工作量大、处理效率低,且对建模后室内环境的变更难以实现及时更新,导致室内模型纹理存在不真实甚至错误的现象。对此,提出一种室内三维模型纹理手机图片的自动更新方法,该方法主要以手机拍摄的图片为数据源,首先利用智能手机传感器获取拍摄图片的位姿参数,进而通过室内场景理解技术提取图片空间中的三维布局结构,最后与几何模型进行坐标点匹配解算纹理坐标,实现手机图片到三维几何模型的自动纹理映射。实验结果表明,该方法能够利用手机图片数据实现室内环境下的三维模型纹理自动生成及动态更新,有效提高室内三维场景表达的真实性。     

基于降维技术的面状居民地匹配方法

作为数据更新与融合关键技术之一,空间数据匹配越来越受重视。城市居民地是空间目标变化中最为活跃的要素之一,成为空间数据更新的主要内容。不同于已有要素直接匹配的做法,提出了面状居民地匹配新方法,即对面状居民地采用降维技术进行处理,分别提取匹配双方面状居民地的骨架线,并通过其骨架线之间的匹配来达到面状居民地之间匹配的目的。实验证明,所提方法中把2维面状居民地转化为1维线状骨架线后,其匹配的复杂性与不确定性大幅降低,匹配效率、速度得到有效提升。     

Real-time fusion of multiple videos and 3D real scenes based on optimal viewpoint selection

3D real scenes are a digital virtual space that represents and portrays the real world in a photorealistic, three-dimensional, and sequential manner. Existing methods for constructing and updating 3D models, such as oblique photography and laser scanning, are difficult to meet the demand of perceiving the real world intuitively, dynamically, and in real time. In recent years, the method of integrating rapidly rising video data and 3D models has become increasingly popular. Compared with existing methods, it enhances the real-time perception of 3D scenes by taking advantage of the real-time character of videos and the intuitive character of 3D models. In this article, we propose a real-time fusion method of multiple videos and 3D real scenes based on optimal viewpoint selection. To begin, 3D reconstruction and video camera calibration were used to prepare the basic data for the fusion of videos and 3D model. Second, a visible-surface detection-based video space restoration method was provided, and the overlapping region between multiple videos was determined. Third, to split the overlapping region into the corresponding camera spaces, a segmentation method based on optimal viewpoint selection was given. Finally, the 2D videos were dynamically fitted to the 3D model using the dynamic texture mapping method, while accomplishing the fusing and rendering of the 3D real scene. After experimental verification, the overall effect of the multiple videos and 3D real scene fusion system implemented using the method proposed in this article is better, while the algorithm is less time-consuming and efficient in rendering.     

城市3维景观模型重建技术研究

3维景观模型越来越广泛地应用于城市建设和管理之中,如何高效快速地构建城市3维景观模型成为一个关键技术问题。地形与地物分层建模法是城市3维景观模型重建领域中的一个热门方法,它采用地形数据叠加建筑物实体来构建3维景观。该方法已成功应用于惠州市3维建模,实践证明该方法建模速度快、操作简单、具有广阔的应用前景。     

A multiple representation data structure for dynamic visualisation of generalised 3D city models

In this paper, a novel multiple representation data structure for dynamic visualisation of 3D city models, called CityTree, is proposed. To create a CityTree, the ground plans of the buildings are generated and simplified. Then, the buildings are divided into clusters by the road network and one CityTree is created for each cluster. The leaf nodes of the CityTree represent the original 3D objects of each building, and the intermediate nodes represent groups of close buildings. By utilising CityTree, it is possible to have dynamic zoom functionality in real time. The CityTree methodology is implemented in a framework where the original city model is stored in CityGML and the CityTree is stored as X3D scenes. A case study confirms the applicability of the CityTree for dynamic visualisation of 3D city models.     

Augmented virtual environment: fusion of real-time video and 3D models in the digital earth system

ABSTRACT

An Augmented virtual environment (AVE) is concerned with the fusion of real-time video with 3D models or scenes so as to augment the virtual environment. In this paper, a new approach to establish an AVE with a wide field of view is proposed, including real-time video projection, multiple video texture fusion and 3D visualization of moving objects. A new diagonally weighted algorithm is proposed to smooth the apparent gaps within the overlapping area between the two adjacent videos. A visualization method for the location and trajectory of a moving virtual object is proposed to display the moving object and its trajectory in the 3D virtual environment. The experimental results showed that the proposed set of algorithms are able to fuse multiple real-time videos with 3D models efficiently, and the experiment runs a 3D scene containing two million triangles and six real-time videos at around 55 frames per second on a laptop with 1GB of graphics card memory. In addition, a realistic AVE with a wide field of view was created based on the Digital Earth Science Platform by fusing three videos with a complex indoor virtual scene, visualizing a moving object and drawing its trajectory in the real time.