车载激光扫描数据中实线型交通标线提取

本文提出一种基于路面点云强度增强的车载激光点云实线型交通标线提取方法。首先通过预处理提取路面点云，获取各激光点与轨迹线的距离。然后逐段对路面进行强度增强，集合多滤波器集成的策略进行强度变换和去噪，消除距离、点密度、磨损等因素对反射强度值影响，增强路面点云和标线的强度差异。基于增强后的反射强度，采用k均值聚类和连通分支聚类等方法对标线进行分割，并利用归一化图割方法优化强度分割结果。最后利用实线型标线的语义信息和空间分布特征从分割后标线对象中识别实线型交通标线。试验采用四份不同车载激光扫描系统获取的数据用于验证本文方法有效性，实线型标线提取结果的准确率达到95.98%，召回率达到91.87%，综合评价指标F₁-Measure值达到95.55%以上。试验结果表明本文方法能够有效增强受扫描距离、路面磨损及点密度分布不均等因素影响的点云强度信息，实现不同车载激光扫描获取的复杂道路环境下实线型交通标线的提取。     

高分辨率航空影像中斑马线的识别与重建

提出了一种利用高分辨率航空影像自动识别与重建斑马线的方法。文中利用基于灰度共生矩阵（cray level co-occurrence matrix,GLCM）和二维Gabor滤波器特征的JointBoost分类器来提取斑马线,并依据斑马线在空间几何上的重复性规则对斑马线建立参数模型。最后结合一些具有代表性的实验数据（如阴影、遮挡和模糊等）来验证本文所提出的方法在斑马线的识别与重建中的有效性。     

基于几何规则的车载近景立体影像道路交通标线自动提取

道路交通标线信息是道路导航地图中必不可少的数据，对于制作精度更高、道路细节信息更加丰富清晰的高精度导航地图具有重要的作用。本文以车载近景立体影像中的道路交通标线信息自动提取为研究目标，针对道路交通标线快速、精确采集的应用需求，提出了基于几何规则的车载近景立体影像道路交通标线自动提取方法。该方法首先分析了道路交通标线的几何特征；其次，构建了基于几何特征的交通标线信息提取规则；最后，以标线种子点为基础，结合前述规则，实现了道路交通标线三维空间信息的自动采集。以南京师范大学的车载移动测量系统拍摄的实际近景立体影像为数据进行了试验，试验结果证明，本文方法相比传统人机交互采集方法，在交通标线特征点采集效率、标线几何相似度等方面有较大的优势，可为高精度导航地图的生产提供一种可借鉴的技术支撑。     

高精度矢量数据的路面三维自动建模方法

为了解决路面手工三维建模速度慢、工作量大等问题,本文面向规范化处理的高精度矢量数据,对不同路口进行精细化设计,自动生成路面三维模型。首先使用道路高精度三维信息采集软件,在获取的点云数据中半自动化提取准确的道路边线、道路标识线等矢量信息;然后针对不同路口进行精细化线形设计,提出连续四边形重建方法、弯道平滑处理方法、交叉口重建方法及路面标识线投射重建方法;最后对提取的高精度矢量数据进行规范化处理,在满足路面线形设计要求后,借助MAXScript脚本实现路面三维自动化建模。以车载移动测量系统获取的某段道路点云数据进行试验,验证了该方法的可行性和有效性。     

A geometric stochastic approach based on marked point processes for road mark detection from high resolution aerial images

Road detection has been a topic of great interest in the photogrammetric and remote sensing communities since the end of the 70s. Many approaches dealing with various sensor resolutions, the nature of the scene or the wished accuracy of the extracted objects have been presented. This topic remains challenging today as the need for accurate and up-to-date data is becoming more and more important. Based on this context, we will study in this paper the road network from a particular point of view, focusing on road marks, and in particular dashed lines. Indeed, they are very useful clues, for evidence of a road, but also for tasks of a higher level. For instance, they can be used to enhance quality and to improve road databases. It is also possible to delineate the different circulation lanes, their width and functionality (speed limit, special lanes for buses or bicycles...).In this paper, we propose a new robust and accurate top–down approach for dashed line detection based on stochastic geometry. Our approach is automatic in the sense that no intervention from a human operator is necessary to initialise the algorithm or to track errors during the process. The core of our approach relies on defining geometric, radiometric and relational models for dashed lines objects. The model also has to deal with the interactions between the different objects making up a line, meaning that it introduces external knowledge taken from specifications.Our strategy is based on a stochastic method, and in particular marked point processes. Our goal is to find the objects configuration minimising an energy function made-up of a data attachment term measuring the consistency of the image with respect to the objects and a regularising term managing the relationship between neighbouring objects. To sample the energy function, we use Green algorithm’s; coupled with a simulated annealing to find its minimum.Results from aerial images at various resolutions are presented showing that our approach is relevant and accurate as it can handle the most frequent layouts of dashed lines. Some issues, for instance, such as the relative weighting of both terms of the energy are also discussed in the conclusion.     

A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs

Photogrammetric methods for dense 3D surface reconstruction are increasingly available to both professional and amateur users who have requirements that span a wide variety of applications. One of the key concerns in choosing an appropriate method is to understand the achievable accuracy and how choices made within the workflow can alter that outcome. In this paper we consider accuracy in two components: the ability to generate a correctly scaled 3D model; and the ability to automatically deliver a high quality data set that provides good agreement to a reference surface. The determination of scale information is particularly important, since a network of images usually only provides angle measurements and thus leads to unscaled geometry. A solution is the introduction of known distances in object space, such as base lines between camera stations or distances between control points. In order to avoid using known object distances, the method presented in this paper exploits a calibrated stereo camera utilizing the calibrated base line information from the camera pair as an observational based geometric constraint. The method provides distance information throughout the object volume by orbiting the object.In order to test the performance of this approach, four topical surface matching methods have been investigated to determine their ability to produce accurate, dense point clouds. The methods include two versions of Semi-Global Matching as well as MicMac and Patch-based Multi-View Stereo (PMVS). These methods are implemented on a set of stereo images captured from four carefully selected objects by using (1) an off-the-shelf low cost 3D camera and (2) a pair of Nikon D700 DSLR cameras rigidly mounted in close proximity to each other. Inter-comparisons demonstrate the subtle differences between each of these permutations. The point clouds are also compared to a dataset obtained with a Nikon MMD laser scanner. Finally, the established process of achieving accurate point clouds from images and known object space distances are compared with the presented strategies.Results from the matching demonstrate that if a good imaging network is provided, using a stereo camera and bundle adjustment with geometric constraints can effectively resolve the scale. Among the strategies for dense 3D reconstruction, using the presented method for solving the scale problem and PMVS on the images captured with two DSLR cameras resulted in a dense point cloud as accurate as the Nikon laser scanner dataset.     

Change detection on LOD 2 building models with very high resolution spaceborne stereo imagery

Due to the fast development of the urban environment, the need for efficient maintenance and updating of 3D building models is ever increasing. Change detection is an essential step to spot the changed area for data (map/3D models) updating and urban monitoring. Traditional methods based on 2D images are no longer suitable for change detection in building scale, owing to the increased spectral variability of the building roofs and larger perspective distortion of the very high resolution (VHR) imagery. Change detection in 3D is increasingly being investigated using airborne laser scanning data or matched Digital Surface Models (DSM), but rare study has been conducted regarding to change detection on 3D city models with VHR images, which is more informative but meanwhile more complicated. This is due to the fact that the 3D models are abstracted geometric representation of the urban reality, while the VHR images record everything. In this paper, a novel method is proposed to detect changes directly on LOD (Level of Detail) 2 building models with VHR spaceborne stereo images from a different date, with particular focus on addressing the special characteristics of the 3D models. In the first step, the 3D building models are projected onto a raster grid, encoded with building object, terrain object, and planar faces. The DSM is extracted from the stereo imagery by hierarchical semi-global matching (SGM). In the second step, a multi-channel change indicator is extracted between the 3D models and stereo images, considering the inherent geometric consistency (IGC), height difference, and texture similarity for each planar face. Each channel of the indicator is then clustered with the Self-organizing Map (SOM), with “change”, “non-change” and “uncertain change” status labeled through a voting strategy. The “uncertain changes” are then determined with a Markov Random Field (MRF) analysis considering the geometric relationship between faces. In the third step, buildings are extracted combining the multispectral images and the DSM by morphological operators, and the new buildings are determined by excluding the verified unchanged buildings from the second step. Both the synthetic experiment with Worldview-2 stereo imagery and the real experiment with IKONOS stereo imagery are carried out to demonstrate the effectiveness of the proposed method. It is shown that the proposed method can be applied as an effective way to monitoring the building changes, as well as updating 3D models from one epoch to the other.     

利用图割算法进行城市密集点云表面模型重建

利用倾斜影像获得的密集点云来构建表面模型是基于倾斜影像进行三维重建的核心之一。本文针对现行密集点云表面模型重建存在的建模效率低、表面选取不真实等问题，提出了一种基于图割算法的城市密集点云表面模型重建方法。利用该方法重建城市密集点云表面模型，首先通过预处理软件对无人机倾斜影像进行空中三角测量，并利用空中三角测量的解算结果生成密集点云；然后对密集点云添加相应的边，同时对三维点云根据距离进行选取合并；最后根据三维点云形成的四面体和三角面建立图割问题，并通过求解图割问题来求取最优的密集点云表面模型。为证明这种方法的可行性和有效性，使用城市地区的无人机倾斜影像数据进行城市密集点云表面模型重建，试验结果表明，该方法具有可行性好、建模效果好、处理速度快等优势。     

基于多源数据的拼接型房屋三维重建方法研究

提出了结合房屋矢量数据、航空影像和点云数据的拼接型房屋(由平顶房、人字型和四坡型房屋组成)自动三维重建算法。算法重点研究了基于点云数据和影像特征提取的拼接型房屋屋脊线检测,并利用其对拼接型房屋组成的模型进行拆分;对于人字型和四坡型房屋组成模型,结合矢量数据和屋脊线,利用几何约束条件自动寻找房屋组成模型的屋檐线,从而获得拼接型房屋组成模型的完整分割;最后通过点云数据的屋顶平面解算其组成房屋模型的参数,最终实现整个拼接型房屋的三维重建。实验数据证明,该方法能较好地实现拼接型房屋的几何模型自动重建。     

地性线的山地区域的卫星影像几何精纠正

提出了一种山地区域基于DEM地性线的控制纠正新方法,该方法以数字地形模型DEM为无几何变形的控制基准纠正卫星影像。阐述了提取沟谷、山脊、山峰和凹地区域的地性线的原理和算法,给出了山地区域基于地性线进行卫星图像几何精纠正实施步骤,进一步讨论了地性线提取、控制点采集存在的问题,以及解决问题的途径。实验结果表明,对于山地区域,地性线的空间数量数倍于水系、道路等常规地图层;地性线来源于DEM,其空间稳定性和可靠性更高,可以用于山地区域的卫星影像的严格控制纠正。用该方法进行几何纠正处理,几何误差能控制在一个像元的水平上。     

Stereo analysis of high-resolution SAR images for building height estimation in cases of orthogonal aspect directions

SAR stereo image analysis for 3D information extraction is mostly carried out based on imagery taken under same-side or opposite-side viewing conditions. For urban scenes in practice stereo is up to now usually restricted to the first configuration, because increasing image dissimilarity connected with rising illumination direction differences leads to a lack of suitable features for matching, especially in the case of low or medium resolution data. However, due to two developments SAR stereo from arbitrary viewing conditions becomes an interesting option for urban information extraction. The first one is the availability of airborne sensor systems, which are capable of more flexible data acquisition in comparison to satellite sensors. This flexibility enables multi-aspect analysis of objects in built-up areas for various kinds of purpose, such as building recognition, road network extraction, or traffic monitoring. The second development is the significant improvement of the geometric resolution providing a high level of detail especially of roof features, which can be observed from a wide span of viewpoints. In this paper, high-resolution SAR images of an urban scene are analyzed in order to infer buildings and their height from the different layover effects in views taken from orthogonal aspect angles. High level object matching is proposed that relies on symbolic data, representing suitable features of urban objects. Here, a knowledge-based approach is applied, which is realized by a production system that codes a set of suitable principles of perceptual grouping in its production rules. The images are analyzed separately for the presence of certain object groups and their characteristics frequently appearing on buildings, such as salient rows of point targets, rectangular structures or symmetries. The stereo analysis is then accomplished by means of productions that combine and match these 2D image objects and infer their height by 3D clustering. The approach is tested using real SAR data of an urban scene.     

利用低空无人机飞控数据的摄影航带全自动整理方法

本文为低空无人机平台弱控制航摄影像建立符合航测处理要求的区域网,提出了基于无人机飞控数据的无人机影像航带整理技术;分析了无人机影像航测处理区域网构建要求,提出针对无人机航测处理的航带整理技术流程;设计了基于飞控姿态数据的无人机起降和转弯影像自动剔除算法,自动生成航带;并提出了基于飞控数据快速计算像片FOV算法,构建区域网内像对链接关系;对实际无人机航摄的两个测区进行航带整理实验,结果表明基于飞控数据可快速构建区域网,满足空三匹配和挑片测图要求。     

多特征约束的高分辨率光学遥感影像道路提取

针对复杂场景中的遥感影像道路提取问题,论文提出了一种多特征约束的影像道路提取方法,并开展了论文方法可行性论证。该方法首先,根据道路宽度的先验知识以及道路的几何特征,提出一种改进的线段二次提取模型,利用线段长度和道路宽度确定候选道路种子点集;其次,输入道路结构信息,基于道路辐射特征对候选道路种子点进行整体匹配评价;再次,当候选道路种子无法符合辐射特征要求时,提出一种浅色机动车检测模型,以此将浅色机动车结果作为道路上下文特征,利用道路上下文特征对候选道路种子点进行分析;然后,构建道路拓扑分析模型,依据道路拓扑特征对候选道路种子点进行最终验证;最后,对提取道路种子点进行优化处理,并提出道路跟踪及拟合方法。通过不同复杂场景、不同分辨率高分辨率遥感影像下开展的不同方法实验结果对比分析表明,相对于其他商用软件ECognition和Erdas的方法,本方法自动化程度更高,运行效率高,适用于解决道路类型多样化、几何光谱噪声大的复杂场景道路提取问题。     

光学遥感影像道路提取的方法综述

道路信息在多个应用领域中发挥着基础性的作用。光学遥感影像能够以较高的空间分辨率对目标地物进行精细化解译，可大幅增强地物目标的提取能力。充分利用光学遥感影像丰富的几何纹理信息，进行道路的精确提取，已成为当前遥感学界研究的热点与前沿问题。鉴于此，本文依据近年来大量相关文献，对现有的理论与方法进行了归类与总结，通过分析不同方法采用的道路特征组合，将道路提取方法划分为模板匹配、知识驱动、面向对象和深度学习4类方法，简要介绍了道路提取普适性的评价指标并对部分方法进行了分析与评价；最后对现有光学遥感影像道路提取的发展提出了建议和展望。     

Automatic detection and tracking of pedestrians from a moving stereo rig

We report on a stereo system for 3D detection and tracking of pedestrians in urban traffic scenes. The system is built around a probabilistic environment model which fuses evidence from dense 3D reconstruction and image-based pedestrian detection into a consistent interpretation of the observed scene, and a multi-hypothesis tracker to reconstruct the pedestrians’ trajectories in 3D coordinates over time. Experiments on real stereo sequences recorded in busy inner-city scenarios are presented, in which the system achieves promising results.     

基于道路标线布设方案的交通路网数据库构建研究

道路标线是交通规则的载体,它们布设在物理道路网络上为交通参与者分配路权,并规范其行为。通常,称这种加载了交通规则的物理道路网络为交通路网。本文首先提出了物理道路网络的表示模型;然后结合线性参考技术,以物理道路网络为基础,构建了基于的GIS道路标线布设方案数据模型;最后,本文选取示范路网,运用道路标线布设方案数据库,进行路网交通规则的推导,构建了基于车道级路网数据模型的交通路网数据库,为交通路网数据库的构建提供了一种参考。     

基于倾斜影像的城市场景隐式曲面重建

在基于倾斜影像的城市场景重建过程中,由于获取影像时存在场景遮蔽和大视点变化的情况,建筑物立面等区域存在着影像密集匹配点云稀疏甚至空洞的情况,自动化重建难度大,难以反映建筑物的真实形态。本文提出了一种新的基于倾斜影像的城市场景隐式曲面重建方法：首先,以倾斜影像密集匹配点云为基础建立Delaunay四面体;然后,对Delaunay四面体进行约束图割,提取出可视化的三角面,进而更加精确地估计点云的法向信息;最终,结合Screened Poisson曲面重建,实现了城市场景的隐式曲面重建。通过多种隐式曲面重建方法的对比试验,验证了本方法的准确性和适用性。     

Multi-view dense matching supported by triangular meshes

We present a new procedure to compute dense 3D point clouds from a sequential set of images. This procedure is considered as a second step of a three-step algorithm for 3D reconstruction from image sequences, whose first step consists of image orientation and the last step is shape reconstruction. We assume that the camera matrices as well as a sparse set of 3D points are available and we strive for obtaining a dense and reliable 3D point cloud. Three novel ideas are presented: (1) for sparse tracking and triangulation, the search space for correspondences is reduced to a line segment by means of known camera matrices and disparity ranges are provided by triangular meshes from the already available points; (2) triangular meshes from extended sets of points are used for dense matching, because these meshes help to reconstruct points in weakly textured areas and present a natural way to obtain subpixel accuracy; (3) two non-local optimization methods, namely, 1D dynamic programming along horizontal lines and semi-global optimization were employed for refinement of local results obtained from an arbitrary number of images. All methods were extensively tested on a benchmark data set and an infrared video sequence. Both visual and quantitative results demonstrate the effectiveness of our algorithm.     

Detection and 3D reconstruction of traffic signs from multiple view color images

3D reconstruction of traffic signs is of great interest in many applications such as image-based localization and navigation. In order to reflect the reality, the reconstruction process should meet both accuracy and precision. In order to reach such a valid reconstruction from calibrated multi-view images, accurate and precise extraction of signs in every individual view is a must. This paper presents first an automatic pipeline for identifying and extracting the silhouette of signs in every individual image. Then, a multi-view constrained 3D reconstruction algorithm provides an optimum 3D silhouette for the detected signs. The first step called detection, tackles with a color-based segmentation to generate ROIs (Region of Interests) in image. The shape of every ROI is estimated by fitting an ellipse, a quadrilateral or a triangle to edge points. A ROI is rejected if none of the three shapes can be fitted sufficiently precisely. Thanks to the estimated shape the remained candidates ROIs are rectified to remove the perspective distortion and then matched with a set of reference signs using textural information. Poor matches are rejected and the types of remained ones are identified. The output of the detection algorithm is a set of identified road signs whose silhouette in image plane is represented by and ellipse, a quadrilateral or a triangle. The 3D reconstruction process is based on a hypothesis generation and verification. Hypotheses are generated by a stereo matching approach taking into account epipolar geometry and also the similarity of the categories. The hypotheses that are plausibly correspond to the same 3D road sign are identified and grouped during this process. Finally, all the hypotheses of the same group are merged to generate a unique 3D road sign by a multi-view algorithm integrating a priori knowledges about 3D shape of road signs as constraints. The algorithm is assessed on real and synthetic images and reached and average accuracy of 3.5cm for position and 4.5° for orientation.     

在高分辨率遥感影像中提取无清晰连续边缘线的道路

现有的许多道路提取算法均利用道路的外边缘线信息来实现道路的提取,当边缘线清晰连续时,采用这些方法都可以取得很好的提取效果.不过,在高分辨率的城市遥感影像中,常常会存在一些低对比度区域,处于其中的道路边缘线非常之弱,以致难以直接检测出单个的边缘点.如果受到树木、房屋及车辆的干扰,这些原本就很弱的边缘还会发生断裂.通过现有方法提取具有如此边缘线的道路难度很大.本文给出一种旨在解决这一问题的新方法.首先借鉴相位编组原理形成边缘线支持区并对其进行连接;然后利用动态规划方法从支持区中检测出边缘线并对这些线进行平滑;最后连接由边缘线构成的道路段,得出道路提取结果.实验表明,本方法可以较好地提取出无清晰连续边缘线的道路,对于边缘对比度较大的道路则可取得更为令人满意的结果.