Building roof modeling from airborne laser scanning data based on level set approach

This paper presents a novel approach to building roof modeling, including roof plane segmentation and roof model reconstruction, from airborne laser scanning data. Segmentation is performed by minimizing an energy function formulated as multiphase level set. The energy function is minimized when each segment corresponds to one or several roof plans of the same normal vector. With this formulation, maximum n regions are segmented at a time by applying log₂n level set functions. The roof ridges or step edges are then delineated by the union of the zero level contours of the level set functions. In the final step of segmentation, coplanar and parallel roof segments are separated into individual roof segments based on their connectivity and homogeneity. To reconstruct a 3D roof model, roof structure points are determined by intersecting adjacent roof segments or line segments of building boundary and then connected based on their topological relations inferred from the segmentation result. As a global solution to the segmentation problem, the proposed approach determines multiple roof segments at the same time, which leads to topological consistency among the segment boundaries. The paper describes the principle and solution of the multiphase level set approach and demonstrates its performance and properties with two airborne laser scanning data sets.     

A shape-based segmentation method for mobile laser scanning point clouds

Segmentation of mobile laser point clouds of urban scenes into objects is an important step for post-processing (e.g., interpretation) of point clouds. Point clouds of urban scenes contain numerous objects with significant size variability, complex and incomplete structures, and holes or variable point densities, raising great challenges for the segmentation of mobile laser point clouds. This paper addresses these challenges by proposing a shape-based segmentation method. The proposed method first calculates the optimal neighborhood size of each point to derive the geometric features associated with it, and then classifies the point clouds according to geometric features using support vector machines (SVMs). Second, a set of rules are defined to segment the classified point clouds, and a similarity criterion for segments is proposed to overcome over-segmentation. Finally, the segmentation output is merged based on topological connectivity into a meaningful geometrical abstraction. The proposed method has been tested on point clouds of two urban scenes obtained by different mobile laser scanners. The results show that the proposed method segments large-scale mobile laser point clouds with good accuracy and computationally effective time cost, and that it segments pole-like objects particularly well.     

An adaptive approach for the segmentation and extraction of planar and linear/cylindrical features from laser scanning data

Laser scanning systems have been established as leading tools for the collection of high density three-dimensional data over physical surfaces. The collected point cloud does not provide semantic information about the characteristics of the scanned surfaces. Therefore, different processing techniques have been developed for the extraction of useful information from this data which could be applied for diverse civil, industrial, and military applications. Planar and linear/cylindrical features are among the most important primitive information to be extracted from laser scanning data, especially those collected in urban areas. This paper introduces a new approach for the identification, parameterization, and segmentation of these features from laser scanning data while considering the internal characteristics of the utilized point cloud – i.e., local point density variation and noise level in the dataset. In the first step of this approach, a Principal Component Analysis of the local neighborhood of individual points is implemented to identify the points that belong to planar and linear/cylindrical features and select their appropriate representation model. For the detected planar features, the segmentation attributes are then computed through an adaptive cylinder neighborhood definition. Two clustering approaches are then introduced to segment and extract individual planar features in the reconstructed parameter domain. For the linear/cylindrical features, their directional and positional parameters are utilized as the segmentation attributes. A sequential clustering technique is proposed to isolate the points which belong to individual linear/cylindrical features through directional and positional attribute subspaces. Experimental results from simulated and real datasets demonstrate the feasibility of the proposed approach for the extraction of planar and linear/cylindrical features from laser scanning data.     

一种改进的超体素与区域生长点云分割方法

点云分割作为识别地理场景的空间特征、探索和记录空间信息的关键处理步骤,其分割精度直接影响后续三维场景重建、地物特征提取等应用的效果。针对传统区域生长点云分割算法的不稳定等问题,本文结合超体素和区域生长算法对点云数据进行分割,并利用点云自身的色彩信息进一步改进分割结果。试验结果表明,相较于传统的区域生长和已有的结合超体素与区域生长的分割算法,本文算法对点云数据分割的效果更好,且其精确率与召回率均有提高。     

A multi-band approach to unsupervised scale parameter selection for multi-scale image segmentation

Image segmentation is one of key steps in object based image analysis of very high resolution images. Selecting the appropriate scale parameter becomes a particularly important task in image segmentation. In this study, an unsupervised multi-band approach is proposed for scale parameter selection in the multi-scale image segmentation process, which uses spectral angle to measure the spectral homogeneity of segments. With the increasing scale parameter, spectral homogeneity of segments decreases until they match the objects in the real world. The index of spectral homogeneity is thus used to determine multiple appropriate scale parameters. The performance of the proposed method is compared to a single-band based method through qualitative visual interpretation and quantitative discrepancy measures. Both methods are applied for segmenting two images: a QuickBird scene of an urban area within Beijing, China and a Woldview-2 scene of a suburban area in Kashiwa, Japan. The proposed multi-band based segmentation scale parameter selection method outperforms the single-band based method with the better recognition for diverse land cover objects in different urban landscapes.     

车载激光扫描数据中多类目标的层次化提取方法

提出了一种从车载激光扫描数据中层次化提取多类型目标的有效方法。该方法首先利用颜色、激光反射强度、空间距离等特征,生成多尺度超级体素;然后综合超级体素的颜色、激光反射强度、法向量、主方向等特征利用图分割方法对体素进行分割;同时计算分割区域的显著性,以当前显著性最大的区域为种子区域进行邻域聚类得到目标;最后结合聚类区域的几何特性判断目标可能所属的类别,并按照目标类别采用不同的聚类准则重新聚类得到最终目标。试验结果表明,该方法成功地提取出建筑物、地面、路灯、树木、电线杆、交通标志牌、汽车、围墙等多类目标,目标提取的总体精度为92.3%。     

一种自适应的坡度阈值地面点云分割方法

针对城市道路斜坡地形场景中地面欠分割或过分割的问题,提出了一种自适应的激光雷达地面分割算法。首先将激光点云按照水平角度分辨率进行有序组织,然后求取同一水平角度下前后扫描圈间激光点云的距离和局部坡度,最后采用自适应水平距离、局部高度和全局高度阈值区分地面点和非地面点。结合40线激光雷达进行多场景实例分析,结果表明本文算法分割的准确率更高,处理每帧数据均用时约1ms,满足无人驾驶汽车的实时性需求。提出了一种自适应的激光雷达地面分割算法,实现了对激光雷达地面点云的准确分割。     

面向对象的船载激光扫描数据船舶目标检测方法

提出了一种基于对象的船载激光扫描数据内河船舶目标检测方法。该方法基于船舶目标的高程信息和几何特征,利用投影和图像形态学运算方法快速确定包含船舶目标的兴趣区域;然后针对船舶目标数据的空间分布特征,对兴趣区域点云数据进行欧式距离分割和优化处理,生成实体对象,并构建高差、外包围盒和局部密度等特征构成的向量,采用支持向量机进行二元分类,提取出船舶目标。该方法成功地检测出船载激光扫描数据中的船舶目标,船舶目标检测的准确率较高。     

三维激光扫描技术在溶洞探测中的应用

由于溶洞的特殊性,传统测量仪器已经不能满足当前对溶洞探测的要求。三维激光扫描技术采用非接触式高速激光测量方式,能在复杂的现场和空间对被测物体进行快速扫描测量,从而获得点云数据。文中介绍激光扫描的工作原理及三维激光扫描的工作流程,并给出采用Riegl LMS_Z420i三维激光扫描仪对吉首至茶洞高速公路吉首岸索塔基坑下的溶洞进行探测的实例。     

多尺度图像分割和颜色传递的遥感图像彩色化增强

提出一种基于小波降噪、多尺度图像分割和颜色传递的遥感图像彩色化增强方法。该方法利用一种多尺度图像分割技术,将图像分割为若干子区域,在子区域之间进行亮度匹配和颜色传递,减少了颜色传递误差,再与采用软阈值方法的复数小波包降噪预处理相结合,来增强遥感图像的细节分辨能力。试验结果证明,基于图像分割和色彩传递相结合的方法,其参考彩色图像不需要与目标图像配准,只要特征、风格相近似,就可以对纹理结构相对较简单的全色遥感图像实现全自动的彩色化增强。彩色化的结果图像在美观程度及目标的可识别度上都有了明显增强。     

室内三维点云空间自动划分与规则化方法北大核心CSCD

精准空间划分是实现室内语义建模与拓扑结构重建的重要基础。三维点云作为常用的室内空间数据载体,如何基于三维点云进行室内空间语义信息提取与规则化具有重要意义。本文提出了一种基于形态学分割方法实现室内场景的分割,并结合矢量规则化方法完成分割场景的规则化。首先,基于区域增长算法与线性拟合方法提取空间分割要素,通过平面投影生成二进制影像,进而利用距离变换和分水岭算法完成空间分割;然后,对空间分割要素进行线性拟合,进行室内空间格网划分,采用矢栅叠加方法实现空间要素规则化;最后,通过4组实际场景(包含3组ISPRS数据集及1组实际场景采集数据)进行数据验证。试验结果显示,本文提出的室内空间分割与规则化方法可以准确快速地完成室内空间要素的提取。     

The comparison index: A tool for assessing the accuracy of image segmentation

Segmentation algorithms applied to remote sensing data provide valuable information about the size, distribution and context of landscape objects at a range of scales. However, there is a need for well-defined and robust validation tools to assessing the reliability of segmentation results. Such tools are required to assess whether image segments are based on ‘real’ objects, such as field boundaries, or on artefacts of the image segmentation algorithm. These tools can be used to improve the reliability of any land-use/land-cover classifications or landscape analyses that is based on the image segments.The validation algorithm developed in this paper aims to: (a) localize and quantify segmentation inaccuracies; and (b) allow the assessment of segmentation results on the whole. The first aim is achieved using object metrics that enable the quantification of topological and geometric object differences. The second aim is achieved by combining these object metrics into a ‘Comparison Index’, which allows a relative comparison of different segmentation results. The approach demonstrates how the Comparison Index CI can be used to guide trial-and-error techniques, enabling the identification of a segmentation scale H that is close to optimal. Once this scale has been identified a more detailed examination of the CI–H- diagrams can be used to identify precisely what H value and associated parameter settings will yield the most accurate image segmentation results.The procedure is applied to segmented Landsat scenes in an agricultural area in Saxony-Anhalt, Germany. The segmentations were generated using the ‘Fractal Net Evolution Approach’, which is implemented in the eCognition software.     

基于均值漂移和谱图分割的极化SAR影像分割方法及其评价

提出了一种基于均值漂移和谱图分割的极化SAR(PolSAR)影像分割方法。首先,通过均值漂移算法对PolSAR影像进行过分割处理,并基于Wishart统计分布和假设检验的方法构建边缘检测器,充分利用了PolSAR影像的全极化信息提取边缘信息;然后,在过分割和边缘信息的基础上构建相似性度量矩阵,并采用归一化割准则实现PolSAR影像的分割。该算法充分利用了均值漂移算法过分割的特点,降低了谱图分割算法的运算代价,并结合谱图分割算法全局优化的优点改善了PolSAR影像的分割结果;最后,利用Radar-sat-2全极化影像进行了实验,并采用改进的分割效果评价方法实现了精度评价。实验表明,该算法有效地实现了PolSAR影像的分割,显著提高了谱图分割算法的效率,分割结果优良,分割精度优于eCognition软件中的多尺度分割方法。     

Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows

This paper is an exploratory study, which aimed to discover the synergies of data fusion and image segmentation in the context of EO-based rapid mapping workflows. Our approach pillared on the geographic object-based image analysis (GEOBIA) focusing on multiscale, internally-displaced persons’ (IDP) camp information extraction from very high spatial resolution (VHSR) images. We applied twelve pansharpening algorithms to two subsets of a GeoEye-1 image scene that was taken over a former war-induced ephemeral settlement in Sri Lanka. A multidimensional assessment was employed to benchmark pansharpening algorithms with respect to their spectral and spatial fidelity. The multiresolution segmentation (MRS) algorithm of the eCognition Developer software served as the key algorithm in the segmentation process. The first study site was used for comparing segmentation results produced from the twelve fused products at a series of scale, shape, and compactness settings of the MRS algorithm. The segmentation quality and optimum parameter settings of the MRS algorithm were estimated by using empirical discrepancy measures. Non-parametric statistical tests were used to compare the quality of image object candidates, which were derived from the twelve pansharpened products. A wall-to-wall classification was performed based on a support vector machine (SVM) classifier to classify image objects candidates of the fused images. The second site simulated a more realistic crisis information extraction scenario where the domain expertise is crucial in segmentation and classification. We compared segmentation and classification results of the original images (non-fused) and twelve fused images to understand the efficacy of data fusion. We have shown that the GEOBIA has the ability to create meaningful image objects during the segmentation process by compensating the fused image’s spectral distortions with the high-frequency information content that has been injected during fusion. Our findings further questioned the necessity of the data fusion step in rapid mapping context. Bypassing time-intensive data fusion helps to actuate EO-based rapid mapping workflows. We, however, emphasize the fact that data fusion is not limited to VHSR image data but expands over many different combinations of multi-date, multi-sensor EO-data. Thus, further research is needed to understand the synergies of data fusion and image segmentation with respect to multi-date, multi-sensor fusion scenarios and extrapolate our findings to other remote sensing application domains beyond EO-based crisis information retrieval.     

Generation of 3D virtual geographic environment based on laser scanning technique

This paper demonstrates an experiment on the generation of 3D virtual geographic environment on the basis of experimental flight laser scan-ning data by a set of algorithms and methods that were developed to auto-matically interpret range images for extracting geo-spatial features and then to reconstruct geo-objects. The algorithms and methods for the inter-pretation and modeling of laser scanner data include triangulated-irregular-net- work (TIN)-based range image inter- polation; mathematical-morphology (MM)-based range image filtering,feature extraction and range image segmentation, feature generalization and optimization, 3D objects recon-struction and modeling; computer-graphics (CG)-based visualization and animation of geographic virtual reality environment.     

基于DBN的车载激光点云路侧多目标提取

提出一种基于深度信念网络（DBN）的车载激光点云路侧多目标提取方法。首先通过预处理对原始数据进行分段,并将地面和建筑物点云与路侧目标进行分离;然后利用连通分支聚类分析算法进行路侧点云聚类,并采用基于体素的归一化分割方法分割重叠点云,从而生成独立目标点云;在此基础上,生成基于多方向目标对象的二值图像并展开成二值向量作为独立目标点云的描述特征;最后构建并训练DBN,利用训练好的DBN提取行道树、车辆及杆状目标等3类路侧目标。试验采用两份不同城市道路场景的点云数据,行道树、车辆及杆状目标提取结果的准确率分别达97.31%、97.79%、92.78%,召回率分别达98.30%、98.75%和96.77%,精度分别达95.70%、93.81%和90.00%,F1值分别达97.80%、96.81%和94.73%。试验结果验证了本文的有效性。     

Generation of 3D virtual geographic environment based on laser scanning technique

This paper demonstrates an experiment on the generation of 3D virtual geographic environment on the basis of experimental flight laser scanning data by a set of algorithms and methods that were developed to automatically interpret range images for extracting geo-spatial features and then to reconstruct geo-objects. The algorithms and methods for the interpretation and modeling of laser scanner data include triangulated-irregular-net-work (TIN)-based range image interpolation; mathematical-morphology (MM)-based range image filtering, feature extraction and range image segmentation, feature generalization and optimization, 3D objects reconstruction and modeling; computergraphics (CG)-based visualization and animation of geographic virtual reality environment.     

面向对象的高分辨率遥感影像建设用地变化监测

建设用地变化监测对城市可持续发展具有十分重要的意义,为准确提取建设用地的变化信息,本文提出了一种结合旧时期土地利用矢量数据、随机森林及模糊C均值聚类算法的建设用地变化监测方法.首先基于旧时期土地利用矢量数据,将建设用地变化监测分为建成区与非建成区建设用地变化监测;然后进行面向对象分割、基于对象遥感影像光谱、GLCM纹理...     

基于图像语义分割的动态场景下的单目SLAM算法

在恢复场景信息和相机运动时,传统的SLAM算法是基于静态环境假设的。场景中的动态物体会降低算法的稳健性和最终的定位精度。本文提出将基于深度学习的图像语义分割技术与传统的视觉SLAM算法结合,以减少动态物体对定位结果的干扰。首先,构建有监督的卷积神经网络对输入图像中的动态物体进行分割,获得语义图像;然后,从原始图像中提取特征点,并根据语义图像剔除动态物体特征点,保留静态物体特征点;最后,利用静态物体特征点采用基于特征点的单目视觉SLAM算法对相机运动进行跟踪。在ApolloScape自动驾驶数据集上的试验表明,与传统方法相比,本文算法在动态场景中定位精度提升约17%。