农作物冠层光谱分析及反演技术综述

农作物的冠层光谱反射率与作物的氮含量、叶绿素含量及叶面积指数等参数之间具有很强的相关性,通过对作物冠层光谱进行分析可反演出作物的生物物理参数,并应用在长势分析、产量预测、病虫害预警等领域。本文首先阐述了作物冠层反射率采集方法,对地面、机载及遥感卫星3个采集层面的优缺点进行了对比;其次给出了植被指数构建原理及常用植被指数,分析了物理模型反演法和统计反演法的复杂度和性能;最后提出了农作物冠层光谱分析及反演技术的下一步发展方向及面临的挑战。     

神经网络支持下的Sentinel-2卫星影像自动云检测

为解决利用Sentinel-2卫星影像进行地物信息提取时云层遮挡造成的信息误判问题,提出了一种基于深度学习的遥感影像云区高精度分割方法。该方法通过预处理的遥感样本数据构建出一种深度神经网络模型,自动提取高层次影像特征;再将影像特征输入分类器,实现遥感影像的像素级分类,从而分割出云覆盖矩阵;最后将云覆盖矩阵转化为云二值图,结合感兴趣区矢量准确获取指定区域云检测结果。选取典型区域进行测试,结果表明：该方法检测精度较高,速度较快,且无须辅助信息与人工干预,可用于Sentinel-2卫星影像不规则区域自动云检测。     

结合面向对象和深度特征的高分影像树种分类

针对传统手工提取特征方法需要专业领域知识,提取高质量特征困难的问题,将深度迁移学习技术引入到高分影像树种分类中,提出一种结合面向对象和深度特征的高分影像树种分类方法。为了获取树种的精确边界,该方法首先利用多尺度分割技术分割整幅遥感影像,并选择训练样本作为深度卷积神经网络的输入。为了避免样本数量少导致过拟合问题,采用迁移学习方法,使用ImageNet上训练的VGG16模型参数初始化深度卷积神经网络,并利用全局平局池化压缩参数,在网络最后添加1024个节点的全连接层和7个节点的Softmax分类器,利用反向传播和Adam优化算法训练网络。最后分类整幅遥感影像,生成树种专题地图。以安徽省滁州市的皇甫山国家森林公园为研究区,QuickBird高分影像作为数据源,采用本文方法进行树种分类。试验结果表明,本文方法树种分类总体精度和Kappa系数分别为78.98%和0.685 0,在保证树种精度的同时实现了端到端的树种分类。     

遥感影像建筑物提取的卷积神经元网络与开源数据集方法

从遥感图像中自动化地检测和提取建筑物在城市规划、人口估计、地形图制作和更新等应用中具有极为重要的意义。本文提出和展示了建筑物提取的数个研究进展。由于遥感成像机理、建筑物自身、背景环境的复杂性,传统的经验设计特征的方法一直未能实现自动化,建筑物提取成为30余年尚未解决的挑战。先进的深度学习方法带来新的机遇,但目前存在两个困境:①尚缺少高精度的建筑物数据库,而数据是深度学习必不可少的"燃料";②目前国际上的方法都采用像素级的语义分割,目标级、矢量级的提取工作亟待开展。针对于此,本文进行以下工作:①与目前同类数据集相比,建立了一套目前国际上范围最大、精度最高、涵盖多种样本形式(栅格、矢量)、多类数据源(航空、卫星)的建筑物数据库(WHU building dataset),并实现开源;②提出一种基于全卷积网络的建筑物语义分割方法,与当前国际上的最新算法相比达到了领先水平;③将建筑物提取的范围从像素级的语义分割推广至目标实例分割,实现以目标(建筑物)为对象的识别和提取。通过试验,验证了WHU数据库在国际上的领先性和本文方法的先进性。     

基于CNN和RNN的像素级视频目标跟踪算法

影像目标跟踪定位技术是当前计算机视觉领域的研究热点,目标跟踪算法也是现阶段将视频结果用于定位的薄弱环节之一.本文分析了像素级目标跟踪存在的问题,根据深度学习在图像领域的最新研究成果与视频跟踪需求,结合最新的图像分割、卷积神经网络(CNN)、循环神经网络(RNN)和加密解码结构等方法提出了一种像素级视频目标跟踪算法.使用公开数据集实现算法并设计了定量评价指标.实验结果表明该算法具有较强的像素级视频目标跟踪定位能力.     

Is it possible to discern Striga weed (Striga hermonthica) infestation levels in maize agro-ecological systems using in-situ spectroscopy?

The invasion by Striga in most cereal crop fields in Africa has posed a significant threat to food security and has caused substantial socioeconomic losses. Hyperspectral remote sensing is an effective means to discriminate plant species, providing possibilities to track such weed invasions and improve precision agriculture. However, essential baseline information using remotely sensed data is missing, specifically for the Striga weed in Africa. In this study, we investigated the spectral uniqueness of Striga compared to other co-occurring maize crops and weeds. We used the in-situ FieldSpec® Handheld 2™ analytical spectral device (ASD), hyperspectral data and their respective narrow-band indices in the visible and near infrared (VNIR) region of the electromagnetic spectrum (EMS) and four machine learning discriminant algorithms (i.e. random forest: RF, linear discriminant analysis: LDA, gradient boosting: GB and support vector machines: SVM) to discriminate among different levels of Striga (Striga hermonthica) infestations in maize fields in western Kenya. We also tested the utility of Sentinel-2 waveband configurations to map and discriminate Striga infestation in heterogenous cereal crop fields. The in-situ hyperspectral reflectance data were resampled to the spectral waveband configurations of Sentinel-2 using published spectral response functions. We sampled and detected seven Striga infestation classes based on three flowering Striga classes (low, moderate and high) against two background endmembers (soil and a mixture of maize and other co-occurring weeds). A guided regularized random forest (GRRF) algorithm was used to select the most relevant hyperspectral wavebands and vegetation indices (VIs) as well as for the resampled Sentinel-2 multispectral wavebands for Striga infestation discrimination. The performance of the four discriminant algorithms was compared using classification accuracy assessment metrics. We were able to positively discriminate Striga from the two background endmembers i.e. soil and co-occurring vegetation (maize and co-occurring weeds) based on the few GRRF selected hyperspectral vegetation indices and the GRRF selected resampled Sentinel-2 multispectral bands. RF outperformed all the other discriminant methods and produced the highest overall accuracy of 91% and 85%, using the hyperspectral and resampled Sentinel-2 multispectral wavebands, respectively, across the four different discriminant models tested in this study. The class with the highest detection accuracy across all the four discriminant algorithms, was the “exclusively maize and other co-occurring weeds” (>70%). The GRRF reduced the dimensionality of the hyperspectral data and selected only 9 most relevant wavebands out of 750 wavebands, 6 VIs out of 15 and 6 out of 10 resampled Sentinel-2 multispectral wavebands for discriminating among the Striga and co-occurring classes. Resampled Sentinel-2 multispectral wavebands 3 (green) and 4 (red) were the most crucial for Striga detection. The use of the most relevant hyperspectral features (i.e. wavebands and VIs) significantly (p ≤ 0.05) increased the overall classification accuracy and Kappa scores (±5% and ±0.2, respectively) in all the machine learning discriminant models. Our results show the potential of hyperspectral, resampled Sentinel-2 multispectral datasets and machine learning discriminant algorithms as a tool to accurately discern Striga in heterogenous maize agro-ecological systems.     

A multi-level context-guided classification method with object-based convolutional neural network for land cover classification using very high resolution remote sensing images

Classification of very high resolution imagery (VHRI) is challenging due to the difficulty in mining complex spatial and spectral patterns from rich image details. Various object-based Convolutional Neural Networks (OCNN) for VHRI classification have been proposed to overcome the drawbacks of the redundant pixel-wise CNNs, owing to their low computational cost and fine contour-preserving. However, classification performance of OCNN is still limited by geometric distortions, insufficient feature representation, and lack of contextual guidance. In this paper, an innovative multi-level context-guided classification method with the OCNN (MLCG-OCNN) is proposed. A feature-fusing OCNN, including the object contour-preserving mask strategy with the supplement of object deformation coefficient, is developed for accurate object discrimination by learning simultaneously high-level features from independent spectral patterns, geometric characteristics, and object-level contextual information. Then pixel-level contextual guidance is used to further improve the per-object classification results. The MLCG-OCNN method is intentionally tested on two validated small image datasets with limited training samples, to assess the performance in applications of land cover classification where a trade-off between time-consumption of sample training and overall accuracy needs to be found, as it is very common in the practice. Compared with traditional benchmark methods including the patch-based per-pixel CNN (PBPP), the patch-based per-object CNN (PBPO), the pixel-wise CNN with object segmentation refinement (PO), semantic segmentation U-Net (U-NET), and DeepLabV3+(DLV3+), MLCG-OCNN method achieves remarkable classification performance (> 80 %). Compared with the state-of-the-art architecture DeepLabV3+, the MLCG-OCNN method demonstrates high computational efficiency for VHRI classification (4–5 times faster).     

面向高光谱影像分类的生成式对抗网络

为了提高高光谱影像分类精度,提出了一种基于生成式对抗网络的高光谱影像分类方法。生成式对抗网络由生成器、判别器和分类器3部分组成,其中生成器用于模拟高光谱样本的数据分布,生成特定类别的样本;判别器是一个二值分类器,用于判断输入的样本是否为真实数据;分类器用于对输入的样本进行分类。利用反向传播算法依次更新生成器、判别器和分类器的网络参数使损失函数最小,从而达到训练网络的目的。生成器和判别器能够模拟高光谱影像的样本分布来辅助训练分类器,因此能够提高高光谱影像的分类精度。分别采用Pavia大学和Salinas高光谱数据集进行分类试验,试验结果表明提出的分类方法能够在小样本条件下提高高光谱影像的分类精度。     

光学遥感影像道路提取的方法综述

道路信息在多个应用领域中发挥着基础性的作用。光学遥感影像能够以较高的空间分辨率对目标地物进行精细化解译,可大幅增强地物目标的提取能力。充分利用光学遥感影像丰富的几何纹理信息,进行道路的精确提取,已成为当前遥感学界研究的热点与前沿问题。鉴于此,本文依据近年来大量相关文献,对现有的理论与方法进行了归类与总结,通过分析不同方法采用的道路特征组合,将道路提取方法划分为模板匹配、知识驱动、面向对象和深度学习4类方法,简要介绍了道路提取普适性的评价指标并对部分方法进行了分析与评价;最后对现有光学遥感影像道路提取的发展提出了建议和展望。     

Mapping Rice Paddies in Complex Landscapes with Convolutional Neural Networks and Phenological Metrics

ABSTRACT

Rice mapping with remote sensing imagery provides an alternative means for estimating crop-yield and performing land management due to the large geographical coverage and low cost of remotely sensed data. Rice mapping in Southern China, however, is very difficult as rice paddies are patchy and fragmented, reflecting the undulating and varied topography. In addition, abandoned lands widely exist in Southern China due to rapid urbanization. Abandoned lands are easily confused with paddy fields, thereby degrading the classification accuracy of rice paddies in such complex landscape regions. To address this problem, the present study proposes an innovative method for rice mapping through combining a convolutional neural network (CNN) model and a decision tree (DT) method with phenological metrics. First, a pre-trained LeNet-5 Model using the UC Merced Dataset was developed to classify the cropland class from other land cover types, i.e. built-up, rivers, forests. Then, paddy rice field was separated from abandoned land in the cropland class using a DT model with phenological metrics derived from the time-series data of the normalized difference vegetation index (NDVI). The accuracy of the proposed classification methods was compared with three other classification techniques, namely, back propagation neural network (BPNN), original CNN, pre-trained CNN applied to HJ-1 A/B charge-coupled device (CCD) images of Zhuzhou City, Hunan Province, China. Results suggest that the proposed method achieved an overall accuracy of 93.56%, much higher than those of other methods. This indicates that the proposed method can efficiently accommodate the challenges of rice mapping in regions with complex landscapes.