Evaluation of image fusion methods using PALSAR,RADARSAT-1 and SPOT images for land use/ land cover classification

This research aimed to explore the fusion of multispectral optical SPOT data with microwave L-band ALOS PALSAR and C-band RADARSAT-1 data for a detailed land use/cover mapping to find out the individual contributions of different wavelengths. Many fusion approaches have been implemented and analyzed for various applications using different remote sensing images. However, the fusion methods have conflict in the context of land use/cover (LULC) mapping using optical and synthetic aperture radar (SAR) images together. In this research two SAR images ALOS PALSAR and RADARSAT-1 were fused with SPOT data. Although, both SAR data were gathered in same polarization, and had same ground resolution, they differ in wavelengths. As different data fusion methods, intensity hue saturation (IHS), principal component analysis, discrete wavelet transformation, high pass frequency (HPF), and Ehlers, were performed and compared. For the quality analyses, visual interpretation was applied as a qualitative analysis, and spectral quality metrics of the fused images, such as correlation coefficient (CC) and universal image quality index (UIQI) were applied as a quantitative analysis. Furthermore, multispectral SPOT image and SAR fused images were classified with Maximum Likelihood Classification (MLC) method for the evaluation of their efficiencies. Ehlers gave the best score in the quality analysis and for the accuracy of LULC on LULC mapping of PALSAR and RADARSAT images. The results showed that the HPF method is in the second place with an increased thematic mapping accuracy. IHS had the worse results in all analyses. Overall, it is indicated that Ehlers method is a powerful technique to improve the LULC classification.     

基于目标关联的多源卫星遥感图像兵营融合检测方法

目前的目标融合检测方法大都是基于多源遥感图像配准的,然而在实际的应用中,成像机理不同的多源遥感图像的精校正和图像间的配准是十分复杂的,难以确保其配准精度.为此,本文提出了一种基于目标关联的多源卫星遥感图像的兵营融合检测方法.该方法不对图像进行配准,而是根据单源图像的目标自动检测结果,利用图像的大地坐标信息,截取包含目标的同一地区的局部遥感图像,再分别提取多源遥感图像目标的特征,并根据其中冗余的特征,对提取的目标区域建立关联,再由关联检验确保特征关联的正确性,最后对目标特征进行融合决策,得到目标融合检测结果.实验结果表明,该方法能有效地利用多源遥感图像的信息,降低遥感图像目标检测的误判率,提高目标特征的准确度.     

基于小波纹理信息的星载SAR图像与TM图像的数据融合

遥感图像的数据融合是当前遥感界研究的热点问题之一。论述利用小波变换提取合成孔径雷达（SAR）图像的多尺度纹理信息，基于小波纹理信息将SAR图像与TM图像进行融合。选取徐州市南郊风景区的Radarsat卫星SAR图像和TM图像进行试验研究，并与颜色变换法融合图像进行对比分析，结果表明，无论是目视解译还是定量分析，该融合方法与颜色变换法相比，将获得更理想的高空间分辨率多光谱的融合图像。     

ALOS PALSAR and Hyperion Data Fusion for Land Use Land Cover Feature Extraction

Detailed and enhanced land use land cover (LULC) feature extraction is possible by merging the information extracted from two different sensors of different capability. In this study different pixel level image fusion algorithms (PCA, Brovey, Multiplicative, Wavelet and combination of PCA & IHS) are used for integrating the derived information like texture, roughness, polarization from microwave data and high spectral information from hyperspectral data. Span image which is total intensity image generated from Advanced Land observing Satellite-Phase array L-band SAR (ALOS-PALSAR) quad polarization data and EO-1 Hyperion data (242 spectral bands) were used for fusion. Overall PCA fused images had shown better result than other fusion techniques used in this study. However, Brovey fusion method was found good for differentiating urban features. Classification using support vector machines was conducted for classifying Hyperion, ALOS PALSAR and fused images. It was observed that overall classification accuracy and kappa coefficient with PCA fused images was relatively better than other fusion techniques as it was able to discriminate various LULC features more clearly.     

Estimating soil erosion using MODIS and TM images based on support vector machine and à trous wavelet

To date, there is little work concerning the application of fusing images with significantly different spectral and spatial resolutions. In this paper, a novel method based on support vector machine (SVM) is proposed to quickly estimate soil erosion using the fused results produced from fusing such multisensor images by à trous wavelet transform (AWT). In the proposed method, the AWT is used to derive the high-resolution vegetation coverage image (HVCI) while the SVM overlays the HVCI and the slope image to derive the soil erosion map. By taking MODIS and TM images as an example, the potential of the proposed method is evaluated both quantitatively and qualitatively. The results show that it is feasible to perform the fusion of MODIS and TM images and the soil erosion map produced from the fused images by the proposed method can be achieved with an accuracy level comparable to that solely from the TM images. The merging of MODIS and TM images partly solves the constrains associated with the TM data availability which is caused by the lower revisit frequency and narrower spatial coverage.     

The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna

Multi-sensor image fusion using the wavelet approach provides a conceptual framework for the improvement of the spatial resolution with minimal distortion of the spectral content of the source image. This paper assesses whether images with a large ratio of spatial resolution can be fused, and evaluates the potential of using such fused images for mapping the Brazilian Savanna. Three types of wavelet transforms were used to perform the fusion between MODIS and Landsat TM images. Five quality measures were defined to assess the quality of the fused images. The results showed that it was possible to perform the fusion of MODIS and TM images and the pyramidal in Fourier space wavelet transform provided the best quality measures for the fused images. Classification results showed that fused images could be used for mapping the Brazilian Savanna with an accuracy level comparable to the Landsat TM image.     

基于多时相SAR数据的大区域城镇信息变化检测

多时相SAR变化检测技术,通过分析同一区域不同时相的SAR数据可以检测地表地物目标的变化信息,在土地资源调查及监测管理方面具有广泛应用。本文将长时间SAR图像相干性特征与目标幅度信息进行融合,并采用多时相SAR数据堆栈处理方法进行大区域城建目标分类及变化信息检测。最后采用13景ALOS PALSAR数据对中国天津地区2007~2010年期间的城建区域变化进行了检测实验,得到了良好的实验结果,并验证方法有效性。     

SAR和TM图像主成分变换融合中不同主分量替换的比较

常用的主成分变换融合方法是将一种遥感图像数据代替主成分变换后的第一主成分并进行反变换,从而得到融合信息的方法。但是,信息量较高的第一主成分被替换,往往造成一定的信息损失。本文对TM2、TM3、TM4、TM5和TM7进行主成分变换,然后用RadarsatSAR影像分别替换各主成分,并对其进行反变换。研究表明,与替换第一主成分或原始图像相比,替换第四和第五主成分的结果在信息量上有很大提高,且信息增强,类别间分离度增大,分类精度提高。但是,替换第四、第五主成分的融合结果相差不大.     

基于亮度相关矩的MODIS和SPOT影像融合研究

针对MODIS影像空间分辨率较低的问题，提出了一种基于亮度相关矩的多分辨率图像融合方法。该方法首先对SPOT影像进行小波分解，将MODIS影像构成的RGB颜色系统变换到IHS颜色系统；然后，根据强度分量和SPOT影像低频分量的均值和方差来定义图像亮度相关矩；最后，IHS逆变换和小波逆变换得到包含更多信息和有效特征的融合图像。试验结果证明该方法得到的融合图像在保留地物光谱信息和提高空间分辨率上都具有很好的效果。     

Mapping impervious surfaces with the integrated use of Landsat Thematic Mapper and radar data: A case study in an urban–rural landscape in the Brazilian Amazon

This research explored the integrated use of Landsat Thematic Mapper (TM) and radar (i.e., ALOS PALSAR L-band and RADARSAT-2 C-band) data for mapping impervious surface distribution to examine the roles of radar data with different spatial resolutions and wavelengths. The wavelet-merging technique was used to merge TM and radar data to generate a new dataset. A constrained least-squares solution was used to unmix TM multispectral data and multisensor fusion images to four fraction images (high-albedo, low-albedo, vegetation, and soil). The impervious surface image was then extracted from the high-albedo and low-albedo fraction images. QuickBird imagery was used to develop an impervious surface image for use as reference data to evaluate the results from TM and fusion images. This research indicated that increasing spatial resolution by multisensor fusion improved spatial patterns of impervious surface distribution, but cannot significantly improve the statistical area accuracy. This research also indicated that the fusion image with 10-m spatial resolution was suitable for mapping impervious surface spatial distribution, but TM multispectral image with 30 m was too coarse in a complex urban–rural landscape. On the other hand, this research showed that no significant difference in improving impervious surface mapping performance by using either PALSAR L-band or RADARSAT C-band data with the same spatial resolution when they were used for multi-sensor fusion with the wavelet-based method.     

证据推理应用于多源信息融合分析

运用证据理论合并来自不同数据源的证据,以实现各种数据所含信息融合的原理和方法。该方法的最大特点是将数据源中存在的不确定性引入数据分析过程。另外,利用证据推理,可以在数据分析过程中方便地引入专家解译图解的经验和知识。最后通过利用ＥＲＳ ＳＡＲ数据和ＴＭ影像进行融合分析,证明该方法在遥感图解自动分类中有很好的应用前景。     

High altitude aircraft remote sensing during the 1988 Yellowstone national park wildfires

Abstract

The advancement of satellite remote sensing has offered greater potential for mapping volcanic deposits. Although the development of weather‐independent microwave remote sensing has made the frequent detection over large area detection of deposits using SAR intensity image is sometimes hindered by ambiguities and noise. The ambiguities occur in volcanic deposit areas covered by young vegetation and that give either high or low backscatter depending upon their orientation. For this reason coherent images were integrated with SAR intensity images to extract more reliable information about volcanic deposited area. Besides, the layover areas due to the viewing geometry of SAR make difficulties to map the volcanic deposits on every side of the mountain. To avoid the influence of layover effects fusion techniques of ascending and descending pass SAR intensity and coherent images were developed. Using the fused images with an optical image, a color composite was developed to identify the areas affected by an eruption. In this color composite, especially vegetation damages can be easily identified.     

利用分形和多尺度分析的中低分辨率SAR图像变化检测

对于合成孔径雷达(synthetic aperture radar,SAR)图像像素级变化检测,常见的对数比、交叉熵差异图在提取建筑物等人造目标的变化时不能保持其结构特征。本文将分形维数引入到差异图构造中,定义了分形-对数比(fractal dimension-log ratio, FD-LR)融合差异图,在有效提取不同地物类型变化的同时,能够保持其轮廓结构。为克服斑噪干扰,对FD-LR进行多尺度分析,通过贝叶斯分割和决策级融合提取变化信息。实验结果表明,该方法模型简单,能够有效检测不同地物类型的变化,在中低分辨率复杂场景的SAR图像变化检测中具有优势。     

A new approach for surface water change detection: Integration of pixel level image fusion and image classification techniques

Normally, to detect surface water changes, water features are extracted individually using multi-temporal satellite data, and then analyzed and compared to detect their changes. This study introduced a new approach for surface water change detection, which is based on integration of pixel level image fusion and image classification techniques. The proposed approach has the advantages of producing a pansharpened multispectral image, simultaneously highlighting the changed areas, as well as providing a high accuracy result. In doing so, various fusion techniques including Modified IHS, High Pass Filter, Gram Schmidt, and Wavelet-PC were investigated to merge the multi-temporal Landsat ETM+ 2000 and TM 2010 images to highlight the changes. The suitability of the resulting fused images for change detection was evaluated using edge detection, visual interpretation, and quantitative analysis methods. Subsequently, artificial neural network (ANN), support vector machine (SVM), and maximum likelihood (ML) classification techniques were applied to extract and map the highlighted changes. Furthermore, the applicability of the proposed approach for surface water change detection was evaluated in comparison with some common change detection methods including image differencing, principal components analysis, and post classification comparison. The results indicate that Lake Urmia lost about one third of its surface area in the period 2000–2010. The results illustrate the effectiveness of the proposed approach, especially Gram Schmidt-ANN and Gram Schmidt-SVM for surface water change detection.     

深度学习在光学和SAR影像融合研究进展

遥感影像融合作为影像处理领域中最具有挑战的工作,一直是学术界研究的热点。合成孔径雷达SAR(Synthetic Aperture Radar)具备全天时、全天候、穿透云雾等多种特点,却因存在相干斑噪声等问题,使得影像难以解译。相比之下,光学影像可以反映地物的光谱和空间信息,易于解译,但容易受到云雾干扰,造成信息丢失,将光学与SAR影像数据融合可以实现不同类型传感器成像之间的信息互补,能够更好地为后续的影像分析与解译提供方便。本文首先对光学和SAR影像融合进行了系统性回顾,包括传统融合方法和基于深度学习方法在影像融合方面的最新工作,重点阐述了卷积神经网络CNN (Convolutional Neural Network)、生成式对抗网络GAN (Generative Adversarial Networks)等框架在光学和SAR影像融合中的进展;然后总结了光学和SAR影像融合在深度学习领域开发的数据集,并做了简单介绍和说明;最后,从数据集、时间序列影像融合、融合评价体系和算法轻量化等4个方面对光学和SAR影像融合的未来发展趋势进行了展望。     

基于MRF信息融合的多通道SAR图像变化检测算法

SAR图像变化检测是近几年SAR图像应用研究的新领域,现有的SAR图像变化检测算法大多针对单通道图像数据,而利用多通道SAR图像数据进行变化检测,可以充分利用图像信息,能够得到更好的检测效果。论文研究了基于MRF信息融合的多通道SAR图像变化检测算法,通过融合图像不同通道信息,实现变化检测;并重点论述了算法的基本原理和算法实现过程,通过实验对比,证明了论文提出的算法可以得到较高的检测精度。     

SIFT-FANN: An efficient framework for spatio-spectral fusion of satellite images

Image fusion techniques are widely used for remote sensing data. A special application is for using low resolution multi-spectral image with high resolution panchromatic image to obtain an image having both spectral and spatial information. Alignment of images to be fused is a step prior to image fusion. This is achieved by registering the images. This paper proposes the methods involving Fast Approximate Nearest Neighbor (FANN) for automatic registration of satellite image (reference image) prior to fusion of low spatial resolution multi-spectral QuickBird satellite image (sensed image) with high spatial resolution panchromatic QuickBird satellite image. In the registration steps, Scale Invariant Feature Transform (SIFT) is used to extract key points from both images. The keypoints are then matched using the automatic tuning algorithm, namely, FANN. This algorithm automatically selects the most appropriate indexing algorithm for the dataset. The indexed features are then matched using approximate nearest neighbor. Further, Random Sample Consensus (RanSAC) is used for further filtering to obtain only the inliers and co-register the images. The images are then fused using Intensity Hue Saturation (IHS) transform based technique to obtain a high spatial resolution multi-spectral image. The results show that the quality of fused images obtained using this algorithm is computationally efficient.     

遥感影像时—空融合的“点”—“线”—“面”质量评价

遥感影像时—空融合可集成多源数据高空间分辨率和高时间分辨率互补优势,生成时间连续的高空间分辨率影像,在遥感影像的动态监测与时序分析等方面具有重要应用价值.然而,现有多数研究往往基于单一数据产品对时—空融合算法进行评价,而在实际生产应用中,需要验证算法在多种遥感产品数据的融合表现;此外,目前研究大多基于“单点时刻”进行评...     

A comparative data-fusion analysis of multi-sensor satellite images

Remote-sensing data play an important role in extracting information with the help of various sensors having different spectral, spatial and temporal resolutions. Therefore, data fusion, which merges images of different spatial and spectral resolutions, plays an important role in information extraction. This research investigates quality-assessment methods of multisensor (synthetic aperture radar [SAR] and optical) data fusion. In the analysis, three SAR data-sets from different sensors (RADARSAT-1, ALOS-PALSAR and ENVISAT-ASAR) and optical data from SPOT-2 were used. Although the PALSAR and the RADARSAT-1 images have the same resolutions and polarisations, images are gathered in different frequencies (L and C bands, respectively). The ASAR sensor also has C-band radar, but with lower (25 m) resolution. Since the frequency is a key factor for penetration depth, it is thought that the use of different SAR data might give interesting results as an output. This study describes a comparative study of multisensor fusion methods, namely the intensity-hue-saturation, Ehlers, and Brovey techniques, by using different statistical analysis techniques, namely the bias of mean, correlation coefficient, standard deviation difference and universal image quality index methods. The results reveal that Ehlers' method is superior to the others in terms of spectral and statistical fidelity.     

基于多进制小波变换的遥感影像融合

首先介绍了遥感影像融合的理论和方法 ,然后在讨论多进制小波理论的基础上 ,提出了一种基于特征的多进制小波变换的影像融合算法 ,该算法根据待融合影像分辨率之比确定采用多进制小波 ,从而最大限度的利用了待融合影像的信息 ,防止影像信息的丢失。通过对具体影像的实验 ,证明融合后的影像最大限度地保留了待融合影像的光谱信息 ,同时提高了待融合影像的清晰度和空间分辨率。文中给出了SPOT全色影像与SPOT多光谱波段影像、SPOT全色影像与TM影像的融合结果 ,并与其他方法进行了比较 ,证明了本方法的优越性和自适应能力