SPOT-7遥感图像融合技术对比研究

随着高分辨率影像研究的发展,影像融合成为遥感影像处理领域中一个重要的研究方向。目前对于影像的融合已有很多的方法,如IHS法、HPF法等。本文将以SPOT-7高分辨率影像作为研究对象,探讨经PCA法、Pansharpening法、Gram-Schmidt法、NNDiffuse法这4种融合方法,融合后的影像在保持地物的波谱特征,以及信息识别效果等多方面的各自优势,并通过定性和定量评价来确定适合SPOT-7高分辨率影像的融合方法,实验结果表明:NNDiffuse方法的融合结果最为理想。     

Fusion of IKONOS Satellite Imagery Using IHS Transform and Local Variation

The intensity-hue-saturation (IHS) technique is a well-known merging approach for its computational efficiency and spatial definition holding. However, it results in color distortion particularly for the remote sensing images of IKONOS and QuickBird as some other fusion methods, such as principal component analysis, and Brovey transform. Although wavelet-based image fusion approaches can provide a better tradeoff between spatial and spectral quality, the fused images with these methods often have a spatial resolution that is less than that of the IHS-based algorithm. A remote sensing image fusion algorithm based on IHS transform and local variation and its modified approach with low computational complexity are proposed. Visual effect and quantity evaluation results show that the proposed simple algorithm outperforms the conventional image fusion methods in the spectral domain with the spatial quality similar to that of the undecimated wavelet transform-based scheme. The proposed modified method can obtain the similar spatial resolution of the merged image with the IHS-based fusion algorithm and the better spectral quality in the green vegetation areas.      

SIFT-FANN: An efficient framework for spatio-spectral fusion of satellite images

Image fusion techniques are widely used for remote sensing data. A special application is for using low resolution multi-spectral image with high resolution panchromatic image to obtain an image having both spectral and spatial information. Alignment of images to be fused is a step prior to image fusion. This is achieved by registering the images. This paper proposes the methods involving Fast Approximate Nearest Neighbor (FANN) for automatic registration of satellite image (reference image) prior to fusion of low spatial resolution multi-spectral QuickBird satellite image (sensed image) with high spatial resolution panchromatic QuickBird satellite image. In the registration steps, Scale Invariant Feature Transform (SIFT) is used to extract key points from both images. The keypoints are then matched using the automatic tuning algorithm, namely, FANN. This algorithm automatically selects the most appropriate indexing algorithm for the dataset. The indexed features are then matched using approximate nearest neighbor. Further, Random Sample Consensus (RanSAC) is used for further filtering to obtain only the inliers and co-register the images. The images are then fused using Intensity Hue Saturation (IHS) transform based technique to obtain a high spatial resolution multi-spectral image. The results show that the quality of fused images obtained using this algorithm is computationally efficient.     

提高中巴卫星IR MSS图像空间分辨能力的光谱保真融合方法

介绍一种提高中巴资源卫星IRMSS图像空间分辨能力的光谱保真融合方法。通过计算低分辨率图像上每一个像元对应的高分辨率图像上一组子像元的平均亮度值及二者之差,将该差值与高分辨率图像上相应子像元亮度求和,形成新的图像。该图像具有高分辨率图像的空间细节,又具有低分辨率图像的光谱信息,从而实现融合图像信息保真。试验表明,光谱保真融合方法可以在不改变光谱信息的前提下提高IRMSS图像的空间分辨能力,是一种新的简单实用的数据处理方法。     

A new Pansharpening Approach Based on NonSubsampled Contourlet Transform Using Enhanced PCA Applied to SPOT and ALSAT-2A Satellite Images

The Pansharpening process aims to merge the high spatial resolution of the panchromatic (Pan) image with the spectral information of the multispectral (MS) images. The fused images should represent an enhanced spatial resolution and should preserve the spectral information simultaneously. In the two last decades, many pansharpening algorithms have been implemented in the literature such as IHS, PCA, HPF, etc. Therefore, in comparison with the various conventional methods, our contribution is the conception of a new fusion scheme by combining two different approaches: the Principal Component Analysis (PCA) and the NonSubsampled Contourlet Transform (NSCT). The hypothesis in this combination represent the use of PCA, in first, like statistical approach to obtain from the MS bands the main information, followed by the NSCT as a robust multiresolution and multidirectional approach, to give an optimal representation of the characteristics in the image compared to the classical methods (wavelets), in order to overcome the drawback caused by PCA with the spectral distortion. The focus of this study is to show a new way to combine differently from usual those two approaches, to find a compromise between enhancing the spatial resolution and preserving the spectral information at the same time. The quality of the resulted images has been evaluated by the visual interpretation and the statistical assessment to prove its efficiency compared to other conventional methods.     

Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique

The fusion of multispectral (MS) and panchromatic (PAN) images is a useful technique for enhancing the spatial quality of low-resolution MS images. Liu recently proposed the smoothing-filter-based intensity modulation (SFIM) fusion technique. This technique upscales MS images using bicubic interpolation and introduces high-frequency information of the PAN image into the MS images. However, this fusion technique is plagued by blurred edges if the upscaled MS images are not accurately coregistered with the PAN image. In the first part of this letter, we propose the use of the Induction scaling technique instead of bicubic interpolation to obtain sharper, better correlated, and hence better coregistered upscaled images. In the second part, we propose a new fusion technique derived from induction, which is named ldquoIndusion.rdquo In this method, the high-frequency content of the PAN image is extracted using a pair of upscaling and downscaling filters. It is then added to an upscaled MS image. Finally, a comparison of SFIM (with both bicubic interpolation and induction scaling) is presented along with the fusion results obtained by IHS, discrete wavelet transform, and the proposed Indusion techniques using Quickbird satellite images.     

Spectral and Spatial Quality Analysis in Pan Sharpening Process

Image fusion is a process to obtain new images containing more information by combining images obtained same or different sensors. With most of the earth observation satellites, high spatial resolution panchromatic images and low spatial resolution multispectral images are obtained. As an example of image fusion ??pan sharpening?? is a process of combining of high spatial resolution panchromatic images and low spatial resolution multispectral images. At the end of the fusion process both high spatial and spectral resolution new images are obtained. In this study, panchromatic and multispectral images gathered from Ikonos were used. Panchromatic and multispectral images belonging to the same sensor were combined by using different image fusion methods. As pan sharpening methods Brovey transform, Modified IHS, Principal Component Analysis (PCA), Wavelet PC transform and Wavelet A Trous transformation methods were used. Quality of fused products was evaluated from the point of view of both visual and statistical criteria. While wavelet based methods are succesfull in terms of protection of spectral quality of original multispectral images, the colorbased and statistical methods are giving better results within the improvement of spatial content.     

遥感高时空融合方法的研究进展及应用现状

针对遥感图像的"时空矛盾",评述了当前解决这一问题最主要的方法即遥感时空信息融合的方法,包括基于变化模型的融合、基于重建模型的融合以及基于学习模型的融合。通过分析各个模型的研究现状,指出了每种模型方法的优劣,特别重点介绍了影响较大的自适应时空融合方法的理论以及对其的改进算法。同时本文总结了当前时空融合模型在长时间序列模拟以及大区域数据集生成等方面的实际应用的效果,以及分析了影响时空融合结果的主要因素。最后基于这些问题和影响因素提出了今后时空融合模型发展的目标和方向。     

Assessing Optimal Image Fusion Methods for Very High Spatial Resolution Satellite Images to Support Coastal Monitoring

This study examines best image fusion approaches for generating pansharpened very high resolution (VHR) multispectral images to be utilized for monitoring coastal barrier island development. Selected fusion techniques assessed in this research come from the three categories of spectral substitution (e.g., Brovey transform and multiplicative merging), arithmetic merging (e.g., modified intensity-hue-saturation and principal component analysis), and spatial domain (e.g., high-pass filter, and subtractive resolution merge). The image fusion methods selected for this study were capable of producing pansharpened VHR images with more than three bands. Comparisons of fusion techniques were applied to images from three satellite sensors: United States commercial satellites IKONOS and QuickBird, and the Korean KOMPSAT II. Pansharpened VHR multispectral images were assessed by spectral and spatial quality measurements. Results satisfying both spectral and spatial quality revealed optimum pansharpened techniques necessary for regular coastal mapping of barrier islands. These techniques may also be used to assess the quality of recently available VHR imagery acquired by numerous international, government, and commercial VHR satellite programs.     

联合IHS 变换和MAP 估计的遥感图像融合

为了提高多光谱图像和全色图像的融合质量, 提出一种基于推广的IHS(Generalized Intensity-Hue-Saturation, GIHS)变换与最大后验概率MAP(Maximum a Posteriori)相结合的遥感图像融合算法。该算法首先经过GIHS 变换, 由多光谱图像得到强度分量; 其次针对强度分量和全色图像, 通过MAP 构建高分辨率图像的成像模型, 采用最速下 降优化算法得到富含光谱信息的高分辨率全色图像; 进而依据GIHS 变换得到融合图像。实验中分别以IKONOS 卫 星、Quickbird 卫星的多光谱图像和全色图像为例, 进行融合算法验证, 并与GIHS 融合算法、传统的小波变换融合 算法、小波变换结合IHS 变换的融合算法等进行比较分析, 实验表明, 新的融合方法具有更好的融合效果。     

基于Shearlet变换的SAR与多光谱遥感影像融合

针对合成孔径雷达（SAR）影像和多光谱遥感影像在融合时空间特征和光谱特征方面不能同时得到较大改善的问题,提出了一种基于成像特性的Shearlet变换域下的多源遥感影像融合方法。利用Shearlet变换的多方向和多尺度分解特性,将多光谱影像和SAR影像分别分解为高频和低频系数,从影像区域能量特征和区域相关性入手,设计了基于区域能量的低频系数融合规则和改进型的脉冲耦合神经网络的高频系数融合规则,使融合结果能够包含更多空间细节信息和光谱信息。利用TerraSAR-X、Landsat5-TM影像进行实验,结果表明该方法在提高影像空间细节表达能力的同时能够较好地融合更多的光谱信息。与小波变换、非下采样轮廓波变换（Nonsubsampled contourlet Transform,NSCT）等方法相比,该方法在空间信息保有量和光谱信息保有量方面都有明显的提升,其中交叉熵有接近100%的提升幅度,互相关系数有高于25%的提升幅度,光谱扭曲度有优于40%的提升幅度。     

The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna

Multi-sensor image fusion using the wavelet approach provides a conceptual framework for the improvement of the spatial resolution with minimal distortion of the spectral content of the source image. This paper assesses whether images with a large ratio of spatial resolution can be fused, and evaluates the potential of using such fused images for mapping the Brazilian Savanna. Three types of wavelet transforms were used to perform the fusion between MODIS and Landsat TM images. Five quality measures were defined to assess the quality of the fused images. The results showed that it was possible to perform the fusion of MODIS and TM images and the pyramidal in Fourier space wavelet transform provided the best quality measures for the fused images. Classification results showed that fused images could be used for mapping the Brazilian Savanna with an accuracy level comparable to the Landsat TM image.     

多源高分辨率遥感影像智能融合

本文面向多源高分辨率遥感影像自动化融合的应用需求,探索按需应用的智能化融合方法,充分利用不同分辨率和不同时相的高分辨率多源遥感影像数据资源与特性,研究了影像融合数据源选取的决策树算法,建立了遥感影像融合规则知识库,并自动化选取适合的融合算法,提出了Curvelet_HCS算法,对低频和高频系数选用不同的融合规则,改善了HCS算法的光谱失真问题,可同时融合多光谱影像的多个谱段,并保持更丰富的空间细节信息。根据融合评价结果对遥感影像融合规则知识库进行更新,实验验证表明了该套方法的有效性,为开展大规模智能化的多源遥感影像融合应用提供了重要的方法和技术支撑。     

ISVR: an improved synthetic variable ratio method for image fusion

An Improved Synthetic Variable Ratio (ISVR) fusion method is proposed to merge high spatial resolution panchromatic (Pan) images and multispectral (MS) images based on a simulation of the panchromatic image from the multispectral bands. Compared to the existing SVR (Synthetic Variable Ratio) family methods, the ISVR method manifests two major improvements: a simplified and physically meaningful scheme to derive the parameters necessary as required by SVR, and less computing power. Two sets of IKONOS Pan and MS images: one in urban area and another one in a forest area, were used to evaluate the effectiveness of classification-oriented ISVR method in comparison to the Principal Component Substitution (PCS), Synthetic Variable Ratio (SVR) and Gram-Schmidt Spectral Sharpening (GS) methods that are available in the ENVI software package. Results indicate the ISVR method achieves the best spectral fidelity to facilitate classification compared to PCS, SVR, and GS methods.     

Remote Sensing Image Fusion Based on Nonlinear IHS and Fast Nonsubsampled Contourlet Transform

The purpose of remote sensing image fusion is to inject the detail image extracted from the panchromatic (PAN) image into the low spatial resolution multispectral (MS) image. A novel remote sensing image fusion method based on fast nonsubsampled contourlet transform (FNSCT) and Nonlinear intensity-hue-saturation (IHS) is presented in this paper. Firstly, the Nonlinear IHS transform is performed on the multispectral image, and then the I-component representing the spatial resolution and the panchromatic image is transformed by NSCT to obtain the low frequency and high frequency. Finally, the coefficients are selected using the improved sum-modified-Laplacian (SML) method and the improved Log-Gabor filter in the low frequency and the high frequency, respectively. Experimental results show that the proposed method is the most advanced fusion method in subjective and objective evaluation, can provide more spatial information, and retain more spectral information compared with several other methods.     

基于PCA+àstrous小波融合方法

针对PCA变换融合影像存在较严重的光谱失真现象,以及àstrous小波融合影像保真度高,而空间分辨率相对低的情况,本文提出一种基于PCA+àstrous小波融合算法。新方法首先对将多波段图像经PCA变换至各不相关的成分,而后对高分辨率图像与低分辨率图像主成分按照特定融合规则进行融合处理,并使用该融合后的第一主成份分量来替代高分辨率图像与低分辨率图像进行àstrous小波融合,即PCA变换与àstrous小波变换相结合的融合处理方法。主观视觉分析和客观参数表明,新方法不仅很好的保留了影像的光谱信息,而且兼顾了地物细节能力的表达。     

单样本对卷积神经网络遥感图像时空融合

遥感图像时空融合是一种生成兼具高时空分辨率的合成遥感数据的技术。近年来,产生了一些基于卷积神经网络的时空融合方法。这些方法效果良好,但需要较多的图像样本对训练模型,限制了它们的应用。针对此问题,本文提出了一种单样本对卷积神经网络时空融合方法（SS-CNN）。该方法以高空间分辨率图像的波段平均图像提供的空间信息激励卷积神经网络建立高、低空间分辨率图像间的超分关系,进而利用该超分关系映射求解目标高空间分辨率图像。在实验中使用两个模拟数据集和一个真实数据集对该方法进行了测试,并与两种常用的时空融合方法做了比较。实验结果表明,SS-CNN在单样本对训练的情况下,可以较好地预测地物的物候变化和类型的变化,且在异质性高、地块破碎的区域表现良好。其不足之处在于会在地物边界上会造成轻微的模糊,将来需针对此问题做进一步改进。     

A GIHS-based spectral preservation fusion method for remote sensing images using edge restored spectral modulation

High spatial resolution and spectral fidelity are basic standards for evaluating an image fusion algorithm. Numerous fusion methods for remote sensing images have been developed. Some of these methods are based on the intensity–hue–saturation (IHS) transform and the generalized IHS (GIHS), which may cause serious spectral distortion. Spectral distortion in the GIHS is proven to result from changes in saturation during fusion. Therefore, reducing such changes can achieve high spectral fidelity. A GIHS-based spectral preservation fusion method that can theoretically reduce spectral distortion is proposed in this study. The proposed algorithm consists of two steps. The first step is spectral modulation (SM), which uses the Gaussian function to extract spatial details and conduct SM of multispectral (MS) images. This method yields a desirable visual effect without requiring histogram matching between the panchromatic image and the intensity of the MS image. The second step uses the Gaussian convolution function to restore lost edge details during SM. The proposed method is proven effective and shown to provide better results compared with other GIHS-based methods.     

Spectral unmixing based spatiotemporal downscaling fusion approach

Time-series remote sensing data are important in monitoring land surface dynamics. Due to technical limitations, satellite sensors have a trade-off between temporal, spatial and spectral resolutions when acquiring remote sensing images. In order to obtain remote sensing images with high spatial resolution and high temporal frequency, spatiotemporal fusion methods have been developed. In this paper, we propose a Linear Spectral Unmixing-based Spatiotemporal Data Fusion Model (LSUSDFM) for spatial and temporal data fusion. In this model, the endmember abundance of the low-resolution image pixel is calculated based on that of the high-resolution image by the spectral mixture analysis. The endmember spectrum signals of low-resolution images are then calculated continuously within an optimized moving window. Subsequently, the fused image is reconstructed according to the endmember spectrum and its corresponding abundance map. A simulated dataset and real satellite images are used to test the fusion model, and the fusion results are compared with a current spectral unmixing based downscaling fusion model (SUDFM). Our experimental work shows that, compared to the SUDFM, the proposed LSUSDFM can achieve better quality and accuracy of fused images, especially in effectively eliminating the “plaque” phenomenon in the results by the SUDFM. The LSUSDFM has great potential in generating images with both high spatial resolution and high temporal frequency, as well as increasing the number of spectral bands of the high spatial resolution data.     

FFT-enhanced IHS transform method for fusing high-resolution satellite images

Existing image fusion techniques such as the intensity–hue–saturation (IHS) transform and principal components analysis (PCA) methods may not be optimal for fusing the new generation commercial high-resolution satellite images such as Ikonos and QuickBird. One problem is color distortion in the fused image, which causes visual changes as well as spectral differences between the original and fused images. In this paper, a fast Fourier transform (FFT)-enhanced IHS method is developed for fusing new generation high-resolution satellite images. This method combines a standard IHS transform with FFT filtering of both the panchromatic image and the intensity component of the original multispectral image. Ikonos and QuickBird data are used to assess the FFT-enhanced IHS transform method. Experimental results indicate that the FFT-enhanced IHS transform method may improve upon the standard IHS transform and the PCA methods in preserving spectral and spatial information.