Multiresolution and Multispectral Data Fusion Using Discrete Wavelet Transform with IRS Images: Cartosat-1, IRS LISS III and LISS IV

Image fusion techniques integrate complimentary information from multiple image sensor data such that the new images are more suitable for the purpose of human visual perception and computer based processing tasks for extraction of detail information. As an important part of image fusion algorithms, pixel-level image fusion can combine spectral information of coarse resolution imagery with finer spatial resolution imagery. Ideally, the method used to merge data sets with high-spatial and highspectral resolution should not distort the spectral characteristics of the high-spectral resolution data. This paper describes the Discrete Wavelet Transform (DWT) algorithm for the fusion of two images using different spectral transform methods and nearest neighbor resampling techniques. This research paper investigates the performance of fused image with high spatial resolution Cartosat-1(PAN) with LISS IV and Cartosat-1(PAN) sensor images with the LISS III sensor image of Indian Remote Sensing satellites. The visual and statistical analysis of fused images has shown that the DWT method outperforms in terms of Geometric, Radiometric, and Spectral fidelity.     

快速离散Curvelet变换和IHS变换集成的遥感影像融合方法

本文提出一种快速离散Curvelet变换(FDCT)和IHS变换集成的遥感影像融合方法,可获得较传统方法更高质量的融合影像。在融合过程中,通过FDCT获取I分量的多尺度多方向系数集合,采用标准差加权的融合策略,自适应地调整空间细节与光谱信息的权重,从而达到最佳融合空间细节与光谱信息的效果。作者选择QuickBird和WorldView-2全色和多光谱影像进行融合实验,并与基于传统IHS、FDCT的方法进行了比较,采用两种评价模型,选择偏差指数、UIQI等质量指标进行客观量化评价,验证了本文方法的优越性。     

Landslide inventory using image fusion techniques in Brazil

The present work aims to assess the accuracy of six fusion techniques (Brovey, IHS, HSV, PCA, WTYO and WTVE) in order to compile landslide inventories using orbital images (ETM+ and PAN HRV). The study area is characterized by steep terrain and dense forest in Caraguatatuba, São Paulo State, Brazil. In terms of spatial quality, the Wavelet Transform technique provided the best results, presenting correlations above 90%. As for spectral quality, the best results were obtained with the IHS fusion. Based on the results, it may be concluded that the IHS is the best technique for preserving spatial and spectral information from the original images, so as to more clearly identify landslide scars. However, it was still not possible to typify the landslides from remote sensing data. Nonetheless, it is believed that image fusion techniques adequately met expectations in terms of their capacity to identify landslide for the creation of an inventory for the studied area.     

多卫星传感器数据的Brovey融合改进方法

提出一种针对当前不同卫星传感器数据融合的新方法。该方法基于Brovey融合方法的思想,充分考虑了不同卫星传感器全色影像与多光谱影像的光谱范围差异以及光谱响应差异,通过公式推导建立了基于权重系数β和比例系数w两个因子的全色影像与多光谱影像的关系式,并根据这两个因子重新构建了Brovey融合过程中的乘积系数。改进后的方法有效地改善了传统Brovey融合方法的光谱畸变问题。将上述方法应用于北京1号、SPOT 4/5、Landsat5(TM)以及环境一号卫星数据之间的4例融合实验中,并与Brovey融合、Modified IHS融合方法进行定性和定量评价,结果表明其综合性能优于其他方法,在细节融入度高的基础上,仍能保持良好的光谱信息,而且保留了Brovey融合快速的优点,易于推广和应用。     

Multiresolution fusion of remote sensing images based on resolution degradation model

A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images. Some ETM panchromatic and multispectral images are used to assess the new method. Its spatial and spectral effects are evaluated by qualitative and quantitative measures and the results are compared with those of IHS, PCA, Brovey, OWT(Orthogonal Wavelet Transform) and RWT (Redundant Wavelet Transform). The results show that the new method can keep almost the same spatial resolution as the panchromatic images, and the spectral effect of the new method is as good as those of waveletbased methods.     

ALOS数据像素级融合方法比较研究

遥感数据融合是多源遥感海量数据富集表示的有效途径。如何在提高融合影像空间分辨率的同时最大限度地保持光谱信息是长期以来遥感数据融合研究的焦点内容。本文以ALOS PRISM和ALOS AVNIR-2传感器的数据为数据源,比较研究了遥感领域中常用和代表性的BROVEY、IHS、MULTIPLICATIVE、PCA、WAVELET和HPF六种融合方法,并通过主观评价和定量分析对融合效果进行了综合评价。实验结果表明,HPF方法在显著提高融合影像空间分辨率的同时,有效保持了多光谱影像的光谱信息,是适合ALOS数据的最优融合方法。     

Fusion of RADARSAT-2 and multispectral optical remote sensing data for LULC extraction in a tropical agricultural area

In this study, we investigated the performance of different fusion and classification techniques for land cover mapping in Hilir Perak, Peninsula Malaysia using RADAR and Landsat-8 images in a predominantly agricultural area. The fusion methods used are Brovey Transform, Wavelet Transform, Ehlers and Layer Stacking and their results classified into seven different land cover classes which include (1) pixel-based classifiers (spectral angle mapper (SAM), maximum likelihood (ML), support vector machine (SVM)) and (2) Object-based (rule-based and standard nearest neighbour (NN)) classifiers. The result shows that pixel-based classification achieved maximum accuracy of the optical data classification using SVM in Landsat-8 with 74.96% accuracy compared to SAM and ML. For multisource data classification, the highest overall accuracy recorded for layer stacking (SVM) was 79.78%, Ehlers fusion (SVM) with 45.57%, Brovey fusion (SVM) with 63.70% and Wavelet fusion (SVM) 61.16%. And for object-based classifiers, the overall classification accuracy is 95.35% for rule-based and 76.33% for NN classifier, respectively. Based on the analysis of their performances, object-based and the rule-based classifiers produced the best classification accuracy from the fused images.     

Landsat7 ETM＋影像的融合和自动分类研究

利用SFIM、MLT、HPF和修改的Brovey(MB)等遥感影像融合算法对Landsat 7 ETM 影像进行融合和自动分类研究，并就融合影像的光谱保真度、高频空间信息融人度和分类精度对这些方法进行评价。结果表明SFIM变换几乎完全保持了原始影像的光谱特点，并具有最高的平均分类精度；MB变换具有最高的高频空间信息融人度；MLT变换也具有较高的分类精度；只有HPF变换的各项指标都不突出。所有4种融合影像的分类精度都较原始影像的分类精度有明显的提高。这表明，源于同一传感器系统的不同分辨率影像的融合可以避免异源传感器融合影像所常见的各种参数、时相和配准误差，所以能够明显地提高影像的自动分类精度。     

Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique

The fusion of multispectral (MS) and panchromatic (PAN) images is a useful technique for enhancing the spatial quality of low-resolution MS images. Liu recently proposed the smoothing-filter-based intensity modulation (SFIM) fusion technique. This technique upscales MS images using bicubic interpolation and introduces high-frequency information of the PAN image into the MS images. However, this fusion technique is plagued by blurred edges if the upscaled MS images are not accurately coregistered with the PAN image. In the first part of this letter, we propose the use of the Induction scaling technique instead of bicubic interpolation to obtain sharper, better correlated, and hence better coregistered upscaled images. In the second part, we propose a new fusion technique derived from induction, which is named ldquoIndusion.rdquo In this method, the high-frequency content of the PAN image is extracted using a pair of upscaling and downscaling filters. It is then added to an upscaled MS image. Finally, a comparison of SFIM (with both bicubic interpolation and induction scaling) is presented along with the fusion results obtained by IHS, discrete wavelet transform, and the proposed Indusion techniques using Quickbird satellite images.     

Comparison of Pixel and Object Oriented Based Classification of Hyperspectral Pansharpened Images

In this paper pixel-based and object-oriented classifications were investigated for land-cover mapping in an urban area. Since the image fusion methods are playing a useful role in supplying classification different fusion approaches such as Gram-Schmidt Transform (GS), Principal Component Transform (PC), Haar wavelet, and À Trous Wavelet Transform (ATWT) algorithms have been used and the fused image with the best quality has been assessed on its respected classification. A Hyperion image and IRS-PAN image covering a region near Tehran, Iran have been used to demonstrate the enhancement and accuracy assessment of fused image over the initial images. The evaluation results of fused images showed that the Haar wavelet approach has good quality in preserving spectral information as well as spatial information. Classification results were compared to evaluate the effectiveness of the two classification approaches. Result of the pan-sharpened image classifications displayed that the object-oriented procedure presented more accurate outcomes (90.47 %) than those obtained by pixel-based classification method (77.33 %).     

基于IHS变换的最优树分解在遥感图像融合中的应用

探讨了遥感多光谱与全色波段图像的融合问题，分析了基于IHS变换的小波包变换分解的遥感图像融合方法，提出了基于最优树分解的融合方法。此方法首先将多光谱图像进行IHS变换，然后对I分量和全色图像进行小波包分解和最优树分解，再进行融合，最后进行IHS 逆变换得到融合图像。此方法不仅得到较好的图像主观视觉效果，而且兼顾了客观上熵最大的原则。     

Improved Image Pansharpening Technique using Nonsubsampled Contourlet Transform with Sparse Representation

Multispectral (MS) and panchromatic (PAN) images contains complementary information. High spatial and spectral resolution is a prerequisite for images to be useful, which can be achieved through image pansharpening. In this paper, we propose a new pansharpening technique which is a combination of nonsubsampled contourlet transform (NSCT) and sparse representation (SR), called NSCT–SR. NSCT is a shift-invariant version of the contourlet transform which combines nonsubsampled pyramid (NSP) and the directional filter banks. NSP splits input MS and PAN images into low-pass and high-pass sub-bands. Fusion of high-pass sub-bands is done using local energy information while low-pass sub-bands are fused using SR. Finally, fused low-pass and high-pass sub-bands are combined to obtain image with high spatial and high spectral resolution. We have quantitatively compared NSCT–SR with other multiresolution algorithms by calculating spatial and spectral quality parameters. It is observed that spatial quality is improved by 0.93 % (for seaside image) and 1.54 % (for urban image). While spectral quality is improved maximum up to 31.39 and 40.47 %, for respective images. NSCT–SR also compared with other state-of-art algorithms by calculating various performance parameters including quality with no reference. It is found that, overall; NSCT–SR performs better compared to algorithms considered in work.     

密集卷积残差网络的遥感图像融合

针对传统的遥感图像融合方法通常会引起光谱失真的问题和大多数基于深度学习的融合方法忽略充分利用每个卷积层信息的不足,本文结合密集连接卷积网络和残差网络的特性,提出了一个新的融合网络。该网络通过建立多个密集卷积块来充分利用卷积层的分级特征,同时块与块之间通过过渡层加快信息流动,从而最大程度地对特征进行极致利用并提取到丰富的特征。该网络应用残差学习拟合深层特征与浅层特征之间的残差,加快网络的收敛速度。实验中利用GaoFen-1（GF-1）和WorldView-2/3（WV-2/3）的多光谱图像MS （Multispectral Image）和全色图像PAN（Panchromatic Image）（MS与PAN的空间分辨率之比为4）评估本文提出方法的有效性。从视觉效果和定量评估结果两个方面来看,本文方法得到的融合结果要优于所对比的传统方法和深度学习方法,并且该网络具有鲁棒性,能够泛化到不需要预训练的其他卫星图像。本文方法通过特征的重复利用实现了光谱信息的高保真并提高了空间细节分辨能力,有利于遥感图像的应用研究。     

Spectral and Spatial Quality Analysis in Pan Sharpening Process

Image fusion is a process to obtain new images containing more information by combining images obtained same or different sensors. With most of the earth observation satellites, high spatial resolution panchromatic images and low spatial resolution multispectral images are obtained. As an example of image fusion ??pan sharpening?? is a process of combining of high spatial resolution panchromatic images and low spatial resolution multispectral images. At the end of the fusion process both high spatial and spectral resolution new images are obtained. In this study, panchromatic and multispectral images gathered from Ikonos were used. Panchromatic and multispectral images belonging to the same sensor were combined by using different image fusion methods. As pan sharpening methods Brovey transform, Modified IHS, Principal Component Analysis (PCA), Wavelet PC transform and Wavelet A Trous transformation methods were used. Quality of fused products was evaluated from the point of view of both visual and statistical criteria. While wavelet based methods are succesfull in terms of protection of spectral quality of original multispectral images, the colorbased and statistical methods are giving better results within the improvement of spatial content.     

A new Pansharpening Approach Based on NonSubsampled Contourlet Transform Using Enhanced PCA Applied to SPOT and ALSAT-2A Satellite Images

The Pansharpening process aims to merge the high spatial resolution of the panchromatic (Pan) image with the spectral information of the multispectral (MS) images. The fused images should represent an enhanced spatial resolution and should preserve the spectral information simultaneously. In the two last decades, many pansharpening algorithms have been implemented in the literature such as IHS, PCA, HPF, etc. Therefore, in comparison with the various conventional methods, our contribution is the conception of a new fusion scheme by combining two different approaches: the Principal Component Analysis (PCA) and the NonSubsampled Contourlet Transform (NSCT). The hypothesis in this combination represent the use of PCA, in first, like statistical approach to obtain from the MS bands the main information, followed by the NSCT as a robust multiresolution and multidirectional approach, to give an optimal representation of the characteristics in the image compared to the classical methods (wavelets), in order to overcome the drawback caused by PCA with the spectral distortion. The focus of this study is to show a new way to combine differently from usual those two approaches, to find a compromise between enhancing the spatial resolution and preserving the spectral information at the same time. The quality of the resulted images has been evaluated by the visual interpretation and the statistical assessment to prove its efficiency compared to other conventional methods.     

A novel image-fusion method based on the un-mixing of mixed MS sub-pixels regarding high-resolution DSM

A major reason for the spectral distortions of fused images generated by current image-fusion methods is that the fused versions of mixed multispectral (MS) sub-pixels (MSPs) corresponding to panchromatic (PAN) pure pixels remain mixed. The MSPs can be un-mixed spectrally to pure pixels having the same land cover classes in a fine classification map during the fusion process. Since it is difficult to produce such a land cover classification map using only MS and PAN images, a Digital Surface Model (DSM) derived from airborne Light Detection And Ranging data were employed in this study to facilitate the classification. In a novel fusion method proposed in this paper, MSPs near and across boundaries between vegetation and non-vegetation are identified using MS, PAN, and normalized Digital Surface Model (nDSM). The identified MSPs then are fused to pure pixels with respect to the corresponding land cover class in the classification map. In a test on WorldView-2 images over an urban area and the corresponding nDSM, the fused image generated by the proposed method was visually and quantitatively compared with fused images obtained using common image-fusion methods. The fused images generated by the proposed method yielded minimal spectral distortions and sharpened boundaries between vegetation and non-vegetation.     

不同遥感影像融合方法在地理国情普查中的应用对比研究——以海南北部地区为例

利用比值变换融合、高通滤波融合、改进IHS融合、小波变换融合和基于主分量变换等图像融合方法对IKONOS多光谱影像和IKONOS全色影像进行融合,结合地理国情普查的地表覆盖类型,对比融合后影像的特点,并分析评价对比结果,为地理国情普查工作选用合适的融合方法生成效果较好、地物清晰的遥感底图,从而为提高解译效率提供参考依据。     

ALOS PALSAR and Hyperion Data Fusion for Land Use Land Cover Feature Extraction

Detailed and enhanced land use land cover (LULC) feature extraction is possible by merging the information extracted from two different sensors of different capability. In this study different pixel level image fusion algorithms (PCA, Brovey, Multiplicative, Wavelet and combination of PCA & IHS) are used for integrating the derived information like texture, roughness, polarization from microwave data and high spectral information from hyperspectral data. Span image which is total intensity image generated from Advanced Land observing Satellite-Phase array L-band SAR (ALOS-PALSAR) quad polarization data and EO-1 Hyperion data (242 spectral bands) were used for fusion. Overall PCA fused images had shown better result than other fusion techniques used in this study. However, Brovey fusion method was found good for differentiating urban features. Classification using support vector machines was conducted for classifying Hyperion, ALOS PALSAR and fused images. It was observed that overall classification accuracy and kappa coefficient with PCA fused images was relatively better than other fusion techniques as it was able to discriminate various LULC features more clearly.     

城市绿地信息提取中高分辨率卫星影像融合方法研究

利用GS变换、主成分分析、Ehlers变换、Wavelet分析、HIS变换5种方法对城区WorldView-2和PL-1A影像进行融合,并从影像融合质量和绿地信息提取精度两方面对融合方法的有效性进行了评价。结果表明：①5种融合方法中,GS变换融合的效果最好;主成分分析和Ehlers变换融合WorldView-2质量较好,但融合PL-1A影像质量较差;Wavelet变换、HIS变换融合两种影像质量都较差;②用于绿地信息提取时,GS、PCA融合影像获取的精度最高,其次为Ehlers、Wavelet融合影像,均明显高于多光谱影像的提取精度;Ehlers、Wavelet变换精度最低,绿地信息提取精度低于多光谱影像的提取精度。可以得出,影像融合可以明显地提高绿地信息提取精度,5种影像融合方法中,GS变换普适性较好,影像融合质量最好,提高分类精度效果最明显。     

A GIHS-based spectral preservation fusion method for remote sensing images using edge restored spectral modulation

High spatial resolution and spectral fidelity are basic standards for evaluating an image fusion algorithm. Numerous fusion methods for remote sensing images have been developed. Some of these methods are based on the intensity–hue–saturation (IHS) transform and the generalized IHS (GIHS), which may cause serious spectral distortion. Spectral distortion in the GIHS is proven to result from changes in saturation during fusion. Therefore, reducing such changes can achieve high spectral fidelity. A GIHS-based spectral preservation fusion method that can theoretically reduce spectral distortion is proposed in this study. The proposed algorithm consists of two steps. The first step is spectral modulation (SM), which uses the Gaussian function to extract spatial details and conduct SM of multispectral (MS) images. This method yields a desirable visual effect without requiring histogram matching between the panchromatic image and the intensity of the MS image. The second step uses the Gaussian convolution function to restore lost edge details during SM. The proposed method is proven effective and shown to provide better results compared with other GIHS-based methods.