Spectral and Spatial Quality Analysis in Pan Sharpening Process

Image fusion is a process to obtain new images containing more information by combining images obtained same or different sensors. With most of the earth observation satellites, high spatial resolution panchromatic images and low spatial resolution multispectral images are obtained. As an example of image fusion ??pan sharpening?? is a process of combining of high spatial resolution panchromatic images and low spatial resolution multispectral images. At the end of the fusion process both high spatial and spectral resolution new images are obtained. In this study, panchromatic and multispectral images gathered from Ikonos were used. Panchromatic and multispectral images belonging to the same sensor were combined by using different image fusion methods. As pan sharpening methods Brovey transform, Modified IHS, Principal Component Analysis (PCA), Wavelet PC transform and Wavelet A Trous transformation methods were used. Quality of fused products was evaluated from the point of view of both visual and statistical criteria. While wavelet based methods are succesfull in terms of protection of spectral quality of original multispectral images, the colorbased and statistical methods are giving better results within the improvement of spatial content.     

SIFT-FANN: An efficient framework for spatio-spectral fusion of satellite images

Image fusion techniques are widely used for remote sensing data. A special application is for using low resolution multi-spectral image with high resolution panchromatic image to obtain an image having both spectral and spatial information. Alignment of images to be fused is a step prior to image fusion. This is achieved by registering the images. This paper proposes the methods involving Fast Approximate Nearest Neighbor (FANN) for automatic registration of satellite image (reference image) prior to fusion of low spatial resolution multi-spectral QuickBird satellite image (sensed image) with high spatial resolution panchromatic QuickBird satellite image. In the registration steps, Scale Invariant Feature Transform (SIFT) is used to extract key points from both images. The keypoints are then matched using the automatic tuning algorithm, namely, FANN. This algorithm automatically selects the most appropriate indexing algorithm for the dataset. The indexed features are then matched using approximate nearest neighbor. Further, Random Sample Consensus (RanSAC) is used for further filtering to obtain only the inliers and co-register the images. The images are then fused using Intensity Hue Saturation (IHS) transform based technique to obtain a high spatial resolution multi-spectral image. The results show that the quality of fused images obtained using this algorithm is computationally efficient.     

SPOT-7遥感图像融合技术对比研究

随着高分辨率影像研究的发展,影像融合成为遥感影像处理领域中一个重要的研究方向。目前对于影像的融合已有很多的方法,如IHS法、HPF法等。本文将以SPOT-7高分辨率影像作为研究对象,探讨经PCA法、Pansharpening法、Gram-Schmidt法、NNDiffuse法这4种融合方法,融合后的影像在保持地物的波谱特征,以及信息识别效果等多方面的各自优势,并通过定性和定量评价来确定适合SPOT-7高分辨率影像的融合方法,实验结果表明:NNDiffuse方法的融合结果最为理想。     

Fusion of IKONOS Satellite Imagery Using IHS Transform and Local Variation

The intensity-hue-saturation (IHS) technique is a well-known merging approach for its computational efficiency and spatial definition holding. However, it results in color distortion particularly for the remote sensing images of IKONOS and QuickBird as some other fusion methods, such as principal component analysis, and Brovey transform. Although wavelet-based image fusion approaches can provide a better tradeoff between spatial and spectral quality, the fused images with these methods often have a spatial resolution that is less than that of the IHS-based algorithm. A remote sensing image fusion algorithm based on IHS transform and local variation and its modified approach with low computational complexity are proposed. Visual effect and quantity evaluation results show that the proposed simple algorithm outperforms the conventional image fusion methods in the spectral domain with the spatial quality similar to that of the undecimated wavelet transform-based scheme. The proposed modified method can obtain the similar spatial resolution of the merged image with the IHS-based fusion algorithm and the better spectral quality in the green vegetation areas.      

SPOT5影像数据不同融合方法的比较与评价

采用小波IHS变换、小波PCA变换、EHLERS变换等五种不同融合技术对SPOT5的多光谱影像和全色影像进行融合,并从均值、标准差等方面对融合结果进行了评价。研究表明：EHLERS融合后影像有很好的整体视觉效果,但在细节表达方面有所缺陷;改进后的IHS融合后影像清晰度较低;PCA变换融合容易导致影像失真;而小波IHS和小波PCA融合技术以数据保留量大、失真程度小、视觉效果好、影像层次分明等特点证明了小波分解技术的优势。     

基于经验模态分解的高分辨率影像融合(英文)

High resolution image fusion is a significant focus in the field of image processing. A new image fusion model is presented based on the characteristic level of empirical mode decomposition （EMD）. The intensity hue saturation （IHS） transform of the multi-spectral image first gives the intensity image. Thereafter, the 2D EMD in terms of row-column extension of the 1D EMD model is used to decompose the detailed scale image and coarse scale image from the high-resolution band image and the intensity image. Finally, a fused intensity image is obtained by reconstruction with high frequency of the high-resolution image and low frequency of the intensity image and IHS inverse transform result in the fused image. After presenting the EMD principle, a multi-scale decomposition and reconstruction algorithm of 2D EMD is defined and a fusion technique scheme is advanced based on EMD. Panchromatic band and multi-spectral band 3,2,1 of Quickbird are used to assess the quality of the fusion algorithm. After selecting the appropriate intrinsic mode function （IMF） for the merger on the basis of EMD analysis on specific row （column） pixel gray value series, the fusion scheme gives a fused image, which is compared with generally used fusion algorithms （wavelet, IHS, Brovey）. The objectives of image fusion include enhancing the visibility of the image and improving the spatial resolution and the spectral information of the original images. To assess quality of an image after fusion, information entropy and standard deviation are applied to assess spatial details of the fused images and correlation coefficient, bias index and warping degree for measuring distortion between the original image and fused image in terms of spectral information. For the proposed fusion algorithm, better results are obtained when EMD algorithm is used to perform the fusion experience.     

IKONOS影像在黑方台黄土滑坡调查中的应用

以黑方台为典型的黄土台塬, 过量农业灌溉造成了区内地下水位上升, 诱发了大量黄土滑坡, 该文选用IKONOS影像对其进行了遥感解译。通过对比PCA变换、Brovey变换、IHS变换和Multiplative变换融合影像效果, 选用PCA变换融合影像作为分析的基础。重点分析了IKONOS影像在黑方台黄土滑坡调查中的应用。在综合分析研究区地质资料和滑坡影像特征的基础上, IKONOS影像在滑坡类型划分、滑坡周界及期次关系确定、空间分布规律和滑坡特征参数统计方面具有很好的应用前景。     

IHS变换和小波变换相结合的遥感影像融合

本文针对低分辨率多光谱影像与高分辨率全色影像的融合，提出了一种IHS变换和小波变换相结合的遥感影像融合方法。方法首先对多光谱影像作IHS正变换，得到亮度I、色度H和饱和度S三个分量：然后利用小波变换融合方法，融合多光谱影像的亮度分量与全色影像，并用融合后的影像替代多光谱影像的亮度分量；最后，利用IHS反变换得到新的多光谱影像。试验结果分析表明，新方法的性能优于IHS变换融合方法、小波变换融合方法，在增强融合影像的空间细节表现能力的同时，很好地保留了多光谱影像的光谱信息。     

基于经验模态分解的高分辨率影像融合

文章提出基于经验模态分解（Emp iricalMode Decomposition,EMD）的特征层影像融合模型。对多光谱波段影像进行IHS变换获得强度影像,采用行列分解实现一维经验模态分解的二维拓展,并用于分离高分辨波段影像与强度影像的细节特征信息,对高分辨率波段影像的高频与强度影像波段的低频进行重构获得融合后的强度影像,再通过IHS反变换获得融合影像。文章介绍了经验模态分解的基本原理,定义了经验模态分解的多尺度分解与合成结构,提出融合模型的技术路线。选择UICKB IRD影像的全色波段与多光谱波段进行融合实验,根据典型行（列）的EMD分析,确定经验模量的取舍尺度,按提出的融合路线获得融合影像,并与小波融合,IHS融合,Brovey融合模型获得的影像进行视觉及量化比较。选择信息熵、标准差指标对融合影像的空间细节信息进行评价,同时选择平均灰度值、相关系数、偏差指数评价融合影像的光谱扭曲程度,结果表明本融合模型最优。     

基于亮度相关矩的MODIS和SPOT影像融合研究

针对MODIS影像空间分辨率较低的问题，提出了一种基于亮度相关矩的多分辨率图像融合方法。该方法首先对SPOT影像进行小波分解，将MODIS影像构成的RGB颜色系统变换到IHS颜色系统；然后，根据强度分量和SPOT影像低频分量的均值和方差来定义图像亮度相关矩；最后，IHS逆变换和小波逆变换得到包含更多信息和有效特征的融合图像。试验结果证明该方法得到的融合图像在保留地物光谱信息和提高空间分辨率上都具有很好的效果。     

多源高分辨率遥感影像智能融合

本文面向多源高分辨率遥感影像自动化融合的应用需求,探索按需应用的智能化融合方法,充分利用不同分辨率和不同时相的高分辨率多源遥感影像数据资源与特性,研究了影像融合数据源选取的决策树算法,建立了遥感影像融合规则知识库,并自动化选取适合的融合算法,提出了Curvelet_HCS算法,对低频和高频系数选用不同的融合规则,改善了HCS算法的光谱失真问题,可同时融合多光谱影像的多个谱段,并保持更丰富的空间细节信息。根据融合评价结果对遥感影像融合规则知识库进行更新,实验验证表明了该套方法的有效性,为开展大规模智能化的多源遥感影像融合应用提供了重要的方法和技术支撑。     

国产高分卫星遥感影像融合方法比较与评价

选择适宜的融合方法有利于卫星遥感影像融合产品更好地服务于生产实践及科学研究。本文在总结现有影像像素级融合算法原理的基础上，选用Pansharp、Gram-Schmidt、HPF、Ehlers、Subtractive、Modified IHS、Brovey、PCA、NNDiffuse等多种常用的影像融合方法对国产高分影像的全色和多光谱数据进行了融合处理，并从定性和定量的角度对融合结果进行了详细评价，试图寻找适用于国产高分卫星遥感影像的最佳融合方法。结果表明：针对国产高分一号卫星遥感数据，超分辨率贝叶斯算法融合效果在视觉效果与影像质量定量评价指标中综合表现最佳；Gram-Schmidt、NNDiffuse、Subtractive和HPF融合结果地物边界最为清晰；Modified IHS、PCA、Brovey融合影像色彩失真较为明显；NNDiffuse在可见光波段表现较突出；Gram-Schmidt在近红外波段表现效果最佳。     

基于PCA+àstrous小波融合方法

针对PCA变换融合影像存在较严重的光谱失真现象,以及àstrous小波融合影像保真度高,而空间分辨率相对低的情况,本文提出一种基于PCA+àstrous小波融合算法。新方法首先对将多波段图像经PCA变换至各不相关的成分,而后对高分辨率图像与低分辨率图像主成分按照特定融合规则进行融合处理,并使用该融合后的第一主成份分量来替代高分辨率图像与低分辨率图像进行àstrous小波融合,即PCA变换与àstrous小波变换相结合的融合处理方法。主观视觉分析和客观参数表明,新方法不仅很好的保留了影像的光谱信息,而且兼顾了地物细节能力的表达。     

保持光谱信息的遥感图像融合方法研究

常用的遥感图像融合方法,如IHS变换法、Brovey变换法和主成分变换法等在实施图像融合时,均会有不同程度的光谱扭曲现象.探讨能有效保持光谱信息的EECN融合法.EECN融合法采用比值变换法,同时对参与融合的全色波段进行增强边缘,融合后的图像在光谱保持性能、分类精度等方面均较优.     

利用小波变换的高分辨率多光谱遥感图像多尺度分水岭分割

为了减少仅用分水岭变换而导致的过分割问题,本文提出利用小波变换的多尺度处理方式用于融合后多光谱QuickBird图像的分割。整个分割过程包括多尺度图像表示、图像分割、区域合并和结果映射等过程。首先,依据原始图像的大小确定分解尺度并用小波变换产生各波段的低尺度图像。采用相位一致模型提取各近似系数的梯度,并逐尺度地融合各梯度图。分析不同尺度下的不同地物的局部梯度方差,以选择最佳的小波分解尺度。然后,通过移动阈值与扩展最小变换,利用多层次标记提取方法标记均质区域。进而,在梯度重建的基础上利用标记分水岭变换得到分割图像。其次,采取空间相邻关系、面积、光谱与纹理等多约束策略,以搜索最小合并代价的方式合并最初分割区域中的邻接区域对。最后,修改细节子图并进行小波逆变换将最初分割结果投影到更高尺度图像,同时处理边界上的像元以保持区域边界直至原始图像。实验结果表明本文方法不仅能够用于高分辨率多光谱遥感图像的分割,而且缓解了过分割问题且取得了较准确的分割效果。     

基于小波统计特性的遥感图像像素与特征联合最优融合方法

遥感影像的IHS融合方法由于匹配误差导致光谱畸变和退化,而小波变换在变换域具有良好的分频特性,小波系数的统计特性反映了遥感影像的边缘、线和区域等显著特征。提出了基于小波统计特性的遥感影像的像素和特征联合最优融合方法,在IHS空间,对强度分量I的高频部分利用多分辨率小波融合方法进行影像的高频细节特征融合,低频部分选取光谱信息和空间分辨率评价指标作为融合权系数求优指标,进行像素级最优融合,实验结果证明了该方法的有效性。     

Improved IHS Algorithm for Fusing High Resolution Satellite Images of Urban Areas

The intensity-hue-saturation method is used frequently in image fusion due to its efficiency and high spatial quality. The main shortage is its spectral distortion stemmed from replacement of intensity band with higher resolution image. In this study, a new method is introduced to improve the spectral quality of the Intensity-Hue-Saturation (IHS) algorithm. The goal of this study is to produce the fused image that has a better spectral and spatial quality with respect to the original images in term of visual comparison and the classification result. In this regard, an improved statistical approach is developed to combine an intensity band from IHS algorithm and an input high resolution image such as SAR or Panchromatic image. Then the intensity image is replaced by the combined image band. Final fused images are attained using the inverse IHS algorithm. The proposed fusion algorithm is tested on two data sets of: a) panchromatic and multi spectral bands of IKONOS image with the same acquisition date, and b) multi spectral and HH bands of IKONOS and TerraSAR-X images respectively with different acquisition dates. Moreover, the obtained results are compared with other fusion methods like IHS, Gungor, Brovey and synthetic variable ratio. The results show less spectral discrepancy of the proposed method comparing to other methods. Finally, the outcome of proposed method is classified and classification overall accuracy is improved by 5.6 and 2 percentage for data set ‘a’ and ‘b’ respectively.     

遥感影像像素级融合方法比较研究

遥感影像数据的融合对于利用影像进行的分类、特征提取和目标识别具有重要的意义。文中阐述了IHS彩色空间变换融合法、主成分分析法（PCA）、Brovey法及Gram-schmidt法的算法实现,在此基础上对QuickBird全色波段和多光谱波段进行融合实验,最后从信息熵、灰度均值、相关系数、标准差和视觉效果5个方面综合进行定量与定性评价。分析结果表明,IHS整体上清晰,色调协调,保留了较多的空间信息,细节特征明显,质量较好。     

ALOS PALSAR and Hyperion Data Fusion for Land Use Land Cover Feature Extraction

Detailed and enhanced land use land cover (LULC) feature extraction is possible by merging the information extracted from two different sensors of different capability. In this study different pixel level image fusion algorithms (PCA, Brovey, Multiplicative, Wavelet and combination of PCA & IHS) are used for integrating the derived information like texture, roughness, polarization from microwave data and high spectral information from hyperspectral data. Span image which is total intensity image generated from Advanced Land observing Satellite-Phase array L-band SAR (ALOS-PALSAR) quad polarization data and EO-1 Hyperion data (242 spectral bands) were used for fusion. Overall PCA fused images had shown better result than other fusion techniques used in this study. However, Brovey fusion method was found good for differentiating urban features. Classification using support vector machines was conducted for classifying Hyperion, ALOS PALSAR and fused images. It was observed that overall classification accuracy and kappa coefficient with PCA fused images was relatively better than other fusion techniques as it was able to discriminate various LULC features more clearly.     

结合像元级和目标级的高分辨率遥感影像建筑物变化检测

快速、精准的建筑物变化检测对城市规划建设等业务管理具有重要意义。随着卫星遥感技术的快速发展,基于高分辨率遥感影像的建筑物变化检测得到了广泛关注。针对像元级建筑物变化检测方法往往精度不足而目标级建筑物变化检测方法过程烦琐等问题,本文提出结合像元级和目标级的高分辨率遥感影像建筑物变化检测方法。首先综合高分辨率遥感影像的多维特征,利用随机森林分类器进行影像集分类,以获取像元级建筑物变化检测结果;然后对后时相遥感影像进行图像分割,获得影像对象;最后融合像元级建筑物变化检测结果和影像对象,识别变化的建筑物目标。利用双时相QuickBird高分辨率遥感影像进行建筑物变化检测试验,结果表明：本文提出的方法能够削弱光照、观测角度等环境差异对建筑物变化检测的影响,显著改善建筑物变化的检测精度。