基于亮度相关系数的ETM+影像融合

传统的影像融合方法对ETM＋多光谱影像和全色影像融合往往存在一定的光谱失真现象,提出了一种基于亮度相关系数的影像融合方法,能够提高融合影像的光谱保真度。该方法首先对多光谱影像进行IHS变换,将全色影像与亮度分量进行直方图匹配;其次,对亮度分量和新的全色影像分别进行小波分解,以分解后近似分量的相关系数作为权值,对两个近似分量图像进行加权融合,得到新的近似分量;然后,进行小波逆变化得到新的I分量;最后,通过IHS逆变化得到融合影像。试验结果证明,该方法得到的融合影像,不仅能够有效地保持全色影像的空间细节信息,而且能很好地保留多光谱影像的光谱信息。     

HCT变换与联合稀疏模型相结合的遥感影像融合

提出了一种基于HCT变换和联合稀疏模型的遥感影像融合方法,可更有效地利用多光谱所需谱段的光谱信息,最终得到所需谱段的融合影像。该方法将所需谱段的多光谱影像进行HCT变换,获取其亮度分量和角度分量;然后利用亮度分量和全色影像小波变换的低频分量进行联合稀疏模型的构建、系数求解和融合,得到融合的全色低频分量;最后将该低频分量与前面步骤所得其他分量分别进行小波逆变换和HCT逆变换,得到高质量的融合影像。试验利用Pleiades-1和WorldView-2两种卫星数据进行验证,并通过视觉效果和量化的融合评价指标进行对比和分析,验证了本文算法的有效性。     

基于小波变换的遥感图像融合研究——以黄河三角洲地区为例

针对黄河三角洲地区Landsat TM的多光谱影像和全色影像,提出了一种基于IHS变化和离散小波变换的遥感图像融合方法。该方法在IHS变换的基础上进行直方图均衡化;其次,利用离散小波变换的方法对多光谱图像的亮度分量I和全色影像进行融合;用融合后的图像代替多光谱图像的亮度分量I再进行IHS逆变换得到融合结果。实验证明,融合后的影像不仅保留Landsat TM多光谱图像的光谱特性,而且具有很高的空间细节表现能力。     

IHS变换和小波变换相结合的遥感影像融合

本文针对低分辨率多光谱影像与高分辨率全色影像的融合，提出了一种IHS变换和小波变换相结合的遥感影像融合方法。方法首先对多光谱影像作IHS正变换，得到亮度I、色度H和饱和度S三个分量：然后利用小波变换融合方法，融合多光谱影像的亮度分量与全色影像，并用融合后的影像替代多光谱影像的亮度分量；最后，利用IHS反变换得到新的多光谱影像。试验结果分析表明，新方法的性能优于IHS变换融合方法、小波变换融合方法，在增强融合影像的空间细节表现能力的同时，很好地保留了多光谱影像的光谱信息。     

基于稀疏表示和字典学习的全色与多光谱影像融合

Pansharpening方法通过融合多光谱影像的光谱信息和全色影像的空间细节信息来得到高分辨多光谱影像。然而传统的Pansharpening方法易导致产生光谱扭曲和空间信息丢失现象。受到影像稀疏表示超分重建理论启发,本文提出了一种新的基于稀疏表示和字典学习的Pansharpening方法。该方法以影像的高频特征作为训练样本,通过字典学习的方法来获取高低分辨率影像字典,使用正交匹配追踪算法求解出影像的稀疏表示系数,最终通过高分辨影像字典与稀疏系数相乘得到融合影像。实验结果表明:本文提出的方法能很好地保持遥感影像的光谱信息和空间细节信息。     

基于Contourlet变换的遥感图像融合方法研究

为了充分利用多源遥感图像的影像信息,针对不同分辨率的遥感图像进行融合算法研究。通过对基于小波变换(warelet transform,WT)与IHS变换的改进算法研究,提出了基于轮廓波变换(Contourlet transform,CT)与IHS变换的改进算法:结合传统IHS彩色空间变换,将经IHS变换获得的多光谱图像亮度分量与原全色图像分别进行CT;然后对得到的低频分量采用自适应融合规则、高频分量采用基于区域相似度的阈值控制规则分别进行融合;最后对融合后的高频和低频分量进行Contourlet逆变换,得到最终的融合图像。对比实验结果表明:本文提出的方法能够在有效保留光谱信息的同时,纳入全色图像丰富的空间细节信息。融合之后的结果图像与原多光谱图像具有更高的相关系数和更小的光谱畸变度,并且信息熵和标准差较传统WT及CT更优,具有一定的实用性。     

结合自适应PCNN的非下采样剪切波遥感影像融合

为解决全色与多光谱遥感影像融合中脉冲耦合神经网络参数不能自适应调节问题,提出一种基于参数自适应脉冲耦合神经网络模型(PA-PCNN)和保持能量属性(EA)融合策略相结合的非下采样剪切波变换(NSST)的遥感影像融合方法:①通过提取多光谱影像YUV颜色空间变换的Y亮度分量并与全色影像进行NSST变换,获得高频系数和低频系数.②针对低频子带系数,采用EA法进行融合;针对高频子带系数,通过PA-PCNN模型得到的最优参数,以确定最优的PCNN模型,进而实现高频子带系数的融合.③将NSST和YUV进行逆变换得到融合影像.本文选取空间频率、相对无量纲全局误差、相关系数、视觉信息保真度、基于梯度的融合性能和结构相似度测量等6种客观评价指标对融合影像的光谱和空间细节评价,利用多组不同分辨率全色和多光谱遥感影像,通过与4种融合方法对比验证,结果表明本文方法在视觉感知和客观评价方面总体优于其他全色与多光谱遥感影像融合方法.     

Contourlet方向区域相关性的遥感图像融合

对遥感图像经Contourlet变换后的高频子带系数分布的方向特征进行统计分析,发现遥感图像经Contourlet变换后高频系数的分布具有较强的方向区域特征,在此基础上,提出一种基于Contourlet系数方向区域相关性的遥感图像融合算法,该算法首先对多光谱图像经IHS变换后的亮度分量和全色图像分别进行Contourlet变换,然后以多光谱图像亮度分量的低频信息作为融合图像亮度分量的低频信息,通过计算并比较全色图像的高频系数和对应的多光谱图像亮度分量的高频系数的方向区域匹配度确定融合图像亮度分量的高频信息;最后经过Contourlet逆变换和IHS逆变换获得融合图像。实验结果表明,该算法在提高融合图像空间分辨率的同时能够更好地保留原始多光谱图像的光谱信息,与传统遥感图像融合算法相比,该算法具有较好的融合图像信息熵和清晰度,具有一定的实用性。     

混沌蜂群优化的NSST域多光谱与全色图像融合

为有效融合多光谱图像的光谱信息和全色图像的空间细节信息,提出了一种基于混沌蜂群优化和改进脉冲耦合神经网络(PCNN)的非下采样Shearlet变换(NSST)域图像融合方法。首先对多光谱图像进行Intensity-HueSaturation(IHS)变换,全色图像的直方图按照多光谱图像亮度分量的直方图进行匹配;然后分别对多光谱图像的亮度分量和新全色图像进行NSST变换,对低频分量使用改进加权融合算法进行融合,以互信息作为适应度函数,利用混沌蜂群算法找到最优加权系数。对高频分量采用改进脉冲耦合神经网络(PCNN)方法进行融合,再经NSST逆变换和IHS逆变换得到融合图像。本文方法在主观视觉效果和信息熵、光谱扭曲度等客观定量评价指标上优于基于IHS变换、基于非下采样Contourlet变换(NSCT)和非负矩阵分解(NMF)、基于NSCT和PCNN等5种融合方法。本文方法在提升图像空间分辨率的同时,有效地保留了光谱信息。     

PCA联合字典的稀疏系数NMF融合

为了减少混合像元对字典建立的影响,结合在线字典学习法与主成分分析(principal component analysis,PCA)法提取全色与各分解影像字典的第一主成分分量构成PCA联合稀疏字典。该字典包括多光谱影像特征与高空间分辨率影像特征,同时考虑到了混合像元问题。使用PCA联合稀疏字典进行正交匹配追踪法(orthogonal matching pursuit,OMP)计算,分别得到全色与多光谱影像的稀疏系数,采用非负矩阵分解(nonnegative matrix factor,NMF)融合算法得到融合影像的稀疏系数,进行重构生成融合影像。对字典矩阵大小的研究,考虑到重构图像的均方根误差与计算机运算的限制,最终确定稀疏字典矩阵大小为64像元×480像元。采用5种定量融合评定指标对本文方法与联合字典NMF方法、小波方法和PCA方法的影像融合结果进行分析比较,结果表明本文方法既可提高融合影像的纹理细节信息,也能较好地保持多光谱信息,获得更好的融合效果。     

Detail focused fusion of hyperspectral and multispectral imagesEI北大核心CSCD

Hyperspectral image (HSI) and multispectral image (MSI) are two types of images widely used in the field of remote sensing. These images are useful in certain applications, such as environmental monitoring, target detection, and mineral exploration. HSI contains a large amount of spectral information. Photons are typically collected in a larger spatial area on the sensor to ensure a sufficiently high signal-to-noise ratio (SNR). Accordingly, the HSI spatial resolution is much lower compared with MSI. This low spatial resolution greatly affects the practicality of HSI. Accordingly, fusing a low-spatial resolution HSI (LR-HSI) with a high-spatial resolution MSI (HR-MSI) in the same scene to obtain a high-resolution HSI (HR-HSI) is a method for solving such problems, which resolves the contradiction that the spatial resolution and the spectral resolution cannot simultaneously maintain a high level. From the analysis of fusion effect, the spatial and spectral reconstruction errors of the existing algorithms are mainly reflected in the edge and detail areas. The method proposed in this work was a fusion algorithm for dictionary construction and image reconstruction based on detail attention. In terms of maintaining spectral characteristics, the spectral distribution in the detail area is complex and diverse because of the proximity effect of the image. This work proposes to perform dictionary learning on the image and detail layers. The detail perception error terms and a constraint of edge adaptive directional total variation are proposed for spatial characteristic enhancement, which is combined with a local low rank constraint in the same fusion framework to estimate the sparse coefficient. Experiments were conducted on two datasets, namely, Pavia University and Indian Pine, to verify the effectiveness of the proposed method. The quantitative evaluation metrics contain peak SNR, relative dimensionless global error in synthesis, spectral angle map, and universal image quality index. Based on the experimental comparison, the fusion result of the algorithm proposed in this work is significantly improved compared with those of the other algorithms in terms of spatial and spectral characteristics. This work uses dictionary learning to propose a fusion algorithm for dictionary construction and image reconstruction with attention to details through the analysis of the existing hyperspectral and multispectral image fusion algorithms. A hierarchical dictionary learning algorithm is proposed to address the problem of large reconstruction error in the detail part of the existing algorithms. The detail perception error term and the direction adaptive full variational regularization term are used to improve the spectral dictionary solution and coefficient estimation, respectively. The result of the fusion is the error in the spectral characteristics and spatial texture of the detail, which achieves an accurate representation of the edge detail. © 2022 National Remote Sensing Bulletin. All rights reserved.     

基于Shearlet变换的SAR与多光谱遥感影像融合

针对合成孔径雷达（SAR）影像和多光谱遥感影像在融合时空间特征和光谱特征方面不能同时得到较大改善的问题,提出了一种基于成像特性的Shearlet变换域下的多源遥感影像融合方法。利用Shearlet变换的多方向和多尺度分解特性,将多光谱影像和SAR影像分别分解为高频和低频系数,从影像区域能量特征和区域相关性入手,设计了基于区域能量的低频系数融合规则和改进型的脉冲耦合神经网络的高频系数融合规则,使融合结果能够包含更多空间细节信息和光谱信息。利用TerraSAR-X、Landsat5-TM影像进行实验,结果表明该方法在提高影像空间细节表达能力的同时能够较好地融合更多的光谱信息。与小波变换、非下采样轮廓波变换（Nonsubsampled contourlet Transform,NSCT）等方法相比,该方法在空间信息保有量和光谱信息保有量方面都有明显的提升,其中交叉熵有接近100%的提升幅度,互相关系数有高于25%的提升幅度,光谱扭曲度有优于40%的提升幅度。     

一种基于小波系数特征的遥感图像融合算法

多光谱图像和全色图像是目前卫星遥感领域最常见的传感器图像.为了更充分地发挥这两类遥感图像数据的价值,人们利用两类数据的互补性,将多传感器融合技术引进了遥感图像处理领域.在IHS彩色空间变换和小波多分辨率分析的基础上,利用图像高频小波系数的多个特征来定义特征量积,并利用特征量积作为依据提出了一种图像融合新算法.通过一组多光谱图像和全色图像数据进行融合仿真试验,并将该算法与IHS,HPF等算法和归一化矩算法作了比较.证明该方法能在保留多光谱图像光谱信息的基础上,有效地提高多光谱图像的空间分辨率.     

Fusion of multispectral and panchromatic Satellite images using the curvelet transform

A useful technique in various applications of remote sensing involves the fusion of different types of satellite images, namely multispectral (MS) satellite images with a high spectral and low spatial resolution and panchromatic (Pan) satellite image with a low spectral and high spatial resolution. Recent studies show that wavelet-based image fusion provides high-quality spectral content in fused images. However, the results of most wavelet-based methods of image fusion have a spatial resolution that is less than that obtained via the Brovey, intensity-hue-saturation, and principal components analysis methods of image fusion. We introduce an improved method of image fusion which is based on the amelioration de la resolution spatiale par injection de structures (ARSIS) concept using the curvelet transform, because the curvelet transform represents edges better than wavelets. Because edges are fundamental in image representation, enhancing the edges is an effective means of enhancing spatial resolution. Curvelet-based image fusion has been used to merge a Landsat Enhanced Thematic Mapper Plus Pan and MS image. The proposed method simultaneously provides richer information in the spatial and spectral domains.     

基于热传导模型的像素级遥感图像融合

通过热传导方程给出了一种像素级遥感图像融合模型和方法：1)给出了空间域内高分辨率图像与低分辨率图像之间的扩散关系,作为特例得到了Brovey变换(Brovey Transform,BT);2)给出了图像融合与增强的统一表达式并得到基于亮度平衡的融合方法;3)低分辨率多光谱图像的方差较小情形,指出基于方差的标准图像融合方法将会丢失高空间分辨率全色图像信息。实验表明,除了图像量化误差以外,所提议的方法不会丢失已知图像的空间分辨率和波谱信息。     

基于分辨率退化模型的全色和多光谱遥感影像融合方法

从影像成像的频率特性出发，提出了一种影像分辨率退化模型，并在此基础上提出了一种新的全色和多光谱遥感影像融合方法。     

Spectral and Spatial Quality Analysis in Pan Sharpening Process

Image fusion is a process to obtain new images containing more information by combining images obtained same or different sensors. With most of the earth observation satellites, high spatial resolution panchromatic images and low spatial resolution multispectral images are obtained. As an example of image fusion ??pan sharpening?? is a process of combining of high spatial resolution panchromatic images and low spatial resolution multispectral images. At the end of the fusion process both high spatial and spectral resolution new images are obtained. In this study, panchromatic and multispectral images gathered from Ikonos were used. Panchromatic and multispectral images belonging to the same sensor were combined by using different image fusion methods. As pan sharpening methods Brovey transform, Modified IHS, Principal Component Analysis (PCA), Wavelet PC transform and Wavelet A Trous transformation methods were used. Quality of fused products was evaluated from the point of view of both visual and statistical criteria. While wavelet based methods are succesfull in terms of protection of spectral quality of original multispectral images, the colorbased and statistical methods are giving better results within the improvement of spatial content.     

A pan-sharpening method based on NSCT and formulated as compressive sensing problem

In this paper, a pan-sharpening method, using non-subsampled contourlet transform (NSCT) and the theory of compressive sensing (CS), is proposed. The NSCT is used for sparse image representation to perform a multiscale and directional decomposition of source images in order to express their detail and express the sparsity of their high frequency. The CS is used to merge the multispectral (MS) and panchromatic (pan) images from partial random measurements. Two different fusion rules are then applied. The final pan-sharpened image is obtained by inverse NSCT. Experimental results show the efficiency of the proposed method, compared with pan sharpening based on standard NSCT, in terms of visual quality and objective assessment. Moreover, the proposed technique is very effective when the storage and transmission bandwidth are limited.