A pan-sharpening method based on NSCT and formulated as compressive sensing problem

In this paper, a pan-sharpening method, using non-subsampled contourlet transform (NSCT) and the theory of compressive sensing (CS), is proposed. The NSCT is used for sparse image representation to perform a multiscale and directional decomposition of source images in order to express their detail and express the sparsity of their high frequency. The CS is used to merge the multispectral (MS) and panchromatic (pan) images from partial random measurements. Two different fusion rules are then applied. The final pan-sharpened image is obtained by inverse NSCT. Experimental results show the efficiency of the proposed method, compared with pan sharpening based on standard NSCT, in terms of visual quality and objective assessment. Moreover, the proposed technique is very effective when the storage and transmission bandwidth are limited.     

Pan-sharpening quality investigation of PLÉIADES-1A images

Optical remote sensing satellites obtain MS and Pan images simultaneously over the same coverage area. Remote sensing and image processing communities are working on different pan-sharpening methods capable of taking advantage of MS and Pan images. Each remote sensing system has its own advantages and disadvantages, leading to the question ‘Which pan-sharpening method should be used for which type of imagery?’ The aim of this research is to investigate the pan-sharpening performance of PLÉIADES-1A images. For this purpose, pan-sharpened images were generated using PCA, IHS and Brovey Transform which are the most popular pan-sharpening methods. Then, the pan-sharpened images were evaluated quantitatively using Correlation Coefficient, Root Mean Square Error, Relative Average Spectral Error, Spectral Angle Mapper and Erreur Relative Globale Adimensionnelle de Synthése. In addition, pan-sharpened images were evaluated qualitatively by taking object availability and completeness into consideration.     

On the Performance Evaluation of Pan-Sharpening Techniques

The limitations of the currently existing pan-sharpening quality indices are analyzed: the absolute difference between pixel values, mean shifting, and dynamic range change is frequently used as spatial fidelity measurement, but they may not correlate well with the actual change of image content; and spectral angle is a widely used metric for spectral fidelity, but the spectral angle remains the same if two vectors are multiplied by two individual constants, which means the average spectral angle between two multispectal images is zero even if pixel vectors are multiplied by different constants. Therefore, it is important to evaluate the quality of a pan-sharpened image under a task of its practical use and to assess spectral fidelity in the context of an image. In this letter, three data analysis techniques in linear unmixing, detection, and classification are applied to evaluate spectral information within a spatial scene context. It is demonstrated that those old but simplest approaches, i.e., Brovey and multiplicative (or after straightforward adjustment) methods, can generally yield acceptable data analysis results. Thus, it is necessary to consider the tradeoff between computational complexity, actual improvement on application, and hardware implementation when developing a pan-sharpening method.     

密集卷积残差网络的遥感图像融合

针对传统的遥感图像融合方法通常会引起光谱失真的问题和大多数基于深度学习的融合方法忽略充分利用每个卷积层信息的不足,本文结合密集连接卷积网络和残差网络的特性,提出了一个新的融合网络.该网络通过建立多个密集卷积块来充分利用卷积层的分级特征,同时块与块之间通过过渡层加快信息流动,从而最大程度地对特征进行极致利用并提取到丰富的...     

Improved Image Pansharpening Technique using Nonsubsampled Contourlet Transform with Sparse Representation

Multispectral (MS) and panchromatic (PAN) images contains complementary information. High spatial and spectral resolution is a prerequisite for images to be useful, which can be achieved through image pansharpening. In this paper, we propose a new pansharpening technique which is a combination of nonsubsampled contourlet transform (NSCT) and sparse representation (SR), called NSCT–SR. NSCT is a shift-invariant version of the contourlet transform which combines nonsubsampled pyramid (NSP) and the directional filter banks. NSP splits input MS and PAN images into low-pass and high-pass sub-bands. Fusion of high-pass sub-bands is done using local energy information while low-pass sub-bands are fused using SR. Finally, fused low-pass and high-pass sub-bands are combined to obtain image with high spatial and high spectral resolution. We have quantitatively compared NSCT–SR with other multiresolution algorithms by calculating spatial and spectral quality parameters. It is observed that spatial quality is improved by 0.93 % (for seaside image) and 1.54 % (for urban image). While spectral quality is improved maximum up to 31.39 and 40.47 %, for respective images. NSCT–SR also compared with other state-of-art algorithms by calculating various performance parameters including quality with no reference. It is found that, overall; NSCT–SR performs better compared to algorithms considered in work.     

遥感影像融合AIHS转换与粒子群优化算法

Pan-sharpening是通过将低分辨率多光谱图像(LMS)与高分辨率全色图像(PAN)进行合成而获得高光谱高空间分辨率的多光谱图像(HMS)的过程。本文提出一种Pan-sharpening方法,称为PAIHS。该方法基于自适应亮度-色度-饱和度(AIHS)转换和变分Pan-sharpening框架以及两个假设(①Pan-sharpening图像和原始多光谱图像(MS)具有相同的光谱信息;②Pan-sharpening图像与全色图像(PAN)包含的几何信息保持一致),同时确定目标函数,然后用粒子群算法(PSO)进行优化,目的是得到最佳控制参数并求得目标函数最小值,此时对应着最好的Pan-sharpening质量。试验结果表明,本文提出的方法具有高效性和可靠性,获得的性能指标也优于目前一些主流的融合方法。     

利用小波变换的高分辨率多光谱遥感图像多尺度分水岭分割

为了减少仅用分水岭变换而导致的过分割问题,本文提出利用小波变换的多尺度处理方式用于融合后多光谱QuickBird图像的分割。整个分割过程包括多尺度图像表示、图像分割、区域合并和结果映射等过程。首先,依据原始图像的大小确定分解尺度并用小波变换产生各波段的低尺度图像。采用相位一致模型提取各近似系数的梯度,并逐尺度地融合各梯度图。分析不同尺度下的不同地物的局部梯度方差,以选择最佳的小波分解尺度。然后,通过移动阈值与扩展最小变换,利用多层次标记提取方法标记均质区域。进而,在梯度重建的基础上利用标记分水岭变换得到分割图像。其次,采取空间相邻关系、面积、光谱与纹理等多约束策略,以搜索最小合并代价的方式合并最初分割区域中的邻接区域对。最后,修改细节子图并进行小波逆变换将最初分割结果投影到更高尺度图像,同时处理边界上的像元以保持区域边界直至原始图像。实验结果表明本文方法不仅能够用于高分辨率多光谱遥感图像的分割,而且缓解了过分割问题且取得了较准确的分割效果。     

Comparison of Pixel and Object Oriented Based Classification of Hyperspectral Pansharpened Images

In this paper pixel-based and object-oriented classifications were investigated for land-cover mapping in an urban area. Since the image fusion methods are playing a useful role in supplying classification different fusion approaches such as Gram-Schmidt Transform (GS), Principal Component Transform (PC), Haar wavelet, and À Trous Wavelet Transform (ATWT) algorithms have been used and the fused image with the best quality has been assessed on its respected classification. A Hyperion image and IRS-PAN image covering a region near Tehran, Iran have been used to demonstrate the enhancement and accuracy assessment of fused image over the initial images. The evaluation results of fused images showed that the Haar wavelet approach has good quality in preserving spectral information as well as spatial information. Classification results were compared to evaluate the effectiveness of the two classification approaches. Result of the pan-sharpened image classifications displayed that the object-oriented procedure presented more accurate outcomes (90.47 %) than those obtained by pixel-based classification method (77.33 %).     

Comparison of Fusion Techniques for Very High Resolution Data for Extraction of Urban Land-Cover

This paper aims in presenting a thorough comparison of performance of pan sharpening techniques, belonging to spatial, spectral, scale-space and spatial-frequency domain, for Very High Resolution Satellite Data. With the availability of new Very High Resolution sensors, especially, World View-2 sensor, which provides data at sub-meter level, the need for fusion of Panchromatic (PAN) and Multispectral (MS) images has to be further investigated. Pan-sharpening techniques namely, Hue-Saturation-Intensity, Brovey Transform, Principal Components Analysis, Discrete Wavelet Transform, Stationary Wavelet Transform, Non Sub-sampled contourlet Transform and Pseudo Wigner Distribution (PWD) fusion method have been selected for the fusion of PAN and MS images of World View-2 sensor. Further, the comparison of performance of each of the techniques have been carried out by using various evaluation indicators, such as, Root Mean Square Error, Peak Signal-to-Noise Ratio, Correlation Coefficient, Universal Image Quality Index. It is found that PWD based fusion technique gives good result with a good trade-off between the preservation of spectral information and enhancement of spatial resolution.     

基于分辨率退化模型的全色和多光谱遥感影像融合方法

从影像成像的频率特性出发，提出了一种影像分辨率退化模型，并在此基础上提出了一种新的全色和多光谱遥感影像融合方法。     

高分辨率多光谱影像城区建筑物提取研究

城区高空间分辨率遥感数据由于存在大量同物异谱和异物同谱现象,应用传统的基于像元光谱分类的方法进行建筑物分类提取难以取得满意的效果。本文发展了一种从高分辨率Ikonos卫星影像上基于知识规则的面向对象分类提取城区建筑物方法,包括如下步骤：(1)融合1m全色和4m多光谱波段影像,生成1m分辨率的多光谱融合影像;（2）分割融合影像;（3）执行基于对象光谱的最近邻监督分类;（4）应用模糊逻辑分类器结合光谱、空间、纹理和上下文特征等知识规则进行建筑物分类。精度统计结果表明,本文提出的分类方法提取城区建筑物取得了93%的精度。     

Using pan-sharpened high resolution satellite data to improve impervious surfaces estimation

Impervious surface is an important environmental and socio-economic indicator for numerous urban studies. While a large number of researches have been conducted to estimate the area and distribution of impervious surface from satellite data, the accuracy for impervious surface estimation (ISE) is insufficient due to high diversity of urban land cover types. This study evaluated the use of panchromatic (PAN) data in very high resolution satellite image for improving the accuracy of ISE by various pan-sharpening approaches, with a further comprehensive analysis of its scale effects. Three benchmark pan-sharpening approaches, Gram-Schmidt (GS), PANSHARP and principal component analysis (PCA) were applied to WorldView-2 in three spots of Hong Kong. The on-screen digitization were carried out based on Google Map and the results were viewed as referenced impervious surfaces. The referenced impervious surfaces and the ISE results were then re-scaled to various spatial resolutions to obtain the percentage of impervious surfaces. The correlation coefficient (CC) and root mean square error (RMSE) were adopted as the quantitative indicator to assess the accuracy. The accuracy differences between three research areas were further illustrated by the average local variance (ALV) which was used for landscape pattern analysis. The experimental results suggested that 1) three research regions have various landscape patterns; 2) ISE accuracy extracted from pan-sharpened data was better than ISE from original multispectral (MS) data; and 3) this improvement has a noticeable scale effects with various resolutions. The improvement was reduced slightly as the resolution became coarser.     

光谱角—欧氏距离的高光谱图像辐射归一化

辐射归一化旨在减小不同时相遥感影像间因获取条件不一致而导致的非地表辐射变化的差异,是土地覆盖变化监测的重要前提条件。本文根据高光谱图像上同类地物的谱形及数值的相似性,利用光谱角距离(SAD)和欧氏距离(ED)双重判定选取不变特征点,提出了一种基于光谱角—欧氏距离的辐射归一化方法。在评价指标中除了常用的均方根误差和相对偏差,更增加了高光谱特色的衡量光谱保真性指标:皮尔森系数、光谱扭曲程度。利用高光谱遥感CHRIS图像对本文提出方法进行验证,并与基于多元变化检测(MAD)的辐射归一化方法比较。结果表明,本文方法不仅在辐射特性上优于基于多元变化检测(MAD)的方法,而且具有保持光谱特性的优势,具有较好的应用前景。     

IKONOS图像的线性回归波段拟合融合方法

讨论基于线性回归波段拟合的空间细节信息提取方法的可行性。首先通过全色与多光谱图像构造线性回归方程,根据全色图像的高频成分设置最小二乘求解的权系数,然后利用回归系数构造低分辨率的全色图像,提取空间细节信息,最后将空间细节注入多光谱图像中进行融合。通过IKONOS全色和多光谱图像的融合实验,比较了本文方法与基于光谱响应函数的方法,结果表明:采用本文方法提取的空间细节信息进行融合,能达到甚至超过基于光谱响应函数方法的融合质量;相对于与FastIHS融合方法,本文方法的融合质量也有较大的提高。     

基于空间约束和结构特征的光学与SAR影像配准

针对光学和合成孔径雷达(synthetic aperture radar,SAR)影像间的几何形变和辐射差异造成的配准困难问题,提出一种基于空间几何约束和结构特征的光学影像与SAR影像自动配准方法.首先,利用分块的Harris算子在输入影像上提取分布均匀的特征点,根据有理函数模型对输入影像进行局部几何纠正,实现输入影像...     

A global quality measurement of pan-sharpened multispectral imagery

This letter focuses on quality assessment of fusion of multispectral (MS) images with high-resolution panchromatic (Pan) observations. A new quality index suitable for MS imagery having four spectral bands is defined from the theory of hypercomplex numbers, or quaternions. Both spectral and radiometric distortion measurements are encapsulated in a unique measurement, simultaneously accounting for local mean bias, changes in contrast, and loss of correlation of individual bands, together with spectral distortion. Results are presented and discussed on very high-resolution QuickBird data, through comparisons between state-of-the-art and advanced MS+Pan merge algorithms.     

Spectral and Spatial Quality Analysis in Pan Sharpening Process

Image fusion is a process to obtain new images containing more information by combining images obtained same or different sensors. With most of the earth observation satellites, high spatial resolution panchromatic images and low spatial resolution multispectral images are obtained. As an example of image fusion ??pan sharpening?? is a process of combining of high spatial resolution panchromatic images and low spatial resolution multispectral images. At the end of the fusion process both high spatial and spectral resolution new images are obtained. In this study, panchromatic and multispectral images gathered from Ikonos were used. Panchromatic and multispectral images belonging to the same sensor were combined by using different image fusion methods. As pan sharpening methods Brovey transform, Modified IHS, Principal Component Analysis (PCA), Wavelet PC transform and Wavelet A Trous transformation methods were used. Quality of fused products was evaluated from the point of view of both visual and statistical criteria. While wavelet based methods are succesfull in terms of protection of spectral quality of original multispectral images, the colorbased and statistical methods are giving better results within the improvement of spatial content.     

Remote Sensing Image Fusion Based on Nonlinear IHS and Fast Nonsubsampled Contourlet Transform

The purpose of remote sensing image fusion is to inject the detail image extracted from the panchromatic (PAN) image into the low spatial resolution multispectral (MS) image. A novel remote sensing image fusion method based on fast nonsubsampled contourlet transform (FNSCT) and Nonlinear intensity-hue-saturation (IHS) is presented in this paper. Firstly, the Nonlinear IHS transform is performed on the multispectral image, and then the I-component representing the spatial resolution and the panchromatic image is transformed by NSCT to obtain the low frequency and high frequency. Finally, the coefficients are selected using the improved sum-modified-Laplacian (SML) method and the improved Log-Gabor filter in the low frequency and the high frequency, respectively. Experimental results show that the proposed method is the most advanced fusion method in subjective and objective evaluation, can provide more spatial information, and retain more spectral information compared with several other methods.     

Hue Adjustment to IHS Pan-Sharpened IKONOS Imagery for Vegetation Enhancement

Fused or pan-sharpened IKONOS images are invaluable to the visual interpretation of large-area-scale applications. Frequently, the paramount objective is merely to obtain an image for visualization purposes, with no further image processing or analysis in mind. In such cases, the fused image should resemble reality as much as possible, with objects represented by their true colors at surface reflectance. In this letter, a technique for image fusion of IKONOS, or similar imagery, is proposed for when the main purpose of a specific image is vegetation visualization. The technique consists of a hue spectral adjustment scheme integrated with an intensity-hue-saturation transformation. Experimental evidence to support the technique is provided with a subset of IKONOS data available from the University of Alcalaacute campus. In the final fused image, deciduous and evergreen vegetation can be clearly differentiated. The high quality of the fused image can also be appreciated in relation to other types of cartographic objects; the quantitative evaluation of spectral and spatial information results in a high color correlation and excellent spatial information quality     

基于Contourlet域HMT和D-S证据融合的SAR图像分割

针对Contourlet的多尺度、局部化、方向性和各向异性等优点,结合隐马尔科夫树(hidden Markov tree,HMT)模型和D-S(Dempster-Shafer)证据理论,提出一种新的SAR图像分割算法.该算法首先将隐马尔科夫树模型推广到Contourlet域,在多尺度HMT上采用D-S证据融合理论有效地...