Fusion of infrared and visible images based on NSUDCT
-
摘要: 针对同一场景的红外与可见光图像，提出了基于非下采样均匀离散Curvelet 变换（NSUDCT）的图像融合方法。首先使用标记控制的分水岭分割（MCWS）算法对源图像进行区域分割，对各分割结果进行叠加得到联合区域图。然后对源图像进行非下采样均匀离散Curvelet 分解，分解后的低频系数采用区域对比度和区域标准差作为量测指标进行融合，高频方向系数使用基于局部能量的融合规则进行融合，并对融合系数做一致性检测。最后通过各频带融合系数重建得到融合图像。实验结果表明文中方法取得了比较好的视觉效果和量化数据，相比基于NSUDCT 的像素融合方法，此文方法的熵值提高了9.87%，交叉熵减少了68.04%,互信息提高了80%。
-
关键词:
- 图像融合 /
- 非下采样均匀离散Curvelet 变换 /
- 区域分割
Abstract: Aiming at the infrared and visible images in a same scene, a novel fusion algorithm based on the nonsubsampled uniform discrete curvelet transform (NSUDCT) was proposed. First, the source images were segmented using the marker controlled watershed segmentation (MCWS), and the joint region graph was obtained by superimposing the segmented results. Then, the nonsubsampled uniform discrete Curvelet transform was applied to the source images, the low-frequency coefficients were fused with the measurement of ratio of region contrast and region standard deviation, the high-frequency directional coefficients were fused with the local energy fusion rule, and the consistency of the fused coefficients was examined. Finally, the fused image was reconstructed from the subband fused coefficients. The experiment results indicate that the proposed method could provide better fusion quality in terms of both visual and quantified measure. Compared with the pixel fusion method based on NSUDCT, the Entropy of fused images increased by 9.87% , the Cross Entropy decreased by 68.04% and the Mutual Information increased by 80%. -
[1] [2] Jing Zhongliang, Xiao Gang, Li Zhenghua. Image Fusion: Theory and Applications [M]. Beijing: Higher Education Press, 2007. (in Chinese) [3] [4] Xia Mingge, He You, Ouyang Wen, et al. Overview of wavelet-analysis-based image fusion [J]. Infrared and Laser Engineering, 2003, 32(2): 177-181. (in Chinese) [5] [6] Nguyen Truong T, Herv Chauris. Uniform discrete Curvelet transform[J]. IEEE Transactions on Signal Processing, 2010, 58(7): 3618-3614. [7] [8] Cands E J, Demanet L, Donoho D L, et al. Fast discrete curvelet transforms[J]. Multiscale Modeling and Simulation, 2006, 5(3): 861-899. [9] Do M N, Vetterli M. The Contourlet transform: an efficient directional multiresolution image representation [J]. IEEE Transactions on Image Processing, 2005, 14(12): 2091-2106. [10] [11] Easley G R, Labate D, Lim W Q. Sparse directional image representations using the discrete shearlet transform[J]. Applied Computational Harmonic Analysis, 2008, 25(1): 25-46. [12] [13] Cunha A L, Zhou Jianping, Do Minh N. The nonsubsampled contourlet transform: theory, design, and applications [J]. IEEE Transactions on Image Processing , 2006 , 15 ( 10 ) : 3089-3101. [14] [15] [16] Jelena Kovaovaevic, Chebira A. Life beyond bases: the advent of frames[J]. IEEE Signal Process Mag, 2007, 24(4): 86-104. [17] Mallat S G. A Wavelet Tour of Signal Processing: The Sparse Way[M]. 3rd ed. Burlington: Elsevier, 2009. [18] [19] [20] Piella G. A region-based multiresolution image fusion algorithm [C]//ISIF Fusion 2002 Conference, 2002: 1557- 1564. [21] Liu Kun, Guo Lei, Chen Jingsong. Sequence infrared image fusion algorithm using region segmentation [J]. Infrared and Laser Engineering, 2009 38(3): 553-558. (in Chinese) [22] [23] [24] Ye Chuanqi, Wang Baoshu, Miao Qiguang. Fusion algorithm of infrared and visible images based on region feature [J]. Acta Photonica Sinica, 2009, 38(6): 1498-1503. (in Chinese) [25] Otsu N. A threshold selection method from gray-level histograms [J]. IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1): 62-66. [26] [27] Burt P J, Kolczyski R J. Enhanced Image Capture Through Fusion [C]//International Conferenceon Computer Vision, 1993, l: 173-186. [28] [29] Wang Haihui, Peng Jiaxiong, Wu Wei. Comparison of the methods of evaluating the performance of multi-sensor image fusion [J]. Infrared and Laser Engineering, 2004, 33 (2): 189-193. (in Chinese) -
点击查看大图
计量
- 文章访问数: 261
- HTML全文浏览量: 22
- PDF下载量: 138
- 被引次数: 0
下载:
