Infrared and visible fusion algorithm based on latLRR and PCNN

Yan-xin XIE

doi:10.3788/YJYXS20193404.0423

您当前的位置：

首页 >

文章列表页 >

Infrared and visible fusion algorithm based on latLRR and PCNN

Image Processing | 更新时间：2020-07-05

- Infrared and visible fusion algorithm based on latLRR and PCNN
- Chinese Journal of Liquid Crystals and Displays Vol. 34, Issue 4, Pages: 423-429(2019)
- 作者机构：
  
  吉林农业科技学院电气与信息工程学院, 吉林吉林 132101
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20193404.0423
  CLC： TP391
- Received：06 November 2018，
  
  Accepted：16 February 2019，
  
  Published：2019-04
- 稿件说明：
移动端阅览
Yan-xin XIE. Infrared and visible fusion algorithm based on latLRR and PCNN[J]. Chinese journal of liquid crystals and displays, 2019, 34(4): 423-429.
DOI：

Yan-xin XIE. Infrared and visible fusion algorithm based on latLRR and PCNN[J]. Chinese journal of liquid crystals and displays, 2019, 34(4): 423-429. DOI： 10.3788/YJYXS20193404.0423.

摘要

针对光谱差异较大的红外与可见光图像，本文提出一种基于潜在低秩表示（LatLRR）和脉冲式耦合神经网络（PCNN）的多尺度融合模型。首先，该算法利用非下采样剪切波变换（NSST）获取图像的低频与高频分量。鉴于图像的低频分量决定最终的融合效果，采用LatLRR算法挖掘源图像内在的显著特征对低频分量自适应加权融合。除此外，针对决定融合图像细节的高频分量，则利用双通道PCNN模型作为它的融合规则。其中平均梯度算子（AVG）和方向梯度和算子（SDG）分别作为PCNN的外界刺激与链接强度，它们能更好地表征图像的纹理特性。通过上述全新的融合规则，可将包含在红外图像内部的显著性特征与可见光图像的梯度特征完美结合，从而获取具有优良视觉效果的融合图像。本文采用3种不同的场景来测试所提方法的融合性能，与其他典型融合方法相比，本文提出的算法具有更佳的视觉效果，同时客观评价参数值增加约2%~5%。

Abstract

Aiming at the infrared and visible images with large spectral differences

this paper proposed a multi-scale fusion model based on latent low rank representation (LatLRR) and pulse coupled neural network (PCNN). Firstly

the proposed algorithm used non-subsampled shearlet transform (NSST) to acquire the low and high-frequency components of the image. In view of the low-frequency component of the image to determine the final fusion effect

the LatLRR algorithm was used to mine the intrinsic salient features of the source image

and this feature was used to adaptively weight the fusion of low-frequency components. In addition

for the high-frequency components that determined the details of the fused image

the dual-channel PCNN model was used as its fusion rule. Among them

the average gradient operator (AVG) and the sum of the direction gradients operator (SDG) were the external stimulus and link strength of PCNN

respectively

which all can better characterize the texture characteristics of the image. Through the above new fusion rules

the saliency features contained in the infrared images can be perfectly combined with the gradient features of the visible images to obtain a fused image with excellent visual effects. In this paper

three different scenarios were used to test the fusion performance of the proposed method. Compared with other typical fusion methods

the proposed algorithm has better visual effects

and the objective evaluation parameter value increases by about 2%~5%.

关键词

Keywords

references

MA J Y, MA Y, LI C. Infrared and visible image fusion methods and applications:a survey[J]. Information Fusion, 2019, 45:153-178.

LIU Y, CHEN X, WANG Z F, et al . Deep learning for pixel-level image fusion:recent advances and future prospects[J]. Information Fusion, 2018, 42:158-173.

ZHANG P, YUAN Y C, FEI C, et al . Infrared and visible image fusion using co-occurrence filter[J]. Infrared Physics & Technology, 2018, 93:223-231.

LIU Y, LIU S P, WANG Z F. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 2015, 24:147-164.

陈广秋, 高印寒, 才华, 等.局部化NSST与PCNN相结合的图像融合[J].液晶与显示, 2015, 30(4):701-712.

CHEN G Q, GAO Y H, CAI H, et al . Image fusion algorithm based on local NSST and PCNN[J]. Chinese Journal of Liquid Crystals and Displays, 2015, 30(4):701-712. (in Chinese)

LIM W Q. The discrete shearlet transform:a new directional transform and compactly supported shearlet frames[J]. IEEE Transactions on Image Processing, 2010, 19(5):1166-1180.

LIU X B, MEI W B, DU H Q. Structure tensor and nonsubsampled shearlet transform based algorithm for CT and MRI image fusion[J]. Neurocomputing, 2017, 235:131-139.

CHENG B Y, JIN L X, LI G N. General fusion method for infrared and visual images via latent low-rank representation and local non-subsampled shearlet transform[J]. Infrared Physics & Technology, 2018, 92:68-77.

ZHAO J F, ZHOU Q, CHEN Y T, et al . Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition[J]. Infrared Physics & Technology, 2013, 56:93-99.

MA J L, ZHOU Z Q, BO W, et al . Infrared and visible image fusion based on visual saliency map and weighted least square optimization[J]. Infrared Physics & Technology, 2017, 82:8-17.

FU Z Z, XUE W, XU J, et al . Infrared and visible images fusion based on RPCA and NSCT[J]. Infrared Physics & Technology, 2016, 77:114-123.

LIU Z W, FENG Y, ZHANG Y F, et al . A fusion algorithm for infrared and visible images based on RDU-PCNN and ICA-bases in NSST domain[J]. Infrared Physics & Technology, 2016, 79:183-190.

XU X Z, SHAN D, WANG G Y, et al . Multimodal medical image fusion using PCNN optimized by the QPSO algorithm[J]. Applied Soft Computing, 2016, 46:588-595.

LIU G C, YAN S C. Latent Low-Rank Representation for subspace segmentation and feature extraction[C]// Proceedings of 2011 International Conference on Computer Vision . Barcelona, Spain: IEEE, 2011: 1615-1622.

陈广秋, 高印寒, 段锦, 等.基于奇异值分解的PCNN红外与可见光图像融合[J].液晶与显示, 2015, 30(1):126-136.

CHEN G Q, GAO Y H, DUAN J, et al . Fusion algorithm of infrared and visible images based on singular value decomposition and PCNN[J]. Chinese Journal of Liquid Crystals and Displays, 2015, 30(1):126-136. (in Chinese)

XIANG T Z, YAN L, GAO R R. A fusion algorithm for infrared and visible images based on adaptive dual-channel unit-linking PCNN in NSCT domain[J]. Infrared Physics & Technology, 2015, 69:53-61.

KONG W W, ZHANG L J, LEI Y. Novel fusion method for visible light and infrared images based on NSST-SF-PCNN[J]. Infrared Physics & Technology, 2014, 65:103-112.

LIU Y, CHEN X, PENG H, et al . Multi-focus image fusion with a deep convolutional neural network[J]. Information Fusion, 2017, 36:191-207.

MA J Y, CHEN C, LI C, et al . Infrared and visible image fusion via gradient transfer and total variation minimization[J]. Information Fusion, 2016, 31:100-109.

YIN H P, LI Y X, CHAI Y, et al . A novel sparse-representation-based multi-focus image fusion approach[J]. Neurocomputing, 2016, 216:216-229.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Robust stitching method for borehole wall images under multi-interference imaging conditions

Image defogging algorithm based on multi-scale residual feature fusion

Infrared and visible image fusion algorithm based on structure-texture decomposition

Laboratory flame image segmentation and recognition by fusing infrared and visible light

Fusion of NSCT infrared and visible images based on improved FT saliency detection

Related Author

LUO Qi

XU Wangming

LI Yaoxiang

ZHAO Yuhang

XIE Xindan

LI Xiaoyan

WANG Peng

DI Ruohai

Related Institution

School of Information Science and Engineering， Wuhan University of Science and Technology

School of Electronics and Information Engineering， Xi'an Technological University

School of Optoelectronic Engineering， Xi'an Technological University

School of Mechanical and Electrical Engineering， Xi'an Technological University

College of Electronic Information and Artificial Intelligence， Shaanxi University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰