Image fusion based on block principal pivoting nonnegative matrix in undecimated dual-tree complex wavelet domain

Qing-jiang CHEN; Bing-zhe WEI; Yu-zhou CHAI; Yan-bo ZHANG

doi:10.3788/YJYXS20163108.0784

您当前的位置：

首页 >

文章列表页 >

Image fusion based on block principal pivoting nonnegative matrix in undecimated dual-tree complex wavelet domain

Driving and Controlling | 更新时间：2020-07-07

- Image fusion based on block principal pivoting nonnegative matrix in undecimated dual-tree complex wavelet domain
- Chinese Journal of Liquid Crystals and Displays Vol. 31, Issue 8, Pages: 784-792(2016)
- 作者机构：
  
  1.西安建筑科技大学理学院, 陕西西安 710055
  2.陕西西安空间电子信息技术研究院, 陕西西安 710055
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20163108.0784
  CLC： TP391
- Received：18 January 2016，
  
  Accepted：18 March 2016，
  
  Published：2016-08
- 稿件说明：
移动端阅览
Qing-jiang CHEN, Bing-zhe WEI, Yu-zhou CHAI, et al. Image fusion based on block principal pivoting nonnegative matrix in undecimated dual-tree complex wavelet domain[J]. Chinese journal of liquid crystals and displays, 2016, 31(8): 784-792.
DOI：

Qing-jiang CHEN, Bing-zhe WEI, Yu-zhou CHAI, et al. Image fusion based on block principal pivoting nonnegative matrix in undecimated dual-tree complex wavelet domain[J]. Chinese journal of liquid crystals and displays, 2016, 31(8): 784-792. DOI： 10.3788/YJYXS20163108.0784.

摘要

提出了一种非抽样双树复小波变换（UDT-CWT）与基于块主元旋转的非负矩阵分解（BPP-NMF）相结合的多聚焦图像融合算法。利用UDT-CWT具有完美的平移不变性及良好的方向选择性，首先对图像进行多尺度、多方向分解并得到低频子带和高频子带系数；然后对低频子带系数采用块主元旋转的非负矩阵分解的融合策略，高频系数则选用高斯加权区域能量与区域标准差一致性选择的融合准则。最后对融合后的系数进行UDT-CWT逆变换得到重构图像。选用多组多聚焦图像进行融合并对融合结果进行主观视觉、客观方面的评价。试验结果表明，该融合算法不仅具有良好的视觉效果，同时在客观评价指标也优于一般的融合策略，验证了该算法的有效性。

Abstract

A multi-focus image fusion algorithm based on undecimated dual-tree complex wavelet transform(UDT-CWT) domain and block principal pivoting method for nonnegative matrix factorization(BPP-NMF) is proposed. Firstly

combined with its shift invariance and good directional selectivity

the source images are decomposed to sub-band images with multi-scales and multi-directions by UDT-CWT

thus the low frequency sub-band coefficients and high frequency sub-band coefficients are obtained. The fusion strategy of low frequency sub-band coefficients was based on the method of nonnegative matrix factorization which adopted the block principal pivoting method; while for high frequency sub-band

a fusion rule adopting the consistency selection of Gaussian-weighted regional energy and area standard deviation is presented. Finally

the fused low and high frequency coefficients are reconstructed to image by undecimated dual-tree complex wavelet inverse transform. Fusion result is done with several sets of different multi-focus images

both subjective visual evaluation and objective performance assessments of these results are implemented. Results indicate that the fusion algorithm not only has good subjective visual effects

but also better than other general fusion strategies in the objective evaluation; hence the algorithm is effective.

关键词

Keywords

references

许廷发, 李俊涛, 张一舟, 等.真彩色传递双波段图像融合[J].中国光学, 2014, 7(3):402-410.

XU T F, LI J T, ZHANG Y Z, et al . True color transfer for dual band image fusion[J]. Chinese Optics , 2014, 7(3): 402-410. (in Chinese)

PIELLA G. A general framework for multiresolution image fusion: from pixels to regions[J]. Information Fusion , 2003, 4(4): 259-280.

DAUBECHIES I. Ten Lectures on Wavelets [M]. Philadelphia: SIAM, l992.

STARCK J L, FADILI J, MURTAGH F. The undecimated wavelet decomposition and its reconstruction[J]. IEEE Transactions on Image Processing , 2007, 16(2): 297-309.

ROCKINGER O. Pixel-level fusion of image sequences using wavelet frames[C]. Proceedings of the 16th Leeds Applied Shape Research Workshop , Leeds: Leeds University Press, 1996: 149-154.

DUTILLEUX P. An implementation of the "algorithme à trous" to compute the wavelet transform [M]. COMBES J M, GROSSMANN A, TCHAMITCHIAN P. Wavelets: Inverse Problems and Theoretical Imaging, Berlin Heidelberg: Springer, 1990: 298-304.

UNSER M. Texture classification and segmentation using wavelet frames[J]. IEEE Transactions on Image Processing , 1995, 4(11): 1549-1560.

SELESNICK I W, BARANIUK R G, KINGSBURY N G. The dual-tree complex wavelet transform[J]. IEEE Signal Processing Magazine , 2005, 22(6): 123-151.

FAUQUEUR J, KINGSBURY N, ANDERSON R. Multiscale keypoint detection using the dual-tree complex wavelet transform[C]. Proceedings of the 2006 International Conference on Image Processing , Atlanta, GA: IEEE, 2006: 1625-1628.

CUNHA A L, ZHOU J, DO M N. The nonsubsampled contourlet transform: theory, design, and applications[J]. IEEE Transactions on Image Processing , 2006, 15(10): 3089-3101.

CAO Y, LI S T, HU J W. Multi-focus image fusion by nonsubsampled shearlet transform[C]. Proceedings of the Sixth International Conference on Image and Graphics , Hefei: IEEE, 2011: 17-21.

HILL P, ACHIM A, BULL D. The undecimated dual tree complex wavelet transform and its application to bivariate image denoising using a cauchy model[C]. Proceedings of the 201219th IEEE International Conference on Image Processing , Orlando: IEEE, 2012: 1205-1208.

严洁, 阮友田, 薛珮瑶.主被动光学图像融合技术研究[J].中国光学, 2015, 8(3):378-385.

YAN J, RUAN Y T, XUE P Y. Active and passive optical image fusion technology[J]. Chinese Optics , 2015, 8(3): 378-385. (in Chinese)

陈广秋, 高印寒, 刘广文, 等.有限离散剪切波域结合区域客观评价的图像融合[J].吉林大学学报(工学版), 2014, 44(6):1849-1859.

CHEN G Q, GAO Y H, LIU G W, et al . Image fusion based on area objective assessment in finite discrete shearlet transform domain[J]. Journal of Jilin University (Engineering and Technology Edition) , 2014, 44(6): 1849-1859. (in Chinese)

范艳玲, 杨明.基于双树复小波变换的多聚焦图像融合[J].核电子学与探测技术, 2014, 34(2):204-207, 221.

FAN Y L, YANG M. Multi-focus image fusion based on dual-tree complex wavelet transform[J]. Nuclear Electronics & Detection Technology , 2014, 34(2): 204-207, 221. (in Chinese)

LEE D D, SEUNG H S. Learning the parts of objects by non-negative matrix factorization.[J]. Nature , 1999, 401(6755): 788-791.

LEE D D, SEUNG H S. Algorithms for non-negative matrix factorization[C]. Proceedings of the 2000 Conference Advances in Neural Information Processing Systems 13 , Cambridge, MA: MTP Press, 2000: 556-562.

LIN C J. Projected gradient methods for nonnegative matrix factorization[J]. Neural Computation , 2007, 19(10): 2756-2779.

KIM D, SRA S, DHILLON I S. Fast newton-type methods for the least squares nonnegative matrix approximation problem[C]. Proceedings of the 2007 SIAM International Conference on Data Mining , Minnesota: SIAM, 2007: 38-51.

KIM H, PARK H. Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method[J]. SIAM Journal on Matrix Analysis and Applications , 2008, 30(2): 713-730.

KIM J, PARK H. Fast nonnegative matrix factorization: an active-set-like method and comparisons[J]. SIAM Journal on Scientific Computing , 2011, 33(6): 3261-3281.

陈广秋, 高印寒, 才华, 等.局部化NSST与PCNN相结合的图像融合[J].液晶与显示, 2015, 30(4):701-712.

CHEN G Q, GAO Y H, CAI H, et al . Image fusion algorithm based on local NSST and PCNN[J]. Chinese Journal of Liquid Crystals and Displays , 2015, 30(4): 701-712. (in Chinese)

王宇庆, 王索建.红外与可见光融合图像的质量评价[J].中国光学, 2014, 7(3):396-401.

WANG Y Q, WANG S J. Quality assessment method of IR and visible fusion image[J]. Chinese Optics , 2014, 7(3): 396-401. (in Chinese)

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Robust stitching method for borehole wall images under multi-interference imaging conditions

Image defogging algorithm based on multi-scale residual feature fusion

Infrared and visible image fusion algorithm based on structure-texture decomposition

Laboratory flame image segmentation and recognition by fusing infrared and visible light

Fusion of NSCT infrared and visible images based on improved FT saliency detection

Related Author

ZHAO Yuhang

LI Yaoxiang

XU Wangming

LUO Qi

LI Xiaoyan

WANG Peng

DI Ruohai

XIE Xindan

Related Institution

School of Information Science and Engineering， Wuhan University of Science and Technology

School of Electronics and Information Engineering， Xi'an Technological University

School of Optoelectronic Engineering， Xi'an Technological University

School of Mechanical and Electrical Engineering， Xi'an Technological University

College of Electronic Information and Artificial Intelligence， Shaanxi University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰