Fast multi-exposure image fusion for HDR video

PIAO Yong-jie; XU Wei; WANG Shao-ju; TAO Shu-ping

doi:10.3788/YJYXS20142906.1032

您当前的位置：

首页 >

文章列表页 >

Fast multi-exposure image fusion for HDR video

Table of contents | 更新时间：2020-08-12

- Fast multi-exposure image fusion for HDR video
- Chinese Journal of Liquid Crystals and Displays Vol. 29, Issue 6, Pages: 1032-1041(2014)
- 作者机构：
  
  中国科学院长春光学精密机械与物理研究所小卫星技术国家地方联合工程研究中心,吉林长春,130033
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20142906.1032
  CLC： TH703;TP391
- Received：08 April 2014，
  
  Revised：08 May 2014，
  
  Published：05 December 2014
- 稿件说明：
移动端阅览
朴永杰, 徐伟, 王绍举, 陶淑苹. 高动态范围视频的多曝光图像序列快速融合[J]. 液晶与显示, 2014,29(6): 1032-1041

PIAO Yong-jie, XU Wei, WANG Shao-ju, TAO Shu-ping. Fast multi-exposure image fusion for HDR video[J]. , 2014,29(6): 1032-1041
朴永杰, 徐伟, 王绍举, 陶淑苹. 高动态范围视频的多曝光图像序列快速融合[J]. 液晶与显示, 2014,29(6): 1032-1041 DOI： 10.3788/YJYXS20142906.1032.

PIAO Yong-jie, XU Wei, WANG Shao-ju, TAO Shu-ping. Fast multi-exposure image fusion for HDR video[J]. , 2014,29(6): 1032-1041 DOI： 10.3788/YJYXS20142906.1032.

摘要

使用多次曝光法进行高动态范围视频获取时，需要将多幅低动态范围（LDR）图像进行快速融合，并满足视频融合系统的实时性要求。本文提出了一种改进的快速多分辨率塔形分解融合算法，在不降低原有算法融合质量的前提下极大减少计算量。算法分别从金字塔分解卷积核、高斯系数扩展插值方法、拉普拉斯系数融合规则、高斯系数融合规则等方面进行改进，简化了塔形分解、融合和重构过程。该方法应用在某运载火箭视频采集系统中，实验结果表明，该改进算法稳定性强，融合质量高，并极大地减少了计算量，运算速度提高了10倍以上，在TMS320DM642 DSP上一帧512512图像的融合时间约为8.9 ms，满足25 fps高动态范围视频融合的实时性要求。

Abstract

Fast fusion of multiple low dynamic range(LDR) images is essential for the real-time performance of a high dynamic range(HDR) video acquisition system using multi-exposure method. This paper proposed an improved fusion algorithm based on multi-resolution pyramid decompose. The algorithm dramatically reduces computing complexity while preserving the fusion quality of the original method. The proposed method improves the real-time performance in the following aspects: pyramid decompose convolution core

Gaussian coefficients expansion method

Laplacian coefficients fusion rule

Gaussian coefficients fusion rule. The computing complexity of pyramid decomposes

fusion

and reconstruction is reduced. Experiment results shows that the proposed method is stable and got good fusion results. The method is applied to a launch vehicle observation system. The computing speed is boosted 10 times and it takes 8.9 ms to fuse one 512512 frame on TM320MD642 DSP

fulfilling the real-time requirement of 25 fps HDR video acquisition system.

关键词

Keywords

references

关澈, 王延杰. CCD 相机实时自动调光系统[J]. 光学精密工程, 2008, 16(2): 358-366. Guan C, Wang Y. Real-time auto light control system of CCD camera[J].Opt. Precision Eng.,2008, 16(2): 358-366.(in Chinese)[2] 杨海涛, 常义林, 王静, 等. 一种基于亮度直方图的自动曝光控制方法[J]. 光学学报, 2007, 27(5):841-847. Zhou H T, Chang Y L, Wang J,et al.A new automatic exposure algorithm for video cameras using luminance histogram[J].Acta Optica Sinica,2001,8(6): 50-53.(in Chinese)[3] 苏宏武, 杨小君, 李哲, 等. 基于平均和峰值灰度加权的自动调光系统[J]. 光子学报, 2006, 35(1): 158-160. Su H W, Yang X J, Li Z,et al.Automatic adjust light systems based on combined average gray with peak gray[J].Acta Optica Sinica,2006, 35(1): 158-160.(in Chinese)[4] Mann S, Picard R W. On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures[C].IS&T's 48th Annual Conference,1995: 422-428.[5] Nayar S K, Mitsunaga T. High dynamic range imaging: spatially varying pixel exposures[C].Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,2000.[6] Robertson M A, Borman S, Stevenson R L. Estimation-theoretic approach to dynamic range enhancement using multiple exposures[J].Journal of Electronic Imaging,2003, 12(2): 219-228.[7] 杨作廷, 阮萍, 翟波. 基于图像熵的高动态范围场景的自动曝光算法[J]. 光子学报, 2013, 42(6): 742-746. Yang Z T, Ruan P, Zhai B. Auto-exposure algorithm for scenes with high dynamic range based on image entropy[J].Acta Optica Sinica,2013, 42(6): 742-746.(in Chinese)[8] 唐艳秋, 张星祥, 李新娥, 等. 基于人眼视觉灰度识别特性的图像动态范围小波变换处理方法[J]. 液晶与显示, 2012, 27(3): 385-390. Tang Y Q, Zhang X X, Li X E,et al.Image processing method of dynamic range with wavelet transform based on human visual gray recognition characteristics[J].Chinese Journal of Liquid Crystals and Displays,2012, 27(3): 385-390.(in Chinese)[9] 朴永杰, 徐伟, 张贵祥. 高动态范围视频的多曝光时间自适应快速选择[J]. 光学精密工程, 2012, 20(12): 216-223. Piao Y J, Xu W, Zhang G X. Fast and adaptive decision of exposure time in multi-exposure HDR video[J].Opt. Precision Eng.,2012, 20(12): 216-223.(in Chinese)[10] Piella G. A region-based multiresolution image fusion algorithm[C].Proeeedings of the 5th International Conference on Information Fusion,2002:1557-1564.[11] Barakat N, Darcie T E. Minimal capture sets for multi-exposure enhanced-dynamic-range imaging[C].Proceedings of International Symposium on Signal Processing and Information Technology,2006: 524-529.[12] Burt P J, Anelson E H. The Laplacian pyramid as a compact image code[J].IEEE Transactions on Communications,1983, 31(4): 532-540.[13] Mertens T, Kautz J , Reeth F V. Exposure fusion[C]. Proceedings of 15th Pacific Conference on Computer Graphics and Applications,2007: 382-390.[14] Schlik C. Quantization techniques for visualization of high dynamic range pictures[C].5th Eurographics Workshop on Rendering,1994: 7-18.[15] Vuong Q K, Yun S H, Kim S. A new auto exposure and auto white-balance algorithm to detect high dynamic range conditions using CMOS technology[C].Proceedings of the World Congress on Engineering and Computer Science,2008: 210-205.[16] Blinn J. Dirty pixels[J].IEEE Computer Graphics Application,1989(9): 100-105.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Robust stitching method for borehole wall images under multi-interference imaging conditions

Image defogging algorithm based on multi-scale residual feature fusion

Infrared and visible image fusion algorithm based on structure-texture decomposition

Laboratory flame image segmentation and recognition by fusing infrared and visible light

Fusion of NSCT infrared and visible images based on improved FT saliency detection

Related Author

ZHAO Yuhang

LUO Qi

XU Wangming

LI Yaoxiang

SUN Mengyu

DI Ruohai

WANG Peng

LI Xiaoyan

Related Institution

School of Information Science and Engineering， Wuhan University of Science and Technology

School of Electronics and Information Engineering， Xi'an Technological University

School of Optoelectronic Engineering， Xi'an Technological University

School of Mechanical and Electrical Engineering， Xi'an Technological University

College of Electronic Information and Artificial Intelligence， Shaanxi University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰