基于双残差卷积网络的低照度图像增强

陈清江; 屈梅

doi:10.37188/CJLCD.2020-0168

您当前的位置：

首页 >

文章列表页 >

基于双残差卷积网络的低照度图像增强

图像处理 | 更新时间：2021-02-07

- 基于双残差卷积网络的低照度图像增强
- Low-light image enhancement based on dual-residual convolutional network
- 液晶与显示 2021年36卷第2期页码：305-316
- 作者机构：
  
  西安建筑科技大学理学院, 陕西西安 710055
- 作者简介：
  
  [ "陈清江(1966-), 男, 河南信阳人, 博士, 教授, 2006年于西安交通大学获博士学位, 主要从事小波分析、图像处理与信号处理方面的研究。E-mail:qjchen66xytu@126.com" ]
  [ "屈梅(1999-), 女, 陕西汉中人, 硕士研究生, 2018年于咸阳师范学院获得学士学位, 主要从事小波分析、图像处理与信号处理方面的研究。E-mail:862907196@qq.com" ]
- 基金信息：
  
  国家自然科学基金(61403298);陕西省自然科学基金(2015JM1024)
- DOI：10.37188/CJLCD.2020-0168
  中图分类号： TP391.4
- 收稿日期：2020-06-26，
  
  修回日期：2020-09-08，
  
  录用日期：2020-9-8，
  
  纸质出版日期：2021-02
- 稿件说明：
移动端阅览
陈清江, 屈梅. 基于双残差卷积网络的低照度图像增强[J]. 液晶与显示, 2021,36(2):305-316.

Qing-jiang CHEN, Mei QU. Low-light image enhancement based on dual-residual convolutional network[J]. Chinese journal of liquid crystals and displays, 2021, 36(2): 305-316.
陈清江, 屈梅. 基于双残差卷积网络的低照度图像增强[J]. 液晶与显示, 2021,36(2):305-316. DOI： 10.37188/CJLCD.2020-0168.

Qing-jiang CHEN, Mei QU. Low-light image enhancement based on dual-residual convolutional network[J]. Chinese journal of liquid crystals and displays, 2021, 36(2): 305-316. DOI： 10.37188/CJLCD.2020-0168.

摘要

为解决当前低照度图像增强问题，提出了一种基于双残差卷积网络的图像增强算法。首先，根据Retinex理论模型，将正常照度图像合成低照度图像，再分别将它们分解在R（红）、G（绿）、B（蓝）3个分量上，然后通过特征提取模块和双残差模块学习低照度图像与正常照度图像在各分量的映射关系，获得各分量上的增强图像，最后合成增强的RGB图像。采用双边滤波优化增强的RGB图像，使得所获得的图像更加接近参考图像。实验表明，本文所提算法，对于处理合成的低照度图像，峰值信噪比最高可达25.931 1 dB，结构相似度最高可达0.945 2；对于处理真实的低照度图像，盲图像质量评估指标高于其他算法，且运行速度更快。

Abstract

In order to solve the current problem about low-light image enhancement

an algorithm of image enhancement based on dual-residual convolutional network is proposed. First

according to Retinex theory

the normal-light image is synthesized into low-light image

the synthetic is decomposed onto the three components of R、G and B

and learning the mapping relations between low-light image and normal-light image on all components through the module of feature extraction as well as dual-residual. Then the enhanced image on all components can be obtained

and finally the enhanced RGB image is synthesized. Subsequently

the bilateral filtering is used to optimize the enhanced RGB image so that the obtained image is analogical to the reference image.The experiment results show that the algorithm proposed in this paper

whose Peak Signal to Noise Ratio can reach up to 25.931 1 dB and Structural Similarity Index can reach up to 0.945 2 in terms of processing synthesized low-light image

and whose novel blind image quality assessment can exceed other compared algorithms and the algorithm in this paper goes faster in terms of processing real low-light image.Therefore

the proposed algorithm is superior to the contrast algorithms.

关键词

Keywords

references

H LANDE . The retinex theory of color vision . Scientific American , 1977 . 237 ( 6 ): 108 - 128 . DOI: 10.1038/scientificamerican1277-108 http://doi.org/10.1038/scientificamerican1277-108 .

S M PIZER , E P AMBURN , J D AUSTIN , 等 . Adaptive histogram equalization and its variations . Computer Vision, Graphics, and Image Processing , 1987 . 39 ( 3 ): 355 - 368 . DOI: 10.1016/S0734-189X(87)80186-X http://doi.org/10.1016/S0734-189X(87)80186-X .

A M REZA . Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement . Journal of VLSI Signal Processing Systems for Signal, Image and Video Technology , 2004 . 38 ( 1 ): 35 - 44 . DOI: 10.1023/B:VLSI.0000028532.53893.82 http://doi.org/10.1023/B:VLSI.0000028532.53893.82 .

D J JOBSON , Z RAHMAN , G A WOODELL . Properties and performance of a center/surround Retinex . IEEE Transactions on Image Processing , 1997 . 6 ( 3 ): 451 - 462 . DOI: 10.1109/83.557356 http://doi.org/10.1109/83.557356 .

H N LIN , Z W SHI . Multi-scale retinex improvement for nighttime image enhancement . Optik , 2014 . 125 ( 24 ): 7143 - 7148 . DOI: 10.1016/j.ijleo.2014.07.118 http://doi.org/10.1016/j.ijleo.2014.07.118 .

X Y FU , D L ZENG , Y HUANG , 等 . A fusion-based enhancing method for weakly illuminated images . Signal Processing , 2016 . 129 82 - 96 . DOI: 10.1016/j.sigpro.2016.05.031 http://doi.org/10.1016/j.sigpro.2016.05.031 .

YING Z Q, LI G, GAO W. A bio-inspired multi-exposure fusion framework for low-light image enhancement[J]. arXiv: 1711.00591, 2017.

REN X T, LI M D, CHENG W H, et al . Joint enhancement and denoising method via sequential decomposition[C]// Proceedings of 2018 IEEE International Symposium on Circuits and Systems . Florence, Italy: IEEE, 2018: 1-5.

刘峰 , 沈同圣 , 马新星 , 等 . 基于多波段深度神经网络的舰船目标识别 . 光学精密工程 , 2017 . 25 ( 11 ): 2939 - 2946 .

F LIU , T S SHEN , X X MA , 等 . Ship recognition based on multi-band deep neural Network . Optics and Precision Engineering , 2017 . 25 ( 11 ): 2939 - 2946 .

谢冰 , 段哲民 , 郑宾 , 等 . 基于迁移学习SAE的无人机目标识别算法研究 . 红外与激光工程 , 2018 . 47 ( 6 ): 0626001 .

B XIE , Z M DUAN , B ZHENG , 等 . Research on UAV target recognition algorithm based on transfer learning SAE . Infrared and Laser Engineering , 2018 . 47 ( 6 ): 0626001 .

梁华 , 宋玉龙 , 钱锋 , 等 . 基于深度学习的航空对地小目标检测 . 液晶与显示 , 2018 . 33 ( 9 ): 793 - 800 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1379565&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1379565&Fpath=&index=-1&l=zh .

H LIANG , Y L SONG , F QIAN , 等 . Detection of small target in aerial photography based on deep learning . Chinese Journal of Liquid Crystals and Displays , 2018 . 33 ( 9 ): 793 - 800 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1379565&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1379565&Fpath=&index=-1&l=zh .

黄乐弘 , 曹立华 , 李宁 , 等 . 深度学习的空间红外弱小目标状态感知方法 . 中国光学 , 2020 . 13 ( 3 ): 527 - 536 .

L H HUANG , L H CAO , N LI , 等 . A state perception method for infrared dim and small targets with deep learning . Chinese Optics , 2020 . 13 ( 3 ): 527 - 536 .

吴磊 , 吕国强 , 赵晨 , 等 . 基于多尺度残差网络的CT图像超分辨率重建 . 液晶与显示 , 2019 . 34 ( 10 ): 1006 - 1012 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1384623&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1384623&Fpath=&index=-1&l=zh .

L WU , G Q LYU , C ZHAO , 等 . CT image super-resolution reconstruction based on multi-scale residual network . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 10 ): 1006 - 1012 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1384623&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1384623&Fpath=&index=-1&l=zh .

DONG C, LOY C C, HE K M, et al . Learning a deep convolutional network for image super-resolution[C]// Proceedings of the 13 th European Conference on Computer Vision-ECCV 2014. Zurich, Switzerland: Springer, 2014: 184-199.

T Y CHEN , C Z FU . Single-image-based rain detection and removal via CNN . Journal of Physics:Conference Series , 2018 . 1004 012007 DOI: 10.1088/1742-6596/1004/1/012007 http://doi.org/10.1088/1742-6596/1004/1/012007 .

Y C GUO , C LI , Q LIU . R 2 N:a novel deep learning architecture for rain removal from single image . Computers, Materials & Continua , 2019 . 58 ( 3 ): 829 - 843 . http://www.researchgate.net/publication/331615963_R2N_A_Novel_Deep_Learning_Architecture_for_Rain_Removal_from_Single_Image http://www.researchgate.net/publication/331615963_R2N_A_Novel_Deep_Learning_Architecture_for_Rain_Removal_from_Single_Image .

C Y LI , J C GUO , F PORIKLI , 等 . LightenNet:a convolutional neural network for weakly illuminated image enhancement . Pattern Recognition Letters , 2018 . 104 15 - 22 . DOI: 10.1016/j.patrec.2018.01.010 http://doi.org/10.1016/j.patrec.2018.01.010 .

马红强 , 马时平 , 许悦雷 , 等 . 基于深度卷积神经网络的低照度图像增强 . 光学学报 , 2019 . 39 ( 2 ): 0210004 .

H Q MA , S P MA , Y L XU , 等 . Low-light image enhancement based on deep convolutional neural network . Acta Optica Sinica , 2019 . 39 ( 2 ): 0210004 .

CHEN X Y, WANG S A. Superpixel segmentation based on Delaunay triangulation[C]// Proceedings of the 23 rd International Conference on Mechatronics and Machine Vision in Practice ( M 2 VIP ). Nanjing, China: IEEE, 2016: 1-6.

K MA , K ZENG , Z WANG . Perceptual quality assessment for multi-exposure image fusion . IEEE Transactions on Image Processing , 2015 . 24 ( 11 ): 3345 - 3356 . DOI: 10.1109/TIP.2015.2442920 http://doi.org/10.1109/TIP.2015.2442920 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

NCA-MobileNet：一种轻量化人脸表情识别方法

半监督空谱局部判别分析的高光谱影像特征提取

改进YOLOv5s的道路目标检测算法

复合残差网络在低照度图像增强中的技术研究

复杂海背景下的自适应舰船目标检测