显示设备环境自适应色调映射算法

弓殷强; 余新; 邱国平

doi:10.37188/CJLCD.2021-0100

您当前的位置：

首页 >

文章列表页 >

显示设备环境自适应色调映射算法

显示技术与应用 | 更新时间：2021-12-10

- 显示设备环境自适应色调映射算法
- Environment adaptive tone mapping algorithm for display devices
- 液晶与显示 2021年36卷第12期页码：1645-1657
- 作者机构：
  
  深圳大学电子与信息工程学院, 广东深圳 518052
- 作者简介：
  
  [ "弓殷强(1992-), 男, 陕西宝鸡人, 博士, 研究员, 2019年于北京大学获得博士学位, 主要从事HDR、图像处理、显示技术方面的研究。E-mail: yqgong@appotronics.cn" ]
  [ "邱国平(1964-), 男, 广东河源人, 博士, 教授, 1993于英国兰开夏大学获得博士学位, 主要从事HDR、图像处理、模式识别、计算机视觉、机器学习和多媒体信号处理等方面的研究。E-mail: guoping.qiu@nottingham.ac.uk" ]
- 基金信息：
  
  国家重点研发计划(2018YFB0406800);广东省重点领域研发计划(2019B010926001);广东省省级科技计划(2018B030323014)
- DOI：10.37188/CJLCD.2021-0100
  中图分类号： TN27;TN29
- 收稿日期：2021-04-14，
  
  修回日期：2021-05-11，
  
  纸质出版日期：2021-12
- 稿件说明：
移动端阅览
弓殷强, 余新, 邱国平. 显示设备环境自适应色调映射算法[J]. 液晶与显示, 2021,36(12):1645-1657.

Yin-qiang GONG, Xin YU, Guo-ping QIU. Environment adaptive tone mapping algorithm for display devices[J]. Chinese journal of liquid crystals and displays, 2021, 36(12): 1645-1657.
弓殷强, 余新, 邱国平. 显示设备环境自适应色调映射算法[J]. 液晶与显示, 2021,36(12):1645-1657. DOI： 10.37188/CJLCD.2021-0100.

Yin-qiang GONG, Xin YU, Guo-ping QIU. Environment adaptive tone mapping algorithm for display devices[J]. Chinese journal of liquid crystals and displays, 2021, 36(12): 1645-1657. DOI： 10.37188/CJLCD.2021-0100.

摘要

环境光对显示和感知的不利影响是提高显示设备画质的重要障碍之一。本研究提出了一种色调映射算法，可以根据环境光的亮度和颜色自适应调整图像的亮度和颜色，实现不同亮度范围内图像的可靠亮度映射和颜色校正。首先，分析环境光对显示设备的影响，建立显示设备模型。接着，利用对比度感知模型作为桥梁，求解最小化对比度感知差异的亮度映射曲线。然后，利用色貌模型CAM16，将原始图像映射到显示设备所处的环境中，并且保持颜色和亮度的感知不变。最后，将亮度映射和颜色修正结合起来，并设计了软截断函数修正过曝问题。实验和仿真结果表明：在不同的环境下，该算法可以修复由于亮度压缩导致的颜色偏离，将颜色的误差降低到传统方法的60%以下，降低对比度感知误差，获得稳定的画面表现。本算法可以满足复杂环境下显示设备的使用需求。

Abstract

Ambient light has always been one of the essential obstacles to improving display devices' image quality. In this study

a tone mapping algorithm is proposed

which can adjust the luminance and color of the image to achieve reliable luminance mapping and color correction of the image in different luminance ranges. Firstly

the influence of ambient light on the display device is analyzed

and the display device model is established. Secondly

the contrast perception model was used as a bridge to solve the luminance mapping curve to minimize the contrast perception difference. Then

using the color appearance model CAM16

the original image is mapped into the environment where the display device is located

while the perception of color and brightness remains unchanged. Finally

luminance mapping and color correction are combined

and a soft clip function is designed to correct the overexposure problem. Experimental and simulation results show that under different environments

the algorithm can repair the color deviation caused by luminance compression

reduce the color error to less than 60% of the traditional method

reduce the contrast perception error

and obtain a stable image performance. The requirements of display devices in a complex environment can be met.

关键词

Keywords

references

B HOEFFLINGER . High-Dynamic-Range (HDR) Vision: Microelectronics, Image Processing, Computer Graphics , : Berlin Heidelberg Springer , 2007 .

J J MCCANN , A RIZZI . The Art and Science of HDR Imaging , : Chichester John Wiley & Son , 2012 .

A ARTUSI , T RICHTER , T EBRAHIMI , 等 . High dynamic range imaging technology . IEEE Signal Processing Magazine , 2017 . 34 ( 5 ): 165 - 172 . DOI: 10.1109/MSP.2017.2716957 http://doi.org/10.1109/MSP.2017.2716957 .

F BANTERLE , A ARTUSI , K DEBATTISTA , 等 . Advanced High Dynamic Range Imaging , 2nd ed : Boca Raton Taylor & Francis , 2018 .

SMPTE. ST 2094-1: 2016 -SMPTE standard dynamic metadata for color volume transform-core components[S]. SMPTE, NewYork: 2016.

J TUMBLIN , H RUSHMEIER . Tone reproduction for realistic images . IEEE Computer Graphics and Applications , 1993 . 13 ( 6 ): 42 - 48 . DOI: 10.1109/38.252554 http://doi.org/10.1109/38.252554 .

FERWERDA J A, PATTANAIK S N, SHIRLEY P, et al . A model of visual adaptation for realistic image synthesis[C]// Proceedings of the 23 rd Annual Conference on Computer Graphics and Interactive Techniques . New Orleans: Association for Computing Machinery, 1996: 249-258.

G W LARSON , H RUSHMEIER , C PIATKO . A visibility matching tone reproduction operator for high dynamic range scenes . IEEE Transactions on Visualization and Computer Graphics , 1997 . 3 ( 4 ): 291 - 306 . DOI: 10.1109/2945.646233 http://doi.org/10.1109/2945.646233 .

E REINHARD , M STARK , P SHIRLEY , 等 . Photographic tone reproduction for digital images . ACM Transactions on Graphics , 2002 . 21 ( 3 ): 267 - 276 . DOI: 10.1145/566654.566575 http://doi.org/10.1145/566654.566575 .

DUAN J, QIU G P. Fast tone mapping for high dynamic range images[C]// Proceedings of the 17 th International Conference on Pattern Recognition , 2004. ICPR 2004. Cambridge: IEEE, 2004: 847-850.

E REINHARD , K DEVLIN . Dynamic range reduction inspired by photoreceptor physiology . IEEE Transactions on Visualization and Computer Graphics , 2005 . 11 ( 1 ): 13 - 24 . DOI: 10.1109/TVCG.2005.9 http://doi.org/10.1109/TVCG.2005.9 .

QIU G P, DUAN J. An optimal tone reproduction curve operator for the display of high dynamic range images[C]//2005 IEEE International Symposium on Circuits and Systems . Kobe: IEEE, 2005: 6276-6279.

J DUAN , M BRESSAN , C DANCE , 等 . Tone-mapping high dynamic range images by novel histogram adjustment . Pattern Recognition , 2010 . 43 ( 5 ): 1847 - 1862 . DOI: 10.1016/j.patcog.2009.12.006 http://doi.org/10.1016/j.patcog.2009.12.006 .

QIU G P, MEI Y J, LAM K M, et al . Tone mapping HDR images using optimization: a general framework[C]//2010 IEEE International Conference on Image Processing . Hong Kong, China: IEEE, 2010: 3129-3132.

S PARIS , S W HASINOFF , J KAUTZ . Local Laplacian filters: edge-aware image processing with a Laplacian pyramid . Communications of the ACM , 2015 . 58 ( 3 ): 81 - 91 . DOI: 10.1145/2723694 http://doi.org/10.1145/2723694 .

E ŠIKUDOVÁ , T POULI , A ARTUSI , 等 . A gamut-mapping framework for color-accurate reproduction of HDR images . IEEE Computer Graphics and Applications , 2016 . 36 ( 4 ): 78 - 90 . DOI: 10.1109/MCG.2015.116 http://doi.org/10.1109/MCG.2015.116 .

H H CHOI , H S KANG , B J YUN . Tone mapping of high dynamic range images combining co-occurrence histogram and visual salience detection . Applied Sciences , 2019 . 9 ( 21 ): 4658 DOI: 10.3390/app9214658 http://doi.org/10.3390/app9214658 .

欧海燕 , 郭太良 , 姚剑敏 , 等 . 基于分层色调映射的LED背光调制算法 . 液晶与显示 , 2011 . 26 ( 2 ): 246 - 249 .

H Y OU , T L GUO , J M YAO , 等 . Modulation of LED backlight based on hierarchical tone mapping algorithm . Chinese Journal of Liquid Crystals and Displays , 2011 . 26 ( 2 ): 246 - 249 .

芦碧波 , 皇甫珍珍 , 郭凯 , 等 . 基于双边滤波的多尺度分层色调映射算法 . 液晶与显示 , 2018 . 33 ( 9 ): 816 - 822 . DOI: 10.3788/YJYXS20183309.0816 http://doi.org/10.3788/YJYXS20183309.0816 .

B B LU , Z Z HUANGFU , K GUO , 等 . Bilateral filter based multiscale layer tone mapping algorithm . Chinese Journal of Liquid Crystals and Displays , 2018 . 33 ( 9 ): 816 - 822 . DOI: 10.3788/YJYXS20183309.0816 http://doi.org/10.3788/YJYXS20183309.0816 .

王峰 , 严利民 . 一种亮度分区和导向滤波相结合的色调映射算法 . 液晶与显示 , 2019 . 34 ( 10 ): 1000 - 1005 . DOI: 10.3788/YJYXS20193410.1000 http://doi.org/10.3788/YJYXS20193410.1000 .

F WANG , L M YAN . Tone mapping algorithm combining luminance partitioning and guiding filtering . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 10 ): 1000 - 1005 . DOI: 10.3788/YJYXS20193410.1000 http://doi.org/10.3788/YJYXS20193410.1000 .

张涛 , 胡孟阳 , 杜文丽 , 等 . 一种新型可调节的自适应区域调光方法 . 激光与光电子学进展 , 2020 . 57 ( 12 ): 121017 .

T ZHANG , M Y HU , W L DU , 等 . Adjustable adaptive local dimming method . Laser & Optoelectronics Progress , 2020 . 57 ( 12 ): 121017 .

R MANTIUK , S DALY , L KEROFSKY . Display adaptive tone mapping . ACM Transactions on Graphics , 2008 . 27 ( 3 ): 1 - 10 .

REMPEL A G, HEIDRICH W, LI H, et al . Video viewing preferences for HDR displays under varying ambient illumination[C]// Proceedings of the 6 th Symposium on Applied Perception in Graphics and Visualization . Chania, Crete, Greece: Association for Computing Machinery, 2009: 45-52.

REINHARD E. Tone reproduction and color appearance modeling: two sides of the same coin?[C]// Color Imaging Conference , 19 th Color and Imaging Conference Final Program and Proceedings . San Jose: Society for Imaging Science and Technology, 2011: 171-176.

WANG L, JUNG C. Surrounding adaptive tone mapping in displayed images under ambient light[C]//2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . New Orleans, LA: IEEE, 2017: 1992-1996.

J C STEVENS , S S STEVENS . Brightness function: effects of adaptation . Journal of the Optical Society of America , 1963 . 53 ( 3 ): 375 - 385 . DOI: 10.1364/JOSA.53.000375 http://doi.org/10.1364/JOSA.53.000375 .

M D FAIRCHILD . Color Appearance Models , : Chichester, West Sussex John Wiley & Sons, Inc. , 2013 .

R S BERNS . Billmeyer and Saltzman's Principles of Color Technology , 4th ed : Hoboken, NJ John Wiley & Sons, Inc. , 2019 .

H R WILSON . A transducer function for threshold and suprathreshold human vision . Biological Cybernetics , 1980 . 38 ( 3 ): 171 - 178 . DOI: 10.1007/BF00337406 http://doi.org/10.1007/BF00337406 .

C J LI , Z Q LI , Z F WANG , 等 . Comprehensive color solutions: CAM16, CAT16, and CAM16-UCS . Color Research & Application , 2017 . 42 ( 6 ): 703 - 718 . http://www.onacademic.com/detail/journal_1000039925048910_8a1c.html http://www.onacademic.com/detail/journal_1000039925048910_8a1c.html .

Y F OU , P AMBALATHANKANDY , S TAKAMAEDA , 等 . Real-time tone mapping: a survey and cross-implementation hardware benchmark . IEEE Transactions on Circuits and Systems for Video Technology , 2021 . DOI: 10.1109/TCSVT.2021.3060143 http://doi.org/10.1109/TCSVT.2021.3060143 .

G EILERTSEN , R K MANTIUK , J UNGER . A comparative review of tone-mapping algorithms for high dynamic range video . Computer Graphics Forum , 2017 . 36 ( 2 ): 565 - 592 . DOI: 10.1111/cgf.13148 http://doi.org/10.1111/cgf.13148 .

冯维 , 刘红帝 , 吴贵铭 , 等 . 基于颜色校正模型的梯度域自适应色调映射算法 . 激光与光电子学进展 , 2020 . 57 ( 8 ): 081007 .

W FENG , H D LIU , G M WU , 等 . Gradient domain adaptive tone mapping algorithm based on color correction model . Laser & Optoelectronics Progress , 2020 . 57 ( 8 ): 081007 .

FAIRCHILD M D. The HDR photographic survey[C]//15 th Color and Imaging Conference . Albuquerque: Society for Imaging Science and Technology, 2007: 233-238.

IEC. IEC 61966-2-1 Multimedia systems and equipment-colour measurement and management-Part 2-1: colour management-Default RGB colour space-sRGB[S]. International Electrotechnical Commission, 1999.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于快速局部对比度和目标特征的星图弱小目标检测算法

量子点LED显示研究进展：材料、封装涂层、图案化显示应用

基于颜色名称的彩色图像质量评价

Micro-LED显示的发展现状与技术挑战