Environment adaptive tone mapping algorithm for display devices

Yin-qiang GONG; Xin YU; Guo-ping QIU

doi:10.37188/CJLCD.2021-0100

您当前的位置：

首页 >

文章列表页 >

Environment adaptive tone mapping algorithm for display devices

Display Technologyand Applications | 更新时间：2021-12-10

- Environment adaptive tone mapping algorithm for display devices
- Chinese Journal of Liquid Crystals and Displays Vol. 36, Issue 12, Pages: 1645-1657(2021)
- 作者机构：
  
  深圳大学电子与信息工程学院, 广东深圳 518052
- 作者简介：
- 基金信息：
  
  Supported by National Key R&D Program of China(2018YFB0406800);Key-Area Research and Development Program of GuangDong Province(2019B010926001);Science and Technology Planning Project of Guangdong Province(2018B030323014)
- DOI：10.37188/CJLCD.2021-0100
  CLC： TN27;TN29
- Received：14 April 2021，
  
  Revised：11 May 2021，
  
  Published：2021-12
- 稿件说明：
移动端阅览
Yin-qiang GONG, Xin YU, Guo-ping QIU. Environment adaptive tone mapping algorithm for display devices[J]. Chinese journal of liquid crystals and displays, 2021, 36(12): 1645-1657.
DOI：

Yin-qiang GONG, Xin YU, Guo-ping QIU. Environment adaptive tone mapping algorithm for display devices[J]. Chinese journal of liquid crystals and displays, 2021, 36(12): 1645-1657. DOI： 10.37188/CJLCD.2021-0100.

摘要

环境光对显示和感知的不利影响是提高显示设备画质的重要障碍之一。本研究提出了一种色调映射算法，可以根据环境光的亮度和颜色自适应调整图像的亮度和颜色，实现不同亮度范围内图像的可靠亮度映射和颜色校正。首先，分析环境光对显示设备的影响，建立显示设备模型。接着，利用对比度感知模型作为桥梁，求解最小化对比度感知差异的亮度映射曲线。然后，利用色貌模型CAM16，将原始图像映射到显示设备所处的环境中，并且保持颜色和亮度的感知不变。最后，将亮度映射和颜色修正结合起来，并设计了软截断函数修正过曝问题。实验和仿真结果表明：在不同的环境下，该算法可以修复由于亮度压缩导致的颜色偏离，将颜色的误差降低到传统方法的60%以下，降低对比度感知误差，获得稳定的画面表现。本算法可以满足复杂环境下显示设备的使用需求。

Abstract

Ambient light has always been one of the essential obstacles to improving display devices' image quality. In this study

a tone mapping algorithm is proposed

which can adjust the luminance and color of the image to achieve reliable luminance mapping and color correction of the image in different luminance ranges. Firstly

the influence of ambient light on the display device is analyzed

and the display device model is established. Secondly

the contrast perception model was used as a bridge to solve the luminance mapping curve to minimize the contrast perception difference. Then

using the color appearance model CAM16

the original image is mapped into the environment where the display device is located

while the perception of color and brightness remains unchanged. Finally

luminance mapping and color correction are combined

and a soft clip function is designed to correct the overexposure problem. Experimental and simulation results show that under different environments

the algorithm can repair the color deviation caused by luminance compression

reduce the color error to less than 60% of the traditional method

reduce the contrast perception error

and obtain a stable image performance. The requirements of display devices in a complex environment can be met.

关键词

Keywords

references

B HOEFFLINGER . High-Dynamic-Range (HDR) Vision: Microelectronics, Image Processing, Computer Graphics , : Berlin Heidelberg Springer , 2007 .

J J MCCANN , A RIZZI . The Art and Science of HDR Imaging , : Chichester John Wiley & Son , 2012 .

A ARTUSI , T RICHTER , T EBRAHIMI , 等 . High dynamic range imaging technology . IEEE Signal Processing Magazine , 2017 . 34 ( 5 ): 165 - 172 . DOI: 10.1109/MSP.2017.2716957 http://doi.org/10.1109/MSP.2017.2716957 .

F BANTERLE , A ARTUSI , K DEBATTISTA , 等 . Advanced High Dynamic Range Imaging , 2nd ed : Boca Raton Taylor & Francis , 2018 .

SMPTE. ST 2094-1: 2016 -SMPTE standard dynamic metadata for color volume transform-core components[S]. SMPTE, NewYork: 2016.

J TUMBLIN , H RUSHMEIER . Tone reproduction for realistic images . IEEE Computer Graphics and Applications , 1993 . 13 ( 6 ): 42 - 48 . DOI: 10.1109/38.252554 http://doi.org/10.1109/38.252554 .

FERWERDA J A, PATTANAIK S N, SHIRLEY P, et al . A model of visual adaptation for realistic image synthesis[C]// Proceedings of the 23 rd Annual Conference on Computer Graphics and Interactive Techniques . New Orleans: Association for Computing Machinery, 1996: 249-258.

G W LARSON , H RUSHMEIER , C PIATKO . A visibility matching tone reproduction operator for high dynamic range scenes . IEEE Transactions on Visualization and Computer Graphics , 1997 . 3 ( 4 ): 291 - 306 . DOI: 10.1109/2945.646233 http://doi.org/10.1109/2945.646233 .

E REINHARD , M STARK , P SHIRLEY , 等 . Photographic tone reproduction for digital images . ACM Transactions on Graphics , 2002 . 21 ( 3 ): 267 - 276 . DOI: 10.1145/566654.566575 http://doi.org/10.1145/566654.566575 .

DUAN J, QIU G P. Fast tone mapping for high dynamic range images[C]// Proceedings of the 17 th International Conference on Pattern Recognition , 2004. ICPR 2004. Cambridge: IEEE, 2004: 847-850.

E REINHARD , K DEVLIN . Dynamic range reduction inspired by photoreceptor physiology . IEEE Transactions on Visualization and Computer Graphics , 2005 . 11 ( 1 ): 13 - 24 . DOI: 10.1109/TVCG.2005.9 http://doi.org/10.1109/TVCG.2005.9 .

QIU G P, DUAN J. An optimal tone reproduction curve operator for the display of high dynamic range images[C]//2005 IEEE International Symposium on Circuits and Systems . Kobe: IEEE, 2005: 6276-6279.

J DUAN , M BRESSAN , C DANCE , 等 . Tone-mapping high dynamic range images by novel histogram adjustment . Pattern Recognition , 2010 . 43 ( 5 ): 1847 - 1862 . DOI: 10.1016/j.patcog.2009.12.006 http://doi.org/10.1016/j.patcog.2009.12.006 .

QIU G P, MEI Y J, LAM K M, et al . Tone mapping HDR images using optimization: a general framework[C]//2010 IEEE International Conference on Image Processing . Hong Kong, China: IEEE, 2010: 3129-3132.

S PARIS , S W HASINOFF , J KAUTZ . Local Laplacian filters: edge-aware image processing with a Laplacian pyramid . Communications of the ACM , 2015 . 58 ( 3 ): 81 - 91 . DOI: 10.1145/2723694 http://doi.org/10.1145/2723694 .

E ŠIKUDOVÁ , T POULI , A ARTUSI , 等 . A gamut-mapping framework for color-accurate reproduction of HDR images . IEEE Computer Graphics and Applications , 2016 . 36 ( 4 ): 78 - 90 . DOI: 10.1109/MCG.2015.116 http://doi.org/10.1109/MCG.2015.116 .

H H CHOI , H S KANG , B J YUN . Tone mapping of high dynamic range images combining co-occurrence histogram and visual salience detection . Applied Sciences , 2019 . 9 ( 21 ): 4658 DOI: 10.3390/app9214658 http://doi.org/10.3390/app9214658 .

欧海燕 , 郭太良 , 姚剑敏 , 等 . 基于分层色调映射的LED背光调制算法 . 液晶与显示 , 2011 . 26 ( 2 ): 246 - 249 .

H Y OU , T L GUO , J M YAO , 等 . Modulation of LED backlight based on hierarchical tone mapping algorithm . Chinese Journal of Liquid Crystals and Displays , 2011 . 26 ( 2 ): 246 - 249 .

芦碧波 , 皇甫珍珍 , 郭凯 , 等 . 基于双边滤波的多尺度分层色调映射算法 . 液晶与显示 , 2018 . 33 ( 9 ): 816 - 822 . DOI: 10.3788/YJYXS20183309.0816 http://doi.org/10.3788/YJYXS20183309.0816 .

B B LU , Z Z HUANGFU , K GUO , 等 . Bilateral filter based multiscale layer tone mapping algorithm . Chinese Journal of Liquid Crystals and Displays , 2018 . 33 ( 9 ): 816 - 822 . DOI: 10.3788/YJYXS20183309.0816 http://doi.org/10.3788/YJYXS20183309.0816 .

王峰 , 严利民 . 一种亮度分区和导向滤波相结合的色调映射算法 . 液晶与显示 , 2019 . 34 ( 10 ): 1000 - 1005 . DOI: 10.3788/YJYXS20193410.1000 http://doi.org/10.3788/YJYXS20193410.1000 .

F WANG , L M YAN . Tone mapping algorithm combining luminance partitioning and guiding filtering . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 10 ): 1000 - 1005 . DOI: 10.3788/YJYXS20193410.1000 http://doi.org/10.3788/YJYXS20193410.1000 .

张涛 , 胡孟阳 , 杜文丽 , 等 . 一种新型可调节的自适应区域调光方法 . 激光与光电子学进展 , 2020 . 57 ( 12 ): 121017 .

T ZHANG , M Y HU , W L DU , 等 . Adjustable adaptive local dimming method . Laser & Optoelectronics Progress , 2020 . 57 ( 12 ): 121017 .

R MANTIUK , S DALY , L KEROFSKY . Display adaptive tone mapping . ACM Transactions on Graphics , 2008 . 27 ( 3 ): 1 - 10 .

REMPEL A G, HEIDRICH W, LI H, et al . Video viewing preferences for HDR displays under varying ambient illumination[C]// Proceedings of the 6 th Symposium on Applied Perception in Graphics and Visualization . Chania, Crete, Greece: Association for Computing Machinery, 2009: 45-52.

REINHARD E. Tone reproduction and color appearance modeling: two sides of the same coin?[C]// Color Imaging Conference , 19 th Color and Imaging Conference Final Program and Proceedings . San Jose: Society for Imaging Science and Technology, 2011: 171-176.

WANG L, JUNG C. Surrounding adaptive tone mapping in displayed images under ambient light[C]//2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . New Orleans, LA: IEEE, 2017: 1992-1996.

J C STEVENS , S S STEVENS . Brightness function: effects of adaptation . Journal of the Optical Society of America , 1963 . 53 ( 3 ): 375 - 385 . DOI: 10.1364/JOSA.53.000375 http://doi.org/10.1364/JOSA.53.000375 .

M D FAIRCHILD . Color Appearance Models , : Chichester, West Sussex John Wiley & Sons, Inc. , 2013 .

R S BERNS . Billmeyer and Saltzman's Principles of Color Technology , 4th ed : Hoboken, NJ John Wiley & Sons, Inc. , 2019 .

H R WILSON . A transducer function for threshold and suprathreshold human vision . Biological Cybernetics , 1980 . 38 ( 3 ): 171 - 178 . DOI: 10.1007/BF00337406 http://doi.org/10.1007/BF00337406 .

C J LI , Z Q LI , Z F WANG , 等 . Comprehensive color solutions: CAM16, CAT16, and CAM16-UCS . Color Research & Application , 2017 . 42 ( 6 ): 703 - 718 . http://www.onacademic.com/detail/journal_1000039925048910_8a1c.html http://www.onacademic.com/detail/journal_1000039925048910_8a1c.html .

Y F OU , P AMBALATHANKANDY , S TAKAMAEDA , 等 . Real-time tone mapping: a survey and cross-implementation hardware benchmark . IEEE Transactions on Circuits and Systems for Video Technology , 2021 . DOI: 10.1109/TCSVT.2021.3060143 http://doi.org/10.1109/TCSVT.2021.3060143 .

G EILERTSEN , R K MANTIUK , J UNGER . A comparative review of tone-mapping algorithms for high dynamic range video . Computer Graphics Forum , 2017 . 36 ( 2 ): 565 - 592 . DOI: 10.1111/cgf.13148 http://doi.org/10.1111/cgf.13148 .

冯维 , 刘红帝 , 吴贵铭 , 等 . 基于颜色校正模型的梯度域自适应色调映射算法 . 激光与光电子学进展 , 2020 . 57 ( 8 ): 081007 .

W FENG , H D LIU , G M WU , 等 . Gradient domain adaptive tone mapping algorithm based on color correction model . Laser & Optoelectronics Progress , 2020 . 57 ( 8 ): 081007 .

FAIRCHILD M D. The HDR photographic survey[C]//15 th Color and Imaging Conference . Albuquerque: Society for Imaging Science and Technology, 2007: 233-238.

IEC. IEC 61966-2-1 Multimedia systems and equipment-colour measurement and management-Part 2-1: colour management-Default RGB colour space-sRGB[S]. International Electrotechnical Commission, 1999.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Star map spatial target detection method based on fast local contrast and target features

Review of quantum dot-based LED display： materials， encapsulation coatings， patterned display applications

Color image quality assessment based on colornames

Micro-LED display: Recent progress and future challenges

Related Author

Guo-ping QIU

Xin YU

Yin-qiang GONG

SHAO Jianbing

NIU Haipeng

YAN Changxiang

WANG Yilin

GUAN Haijun

Related Institution

College of Electronics and Information Engineering， Shenzhen University

Changchun Changguang Zhiou Technology Co.， Ltd.

University of Chinese Academy of Sciences

Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences

R & D Center， TCL Electronics Holdings Limited

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰