结合图像签名和最优传输的颜色传递方法

谢斌; 刘轲; 张抗

doi:10.37188/CJLCD.2020-0300

您当前的位置：

首页 >

文章列表页 >

结合图像签名和最优传输的颜色传递方法

图像处理 | 更新时间：2021-08-05

- 结合图像签名和最优传输的颜色传递方法
- Color transfer method for joint image signature and optimal transmission
- 液晶与显示 2021年36卷第8期页码：1151-1165
- 作者机构：
  
  江西理工大学信息工程学院, 江西赣州 341000
- 作者简介：
  
  [ "谢斌(1977-), 男, 江西于都人, 博士, 副教授, 2020年于深圳大学获得博士学位, 研究方向为图像处理、深度学习。E-mail:xiebin-66@163.com" ]
  [ "刘轲(1995-)男, 湖北黄冈人, 硕士研究生, 2018年于湖北科技学院获得学士学位, 研究方向为深度学习、图像处理。E-mail: wendaocheke@126.com" ]
- 基金信息：
  
  国家自然科学基金(61741109);国家自然科学基金(61972264);江西省教育厅科学技术研究项目(GJJ180441);江西理工大学博士启动基金(205200100508)
- DOI：10.37188/CJLCD.2020-0300
  中图分类号： TP391.4
- 收稿日期：2020-11-09，
  
  修回日期：2020-12-24，
  
  纸质出版日期：2021-08
- 稿件说明：
移动端阅览
谢斌, 刘轲, 张抗. 结合图像签名和最优传输的颜色传递方法[J]. 液晶与显示, 2021,36(8):1151-1165.

Bin XIE, Ke LIU, Kang ZHANG. Color transfer method for joint image signature and optimal transmission[J]. Chinese journal of liquid crystals and displays, 2021, 36(8): 1151-1165.
谢斌, 刘轲, 张抗. 结合图像签名和最优传输的颜色传递方法[J]. 液晶与显示, 2021,36(8):1151-1165. DOI： 10.37188/CJLCD.2020-0300.

Bin XIE, Ke LIU, Kang ZHANG. Color transfer method for joint image signature and optimal transmission[J]. Chinese journal of liquid crystals and displays, 2021, 36(8): 1151-1165. DOI： 10.37188/CJLCD.2020-0300.

摘要

颜色传递在图像处理领域一直备受关注，传统的颜色传递方法往往存在细节保持能力不足、层次感欠缺和视觉效果不佳等问题。针对上述问题，本文提出了一种结合图像签名和最优传输的局部颜色传递新方法。首先，引入基于图像签名的显著区域检测方法，得到参考图像和内容图像的前景区域和背景区域，然后在对应区域进行颜色传递以提高结果图像的层次感。其次，在传统线性颜色传递模型的基础上，结合最优传输理论提出了一种保持内容图像亮度的颜色传递策略，以较好地提升结果图像的质量。最后，为了更好地评估颜色传递效果，结合色度差和结构相似度设计了一种新的颜色传递客观评价指标。实验结果表明，相比于传统的颜色传递方法，文中所提方法得到的结果图像能够较好地保持内容图像的细节信息和层次感，并且具有更佳的视觉效果（新方法综合效果较传统方法提升了约30%）。另外，相对于传统的颜色传递评价指标而言，文中所提客观评价指标更加忠实于用户的主观评价结果。实验分析表明，与传统颜色传递方法相比，文中所提方法得到的结果图像在细节保持、层次感保持以及视觉效果上均有更佳表现，而且文中所提客观评价指标更为贴近主观评价结果。

Abstract

Color transfer has always attracted much attention in the field of image processing

but the traditional color transfer methods often have problems such as insufficient detail retention

lack of layering

and poor visual effects. To solve the above problems

this paper proposes a new method of local color transfer combining image signature and optimal transmission. Firstly

a salient region detection method based on image signature is introduced to obtain the foreground region and background region of the reference image and the content image

and then color transfer is performed in the corresponding region to improve the layering of the result image. Secondly

on the basis of the traditional linear color transfer model

combined with the optimal transmission theory

a color transfer strategy that maintains the brightness of the content image is proposed to improve the quality of the resulting image well. Finally

in order to evaluate the effect of color transfer more accurately

a new objective evaluation index of color transfer is designed in combination with chromaticity difference and structural similarity. The experimental results show that compared with the traditional color transfer method

the result image obtained by the method proposed in this paper preferably maintains the detailed information and layering of the content image

and has a more admirable visual effect (the comprehensive effect of the new method is about 30% higher than that of the traditional method). In addition

compared with the traditional color transfer evaluation index

the objective evaluation index mentioned in the article is more faithful to the user's subjective evaluation result. Experimental analysis shows that compared with the traditional color transfer method

the result image obtained by the method in this paper has more outstanding performance in detail preservation

layering preservation and visual effects

and the objective evaluation index mentioned in the paper is closer to the result of subjective evaluation.

关键词

Keywords

references

Y HAN , C XU , G BACIU , 等 . Cartoon and texture decomposition-based color transfer for fabric images . IEEE Transactions on Multimedia , 2017 . 19 ( 1 ): 80 - 92 . DOI: 10.1109/TMM.2016.2608000 http://doi.org/10.1109/TMM.2016.2608000 .

B XIE , C XU , Y HAN , 等 . Color transfer using adaptive second-order total generalized variation regularizer . IEEE Access , 2018 . 6 6829 - 6839 . DOI: 10.1109/ACCESS.2018.2789981 http://doi.org/10.1109/ACCESS.2018.2789981 .

李光鑫 , 徐抒岩 , 赵运隆 , 等 . 颜色传递技术的快速彩色图像融合 . 光学精密工程 , 2010 . 18 ( 7 ): 1637 - 164 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201007024.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201007024.htm .

G X LI , S Y XU , Y L ZHAO , 等 . Fast color image fusion based on color transfer technique . Optics and Precision Engineering , 2010 . 18 ( 7 ): 1637 - 1647 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201007024.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201007024.htm .

E REINHARD , M ADHIKHMIN , B GOOCH , 等 . Color transfer between images . IEEE Computer Graphics and Applications , 2001 . 21 ( 5 ): 34 - 41 .

PITIE F, KOKARAM A C, DAHYOT R. N -dimensional probability density function transfer and its application to color transfer[C]// Proceedings of the Tenth IEEE International Conference on Computer Vision ( ICCV' 05) Volume 1. Beijing, China: IEEE, 2005: 1434-1439.

F PITIÉ , A C KOKARAM , R DAHYOT . Automated colour grading using colour distribution transfer . Computer Vision and Image Understanding , 2007 . 107 ( 1/2 ): 123 - 137 .

XIAO X Z, MA L Z. Color transfer in correlated color space[C]// Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications. Hong Kong, China: ACM, 2006: 305-309.

X Z XIAO , L Z MA . Gradient-preserving color transfer . Computer Graphics Forum , 2009 . 28 ( 7 ): 1879 - 1886 . DOI: 10.1111/j.1467-8659.2009.01566.x http://doi.org/10.1111/j.1467-8659.2009.01566.x .

R M H NGUYEN , S J KIM , M S BROWN . Illuminant aware gamut-based color transfer . Computer Graphics Forum , 2014 . 33 ( 7 ): 319 - 328 . DOI: 10.1111/cgf.12500 http://doi.org/10.1111/cgf.12500 .

L HE , H R QI , R ZARETZKI . Image color transfer to evoke different emotions based on color combinations . Signal, Image and Video Processing , 2015 . 9 ( 8 ): 1965 - 1973 . DOI: 10.1007/s11760-014-0691-y http://doi.org/10.1007/s11760-014-0691-y .

D WANG , C Q ZOU , G Q LI , 等 . 0 Gradient-preserving color transfer . Computer Graphics Forum , 2017 . 36 ( 7 ): 93 - 103 . DOI: 10.1111/cgf.13275 http://doi.org/10.1111/cgf.13275 .

GIRAUD R, TA V T, PAPADAKIS N. Superpixel-based color transfer[C]// Proceedings of 2017 IEEE International Conference on Image Processing. Beijing, China: IEEE, 2017: 700-704.

M GROGAN , R DAHYOT . ℓ 2 Divergence for robust colour transfer . Computer Vision and Image Understanding , 2019 . 181 39 - 49 . DOI: 10.1016/j.cviu.2019.02.002 http://doi.org/10.1016/j.cviu.2019.02.002 .

Z C YAN , H ZHANG , B Y WANG , 等 . Automatic photo adjustment using deep neural networks . Acm Transactions on Graphics , 2016 . 35 ( 2 ): 11 http://arxiv.org/abs/1412.7725v2 http://arxiv.org/abs/1412.7725v2 .

GATYS L A, ECKER A S, BETHGE M. Image style transfer using convolutional neural networks[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 2414-2423.

M M HE , J LIAO , D D CHEN , 等 . Progressive color transfer with dense semantic correspondences . ACM Transactions on Graphics , 2019 . 38 ( 2 ): 13 http://arxiv.org/abs/1710.00756v2 http://arxiv.org/abs/1710.00756v2 .

黄冠婷 , 韩学辉 , 龚晓婷 , 等 . 基于图像分割和区域匹配的灰度图像彩色化算法 . 液晶与显示 , 2019 . 34 ( 6 ): 619 - 626 . DOI: 10.3788/YJYXS20193406.0619 http://doi.org/10.3788/YJYXS20193406.0619 .

G T HUANG , X H HAN , X T GONG , 等 . Gray image colorization algorithm based on image segmentation and region matching . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 6 ): 619 - 626 . DOI: 10.3788/YJYXS20193406.0619 http://doi.org/10.3788/YJYXS20193406.0619 .

刘冬梅 , 常发亮 . 结合Retinex校正和显著性的主动轮廓图像分割 . 光学精密工程 , 2019 . 27 ( 7 ): 1593 - 1600 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201907021.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201907021.htm .

D M LIU , F L CHANG . Active contour model for image segmentation based on Retinex correction and saliency . Optics and Precision Engineering , 2019 . 27 ( 7 ): 1593 - 1600 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201907021.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201907021.htm .

Y YANG , H L ZHAO , L H YOU , 等 . Semantic portrait color transfer with internet images . Multimedia Tools and Applications , 2017 . 76 ( 1 ): 523 - 541 . DOI: 10.1007/s11042-015-3063-x http://doi.org/10.1007/s11042-015-3063-x .

XIA J Z. Saliency-guided color transfer between images[C]// Proceedings of the 9 th International Symposium on Visual Computing . Rethymnon, Crete, Greece: Springer, 2013.

HAREL J, KOCH C, PERONA P. Graph-based visual saliency[C]// Proceedings of the 19 th International Conference on Neural Information Processing Systems. Canada: MIT Press, 2006: 545-552.

X D HOU , J HAREL , C KOCH . Image signature: highlighting sparse salient regions . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2012 . 34 ( 1 ): 194 - 201 . DOI: 10.1109/TPAMI.2011.146 http://doi.org/10.1109/TPAMI.2011.146 .

GROGAN M, DAHYOT R. Robust registration of Gaussian mixtures for colour transfer[J]. arXiv : 1705.06091, 2017.

L RVSCHENDORF . Optimal transport. old and new . Jahresbericht der Deutschen Mathematiker-Vereinigung , 2009 . 111 ( 2 ): 18 - 21 . http://www.istic.ac.cn/suoguan/detailed.htm?dbname=xw_qk&wid=0220090900257916 http://www.istic.ac.cn/suoguan/detailed.htm?dbname=xw_qk&wid=0220090900257916 .

M HALLIN . From mahalanobis to bregman via monge and Kantorovich: towards a "general generalizeddistance" . Sankhya B , 2018 . 80 ( 1 ): 135 - 146 . DOI: 10.1007/s13571-018-0163-4 http://doi.org/10.1007/s13571-018-0163-4 .

L ZHANG , L ZHANG , X Q MOU , 等 . FSIM: a feature similarity index for image quality assessment . IEEE Transactions on Image Processing , 2011 . 20 ( 8 ): 2378 - 2386 . DOI: 10.1109/TIP.2011.2109730 http://doi.org/10.1109/TIP.2011.2109730 .

M R LUO , G CUI , B RIGG . The development of the CIE 2000 colour-difference formula: CIEDE2000 . Color Research & Application , 2001 . 26 ( 5 ): 340 - 350 .

杨春玲 , 旷开智 , 陈冠豪 , 等 . 基于梯度的结构相似度的图像质量评价方法 . 华南理工大学学报(自然科学版) , 2006 . 34 ( 9 ): 22 - 25 . DOI: 10.3321/j.issn:1000-565X.2006.09.005 http://doi.org/10.3321/j.issn:1000-565X.2006.09.005 .

C L YANG , K Z KUANG , G H CHEN , 等 . Gradient-based structural similarity for image quality assessment . Journal of South China University of Technology (Natural Science Edition) , 2006 . 34 ( 9 ): 22 - 25 . DOI: 10.3321/j.issn:1000-565X.2006.09.005 http://doi.org/10.3321/j.issn:1000-565X.2006.09.005 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于图像分割和区域匹配的灰度图像彩色化算法