Fast color transfer algorithm based on neighborhood-first searching

Ming ZHU; Xing-yun ZHAO; Jing-kun YANG

doi:10.37188/YJYXS20203508.0877

您当前的位置：

首页 >

文章列表页 >

Fast color transfer algorithm based on neighborhood-first searching

Image Processing | 更新时间：2020-08-11

- Fast color transfer algorithm based on neighborhood-first searching
- Chinese Journal of Liquid Crystals and Displays Vol. 35, Issue 8, Pages: 877-884(2020)
- 作者机构：
  
  河南工程学院材料与化学工程学院, 河南郑州 450007
- 作者简介：
- 基金信息：
  
  2017 Training Plan for Young Backbone Teachers of Colleges and Universities in Henan Province(2017GGJS154);2020 Scientific Research Cultivating Fundation of Henan University of Engineering(2020010);2019 Innovation Training Program for College Students in Henan Province(S201911517005)
- DOI：10.37188/YJYXS20203508.0877
  CLC： TP391;TP37
- Received：16 February 2020，
  
  Revised：24 April 2020，
  
  Accepted：24 April 2020，
  
  Published：2020-08
- 稿件说明：
移动端阅览
Ming ZHU, Xing-yun ZHAO, Jing-kun YANG. Fast color transfer algorithm based on neighborhood-first searching[J]. Chinese journal of liquid crystals and displays, 2020, 35(8): 877-884.
DOI：

Ming ZHU, Xing-yun ZHAO, Jing-kun YANG. Fast color transfer algorithm based on neighborhood-first searching[J]. Chinese journal of liquid crystals and displays, 2020, 35(8): 877-884. DOI： 10.37188/YJYXS20203508.0877.

摘要

提出了一种基于邻域优先搜索和纹理相似度匹配的色彩转移算法。首先设计了邻域搜索方案在彩色图像中寻找目标灰度像素的候选匹配像素，然后基于纹理相似度计算候选像素与目标像素之间的匹配误差，并据此确定最终匹配像素。对于不满足邻域匹配条件的目标像素，通过对彩色参考图像进行边缘保持平滑滤波并设置采样间隔的手段，提高其全图搜索和匹配速度。针对全局匹配后图像中出现的失真区域，在彩色图像中设置对应的样窗与其进行单独匹配，以进一步提升色彩转移效果。主观评价结果显示：在4个测试案例中，本文算法与经典Welsh算法具有相似的色彩转移效果，但在计算效率上，本文算法比Welsh算法具有较大优势。借助一个色彩构成较为复杂的灰度图像彩色化案例，验证了样窗匹配在色彩转移和色域再现方面的改进效果。

Abstract

A new

general

fast and user-friendly method to solve the problem of colorizing grayscale images is proposed. The neighborhood-first searching scheme is designed firstly to find the candidate matching pixels of a target grayscale pixel. Then

the final matching pixels are determined by calculating matching error between the candidates and the target pixels based on the texture similarity. For the pixels that don't meet the neighborhood matching criterion

the whole image searching and matching can be sped up by using edge-preservation smooth filter to smooth the color reference image and setting sampling interval. To address the problem of image distortion occurred after global matching

our method conducts one or more swatch matching procedures to transfer the desired color moods from groups of swatch regions in the color reference image to the distortion regions of the colorized image. The subjective evaluation results show that in four test cases

the proposed algorithm has similar performance to the classical Welsh algorithm on the color transfer quality

but in the aspect of computing efficiency

the proposed algorithm has a great advantage over Welsh algorithm. By means of a test case of colorizing a grayscale image with complex color composition

the improvement of the swatch matching in color transfer and gamut reproduction is verified.

关键词

Keywords

references

T WELSH , M ASHIKHMIN , K MUELLER . Transferring color to greyscale images . ACM Transactions on Graphics , 2002 . 21 ( 3 ): 277 - 280 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=380be02c57aff69c491d1ba3701858f6 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=380be02c57aff69c491d1ba3701858f6 .

E REINHARD , M ADHIKHMIN , B GOOCH , 等 . Color transfer between images . IEEE Computer Graphics and Applications , 2001 . 21 ( 5 ): 34 - 41 . DOI: 10.1109/38.946629 http://doi.org/10.1109/38.946629 .

王颍蓓.灰度图像颜色转移算法研究[D].西安: 西安理工大学, 2016. http://d.wanfangdata.com.cn/thesis/D01040717

WANG Y B. Algorithm research of color transfer between grayscale images[D]. Xi'an: Xi'an University of Technology, 2016. (in Chinese)

ZHAO Y M, WANG L X, JIN W Q, et al . A grayscale image color transfer method based on region texture analysis using GLCM[C]// Proceedings of SPIE 8193 , International Symposium on Photoelectronic Detection and Imaging 2011 : Advances in Infrared Imaging and Applications . Beijing, China: SPIE, 2011: 9879-9891.

S G LIU , X ZHANG . Image colorization based on texture map . Journal of Electronic Imaging , 2013 . 22 ( 1 ): 013011 DOI: 10.1117/1.JEI.22.1.013011 http://doi.org/10.1117/1.JEI.22.1.013011 .

B ARBELOT , R VERGNE , T HURTUT , 等 . Local texture-based color transfer and colorization . Computers & Graphics , 2017 . 62 15 - 27 . DOI: 10.1117/1.JEI.22.1.013011 http://doi.org/10.1117/1.JEI.22.1.013011 .

X S WANG , G CAO , Y H CHENG . Multi-source local color transfer based on texture similarity . Chinese Journal of Electronics , 2014 . 23 ( 4 ): 718 - 722 .

李建明 , 叶飞 , 于守秋 , 等 . 一种快速灰度图像彩色化算法 . 中国图象图形学报 , 2007 . 12 ( 3 ): 536 - 540 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200703026 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200703026 .

J M LI , F YE , S Q YU , 等 . A fast algorithm of transferring color to greyscale images . Journal of Image and Graphics , 2007 . 12 ( 3 ): 536 - 540 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200703026 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200703026 .

J D YOO , M K PARK , J H CHO , 等 . Local color transfer between images using dominant colors . Journal of Electronic Imaging , 2013 . 22 ( 3 ): 033003 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=35b4b3997809f9b19f7bf10debf4f849 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=35b4b3997809f9b19f7bf10debf4f849 .

L Q CAO , L JIAO , Z J LI , 等 . Grayscale image colorization using an adaptive weighted average method . Journal of Imaging Science and Technology , 2017 . 61 ( 6 ): 060502 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=39bbb1eccae09063f77b7aaeed82b24c http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=39bbb1eccae09063f77b7aaeed82b24c .

M M HE , J LIAO , D D CHEN , 等 . Progressive color transfer with dense semantic correspondences . ArXiv , 2017 . 1710.00756. DOI: 10.1145/3292482 http://doi.org/10.1145/3292482 .

C F XIAO , C HAN , Z M ZHANG , 等 . Example-based colourization via dense encoding pyramids . Computer Graphics Forum , 2020 . 39 ( 1 ): 20 - 33 . http://onlinelibrary.wiley.com/doi/10.1111/cgf.13659 http://onlinelibrary.wiley.com/doi/10.1111/cgf.13659 .

李郁峰 , 冯晓云 , 徐铭蔚 , 等 . 结合快速融合与颜色传递的双波段图像染色 . 中国图象图形学报 , 2012 . 17 ( 10 ): 1213 - 1221 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201210003 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201210003 .

Y F LI , X Y FENG , M W XU , 等 . vision dual-band images coloration using fast fusion and color transfer . Journal of Image and Graphics , 2012 . 17 ( 10 ): 1213 - 1221 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201210003 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201210003 .

张引 , 饶娜 , 张三元 , 等 . 自动采集样本的图像颜色传递算法 . 中国图象图形学报 , 2005 . 10 ( 10 ): 1258 - 1263 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200510009 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200510009 .

Y ZHANG , N RAO , S Y ZHANG , 等 . Color transfer between images with auto selecting swatches . Journal of Image and Graphics , 2005 . 10 ( 10 ): 1258 - 1263 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200510009 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a200510009 .

DESHPANDE A, ROCK J, FORSYTH D.Learning large-scale automatic image colorization[C]// Proceedings of 2015 IEEE International Conference on Computer Vision ( ICCV ). Santiago, Chile: IEEE, 2015: 567-575.

DESHPANDE A, LU J J, YEH M C, et al . Learning diverse image colorization[C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition ( CVPR ). Honolulu, Hawaii: IEEE, 2017: 2877-2885.

M ZHU , N WANG , J Y HARDEBERG . Spatial gamut mapping based on guided filter to preserve spatial luminance variations . Journal of Imaging Science and Technology , 2017 . 61 ( 2 ): 20506 https://www.researchgate.net/publication/221501818_Gamut_Mapping_to_Preserve_Spatial_Luminance_Variations https://www.researchgate.net/publication/221501818_Gamut_Mapping_to_Preserve_Spatial_Luminance_Variations .

M ZHU , T ZHUN . A spatial gamut mapping algorithm based on adaptive detail preservation . Journal of Imaging Science and Technology , 2018 . 62 ( 1 ): 10505 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=9059c6599c950e6b4009a2e9a8bc3cc8 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=9059c6599c950e6b4009a2e9a8bc3cc8 .

K M HE , J SUN , X O TANG . Guided image filtering . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2013 . 35 ( 6 ): 1397 - 1409 . http://www.ncbi.nlm.nih.gov/pubmed/23599054 http://www.ncbi.nlm.nih.gov/pubmed/23599054 .

朱明 , 张志广 , 田准 . "Windows"平台下显示器色彩再现机理的研究和分析 . 液晶与显示 , 2017 . 32 ( 11 ): 923 - 933 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1376703&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1376703&Fpath=&index=-1&l=zh .

M ZHU , Z G ZHANG , Z TIAN . Color reproduction mechanism of monitor based on "Windows" platform . Chinese Journal of Liquid Crystals and Displays , 2017 . 32 ( 11 ): 923 - 933 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1376703&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1376703&Fpath=&index=-1&l=zh .

冀利利 , 孔玲君 , 刘真 , 等 . 基于区域分割法的图像色域边界描述 . 包装工程 , 2014 . 35 ( 9 ): 110 - 116, 121 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=bzgc201409023 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=bzgc201409023 .

L L JI , L J KONG , Z LIU , 等 . Image gamut boundary descriptor based on the segment maxima method . Packaging Engineering , 2014 . 35 ( 9 ): 110 - 116, 121 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=bzgc201409023 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=bzgc201409023 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Image defogging algorithm based on improved dark channel and adaptive tolerance

Adaptive guided filtering based infrared image detail enhancement

Improved multi-scale Retinex infrared image enhancement

Optimized dehazing method based on dark channel prior

Related Author

LIAO Yi-peng

ZHONG Hui-juan

WANG Jia-rong

HAO Zhi-cheng

ZHU Ming

YANG Jin-cheng

JIANG Xin

LU Lu

Related Institution

School of Network and Communications， Hebei Polytechnic Institute

College ofartificial intelligence，Yango University

College of Physics and Information Engineering， Fuzhou University

Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences

Chongqing JiaLing HuaGuang Photoelectric Technology Co.， Ltd.

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰