
浏览全部资源
扫码关注微信
1.天津大学 微电子学院, 天津 300072
2.海信视像科技股份有限公司, 山东 青岛 266071
[ "张坤(1996-), 男, 河北石家庄人, 硕士研究生, 2018年于长春理工大学获得学士学位, 主要从事图像处理技术方面的研究。E-mail:zk_cohen61004@tju.edu.cn" ]
[ "雷志春(1964-), 男, 河北迁安人, 博士, 教授, 1998年于德国多特蒙德大学获得博士学位, 主要从事图像处理、显示技术等方面的研究。E-mail:zclei@tju.edu.cn" ]
收稿日期:2020-07-24,
修回日期:2020-09-18,
录用日期:2020-9-18,
纸质出版日期:2021-02
移动端阅览
张坤, 王烨东, 李文元, 等. 自适应动态肤色检测技术研究进展[J]. 液晶与显示, 2021,36(2):293-304.
Kun ZHANG, Ye-dong WANG, Wen-yuan LI, et al. Research progress of adaptive dynamic skin color detection technology[J]. Chinese journal of liquid crystals and displays, 2021, 36(2): 293-304.
张坤, 王烨东, 李文元, 等. 自适应动态肤色检测技术研究进展[J]. 液晶与显示, 2021,36(2):293-304. DOI: 10.37188/CJLCD.2020-0196.
Kun ZHANG, Ye-dong WANG, Wen-yuan LI, et al. Research progress of adaptive dynamic skin color detection technology[J]. Chinese journal of liquid crystals and displays, 2021, 36(2): 293-304. DOI: 10.37188/CJLCD.2020-0196.
肤色检测在人脸检测、手势识别、敏感图像过滤、医疗诊断、图像增强等计算机视觉和图像处理领域具有广泛的应用。由于人体肤色容易受光照条件、种族等因素的影响,难以在非限制性场景中达到理想的肤色检测效果,所以自适应肤色检测方法应运而生。本文较全面地对自适应肤色检测方法进行了综述,重点分析了基于参数动态调整和基于高层语义特征的自适应肤色检测方法,讨论了它们各自的优势和不足,并在此基础之上展望了未来的发展趋势,为相关研究人员提供参考。
Skin color detection is widely used in face detection
gesture recognition
sensitive image filtering
medical diagnosis
image enhancement and so on. It is an important technology for computer vision and image processing fields. Because human skin color is easily affected by lighting conditions
races
etc.
it is difficult to achieve ideal detection results under unconstrained environments. The emergence of adaptive methods makes the above problems improved. In this paper
adaptive skin detection methods are comprehensively reviewed. The paper focuses on the analysis of adaptive skin detection methods based on parameter dynamic adjustment and high-level semantic features. Meanwhile
it discusses their respective advantages and disadvantages. On this basis
the future development trend is prospected
which aims at providing reference for related researchers.
林 国军 , 杨 明中 , 陈 明举 , 等 . 一种肤色定位的人脸检测算法 . 液晶与显示 , 2019 . 34 ( 1 ): 70 - 73 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1456317&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1456317&Fpath=&index=-1&l=zh .
G J LIN , M Z YANG , M J CHEN , 等 . Face detection algorithm based on skin color location . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 1 ): 70 - 73 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1456317&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1456317&Fpath=&index=-1&l=zh .
L WANG , W M HU , T N TAN . Recent developments in human motion analysis . Pattern Recognition , 2003 . 36 ( 3 ): 585 - 601 . DOI: 10.1016/S0031-3203(02)00100-0 http://doi.org/10.1016/S0031-3203(02)00100-0 .
谢 非 , 龚 俊 , 王 元祥 , 等 . 基于肤色增强和分块PCA的人脸表情识别方法 . 南京师范大学学报(工程技术版) , 2017 . 17 ( 2 ): 49 - 56 . https://www.cnki.com.cn/Article/CJFDTOTAL-NJSE201702009.htm https://www.cnki.com.cn/Article/CJFDTOTAL-NJSE201702009.htm .
F XIE , J GONG , Y X WANG , 等 . A facial expression recognition method based on skin color enhancement and block PCA . Journal of Nanjing Normal University (Engineering and Technology Edition) , 2017 . 17 ( 2 ): 49 - 56 . https://www.cnki.com.cn/Article/CJFDTOTAL-NJSE201702009.htm https://www.cnki.com.cn/Article/CJFDTOTAL-NJSE201702009.htm .
史 东承 , 倪 康 . 基于YCbCr颜色空间背景建模与手势阴影消除 . 中国光学 , 2015 . 8 ( 4 ): 589 - 595 .
D C SHI , K NI . Background modeling based on YCbCr color space and gesture shadow elimination . Chinese Optics , 2015 . 8 ( 4 ): 589 - 595 . DOI: 10.3788/CO.20150804.0589 http://doi.org/10.3788/CO.20150804.0589 .
WANG R B, GUO K Y, SHI S M, et al. A monitoring method of driver fatigue behavior based on machine vision[C]// IEEE IV 2003 Intelligent Vehicles Symposium. Columbus: IEEE, 2003: 110-113.
A SHIFA , M B IMTIAZ , M N ASGHAR , 等 . Skin detection and lightweight encryption for privacy protection in real-time surveillance applications . Image and Vision Computing , 2020 . 94 103859 DOI: 10.1016/j.imavis.2019.103859 http://doi.org/10.1016/j.imavis.2019.103859 .
陈梦竹.基于肤色检测的中医面色识别[D].北京: 北京交通大学, 2018.
CHEN M Z. TCM complexion recognition based on skin color[D]. Beijing: Beijing Jiaotong University, 2018. (in Chinese)
M J JONES , J M REHG . Statistical color models with application to skin detection . International Journal of Computer Vision , 2002 . 46 ( 1 ): 81 - 96 . DOI: 10.1023/A:1013200319198 http://doi.org/10.1023/A:1013200319198 .
J S LEE , Y M KUO , P C CHUNG , 等 . Naked image detection based on adaptive and extensible skin color model . Pattern Recognition , 2007 . 40 ( 8 ): 2261 - 2270 . DOI: 10.1016/j.patcog.2006.11.016 http://doi.org/10.1016/j.patcog.2006.11.016 .
周结.2019年中国网络视听发展研究报告[EB/OL].(2019-05-27)[2020-07-12] . https://www.sohu.com/a/316802357_728306 https://www.sohu.com/a/316802357_728306 .
ZHOU J.Research report on china's network audio visual development in 2019[EB/OL]. (2019-05-27)[2020-07-12] . https://www.sohu.com/a/316802357_728306 https://www.sohu.com/a/316802357_728306 . (in Chinese)
ZAFARIFAR B, BELLERS E B, DE WITH P H N. Application and evaluation of texture-adaptive skin detection in TV image enhancement[C]//2013 IEEE International Conference on Consumer Electronics. Las Vegas: IEEE, 2013: 88-91.
H S CHEN , T M WANG , S H CHEN , 等 . Skin-color correction method based on hue template mapping for wide color gamut liquid crystal display devices . Color Research and Application , 2011 . 36 ( 5 ): 335 - 348 . DOI: 10.1002/col.20636 http://doi.org/10.1002/col.20636 .
陈 锻生 , 刘 政凯 . 肤色检测技术综述 . 计算机学报 , 2006 . 29 ( 2 ): 194 - 207 . DOI: 10.3321/j.issn:0254-4164.2006.02.002 http://doi.org/10.3321/j.issn:0254-4164.2006.02.002 .
D S CHEN , Z K LIU . A survey of skin color detection . Chinese Journal of Computers , 2006 . 29 ( 2 ): 194 - 207 . DOI: 10.3321/j.issn:0254-4164.2006.02.002 http://doi.org/10.3321/j.issn:0254-4164.2006.02.002 .
郑 燕 , 张 霞 . 基于像素的肤色检测方法综述 . 计算机系统应用 , 2020 . 29 ( 3 ): 1 - 10 . https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202003002.htm https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202003002.htm .
Y ZHENG , X ZHANG . Survey on pixel-based skin color detection methods . Computer Systems & Applications , 2020 . 29 ( 3 ): 1 - 10 . https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202003002.htm https://www.cnki.com.cn/Article/CJFDTOTAL-XTYY202003002.htm .
S NAJI , H A JALAB , S A KAREEM . A survey on skin detection in colored images . Artificial Intelligence Review , 2019 . 52 ( 2 ): 1041 - 1087 . DOI: 10.1007/s10462-018-9664-9 http://doi.org/10.1007/s10462-018-9664-9 .
H M SUN . Skin detection for single images using dynamic skin color modeling . Pattern Recognition , 2010 . 43 ( 4 ): 1413 - 1420 . DOI: 10.1016/j.patcog.2009.09.022 http://doi.org/10.1016/j.patcog.2009.09.022 .
R L HSU , M ABDEL-MOTTALEB , A K JAIN . Face detection in color images . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2002 . 24 ( 5 ): 696 - 706 . DOI: 10.1109/34.1000242 http://doi.org/10.1109/34.1000242 .
A LUMINI , L NANNI . Fair comparison of skin detection approaches on publicly available datasets . Expert Systems with Applications , 2020 . 160 113677 DOI: 10.1016/j.eswa.2020.113677 http://doi.org/10.1016/j.eswa.2020.113677 .
V BADRINARAYANAN , A KENDALL , R CIPOLLA . Segnet:a deep convolutional encoder-decoder architecture for image segmentation . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 . 39 ( 12 ): 2481 - 2495 . DOI: 10.1109/TPAMI.2016.2644615 http://doi.org/10.1109/TPAMI.2016.2644615 .
RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[C]//18 th International Conference on Medical Image Computing and Computer-Assisted Intervention . Cham: Springer, 2015: 234-241.
CHEN L C, ZHU Y K, PAPANDREOU G, et al . Encoder-decoder with atrous separable convolution for semantic image segmentation[C]// Proceedings of the 15th European Conference on Computer Vision . Cham: Springer, 2018: 801-818.
A DOURADO , F GUTH , T E DE CAMPOS , 等 . Domain adaptation for holistic skin detection . arXiv preprint arXiv:1903.06969 , 2019 . http://arxiv.org/abs/1903.06969v2 http://arxiv.org/abs/1903.06969v2 .
HE Y, SHI J Y, WANG C, et al . Semi-supervised skin detection by network with mutual guidance[C]// Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019: 2111-2120.
S J SCHMUGGE , S JAYARAM , M C SHIN , 等 . Objective evaluation of approaches of skin detection using ROC analysis . Computer Vision and Image Understanding , 2007 . 108 ( 1/2 ): 41 - 51 . http://www.sciencedirect.com/science/article/pii/S1077314206002268 http://www.sciencedirect.com/science/article/pii/S1077314206002268 .
WIMMER M, RADIG B. Adaptive skin color classificator[C]// Proceedings of the first ICGST International Conference on Graphics Vision and Image Processing GVIP -05. Cairo, Egypt: CICC, 2005, 1: 324-327.
陶 霖密 , 彭 振云 , 徐 光祐 , 等 . 人体的肤色特征 . 软件学报 , 2001 . 12 ( 7 ): 1032 - 1041 . https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200107009.htm https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200107009.htm .
L M TAO , Z Y PENG , F Y XU , 等 . The features of skin color . Journal of Software , 2001 . 12 ( 7 ): 1032 - 1041 . https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200107009.htm https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200107009.htm .
JAYARAM S, SCHMUGGE S, SHIN M C, et al . Effect of colorspace transformation, the illuminance component, and color modeling on skin detection[C]// Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 2004. Washington: IEEE, 2004: 813-818.
C GARCIA , G TZIRITAS . Face detection using quantized skin color regions merging and wavelet packet analysis . IEEE Transactions on Multimedia , 1999 . 1 ( 3 ): 264 - 277 . DOI: 10.1109/6046.784465 http://doi.org/10.1109/6046.784465 .
K M CHO , J H JANG , K S HONG . Adaptive skin-color filter . Pattern Recognition , 2001 . 34 ( 5 ): 1067 - 1073 . DOI: 10.1016/S0031-3203(00)00034-0 http://doi.org/10.1016/S0031-3203(00)00034-0 .
M SORIANO , B MARTINKAUPPI , S HUOVINEN , 等 . Adaptive skin color modeling using the skin locus for selecting training pixels . Pattern Recognition , 2003 . 36 ( 3 ): 681 - 90 . DOI: 10.1016/S0031-3203(02)00089-4 http://doi.org/10.1016/S0031-3203(02)00089-4 .
R FOOPRATEEPSIRI , W KURUTACH . A general framework for face reconstruction using single still image based on 2D-to-3D transformation kernel . Forensic Science International , 2014 . 236 117 - 126 . DOI: 10.1016/j.forsciint.2013.12.020 http://doi.org/10.1016/j.forsciint.2013.12.020 .
郭 耸 , 顾 国昌 , 蔡 则苏 , 等 . 肤色相似度和动态阈值相结合的肤色分割技术 . 计算机工程与应用 , 2010 . 46 ( 18 ): 1 - 3, 12 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG201018004.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG201018004.htm .
S GUO , G C GU , Z S CAI , 等 . Skin segmentation using similarity of skin color and dynamic threshold . Computer Engineering and Applications , 2010 . 46 ( 18 ): 1 - 3, 12 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG201018004.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG201018004.htm .
张 明吉 , 王 伟强 , 郑 清芳 , 等 . 静态图像中的自适应阈值肤色检测算法 . 计算机研究与发展 , 2006 . 43 ( 9 ): 1674 - 1680 . https://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ200609027.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ200609027.htm .
M J ZHANG , W Q WANG , Q F ZHENG , 等 . Adaptive skin-color detection in still images . Journal of Computer Research and Development , 2006 . 43 ( 9 ): 1674 - 1680 . https://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ200609027.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ200609027.htm .
PHUNG S L, CHAI D, BOUZERDOUM A. Adaptive skin segmentation in color images[C]// Proceedings of the 2003 International Conference on Multimedia and Expo . Baltimore: IEEE, 2003: Ⅲ-173.
李 晓光 , 李 晓华 , 沈 兰荪 . 一种DCT压缩域中基于三维椭圆模型的自适应肤色分割算法 . 电子学报 , 2005 . 33 ( 12A ): 2464 - 2467 .
X G LI , X H LI , L S SHEN . A 3D ellipse model based adaptive skin color segmentation algorithm in DCT compressed domain . Acta Electronica Sinica , 2005 . 33 ( 12A ): 2464 - 2467 .
夏 思宇 , 李 久贤 , 袁 晓辉 , 等 . 一种改进的自适应肤色检测算法 . 数据采集与处理 , 2006 . 21 ( 2 ): 174 - 178 . https://www.cnki.com.cn/Article/CJFDTOTAL-SJCJ200602010.htm https://www.cnki.com.cn/Article/CJFDTOTAL-SJCJ200602010.htm .
S Y XIA , J X LI , X H YUAN , 等 . Improved adaptive algorithm for skin color detection . Journal of Data Acquisition & Processing , 2006 . 21 ( 2 ): 174 - 178 . https://www.cnki.com.cn/Article/CJFDTOTAL-SJCJ200602010.htm https://www.cnki.com.cn/Article/CJFDTOTAL-SJCJ200602010.htm .
曾 飞 , 蔡 灿辉 . 自适应肤色检测算法的研究 . 微型机与应用 , 2011 . 30 ( 4 ): 37 - 40 . https://www.cnki.com.cn/Article/CJFDTOTAL-WXJY201104017.htm https://www.cnki.com.cn/Article/CJFDTOTAL-WXJY201104017.htm .
F ZENG , C H CAI . Study on adaptive skin color detection algorithm . Microcomputer & its Applications , 2011 . 30 ( 4 ): 37 - 40 . https://www.cnki.com.cn/Article/CJFDTOTAL-WXJY201104017.htm https://www.cnki.com.cn/Article/CJFDTOTAL-WXJY201104017.htm .
熊 霞 , 桑 庆兵 . 光照自适应的肤色检测方法 . 计算机应用 , 2011 . 31 ( 5 ): 1233 - 1236 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201105024.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201105024.htm .
X XIONG , Q B SANG . Illumination-adaptive skin color detection method . Journal of Computer Applications , 2011 . 31 ( 5 ): 1233 - 1236 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201105024.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201105024.htm .
张 情 , 黎 明 , 冷 璐 . 结合自适应肤色模型和区域生长的掌纹分割 . 计算机工程与设计 , 2017 . 38 ( 10 ): 2794 - 2798 . https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201710036.htm https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201710036.htm .
Q ZHANG , M LI , L LENG . Palmprint segmentation combining adaptive skin-color model and region growing . Computer Engineering and Design , 2017 . 38 ( 10 ): 2794 - 2798 . https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201710036.htm https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201710036.htm .
江 国来 , 林 耀荣 . 自适应模型和固定模型结合的肤色分割算法 . 计算机应用 , 2010 . 30 ( 10 ): 2698 - 2701 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201010037.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201010037.htm .
G L JIANG , Y R LIN . Skin color segmentation algorithm combining adaptive model and fixed model . Journal of Computer Application , 2010 . 30 ( 10 ): 2698 - 2701 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201010037.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY201010037.htm .
R KHAN , A HANBURY , J STÖTTINGER , 等 . Multiple color space channel fusion for skin detection . Multimedia Tools and Applications , 2014 . 72 ( 2 ): 1709 - 1730 . DOI: 10.1007/s11042-013-1443-7 http://doi.org/10.1007/s11042-013-1443-7 .
A GUPTA , A CHAUDHARY . Robust skin segmentation using color space switching . Pattern Recognition and Image Analysis , 2016 . 26 ( 1 ): 61 - 68 . DOI: 10.1134/S1054661815040033 http://doi.org/10.1134/S1054661815040033 .
GOMEZ G. On selecting colour components for skin detection[C]// Object Recognition Supported by User Interaction for service robots . Quebec City: IEEE, 2002, 2: 961-964.
N BRANCATI , G DE PIETRO , M FRUCCI , 等 . Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering . Computer Vision and Image Understanding , 2017 . 155 33 - 42 . http://www.sciencedirect.com/science/article/pii/s1077314216301989 http://www.sciencedirect.com/science/article/pii/s1077314216301989 .
C C HSIEH , D H LIOU , W R LAI . Enhanced face-based adaptive skin color model . Journal of Applied Science and Engineering , 2012 . 15 ( 2 ): 167 - 176 .
YOGARAJAH P, CONDELL J, CURRAN K, et al . A dynamic threshold approach for skin segmentation in color images[C]//2010 IEEE International Conference on Image Processing . Hong Kong: IEEE, 2010: 2225-2228.
W R TAN , C S CHAN , P YOGARAJAH , 等 . A fusion approach for efficient human skin detection . IEEE Transactions on Industrial Informatics , 2012 . 8 ( 1 ): 138 - 147 . http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6051482 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6051482 .
I FASEL , B FORTENBERRY , J MOVELLAN . A generative framework for real time object detection and classification . Computer Vision and Image Understanding , 2005 . 98 ( 1 ): 182 - 210 . http://www.sciencedirect.com/science/article/pii/S1077314204001171 http://www.sciencedirect.com/science/article/pii/S1077314204001171 .
方 晶晶 , 李 振波 , 姜 宇 . 人体肤色区域的自适应模型分割方法 . 计算机辅助设计与图形学学报 , 2013 . 25 ( 2 ): 229 - 234 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201302013.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201302013.htm .
J J FANG , Z B LI , Y JIANG . Human skin color region segmentation based on adaptive model . Journal of Computer-Aided Design & Computer Graphics , 2013 . 25 ( 2 ): 229 - 234 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201302013.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201302013.htm .
Y LUO , Y P GUAN . Adaptive skin detection using face location and facial structure estimation . IET Computer Vision , 2017 . 11 ( 7 ): 550 - 559 . http://ieeexplore.ieee.org/document/8039317 http://ieeexplore.ieee.org/document/8039317 .
ZHU Q, CHENG K T, WU C T. A unified adaptive approach to accurate skin detection[C]//2004 International Conference on Image Processing . Singapore: IEEE, 2004: 1189-1192.
R MOHANTY , M V RAGHUNADH . Skin color segmentation based face detection using multi-color space . International Journal of Advanced Research in Computer and Communication Engineering , 2016 . 5 ( 5 ): 470 - 475 . http://www.ijarcce.com/upload/2016/may-16/IJARCCE%20122.pdf http://www.ijarcce.com/upload/2016/may-16/IJARCCE%20122.pdf .
S BIANCO , F GASPARINI , R SCHETTINI . Adaptive skin classification using face and body detection . IEEE Transactions on Image Processing , 2015 . 24 ( 12 ): 4756 - 4765 . http://ieeexplore.ieee.org/document/7185418/ http://ieeexplore.ieee.org/document/7185418/ .
VIOLA P, JONES M. Rapid object detection using a boosted cascade of simple features[C]// Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Kauai: IEEE, 2001, 1: I.
0
浏览量
94
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621