Saliency detection algorithm integrating multiple features of high and low level

Jun-ding SUN; Yi ZHANG; Hai-hua LI

doi:10.3788/YJYXS20193404.0430

您当前的位置：

首页 >

文章列表页 >

Saliency detection algorithm integrating multiple features of high and low level

Image Processing | 更新时间：2020-07-05

- Saliency detection algorithm integrating multiple features of high and low level
- Chinese Journal of Liquid Crystals and Displays Vol. 34, Issue 4, Pages: 430-438(2019)
- 作者机构：
  
  1.河南理工大学计算机科学与技术学院, 焦作 454000
  2.河南理工大学物理与电子信息学院, 焦作 454000
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20193404.0430
  CLC： TP391
- Received：17 October 2018，
  
  Accepted：08 January 2019，
  
  Published：2019-04
- 稿件说明：
移动端阅览
Jun-ding SUN, Yi ZHANG, Hai-hua LI. Saliency detection algorithm integrating multiple features of high and low level[J]. Chinese journal of liquid crystals and displays, 2019, 34(4): 430-438.
DOI：

Jun-ding SUN, Yi ZHANG, Hai-hua LI. Saliency detection algorithm integrating multiple features of high and low level[J]. Chinese journal of liquid crystals and displays, 2019, 34(4): 430-438. DOI： 10.3788/YJYXS20193404.0430.

摘要

针对单一显著性特征无法全面表达图像显著性致使显著性检测精度不高等问题，本文提出了一种多特征融合的显著性检测算法。算法在高层先验知识基础上，对靠近中心的超像素设置高显著值，利用高斯分布求解中心先验；在底层特征上融合图像的边界稀疏、全局对比度、颜色空间分布和超级像素差异等4种显著特征，利用类间差异最大阈值对高低层特征进行线性和非线性融合，最终得到高质量的显著图。在MSRA-1000、SED、SOD 3个公开的数据集上进行实验，结果表明：本文算法融合得到的显著图边缘清晰、显著区域突出均匀，在有效抑制背景信息的同时所得显著图像视觉感知更好，与其他显著性算法相比查全率和查准率上至少提高3.4%。

Abstract

Aiming at the problem that the single saliency feature can not fully express the image saliency

resulting in low accuracy of saliency detection

a saliency detection algorithm for multi-feature fusion was proposed. Based on the high-level prior knowledge

the background priori and the center priori were redefined.The super-pixels near the center were set to high saliency values

and the center priori was solved by using Gauss distribution. Four kinds of salient features such as image sparseness

global contrast

color space distribution and super pixel difference on the underlying features were fused

and the maximum threshold and high-low layer features of the inter-class difference were linearly and nonlinearly fused to obtain a high-quality saliency map. Experiments on three public datasets of MSRA-1000

SED and SOD show that the saliency map obtained by the fusion of the algorithm has clear edges and prominent regions

and the visual image perception is better when the background information is effectively suppressed. Compared with other significant algorithms

the recall rate and precision rate are increased by at least 3.4%.

关键词

Keywords

references

RUTISHAUSER U, WALTHER D, KOCH C, et al . Is bottom-up attention useful for object recognition?[C]// Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE , 2004.

HAN J, NGAN K N, LI M J, et al . Unsupervised extraction of visual attention objects in color images[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2006, 16(1):141-145.

CHENG M M, WARRELL J, LIN W Y, et al . Efficient salient region detection with soft image abstraction[C]// Proceedings of 2013 IEEE International Conference on Computer Vision . Sydney, NSW: IEEE, 2013: 1529-1536.

TONG N, LU H C, ZHANG L H, et al . Saliency detection with multi-scale superpixels[J]. IEEE Signal Processing Letters, 2014, 21(9):1035-1039.

唐红梅, 吴士婧, 郭迎春, 等.自适应阈值分割与局部背景线索结合的显著性检测[J].电子与信息学报, 2017, 39(7):1592-1598.

TANG H M, WU S J, GUO Y C, et al . Saliency detection based on adaptive threshold segmentation and local background clues[J]. Journal of Electronics & Information Technology, 2017, 39(7):1592-1598. (in Chinese)

蔡强, 郝佳云, 曹健, 等.结合局部特征及全局特征的显著性检测[J].光学精密工程, 2017, 25(3):772-778.

CAI Q, HAO J Y, CAO J, et al . Salient detection via local and global feature[J]. Optics and Precision Engineering, 2017, 25(3):772-778. (in Chinese)

钱生, 陈宗海, 林名强, 等.基于条件随机场和图像分割的显著性检测[J].自动化学报, 2015, 41(4):711-724.

QIAN S, CHEN Z H, LIN M Q, et al . Saliency detection based on conditional random field and image segmentation[J]. Acta Automatica Sinica, 2015, 41(4):711-724. (in Chinese)

刘志远, 李华锋.对比度与空间位置关系驱动的显著性检测[J].计算机应用, 2016, 36(3):795-799.

LIU Z Y, LI H F. Saliency detection using contrast and spatial location-relation[J]. Journal of Computer Applications, 2016, 36(3):795-799. (in Chinese)

朱玲, 徐蔚鸿, 陈沅涛, 等.应用图像局部特征和全局特征对比的显著性检测模型[J].小型微型计算机系统, 2016, 37(9):2109-2113.

ZHU L, XU W H, CHEN Y T, et al . Saliency detection model using contrast of local feature and global feature in image[J]. Journal of Chinese Computer Systems, 2016, 37(9):2109-2113. (in Chinese)

袁巧, 程艳芬, 陈先桥.多先验特征与综合对比度的图像显著性检测[J].中国图象图形学报, 2018, 23(2):239-248.

YUAN Q, CHENG Y F, CHEN X Q. Saliency detection based on multiple priorities and comprehensive contrast[J]. Journal of Image and Graphics, 2018, 23(2):239-248. (in Chinese)

JUDD T, EHINGER K, DURAND F, et al . Learning to predict where humans look[C]// Proceedings of the 12 th IEEE International Conference on Computer Vision . Kyoto, Japan: IEEE, 2009: 2106-2113.

BORJI A, ITTI L. Exploiting local and global patch rarities for saliency detection[C]// Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition . Providence, RI: IEEE, 2012: 478-485.

LIU T, YUAN Z J, SUN J, et al . Learning to detect a salient object[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(2):353-367.

冯海永, 高美凤.基于SLIC超像素和贝叶斯框架的显著性区域检测[J].小型微型计算机系统, 2016, 37(10):2351-2354.

FENG H Y, GAO M F. Salient region detection based on SLIC superpixel and bayesian framework[J]. Journal of Chinese Computer Systems, 2016, 37(10):2351-2354. (in Chinese)

GUO C L, MA Q, ZHANG L M. Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform[C]// Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, AK: IEEE , 2008: 1-8.

GOFERMAN S, ZELNIK-MANOR L, TAL A. Context-aware saliency detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(10):1915-1926.

WANG Z S, LI B X. A two-stage approach to saliency detection in images[C]// Proceedings of 2008 IEEE International Conference on Acoustics, Speech and Signal Processing . Las Vegas, NV: IEEE, 2008: 965-968.

CHENG M M, MITRA N J, HUANG X L, et al . Global contrast based salient region detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3):569-582.

PERAZZI F, KRÄHENBVHL P, PRITCH Y, et al . Saliency filters: contrast based filtering for salient region detection[C] // Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition . Providence, RI: IEEE, 2012: 733-740.

DUAN Q C, LI S, MAO M X. Salient region detection using multilevel image features[C]// Proceedings of 2016 Chinese Intelligent Systems Conference . Singapore: Springer, 2016: 233-242.

ACHANTA R, HEMAMI S, ESTRADA F, et al . Frequency-tuned salient region detection[C]// Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition . Miami, FL: IEEE, 2009: 1597-1604.

NGAU C W H, ANG L M, SENG K P. Comparison of colour spaces for visual saliency[C]// Proceedings of 2009 International Conference on Intelligent Human-Machine Systems and Cybernetics . Hangzhou: IEEE, 2009: 278-281.

ALPERT S, GALUN M, BRANDT A, et al . Image segmentation by probabilistic bottom-up aggregation and cue integration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(2):315-327.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Multi-feature fusion target tracking algorithm

Multi-feature fusion gesture recognition based ondeep convolutional neural network

Multi-template collaborative correlation tracking with multi-feature fusion

Related Author

Hui-hui LIANG

Qiu-sheng HE

Wei-zhen JIA

Wei-feng ZHANG

Wei-guo YUN

Qi-qi SHI

Min WANG

Ning MAO

Related Institution

School of Electronic Information Engineering, Taiyuan University of Science and Technology

School of Information and Control Engineering, Xi'an University of Architecture and Technology

School of Control Science and Engineering, Hebei University of Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰