Foam infrared image segmentation combining NSST saliency detection and graph cuts

Shi-yuan CHEN; Yi-peng LIAO; Jin ZHANG; Wei-xing WANG

doi:10.37188/CJLCD.2020-0234

您当前的位置：

首页 >

文章列表页 >

Foam infrared image segmentation combining NSST saliency detection and graph cuts

Image Processing | 更新时间：2021-04-02

- Foam infrared image segmentation combining NSST saliency detection and graph cuts
- Chinese Journal of Liquid Crystals and Displays Vol. 36, Issue 4, Pages: 584-595(2021)
- 作者机构：
  
  福州大学物理与信息工程学院, 福建福州 350108
- 作者简介：
- 基金信息：
- DOI：10.37188/CJLCD.2020-0234
  CLC： TP391
- Received：09 September 2020，
  
  Revised：22 October 2020，
  
  Published：2021-04
- 稿件说明：
移动端阅览
Shi-yuan CHEN, Yi-peng LIAO, Jin ZHANG, et al. Foam infrared image segmentation combining NSST saliency detection and graph cuts[J]. Chinese journal of liquid crystals and displays, 2021, 36(4): 584-595.
DOI：

Shi-yuan CHEN, Yi-peng LIAO, Jin ZHANG, et al. Foam infrared image segmentation combining NSST saliency detection and graph cuts[J]. Chinese journal of liquid crystals and displays, 2021, 36(4): 584-595. DOI： 10.37188/CJLCD.2020-0234.

摘要

为精确提取浮选泡沫表面的崩塌、新合成气泡，减少噪声和光照影响，提出一种结合非下采样Shearlet变换（NSST）域显著性检测及图割的泡沫红外图像分割方法。对泡沫红外图像进行NSST多尺度分解，采用GBVS算法对低频子带图像进行显著性检测，通过马尔科夫链特征差异计算显著性值，对各个高频方向子带进行噪声系数去除和边缘、弱边缘系数非线性增强。对处理后的多尺度高频子带、低频子带图像进行NSST重构，通过低频子带图像的显著性检测结果构建显著性约束项，采用高斯拟合函数构建气泡亮度约束项，然后构造图割能量函数，最后利用最大流/最小割算法对目标区域进行分割。实验结果表明：该方法受光照影响小，一定程度上解决了过分割和欠分割问题。正常浮选检测准确率为91.8%，欠浮选为87.1%，过浮选为88.9%，分割精度较现有方法有明显提高，能有效提取出崩塌或新合成的气泡，表现出良好的抗噪性，且在不同工况下均表现出良好的鲁棒性。

Abstract

In order to accurately extract the collapse of the surface of the flotation foam

newly synthesized bubbles

and reduce the impact of noise and light

a foam infrared image segmentation method combining non-downsampling Shearlet Transform (NSST) domain saliency detection and graph cutting is proposed. NSST multi-scale decomposition of the foam infrared image

saliency detection of low-frequency subband images using GBVS algorithm

saliency value calculation based on Markov chain feature differences

noise coefficient removal and edge

weak edge coefficients are non-linearly enhanced. NSST reconstruction of the processed multi-scale high-frequency subband and low-frequency subband images is performed. The significance constraint term is constructed based on the saliency detection results of the low-frequency subband image

and the bubble brightness constraint term is constructed using a Gaussian fitting function. Then

the map is constructed Graph (Cut Cuts) energy function

and finally the maximum flow/minimum cut algorithm is used to segment the target area. The experimental results show that this method is less affected by light

and to some extent

it solves the problems of over-segmentation and under-segmentation. The detection accuracy rate of normal flotation under-flotation

and over-flotation are 91.8%

87.1%

88.9%

respectively. The segmentation accuracy is significantly improved compared with the existing methods. It can effectively extract collapsed or newly synthesized bubbles

and shows good noise immunity. It has good robustness under different working conditions.

关键词

Keywords

references

R R FONSECA , I C FRANCO , J P JR THOMPSON , 等 . Turbidity control on dissolved air flotation process using fuzzy logic . Water Science & Technology , 2018 . 78 ( 12 ): 2586 - 2596 . http://www.ncbi.nlm.nih.gov/pubmed/30767923 http://www.ncbi.nlm.nih.gov/pubmed/30767923 .

J K TAN , L LIANG , Y L PENG , 等 . The concentrate ash content analysis of coal flotation based on froth images . Minerals Engineering , 2016 . 92 9 - 20 . DOI: 10.1016/j.mineng.2016.02.006 http://doi.org/10.1016/j.mineng.2016.02.006 .

N SHARMA , H P SULTANA , R SINGH , 等 . Image segmentation in constrained IoT servers . Procedia Computer Science , 2019 . 165 336 - 342 . DOI: 10.1016/j.procs.2020.01.041 http://doi.org/10.1016/j.procs.2020.01.041 .

J ZHANG , Z H TANG , M X AI , 等 . Nonlinear modeling of the relationship between reagent dosage and flotation froth surface image by Hammerstein-Wiener model . Minerals Engineering , 2018 . 120 19 - 28 . DOI: 10.1016/j.mineng.2018.01.018 http://doi.org/10.1016/j.mineng.2018.01.018 .

S H MORAR , D J BRADSHAW , M C HARRIS . The use of the froth surface lamellae burst rate as a flotation froth stability measurement . Minerals Engineering , 2012 . 36-38 152 - 159 . DOI: 10.1016/j.mineng.2012.03.018 http://doi.org/10.1016/j.mineng.2012.03.018 .

A JAHEDSARAVANI , M H MARHABAN , M MASSINAEI . Prediction of the metallurgical performances of a batch flotation system by image analysis and neural networks . Minerals Engineering , 2014 . 69 137 - 145 . DOI: 10.1016/j.mineng.2014.08.003 http://doi.org/10.1016/j.mineng.2014.08.003 .

陈良琴 , 王卫星 . 基于泡沫表面特征变化及支持向量机的气泡稳定度测量 . 中国矿业大学学报 , 2018 . 47 ( 3 ): 652 - 661 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZGKD201803020.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZGKD201803020.htm .

L Q CHEN , W X WANG . Bubble stability measurement based on froth surface feature variation and support vector machine . Journal of China University of Mining & Technology , 2018 . 47 ( 3 ): 652 - 661 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZGKD201803020.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZGKD201803020.htm .

F NAKHAEI , M IRANNAJAD , S MOHAMMADNEJAD . Column flotation performance prediction: PCA, ANN and image analysis-based approaches . Physicochemical Problems of Mineral Processing , 2019 . 55 ( 5 ): 1298 - 1310 . http://www.researchgate.net/publication/336149789_Column_flotation_performance_prediction_PCA_ANN_and_image_analysis-based_approaches http://www.researchgate.net/publication/336149789_Column_flotation_performance_prediction_PCA_ANN_and_image_analysis-based_approaches .

邵磊 , 张一鸣 , 李季 , 等 . 基于改进的两维Otsu管道红外图像高温区域分割研究 . 光谱学与光谱分析 , 2019 . 39 ( 5 ): 1637 - 1642 . https://www.cnki.com.cn/Article/CJFDTOTAL-GUAN201905055.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GUAN201905055.htm .

L SHAO , Y M ZHANG , J LI , 等 . Research on high temperature region segmentation of infrared pipeline image based on improved two-dimensional-Otsu . Spectroscopy and Spectral Analysis , 2019 . 39 ( 5 ): 1637 - 1642 . https://www.cnki.com.cn/Article/CJFDTOTAL-GUAN201905055.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GUAN201905055.htm .

H BI , H TANG , G Y YANG , 等 . Accurate image segmentation using Gaussian mixture model with saliency map . Pattern Analysis and Applications , 2018 . 21 ( 3 ): 869 - 878 . DOI: 10.1007/s10044-017-0672-1 http://doi.org/10.1007/s10044-017-0672-1 .

Z L PENG , S J QU , Q L LI . Interactive image segmentation using geodesic appearance overlap graph cut . Signal Processing: Image Communication , 2019 . 78 159 - 170 . DOI: 10.1016/j.image.2019.06.012 http://doi.org/10.1016/j.image.2019.06.012 .

廖苗 , 刘毅志 , 欧阳军林 , 等 . 基于非线性增强和图割的CT序列肝脏肿瘤自动分割 . 计算机辅助设计与图形学学报 , 2019 . 31 ( 6 ): 1030 - 1038 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201906019.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201906019.htm .

M LIAO , Y Z LIU , J L OUYANG , 等 . Automatic segmentation of liver tumor in CT volumes using nonlinear enhancement and graph cuts . Journal of Computer-Aided Design & Computer Graphics , 2019 . 31 ( 6 ): 1030 - 1038 . https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201906019.htm https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF201906019.htm .

S SINGH , R S ANAND , D GUPTA . CT and MR image information fusion scheme using a cascaded framework in ripplet and NSST domain . IET Image Processing , 2018 . 12 ( 5 ): 696 - 707 . DOI: 10.1049/iet-ipr.2017.0214 http://doi.org/10.1049/iet-ipr.2017.0214 .

廖一鹏 , 王卫星 . 基于Shearlet多尺度边界检测及融合的浮选气泡提取 . 光学学报 , 2018 . 38 ( 3 ): 0315004 https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201803037.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201803037.htm .

Y P LIAO , W X WANG . Flotation bubble delineation based on Shearlet multiscale boundary detection and fusion . Acta Optica Sinica , 2018 . 38 ( 3 ): 0315004 https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201803037.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201803037.htm .

廖一鹏 , 王卫星 , 付华栋 , 等 . 结合分数阶微分的浮选泡沫图像NSCT多尺度增强 . 华南理工大学学报(自然科学版) , 2018 . 46 ( 3 ): 92 - 102 . DOI: 10.3969/j.issn.1000-565X.2018.03.014 http://doi.org/10.3969/j.issn.1000-565X.2018.03.014 .

Y P LIAO , W X WANG , H D FU , 等 . Flotation foam image NSCT multi-scale enhancement with fractional differential . Journal of South China University of Technology (Natural Science Edition) , 2018 . 46 ( 3 ): 92 - 102 . DOI: 10.3969/j.issn.1000-565X.2018.03.014 http://doi.org/10.3969/j.issn.1000-565X.2018.03.014 .

G EASLEY , D LABATE , W Q LIM . Sparse directional image representations using the discrete shearlet transform . Applied and Computational Harmonic Analysis , 2008 . 25 ( 1 ): 25 - 46 . DOI: 10.1016/j.acha.2007.09.003 http://doi.org/10.1016/j.acha.2007.09.003 .

程藜 , 吴谨 , 朱磊 . 基于结构标签学习的显著性目标检测 . 液晶与显示 , 2016 . 31 ( 7 ): 726 - 732 . http://cjlcd.lightpublishing.cn/thesisDetails#10.3788/YJYXS20163107.0726 http://cjlcd.lightpublishing.cn/thesisDetails#10.3788/YJYXS20163107.0726 .

L CHENG , J WU , L ZHU . Salient object detection based on structured labels learning . Chinese Journal of Liquid Crystals and Displays , 2016 . 31 ( 7 ): 726 - 732 . http://cjlcd.lightpublishing.cn/thesisDetails#10.3788/YJYXS20163107.0726 http://cjlcd.lightpublishing.cn/thesisDetails#10.3788/YJYXS20163107.0726 .

A COUTROT , J H HSIAO , A B CHAN . Scanpath modeling and classification with hidden Markov models . Behavior Research Methods , 2018 . 50 ( 1 ): 362 - 379 . DOI: 10.3758/s13428-017-0876-8 http://doi.org/10.3758/s13428-017-0876-8 .

Views

191

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Development of AOI inspection of Mura defects on TFT-LCD surface

Application of dual-wavelength fiber guided light based on OpenCV in high-precision assembly and alignment

Design and implementation of piecewise approximation bilateral filtering algorithm based on FPGA

Defect detection of small object solder joints based on improved YOLOv7

Human posture estimation and movement recognition in fitness behavior

Related Author

CHEN Zekang

SHEN Yi

ZHAI Chenyang

DONG Chenyao

WANG Shuangxi

LÜ Guanhui

LIU Xiaomei

ZHANG Zengbao

Related Institution

College of Engineering， Shantou University

Guangdong Provincial Key Laboratory of Automotive Display and Touch Technologies

College of Mechanical and Electrical Engineering， Hainan University

Key Laboratory of Chemical Lasers， Dalian Institute of Chemical Physics， Chinese Academy of Sciences

School of Microelectronics， Shanghai University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰