Object 6D pose estimation algorithm based on improved heatmap loss function

Lin LIN; Yan-jie WANG; Hai-chao SUN

doi:10.37188/CJLCD.2021-0317

您当前的位置：

首页 >

文章列表页 >

Object 6D pose estimation algorithm based on improved heatmap loss function

Image Processing | 更新时间：2022-07-25

- Object 6D pose estimation algorithm based on improved heatmap loss function
- Chinese Journal of Liquid Crystals and Displays Vol. 37, Issue 7, Pages: 913-923(2022)
- 作者机构：
  
  1.中国科学院长春光学精密机械与物理研究所，吉林长春 130033
  2.中国科学院大学，北京 100049
- 作者简介：
- 基金信息：
  
  Department of Science and Technology of Jilin Province(20210201132GX)
- DOI：10.37188/CJLCD.2021-0317
  CLC： TP391.4
- Received：03 December 2021，
  
  Revised：09 January 2022，
  
  Published：05 July 2022
- 稿件说明：
移动端阅览
Lin LIN, Yan-jie WANG, Hai-chao SUN. Object 6D pose estimation algorithm based on improved heatmap loss function[J]. Chinese journal of liquid crystals and displays, 2022, 37(7): 913-923.
DOI：

Lin LIN, Yan-jie WANG, Hai-chao SUN. Object 6D pose estimation algorithm based on improved heatmap loss function[J]. Chinese journal of liquid crystals and displays, 2022, 37(7): 913-923. DOI： 10.37188/CJLCD.2021-0317.

摘要

针对传统热图回归使用的均方误差（MSE）损失函数训练热图回归网络的精度不高且训练缓慢的问题，本文提出了用于热图回归的损失函数Heatmap Wing Loss（HWing Loss）。该损失函数对于不同的像素值有不同的损失函数值，前景像素的损失函数梯度更大，可以使网络更加关注前景像素，使热图回归更加准确快速。同时根据热图分布特性，使用基于高斯分布的关键点推理方法减小热图推断关键点时的量化误差。以此两点为基础，构造新的基于关键点定位的单目标姿态估计的算法。实验结果表明，相比于使用MSE Loss的算法，使用HWing Loss的姿态估计算法有更高的ADD（-S）准确率，在LINEMOD数据集上达到了88.8%，性能优于近期其他的基于深度学习的姿态估计算法。本文算法在RTX3080 GPU上最快能以25 fps的速度运行，兼具速度与性能优势。

Abstract

In view of the problem of low precision and slow training of heatmap regression network trained by mean square error （MSE） loss function used in traditional heatmap regression， the loss function Heatmap Wing Loss （HWing Loss） for heatmap regression is proposed in this thesis. In terms of different pixel values， the loss function has different loss function values， and the loss function gradient of foreground pixels is larger， which can make the network focus more on the foreground pixels and make the heatmap regression more accurate and faster. In line with the distribution characteristics of the heatmap， the keypoint inference method based on the Gaussian distribution is adopted in this thesis to reduce the quantization error when the heatmap infers the keypoints. By taking the two points as the basis， it constructs a new monocular pose estimation algorithm based on keypoint positioning. According to the experiments， in contrast with the algorithm using MSE Loss， the pose estimation algorithm using HWing Loss has a higher ADD（-S） accuracy rate， which reaches 88.8% on the LINEMOD dataset. Meanwhile， the performance is better than other recent pose estimation algorithms based on deep learning. The algorithm in this thesis can run at the fastest speed of 25 fps on RTX3080 GPU， in which the high speed and performance can be both embodied.

关键词

Keywords

references

RUBLEE E ， RABAUD V ， KONOLIGE K ， et al . ORB： an efficient alternative to SIFT or SURF ［C］// 2011 International Conference on Computer Vision . Barcelona ： IEEE ， 2011 ： 2564 - 2571 . doi: 10.1109/iccv.2011.6126544 http://dx.doi.org/10.1109/iccv.2011.6126544

BAY H ， ESS A ， TUYTELAARS T ， et al . Speeded-up robust features （SURF）［J］. Computer Vision and Image Understanding ， 2008 ， 110 （ 3 ）： 346 - 359 .

丁南南，刘艳滢，朱明．尺度相互作用墨西哥帽小波提取图像特征点［J］．液晶与显示， 2012 ， 27 （ 1 ）： 125 - 129 ． doi: 10.3788/yjyxs20122701.0125 http://dx.doi.org/10.3788/yjyxs20122701.0125

DING N N ， LIU Y Y ， ZHU M . Extracting image feature points using scale-interaction of mexican-hat wavelets ［J］. Chinese Journal of Liquid Crystals and Displays ， 2012 ， 27 （ 1 ）： 125 - 129 . （in Chinese） . doi: 10.3788/yjyxs20122701.0125 http://dx.doi.org/10.3788/yjyxs20122701.0125

DO T T ， CAI M ， PHAM T ， et al . Deep-6DPose： recovering 6D object pose from a single RGB image ［EB/OL］. （ 2018-02-28 ）. https：//arxiv.org/abs/1802.10367v1 https://arxiv.org/abs/1802.10367v1 .

SUNDERMEYER M ， MARTON Z C ， DURNER M ， et al . Augmented autoencoders： implicit 3D orientation learning for 6D object detection ［J］. International Journal of Computer Vision ， 2020 ， 128 （ 3 ）： 714 - 729 . doi: 10.1007/s11263-019-01243-8 http://dx.doi.org/10.1007/s11263-019-01243-8

TEKIN B ， SINHA S N ， FUA P ， et al . Real-time seamless single shot 6D object pose prediction ［C］// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City ： IEEE ， 2018 ： 292 - 301 . doi: 10.1109/cvpr.2018.00038 http://dx.doi.org/10.1109/cvpr.2018.00038

ZHAO Z L ， PENG G ， WANG H Y ， et al . Estimating 6D pose from localizing designated surface keypoints ［EB/OL］. （ 2018-12-04 ）. https：//arxiv.org/abs/1812.01387 https://arxiv.org/abs/1812.01387 .

PARK K ， PATTEN T ， VINCZE M . Pix2Pose： pixel-wise coordinate regression of objects for 6D pose estimation ［C］// 2019 IEEE/CVF International Conference on Computer Vision . Seoul ： IEEE ， 2019 ： 7667 - 7676 . doi: 10.1109/iccv.2019.00776 http://dx.doi.org/10.1109/iccv.2019.00776

PENG S D ， LIU Y ， HUANG Q X ， et al . PVNet： pixel-wise voting network for 6DoF pose estimation ［C］// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach ： IEEE ， 2019 ： 4556 - 4565 . doi: 10.1109/cvpr.2019.00469 http://dx.doi.org/10.1109/cvpr.2019.00469

WANG X Y ， BO L F ， LI F X . Adaptive wing loss for robust face alignment via heatmap regression ［C］// 2019 IEEE/CVF International Conference on Computer Vision . Seoul ： IEEE ， 2019 ： 6970 - 6980 . doi: 10.1109/iccv.2019.00707 http://dx.doi.org/10.1109/iccv.2019.00707

SUN K ， XIAO B ， LIU D ， et al . Deep high-resolution representation learning for human pose estimation ［C］// IEEE Conference on Computer Vision and Pattern Recognition . Long Beach ： IEEE ， 2019 ： 5693 - 5703 . doi: 10.1109/cvpr.2019.00584 http://dx.doi.org/10.1109/cvpr.2019.00584

WANG J D ， SUN K ， CHENG T H ， et al . Deep high-resolution representation learning for visual recognition ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence ， 2021 ， 43 （ 10 ）： 3349 - 3364 . doi: 10.1109/tpami.2020.2983686 http://dx.doi.org/10.1109/tpami.2020.2983686

ZHANG F ， ZHU X T ， DAI H B ， et al . Distribution-aware coordinate representation for human pose estimation ［C］// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle ： IEEE ， 2020 ： 7091 - 7100 . doi: 10.1109/cvpr42600.2020.00712 http://dx.doi.org/10.1109/cvpr42600.2020.00712

LEPETIT V ， MORENO-NOGUER F ， FUA P . EP n P： an accurate O （ n ） solution to the P n P problem ［J］. International Journal of Computer Vision ， 2009 ， 81 （ 2 ）： 155 - 166 . doi: 10.1007/s11263-008-0152-6 http://dx.doi.org/10.1007/s11263-008-0152-6

XIAO J X ， HAYS J ， EHINGER K A ， et al . SUN database： large-scale scene recognition from abbey to zoo ［C］// 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition . San Francisco ： IEEE ， 2010 ： 3485 - 3492 . doi: 10.1109/cvpr.2010.5539970 http://dx.doi.org/10.1109/cvpr.2010.5539970

XIANG Y ， SCHMIDT T ， NARAYANAN V ， et al . PoseCNN： a convolutional neural network for 6D object pose estimation in cluttered scenes ［C］// Proceedings of the 14th Robotics： Science and Systems . Pittsburgh ： IEEE ， 2018 .

LI Y ， WANG G ， JI X Y ， et al . DeepIM： deep iterative matching for 6D pose estimation ［J］. International Journal of Computer Vision ， 2020 ， 128 （ 3 ）： 657 - 678 . doi: 10.1007/s11263-019-01250-9 http://dx.doi.org/10.1007/s11263-019-01250-9

OBERWEGER M ， RAD M ， LEPETIT V . Making deep heatmaps robust to partial occlusions for 3D object pose estimation ［C］// Proceedings of the 15th European Conference on Computer Vision . Munich ： Springer ， 2018 ： 125 - 141 . doi: 10.1007/978-3-030-01267-0_8 http://dx.doi.org/10.1007/978-3-030-01267-0_8

Views

530

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

3D hand reconstruction method based on adaptive occlusion recovery and topology-pose bidirectional perception

Reconstruction method of video snapshot compressive imaging based on Mamba-2

Research progress on absolute visual localization of unmanned aerial vehicles

3D light-field display with corrected perspective based on optical flow prediction

Related Author

LIN Lin

WANG Yan-jie

SUN Hai-chao

LIU Jia

HUANG Nanxuan

CHEN Dapeng

WEI Lina

SHI Dunpan

Related Institution

Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences

School of Automation， Nanjing University of Information Science & Technology

School of Computer and Computing Science， Hangzhou City University

Key Laboratory of Space-based Dynamic & Rapid Optical Imaging Technology， Chinese Academy of Sciences

Jilin Provincial Key Laboratory of Aerospace Advanced Optical Imaging Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰