三维医用电子内窥镜可视化中的几何畸变

夏振平; 张博文; 王飞; 程成; 顾敏明

doi:10.37188/CJLCD.2021-0252

您当前的位置：

首页 >

文章列表页 >

三维医用电子内窥镜可视化中的几何畸变

显示技术与应用 | 更新时间：2022-01-19

- 三维医用电子内窥镜可视化中的几何畸变
- Geometric distortions in three-dimensional medical electronic endoscopic visualization
- 液晶与显示 2022年37卷第1期页码：29-36
- 作者机构：
  
  1.苏州科技大学电子与信息工程学院，江苏苏州 215009
  2.苏州市立医院泌尿外科，江苏苏州 215002
- 作者简介：
  
  [ "夏振平 (1985-)，男，江苏兴化人，博士，副教授，2014年于东南大学获得博士学位，主要从事视觉相关的立体显示图像质量测量、评价和优化方面的研究。E-mail: xzp@usts.edu.cn" ]
- 基金信息：
  
  国家自然科学基金(62002254);国家自然科学基金(61876121);江苏省自然科学基金(BK20200988);国家留学基金委项目(201704515003)
- DOI：10.37188/CJLCD.2021-0252
  中图分类号： TN27
- 收稿日期：2021-10-08，
  
  修回日期：2021-11-05，
  
  纸质出版日期：2022-01
- 稿件说明：
移动端阅览
夏振平, 张博文, 王飞, 等. 三维医用电子内窥镜可视化中的几何畸变[J]. 液晶与显示, 2022,37(1):29-36.

Zhen-ping XIA, Bo-wen ZHANG, Fei WANG, et al. Geometric distortions in three-dimensional medical electronic endoscopic visualization[J]. Chinese journal of liquid crystals and displays, 2022, 37(1): 29-36.
夏振平, 张博文, 王飞, 等. 三维医用电子内窥镜可视化中的几何畸变[J]. 液晶与显示, 2022,37(1):29-36. DOI： 10.37188/CJLCD.2021-0252.

Zhen-ping XIA, Bo-wen ZHANG, Fei WANG, et al. Geometric distortions in three-dimensional medical electronic endoscopic visualization[J]. Chinese journal of liquid crystals and displays, 2022, 37(1): 29-36. DOI： 10.37188/CJLCD.2021-0252.

摘要

三维医用电子内窥镜已经广泛应用于各类医学诊断、微创手术以及医学培训。三维内窥镜可视化过程中的立体空间几何畸变将直接影响医护人员对于病灶相对大小和距离的视觉感知精确度，同时也可能成为三维内窥镜使用过程中影响视觉舒适度的重要因素之一。现有研究往往仅关注立体影像获取过程中平面图像的畸变及其矫正，而忽略了可视化过程中显示系统不匹配及人眼对三维影像的感知特性造成的立体空间几何畸变。本文通过对三维医用电子内窥镜影像获取、显示及感知过程的分析，建立了三维医用电子内窥镜可视化模型。理想的三维内窥镜影像感知是真实世界空间在各个维度等比例放大的虚拟空间立体感知，三维内窥镜的参数与可视化过程的参数必须匹配才能达到理想的无畸变各维度等放大率效果，最终实现精确的视觉感知以及良好的使用舒适度。研究内容有望为三维影像获取与可视化在医疗领域更为精确和舒适的应用提供理论参考。

Abstract

The three-dimensional medical electronic endoscope system is widely used for medical diagnosis

minimally invasive surgery and medical training. The geometric distortions during the visualization of the three-dimensional endoscope will affect the relative size and distance estimation accuracy of the nidus for the medical staff

and also may be one of the important factors inducing the visual discomfort. Existing researches only focused on the distortions of the two-dimensional image and its correction. The three-dimensional space geometric distortions during the visualization due to the mismatching of the three-dimensional display system and the characteristics of human eye three-dimensional perception are usually ignored. Based on the analysis of three-dimensional medical electronic endoscope image acquisition

display and perception process

the model of three-dimensional medical electronic endoscope system is established. The ideal three-dimensional endoscope image visualization is the equally magnified virtual space based on the real-world space in all dimensions

and the matching of parameters between three-dimensional endoscope image capture and visualization can achieve this goal

and finally realize the precise visual perception and well visual comfort. The results may provide some theoretical guidance for more precise and comfortable utilization of the three-dimensional image capture and visualization in medical domain.

关键词

Keywords

references

郑义微 , 王迪 , 李移隆 , 等 . 基于液晶空间光调制器的大视角全息显示技术 . 液晶与显示 , 2021 . 36 ( 6 ): 789 - 796 . DOI: 10.37188/CJLCD.3-CJLCD-2021-0028 http://doi.org/10.37188/CJLCD.3-CJLCD-2021-0028 .

Y W ZHENG , D WANG , Y L LI , 等 . Holographic display technology with large viewing angle based on liquid crystal spatial light modulator . Chinese Journal of Liquid Crystals and Displays , 2021 . 36 ( 6 ): 789 - 796 . DOI: 10.37188/CJLCD.3-CJLCD-2021-0028 http://doi.org/10.37188/CJLCD.3-CJLCD-2021-0028 .

夏振平 , 胡伏原 , 程成 , 等 . 基于视觉空间定向理论的虚拟现实空间重构 . 液晶与显示 , 2019 . 34 ( 2 ): 215 - 219 . DOI: 10.3788/YJYXS20193402.0215 http://doi.org/10.3788/YJYXS20193402.0215 .

Z P XIA , F Y HU , C CHENG , 等 . Virtual reality space reconstruction based on visual space orientation theory . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 2 ): 215 - 219 . DOI: 10.3788/YJYXS20193402.0215 http://doi.org/10.3788/YJYXS20193402.0215 .

严飞 , 宋振声 , 刘银萍 , 等 . 4K裸眼立体显示系统设计 . 液晶与显示 , 2019 . 34 ( 9 ): 862 - 870 . DOI: 10.3788/YJYXS20193409.0862 http://doi.org/10.3788/YJYXS20193409.0862 .

NF YA , Z S SONG , Y P LIU , 等 . Design of 4K bare-eye stereoscopic display system . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 9 ): 862 - 870 . DOI: 10.3788/YJYXS20193409.0862 http://doi.org/10.3788/YJYXS20193409.0862 .

DODGSON N A. Variation and extrema of human interpupillary distance [C]// Proceedings of SPIE 5291 , Stereoscopic Displays and Virtual Reality Systems Ⅺ . San Jose: SPIE, 2014: 36-46.

G MCLACHLAN . From 2D to 3D: the future of surgery? . The Lancet , 2011 . 378 ( 9800 ): 1368 DOI: 10.1016/S0140-6736(11)61597-3 http://doi.org/10.1016/S0140-6736(11)61597-3 .

C Y LIU , C Y SHI , T S WANG , 等 . Bio-inspired multimodal 3D endoscope for image-guided and robotic surgery . Optics Express , 2021 . 29 ( 1 ): 145 - 157 . DOI: 10.1364/OE.410424 http://doi.org/10.1364/OE.410424 .

S Y BAE , R J KORNISKI , M SHEARN , 等 . 4-mm-diameter three-dimensional imaging endoscope with steerable camera for minimally invasive surgery (3-D-MARVEL) . Neurophotonics , 2016 . 4 ( 1 ): 011008 DOI: 10.1117/1.NPh.4.1.011008 http://doi.org/10.1117/1.NPh.4.1.011008 .

吴贵贤 , 崔茂荣 , 刘俊宁 , 等 . 3D腹腔镜技术在泌尿系统疾病重建手术中的应用 . 临床医学工程 , 2019 . 26 ( 3 ): 281 - 282 . DOI: 10.3969/j.issn.1674-4659.2019.03.0281 http://doi.org/10.3969/j.issn.1674-4659.2019.03.0281 .

G X WU , M R CUI , J N LIU , 等 . Application of 3D laparoscopic technique in reconstruction surgery for urinary system diseases . Clinical Medical & Engineering , 2019 . 26 ( 3 ): 281 - 282 . DOI: 10.3969/j.issn.1674-4659.2019.03.0281 http://doi.org/10.3969/j.issn.1674-4659.2019.03.0281 .

J Y W CHAN , W I WEI . Three-dimensional endoscopy for endoscopic salvage nasopharyngectomy: preliminary report of experience . The Laryngoscope , 2018 . 128 ( 6 ): 1386 - 1391 . DOI: 10.1002/lary.26993 http://doi.org/10.1002/lary.26993 .

S H KONG , B M OH , H YOON , 等 . Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera . Surgical Endoscopy , 2010 . 24 ( 5 ): 1132 - 1143 . DOI: 10.1007/s00464-009-0740-8 http://doi.org/10.1007/s00464-009-0740-8 .

M SCHOENTHALER , D SCHNELL , K WILHELM , 等 . Stereoscopic (3D) versus monoscopic (2D) laparoscopy: comparative study of performance using advanced HD optical systems in a surgical simulator model . World Journal of Urology , 2016 . 34 ( 4 ): 471 - 477 . DOI: 10.1007/s00345-015-1660-y http://doi.org/10.1007/s00345-015-1660-y .

蒋堃 , 梁朝朝 , 周骏 , 等 . 3D腹腔镜与传统腹腔镜技术治疗肾上腺肿瘤的疗效比较 . 中华腔镜泌尿外科杂志(电子版) , 2013 . 7 ( 6 ): 3 - 6 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm , .

K JIANG , C Z LIANG , J ZHOU , 等 . Comparison of 3D and 2D laparoscopic adrenalectomy for adrenal neoplasm . Chinese Journal of Endourology (Electronic Edition) , 2013 . 7 ( 6 ): 3 - 6 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm , .

A NASSIMIZADEH , S M ZAIDI , M NASSIMIZADEH , 等 . Endoscopic training—is the future three-dimensional? . Laryngoscope Investigative Otolaryngology , 2018 . 3 ( 5 ): 345 - 348 . DOI: 10.1002/lio2.207 http://doi.org/10.1002/lio2.207 .

侯蕊 , 葛振杰 , 赵越 , 等 . 基于椭圆拟合的医用内窥镜图像相对畸变率检测方法研究 . 光学技术 , 2019 . 45 ( 3 ): 364 - 367 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm , .

R HOU , Z J GE , Y ZHAO , 等 . Method for detecting the relatived istortion rate of medical endoscope image based on ellipse fitting algorithm . Optical Technique , 2019 . 45 ( 3 ): 364 - 367 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm , .

宋璐 , 卫亚博 , 冯艳平 . 医用电子内窥镜图像畸变校正方法的研究 . 计算机与数字工程 , 2016 . 44 ( 12 ): 2480 - 2483 . DOI: 10.3969/j.issn.1672-9722.2016.12.039 http://doi.org/10.3969/j.issn.1672-9722.2016.12.039 .

L SONG , Y B WEI , Y P FENG . Image distortion correction technology of medical electronic endoscope . Computer and Digital Engineering , 2016 . 44 ( 12 ): 2480 - 2483 . DOI: 10.3969/j.issn.1672-9722.2016.12.039 http://doi.org/10.3969/j.issn.1672-9722.2016.12.039 .

张建勋 , 韩明慧 , 代煜 . 面向低分辨率单目内窥镜图像的三维多孔结构重建 . 光学精密工程 , 2020 . 28 ( 9 ): 2085 - 2095 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm , .

J X ZHANG , M H HAN , Y DAI . Three-dimensional porous structure reconstruction for low-resolution monocular endoscopic images . Optics and Precision Engineering , 2020 . 28 ( 9 ): 2085 - 2095 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm , .

王强 , 陶沛 , 袁波 , 等 . 多颜色空间的内窥镜图像血管增强方法 . 光电工程 , 2020 . 47 ( 1 ): 190268 https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm , .

Q WANG , P TAO , B YUAN , 等 . Vessel enhancement of endoscopic image based on multi-color space . Opto-Electronic Engineering , 2020 . 47 ( 1 ): 190268 https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm , .

A S MALIK , R N H R KHAIRUDDIN , H U AMIN , 等 . EEG based evaluation of stereoscopic 3D displays for viewer discomfort . BioMedical Engineering OnLine , 2015 . 14 21 DOI: 10.1186/s12938-015-0006-8 http://doi.org/10.1186/s12938-015-0006-8 .

A D HWANG , E PELI . Instability of the perceived world while watching 3D stereoscopic imagery: a likely source of motion sickness symptoms . i-Perception , 2014 . 5 ( 6 ): 515 - 535 . DOI: 10.1068/i0647 http://doi.org/10.1068/i0647 .

K YOSHIMOTO , M NOBUTAKA , D KUGA , 等 . Dual optical channel three-dimensional neuroendoscopy: clinical application as an assistive technique in endoscopic endonasal surgery . Interdisciplinary Neurosurgery , 2016 . 6 45 - 50 . DOI: 10.1016/j.inat.2016.08.001 http://doi.org/10.1016/j.inat.2016.08.001 .

J X HE , K L ANG , Z X HAO , 等 . The comparison between novel and traditional three-dimensional image system in thoracoscopy: glasses-less vs . glass . Journal of Thoracic Disease , 2016 . 8 ( 11 ): 3075 - 3080 . DOI: 10.21037/jtd.2016.11.63 http://doi.org/10.21037/jtd.2016.11.63 .

Z P GAO , A HWANG , G T ZHAI , 等 . Correcting geometric distortions in stereoscopic 3D imaging . PLoS One , 2018 . 13 ( 10 ): e0205032 DOI: 10.1371/journal.pone.0205032 http://doi.org/10.1371/journal.pone.0205032 .

Z P XIA , C CHENG , X H LI . Visual comfort enhancement study based on visual attention detection for stereoscopic displays . Journal of the Society for Information Display , 2016 . 24 ( 10 ): 633 - 640 . DOI: 10.1002/jsid.508 http://doi.org/10.1002/jsid.508 .

WOODS A J, DOCHERTY T, KOCH R. Image distortions in stereoscopic video systems [C]// Proceedings of SPIE 1915 , Stereoscopic Displays and Applications IV . San Jose: SPIE, 1993: 36-49.

浏览量

164

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

近眼显示中光学畸变对视觉诱导晕动症的影响

显示系统图像引擎的自适应色彩优化算法

LCD手机白场亮度和饱和度对视觉舒适度和视疲劳的影响

基于人因的液晶显示动态图像质量研究