Geometric distortions in three-dimensional medical electronic endoscopic visualization

Zhen-ping XIA; Bo-wen ZHANG; Fei WANG; Cheng CHENG; Min-ming GU

doi:10.37188/CJLCD.2021-0252

您当前的位置：

首页 >

文章列表页 >

Geometric distortions in three-dimensional medical electronic endoscopic visualization

Display Technologyand Applications | 更新时间：2022-01-19

- Geometric distortions in three-dimensional medical electronic endoscopic visualization
- Chinese Journal of Liquid Crystals and Displays Vol. 37, Issue 1, Pages: 29-36(2022)
- 作者机构：
  
  1.苏州科技大学电子与信息工程学院，江苏苏州 215009
  2.苏州市立医院泌尿外科，江苏苏州 215002
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(62002254);National Natural Science Foundation of China(61876121);Natural Science Foundation of Jiangsu Province, China(BK20200988)
- DOI：10.37188/CJLCD.2021-0252
  CLC： TN27
- Received：08 October 2021，
  
  Revised：05 November 2021，
  
  Published：2022-01
- 稿件说明：
移动端阅览
Zhen-ping XIA, Bo-wen ZHANG, Fei WANG, et al. Geometric distortions in three-dimensional medical electronic endoscopic visualization[J]. Chinese journal of liquid crystals and displays, 2022, 37(1): 29-36.
DOI：

Zhen-ping XIA, Bo-wen ZHANG, Fei WANG, et al. Geometric distortions in three-dimensional medical electronic endoscopic visualization[J]. Chinese journal of liquid crystals and displays, 2022, 37(1): 29-36. DOI： 10.37188/CJLCD.2021-0252.

摘要

三维医用电子内窥镜已经广泛应用于各类医学诊断、微创手术以及医学培训。三维内窥镜可视化过程中的立体空间几何畸变将直接影响医护人员对于病灶相对大小和距离的视觉感知精确度，同时也可能成为三维内窥镜使用过程中影响视觉舒适度的重要因素之一。现有研究往往仅关注立体影像获取过程中平面图像的畸变及其矫正，而忽略了可视化过程中显示系统不匹配及人眼对三维影像的感知特性造成的立体空间几何畸变。本文通过对三维医用电子内窥镜影像获取、显示及感知过程的分析，建立了三维医用电子内窥镜可视化模型。理想的三维内窥镜影像感知是真实世界空间在各个维度等比例放大的虚拟空间立体感知，三维内窥镜的参数与可视化过程的参数必须匹配才能达到理想的无畸变各维度等放大率效果，最终实现精确的视觉感知以及良好的使用舒适度。研究内容有望为三维影像获取与可视化在医疗领域更为精确和舒适的应用提供理论参考。

Abstract

The three-dimensional medical electronic endoscope system is widely used for medical diagnosis

minimally invasive surgery and medical training. The geometric distortions during the visualization of the three-dimensional endoscope will affect the relative size and distance estimation accuracy of the nidus for the medical staff

and also may be one of the important factors inducing the visual discomfort. Existing researches only focused on the distortions of the two-dimensional image and its correction. The three-dimensional space geometric distortions during the visualization due to the mismatching of the three-dimensional display system and the characteristics of human eye three-dimensional perception are usually ignored. Based on the analysis of three-dimensional medical electronic endoscope image acquisition

display and perception process

the model of three-dimensional medical electronic endoscope system is established. The ideal three-dimensional endoscope image visualization is the equally magnified virtual space based on the real-world space in all dimensions

and the matching of parameters between three-dimensional endoscope image capture and visualization can achieve this goal

and finally realize the precise visual perception and well visual comfort. The results may provide some theoretical guidance for more precise and comfortable utilization of the three-dimensional image capture and visualization in medical domain.

关键词

Keywords

references

郑义微 , 王迪 , 李移隆 , 等 . 基于液晶空间光调制器的大视角全息显示技术 . 液晶与显示 , 2021 . 36 ( 6 ): 789 - 796 . DOI: 10.37188/CJLCD.3-CJLCD-2021-0028 http://doi.org/10.37188/CJLCD.3-CJLCD-2021-0028 .

Y W ZHENG , D WANG , Y L LI , 等 . Holographic display technology with large viewing angle based on liquid crystal spatial light modulator . Chinese Journal of Liquid Crystals and Displays , 2021 . 36 ( 6 ): 789 - 796 . DOI: 10.37188/CJLCD.3-CJLCD-2021-0028 http://doi.org/10.37188/CJLCD.3-CJLCD-2021-0028 .

夏振平 , 胡伏原 , 程成 , 等 . 基于视觉空间定向理论的虚拟现实空间重构 . 液晶与显示 , 2019 . 34 ( 2 ): 215 - 219 . DOI: 10.3788/YJYXS20193402.0215 http://doi.org/10.3788/YJYXS20193402.0215 .

Z P XIA , F Y HU , C CHENG , 等 . Virtual reality space reconstruction based on visual space orientation theory . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 2 ): 215 - 219 . DOI: 10.3788/YJYXS20193402.0215 http://doi.org/10.3788/YJYXS20193402.0215 .

严飞 , 宋振声 , 刘银萍 , 等 . 4K裸眼立体显示系统设计 . 液晶与显示 , 2019 . 34 ( 9 ): 862 - 870 . DOI: 10.3788/YJYXS20193409.0862 http://doi.org/10.3788/YJYXS20193409.0862 .

NF YA , Z S SONG , Y P LIU , 等 . Design of 4K bare-eye stereoscopic display system . Chinese Journal of Liquid Crystals and Displays , 2019 . 34 ( 9 ): 862 - 870 . DOI: 10.3788/YJYXS20193409.0862 http://doi.org/10.3788/YJYXS20193409.0862 .

DODGSON N A. Variation and extrema of human interpupillary distance [C]// Proceedings of SPIE 5291 , Stereoscopic Displays and Virtual Reality Systems Ⅺ . San Jose: SPIE, 2014: 36-46.

G MCLACHLAN . From 2D to 3D: the future of surgery? . The Lancet , 2011 . 378 ( 9800 ): 1368 DOI: 10.1016/S0140-6736(11)61597-3 http://doi.org/10.1016/S0140-6736(11)61597-3 .

C Y LIU , C Y SHI , T S WANG , 等 . Bio-inspired multimodal 3D endoscope for image-guided and robotic surgery . Optics Express , 2021 . 29 ( 1 ): 145 - 157 . DOI: 10.1364/OE.410424 http://doi.org/10.1364/OE.410424 .

S Y BAE , R J KORNISKI , M SHEARN , 等 . 4-mm-diameter three-dimensional imaging endoscope with steerable camera for minimally invasive surgery (3-D-MARVEL) . Neurophotonics , 2016 . 4 ( 1 ): 011008 DOI: 10.1117/1.NPh.4.1.011008 http://doi.org/10.1117/1.NPh.4.1.011008 .

吴贵贤 , 崔茂荣 , 刘俊宁 , 等 . 3D腹腔镜技术在泌尿系统疾病重建手术中的应用 . 临床医学工程 , 2019 . 26 ( 3 ): 281 - 282 . DOI: 10.3969/j.issn.1674-4659.2019.03.0281 http://doi.org/10.3969/j.issn.1674-4659.2019.03.0281 .

G X WU , M R CUI , J N LIU , 等 . Application of 3D laparoscopic technique in reconstruction surgery for urinary system diseases . Clinical Medical & Engineering , 2019 . 26 ( 3 ): 281 - 282 . DOI: 10.3969/j.issn.1674-4659.2019.03.0281 http://doi.org/10.3969/j.issn.1674-4659.2019.03.0281 .

J Y W CHAN , W I WEI . Three-dimensional endoscopy for endoscopic salvage nasopharyngectomy: preliminary report of experience . The Laryngoscope , 2018 . 128 ( 6 ): 1386 - 1391 . DOI: 10.1002/lary.26993 http://doi.org/10.1002/lary.26993 .

S H KONG , B M OH , H YOON , 等 . Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera . Surgical Endoscopy , 2010 . 24 ( 5 ): 1132 - 1143 . DOI: 10.1007/s00464-009-0740-8 http://doi.org/10.1007/s00464-009-0740-8 .

M SCHOENTHALER , D SCHNELL , K WILHELM , 等 . Stereoscopic (3D) versus monoscopic (2D) laparoscopy: comparative study of performance using advanced HD optical systems in a surgical simulator model . World Journal of Urology , 2016 . 34 ( 4 ): 471 - 477 . DOI: 10.1007/s00345-015-1660-y http://doi.org/10.1007/s00345-015-1660-y .

蒋堃 , 梁朝朝 , 周骏 , 等 . 3D腹腔镜与传统腹腔镜技术治疗肾上腺肿瘤的疗效比较 . 中华腔镜泌尿外科杂志(电子版) , 2013 . 7 ( 6 ): 3 - 6 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm , .

K JIANG , C Z LIANG , J ZHOU , 等 . Comparison of 3D and 2D laparoscopic adrenalectomy for adrenal neoplasm . Chinese Journal of Endourology (Electronic Edition) , 2013 . 7 ( 6 ): 3 - 6 . https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm https://www.cnki.com.cn/Article/CJFDTOTAL-ZHQJ201306003.htm , .

A NASSIMIZADEH , S M ZAIDI , M NASSIMIZADEH , 等 . Endoscopic training—is the future three-dimensional? . Laryngoscope Investigative Otolaryngology , 2018 . 3 ( 5 ): 345 - 348 . DOI: 10.1002/lio2.207 http://doi.org/10.1002/lio2.207 .

侯蕊 , 葛振杰 , 赵越 , 等 . 基于椭圆拟合的医用内窥镜图像相对畸变率检测方法研究 . 光学技术 , 2019 . 45 ( 3 ): 364 - 367 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm , .

R HOU , Z J GE , Y ZHAO , 等 . Method for detecting the relatived istortion rate of medical endoscope image based on ellipse fitting algorithm . Optical Technique , 2019 . 45 ( 3 ): 364 - 367 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJS201903018.htm , .

宋璐 , 卫亚博 , 冯艳平 . 医用电子内窥镜图像畸变校正方法的研究 . 计算机与数字工程 , 2016 . 44 ( 12 ): 2480 - 2483 . DOI: 10.3969/j.issn.1672-9722.2016.12.039 http://doi.org/10.3969/j.issn.1672-9722.2016.12.039 .

L SONG , Y B WEI , Y P FENG . Image distortion correction technology of medical electronic endoscope . Computer and Digital Engineering , 2016 . 44 ( 12 ): 2480 - 2483 . DOI: 10.3969/j.issn.1672-9722.2016.12.039 http://doi.org/10.3969/j.issn.1672-9722.2016.12.039 .

张建勋 , 韩明慧 , 代煜 . 面向低分辨率单目内窥镜图像的三维多孔结构重建 . 光学精密工程 , 2020 . 28 ( 9 ): 2085 - 2095 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm , .

J X ZHANG , M H HAN , Y DAI . Three-dimensional porous structure reconstruction for low-resolution monocular endoscopic images . Optics and Precision Engineering , 2020 . 28 ( 9 ): 2085 - 2095 . https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GXJM202009022.htm , .

王强 , 陶沛 , 袁波 , 等 . 多颜色空间的内窥镜图像血管增强方法 . 光电工程 , 2020 . 47 ( 1 ): 190268 https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm , .

Q WANG , P TAO , B YUAN , 等 . Vessel enhancement of endoscopic image based on multi-color space . Opto-Electronic Engineering , 2020 . 47 ( 1 ): 190268 https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202001006.htm , .

A S MALIK , R N H R KHAIRUDDIN , H U AMIN , 等 . EEG based evaluation of stereoscopic 3D displays for viewer discomfort . BioMedical Engineering OnLine , 2015 . 14 21 DOI: 10.1186/s12938-015-0006-8 http://doi.org/10.1186/s12938-015-0006-8 .

A D HWANG , E PELI . Instability of the perceived world while watching 3D stereoscopic imagery: a likely source of motion sickness symptoms . i-Perception , 2014 . 5 ( 6 ): 515 - 535 . DOI: 10.1068/i0647 http://doi.org/10.1068/i0647 .

K YOSHIMOTO , M NOBUTAKA , D KUGA , 等 . Dual optical channel three-dimensional neuroendoscopy: clinical application as an assistive technique in endoscopic endonasal surgery . Interdisciplinary Neurosurgery , 2016 . 6 45 - 50 . DOI: 10.1016/j.inat.2016.08.001 http://doi.org/10.1016/j.inat.2016.08.001 .

J X HE , K L ANG , Z X HAO , 等 . The comparison between novel and traditional three-dimensional image system in thoracoscopy: glasses-less vs . glass . Journal of Thoracic Disease , 2016 . 8 ( 11 ): 3075 - 3080 . DOI: 10.21037/jtd.2016.11.63 http://doi.org/10.21037/jtd.2016.11.63 .

Z P GAO , A HWANG , G T ZHAI , 等 . Correcting geometric distortions in stereoscopic 3D imaging . PLoS One , 2018 . 13 ( 10 ): e0205032 DOI: 10.1371/journal.pone.0205032 http://doi.org/10.1371/journal.pone.0205032 .

Z P XIA , C CHENG , X H LI . Visual comfort enhancement study based on visual attention detection for stereoscopic displays . Journal of the Society for Information Display , 2016 . 24 ( 10 ): 633 - 640 . DOI: 10.1002/jsid.508 http://doi.org/10.1002/jsid.508 .

WOODS A J, DOCHERTY T, KOCH R. Image distortions in stereoscopic video systems [C]// Proceedings of SPIE 1915 , Stereoscopic Displays and Applications IV . San Jose: SPIE, 1993: 36-49.

Views

164

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Effects of optical distortion on visually induced motion sickness in near-eye display

Adaptive color optimization algorithm of image engine in display system

Influence of white level and color saturation of LCD smartphone on visual comfort and visual fatigue

Moving image quality of liquid crystal display based on human factor

Related Author

ZHANG Bo-wen

XIA Zhen-ping

CHENG Cheng

WANG Fei

GU Min-ming

ZHANG Yuan-shen

MA Feng-yun

XIA Zhen-ping

Related Institution

Department of Urology， Suzhou Municipal Hospital

College of Electronic and Information Engineering， Suzhou University of Science and Technology

College of Electronics and Information Engineering， Suzhou University of Science and Technology

Joint International Research Laboratory of Information Display and Visualization， School of Electronic Science and Engineering， Southeast University

Suzhou Smart City Research Institute, Suzhou University of Science and Technology

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰