Design of 4K bare-eye stereoscopic display system

Fei YAN; Zhen-sheng SONG; Yin-ping LIU; Qing-qing LIU; Jing-yi CAI

doi:10.3788/YJYXS20193409.0862

您当前的位置：

首页 >

文章列表页 >

Design of 4K bare-eye stereoscopic display system

Materials and Devices | 更新时间：2020-07-05

- Design of 4K bare-eye stereoscopic display system
- Chinese Journal of Liquid Crystals and Displays Vol. 34, Issue 9, Pages: 862-870(2019)
- 作者机构：
  
  1.南京信息工程大学自动化学院, 江苏南京 21004
  2.江苏省大气环境与装备技术协同创新中心, 江苏南京 210044
  3.南京信息工程大学大气物理学院, 江苏南京 210044
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20193409.0862
  CLC： TN391
- Received：22 April 2019，
  
  Accepted：15 May 2019，
  
  Published：05 September 2019
- 稿件说明：
移动端阅览
Fei YAN, Zhen-sheng SONG, Yin-ping LIU, et al. Design of 4K bare-eye stereoscopic display system[J]. Chinese journal of liquid crystals and displays, 2019, 34(9): 862-870.
DOI：

Fei YAN, Zhen-sheng SONG, Yin-ping LIU, et al. Design of 4K bare-eye stereoscopic display system[J]. Chinese journal of liquid crystals and displays, 2019, 34(9): 862-870. DOI： 10.3788/YJYXS20193409.0862.

摘要

随着医疗显示技术的进步，医疗内窥镜摄像系统已经由主流的2D（Two Dimensions）显示向3D（Three Dimensions）显示发展，图像清晰度也从高清（High Definition，HD）向超高清（Ultra High Definition，UHD）转变。因此，本文设计开发了一种基于FPGA的4K（3 840×2 160）裸眼立体显示系统。首先，系统对双路3G-SDI图像采集并进行YUV到RGB的格式转换。其次，使用Xilinx提供的VPSS核实现图像的缩放，同时解决高速图像数据带宽与DDR3存储器带宽间的匹配问题。最后，通过SBS（Side by Side）的拼接方式，将满足立体图像输出格式的视频源通过立体显示器输出。该系统从前端立体图像的采集到后端立体图像的输出，需要经过格式变换、缩放、缓存、同步以及拼接等多个处理过程。实验结果表明，采用参考时钟为148.5 MHz的双路SDI输入，经FPGA的实时处理后可实现分辨率为3 840×2 160、刷新率为60 Hz的SBS拼接格式图像，该图像可直接驱动裸眼立体显示器。

Abstract

With the development of medical display technology

medical endoscope camera system has developed from the mainstream 2D (Two Dimensions) display to 3D (Three Dimensions) display

and image definition has also changed from high definition (HD) to ultra high definition (UHD). Therefore

this paper designed and developed a 4K medical stereo display system based on FPGA. Firstly

the system carried on dual 3G-SDI image acquisition and YUV to RGB format conversion. Secondly

the VPSS core provided by Xilinx was used to realize image scaling

and the matching problem between high-speed image data bandwidth and DDR3 memory bandwidth was solved. Finally

the video source satisfying the stereo image output format was output by the stereo display through the splicing mode of SBS (Side by Side). The system from the front end stereo image acquisition to the back end stereo image output

needed to go through format transformation

scaling

caching

synchronization and Mosaic and other processes. Experimental results show that the dual-channel SDI input with a reference clock of 148.5 MHz and real-time processing by FPGA can achieve a SBS Mosaic image with a resolution of 3 840×2 160 and a refresh rate of 60 Hz

which can directly drive the naked eye stereo display.

关键词

Keywords

references

王嘉祺.基于CUDA的虚拟人视觉感知与记忆模型及其在路径规划中的应用[D].武汉: 华中科技大学, 2016.

WANG J Q. Virtual human visual perception and memory model based on CUDA and its application in path panning[D]. Wuhan: Huazhong University of Science and Technology, 2016. (in Chinese)

李超.基于双目立体视觉裸眼3D显示技术研究[D].南京: 南京航空航天大学, 2015.

LI C. Research on technology of naked-eye 3D display based on binocular stereo vision[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2015. (in Chinese)

MCLACHLANG. From 2D to 3D: the future of surgery?[J]. The Lancet , 2011, 378(9800): 1368-1368.

ALARAIMI B, EL BAKBAK W, SARKER S, et al . A randomized prospective study comparing acquisition of laparoscopic skills in three-dimensional (3D) vs . two-dimensional (2D) laparoscopy[J]. World Journal of Surgery , 2014, 38(11): 2746-2752.

STORZ P, BUESS G F, KUNERTW, et al . 3D HD versus 2D HD: surgical task efficiency in standardised phantom tasks[J]. Surgical Endoscopy , 2012, 26(5): 1454-1460.

SINHA R, SUNDARAM M, RAJE S, et al . 3D laparoscopy: technique and initial experience in 451 cases[J]. Gynecological Surgery , 2013, 10(2): 123-128.

ZENBUTSU S, IGARASHI T, NAKAMURA R, et al . 3D ultrasound assisted laparoscopic liver surgery by visualization of blood vessels[C]// Proceedings of 2013 IEEE International Ultrasonics Symposium . Prague, Czech Republic: IEEE, 2014: 840-843.

GHEDI A, DONARINI E, LAMERA R, et al . 3D vs 2D laparoscopic systems: development of a performance quantitative validation model[C]// Proceedings of 2015 37 th Annual International Conference of the IEEE Engineering in Medicine and Biology Society . Milan, Italy: IEEE, 2015: 6884-6887.

MURALI A, SEN S, KEHOE B, et al . Learning by observation for surgical subtasks: multilateral cutting of 3D viscoelastic and 2D orthotropic tissue phantoms[C]// Proceedings of 2015 IEEE International Conference on Robotics and Automation . Seattle, WA, USA: IEEE, 2015: 1202-1209.

KONG S H, OH B M, YOON H, et al . Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera[J]. Surgical Endoscopy , 2010, 24(5): 1132-1143.

胡雅洁.北京协和医院成功实施国内首例3D腹腔镜肾盂旁囊肿切除术[J].首都医药, 2013, 20(7):40.

HU Y J. Beijing union medical college hospital successfully carried out the first domestic 3D laparoscopic nephropyelectomy[J]. Capital Medical , 2013, 20(7): 40. (in Chinese)

蒋堃, 梁朝朝, 周骏, 等.3D腹腔镜与传统腹腔镜技术治疗肾上腺肿瘤的疗效比较[J].中华腔镜泌尿外科杂志(电子版), 2013, 7(6):3-6.

JIANG K, LIANG C Z, ZHOU J, et al . Comparison of 3D and 2D laparoscopic adrenalectomy for adrenal neoplasm[J]. Chinese Journal of Endourology ( Electronic Version ), 2013, 7(6): 3-6. (in Chinese)

李汉忠, 张玉石, 张学斌, 等.3D腹腔镜系统在泌尿外科手术中的应用[J].中华泌尿外科杂志, 2013, 34(5):325-328.

LI H Z, ZHANG Y S, ZHANG X B, et al . Application of 3D video techniques in urological laparoscopic surgery[J]. Chinese Journal of Urology , 2013, 34(5): 325-328. (in Chinese)

刘皓, 林天歆, 许可慰, 等.3D腹腔镜下根治性膀胱前列腺切除术的初步经验[J].中华泌尿外科杂志, 2013, 34(10):767-770.

LIU H, LIN T X, XU K W, et al . Preliminary experience of laparoscopic radical cystectomy and prostatectomy with three-dimensional laparoscopy[J]. Chinese Journal of Urology , 2013, 34(10): 767-770. (in Chinese)

鲁青.国内首次在神经外科手术中启用3D内镜切除脑垂体瘤[J].健康博览, 2017(1):12.

LU Q.Three-dimensional endoscopic resection of pituitary adenoma was used in neurosurgery for the first time in China[J]. Health Expo. , 2017(1):12. (in Chinese)

LIU X, LI L. FPGA-based three-dimensional endoscope system using a single CCD camera[C]// Proceedings of 2015 IEEE International Conference on Information and Automation . Lijiang: IEEE, 2015: 614-618.

OH J, KIM K. Accurate 3D reconstruction for less overlapped laparoscopic sequential images[C]// Proceedings of 2017 International Conference on Bio - engineering for Smart Technologies . Paris, France: IEEE, 2017: 1-4.

LEE P Y, YAN S L, HU M H, et al . A computed stereoscopic method for laparoscopic surgery by using feature tracking[C]// Proceedings of 2015 IEEE International Conference on Consumer Electronics - Taiwan . Taipei, China: IEEE, 2015: 9-10.

ZHAO Y, WEI Y T, CUI X Y, et al . 3D display technology in medical imaging field[C]// Proceedings of 2013 IEEE International Conference on Medical Imaging Physics and Engineering . Shenyang: IEEE, 2013: 210-214.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Design of heterogeneous FPGA hardware accelerator based on CNN

Design and implementation of piecewise approximation bilateral filtering algorithm based on FPGA

Surface glossiness in stereoscopic displays： a review

Design of serial bus data distribution chip for LED display

Design of multi-channel real-time video processing system based on FPGA

Related Author

JI Haolin

XU Wei

PIAO Yongjie

WU Xiaobin

GAO Tan

LIU Shiyu

ZHAO Xiadong

WEN Pan

Related Institution

Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences

University of Chinese Academy of Sciences

Key Laboratory of Space-based Dynamic & Rapid Optical Imaging Technology， Chinese Academy of Sciences

School of Microelectronics， Shanghai University

Key Laboratory of Advanced Display and System Applications of Ministry of Education， Shanghai University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰