4K裸眼立体显示系统设计

严飞; 宋振声; 刘银萍; 刘卿卿; 蔡静怡

doi:10.3788/YJYXS20193409.0862

您当前的位置：

首页 >

文章列表页 >

4K裸眼立体显示系统设计

材料与器件 | 更新时间：2020-07-05

- 4K裸眼立体显示系统设计
- Design of 4K bare-eye stereoscopic display system
- 液晶与显示 2019年34卷第9期页码：862-870
- 作者机构：
  
  1.南京信息工程大学自动化学院, 江苏南京 21004
  2.江苏省大气环境与装备技术协同创新中心, 江苏南京 210044
  3.南京信息工程大学大气物理学院, 江苏南京 210044
- 作者简介：
  
  [ "严飞(1983—), 男, 江苏南京人, 博士, 讲师, 2014年于中国科学院大学获得博士学位, 主要从事信息显示技术方面的研究。E-mail:fyan@nuist.edu.cn" ]
- 基金信息：
  
  国家自然科学基金(61605083);国家自然科学基金(61701244);江苏省自然科学基金(BK20150903);江苏省高校自然科学基金(16KJB510023);Natural Science Foundation of China(61605083);Natural Science Foundation of China(61701244);Natural Science Foundation of Jiangsu Province of(BK20150903);Natural Science Foundation of Jiangsu Higher Education Institutions(16KJB510023)
- DOI：10.3788/YJYXS20193409.0862
  中图分类号： TN391
- 收稿日期：2019-04-22，
  
  录用日期：2019-5-15，
  
  纸质出版日期：2019-09-05
- 稿件说明：
移动端阅览
严飞, 宋振声, 刘银萍, 等. 4K裸眼立体显示系统设计[J]. 液晶与显示, 2019,34(9):862-870.

Fei YAN, Zhen-sheng SONG, Yin-ping LIU, et al. Design of 4K bare-eye stereoscopic display system[J]. Chinese journal of liquid crystals and displays, 2019, 34(9): 862-870.
严飞, 宋振声, 刘银萍, 等. 4K裸眼立体显示系统设计[J]. 液晶与显示, 2019,34(9):862-870. DOI： 10.3788/YJYXS20193409.0862.

Fei YAN, Zhen-sheng SONG, Yin-ping LIU, et al. Design of 4K bare-eye stereoscopic display system[J]. Chinese journal of liquid crystals and displays, 2019, 34(9): 862-870. DOI： 10.3788/YJYXS20193409.0862.

摘要

随着医疗显示技术的进步，医疗内窥镜摄像系统已经由主流的2D（Two Dimensions）显示向3D（Three Dimensions）显示发展，图像清晰度也从高清（High Definition，HD）向超高清（Ultra High Definition，UHD）转变。因此，本文设计开发了一种基于FPGA的4K（3 840×2 160）裸眼立体显示系统。首先，系统对双路3G-SDI图像采集并进行YUV到RGB的格式转换。其次，使用Xilinx提供的VPSS核实现图像的缩放，同时解决高速图像数据带宽与DDR3存储器带宽间的匹配问题。最后，通过SBS（Side by Side）的拼接方式，将满足立体图像输出格式的视频源通过立体显示器输出。该系统从前端立体图像的采集到后端立体图像的输出，需要经过格式变换、缩放、缓存、同步以及拼接等多个处理过程。实验结果表明，采用参考时钟为148.5 MHz的双路SDI输入，经FPGA的实时处理后可实现分辨率为3 840×2 160、刷新率为60 Hz的SBS拼接格式图像，该图像可直接驱动裸眼立体显示器。

Abstract

With the development of medical display technology

medical endoscope camera system has developed from the mainstream 2D (Two Dimensions) display to 3D (Three Dimensions) display

and image definition has also changed from high definition (HD) to ultra high definition (UHD). Therefore

this paper designed and developed a 4K medical stereo display system based on FPGA. Firstly

the system carried on dual 3G-SDI image acquisition and YUV to RGB format conversion. Secondly

the VPSS core provided by Xilinx was used to realize image scaling

and the matching problem between high-speed image data bandwidth and DDR3 memory bandwidth was solved. Finally

the video source satisfying the stereo image output format was output by the stereo display through the splicing mode of SBS (Side by Side). The system from the front end stereo image acquisition to the back end stereo image output

needed to go through format transformation

scaling

caching

synchronization and Mosaic and other processes. Experimental results show that the dual-channel SDI input with a reference clock of 148.5 MHz and real-time processing by FPGA can achieve a SBS Mosaic image with a resolution of 3 840×2 160 and a refresh rate of 60 Hz

which can directly drive the naked eye stereo display.

关键词

Keywords

references

王嘉祺.基于CUDA的虚拟人视觉感知与记忆模型及其在路径规划中的应用[D].武汉: 华中科技大学, 2016.

WANG J Q. Virtual human visual perception and memory model based on CUDA and its application in path panning[D]. Wuhan: Huazhong University of Science and Technology, 2016. (in Chinese)

李超.基于双目立体视觉裸眼3D显示技术研究[D].南京: 南京航空航天大学, 2015.

LI C. Research on technology of naked-eye 3D display based on binocular stereo vision[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2015. (in Chinese)

MCLACHLANG. From 2D to 3D: the future of surgery?[J]. The Lancet , 2011, 378(9800): 1368-1368.

ALARAIMI B, EL BAKBAK W, SARKER S, et al . A randomized prospective study comparing acquisition of laparoscopic skills in three-dimensional (3D) vs . two-dimensional (2D) laparoscopy[J]. World Journal of Surgery , 2014, 38(11): 2746-2752.

STORZ P, BUESS G F, KUNERTW, et al . 3D HD versus 2D HD: surgical task efficiency in standardised phantom tasks[J]. Surgical Endoscopy , 2012, 26(5): 1454-1460.

SINHA R, SUNDARAM M, RAJE S, et al . 3D laparoscopy: technique and initial experience in 451 cases[J]. Gynecological Surgery , 2013, 10(2): 123-128.

ZENBUTSU S, IGARASHI T, NAKAMURA R, et al . 3D ultrasound assisted laparoscopic liver surgery by visualization of blood vessels[C]// Proceedings of 2013 IEEE International Ultrasonics Symposium . Prague, Czech Republic: IEEE, 2014: 840-843.

GHEDI A, DONARINI E, LAMERA R, et al . 3D vs 2D laparoscopic systems: development of a performance quantitative validation model[C]// Proceedings of 2015 37 th Annual International Conference of the IEEE Engineering in Medicine and Biology Society . Milan, Italy: IEEE, 2015: 6884-6887.

MURALI A, SEN S, KEHOE B, et al . Learning by observation for surgical subtasks: multilateral cutting of 3D viscoelastic and 2D orthotropic tissue phantoms[C]// Proceedings of 2015 IEEE International Conference on Robotics and Automation . Seattle, WA, USA: IEEE, 2015: 1202-1209.

KONG S H, OH B M, YOON H, et al . Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera[J]. Surgical Endoscopy , 2010, 24(5): 1132-1143.

胡雅洁.北京协和医院成功实施国内首例3D腹腔镜肾盂旁囊肿切除术[J].首都医药, 2013, 20(7):40.

HU Y J. Beijing union medical college hospital successfully carried out the first domestic 3D laparoscopic nephropyelectomy[J]. Capital Medical , 2013, 20(7): 40. (in Chinese)

蒋堃, 梁朝朝, 周骏, 等.3D腹腔镜与传统腹腔镜技术治疗肾上腺肿瘤的疗效比较[J].中华腔镜泌尿外科杂志(电子版), 2013, 7(6):3-6.

JIANG K, LIANG C Z, ZHOU J, et al . Comparison of 3D and 2D laparoscopic adrenalectomy for adrenal neoplasm[J]. Chinese Journal of Endourology ( Electronic Version ), 2013, 7(6): 3-6. (in Chinese)

李汉忠, 张玉石, 张学斌, 等.3D腹腔镜系统在泌尿外科手术中的应用[J].中华泌尿外科杂志, 2013, 34(5):325-328.

LI H Z, ZHANG Y S, ZHANG X B, et al . Application of 3D video techniques in urological laparoscopic surgery[J]. Chinese Journal of Urology , 2013, 34(5): 325-328. (in Chinese)

刘皓, 林天歆, 许可慰, 等.3D腹腔镜下根治性膀胱前列腺切除术的初步经验[J].中华泌尿外科杂志, 2013, 34(10):767-770.

LIU H, LIN T X, XU K W, et al . Preliminary experience of laparoscopic radical cystectomy and prostatectomy with three-dimensional laparoscopy[J]. Chinese Journal of Urology , 2013, 34(10): 767-770. (in Chinese)

鲁青.国内首次在神经外科手术中启用3D内镜切除脑垂体瘤[J].健康博览, 2017(1):12.

LU Q.Three-dimensional endoscopic resection of pituitary adenoma was used in neurosurgery for the first time in China[J]. Health Expo. , 2017(1):12. (in Chinese)

LIU X, LI L. FPGA-based three-dimensional endoscope system using a single CCD camera[C]// Proceedings of 2015 IEEE International Conference on Information and Automation . Lijiang: IEEE, 2015: 614-618.

OH J, KIM K. Accurate 3D reconstruction for less overlapped laparoscopic sequential images[C]// Proceedings of 2017 International Conference on Bio - engineering for Smart Technologies . Paris, France: IEEE, 2017: 1-4.

LEE P Y, YAN S L, HU M H, et al . A computed stereoscopic method for laparoscopic surgery by using feature tracking[C]// Proceedings of 2015 IEEE International Conference on Consumer Electronics - Taiwan . Taipei, China: IEEE, 2015: 9-10.

ZHAO Y, WEI Y T, CUI X Y, et al . 3D display technology in medical imaging field[C]// Proceedings of 2013 IEEE International Conference on Medical Imaging Physics and Engineering . Shenyang: IEEE, 2013: 210-214.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于CNN的异构FPGA硬件加速器设计

基于FPGA的分段近似双边滤波算法设计与实现

立体显示下表面光泽感知研究现状与展望

LED显示串行总线数据分发芯片的设计

基于FPGA的多路实时视频处理系统设计