基于OpenGL的交互式全景视频显示系统

周凡; 张伟; 杨付正

doi:10.3788/YJYXS20183309.0808

您当前的位置：

首页 >

文章列表页 >

基于OpenGL的交互式全景视频显示系统

图像处理 | 更新时间：2020-07-06

- 基于OpenGL的交互式全景视频显示系统
- Interactive omnidirectional video display system based on OpenGL
- 液晶与显示 2018年33卷第9期页码：808-815
- 作者机构：
  
  西安电子科技大学综合业务网理论及关键技术国家重点实验室, 陕西西安 710071
- 作者简介：
  
  [ "周凡(1994-), 男, 江苏南通人, 硕士研究生, 研究方向为计算机图形学与虚拟现实。E-mail:fzhou_945@stu.xidian.edu.cn" ]
- 基金信息：
  
  中央高校基本科研业务费(JB180105);国家自然科学基金(61601349);国家自然科学基金(61571337);the Fundamental Research Funds for the Central Universities(JB180105);National Science Foundation of China(61601349);National Natural Science Foundation of China(61571337)
- DOI：10.3788/YJYXS20183309.0808
  中图分类号： TN141
- 收稿日期：2018-05-05，
  
  录用日期：2018-6-20，
  
  纸质出版日期：2018-09-05
- 稿件说明：
移动端阅览
周凡, 张伟, 杨付正. 基于OpenGL的交互式全景视频显示系统[J]. 液晶与显示, 2018,33(9):808-815.

Fan ZHOU, Wei ZHANG, Fu-zheng YANG. Interactive omnidirectional video display system based on OpenGL[J]. Chinese journal of liquid crystals and displays, 2018, 33(9): 808-815.
周凡, 张伟, 杨付正. 基于OpenGL的交互式全景视频显示系统[J]. 液晶与显示, 2018,33(9):808-815. DOI： 10.3788/YJYXS20183309.0808.

Fan ZHOU, Wei ZHANG, Fu-zheng YANG. Interactive omnidirectional video display system based on OpenGL[J]. Chinese journal of liquid crystals and displays, 2018, 33(9): 808-815. DOI： 10.3788/YJYXS20183309.0808.

摘要

随着虚拟现实和多媒体通信技术的快速发展，全景视频作为一种新兴的数字媒体，凭借其良好的临场感和沉浸感在影视娱乐、教育教学、工业仿真、医学研究等众多领域取得广泛应用。为了更好地开展全景视频的相关研究，建立交互式的全景视频显示系统成为了优化和完善全景视频业务的重要前提。本文基于OpenGL渲染技术，结合用户对于全景视频交互操作的需求，搭建了交互式全景视频显示系统，并在该系统上通过实验分析了本系统的交互时延和视频分辨率、帧率的关系。实验结果表明，交互产生的时延和视频分辨率、帧率的大小呈正相关关系。在本平台的设置下，交互产生的时延不超过0.02 s，为用户提供了良好的交互性和视觉体验，为全景视频的相关研究与应用开发提供了稳定的平台。

Abstract

With the rapid development of virtual reality and multimedia communication technology

omnidirectional video has become a major form of immersive media. Due to the sense of presence and immersion provided to the end users

omnidirectional videos have been widely applied in many fields including entertainment

education

industrial simulation

and medicine. To facilitate the research on omnidirectional videos

establishing an interactive omnidirectional video display system is an important precondition. Based on the OpenGL rendering technology

this paper built an interactive omnidirectional video display system according to the display demand of end users. To analyze the performance of the proposed system

the relationship between the interaction delay and the video resolution as well as the frame rate were investigated. Experimental results showed that the interaction delay is proportional to the video resolution and the frame rate and the maximum delay of the proposed system is only 0.02 s in the test condition which is able to provide end users with satisfying interactivity and visual experience. The proposed system can serve as a stable platform for conducting research on omnidirectional videos.

关键词

Keywords

references

QIAN F, JI L S, HAN B, et al . Optimizing 360 video delivery over cellular networks[C]// Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges . New York: ACM, 2016: 1-6..

GHIMIRES. Production of 360° video: Introduction to 360° video and production guidelines[D].Helsinki: Helsinki Metropolia University of Applied Sciences, 2016: 8-12. https://www.theseus.fi/handle/10024/115293

SZELISKI R, SHUM H Y. Creating full view panoramic image mosaics and environment maps[C]// Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques . New York: ACM Press/Addison-Wesley Publishing Co., 1997: 251-258.

NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos[J]. IEEE Transactions on Circuits and Systems for Video Technology , 2005, 15(1):82-95.

HUANG K C, CHIEN P Y, CHIEN C A, et al . A 360-degree panoramic video system design[C]// Technical Papers of 2014 International Symposium on VLSI Design, Automation and Test . Hsinchu, Taiwan, China: IEEE, 2014: 1-4.

FU C W, WAN L, WONG T T, et al . The rhombic dodecahedron map:An efficient scheme for encoding panoramic video[J]. IEEE Transactions on Multimedia , 2009, 11(4):634-644.

LIU Y F, YANG L, XU M, et al . Rate control schemes for panoramic video coding[J]. Journal of Visual Communication and Image Representation , 2018, 53:76-85.

ZONG T Y, TU Z Z, AI L, et al . Panoramic video delivery based on Laplace compensation and Sphere-Markov probability model[C]// Proceedings of 2018 IEEE International Conference on Consumer Electronics (ICCE) . Las Vegas, NV, USA: IEEE, 2018: 1-4.

孔令胜, 南敬实, 荀显超.平面三维显示技术的研究现状[J].中国光学与应用光学, 2009, 2(2):112-118.

KONG L S, NAN J S, XUN X C. Research status quo of flat 3-D display technology[J]. Chinese Journal of Optics and Applied Optics , 2009, 2(2):112-118. (in Chinese)

赵星, 王芳, 杨勇, 等.集成成像三维显示系统显示性能的研究进展[J].中国光学, 2012, 5(3):209-221.

ZHAO X, WANG F, YANG Y, et al . Research progress of display performance of integral imaging three-dimensional display system[J]. Chinese Optics , 2012, 5(3):209-221. (in Chinese)

CHENG Y. Progress in display technologies and their applications[J]. Chinese Journal of Optics and Applied Optics , 2010, 3(1):27-32.

ZORIC G, BARKHUUS L, ENGSTRÖM A, et al . Panoramic video: design challenges and implications for content interaction[C]// Proceedings of the 11th European Conference on Interactive TV and Video . Como, Italy: ACM, 2013: 153-162.

NENG L A R, CHAMBEL T. Get around 360° hypervideo[C]// Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments . Tampere, Finland: ACM, 2010: 119-122.

施珂奕, 邓春健, 邹昆.基于OpenGL的三维模型点坐标拾取方法[J].液晶与显示, 2016, 31(7):708-713.

SHI K Y, DENG C J, ZOU K. Point pick-up in three-dimension model based on OpenGL[J]. Chinese Journal of Liquid Crystals and Displays , 2016, 31(7):708-713. (in Chinese)

RAKKOLAINEN I, RAISAMO R, TURK M, et al . Casual immersive viewing with smartphones[C]// Proceedings of the 20th International Academic Mindtrek Conference . Tampere, Finland: ACM, 2016: 449-452

HEARN D D, BAKER M P, CARITHERS W R. Computer graphics with OpenGL [M]. 4th ed. Upper Saddle River:Prentice Hall Press, 2010.

SHREINER D, SELLERS G, KESSENICH J, et al . OpenGL Programming Guide:The Official Guide to Learning OpenGL [M]. version 4.38th ed. Reading:Addison-Wesley, 2013.

HOWARD I P, ROGERS B J. Binocular Vision and Stereopsis [M]. New York, USA:Oxford University Press, 1995.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于HTC Vive的全景视频显示质量评估

基于视角方向的全景虚拟视图合成

基于OpenGL的三维模型点坐标拾取方法

具有无线电视接收的LCoS显示微系统设计与实现