Interactive omnidirectional video display system based on OpenGL

Fan ZHOU; Wei ZHANG; Fu-zheng YANG

doi:10.3788/YJYXS20183309.0808

您当前的位置：

首页 >

文章列表页 >

Interactive omnidirectional video display system based on OpenGL

Image Processing | 更新时间：2020-07-06

- Interactive omnidirectional video display system based on OpenGL
- Chinese Journal of Liquid Crystals and Displays Vol. 33, Issue 9, Pages: 808-815(2018)
- 作者机构：
  
  西安电子科技大学综合业务网理论及关键技术国家重点实验室, 陕西西安 710071
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20183309.0808
  CLC： TN141
- Received：05 May 2018，
  
  Accepted：20 June 2018，
  
  Published：05 September 2018
- 稿件说明：
移动端阅览
Fan ZHOU, Wei ZHANG, Fu-zheng YANG. Interactive omnidirectional video display system based on OpenGL[J]. Chinese journal of liquid crystals and displays, 2018, 33(9): 808-815.
DOI：

Fan ZHOU, Wei ZHANG, Fu-zheng YANG. Interactive omnidirectional video display system based on OpenGL[J]. Chinese journal of liquid crystals and displays, 2018, 33(9): 808-815. DOI： 10.3788/YJYXS20183309.0808.

摘要

随着虚拟现实和多媒体通信技术的快速发展，全景视频作为一种新兴的数字媒体，凭借其良好的临场感和沉浸感在影视娱乐、教育教学、工业仿真、医学研究等众多领域取得广泛应用。为了更好地开展全景视频的相关研究，建立交互式的全景视频显示系统成为了优化和完善全景视频业务的重要前提。本文基于OpenGL渲染技术，结合用户对于全景视频交互操作的需求，搭建了交互式全景视频显示系统，并在该系统上通过实验分析了本系统的交互时延和视频分辨率、帧率的关系。实验结果表明，交互产生的时延和视频分辨率、帧率的大小呈正相关关系。在本平台的设置下，交互产生的时延不超过0.02 s，为用户提供了良好的交互性和视觉体验，为全景视频的相关研究与应用开发提供了稳定的平台。

Abstract

With the rapid development of virtual reality and multimedia communication technology

omnidirectional video has become a major form of immersive media. Due to the sense of presence and immersion provided to the end users

omnidirectional videos have been widely applied in many fields including entertainment

education

industrial simulation

and medicine. To facilitate the research on omnidirectional videos

establishing an interactive omnidirectional video display system is an important precondition. Based on the OpenGL rendering technology

this paper built an interactive omnidirectional video display system according to the display demand of end users. To analyze the performance of the proposed system

the relationship between the interaction delay and the video resolution as well as the frame rate were investigated. Experimental results showed that the interaction delay is proportional to the video resolution and the frame rate and the maximum delay of the proposed system is only 0.02 s in the test condition which is able to provide end users with satisfying interactivity and visual experience. The proposed system can serve as a stable platform for conducting research on omnidirectional videos.

关键词

Keywords

references

QIAN F, JI L S, HAN B, et al . Optimizing 360 video delivery over cellular networks[C]// Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges . New York: ACM, 2016: 1-6..

GHIMIRES. Production of 360° video: Introduction to 360° video and production guidelines[D].Helsinki: Helsinki Metropolia University of Applied Sciences, 2016: 8-12. https://www.theseus.fi/handle/10024/115293

SZELISKI R, SHUM H Y. Creating full view panoramic image mosaics and environment maps[C]// Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques . New York: ACM Press/Addison-Wesley Publishing Co., 1997: 251-258.

NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos[J]. IEEE Transactions on Circuits and Systems for Video Technology , 2005, 15(1):82-95.

HUANG K C, CHIEN P Y, CHIEN C A, et al . A 360-degree panoramic video system design[C]// Technical Papers of 2014 International Symposium on VLSI Design, Automation and Test . Hsinchu, Taiwan, China: IEEE, 2014: 1-4.

FU C W, WAN L, WONG T T, et al . The rhombic dodecahedron map:An efficient scheme for encoding panoramic video[J]. IEEE Transactions on Multimedia , 2009, 11(4):634-644.

LIU Y F, YANG L, XU M, et al . Rate control schemes for panoramic video coding[J]. Journal of Visual Communication and Image Representation , 2018, 53:76-85.

ZONG T Y, TU Z Z, AI L, et al . Panoramic video delivery based on Laplace compensation and Sphere-Markov probability model[C]// Proceedings of 2018 IEEE International Conference on Consumer Electronics (ICCE) . Las Vegas, NV, USA: IEEE, 2018: 1-4.

孔令胜, 南敬实, 荀显超.平面三维显示技术的研究现状[J].中国光学与应用光学, 2009, 2(2):112-118.

KONG L S, NAN J S, XUN X C. Research status quo of flat 3-D display technology[J]. Chinese Journal of Optics and Applied Optics , 2009, 2(2):112-118. (in Chinese)

赵星, 王芳, 杨勇, 等.集成成像三维显示系统显示性能的研究进展[J].中国光学, 2012, 5(3):209-221.

ZHAO X, WANG F, YANG Y, et al . Research progress of display performance of integral imaging three-dimensional display system[J]. Chinese Optics , 2012, 5(3):209-221. (in Chinese)

CHENG Y. Progress in display technologies and their applications[J]. Chinese Journal of Optics and Applied Optics , 2010, 3(1):27-32.

ZORIC G, BARKHUUS L, ENGSTRÖM A, et al . Panoramic video: design challenges and implications for content interaction[C]// Proceedings of the 11th European Conference on Interactive TV and Video . Como, Italy: ACM, 2013: 153-162.

NENG L A R, CHAMBEL T. Get around 360° hypervideo[C]// Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments . Tampere, Finland: ACM, 2010: 119-122.

施珂奕, 邓春健, 邹昆.基于OpenGL的三维模型点坐标拾取方法[J].液晶与显示, 2016, 31(7):708-713.

SHI K Y, DENG C J, ZOU K. Point pick-up in three-dimension model based on OpenGL[J]. Chinese Journal of Liquid Crystals and Displays , 2016, 31(7):708-713. (in Chinese)

RAKKOLAINEN I, RAISAMO R, TURK M, et al . Casual immersive viewing with smartphones[C]// Proceedings of the 20th International Academic Mindtrek Conference . Tampere, Finland: ACM, 2016: 449-452

HEARN D D, BAKER M P, CARITHERS W R. Computer graphics with OpenGL [M]. 4th ed. Upper Saddle River:Prentice Hall Press, 2010.

SHREINER D, SELLERS G, KESSENICH J, et al . OpenGL Programming Guide:The Official Guide to Learning OpenGL [M]. version 4.38th ed. Reading:Addison-Wesley, 2013.

HOWARD I P, ROGERS B J. Binocular Vision and Stereopsis [M]. New York, USA:Oxford University Press, 1995.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Panoramic video display quality assessment based on HTC Vive

Panoramic video virtual view synthesis based on viewing angle

Point pick-up in three-dimension model based on OpenGL

Design and implementation of LCoS microsystem with terrestrial TV receiver

Related Author

Ze-wei WANG

You-guang YU

Fu-zheng YANG

Shi-rong WANG

Bin YANG

Jian-zhao CHEN

Ying CHEN

Jia-run SONG

Related Institution

High Technology Research and Development Center of Ministry of Science and Technology

School of Chemical Engineering and Technology, Tianjin University

School of Computer Science & Engineering, University of Electronic Science and Technology of China

Zhongshan Institute, University of Electronic Science and Technology of China

Institute of Photo-electronics Thin Film Devices and Technique of Nankai University, Key Laboratory of Photo-Electronics Thin Film Devices and Technique of Tianjin, Key Laboratory of Opto-electronic Information Science and Technology Ministry of Education, Nankai University, Tianjin University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰