Panoramic video virtual view synthesis based on viewing angle

Jian-zhao CHEN; Ying CHEN; Jia-run SONG

doi:10.3788/YJYXS20193401.0063

您当前的位置：

首页 >

文章列表页 >

Panoramic video virtual view synthesis based on viewing angle

Materials and Devices | 更新时间：2020-07-05

- Panoramic video virtual view synthesis based on viewing angle
- Chinese Journal of Liquid Crystals and Displays Vol. 34, Issue 1, Pages: 63-69(2019)
- 作者机构：
  
  西安电子科技大学综合业务网理论及关键技术国家重点实验室, 陕西西安 710071
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20193401.0063
  CLC： TN27
- Received：02 August 2018，
  
  Accepted：22 October 2018，
  
  Published：2019-02
- 稿件说明：
移动端阅览
Jian-zhao CHEN, Ying CHEN, Jia-run SONG. Panoramic video virtual view synthesis based on viewing angle[J]. Chinese journal of liquid crystals and displays, 2019, 34(1): 63-69.
DOI：

Jian-zhao CHEN, Ying CHEN, Jia-run SONG. Panoramic video virtual view synthesis based on viewing angle[J]. Chinese journal of liquid crystals and displays, 2019, 34(1): 63-69. DOI： 10.3788/YJYXS20193401.0063.

摘要

针对3DOF+视频搭建了一套基于视角方向的全景视频虚拟视图合成系统，利用极少视点位置的视频信息即可准确渲染任意视点位置的视频内容，从而为用户提供真实的观看体验。将所合成的新视点位置视图与相机采集的真实视图进行比较。实验结果表明，所合成的虚拟视图平均客观指标PSNR为23 dB左右，主观质量良好，较为真实且能够提供良好的交互性与视觉体验。

Abstract

In order to provide users with a true viewing experience

a panoramic video virtual view synthesis system based on view angle for 3DOF+ video was built

which could accurately render arbitrary viewpoint position by using video information with few viewpoint positions. Comparing the synthesized new viewpoint position view with the real view collected by the camera

the experimental results show that the synthesized objective view has an average objective index PSNR of about 23 dB

good subjective quality

and is realistic and can provide good interactivity and visual experience.

关键词

Keywords

references

QIAN F, HAN L J, GOPALAKRISHNAN V. Optimizing 360 video delivery over cellularnetworks[C]//Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Chanllenges. NewYork: ACM, 2016: 1-6.

CUMMINGS J J, BAILENSON J N. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence[J] . Media Psychology , 2016, 19(2):272-309.

CHAMPELM L, KOENEN R, LAFRUIT G, et al. Working Draft 0.2 of TR: Technical report on architectures for immersive media[R]. ISO/IEC JTC1/SC29/WG11, Doc. MPEG-2017 N16918, Hobart, 2017.

FEHNC. Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV[C]//Stereoscopic Displays and Virtual Reality Systems XI. International Society for Optics and Photonics, 2004, 5291: 93-105.

SZELISKI R, SHUM H Y. Creating full view panoramic image mosaics and environment maps[C]// Proceedings of the 24th annual conference on Computer graphics and interactive techniques. NewYork: ACM Press/Addison-Wesley Publishing Co., 1997: 251-258.

NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos[J]. IEEE Transactions on Circuits and Systems for Video Technology , 2005, 15(1):82-95.

HUANG K C, CHIEN P Y, CHIEN C A, et al. A 360-degree panoramic video system design[C]// Proceedings of Technical Papers of 2014 In ternational Symposium on VLSI Design, Automation and Test. Taiwan, China: IEEE, 2014: 1-4.

FU C W, WAN L, WONG T T, et al. The rhombic dodecahedron map:an efficient scheme for encoding panoramic video[J]. IEEE Transactions on Multimedia , 2009, 11(4):634-644.

WEGNER K, STANKIEWICZ O, DZIEMBOWSKI A, et al. Omnidirectional 6-DoF/3-DoF+ rendering[R]. MPEG-I visual of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. MPEG Doc. m40806, 2017: 1-6.

ZHANG F, LIU F. Casual stereoscopic panorama stitching[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 2002-2010.

Wikipedia.Equirectangular projection[EB/OL]. (2018-02-21)[2018-3-30] . https://en.wikipedia.org/wiki/Equirectangular_projection https://en.wikipedia.org/wiki/Equirectangular_projection .

贾瑞才.重力/地磁辅助的欧拉角无迹卡尔曼滤波姿态估计[J].光学精密工程, 2014, 22(12):3280-3286.

JIA Rui-cai. Attitude estimation base on gravity/magnetic assisted Euler angle UKF.[J]. Optics and Precision Engineering , 2014, 22(12):3280-3286.

王永, 姚太克, 周烽, 等.望远镜副镜的三自由度并联支撑构型研究与运动分析[J].光学精密工程, 2013, 21(11):2860-28696.

WANG Y, YAO T K, ZHOU F, et al. Type synthesis of 3-DOF parallel support system for telescope secondary mirror[J]. Optics and Precision Engineering , 2013, 21(11):2860-2869.

STANKIEWICZ O, WEGNER K, TANIMOTO M, et al. Enhanced view synthesis reference software (VSRS) for free-viewpoint television[R]. ISO/IEC JTC , 2013, 1: 533-541.

LEE C, HO Y S. Common-hole filling for boundary noise removal in VSRS[R]. MPEG2010/M18514, Guangzhou, China 2010.

汪泽伟, 于有光, 杨付正.基于HTC Vive的全景视频显示质量评估[J].液晶与显示, 2018, 33(1):85-91

WANG Z W, YU Y G, YANG F Z. Panoramic video display quality assessment based on HTC Vive[J]. Chinese Journal of Liquid Crystals and Displays , 2018, 33(1):85-91.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Panoramic video display quality assessment based on HTC Vive

Effects of optical distortion on visually induced motion sickness in near-eye display

Virtual reality space reconstruction based on visual space orientation theory

Interactive omnidirectional video display system based on OpenGL

Simulation of Shrapnel Ejection Based on Vega And MFC

Related Author

You-guang YU

Fu-zheng YANG

Ze-wei WANG

ZHANG Yuan-shen

PENG Zi-xiong

CHENG Cheng

XIA Zhen-ping

MA Feng-yun

Related Institution

College of Electronics and Information Engineering， Suzhou University of Science and Technology

College of Electronic and Information Engineering, Suzhou University of Science and Technology

Virtual Reality Key Laboratory of Intelligent Interaction and Application Technology of Suzhou

Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

Graduate University of Chinese Academy of Sciences

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰