基于视角方向的全景虚拟视图合成

陈剑钊; 陈莹; 宋佳润

doi:10.3788/YJYXS20193401.0063

您当前的位置：

首页 >

文章列表页 >

基于视角方向的全景虚拟视图合成

材料与器件 | 更新时间：2020-07-05

- 基于视角方向的全景虚拟视图合成
- Panoramic video virtual view synthesis based on viewing angle
- 液晶与显示 2019年34卷第1期页码：63-69
- 作者机构：
  
  西安电子科技大学综合业务网理论及关键技术国家重点实验室, 陕西西安 710071
- 作者简介：
  
  [ "陈剑钊(1993-), 男, 福建泉州人, 硕士研究生, 2017年于西安电子科技大学获得学士学位, 主要从事计算机图形学与虚拟现实的研究。E-mail:jzchen1993@stu.xidian.edu.cn" ]
- 基金信息：
  
  国家自然科学基金(61601349);National Science Foundation of China(61601349)
- DOI：10.3788/YJYXS20193401.0063
  中图分类号： TN27
- 收稿日期：2018-08-02，
  
  录用日期：2018-10-22，
  
  纸质出版日期：2019-02
- 稿件说明：
移动端阅览
陈剑钊, 陈莹, 宋佳润. 基于视角方向的全景虚拟视图合成[J]. 液晶与显示, 2019,34(1):63-69.

Jian-zhao CHEN, Ying CHEN, Jia-run SONG. Panoramic video virtual view synthesis based on viewing angle[J]. Chinese journal of liquid crystals and displays, 2019, 34(1): 63-69.
陈剑钊, 陈莹, 宋佳润. 基于视角方向的全景虚拟视图合成[J]. 液晶与显示, 2019,34(1):63-69. DOI： 10.3788/YJYXS20193401.0063.

Jian-zhao CHEN, Ying CHEN, Jia-run SONG. Panoramic video virtual view synthesis based on viewing angle[J]. Chinese journal of liquid crystals and displays, 2019, 34(1): 63-69. DOI： 10.3788/YJYXS20193401.0063.

摘要

针对3DOF+视频搭建了一套基于视角方向的全景视频虚拟视图合成系统，利用极少视点位置的视频信息即可准确渲染任意视点位置的视频内容，从而为用户提供真实的观看体验。将所合成的新视点位置视图与相机采集的真实视图进行比较。实验结果表明，所合成的虚拟视图平均客观指标PSNR为23 dB左右，主观质量良好，较为真实且能够提供良好的交互性与视觉体验。

Abstract

In order to provide users with a true viewing experience

a panoramic video virtual view synthesis system based on view angle for 3DOF+ video was built

which could accurately render arbitrary viewpoint position by using video information with few viewpoint positions. Comparing the synthesized new viewpoint position view with the real view collected by the camera

the experimental results show that the synthesized objective view has an average objective index PSNR of about 23 dB

good subjective quality

and is realistic and can provide good interactivity and visual experience.

关键词

Keywords

references

QIAN F, HAN L J, GOPALAKRISHNAN V. Optimizing 360 video delivery over cellularnetworks[C]//Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Chanllenges. NewYork: ACM, 2016: 1-6.

CUMMINGS J J, BAILENSON J N. How immersive is enough? A meta-analysis of the effect of immersive technology on user presence[J] . Media Psychology , 2016, 19(2):272-309.

CHAMPELM L, KOENEN R, LAFRUIT G, et al. Working Draft 0.2 of TR: Technical report on architectures for immersive media[R]. ISO/IEC JTC1/SC29/WG11, Doc. MPEG-2017 N16918, Hobart, 2017.

FEHNC. Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV[C]//Stereoscopic Displays and Virtual Reality Systems XI. International Society for Optics and Photonics, 2004, 5291: 93-105.

SZELISKI R, SHUM H Y. Creating full view panoramic image mosaics and environment maps[C]// Proceedings of the 24th annual conference on Computer graphics and interactive techniques. NewYork: ACM Press/Addison-Wesley Publishing Co., 1997: 251-258.

NG K T, CHAN S C, SHUM H Y. Data compression and transmission aspects of panoramic videos[J]. IEEE Transactions on Circuits and Systems for Video Technology , 2005, 15(1):82-95.

HUANG K C, CHIEN P Y, CHIEN C A, et al. A 360-degree panoramic video system design[C]// Proceedings of Technical Papers of 2014 In ternational Symposium on VLSI Design, Automation and Test. Taiwan, China: IEEE, 2014: 1-4.

FU C W, WAN L, WONG T T, et al. The rhombic dodecahedron map:an efficient scheme for encoding panoramic video[J]. IEEE Transactions on Multimedia , 2009, 11(4):634-644.

WEGNER K, STANKIEWICZ O, DZIEMBOWSKI A, et al. Omnidirectional 6-DoF/3-DoF+ rendering[R]. MPEG-I visual of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. MPEG Doc. m40806, 2017: 1-6.

ZHANG F, LIU F. Casual stereoscopic panorama stitching[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 2002-2010.

Wikipedia.Equirectangular projection[EB/OL]. (2018-02-21)[2018-3-30] . https://en.wikipedia.org/wiki/Equirectangular_projection https://en.wikipedia.org/wiki/Equirectangular_projection .

贾瑞才.重力/地磁辅助的欧拉角无迹卡尔曼滤波姿态估计[J].光学精密工程, 2014, 22(12):3280-3286.

JIA Rui-cai. Attitude estimation base on gravity/magnetic assisted Euler angle UKF.[J]. Optics and Precision Engineering , 2014, 22(12):3280-3286.

王永, 姚太克, 周烽, 等.望远镜副镜的三自由度并联支撑构型研究与运动分析[J].光学精密工程, 2013, 21(11):2860-28696.

WANG Y, YAO T K, ZHOU F, et al. Type synthesis of 3-DOF parallel support system for telescope secondary mirror[J]. Optics and Precision Engineering , 2013, 21(11):2860-2869.

STANKIEWICZ O, WEGNER K, TANIMOTO M, et al. Enhanced view synthesis reference software (VSRS) for free-viewpoint television[R]. ISO/IEC JTC , 2013, 1: 533-541.

LEE C, HO Y S. Common-hole filling for boundary noise removal in VSRS[R]. MPEG2010/M18514, Guangzhou, China 2010.

汪泽伟, 于有光, 杨付正.基于HTC Vive的全景视频显示质量评估[J].液晶与显示, 2018, 33(1):85-91

WANG Z W, YU Y G, YANG F Z. Panoramic video display quality assessment based on HTC Vive[J]. Chinese Journal of Liquid Crystals and Displays , 2018, 33(1):85-91.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于HTC Vive的全景视频显示质量评估

近眼显示中光学畸变对视觉诱导晕动症的影响

基于视觉空间定向理论的虚拟现实空间重构

基于OpenGL的交互式全景视频显示系统

基于MFC和Vega的子母弹抛撒仿真研究