We propose a novel 360° scene representation for converting real scenes into stereoscopic 3D virtual reality content with head-motion parallax. Our image-based scene representation enables efficient synthesis of novel views with six degrees-of-freedom (6-DoF) by fusing motion fields at two scales: (1) disparity motion fields carry implicit depth information and are robustly estimated from multiple laterally displaced auxiliary viewpoints, and (2) pairwise motion fields enable real-time flow-based blending, which improves the visual fidelity of results by minimizing ghosting and view transition artifacts. Based on our scene representation, we present an end-to-end system that captures real scenes with a robotic camera arm, processes the recorded data, and finally renders the scene in a head-mounted display in real time (more than 40 Hz). Our approach is the first to support head-motion parallax when viewing real 360° scenes. We demonstrate compelling results that illustrate the enhanced visual experience – and hence sense of immersion – achieved with our approach compared to widely-used stereoscopic panoramas.
Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax
2018-01-17
Luo , B , Xu , F , Richardt , C & Yong , J-H 2018 , ' Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax ' , IEEE Transactions on Visualization and Computer Graphics , vol. 24 , no. 4 , pp. 1545-1553 . https://doi.org/10.1109/TVCG.2018.2794071
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
360° scene capture , 6 degrees-of-freedom (6-DoF) , Head-motion parallax , Image-based rendering , Scene representation , /dk/atira/pure/subjectarea/asjc/1700/1712 , Software , /dk/atira/pure/subjectarea/asjc/1700/1711 , Signal Processing , /dk/atira/pure/subjectarea/asjc/1700/1707 , Computer Vision and Pattern Recognition , /dk/atira/pure/subjectarea/asjc/1700/1704 , Computer Graphics and Computer-Aided Design
Stereoscopic Scene Flow Computation for 3D Motion Understanding
British Library Online Contents | 2011
|Enhancement of viewer comfort in stereoscopic viewing: parallax adjustment
British Library Conference Proceedings | 1999
|Parallax and stereoscopic vision as applied to making maps from air photographs
Engineering Index Backfile | 1936
|Auto-stereoscopic TFT-LCD with LC Parallax Barrier on Wire Grid Polarizer
British Library Conference Proceedings | 2009
|