We propose a novel 360° scene representation for converting real scenes into stereoscopic 3D virtual reality content with head-motion parallax. Our image-based scene representation enables efficient synthesis of novel views with six degrees-of-freedom (6-DoF) by fusing motion fields at two scales: (1) disparity motion fields carry implicit depth information and are robustly estimated from multiple laterally displaced auxiliary viewpoints, and (2) pairwise motion fields enable real-time flow-based blending, which improves the visual fidelity of results by minimizing ghosting and view transition artifacts. Based on our scene representation, we present an end-to-end system that captures real scenes with a robotic camera arm, processes the recorded data, and finally renders the scene in a head-mounted display in real time (more than 40 Hz). Our approach is the first to support head-motion parallax when viewing real 360° scenes. We demonstrate compelling results that illustrate the enhanced visual experience – and hence sense of immersion – achieved with our approach compared to widely-used stereoscopic panoramas.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax


    Beteiligte:
    Luo, Bicheng (Autor:in) / Xu, Feng (Autor:in) / Richardt, Christian (Autor:in) / Yong, Jun-Hai (Autor:in)

    Erscheinungsdatum :

    2018-01-17


    Anmerkungen:

    Luo , B , Xu , F , Richardt , C & Yong , J-H 2018 , ' Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax ' , IEEE Transactions on Visualization and Computer Graphics , vol. 24 , no. 4 , pp. 1545-1553 . https://doi.org/10.1109/TVCG.2018.2794071



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    004 / 629




    Stereoscopic Scene Flow Computation for 3D Motion Understanding

    Wedel, A. / Brox, T. / Vaudrey, T. et al. | British Library Online Contents | 2011


    Enhancement of viewer comfort in stereoscopic viewing: parallax adjustment

    Konrad, J. / IS&T / SPIE | British Library Conference Proceedings | 1999


    Parallax and stereoscopic vision as applied to making maps from air photographs

    Lambert, Jr., A.W. | Engineering Index Backfile | 1936


    Auto-stereoscopic TFT-LCD with LC Parallax Barrier on Wire Grid Polarizer

    Kang, D.H. / Oh, B.S. / Oh, J.H. et al. | British Library Conference Proceedings | 2009