Technology is disrupting the way films involving visual effects are produced. Chroma-key, LED walls, motion capture (mocap), 3D visual storyboards, and simulcams are only a few examples of the many changes introduced in the cinema industry over the last years. Although these technologies are getting commonplace, they are presenting new, unexplored challenges to the actors. In particular, when mocap is used to record the actors’ movements with the aim of animating digital character models, an increase in the workload can be easily expected for people on stage. In fact, actors have to largely rely on their imagination to understand what the digitally created characters will be actually seeing and feeling. This paper focuses on this specific domain, and aims to demonstrate how Augmented Reality (AR) can be helpful for actors when shooting mocap scenes. To this purpose, we devised a system named AR-MoCap that can be used by actors for rehearsing the scene in AR on the real set before actually shooting it. Through an Optical See-Through Head- Mounted Display (OST-HMD), an actor can see, e.g., the digital characters of other actors wearing mocap suits overlapped in real- time to their bodies. Experimental results showed that, compared to the traditional approach based on physical props and other cues, the devised system can help the actors to position themselves and direct their gaze while shooting the scene, while also improving spatial and social presence, as well as perceived effectiveness.


    Access

    Download


    Export, share and cite



    Title :

    AR-MoCap: Using augmented reality to support motion capture acting



    Publication date :

    2023-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Mocap gait motion samples - Optical marker tajectories

    Jiménez Bascones, Juan Luis / Graña Romay, Manuel | BASE | 2018

    Free access

    MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library

    Gonzalez-Franco, M / Egan, Z / Peachey, M et al. | BASE | 2021

    Free access



    MULTIMODAL DECISION SUPPORT SYSTEM USING AUGMENTED REALITY

    MORGAN GWENDOLYN / GRABOWSKI MARTHA / RANCY JEAN-PHILIPPE | European Patent Office | 2024

    Free access