This paper presents MoveBox an open sourced toolbox for animating motion captured (MoCap) movements onto the Microsoft Rocketbox library of avatars. Motion capture is performed using a single depth sensor, such as Azure Kinect or Windows Kinect V2. Motion capture is performed in real-time using a single depth sensor, such as Azure Kinect or Windows Kinect V2, or extracted from existing RGB videos offline leveraging deep-learning computer vision techniques. Our toolbox enables real-time animation of the user’s avatar by converting the transformations between systems that have different joints and hierarchies. Additional features of the toolbox include recording, playback and looping animations, as well as basic audio lip sync, blinking and resizing of avatars as well as finger and hand animations. Our main contribution is both in the creation of this open source tool as well as the validation on different devices and discussion of MoveBox’s capabilities by end users.


    Access

    Download


    Export, share and cite



    Title :

    MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library


    Contributors:
    Gonzalez-Franco, M (author) / Egan, Z (author) / Peachey, M (author) / Antley, A (author) / Randhavane, T (author) / Panda, P (author) / Zhang, Y (author) / Wang, CY (author) / Reilly, DF (author) / Peck, TC (author)

    Publication date :

    2021-01-01


    Remarks:

    In: Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). (pp. pp. 91-98). Institute of Electrical and Electronics Engineers (IEEE): Utrecht, Netherlands. (2021)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Mocap gait motion samples - Optical marker tajectories

    Jiménez Bascones, Juan Luis / Graña Romay, Manuel | BASE | 2018

    Free access

    AR-MoCap: Using augmented reality to support motion capture acting

    Cannavo', Alberto / Pratticò, Filippo Gabriele / Bruno, Alberto et al. | BASE | 2023

    Free access

    Industrial application of DHM for ergonomics driven by low cost mocap solutions

    DE VECCHI, Giordano / REGAZZONI, Daniele / RIZZI, Caterina | BASE | 2012

    Free access

    Democratizing Active Safety Systems for Cyclists

    Mohan, Vysakh S. | SAE Technical Papers | 2022


    Democratizing Transportation with a VMT Market

    Woodhull, J. / Vag-och transport-forskningsinstitutet | British Library Conference Proceedings | 1992