A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips. We learn data-driven generative models of human movement using autoregressive conditional variational autoencoders, or Motion VAEs. The latent variables of the learned autoencoder define the action space for the movement and thereby govern its evolution over time. Planning or control algorithms can then use this action space to generate desired motions. In particular, we use deep reinforcement learning to learn controllers that achieve goal-directed movements. We demonstrate the effectiveness of the approach on multiple tasks. We further evaluate system-design choices and describe the current limitations of Motion VAEs.


    Access

    Download


    Export, share and cite



    Title :

    Character Controllers Using Motion VAEs


    Contributors:

    Publication date :

    2021


    Remarks:

    Project page: https://www.cs.ubc.ca/~hyuling/projects/mvae/ ; Code: https://github.com/electronicarts/character-motion-vaes



    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Free access

    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    Relaxed-Responsibility Hierarchical Discrete VAEs

    Willetts, Matthew / Miscouridou, Xenia / Roberts, Stephen et al. | ArXiv | 2020

    Free access

    On Incorporating Inductive Biases into VAEs

    Miao, Ning / Mathieu, Emile / Siddharth, N. et al. | ArXiv | 2021

    Free access

    Prior Learning in Introspective VAEs

    Athanasiadis, Ioannis / Lindsten, Fredrik / Felsberg, Michael | ArXiv | 2024

    Free access