Humans regularly interact with their surrounding objects. Such interactions often result in strongly correlated motions between humans and the interacting objects. We thus ask: “Is it possible to infer object properties from skeletal motion alone, even without seeing the interacting object itself?” In this paper, we present a fine-grained action recognition method that learns to infer such latent object properties from human interaction motion alone. This inference allows us to disentangle the motion from the object property and transfer object properties to a given motion. We collected a large number of videos and 3D skeletal motions of performing actors using an inertial motion capture device. We analyzed similar actions and learned subtle differences between them to reveal latent properties of the interacting objects. In particular, we learned to identify the interacting object, by estimating its weight, or its spillability. Our results clearly demonstrate that motions and interacting objects are highly correlated and that related object latent properties can be inferred from 3D skeleton sequences alone, leading to new synthesis possibilities for motions involving human interaction.


    Access

    Download


    Export, share and cite



    Title :

    Inferring object properties from human interaction and transferring them to new motions


    Contributors:
    Zheng, Q (author) / Wu, W (author) / Pan, H (author) / Mitra, N (author) / Cohen-Or, D (author) / Huang, H (author)

    Publication date :

    2021-09-01


    Remarks:

    Computational Visual Media , 7 (3) pp. 375-392. (2021)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Inferring Pedestrian Motions at Urban Crosswalks

    Volz, Benjamin / Mielenz, Holger / Gilitschenski, Igor et al. | IEEE | 2019


    Visual object-action recognition: Inferring object affordances from human demonstration

    Kjellstrom, H. / Romero, J. / Kragic, D. | British Library Online Contents | 2011


    Object transferring apparatus

    LEE DONG HUN / KANG BYUNG KWUN | European Patent Office | 2018

    Free access

    Object transferring method

    European Patent Office | 2018

    Free access

    Object transferring apparatus

    European Patent Office | 2019

    Free access