Human activity recognition systems from static images or video sequences are becoming more and more present in our life. Most computer vision applications such as human-computer interaction, virtual reality, public security, smart home monitoring, or autonomous robotics, to name a few, highly rely on human activity recognition. Of course, basic human activities, such as “walking” and “running”, are relatively easy to recognize. On the other hand, identifying more complex activities is still a challenging task that could be solved by retrieving contextual information from the scene, such as objects, events, or concepts. Indeed, a careful analysis of the scene can help to recognize human activities taking place. In this work, we address a holistic video understanding task to provide a complete semantic level description of the scene. Our solution can bring significant improvements in human activity recognition tasks. Besides, it may allow equipping a robotic and autonomous system with contextual knowledge of the environment. In particular, we want to show how this vision module can be integrated into a social robot to build a more natural and realistic context-based Human-Robot Interaction. We think that social robots must be aware of the surrounding environment to react in a proper and socially acceptable way, according to the different scenarios.


    Access

    Download


    Export, share and cite



    Title :

    Vision-Based Holistic Scene Understanding for Context-Aware Human-Robot Interaction



    Publication date :

    2022-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    004 / 629



    Human-Machine CRFs for Identifying Bottlenecks in Holistic Scene Understanding

    Mottaghi, Roozbeh / Fidler, Sanja / Yuille, Alan L. et al. | DSpace@MIT | 2014

    Free access


    Context-Aware Scene Prediction Network (CASPNet)

    Schafer, Maximilian / Zhao, Kun / Buhren, Markus et al. | IEEE | 2022


    Active vision for scene understanding

    Grotz, Markus | TIBKAT | 2021

    Free access

    Active Vision for Scene Understanding

    Grotz, Markus | GWLB - Gottfried Wilhelm Leibniz Bibliothek | 2021

    Free access