Recognizing human actions, reliably inferring their meaning and being able to potentially exchange mutual social information are core challenges for autonomous systems when they directly share the same space with humans. Intelligent transport systems in particular face this challenge, as interactions with people are often required. The development and testing of technical perception solutions is done mostly on standard vision benchmark datasets for which manual labelling of sensory ground truth has been a tedious but necessary task. Furthermore, rarely occurring human activities are underrepresented in these datasets, leading to algorithms not recognizing such activities. For this purpose, we introduce a modular simulation framework, which offers to train and validate algorithms on various human-centred scenarios. We describe the usage of simulation data to train a state-of-the-art human pose estimation algorithm to recognize unusual human activities in urban areas. Since the recognition of human actions can be an important component of intelligent transport systems, we investigated how simulations can be applied for his purpose. Laboratory experiments show that we can train a recurrent neural network with only simulated data based on motion capture data and 3D avatars, which achieves an almost perfect performance in the classification of those human actions on real data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Enhancing Data-Driven Algorithms for Human Pose Estimation and Action Recognition Through Simulation


    Contributors:


    Publication date :

    2020-09-01


    Size :

    3217210 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Coupled Action Recognition and Pose Estimation from Multiple Views

    Yao, A. / Gall, J. / Gool, L. | British Library Online Contents | 2012


    Aircraft recognition and pose estimation

    Hmam, Hatem / Kim, Jijoong | SPIE | 2000


    Aircraft recognition and pose estimation

    Hmam, H. / Kim, J. | Tema Archive | 2000


    Enhancing Safety and Collision Avoidance in Autonomous Vehicles through Pose Estimation Techniques

    Razzaque, Tanzir / Hussain, Habib / Ahmmad, Rafid et al. | IEEE | 2024


    Histogram of oriented rectangles: A new pose descriptor for human action recognition

    Ikizler, N. / Duygulu, P. | British Library Online Contents | 2009