Recognizing human actions, reliably inferring their meaning and being able to potentially exchange mutual social information are core challenges for autonomous systems when they directly share the same space with humans. Intelligent transport systems in particular face this challenge, as interactions with people are often required. The development and testing of technical perception solutions is done mostly on standard vision benchmark datasets for which manual labelling of sensory ground truth has been a tedious but necessary task. Furthermore, rarely occurring human activities are underrepresented in these datasets, leading to algorithms not recognizing such activities. For this purpose, we introduce a modular simulation framework, which offers to train and validate algorithms on various human-centred scenarios. We describe the usage of simulation data to train a state-of-the-art human pose estimation algorithm to recognize unusual human activities in urban areas. Since the recognition of human actions can be an important component of intelligent transport systems, we investigated how simulations can be applied for his purpose. Laboratory experiments show that we can train a recurrent neural network with only simulated data based on motion capture data and 3D avatars, which achieves an almost perfect performance in the classification of those human actions on real data.
Enhancing Data-Driven Algorithms for Human Pose Estimation and Action Recognition Through Simulation
IEEE Transactions on Intelligent Transportation Systems ; 21 , 9 ; 3990-3999
2020-09-01
3217210 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Coupled Action Recognition and Pose Estimation from Multiple Views
British Library Online Contents | 2012
|Aircraft recognition and pose estimation
Tema Archiv | 2000
|Aircraft recognition and pose estimation
SPIE | 2000
|Histogram of oriented rectangles: A new pose descriptor for human action recognition
British Library Online Contents | 2009
|