Driver monitoring will be required in many countries for all new vehicles with automation functions. While the common approach for this task is face and eye gaze monitoring, cameras with a wider field of view have already been introduced in some cars. However, their mounting position can change between vehicle models. To minimize data collection efforts and to facilitate data reuse it is important for algorithms to be able to deal with a changing environment. We conduct an experiment comparing the performance of video-based models with 3D body pose-based activity recognition methods with regards to sensor and position changes. We introduce a modular activity recognition pipeline which uses a sensor independent representation including the 3D body pose of the driver, 3D dynamic object positions and 3D interior positions. We show that while video-based models offer the best quality overall, when trained and tested on the same camera view, body pose-based methods can be far more robust to positional changes. Moreover, augmentation reduces the performance drop across views to 35% compared to 83% without augmentation and 90% for video-based models.
Viewpoint Invariant 3D Driver Body Pose-Based Activity Recognition
2023-06-04
20079403 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Viewpoint invariant sign language recognition
British Library Online Contents | 2007
|Viewpoint invariant sign language recognition
IEEE | 2005
|Viewpoint Invariant Sign Language Recognition
British Library Conference Proceedings | 2005
|Pose-invariant descriptor for facial emotion recognition
British Library Online Contents | 2016
|Pose Invariant Approach for Face Recognition at Distance
British Library Conference Proceedings | 2012
|