Head pose estimation has been a key task in computer vision since a broad range of applications often requires accurate information about the orientation of the head. Achieving this goal with regular RGB cameras faces challenges in automotive applications due to occlusions, extreme head poses and sudden changes in illumination. Most of these challenges can be attenuated with algorithms relying on depth cameras. This paper proposes a novel point-cloud based deep learning approach to estimate the driver's head pose from depth camera data, addressing these challenges. The proposed algorithm is inspired by the PointNet++ framework, where points are sampled and grouped before extracting discriminative features. We demonstrate the effectiveness of our algorithm by evaluating our approach on a naturalistic driving database consisting of 22 drivers, where the benchmark for the orientation of the driver's head is obtained with the Fi-Cap device. The experimental evaluation demonstrates that our proposed approach relying on point-cloud data achieves predictions that are almost always more reliable than state-of-the-art head pose estimation methods based on regular cameras. Furthermore, our approach provides predictions even for extreme rotations, which is not the case for the baseline methods. To the best of our knowledge, this is the first study to propose head pose estimation using deep learning on point-cloud data.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Robust Driver Head Pose Estimation in Naturalistic Conditions from Point-Cloud Data


    Beteiligte:
    Hu, Tiancheng (Autor:in) / Jha, Sumit (Autor:in) / Busso, Carlos (Autor:in)


    Erscheinungsdatum :

    2020-10-19


    Format / Umfang :

    2267417 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Temporal Head Pose Estimation From Point Cloud in Naturalistic Driving Conditions

    Hu, Tiancheng / Jha, Sumit / Busso, Carlos | IEEE | 2022

    Freier Zugriff

    Driver Head Pose Detection From Naturalistic Driving Data

    Chai, Weiheng / Chen, Jiajing / Wang, Jiyang et al. | IEEE | 2023


    Driver Head Pose Estimation by Regression

    Tessema, Yodit / Höffken, Matthias / Kreßel, Ulrich | Springer Verlag | 2015


    Head pose estimation for driver monitoring

    Youding Zhu, / Fujimura, K. | IEEE | 2004


    Head Pose Estimation for Driver Monitoring

    Zhu, Y. / Fujimura, K. / IEEE | British Library Conference Proceedings | 2004