Head pose estimation has been a key task in computer vision since a broad range of applications often requires accurate information about the orientation of the head. Achieving this goal with regular RGB cameras faces challenges in automotive applications due to occlusions, extreme head poses and sudden changes in illumination. Most of these challenges can be attenuated with algorithms relying on depth cameras. This paper proposes a novel point-cloud based deep learning approach to estimate the driver's head pose from depth camera data, addressing these challenges. The proposed algorithm is inspired by the PointNet++ framework, where points are sampled and grouped before extracting discriminative features. We demonstrate the effectiveness of our algorithm by evaluating our approach on a naturalistic driving database consisting of 22 drivers, where the benchmark for the orientation of the driver's head is obtained with the Fi-Cap device. The experimental evaluation demonstrates that our proposed approach relying on point-cloud data achieves predictions that are almost always more reliable than state-of-the-art head pose estimation methods based on regular cameras. Furthermore, our approach provides predictions even for extreme rotations, which is not the case for the baseline methods. To the best of our knowledge, this is the first study to propose head pose estimation using deep learning on point-cloud data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Robust Driver Head Pose Estimation in Naturalistic Conditions from Point-Cloud Data


    Contributors:
    Hu, Tiancheng (author) / Jha, Sumit (author) / Busso, Carlos (author)


    Publication date :

    2020-10-19


    Size :

    2267417 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    ROBUST DRIVER HEAD POSE ESTIMATION IN NATURALISTIC CONDITIONS FROM POINT-CLOUD DATA

    Hu, Tiancheng / Jha, Sumit / Busso, Carlos | British Library Conference Proceedings | 2020


    Temporal Head Pose Estimation From Point Cloud in Naturalistic Driving Conditions

    Hu, Tiancheng / Jha, Sumit / Busso, Carlos | IEEE | 2022

    Free access

    Driver Head Pose Detection From Naturalistic Driving Data

    Chai, Weiheng / Chen, Jiajing / Wang, Jiyang et al. | IEEE | 2023


    Driver Head Pose Estimation by Regression

    Tessema, Yodit / Höffken, Matthias / Kreßel, Ulrich | Springer Verlag | 2015


    Head Pose Estimation for Driver Monitoring

    Zhu, Y. / Fujimura, K. / IEEE | British Library Conference Proceedings | 2004