Amidst the increasing integration of technology in car interiors, the risk of driver distraction has become a critical concern for automotive safety. Addressing this issue requires robust methods for detecting driver distractions, often relying on intricate models trained on vast amounts of labeled data. However, obtaining such labeled data can be expensive and time-consuming. In this context, self-supervised learning emerges as a promising approach, leveraging unlabeled data to learn meaningful representations and reduce dependency on annotated datasets. In this study, we explore self-supervised learning methods for 3D skeleton-based driver activity recognition. We evaluate the performance of our proposed SkelDINO-SAM method across diverse backbone architectures. Utilizing the Drive&Act dataset, characterized by its long-tailed distribution of activity classes, we evaluate the effectiveness of our approach in addressing challenges associated with real-world scenarios. Our findings highlight the superiority of transformer-based backbones, particularly when combined with our SkelDINO-SAM approach. Through extensive experiments and ablation studies, we demonstrate the efficacy of our method in enhancing driver secondary task recognition accuracy. Overall, our results show the efficiency of our approach outperforming the state-of-the-art method by 11.29%. Our code is published on GitHub.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3D Skeleton-Based Driver Activity Recognition Using Self-Supervised Learning




    Publication date :

    2024-09-24


    Size :

    993609 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Driver-Skeleton: A Dataset for Driver Action Recognition

    Lin, Zeyang / Liu, Yinchuan / Zhang, Xuetao | IEEE | 2021


    Driver activity monitoring through supervised and unsupervised learning

    Veeraraghavan, H. / Atev, S. / Bird, N. et al. | IEEE | 2005


    Driver Activity Monitoring through Supervised and Unsupervised Learning

    Veeraraghavan, H. / Atev, S. E. / Bird, N. et al. | British Library Conference Proceedings | 2005


    A Novel Spatial-Temporal Graph for Skeleton-based Driver Action Recognition

    Li, Peng / Lu, Meiqi / Zhang, Zhiwei et al. | IEEE | 2019


    Driver Distraction Detection Using Semi-Supervised Machine Learning

    Liu, Tianchi / Yang, Yan / Huang, Guang-Bin et al. | IEEE | 2016