Driver distraction recognition plays a fundamental role in road safety. In this paper, we present a modular architecture based on the fusion of key points and object detection for predicting driver’s actions. From multi-camera infrared recordings, we will temporarily detect among a variety of actions that lead to distractions. Our system detects objects of interest and extracts key points from the driver. They are merged by generating features that relate them and processed with a ML-based classification algorithm. Finally, filters are applied to reduce bounces and add temporal context to the detections. Our proposal has been validated on two state-of-the-art datasets for driving distractions. Through several experiments we show that fusion substantially improves related action inference and improves domain adaptation. In addition, our framework is lightweight, explainable and has a low latency as it performs frame-by-frame inference. The modularity of the network allows us to upgrade parts independently or eliminate a camera without having to modify the entire network.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Driver Activity Recognition by Fusing Multi-object and Key Points Detection


    Additional title:

    Lect. Notes in Networks, Syst.



    Conference:

    Iberian Robotics conference ; 2023 ; Coimbra, Portugal November 22, 2023 - November 24, 2023



    Publication date :

    2024-04-27


    Size :

    13 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Action and Object Interaction Recognition for Driver Activity Classification

    Weyers, Patrick / Schiebener, David / Kummert, Anton | IEEE | 2019


    Fusing detection device, fusing detection method, and computer program

    SAWANO SHUNICHI | European Patent Office | 2023

    Free access

    Fusing points and lines for high performance tracking

    Rosten, E. / Drummond, T. | IEEE | 2005


    Fusing Points and Lines for High Performance Tracking

    Rosten, E. / Drummond, T. / IEEE | British Library Conference Proceedings | 2005


    Open Set Driver Activity Recognition

    Roitberg, Alina / Ma, Chaoxiang / Haurilet, Monica et al. | IEEE | 2020