Driver distraction recognition plays a fundamental role in road safety. In this paper, we present a modular architecture based on the fusion of key points and object detection for predicting driver’s actions. From multi-camera infrared recordings, we will temporarily detect among a variety of actions that lead to distractions. Our system detects objects of interest and extracts key points from the driver. They are merged by generating features that relate them and processed with a ML-based classification algorithm. Finally, filters are applied to reduce bounces and add temporal context to the detections. Our proposal has been validated on two state-of-the-art datasets for driving distractions. Through several experiments we show that fusion substantially improves related action inference and improves domain adaptation. In addition, our framework is lightweight, explainable and has a low latency as it performs frame-by-frame inference. The modularity of the network allows us to upgrade parts independently or eliminate a camera without having to modify the entire network.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Driver Activity Recognition by Fusing Multi-object and Key Points Detection


    Weitere Titelangaben:

    Lect. Notes in Networks, Syst.


    Beteiligte:
    Marques, Lino (Herausgeber:in) / Santos, Cristina (Herausgeber:in) / Lima, José Luís (Herausgeber:in) / Tardioli, Danilo (Herausgeber:in) / Ferre, Manuel (Herausgeber:in) / Pardo-Decimavilla, Pablo (Autor:in) / Bergasa, Luis M. (Autor:in) / López-Guillén, Elena (Autor:in) / Llamazares, Ángel (Autor:in) / Abdeselam, Navil (Autor:in)

    Kongress:

    Iberian Robotics conference ; 2023 ; Coimbra, Portugal November 22, 2023 - November 24, 2023



    Erscheinungsdatum :

    27.04.2024


    Format / Umfang :

    13 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Action and Object Interaction Recognition for Driver Activity Classification

    Weyers, Patrick / Schiebener, David / Kummert, Anton | IEEE | 2019


    Fusing detection device, fusing detection method, and computer program

    SAWANO SHUNICHI | Europäisches Patentamt | 2023

    Freier Zugriff

    Fusing Points and Lines for High Performance Tracking

    Rosten, E. / Drummond, T. / IEEE | British Library Conference Proceedings | 2005


    Fusing points and lines for high performance tracking

    Rosten, E. / Drummond, T. | IEEE | 2005


    OPEN SET DRIVER ACTIVITY RECOGNITION

    Roitberg, Alina / Ma, Chaoxiang / Haurilet, Monica et al. | British Library Conference Proceedings | 2020