Knowing what the driver is doing inside a vehicle is essential information for all stages of vehicle automation. For example it can be used for adaptive warning strategies in combination with an advanced driver assistance systems system, for predicting the response time to take back the control of a partially automated vehicle, or ensuring the driver is ready to manually drive a highly automated vehicle in the future. We present a system for driver activity recognition based on image sequences of an in-cabin time-of-flight camera. Our dataset includes actions such as entering and leaving a car or driver object interactions such as using a phone or drinking. In the first stage, we localize body key points of the driver. In the second stage, we extract image regions around the localized hands. These regions and the determined 3D body key points are used as the input to a recurrent neural network for driver activity recognition. With a mean average precision of 0.85 we reach better classification rates than approaches relying only on body key points or images.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Action and Object Interaction Recognition for Driver Activity Classification


    Beteiligte:
    Weyers, Patrick (Autor:in) / Schiebener, David (Autor:in) / Kummert, Anton (Autor:in)


    Erscheinungsdatum :

    01.10.2019


    Format / Umfang :

    2592171 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Dynamic Interaction Graphs for Driver Activity Recognition

    Martin, Manuel / Voit, Michael / Stiefelhagen, Rainer | IEEE | 2020


    Driver-Skeleton: A Dataset for Driver Action Recognition

    Lin, Zeyang / Liu, Yinchuan / Zhang, Xuetao | IEEE | 2021


    Driver Activity Recognition by Fusing Multi-object and Key Points Detection

    Pardo-Decimavilla, Pablo / Bergasa, Luis M. / López-Guillén, Elena et al. | Springer Verlag | 2024


    Open Set Driver Activity Recognition

    Roitberg, Alina / Ma, Chaoxiang / Haurilet, Monica et al. | IEEE | 2020


    OPEN SET DRIVER ACTIVITY RECOGNITION

    Roitberg, Alina / Ma, Chaoxiang / Haurilet, Monica et al. | British Library Conference Proceedings | 2020