In the context of autonomous driving, where humans may need to take over in the event where the computer may issue a takeover request, a key step towards driving safety is the monitoring of the hands to ensure the driver is ready for such a request. This work, focuses on the first step of this process, which is to locate the hands. Such a system must work in real-time and under varying harsh lighting conditions. This article introduces a fast ConvNet approach, based on the work of original work of OpenPose by Cao, et al. for full body joint estimation. The network is modified with fewer parameters and retrained using our own day-time naturalistic autonomous driving dataset to estimate joint and affinity heatmaps for driver and passenger’s wrist and elbows, for a total of 8 joint classes and part affinity fields between each wrist-elbow pair. The approach runs real-time on real-world data at 40 fps on multiple drivers and passengers. The system is extensively evaluated both quantitatively and qualitatively, showing at least 95% detection performance on joint localization and arm-angle estimation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Looking at Hands in Autonomous Vehicles: A ConvNet Approach Using Part Affinity Fields


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    01.09.2020


    Format / Umfang :

    7788614 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Manifold Siamese Network: A Novel Visual Tracking ConvNet for Autonomous Vehicles

    Gao, Ming / Jin, Lisheng / Jiang, Yuying et al. | IEEE | 2020


    Hands-off detection for autonomous and partially autonomous vehicles

    FENTON MATTHEW JAMES / NILL TREVOR J | Europäisches Patentamt | 2023

    Freier Zugriff

    DepthCN: Vehicle detection using 3D-LIDAR and ConvNet

    Asvadi, Alireza / Garrote, Luis / Premebida, Cristiano et al. | IEEE | 2017


    HANDS-OFF DETECTION FOR AUTONOMOUS AND PARTIALLY AUTONOMOUS VEHICLES

    FENTON MATTHEW JAMES / NILL TREVOR J | Europäisches Patentamt | 2023

    Freier Zugriff

    HANDS-OFF DETECTION FOR AUTONOMOUS AND PARTIALLY AUTONOMOUS VEHICLES

    NILL TREVOR / FENTON MATTHEW | Europäisches Patentamt | 2024

    Freier Zugriff