In the context of autonomous driving, where humans may need to take over in the event where the computer may issue a takeover request, a key step towards driving safety is the monitoring of the hands to ensure the driver is ready for such a request. This work, focuses on the first step of this process, which is to locate the hands. Such a system must work in real-time and under varying harsh lighting conditions. This article introduces a fast ConvNet approach, based on the work of original work of OpenPose by Cao, et al. for full body joint estimation. The network is modified with fewer parameters and retrained using our own day-time naturalistic autonomous driving dataset to estimate joint and affinity heatmaps for driver and passenger’s wrist and elbows, for a total of 8 joint classes and part affinity fields between each wrist-elbow pair. The approach runs real-time on real-world data at 40 fps on multiple drivers and passengers. The system is extensively evaluated both quantitatively and qualitatively, showing at least 95% detection performance on joint localization and arm-angle estimation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Looking at Hands in Autonomous Vehicles: A ConvNet Approach Using Part Affinity Fields


    Contributors:

    Published in:

    Publication date :

    2020-09-01


    Size :

    7788614 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Manifold Siamese Network: A Novel Visual Tracking ConvNet for Autonomous Vehicles

    Gao, Ming / Jin, Lisheng / Jiang, Yuying et al. | IEEE | 2020


    Hands-off detection for autonomous and partially autonomous vehicles

    FENTON MATTHEW JAMES / NILL TREVOR J | European Patent Office | 2023

    Free access

    DepthCN: Vehicle detection using 3D-LIDAR and ConvNet

    Asvadi, Alireza / Garrote, Luis / Premebida, Cristiano et al. | IEEE | 2017


    HANDS-OFF DETECTION FOR AUTONOMOUS AND PARTIALLY AUTONOMOUS VEHICLES

    NILL TREVOR / FENTON MATTHEW | European Patent Office | 2024

    Free access

    HANDS-OFF DETECTION FOR AUTONOMOUS AND PARTIALLY AUTONOMOUS VEHICLES

    NILL TREVOR / FENTON MATTHEW | European Patent Office | 2023

    Free access