Over a decade the increase in usage of vehicles and need for safety of people has greatly influenced the development of Advanced Driver Assistance Systems (ADAS) and Autonomous Driving (AD). The main purpose behind these systems is to enhance the ability of vehicle and its driver to react to various conditions on road. The ADAS provides high safety to vehicle drivers by warning about the external environment and possible threats. Similar to Vulnerable Road Users (VRUs) like pedestrian, cyclist, motorbike riders etc. if it is possible to anticipate the hand signals of the vehicle driver then the number of accidents can be controlled and its severity can be reduced drastically. This paper introduces a Computer Vision (CV) based solution to address this issue. A Convolutional Neural Network (CNN) architecture based automatic system is introduced that can help the ego-vehicle to recognize the hand signals of a vehicle driver and take the necessary actions in advance to prevent the road accidents. The proposed algorithm can recognize left, right and stop signals indicated by the vehicle driver that has never been addressed before. This method uses Regional Multi-Person Pose estimation (RMPE) - Alphapose [1] framework for human pose estimation and vehicle arm signal recognition algorithm is built on this framework. The testing of proposed work is done on self-captured dataset. The proposed work provides accurate results to recognize hand signals of the vehicle driver and the accuracy is 92.87% at 10 fps.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Computer Vision Based Vehicle Intension Finding by Understanding Driver Hand Signal


    Contributors:


    Publication date :

    2021-10-24


    Size :

    506259 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Brake control method based on driver brake intension recognition

    XIANG XUAI / ZHANG HUANHUAN / ZHAO PEITENG et al. | European Patent Office | 2015

    Free access

    INTENSION ESTIMATION DEVICE AND TRAVEL CONTROL DEVICE

    TAGUCHI NORIAKI / NAKAI TAKAYOSHI / HOSHINA MASATOSHI et al. | European Patent Office | 2019

    Free access

    BUCKLE INTENSION COVER AND SEAT BELT APPARATUS WITH THE SAME

    JAE HO YOO / KWANG WOOK LEE / DO YEON KIM et al. | European Patent Office | 2019

    Free access

    Small boat with intension structure and manufacturing method of it

    CHOI KI HYUK / LEE YONG JIN / LEE WON MIN | European Patent Office | 2016

    Free access

    Computer Vision Based Vulnerable Road Users Hand Signal Recognition

    Ashtekar, Sunidhi / Dhalwar, Suraj / Pasupathy, Anuradha | IEEE | 2021