In this contribution we present a novel approach to transform data from time-of-flight (ToF) sensors to be interpretable by Convolutional Neural Networks (CNNs). As ToF data tends to be overly noisy depending on various factors such as illumination, reflection coefficient and distance, the need for a robust algorithmic approach becomes evident. By spanning a three-dimensional grid of fixed size around each point cloud we are able to transform three-dimensional input to become processable by CNNs. This simple and effective neighborhood-preserving methodology demonstrates that CNNs are indeed able to extract the relevant information and learn a set of filters, enabling them to differentiate a complex set of ten different gestures obtained from 20 different individuals and containing 600.000 samples overall. Our 20-fold cross-validation shows the generalization performance of the network, achieving an accuracy of up to 98.5% on validation sets comprising 20.000 data samples. The real-time applicability of our system is demonstrated via an interactive validation on an infotainment system running with up to 40fps on an iPad in the vehicle interior.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Free-hand gesture recognition with 3D-CNNs for in-car infotainment control in real-time


    Contributors:


    Publication date :

    2017-10-01


    Size :

    1544008 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Hand-free Gesture Recognition for Vehicle Infotainment System Control

    Ye, Qi / Yang, Lanqing / Xue, Guangtao | IEEE | 2018


    Real-time gesture control for automotive infotainment system

    Chee, Ying Xuan / Lau, Phooi Yee | SPIE | 2021


    Robust multimodal hand and head gesture recognition for controlling automotive infotainment systems

    Althoff, Frank / Lindl, Rudi / Walchshäusl, Leonhard | Tema Archive | 2005


    Robust multimodal hand- and head gesture recognition for controlling automotive infotainment systems

    Althoff, F. / Lindl, R. / Walchshausl, L. et al. | British Library Conference Proceedings | 2005


    Robust multimodal hand and head gesture recognition for controlling automotive infotainment systems

    Althoff,F. / Lindl,R. / Walchshaeusl,L. et al. | Automotive engineering | 2005