In this contribution we present a novel approach to transform data from time-of-flight (ToF) sensors to be interpretable by Convolutional Neural Networks (CNNs). As ToF data tends to be overly noisy depending on various factors such as illumination, reflection coefficient and distance, the need for a robust algorithmic approach becomes evident. By spanning a three-dimensional grid of fixed size around each point cloud we are able to transform three-dimensional input to become processable by CNNs. This simple and effective neighborhood-preserving methodology demonstrates that CNNs are indeed able to extract the relevant information and learn a set of filters, enabling them to differentiate a complex set of ten different gestures obtained from 20 different individuals and containing 600.000 samples overall. Our 20-fold cross-validation shows the generalization performance of the network, achieving an accuracy of up to 98.5% on validation sets comprising 20.000 data samples. The real-time applicability of our system is demonstrated via an interactive validation on an infotainment system running with up to 40fps on an iPad in the vehicle interior.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Free-hand gesture recognition with 3D-CNNs for in-car infotainment control in real-time


    Beteiligte:


    Erscheinungsdatum :

    2017-10-01


    Format / Umfang :

    1544008 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Hand-free Gesture Recognition for Vehicle Infotainment System Control

    Ye, Qi / Yang, Lanqing / Xue, Guangtao | IEEE | 2018


    Real-time gesture control for automotive infotainment system

    Chee, Ying Xuan / Lau, Phooi Yee | SPIE | 2021


    Robust multimodal hand and head gesture recognition for controlling automotive infotainment systems

    Althoff, Frank / Lindl, Rudi / Walchshäusl, Leonhard | Tema Archiv | 2005


    Robust multimodal hand- and head gesture recognition for controlling automotive infotainment systems

    Althoff, F. / Lindl, R. / Walchshausl, L. et al. | British Library Conference Proceedings | 2005


    Robust multimodal hand and head gesture recognition for controlling automotive infotainment systems

    Althoff,F. / Lindl,R. / Walchshaeusl,L. et al. | Kraftfahrwesen | 2005