With the growing interest in Human-Machine interface (HMI), an increasing amount of effort is made to provide always-on low-cost touchless control solutions for Internet-of-Things (IoT) edge devices. In this study, we explore near-audio ultrasound for in-air ultrasonic gesture design and recognition. We propose to use beamforming followed by stages of feature extraction and a Temporal Convolution Network (TCN) for classification. The study is applied to a small form factor concentric hexagonal array of 7 microphones where a beamforming stage is leveraged for spatial feature extraction and ultrasonic gesture features fusion from different angles. In case of such limited number of microphones, we show that a customized Filter-and-Sum (FaS) beamformer is well suited for this application with a set of 5-tap filters. We optimize the beamformer by fitting a fixed beam in the ultrasonic frequency domain, to make the ultrasonic band of interest (18 kHz - 24 kHz) available for use. The beamformer generates parallel readings in time of Doppler shifts from a set of assigned angles as a hand gesture is performed near the array. A TCN of only 10k parameters is used to classify these parallel readings into predefined symbols to build a gesture alphabet. The TCN operates on two modes sharing the same TCN structure with the option to switch between them by loading different set of coefficients. Features from concatenated beamformed frequency points are learned with a per symbol classification accuracy in the range 92%-100% computed on a test set and visualized in the form of normalized confusion matrix. The proposed system gives users a degree of flexibility where gesture diversity can be obtained by grouping the trained symbols from the built alphabet in a post-training design stage. This paves the way for flexible, intuitive and easy to remember gestures.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Multi-Angle Fusion for Low-Cost Near-Field Ultrasonic in-Air Gesture Recognition


    Beteiligte:
    Ibrahim, Emad (Autor:in) / Geilen, Marc C.W. (Autor:in) / Li, Min (Autor:in) / Pineda de Gyvez, Jose (Autor:in)

    Erscheinungsdatum :

    2020-01-01


    Anmerkungen:

    Ibrahim , E , Geilen , M C W , Li , M & Pineda de Gyvez , J 2020 , ' Multi-Angle Fusion for Low-Cost Near-Field Ultrasonic in-Air Gesture Recognition ' , IEEE Access , vol. 8 , pp. 191204-191218 . https://doi.org/10.1109/ACCESS.2020.3031677



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    GESTURE RECOGNITION DEVICE AND GESTURE RECOGNITION METHOD

    HIGUCHI DAIKI / OHASHI DAISUKE | Europäisches Patentamt | 2022

    Freier Zugriff


    mmWave Radar-based Hand Gesture Recognition using Range-Angle Image

    Yu, Jih-Tsun / Yen, Li / Tseng, Po-Hsuan | IEEE | 2020


    Opportunistic Synergy: a Classifier Fusion Engine for Micro-Gesture Recognition

    Angelini, Leonardo / Carrino, Francesco / Carrino, Stefano et al. | Tema Archiv | 2013


    Gesture recognition apparatus, gesture recognition method, and recording medium

    OBATA KIJURO | Europäisches Patentamt | 2016

    Freier Zugriff