The radar sensing on fine human-motion/hand-gesture provides further human-computer interaction (HCI) experience. Most of the studies about gesture recognition with mmWave frequency modulated continuous wave (FMCW) radar adopts the range and the velocity estimated from the raw data, such as the time-frequency spectrogram, micro-doppler spectrogram, or range-Doppler image (RDI). Besides, the angle estimated using multiple receive antennas also contains rich information of gesture, especially in the discrimination among the horizontal movement of the gesture. Thus, we propose to use the range-angle image (RAI) as the input and train a model consisting of the convolutional neural network and long short term memory that is capable of recognizing hand gestures. We validate the proposed scheme based on the collection of hand gestures by several subjects in different classrooms using 77 - 81GHz mmWave radar of Texas Instrument. Based on the configuration of one transmit antenna and four receive antennas, we show that the hand gesture recognition using RAI outperforms that using RDI. Also, we adopt the fusion strategy to consider both RDI and RAI to further improve accuracy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    mmWave Radar-based Hand Gesture Recognition using Range-Angle Image


    Contributors:
    Yu, Jih-Tsun (author) / Yen, Li (author) / Tseng, Po-Hsuan (author)


    Publication date :

    2020-05-01


    Size :

    323425 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Novel Approach for Gesture Recognition Using mmWave FMCW RADAR

    Zhao, Yanhua / Sark, Vladica / Krstic, Milos et al. | IEEE | 2022


    Gesture Recognition Using Multiple mmWave FMCW Radars

    Zhao, Yanhua / Sark, Vladica / Krstic, Milos et al. | IEEE | 2023


    Hand gesture recognition method by radar based on convolutional neural network

    Wang, Jun / Zheng, Tong / Lei, Peng et al. | British Library Online Contents | 2018


    Convexity Defect Based Hand Gesture Recognition Using OpenCV

    Salehin, Md. Najmus / Nahiyan, Md. Helal An / Anik, Fahim Islam | BASE | 2021

    Free access

    A model-based hand gesture recognition system

    Huang, C. / Jeng, S. | British Library Online Contents | 2001