Radar-based gesture recognition can provide autonomous electronic systems with a reliable way to infer a human's intention, e.g., in traffic environments involving vulnerable road users. Particularly in complex scenarios, algorithms operating on radar target lists derived from constant false-alarm rate outputs present an attractive solution, as they not only enable the filtering of relevant targets, but can also make full use of the diverse, high-resolution target parameters provided by modern radar sensors. Therefore, this article proposes PointNet+long short-term memory (LSTM) for the enhanced target list-based recognition of challenging traffic gestures, combining per-frame feature extraction with PointNet and learning from sequences with a LSTM. The approach is generalized to facilitate the use of multistatic radar data from sensor networks to exploit slightly different viewing angles, which is particularly helpful for motions with low radial velocity. The proposed method is validated on a comprehensive dataset comprising eight traffic gestures and data recorded from 35 participants. Measurements are conducted both indoors and outdoors with an incoherent radar sensor network comprising three chirp sequence–multiple-input multiple-output sensors. On this challenging dataset, our approach clearly outperforms a reference convolutional neural network, reaching up to $92.2 \%$ cross-validation accuracy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    PointNet+LSTM for Target List-Based Gesture Recognition With Incoherent Radar Networks


    Contributors:


    Publication date :

    2022-12-01


    Size :

    3137394 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Automatic Target Recognition Based on Incoherent Radar Returns

    Fu, Q. / Yu, W. / IEEE et al. | British Library Conference Proceedings | 1995



    A PointNet-Based Multi-platform Multi-target Data Association Algorithm

    Chu, Xuan / Zheng, Tianyu / Zhang, Xinran et al. | TIBKAT | 2022


    A PointNet-Based Multi-platform Multi-target Data Association Algorithm

    Chu, Xuan / Zheng, Tianyu / Zhang, Xinran et al. | Springer Verlag | 2021


    High Dimensional Frustum PointNet for 3D Object Detection from Camera, LiDAR, and Radar

    Wang, Leichen / Chen, Tianbai / Anklam, Carsten et al. | IEEE | 2020