Integrated sensing and communication have drawn great research attention in recent years. Specifically, 5G mmWave has demonstrated its capabilities not only in high-speed communications but also in perceiving the physical environment. Apart from providing locationing services for user equipment (UE), 5G mmWave can also estimate the position of target objects that does not carry any equipment (i.e., device-free). Existing works of device-free wireless localization often employs a single monostatic radar or a few transceivers in fixed positions. In this work, we examine a cooperative sensing case, where multiple UEs cooperate with the infrastructure of transmit/receive points (TRPs) to jointly locate device-free objects. This new setting brings in new challenges for existing locationing algorithms as the number and the locations of the UEs and sensing targets are all dynamic. Our work proposes a novel procedure that uses visualization methods to jointly represent the information in the mmWave channel impulse responses and the locations of UEs and TRPs. We then introduce an end-to-end deep learning transformer architecture inspired by popular models in the computer vision domain to estimate the target objects’ locations from the visualizations. On a dataset generated using 3D ray-tracing simulations, our system can locate multiple device-free objects with an average error of 0.47 meters within a 20 meterby-40 meter experiment area.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Visual Transformers for Cooperative Device-free Object Localization Using mmWave Signals


    Contributors:
    Wang, Ziqi (author) / Namgoong, June (author) / Yoo, Taesang (author) / Nam, Wooseok (author) / Dai, Yucheng (author) / Doshi, Akash (author) / Luo, Tao (author)


    Publication date :

    2024-10-07


    Size :

    3039033 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Toward O-RAN-based Cell-Free Architecture: Cooperative O-RU/V2X mmWave Beam Tracking

    Ozawa, Sojin / Sasaki, Yuki / Nakazato, Jin et al. | IEEE | 2024


    Cooperative Positioning System for Industrial IoT via mmWave Device-to-Device Communications

    Lu, Yi / Koivisto, Mike / Talvitie, Jukka et al. | IEEE | 2021


    Sub-Resolution mmWave FMCW Radar-based Touch Localization using Deep Learning

    Rao, Raghunandan M. / Kachroo, Amit / Manjunatha, Koushik A. et al. | IEEE | 2024


    Relative Spherical-Visual Localization for Cooperative Unmanned Aerial Systems

    Holter, Steffen / Tsoukalas, Athanasios / Evangeliou, Nikolaos et al. | IEEE | 2021


    Signalling Design in Sensor-Assisted mmWave Communications for Cooperative Driving

    Ciaramitaro, Giovanni / Brambilla, Mattia / Nicoli, Monica et al. | BASE | 2023

    Free access