The knowledge of the precise 3D position of a target in tracking applications is a fundamental requirement. The lack of a low-cost single sensor capable of providing the three-dimensional position (of a target) makes it necessary to use complementary sensors together. This research presents a Local Positioning System (LPS) for outdoor scenarios, based on a data fusion approach for unmodified UAV tracking, combining a vision sensor and mmWave radar. The proposed solution takes advantage of the radar's depth observation ability and the potential of a neural network for image processing. We have evaluated five data association approaches for radar data cluttered to get a reliable set of radar observations. The results demonstrated that the estimated target position is close to an exogenous ground truth obtained from a Visual Inertial Odometry (VIO) algorithm executed onboard the target UAV. Moreover, the developed system's architecture is prepared to be scalable, allowing the addition of other observation stations. It will increase the accuracy of the estimation and extend the actuation area. To the best of our knowledge, this is the first work that uses a mmWave radar combined with a camera and a machine learning algorithm to track a UAV in an outdoor scenario.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Data Fusion Approach for Unmodified UAV Tracking with Vision and mmWave Radar


    Contributors:


    Publication date :

    2025-05-14


    Size :

    5288154 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A DNN-LSTM based Target Tracking Approach using mmWave Radar and Camera Sensor Fusion

    Sengupta, Arindam / Jin, Feng / Cao, Siyang | IEEE | 2019



    Object Tracking System With Radar/Vision Fusion For Automated Vehicles

    SCHIFFMANN JAN K | European Patent Office | 2017

    Free access

    Object tracking system with radar/vision fusion for automated vehicles

    SCHIFFMANN JAN K | European Patent Office | 2020

    Free access

    Vision meets mmWave Radar: 3D Object Perception Benchmark for Autonomous Driving

    Wang, Yizhou / Cheng, Jen-Hao / Huang, Jui-Te et al. | IEEE | 2024