Abstract Non-cooperative Sense and Avoid is a critical technology for the safety and autonomy of Unmanned Aerial Vehicles (UAV). Standalone sensing solutions, i.e., only based on either visual cameras or radars, encounter challenges especially for vehicles flying at low altitude. To overcome this limit, sensor fusion strategies can play a key role. In this framework, this paper proposes a two-step radar/visual sensor fusion approach taking place both at detection and tracking level. The first step, named “Fuse-Before-Track”, consists in jointly using radar information and visual detections (provided by Convolutional Neural Network-based detectors) to remove uninteresting radar echoes thus improving ground clutter removal and speeding up the radar processing pipeline. At the second level, tracking takes place by exploiting the previously retrieved (confirmed) radar measurements and fusing visual detections to improve the solution accuracy. The proposed approach is tested on data collected during experimental flight tests where a ground-fixed multi-sensor setup (integrating a low size weight and power radar and a daylight camera) is used to detect and track a small UAV manually piloted to carry out approaching manoeuvres. Detection and tracking performance is assessed using, as a benchmark, a cm-level relative positioning solution retrieved by means of Carrier Phase Differential GNSS techniques. The implemented detection-level fusion approach ensures radar detection accuracy of meter level and meter-per-second level on range and range rate, respectively. In addition, the second level of fusion allows attaining sub-degree level errors in the angular and angular rates estimates at a tracking stage. Tracking data are finally used for conflict threat assessment, i.e., to get estimates of the distance and time at closest point of approach, with mean errors on the former of about 10 m in most encounters when the latter falls below 50 s.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Radar/visual fusion with fuse-before-track strategy for low altitude non-cooperative sense and avoid


    Contributors:


    Publication date :

    2024-01-29




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Experimental analysis of Radar/Optical track-to-track fusion for non-cooperative Sense and Avoid*

    Vitiello, Federica / Causa, Flavia / Opromolla, Roberto et al. | IEEE | 2023



    Radar/electro-optical data fusion for non-cooperative UAS sense and avoid

    Fasano, Giancarmine / Accardo, Domenico / Tirri, Anna Elena et al. | Elsevier | 2015


    Improved Sensing Strategies for Low Altitude Non Cooperative Sense and Avoid

    Vitiello, Federica / Causa, Flavia / Opromolla, Roberto et al. | IEEE | 2021


    UNMANNED AIRCRAFT SYSTEMS SENSE AND AVOID SENSOR FUSION TRACK INITIALIZATION

    BAGESHWAR VIBHOR L / KUNDAK NURI / VESELY MILOS | European Patent Office | 2015

    Free access