Machine Learning (ML) systems require representative and diverse datasets to accurately learn the objective task. In supervised learning data needs to be accurately annotated, which is an expensive and error-prone process. We present a method for generating synthetic data tailored to the use-case achieving excellent performance in a real-world usecase. We provide a method for producing automatically annotated synthetic visual data of multi rotor unmanned aerial vehicles (UAV) and other airborne objects in a simulated environment with a high degree of scene diversity, from collection of 3D models to generation of annotated synthetic datasets (synthsets). In our data generation framework SynRender we introduce a novel method of using Neural Radiance Field (NeRF) methods to capture photo-realistic high-fidelity 3D-models of multirotor UAVs in order to automate data generation for an object detection task in diverse environments. By producing data tailored to the real-world setting, our NeRF-derived results show an advantage over generic 3D asset collection-based methods where the domain gap between the simulated and real-world is unacceptably large. In the spirit of keeping research open and accessible to the research community we release our dataset VISER DroneDiversity used in this project, where visual images, annotated boxes, instance segmentation and depth maps are all generated for each image sample.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Enhancing Drone Surveillance with NeRF: Real-World Applications and Simulated Environments


    Contributors:


    Publication date :

    2024-09-29


    Size :

    3487134 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Towards autonomous surveillance in real world environments

    Behara, Gayatri M. / Chodavarapu, Vamsy P. | IEEE | 2017


    Surveillance Drone with Microbots

    CARMICHAEL CONNIE JORDAN | European Patent Office | 2020

    Free access

    Surveillance drone with microbots

    CARMICHAEL CONNIE JORDAN | European Patent Office | 2022

    Free access

    Drone Pre-Surveillance

    KERZNER DANIEL TODD / TRUNDLE STEPHEN SCOTT | European Patent Office | 2018

    Free access

    DRONE PRE-SURVEILLANCE

    KERZNER DANIEL TODD / TRUNDLE STEPHEN SCOTT | European Patent Office | 2022

    Free access