A hybrid model-based and data-driven framework is proposed in this paper for autonomous coastline surveillance using an unmanned aerial vehicle. The proposed approach comprises three individual neural network-assisted modules that work together to estimate the state of the target (i.e., shoreline) to contribute to its identification and tracking. The shoreline is first detected through image segmentation using a Convolutional Neural Network. The part of the segmented image that includes the detected shoreline is then fed into a CNN real-time optical flow estimator. The position of pixels belonging to the detected shoreline, as well as the initial approximation of the shoreline motion, are incorporated into a neural network-aided Extended Kalman Filter that learns from data and can provide on-line motion estimation of the shoreline (i.e., position and velocity in the presence of waves) using the system and measurement models with partial knowledge. Finally, the estimated feedback is provided to a Partitioned Visual Servo tracking controller for autonomous multirotor navigation along the coast, ensuring that the latter will always remain inside the onboard camera field of view. A series of outdoor comparative studies using an octocopter flying along the shoreline in various weather and beach settings demonstrate the effectiveness of the suggested architecture.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Hybrid Model and Data-Driven Vision-Based Framework for the Detection, Tracking and Surveillance of Dynamic Coastlines Using a Multirotor UAV


    Beteiligte:


    Erscheinungsdatum :

    2022




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Vision-Based Multirotor Following Using Synthetic Learning Techniques

    Rodriguez Ramos, Alejandro / Álvarez Fernández, Adrián / Bavle, Hriday et al. | BASE | 2019

    Freier Zugriff

    A Framework for Vision-Based Multiple Target Finding and Action Using Multirotor UAVs

    Hinas, Ajmal / Ragel, Roshan / Roberts, Jonathan et al. | IEEE | 2018


    HYBRID MULTIROTOR VEHICLES

    GILBERT ERIC BENJAMIN | Europäisches Patentamt | 2020

    Freier Zugriff

    Data-Driven Modeling for Multirotor Autonomous Control

    Shiotsuka, Tatsuya / Bando, Mai / Hokamoto, Shinji | AIAA | 2024


    Aerodynamic optimization hybrid multirotor

    ZHANG XIN / WANG SONG / LI XUN et al. | Europäisches Patentamt | 2015

    Freier Zugriff