In this work we address the System-of-Systems reassembling operation of a marsupial team comprising a hybrid Unmanned Aerial Vehicle and a Legged Locomotion robot, relying solely on vision-based systems and assisted by Deep Learning. The target application domain is that of large-scale field surveying operations under the presence of wireless communication disruptions. While most real-world field deployments of multi-robot systems assume some degree of wireless communication to coordinate key tasks such as multi-agent rendezvous, a desirable feature against unrecoverable communication failures or radio degradation due to jamming cyber-attacks is the ability for autonomous systems to robustly execute their mission with onboard perception. This is especially true for marsupial air / ground teams, wherein landing onboard the ground robot is required. We propose a pipeline that relies on Deep Neural Network-based Vehicle-to-Vehicle detection based on aerial views acquired by flying at typical altitudes for Micro Aerial Vehicle-based real-world surveying operations, such as near the border of the 400ft Above Ground Level window. We present the minimal computing and sensing suite that supports its execution onboard a fully autonomous micro-Tiltrotor aircraft which detects, approaches, and lands onboard a Boston Dynamics Spot legged robot. We present extensive experimental studies that validate this marsupial aerial / ground robot’s capacity to safely reassemble while in the airborne scouting phase without the need for wireless communication.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Learning–based Reassembling of an Aerial & Legged Marsupial Robotic System–of–Systems




    Publication date :

    2023-06-06


    Size :

    4999632 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Combined Docking-and-Recharging for a Flexible Aerial / Legged Marsupial Autonomous System

    Moore, Brandon / Carlson, Stephen J. / Arora, Prateek et al. | IEEE | 2023


    Three-legged robotic apparatus

    ARAMAYO II GUSTAVO AUGUSTO / CLARKE DAVID / MACGREGOR ROSS et al. | European Patent Office | 2019

    Free access

    THREE-LEGGED ROBOTIC APPARATUS

    ARAMAYO II GUSTAVO AUGUSTO / CLARKE DAVID / MACGREGOR ROSS et al. | European Patent Office | 2019

    Free access