This paper presents a formation control approach for contactless gesture-based Human-Swarm Interaction (HSI) between a team of multi-rotor Unmanned Aerial Vehicles (UAVs) and a human worker. The approach is designed to monitor the safety of human workers, particularly those operating at heights. In the proposed dynamic formation scheme, one UAV acts as the formation leader, equipped with sensors for detecting human workers and recognizing gestures. The follower UAVs maintain a predetermined formation relative to the worker's position, providing additional perspectives of the monitored scene. Hand gestures enable the human worker to specify movement and action commands for the UAV team and to initiate other mission-related tasks without requiring additional communication channels or specific markers. Combined with a novel unified human detection and tracking algorithm, a human position estimation method, and a gesture detection pipeline, the proposed approach represents the first instance of an HSI system incorporating all these modules onboard real-world UAVs. Simulations and field experiments involving three UAVs and a human worker in a mock-up scenario demonstrate the effectiveness and responsiveness of the proposed approach.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Gesture-Controlled Aerial Robot Formation for Human-Swarm Interaction in Safety Monitoring Applications


    Beteiligte:

    Erscheinungsdatum :

    2024


    Anmerkungen:

    8 pages, 8 figures


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Gesture and Voice Controlled Robot for Industrial Applications

    Vanamala, H R / M, Akash S / A, Vinay et al. | IEEE | 2022


    A Gesture Based Interface for Human-Robot Interaction

    Waldherr, S. / Romero, R. / Thrun, S. | British Library Online Contents | 2001


    Hand Gesture Controlled Robot Arm

    Elam Cheren.S / Madhubala.S / Pradeepa.C et al. | BASE | 2020

    Freier Zugriff

    SwarmPaint: Human-Swarm Interaction for Trajectory Generation and Formation Control by DNN-based Gesture Interface

    Serpiva, Valerii / Karmanova, Ekaterina / Fedoseev, Aleksey et al. | IEEE | 2021


    Human-Robot Interaction Through Egocentric Hand Gesture Recognition

    Walunj, Snehal / Mashhaditafreshi, Nazanin / Pahlevannejad, Parsha et al. | Springer Verlag | 2025

    Freier Zugriff