We present an approach that allows a flying robot equipped with onboard RGBD camera to follow a person and to recognize gestures. This enables novel applications such as hands-free filming and picture taking. The self-motion of the moving platform with an onboard camera makes the problem of tracking a person highly challenging. To solve this problem, we stabilize the depth image by warping it to a virtual-static camera, using the estimated pose of the quadrocopter obtained from vision and inertial sensors using an Extended Kalman filter. We show that such a stabilized depth video is well suited to use with existing person trackers such as the OpenNI tracker. Using this approach, the quadrocopter not only obtains the position and orientation of the tracked person, but also the full body pose - which can then for example be used to recognize hand gestures to control the quadrocopter's behaviour. We implemented a small set of example commands ("follow me", "take picture", "land"), and generate corresponding motion commands. We demonstrate the practical performance of our approach in an extensive set of experiments with a quadrocopter. Although our current system is limited to indoor environments and small motions due to the restrictions of the used depth sensor, it indicates that there is large potential for such applications in the near future.


    Access

    Access via TIB

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Gesture Based Social Interaction and Person Following with a Flying Robot


    Contributors:


    Publication date :

    2014


    Size :

    20 Seiten, Bilder, Tabellen, 38 Quellen




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Print


    Language :

    English




    Followman: Control of Social Person Following Robot

    Ashe, Avijit Kumar / Krishna, K. Madhava | IEEE | 2021


    FLYING APPARATUS WITH MULTIPLE SENSORS AND GESTURE-BASED OPERATION

    LEE HOI HUNG HERBERT | European Patent Office | 2017

    Free access

    Human-Robot Interaction : An Arm Gesture-Based Approach

    Venturi, Sai Siri Sree / Bojja, Poorna Teja | BASE | 2023

    Free access

    A Gesture Based Interface for Human-Robot Interaction

    Waldherr, S. / Romero, R. / Thrun, S. | British Library Online Contents | 2001


    FLYING ROBOT CONTROL SYSTEM AND FLYING ROBOT

    KAMIYAMA KEN / AOKI FUMIO / HAZEKAWA HISASHI | European Patent Office | 2016

    Free access