Incorporating hand gesture recognition in human-robot interaction has the potential to provide a natural way of communication, thus contributing to a more fluid collaboration toward optimizing the efficiency of the application at hand and overcoming possible challenges. A very promising field of interest is agriculture, owing to its complex and dynamic environments. The aim of this study was twofold: (a) to develop a real-time skeleton-based recognition system for five hand gestures using a depth camera and machine learning, and (b) to enable a real-time human-robot interaction framework and test it in different scenarios. For this purpose, six machine learning classifiers were tested, while the Robot Operating System (ROS) software was utilized for "translating" the gestures into five commands to be executed by the robot. Furthermore, the developed system was successfully tested in outdoor experimental sessions that included either one or two persons. In the last case, the robot, based on the recognized gesture, could distinguish which of the two workers required help, follow the "locked" person, stop, return to a target location, or "unlock" them. For the sake of safety, the robot navigated with a preset socially accepted speed while keeping a safe distance in all interactions.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    An Integrated Real-Time Hand Gesture Recognition Framework for Human-Robot Interaction in Agriculture


    Beteiligte:
    Moysiadis, V (Autor:in) / Katikaridis, D (Autor:in) / Benos, L (Autor:in) / Busato, P (Autor:in) / Anagnostis, A (Autor:in) / Kateris, D (Autor:in) / Pearson, S (Autor:in) / Bochtis, D (Autor:in) / Moysiadis, V / Katikaridis, D

    Erscheinungsdatum :

    2022-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Real-Time Hand Gesture Recognition for Robot Hand Interface

    Lv, Xiaomeng / Xu, Yulin / Wang, Ming | Springer Verlag | 2014


    Real-Time Hand Gesture Recognition for Robot Hand Interface

    Lv, X. / Xu, Y. / Wang, M. | British Library Conference Proceedings | 2014


    A Real-Time Applicable Dynamic Hand Gesture Recognition Framework

    Kopinski, Thomas / Gepperth, Alexander / Handmann, Uwe | IEEE | 2015


    An integrative framework of human hand gesture segmentation for human robot interaction

    Ju, Zhaojie / Ji, Xiaofei / Li, Jing et al. | BASE | 2015

    Freier Zugriff

    Towards an intuitive human-robot interaction based on hand gesture recognition and proximity sensors

    Al, Gorkem Anil / Estrela, Pedro / Martinez Hernandez, Uriel | BASE | 2020

    Freier Zugriff