Abstract Space robots in the space station can assist or substitute astronauts to conduct some in-cabin tasks to alleviate the problems of heavy tasks and the limited number of astronauts in the space station. In response to these problems, a hand gesture teleoperation method is proposed for controlling of dexterous manipulators in the space station, which is based on monocular hand motion capture and video-calling tools. This method can realize free and convenient teleoperation. The work is mainly divided into two parts, which are monocular hand motion capture and teleoperation framework for dexterous manipulators. For monocular hand motion capture, a hand pose estimation method based on hand biological constraints from single RGB images is designed. On the other hand, a dexterous manipulator teleoperation framework based on hand motion capture and video-calling tools is designed. Experimental results carried out on hand pose estimation datasets proved that the proposed hand pose estimation method outperforms the state-of-the-art methods. Physical experiment on a space dexterous manipulator teleoperation platform validated the effectiveness of the proposed hand gesture teleoperation method.

    Graphical abstract Display Omitted

    Highlights A hand gesture teleoperation method for dexterous manipulators in space station is proposed. A 3D hand pose estimation method from single RGB images based on hand biologically inspiration is proposed. The superiority of the proposed 3D hand pose estimation method is verified on public datasets of hand pose estimation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Hand gesture teleoperation for dexterous manipulators in space station by using monocular hand motion capture


    Beteiligte:
    Gao, Qing (Autor:in) / Li, Jinyang (Autor:in) / Zhu, Yimin (Autor:in) / Wang, Siyue (Autor:in) / Liufu, Jingshu (Autor:in) / Liu, Jinguo (Autor:in)

    Erschienen in:

    Acta Astronautica ; 204 ; 630-639


    Erscheinungsdatum :

    2022-11-23


    Format / Umfang :

    10 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Vision-based perception for dexterous hand-arm teleoperation

    Li, Shuang / Universität Hamburg | TIBKAT | 2021

    Freier Zugriff

    Dexterous underwater robot hand: HEU Hand II

    Meng, Qingxin / Hua Wang / Ping Li et al. | Tema Archiv | 2006


    Robot Forearm and Dexterous Hand

    Lovchik, Christopher S. | NTRS | 2005


    Three-Finger Multisensory Hand for Dexterous Space Robotic Tasks

    Y. Murase / S. Komada / T. Uchiyama et al. | NTIS | 1994


    Kinematic Analysis of a Dexterous Hand

    Biswal, Bibhuti Bhusan ;Parida, P.K. ;Pati, K.C. | Trans Tech Publications | 2012