This work presents a novel technique to control multi-functional hand for robot-assisted laparoscopic surgery. We tested the technique using the MUSHA multi-functional hand, a robot-aided minimally invasive surgery tool with more degrees of freedom than the standard commercial end-effector of the da Vinci robot. Extra degrees of freedom require the development of a proper control strategy to guarantee high performance and avoid an increasing complexity of control consoles. However, developing reliable control algorithms while reducing the control side's mechanical complexity is still an open challenge. In the proposed solution, we present a control strategy that projects the human hand motions into the robot actuation space. The human hand motions are tracked by a LeapMotion camera and mapped into the actuation space of the virtualized end-effector. The effectiveness of the proposed method was evaluated in a twofold manner. Firstly, we verified the Lyapunov stability of the algorithm, then an user study with 10 subjects assessed the intuitiveness and usability of the system.


    Access

    Download


    Export, share and cite



    Title :

    A Human Gesture Mapping Method to Control a Multi‐Functional Hand for Robot‐Assisted Laparoscopic Surgery: The MUSHA Case



    Publication date :

    2021-01-01



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Dynamic Gesture Recognition Using a Smart Glove in Hand-Assisted Laparoscopic Surgery

    Lidia Santos / Nicola Carbonaro / Alessandro Tognetti et al. | BASE | 2018

    Free access

    Robot-assisted laparoscopic surgery of the infrarenal aorta

    Diks, J. / Nio, D. / Jongkind, V. et al. | BASE | 2007

    Free access

    Comparison of Control Modes of a Hand-Held Robot for Laparoscopic Surgery

    O. Tonet / F. Focacci / M. Piccigallo et al. | BASE | 2006

    Free access

    Human-Robot Interaction Through Egocentric Hand Gesture Recognition

    Walunj, Snehal / Mashhaditafreshi, Nazanin / Pahlevannejad, Parsha et al. | Springer Verlag | 2025

    Free access

    Hand Gesture Controlled Robot Arm

    Elam Cheren.S / Madhubala.S / Pradeepa.C et al. | BASE | 2020

    Free access