Camera navigation in minimally invasive surgery changed significantly since the introduction of robotic assistance. Robotic surgeons are subjected to a cognitive workload increase due to the asynchronous control over tools and camera, which also leads to interruptions in the workflow. Camera motion automation has been addressed as a possible solution, but still lacks situation awareness. We propose an online surgical Gesture Recognition for Autonomous Camera-motion Enhancement (GRACE) system to introduce situation awareness in autonomous camera navigation. A recurrent neural network is used in combination with a tool tracking system to offer gesture-specific camera motion during a robotic-assisted suturing task. GRACE was integrated with a research version of the da Vinci surgical system and a user study (involving 10 participants) was performed to evaluate the benefits introduced by situation awareness in camera motion, both with respect to a state of the art autonomous system (S) and current clinical approach (P). Results show GRACE improving completion time by a median reduction of 18.9s (8.1% ) with respect to S and 65.1s (21.1% ) with respect to P. Also, workload reduction was confirmed by statistical difference in the NASA Task Load Index with respect to S (p < 0.05). Reduction of motion sickness, a common issue related to continuous camera motion of autonomous systems, was assessed by a post-experiment survey ( p < 0.01 ).


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    GRACE: Online Gesture Recognition for Autonomous Camera-Motion Enhancement in Robot-Assisted Surgery



    Erscheinungsdatum :

    01.01.2023



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    Dynamic Gesture Recognition Using a Smart Glove in Hand-Assisted Laparoscopic Surgery

    Lidia Santos / Nicola Carbonaro / Alessandro Tognetti et al. | BASE | 2018

    Freier Zugriff

    Human Gesture Recognition for Autonomous Aircraft Operation

    AFRASIABI AMIR / LEE KWANG HEE / PATEL BHARGAVI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Human gesture recognition for autonomous aircraft operation

    AFRASIABI AMIR / LEE KWANG HEE / PATEL BHARGAVI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Towards Human Activity Recognition Enhanced Robot Assisted Surgery

    Su, Hang / De Momi, Elena | Springer Verlag | 2022