Camera navigation in minimally invasive surgery changed significantly since the introduction of robotic assistance. Robotic surgeons are subjected to a cognitive workload increase due to the asynchronous control over tools and camera, which also leads to interruptions in the workflow. Camera motion automation has been addressed as a possible solution, but still lacks situation awareness. We propose an online surgical Gesture Recognition for Autonomous Camera-motion Enhancement (GRACE) system to introduce situation awareness in autonomous camera navigation. A recurrent neural network is used in combination with a tool tracking system to offer gesture-specific camera motion during a robotic-assisted suturing task. GRACE was integrated with a research version of the da Vinci surgical system and a user study (involving 10 participants) was performed to evaluate the benefits introduced by situation awareness in camera motion, both with respect to a state of the art autonomous system (S) and current clinical approach (P). Results show GRACE improving completion time by a median reduction of 18.9s (8.1% ) with respect to S and 65.1s (21.1% ) with respect to P. Also, workload reduction was confirmed by statistical difference in the NASA Task Load Index with respect to S (p < 0.05). Reduction of motion sickness, a common issue related to continuous camera motion of autonomous systems, was assessed by a post-experiment survey ( p < 0.01 ).


    Access

    Download


    Export, share and cite



    Title :

    GRACE: Online Gesture Recognition for Autonomous Camera-Motion Enhancement in Robot-Assisted Surgery



    Publication date :

    2023-01-01



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Dynamic Gesture Recognition Using a Smart Glove in Hand-Assisted Laparoscopic Surgery

    Lidia Santos / Nicola Carbonaro / Alessandro Tognetti et al. | BASE | 2018

    Free access

    Human gesture recognition for autonomous aircraft operation

    AFRASIABI AMIR / LEE KWANG HEE / PATEL BHARGAVI et al. | European Patent Office | 2024

    Free access

    Human Gesture Recognition for Autonomous Aircraft Operation

    AFRASIABI AMIR / LEE KWANG HEE / PATEL BHARGAVI et al. | European Patent Office | 2022

    Free access

    SHREC 2019 Track: Online Gesture Recognition

    F. M. Caputo / S. Burato / G. Pavan et al. | BASE | 2019

    Free access

    Towards Human Activity Recognition Enhanced Robot Assisted Surgery

    Su, Hang / De Momi, Elena | Springer Verlag | 2022