Camera navigation in minimally invasive surgery changed significantly since the introduction of robotic assistance. Robotic surgeons are subjected to a cognitive workload increase due to the asynchronous control over tools and camera, which also leads to interruptions in the workflow. Camera motion automation has been addressed as a possible solution, but still lacks situation awareness. We propose an online surgical Gesture Recognition for Autonomous Camera-motion Enhancement (GRACE) system to introduce situation awareness in autonomous camera navigation. A recurrent neural network is used in combination with a tool tracking system to offer gesture-specific camera motion during a robotic-assisted suturing task. GRACE was integrated with a research version of the da Vinci surgical system and a user study (involving 10 participants) was performed to evaluate the benefits introduced by situation awareness in camera motion, both with respect to a state of the art autonomous system (S) and current clinical approach (P). Results show GRACE improving completion time by a median reduction of 18.9s (8.1% ) with respect to S and 65.1s (21.1% ) with respect to P. Also, workload reduction was confirmed by statistical difference in the NASA Task Load Index with respect to S (p < 0.05). Reduction of motion sickness, a common issue related to continuous camera motion of autonomous systems, was assessed by a post-experiment survey ( p < 0.01 ).
GRACE: Online Gesture Recognition for Autonomous Camera-Motion Enhancement in Robot-Assisted Surgery
01.01.2023
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
| DDC: | 629 |
Dynamic Gesture Recognition Using a Smart Glove in Hand-Assisted Laparoscopic Surgery
| BASE | 2018
Human Gesture Recognition for Autonomous Aircraft Operation
| Europäisches Patentamt | 2022
Human gesture recognition for autonomous aircraft operation
| Europäisches Patentamt | 2024
Towards Human Activity Recognition Enhanced Robot Assisted Surgery
| Springer Verlag | 2022