Robotic-assisted minimally invasive surgeries have gained a lot of popularity over conventional procedures as they offer many benefits to both surgeons and patients. Nonetheless, they still suffer from some limitations that affect their outcome. One of them is the lack of force feedback which restricts the surgeon's sense of touch and might reduce precision during a procedure. To overcome this limitation, we propose a novel force estimation approach that combines a vision based solution with supervised learning to estimate the applied force and provide the surgeon with a suitable representation of it. The proposed solution starts with extracting the geometry of motion of the heart's surface by minimizing an energy functional to recover its 3D deformable structure. A deep network, based on a LSTM-RNN architecture, is then used to learn the relationship between the extracted visual-geometric information and the applied force, and to find accurate mapping between the two. Our proposed force estimation solution avoids the drawbacks usually associated with force sensing devices, such as biocompatibility and integration issues. We evaluate our approach on phantom and realistic tissues in which we report an average root-mean square error of 0.02 N. ; Peer Reviewed ; Postprint (author's final draft)
Towards retrieving force feedback in robotic-assisted surgery: a supervised neuro-recurrent-vision approach
2017-07-01
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
DDC: | 629 |
Sensorless force estimation using a neuro-vision-based approach for robotic-assisted surgery
BASE | 2016
|Current evidence of robotic assisted surgery use in functional reconstructive and neuro-urology
BASE | 2023
|Vision based trajectory planning for robotic assisted fetal surgery treatint TTTS
BASE | 2019
|Robotic Normalizing Force Feedback
SAE Technical Papers | 2005
|Force Feedback Enhancement for Soft Tissue Interaction Tasks in Cooperative Robotic Surgery
BASE | 2015
|