Introduction The current study presents a deep learning framework to determine, in real-time, position and rotation of a target organ from an endoscopic video. These inferred data are used to overlay the 3D model of patient's organ over its real counterpart. The resulting augmented video flow is streamed back to the surgeon as a support during laparoscopic robot-assisted procedures. Methods This framework exploits semantic segmentation and, thereafter, two techniques, based on Convolutional Neural Networks and motion analysis, were used to infer the rotation. Results The segmentation shows optimal accuracies, with a mean IoU score greater than 80% in all tests. Different performance levels are obtained for rotation, depending on the surgical procedure. Discussion Even if the presented methodology has various degrees of precision depending on the testing scenario, this work sets the first step for the adoption of deep learning and augmented reality to generalise the automatic registration process.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A deep learning framework for real-time 3D model registration in robot-assisted laparoscopic surgery



    Erscheinungsdatum :

    2022-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Robot-assisted laparoscopic surgery of the infrarenal aorta

    Diks, J. / Nio, D. / Jongkind, V. et al. | BASE | 2007

    Freier Zugriff


    The future of robotic-assisted laparoscopic surgery

    Dao, Thi My Hanh / Nguyen, Thi Kim Thi / Schirling, Denis | BASE | 2020

    Freier Zugriff

    Real-time Robot-assisted Ergonomics

    Shafti, A / Ataka, A / Urbistondo Lazpita, B et al. | BASE | 2019

    Freier Zugriff

    Evaluation of the learning curve of robot-assisted laparoscopic ventral mesh rectopexy

    van der Schans, Emma M. / Verheijen, Paul M. / El Moumni, Mostafa et al. | BASE | 2022

    Freier Zugriff