Semantic tool segmentation in surgical videos is important for surgical scene understanding and computer-assisted interventions as well as for the development of robotic automation. The problem is challenging because different illumination conditions, bleeding, smoke and occlusions can reduce algorithm robustness. At present labelled data for training deep learning models is still lacking for semantic surgical instrument segmentation and in this paper we show that it may be possible to use robot kinematic data coupled with laparoscopic images to alleviate the labelling problem. We propose a new deep learning based model for parallel processing of both laparoscopic and simulation images for robust segmentation of surgical tools. Due to the lack of laparoscopic frames annotated with both segmentation ground truth and kinematic information a new custom dataset was generated using the da Vinci Research Kit (dVRK) and is made available.


    Access

    Download


    Export, share and cite



    Title :

    Synthetic and Real Inputs for Tool Segmentation in Robotic Surgery


    Contributors:
    Colleoni, E (author) / Edwards, P (author) / Stoyanov, D (author)

    Publication date :

    2020-01-01


    Remarks:

    In: Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. (pp. pp. 700-710). Springer Nature: Cham, Switzerland. (2020)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Robotic Surgery

    NTIS | 2000


    Robotic Surgery

    NTRS | 2000


    Robotic prostate surgery

    Muntener, Michael / Ursu, Daniel / Patriciu, Alexandru et al. | Taylor & Francis Verlag | 2006


    ROBOTIC WORK TOOL AND ROBOTIC TOOL SYSTEM

    KEBLANZ ROLF | European Patent Office | 2023

    Free access

    Hepatectomy in Robotic Surgery

    Coco, Danilo / Leanza, Silvana | BASE | 2020

    Free access