Robot-assisted surgery has potential advantages but lacks force feedback, which can lead to errors such as broken stitches or tissue damage. More experienced surgeons can judge the tool-tissue forces visually and an automated way of capturing this skill is desirable. Methods to measure force tend to involve complex measurement devices or visual tracking of tissue deformation. We investigate whether surgical forces can be estimated simply from the discrepancy between kinematic and visual measurement of the tool position. We show that combined visual and kinematic force estimation can be achieved without external measurements or modelling of tissue deformation. After initial alignment when no force is applied to the tool, visual and kinematic estimates of tool position diverge under force. We plot visual/kinematic displacement with force using vision and marker-based tracking. We demonstrate the ability to discern the forces involved in knot tying and visualize the displacement force using the publicly available JIGSAWS dataset as well as clinical examples of knot tying with the da Vinci surgical system. The ability to visualize or feel forces using this method may offer an advantage to those learning robotic surgery as well as adding to the information available to more experienced surgeons.


    Access

    Download


    Export, share and cite



    Title :

    Visual kinematic force estimation in robot-assisted surgery – application to knot tying


    Contributors:
    Edwards, PJ (author) / Colleoni, E (author) / Sridhar, A (author) / Kelly, JD (author) / Stoyanov, D (author)

    Publication date :

    2021-01-01


    Remarks:

    Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization , 9 (4) pp. 414-420. (2021)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Tying the Knot: Integrating with other Systems

    Mace, M. R. | British Library Conference Proceedings | 1995


    FISHING LINE KNOT TYING CONTEST: A FRESHMEN EXPERIENCE

    Elban, W. L. / Frantz, D. L. / United States | British Library Conference Proceedings | 2002


    SYSTEM, DEVICE AND METHOD TO FACILITATE TYING KNOT

    TYLER E BERKEY / DANIEL THOMAS / MATTHEW L SCOTT | European Patent Office | 2020

    Free access

    REBAR TYING ROBOT

    EVANS MICHAEL / EVANS JASON / DUGGAL JAYAN KANT | European Patent Office | 2022

    Free access

    Rebar Tying Robot

    EVANS MICHAEL / EVANS JASON / DUGGAL JAYAN KANT | European Patent Office | 2022

    Free access