Purpose: Needle placement is a challenging problem for applications such as biopsy or brachytherapy. Tip force sensing can provide valuable feedback for needle navigation inside the tissue. For this purpose, fiber-optical sensors can be directly integrated into the needle tip. Optical coherence tomography (OCT) can be used to image tissue. Here, we study how to calibrate OCT to sense forces, e.g., during robotic needle placement. Methods: We investigate whether using raw spectral OCT data without a typical image reconstruction can improve a deep learning-based calibration between optical signal and forces. For this purpose, we consider three different needles with a new, more robust design which are calibrated using convolutional neural networks (CNNs). We compare training the CNNs with the raw OCT signal and the reconstructed depth profiles. Results: We find that using raw data as an input for the largest CNN model outperforms the use of reconstructed data with a mean absolute error of 5.81 mN compared to 8.04 mN. Conclusions: We find that deep learning with raw spectral OCT data can improve learning for the task of force estimation. Our needle design and calibration approach constitute a very accurate fiber-optical sensor for measuring forces at the needle tip. ; This work was partially supported by the TUHH i 3 initiative and DFG grants SCHL 1844/2-1 and SCHL 1844/2-2. Open Access funding provided by Projekt DEAL.


    Access

    Download


    Export, share and cite



    Title :

    Needle tip force estimation by deep learning from raw spectral OCT data



    Publication date :

    2020-07-22


    Remarks:

    2-s2.0-85088443781



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    004 / 629 / 610




    Spatio-temporal deep learning models for tip force estimation during needle insertion

    Gessert, Nils Thorben / Priegnitz, Torben / Saathoff, Thore et al. | BASE | 2019

    Free access

    Future Needle Position Estimation of Suturing Operation using Deep Learning

    Minamoto, Masahiko / Tanaka, Shunsuke / Hori, Shigeki et al. | British Library Conference Proceedings | 2022


    Needle Tip Force Estimation Using an OCT Fiber and a Fused convGRU-CNN Architecture

    Gessert, Nils / Priegnitz, Torben / Saathoff, Thore et al. | BASE | 2018

    Free access

    A graph-spectral method for surface height recovery from needle-maps

    Robles-Kelly, A. / Hancock, E.R. | IEEE | 2001


    A Graph-Spectral Method for Surface Height Recovery from Needle-Maps

    Robles-Kelly, A. / Hancock, E. R. / IEEE | British Library Conference Proceedings | 2001