The instrumentation of spinal fusion surgeries includes pedicle screw placement and rod implantation. While several surgical navigation approaches have been proposed for pedicle screw placement, less attention has been devoted towards the guidance of patient-specific adaptation of the rod implant. We propose a marker-free and intuitive Augmented Reality (AR) approach to navigate the bending process required for rod implantation. A stereo neural network is trained from the stereo video streams of the Microsoft HoloLens in an end-to-end fashion to determine the location of corresponding pedicle screw heads. From the digitized screw head positions, the optimal rod shape is calculated, translated into a set of bending parameters, and used for guiding the surgeon with a novel navigation approach. In the AR-based navigation, the surgeon is guided step-by-step in the use of the surgical tools to achieve an optimal result. We have evaluated the performance of our method on human cadavers against two benchmark methods, namely conventional freehand bending and marker-based bending navigation in terms of bending time and rebending maneuvers. We achieved an average bending time of 231s with 0.6 rebending maneuvers per rod compared to 476s (3.5 rebendings) and 348s (1.1 rebendings) obtained by our freehand and marker-based benchmarks, respectively.


    Access

    Download


    Export, share and cite



    Title :

    Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion



    Publication date :

    2022-01-10


    Remarks:

    von Atzigen, Marco; Liebmann, Florentin; Hoch, Armando; Spirig, José Miguel; Farshad, Mazda; Snedeker, Jess; Fürnstahl, Philipp (2022). Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion. Medical Image Analysis, 77:102365.



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    SENSOR FUSION METHODS FOR AUGMENTED REALITY NAVIGATION

    ELANGOVAN VIDYA / JAIN PRASHANT / LIANG ANTHONY et al. | European Patent Office | 2019

    Free access

    AUGMENTED REALITY ENHANCED NAVIGATION

    WIND III ANTHONY G / ALBRECHT ROBERT R / HINRICHS TIMOTHY J et al. | European Patent Office | 2018

    Free access

    AUGMENTED REALITY ENHANCED NAVIGATION

    WIND III ANTHONY G / ALBRECHT ROBERT R / HINRICHS TIMOTHY J et al. | European Patent Office | 2018

    Free access

    An integrated augmented reality surgical navigation platform using multi-modality imaging for guidance

    Chan H. H. L. / Haerle S. K. / Daly M. J. et al. | BASE | 2021

    Free access

    USING AUGMENTED REALITY TO IDENTIFY VEHICLE NAVIGATION REQUIREMENTS

    ROBESON KYLE D / MCDUFF STEVE / LORETO ANTHONY DI et al. | European Patent Office | 2020

    Free access