Despite significant progress achieved in the last decade to convert passive capsule endoscopes to actively controllable robots, robotic capsule endoscopy still has some challenges. In particular, a fully dense three-dimensional (3D) map reconstruction of the explored organ remains an unsolved problem. Such a dense map would help doctors detect the locations and sizes of the diseased areas more reliably, resulting in more accurate diagnoses. In this study, we propose a comprehensive medical 3D reconstruction method for endoscopic capsule robots, which is built in a modular fashion including preprocessing, keyframe selection, sparse-then-dense alignment-based pose estimation, bundle fusion, and shading-based 3D reconstruction. A detailed quantitative analysis is performed using a non-rigid esophagus gastroduodenoscopy simulator, four different endoscopic cameras, a magnetically activated soft capsule robot, a sub-millimeter precise optical motion tracker, and a fine-scale 3D optical scanner, whereas qualitative ex-vivo experiments are performed on a porcine pig stomach. To the best of our knowledge, this study is the first complete endoscopic 3D map reconstruction approach containing all of the necessary functionalities for a therapeutically relevant 3D map reconstruction.


    Access

    Download


    Export, share and cite



    Title :

    Sparse-then-dense alignment-based 3D map reconstruction method for endoscopic capsule robots


    Contributors:

    Publication date :

    2018-02-01



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    004 / 629




    Magnetic-visual sensor fusion-based dense 3d reconstruction and localization for endoscopic capsule robots

    Turan, Mehmet / Almalioglu, Yasin / Ornek, Evin Pinar et al. | BASE | 2018

    Free access


    DOA Estimation for Sparse Array via Sparse Signal Reconstruction

    Nan Hu, / Zhongfu Ye, / Xu Xu, et al. | IEEE | 2013


    Dense statistic versus sparse feature-based approach for 3D object recognition

    Decker, P. / Thierfelder, S. / Paulus, D. et al. | British Library Online Contents | 2011