Despite significant progress achieved in the last decade to convert passive capsule endoscopes to actively controllable robots, robotic capsule endoscopy still has some challenges. In particular, a fully dense three-dimensional (3D) map reconstruction of the explored organ remains an unsolved problem. Such a dense map would help doctors detect the locations and sizes of the diseased areas more reliably, resulting in more accurate diagnoses. In this study, we propose a comprehensive medical 3D reconstruction method for endoscopic capsule robots, which is built in a modular fashion including preprocessing, keyframe selection, sparse-then-dense alignment-based pose estimation, bundle fusion, and shading-based 3D reconstruction. A detailed quantitative analysis is performed using a non-rigid esophagus gastroduodenoscopy simulator, four different endoscopic cameras, a magnetically activated soft capsule robot, a sub-millimeter precise optical motion tracker, and a fine-scale 3D optical scanner, whereas qualitative ex-vivo experiments are performed on a porcine pig stomach. To the best of our knowledge, this study is the first complete endoscopic 3D map reconstruction approach containing all of the necessary functionalities for a therapeutically relevant 3D map reconstruction.
Sparse-then-dense alignment-based 3D map reconstruction method for endoscopic capsule robots
2018-02-01
Article (Journal)
Electronic Resource
English
Sparse-then-dense alignment-based 3D map reconstruction method for endoscopic capsule robots
British Library Online Contents | 2018
|Visual Inertial Odometry and Active Dense Reconstruction for Mobile Robots
BASE | 2016
|Dense statistic versus sparse feature-based approach for 3D object recognition
British Library Online Contents | 2011
|