The problem of estimating and predicting position and orientation (pose) of a camera is approached by fusing measurements from inertial sensors (accelerometers and rate gyroscopes) and vision. The sensor fusion approach described in this contribution is based on non-linear filtering of these complementary sensors. This way, accurate and robust pose estimates are available for the primary purpose of augmented reality applications, but with the secondary effect of reducing computation time and improving the performance in vision processing. A real-time implementation of a multi-rate extended Kalman filter is described, using a dynamic model with 22 states, where 12.5 Hz correspondences from vision and 100 Hz inertial measurements are processed. An example where an industrial robot is used to move the sensor unit is presented. The advantage with this configuration is that it provides ground truth for the pose, allowing for objective performance evaluation. The results show that we obtain an absolute accuracy of 2 cm in position and 1° in orientation.
Robust Real-Time Tracking by Fusing Measurements from Inertial and Vision Sensors
2007-01-01
Paper
Electronic Resource
English
DDC: | 629 |
FUSING LOW-COST IMAGE AND INERTIAL SENSORS FOR PASSIVE NAVIGATION
Online Contents | 2007
|Robust Real-time Vision-based Aircraft Tracking From Unmanned Aerial Vehicles.
BASE | 2014
|Fusing visual contour tracking with inertial sensing to recover robot egomotion
BASE | 2003
|