We present a learning approach that allows to detect correspondences between visual and LIDAR measurements. In contrast to approaches that rely on calibration, we propose a learning approach that will create an implicit calibration model from training data. Our model can provide three functions: first of all, it can convert a measurement in one sensor into the coordinate system of the other, or into a distribution of probable measurements in case the transformation is not unique. Secondly, using a correspondence observation that we define, the model is able to decide if two visual/LIDAR measurements are likely to come from the same object. This is of profound importance for applications such as object detection or tracking where contributions from several sensors need to be combined. We demonstrate the feasibility of our approach by training and evaluating our system on tracklets in the KITTI database as well as on a small set of real-world scenes containing pedestrians, in which our method finds correspondences between the results of real visual and LIDAR-based detection algorithms.
Calibration-free match finding between vision and LIDAR
2015 IEEE Intelligent Vehicles Symposium (IV) ; 1061-1067
2015-06-01
1032095 byte
Conference paper
Electronic Resource
English
British Library Online Contents | 1992
|Finding multiple lanes in urban road networks with vision and lidar
British Library Online Contents | 2009
|A Novel Spaceborne Lidar Calibration Technique: The Multi-Calibration Lidar Experiment
British Library Conference Proceedings | 2006
|