In the present paper, we propose a highly accurate and robust people detector, which works well under highly variant and uncertain conditions, such as occlusions, false positives and false detections. These adverse conditions, which initially motivated this research, occur when a robotic platform navigates in an urban environment, and although the scope is originally within the robotics field, the authors believe that our contributions can be extended to other fields. To this end, we propose a multimodal information fusion consisting of laser and monocular camera information. Laser information is modelled using a set of weak classifiers (Adaboost) to detect people. Camera information is processed by using HOG descriptors to classify person/non person based on a linear SVM. A multi-hypothesis tracker trails the position and velocity of each of the targets, providing temporal information to the fusion, allowing recovery of detections even when the laser segmentation fails. Experimental results show that our feedback-based system outperforms previous state-of-the-art methods in performance and accuracy, and that near real-time detection performance can be achieved. ; Peer Reviewed
Multimodal feedback fusion of laser, image and temporal information
2014-01-01
Miscellaneous
Electronic Resource
English
DDC: | 629 |
Multimodal information fusion for urban scene understanding
British Library Online Contents | 2016
|Multimedia event detection with multimodal feature fusion and temporal concept localization
British Library Online Contents | 2014
|Deep spatio-temporal feature fusion with compact bilinear pooling for multimodal emotion recognition
British Library Online Contents | 2018
|Multimodal Medical Image Fusion Using the Sugeno Fuzzy Inference System
Springer Verlag | 2023
|