In the present paper, we propose a highly accurate and robust people detector, which works well under highly variant and uncertain conditions, such as occlusions, false positives and false detections. These adverse conditions, which initially motivated this research, occur when a robotic platform navigates in an urban environment, and although the scope is originally within the robotics field, the authors believe that our contributions can be extended to other fields. To this end, we propose a multimodal information fusion consisting of laser and monocular camera information. Laser information is modelled using a set of weak classifiers (Adaboost) to detect people. Camera information is processed by using HOG descriptors to classify person/non person based on a linear SVM. A multi-hypothesis tracker trails the position and velocity of each of the targets, providing temporal information to the fusion, allowing recovery of detections even when the laser segmentation fails. Experimental results show that our feedback-based system outperforms previous state-of-the-art methods in performance and accuracy, and that near real-time detection performance can be achieved. ; Peer Reviewed


    Access

    Download


    Export, share and cite



    Multimodal information fusion for urban scene understanding

    Xu, P. | British Library Online Contents | 2016




    Deep spatio-temporal feature fusion with compact bilinear pooling for multimodal emotion recognition

    Nguyen, Dung / Nguyen, Kien / Sridharan, Sridha et al. | British Library Online Contents | 2018


    Multimodal Medical Image Fusion Using the Sugeno Fuzzy Inference System

    Tirupal, T. / Shanavaj, K. / Venusri, M. et al. | Springer Verlag | 2023