Despite many years of research, pedestrian recognition is still a difficult, but very important task. It was proved that concatenating information from multi-modality images improves the recognition accuracy, but with a high computational cost. We present a modality selection approach, which is able to dynamically select the most discriminative modality for a given image and furthermore use it in the classification process. Firstly, we extract kernel descriptor features from a given image in three modalities: intensity, depth and flow. Secondly, we dynamically determine the most suitable modality for that image using both: a modality pertinence classifier and a decision confidence indicator. Thirdly, we classify the image in the selected modality using a linear SVM approach. Numerical experiments are performed on the Daimler benchmark dataset consisting of pedestrian and non-pedestrian bounding boxes captured in outdoor urban environments and indicate that our model outperforms all the individual-modality classifiers and the model based on a posterior fusion of multi-modality decisions. Moreover, the proposed selection model is a promising and less computational expensive alternative to the concatenation of multi-modality features prior to classification.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pedestrian Recognition by Using a Dynamic Modality Selection Approach


    Contributors:


    Publication date :

    2015-09-01


    Size :

    225389 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Incremental Cross-Modality deep learning for pedestrian recognition

    Pop, Danut Ovidiu / Rogozan, Alexandrina / Nashashibi, Fawzi et al. | IEEE | 2017


    Incremental Cross-Modality Deep Learning for Pedestrian Recognition

    Pop, Danut Ovidiu / Rogozan, Alexandria / Nashashibi, Fawzi et al. | British Library Conference Proceedings | 2017


    Pedestrian recognition through different cross-modality deep learning methods

    Pop, Danut Ovidiu / Rogozan, Alexandrina / Nashashibi, Fawzi et al. | IEEE | 2017



    Pedestrian intention recognition using Latent-dynamic Conditional Random Fields

    Schulz, Andreas Th. / Stiefelhagen, Rainer | IEEE | 2015