A wide variety of approaches have been proposed for pedestrian detection in the last decay and it still remains an open challenge due to its outstanding importance in the field of automotive. In recent years, deep learning classification methods, in particular convolutional neural networks, combined with multi-modality images applied on different fusion schemes have achieved great performances in computer vision tasks. For the pedestrian recognition task, the late-fusion scheme outperforms the early and intermediate integration of modalities. In this paper, we focus on improving and optimizing the late-fusion scheme for pedestrian classification on the Daimler stereo vision data set. We propose different training methods based on Cross-Modality deep learning of Convolutional Neural Networks (CNNs): (1) a correlated model, (2) an incremental model and, (3) a particular cross-modality model, where each CNN is trained on one modality, but tested on a different one. The experiments show that the incremental cross-modality deep learning of CNNs achieves the best performances. It improves the classification performances not only for each modality classifier, but also for the multi-modality late-fusion scheme. The particular cross-modality model is a promising idea for automated annotation of modality images with a classifier trained on a different modality and/or for cross-dataset training.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pedestrian recognition through different cross-modality deep learning methods




    Publication date :

    2017-06-01


    Size :

    622357 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Incremental Cross-Modality Deep Learning for Pedestrian Recognition

    Pop, Danut Ovidiu / Rogozan, Alexandria / Nashashibi, Fawzi et al. | British Library Conference Proceedings | 2017


    Incremental Cross-Modality deep learning for pedestrian recognition

    Pop, Danut Ovidiu / Rogozan, Alexandrina / Nashashibi, Fawzi et al. | IEEE | 2017


    Pedestrian Recognition by Using a Dynamic Modality Selection Approach

    Rus, Adela-Maria / Rogozan, Alexandrina / Diosan, Laura et al. | IEEE | 2015


    On-Board Pedestrian and Cyclist Recognition Using Deep Learning Methods

    Chen, Wenqiang / Xiong, Hui / Li, Keqiang et al. | ASCE | 2018


    METHOD APPARATUS AND PROGRAM FOR PEDESTRIAN FACIAL RECOGNITION THROUGH DEEP LEARNING VIDEO ANALYSIS

    KIM SIKYUNG / YOO DOOHWAN / YOU YEONG JAE | European Patent Office | 2024

    Free access