Network fusion has been recently explored as an approach for improving pedestrian detection performance. However, most existing fusion methods suffer from runtime efficiency, modularity, scalability, and maintainability due to the complex structure of the entire fused models, their end-to-end training requirements, and sequential fusion process. Addressing these challenges, this paper proposes a novel fusion framework that combines asymmetric inferences from object detectors and semantic segmentation networks for jointly detecting multiple pedestrians. This is achieved by introducing a consensus-based scoring method that fuses pair-wise pixel-relevant information from the object detector and the semantic segmentation network to boost the final confidence scores. The parallel implementation of the object detection and semantic segmentation networks in the proposed framework entails a low runtime overhead. The efficiency and robustness of the proposed fusion framework are extensively evaluated by fusing different state-of-the-art pedestrian detectors and semantic segmentation networks on a public dataset. The generalization of fused models is also examined on new cross pedestrian data collected through an autonomous car. Results show that the proposed fusion method significantly improves detection performance while achieving competitive runtime efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pedestrian Detection for Autonomous Cars: Inference Fusion of Deep Neural Networks



    Published in:

    Publication date :

    2022-12-01


    Size :

    1504057 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Pedestrian detection based on deep convolutional neural network with ensemble inference network

    Fukui, Hiroshi / Yamashita, Takayoshi / Yamauchi, Yuji et al. | IEEE | 2015


    Self-Driving Cars Perception Pedestrian Detection

    Ihssane, Bouasria / Walid, Jebrane / Nabil, El Akchioui | Springer Verlag | 2024


    Autonomous pedestrian detection

    Nkosi, M P / Hancke, G P / dos Santos, R M A | IEEE | 2015



    Revisiting the evaluation of deep neural networks for pedestrian detection

    Feifel, Patrick / Franke, Benedikt / Raulf, Arne et al. | TIBKAT | 2022

    Free access