Network fusion has been recently explored as an approach for improving pedestrian detection performance. However, most existing fusion methods suffer from runtime efficiency, modularity, scalability, and maintainability due to the complex structure of the entire fused models, their end-to-end training requirements, and sequential fusion process. Addressing these challenges, this paper proposes a novel fusion framework that combines asymmetric inferences from object detectors and semantic segmentation networks for jointly detecting multiple pedestrians. This is achieved by introducing a consensus-based scoring method that fuses pair-wise pixel-relevant information from the object detector and the semantic segmentation network to boost the final confidence scores. The parallel implementation of the object detection and semantic segmentation networks in the proposed framework entails a low runtime overhead. The efficiency and robustness of the proposed fusion framework are extensively evaluated by fusing different state-of-the-art pedestrian detectors and semantic segmentation networks on a public dataset. The generalization of fused models is also examined on new cross pedestrian data collected through an autonomous car. Results show that the proposed fusion method significantly improves detection performance while achieving competitive runtime efficiency.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Pedestrian Detection for Autonomous Cars: Inference Fusion of Deep Neural Networks



    Erschienen in:

    Erscheinungsdatum :

    01.12.2022


    Format / Umfang :

    1504057 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Pedestrian detection based on deep convolutional neural network with ensemble inference network

    Fukui, Hiroshi / Yamashita, Takayoshi / Yamauchi, Yuji et al. | IEEE | 2015


    Self-Driving Cars Perception Pedestrian Detection

    Ihssane, Bouasria / Walid, Jebrane / Nabil, El Akchioui | Springer Verlag | 2024


    Autonomous pedestrian detection

    Nkosi, M P / Hancke, G P / dos Santos, R M A | IEEE | 2015



    Revisiting the evaluation of deep neural networks for pedestrian detection

    Feifel, Patrick / Franke, Benedikt / Raulf, Arne et al. | TIBKAT | 2022

    Freier Zugriff