Pedestrian crossing prediction is one of the significant components in the decision-making in the autonomous driving system. And the accuracy of its prediction is to decide whether the autonomous vehicle can forecast the future location of pedestrians, so as to avoid hitting. However, RGB data is easily affected by the environment. When the illumination is insufficient, it is difficult to extract obvious pedestrian features to judge whether the pedestrian has the intention to cross, while we know far-infrared image is robust to the imaging illumination conditions. Therefore, we introduce pseudo-far-infrared data generated by a pre-trained CycleGAN model as a supplement to form a cross-spectral pedestrian crossing prediction framework. And according to the local context features of pedestrians and pedestrian motion information in RGB and pseudo-far-infrared for pedestrian crossing prediction. In order to validate the usefulness of our method, In order to verify the prediction performance of our method, we carried out comparative experiments on two public driving datasets JAAD and PIE. According to the detailed analysis of the experimental results, it can be considered that our proposed method has a promoting effect on pedestrian crossing prediction.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pedestrian Crossing Prediction Based on Invariant Feature Extraction of Cross-Spectral Images


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Fu, Wenxing (editor) / Gu, Mancang (editor) / Niu, Yifeng (editor) / Wang, Fan (author) / Bai, Jie (author) / Fang, Jianwu (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2022 ; Xi'an, China September 23, 2022 - September 25, 2022



    Publication date :

    2023-03-10


    Size :

    11 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    PEDESTRIAN CROSSING PREDICTION METHOD AND PEDESTRIAN CROSSING PREDICTION DEVICE

    FANG FANG / TSUCHIYA CHIKAO / TAKEI SHOICHI et al. | European Patent Office | 2023

    Free access

    Pedestrian crossing decision prediction based on behavioral feature using deep learning

    Sidharta, Hanugra Aulia / Yuniamo, Eko Mulyanto / Kindhi, Berlian Al et al. | IEEE | 2021



    Pedestrian crossing prediction using multiple context-based models

    Bonnin, Sarah / Weisswange, Thomas H. / Kummert, Franz et al. | IEEE | 2014


    Pedestrian Crossing Characteristics Based on Pedestrian Priority

    Yang, Weidan / Zhang, Shengrui / Wang, Rui | ASCE | 2020