Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of information such as pedestrian appearance, states of other road users, the environment layout, etc. To address this problem, we propose a novel multi-modal prediction algorithm that incorporates different sources of information captured from the environment to predict future crossing actions of pedestrians. The proposed model benefits from a hybrid learning architecture consisting of feedforward and recurrent networks for analyzing visual features of the environment and dynamics of the scene. Using the existing 2D pedestrian behavior benchmarks and a 3D driving dataset, we show that our proposed model achieves state-of-the-art performance in pedestrian crossing prediction


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Modal Hybrid Architecture for Pedestrian Action Prediction


    Contributors:
    Rasouli, Amir (author) / Yau, Tiffany (author) / Rohani, Mohsen (author) / Luo, Jun (author)


    Publication date :

    2022-06-05


    Size :

    1456447 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    PEDESTRIAN ACTION PREDICTION DEVICE AND PEDESTRIAN ACTION PREDICTION METHOD

    KINDO TOSHIKI / OGAWA MASAHIRO / FUNAYAMA RYUJI | European Patent Office | 2018

    Free access




    Contrasting Disentangled Partial Observations for Pedestrian Action Prediction

    Feng, Yan / Carballo, Alexander / Niu, Yingjie et al. | IEEE | 2024