Smooth handling of pedestrian interactions is a key requirement for Autonomous Vehicles (AV) and Advanced Driver Assistance Systems (ADAS). Such systems call for early and accurate prediction of a pedestrian’s crossing/not-crossing behaviour in front of the vehicle. Existing approaches to pedestrian behaviour prediction make use of pedestrian motion, his/her location in a scene and static context variables such as traffic lights, zebra crossings etc. We stress on the necessity of early prediction for smooth operation of such systems. We introduce the influence of vehicle interactions on pedestrian intention for this purpose. In this paper, we show a discernible advance in prediction time aided by the inclusion of such vehicle interaction context. We apply our methods to two different datasets, one in-house collected - NTU dataset and another public real-life benchmark - JAAD dataset. We also propose a generalization of the Latent-Dynamic Conditional Random Fields (LDCRF), called Factored LDCRF (FLDCRF), for improved sequence prediction performance. FLDCRF outperforms Long Short-Term Memory (LSTM) networks across the datasets over identical time-series features. While the existing best system predicts pedestrian stopping behaviour with 70% accuracy 0.38 seconds before the actual events, our system achieves such accuracy at least 0.9 seconds on an average before the actual events across datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Context Model for Pedestrian Intention Prediction Using Factored Latent-Dynamic Conditional Random Fields


    Contributors:
    Neogi, Satyajit (author) / Hoy, Michael (author) / Dang, Kang (author) / Yu, Hang (author) / Dauwels, Justin (author)


    Publication date :

    2021-11-01


    Size :

    5223371 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Pedestrian intention recognition using Latent-dynamic Conditional Random Fields

    Schulz, Andreas Th. / Stiefelhagen, Rainer | IEEE | 2015


    Pedestrian Crossing Intention Prediction at Red-Light Using Pose Estimation

    Zhang, Shile / Abdel-Aty, Mohamed / Wu, Yina et al. | IEEE | 2022


    Vehicle Trajectory Prediction Using Intention-based Conditional Variational Autoencoder

    Feng, Xidong / Cen, Zhepeng / Hu, Jianming et al. | IEEE | 2019


    Curb reconstruction using Conditional Random Fields

    Siegemund, J / Pfeiffer, D / Franke, U et al. | IEEE | 2010