Operating autonomous vehicles safely and efficiently in crowded pedestrian environments is a challenging task, especially with partial observations. This is because autonomous vehicles cannot always determine the current state of the pedestrians and take optimal actions due to limitations of onboard sensors such as visual occlusion. Furthermore, scenarios involving partial observations are normally not included in training data for navigation models as it requires extra hybrid training for various partial observations scenarios. To address this challenge, we propose a novel method that incorporates a transformer-based human multi-modal trajectory prediction model into a deep reinforcement learning framework to determine the optimal driving strategy. Furthermore, we introduce a novel metric and use a subset of observations from an existing pedestrian dataset for the evaluation of crowd prediction and navigation methods under various partial observations scenarios. We also validate the robustness and efficiency of our proposed method through several experiments and compare to the state-of-the-art methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Crowd Prediction and Autonomous Navigation with Partial Observations


    Contributors:
    Li, Kunming (author) / Shan, Mao (author) / Worrall, Stewart (author) / Nebot, Eduardo (author)


    Publication date :

    2022-10-08


    Size :

    1642012 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Autonomous Robot Navigation in Crowd

    de Almeida Afonso, Paulo / Ferreira, Paulo Roberto | IEEE | 2022



    Crowd sourcing data for autonomous vehicle navigation

    SHASHUA AMNON / GDALYAHU YORAM / SPRINGER OFER et al. | European Patent Office | 2023

    Free access

    Crowd sourcing data for autonomous vehicle navigation

    SHASHUA AMNON / GDALYAHU YORAM / SPRINGER OFER et al. | European Patent Office | 2022

    Free access

    Crowd sourcing data for autonomous vehicle navigation

    SHASHUA AMNON / GDALYAHU YORAM / SPRINGER OFER et al. | European Patent Office | 2023

    Free access