It is still a challenging topic to make reactive driving behaviors in complex urban environments as road users' intentions are unknown. Model-based reinforcement learning (MBRL) offers great potential to learn a reactive policy by constructing a world model that can provide informative states and imagination training. However, a critical limitation in relevant research lies in the scene-level reconstruction representation learning, which may overlook key interactive vehicles and hardly model the interactive features among vehicles and their long-term intentions. Therefore, this paper presents a novel MBRL method with a predictive individual world model (PIWM) for autonomous driving. PIWM describes the driving environment from an individual-level perspective and captures vehicles' interactive relations and their intentions via trajectory prediction task. Meanwhile, a behavior policy is learned jointly with PIWM. It is trained in PIWM's imagination and effectively navigates in the urban driving scenes leveraging intention-aware latent states. The proposed method is trained and evaluated on simulation environments built upon real-world challenging interactive scenarios. Compared with popular model-free and state-of-the-art model-based reinforcement learning methods, experimental results show that the proposed method achieves the best performance in terms of safety and efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Dream to Drive With Predictive Individual World Model


    Contributors:
    Gao, Yinfeng (author) / Zhang, Qichao (author) / Ding, Da-Wei (author) / Zhao, Dongbin (author)

    Published in:

    Publication date :

    2024-12-01


    Size :

    5632416 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Supercars dream drive

    StAntoine,A. / Audi,Ingolstadt,DE / Porsche,Stuttgart,DE et al. | Automotive engineering | 2010



    1001 dream cars you must drive before you die

    Heptinstall, Simon ;Mason, Nick | SLUB | 2012


    Australian Formula SAE teams drive the dream in Detroit

    British Library Online Contents | 2004


    Dream to Drive: Learning Conditional Driving Policies in Imagination

    Joseph, Tim / Fechner, Marcus / Abouelazm, Ahmed et al. | IEEE | 2024