It is still a challenging topic to make reactive driving behaviors in complex urban environments as road users' intentions are unknown. Model-based reinforcement learning (MBRL) offers great potential to learn a reactive policy by constructing a world model that can provide informative states and imagination training. However, a critical limitation in relevant research lies in the scene-level reconstruction representation learning, which may overlook key interactive vehicles and hardly model the interactive features among vehicles and their long-term intentions. Therefore, this paper presents a novel MBRL method with a predictive individual world model (PIWM) for autonomous driving. PIWM describes the driving environment from an individual-level perspective and captures vehicles' interactive relations and their intentions via trajectory prediction task. Meanwhile, a behavior policy is learned jointly with PIWM. It is trained in PIWM's imagination and effectively navigates in the urban driving scenes leveraging intention-aware latent states. The proposed method is trained and evaluated on simulation environments built upon real-world challenging interactive scenarios. Compared with popular model-free and state-of-the-art model-based reinforcement learning methods, experimental results show that the proposed method achieves the best performance in terms of safety and efficiency.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Dream to Drive With Predictive Individual World Model


    Beteiligte:
    Gao, Yinfeng (Autor:in) / Zhang, Qichao (Autor:in) / Ding, Da-Wei (Autor:in) / Zhao, Dongbin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.12.2024


    Format / Umfang :

    5632416 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Supercars dream drive

    StAntoine,A. / Audi,Ingolstadt,DE / Porsche,Stuttgart,DE et al. | Kraftfahrwesen | 2010



    1001 dream cars you must drive before you die

    Heptinstall, Simon ;Mason, Nick | SLUB | 2012


    Australian Formula SAE teams drive the dream in Detroit

    British Library Online Contents | 2004


    Dream to Drive: Learning Conditional Driving Policies in Imagination

    Joseph, Tim / Fechner, Marcus / Abouelazm, Ahmed et al. | IEEE | 2024