Today’s automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in heterogeneous environments. Based on cooperative modeling of other agents and Decoupled-UCT (a variant of MCTS), the algorithm evaluates the state-action-values of each agent in a cooperative and decentralized manner, explicitly modeling the interdependence of actions between traffic participants. Macro-actions allow for temporal extension over multiple time steps and increase the effective search depth requiring fewer iterations to plan over longer horizons. Without predefined policies for macro-actions, the algorithm simultaneously learns policies over and within macro-actions. The proposed method is evaluated under several conflict scenarios, showing that the algorithm can achieve effective cooperative planning with learned macro-actions in heterogeneous environments.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Decentralized Cooperative Planning for Automated Vehicles with Hierarchical Monte Carlo Tree Search


    Beteiligte:
    Kurzer, Karl (Autor:in) / Zhou, Chenyang (Autor:in) / Marius Zollner, J. (Autor:in)


    Erscheinungsdatum :

    2018-06-01


    Format / Umfang :

    2581496 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Decentralized Cooperative Planning for Automated Vehicles with Continuous Monte Carlo Tree Search

    Kurzer, Karl / Engelhorn, Florian / Zollner, J. Marius | IEEE | 2018




    Monte Carlo Tree Search With Reinforcement Learning for Motion Planning

    Weingertner, Philippe / Ho, Minnie / Timofeev, Andrey et al. | IEEE | 2020