Today’s automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in heterogeneous environments. Based on cooperative modeling of other agents and Decoupled-UCT (a variant of MCTS), the algorithm evaluates the state-action-values of each agent in a cooperative and decentralized manner, explicitly modeling the interdependence of actions between traffic participants. Macro-actions allow for temporal extension over multiple time steps and increase the effective search depth requiring fewer iterations to plan over longer horizons. Without predefined policies for macro-actions, the algorithm simultaneously learns policies over and within macro-actions. The proposed method is evaluated under several conflict scenarios, showing that the algorithm can achieve effective cooperative planning with learned macro-actions in heterogeneous environments.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Decentralized Cooperative Planning for Automated Vehicles with Hierarchical Monte Carlo Tree Search


    Contributors:


    Publication date :

    2018-06-01


    Size :

    2581496 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Decentralized Cooperative Planning for Automated Vehicles with Continuous Monte Carlo Tree Search

    Kurzer, Karl / Engelhorn, Florian / Zollner, J. Marius | IEEE | 2018




    Monte Carlo Tree Search With Reinforcement Learning for Motion Planning

    Weingertner, Philippe / Ho, Minnie / Timofeev, Andrey et al. | IEEE | 2020