This paper introduces an open-source, decentralized framework named SigmaRL, designed to enhance both sample effciency and generalization of multi-agent Reinforcement Learning (RL) for motion planning of connected and automated vehicles. Most RL agents exhibit a limited capacity to generalize, often focusing narrowly on specific scenarios, and are usually evaluated in similar or even the same scenarios seen during training. Various methods have been proposed to address these challenges, including experience replay and regularization. However, how observation design in RL affects sample efficiency and generalization remains an under-explored area. We address this gap by proposing five strategies to design information-dense observations, focusing on general features that are applicable to most traffic scenarios. We train our RL agents using these strategies on an intersection and evaluate their generalization through numerical experiments across completely unseen traffic scenarios, including a new intersection, an on-ramp, and a roundabout. Incorporating these information-dense observations reduces training times to under one hour on a single CPU, and the evaluation results reveal that our RL agents can effectively zero-shot generalize.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SigmaRL: A Sample-Efficient and Generalizable Multi-Agent Reinforcement Learning Framework for Motion Planning


    Contributors:
    Xu, Jianye (author) / Hu, Pan (author) / Alrifaee, Bassam (author)


    Publication date :

    2024-09-24


    Size :

    571593 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Spacecraft cluster game hunting motion planning method based on multi-agent reinforcement learning

    CHEN GANG / CUI ZI'ANG / LIU YUQIANG et al. | European Patent Office | 2024

    Free access


    VISION-BASED SAMPLE-EFFICIENT REINFORCEMENT LEARNING FRAMEWORK FOR AUTONOMOUS DRIVING

    CHIANG SU-HUI / LIU MING-CHANG | European Patent Office | 2019

    Free access

    Multi-Agent Reinforcement Learning for Cooperative Vehicle Motion Control

    Ahmic, Kenan / Ultsch, Johannes / Brembeck, Jonathan et al. | IEEE | 2024