Flocking control is a significant problem in multi-agent systems such as multi-agent unmanned aerial vehicles and multi-agent autonomous underwater vehicles, which enhances the cooperativity and safety of agents. In contrast to traditional methods, multi-agent reinforcement learning (MARL) solves the problem of flocking control more flexibly. However, methods based on MARL suffer from sample inefficiency, since they require a huge number of experiences to be collected from interactions between agents and the environment. We propose a novel method Pretraining with Demonstrations for MARL (PwD-MARL), which can utilize non-expert demonstrations collected in advance with traditional methods to pretrain agents. During the process of pretraining, agents learn policies from demonstrations by MARL and behavior cloning simultaneously, and are prevented from overfitting demonstrations. By pretraining with non-expert demonstrations, PwD-MARL improves sample efficiency in the process of online MARL with a warm start. Experiments show that PwD-MARL improves sample efficiency and policy performance in the problem of flocking control, even with bad or few demonstrations.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Sample-Efficient Multi-Agent Reinforcement Learning with Demonstrations for Flocking Control


    Beteiligte:
    Qiu, Yunbo (Autor:in) / Zhan, Yuzhu (Autor:in) / Jin, Yue (Autor:in) / Wang, Jian (Autor:in) / Zhang, Xudong (Autor:in)


    Erscheinungsdatum :

    2022-09-01


    Format / Umfang :

    858192 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Relational reinforcement learning with guided demonstrations

    Martínez Martínez, David / Alenyà Ribas, Guillem / Torras, Carme | BASE | 2017

    Freier Zugriff

    V-MIN: Efficient reinforcement learning through demonstrations and relaxed reward demands

    Martínez, David / Alenyà, Guillem / Torras, Carme | BASE | 2015

    Freier Zugriff

    V-MIN: efficient reinforcement learning through demonstrations and relaxed reward demands

    Martínez Martínez, David / Alenyà Ribas, Guillem / Torras, Carme | BASE | 2015

    Freier Zugriff

    Low Speed Airship Control using Reinforcement Learning and Expert Demonstrations

    Daskiran, Onur / Huff, Brian / Dogan, Atilla | AIAA | 2017