Collision-free path planning is a major challenge in managing unmanned aerial vehicles (UAVs) fleets, especially in uncertain environments. In this paper, we consider the design of UAV routing policies using multi-agent reinforcement learning, and propose a Multi-resolution, Multi-agent, Mean-field reinforcement learning algorithm, named 3M-RL, for flight planning, where multiple vehicles need to avoid collisions with each other while moving towards their destinations. In the system we consider, each UAV makes decisions based on local observations, and does not communicate with other UAVs. The algorithm trains a routing policy using an Actor-Critic neural network with multi-resolution observations, including detailed local information and aggregated global information based on mean-field. The algorithm tackles the curse-of-dimensionality problem in multi-agent reinforcement learning and provides a scalable solution. We test our algorithm in different complex scenarios in both 2D and 3D space and our simulation results show that 3M-RL result in good routing policies.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3M-RL: Multi-Resolution, Multi-Agent, Mean-Field Reinforcement Learning for Autonomous UAV Routing


    Contributors:


    Publication date :

    2022-07-01


    Size :

    2770297 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    DEEP REINFORCEMENT LEARNING FOR MULTI-AGENT AUTONOMOUS SATELLITE INSPECTION

    Lei, Henry H. / Shubert, Matt / Damron, Nathan et al. | Springer Verlag | 2024


    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Joris Dinneweth / Abderrahmane Boubezoul / René Mandiau et al. | DOAJ | 2022

    Free access

    Autonomous Separation Assurance with Deep Multi-Agent Reinforcement Learning

    Brittain, Marc W. / Yang, Xuxi / Wei, Peng | AIAA | 2021


    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Dinneweth, Joris / Boubezoul, Abderrahmane / Mandiau, René et al. | Springer Verlag | 2022

    Free access