Teams of autonomous unmanned aircraft can be used to monitor wildfires, enabling firefighters to make informed decisions. However, controlling multiple autonomous fixed-wing aircraft to maximize forest fire coverage is a complex problem. The state space is high dimensional, the fire propagates stochastically, the sensor information is imperfect, and the aircraft must coordinate with each other to accomplish their mission. This work presents two deep reinforcement learning approaches for training decentralized controllers that accommodate the high dimensionality and uncertainty inherent in the problem. The first approach controls the aircraft using immediate observations of the individual aircraft. The second approach allows aircraft to collaborate on a map of the wildfire's state and maintain a time history of locations visited, which are used as inputs to the controller. Simulation results show that both approaches allow the aircraft to accurately track wildfire expansions and outperform an online receding horizon controller. Additional simulations demonstrate that the approach scales with different numbers of aircraft and generalizes to different wildfire shapes.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Distributed Wildfire Surveillance with Autonomous Aircraft using Deep Reinforcement Learning


    Beteiligte:

    Erscheinungsdatum :

    2018


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Autonomous Distributed Wildfire Surveillance using Deep Reinforcement Learning

    Julian, Kyle D. / Kochenderfer, Mykel J. | AIAA | 2018


    Autonomous Distributed Wildfire Surveillance using Deep Reinforcement Learning (AIAA 2018-1589)

    Julian, Kyle D. / Kochenderfer, Mykel J. | British Library Conference Proceedings | 2018


    Image-based Guidance of Autonomous Aircraft for Wildfire Surveillance and Prediction

    Julian, Kyle D. / Kochenderfer, Mykel J. | ArXiv | 2018

    Freier Zugriff