Abstract Reinforcement learning (RL) techniques have been studied for solving the demand and capacity balancing (DCB) problem in air traffic management to exploit their full computational potential. Due to the lack of generalisation and the seemingly reduced optimisation performance affected by the training scenarios, it is challenging for existing RL-based DCB methods to be effectively applied in practice. This paper proposes a general multi-agent reinforcement learning (MARL) method that integrates a heuristic-based delay priority strategy to improve the efficiency of the solution and the generalisation of the model. The delay priority strategy is used to reduce the potential learning task and thus training difficulty. This study explores what features of the delay priority strategy are better suited to the MARL method. A long short-term memory (LSTM) network is integrated into a deep q-learning network (DQN) to ensure the model compatible with arbitrary DCB instances and to facilitate agents to identify key sectors. This study is conducted as a part of a large-scale European DCB research project, where real data from French and Spanish airspace are used for experimentation. Results suggest that the proposed method has advantages in generalisation, optimisation performance and computational performance over state-of-the-art RL-based DCB methods.

    Highlights A long short-term memory network improves the proposed method’s generalisation. A heuristic-based delay priority strategy is incorporated to reduce the agent’s learning difficulty. The experiments are based on real data from French and Spanish airspace.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    General multi-agent reinforcement learning integrating heuristic-based delay priority strategy for demand and capacity balancing


    Beteiligte:
    Chen, Yutong (Autor:in) / Xu, Yan (Autor:in) / Hu, Minghua (Autor:in)


    Erscheinungsdatum :

    2023-06-12




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Demand and Capacity Balancing Technology Based on Multi-agent Reinforcement Learning

    Chen, Yutong / Xu, Yan / Hu, Minghua et al. | IEEE | 2021



    Traffic signal priority control based on shared experience multi‐agent deep reinforcement learning

    Wang, Zhiwen / Yang, Kangkang / Li, Long et al. | Wiley | 2023

    Freier Zugriff

    Traffic signal priority control based on shared experience multi‐agent deep reinforcement learning

    Zhiwen Wang / Kangkang Yang / Long Li et al. | DOAJ | 2023

    Freier Zugriff

    Multi-Agent Reinforcement Learning for Autonomous On Demand Vehicles

    Boyali, Ali / Hashimoto, Naohisa / John, Vijay et al. | IEEE | 2019