Abstract Reinforcement learning (RL) techniques have been studied for solving the demand and capacity balancing (DCB) problem in air traffic management to exploit their full computational potential. Due to the lack of generalisation and the seemingly reduced optimisation performance affected by the training scenarios, it is challenging for existing RL-based DCB methods to be effectively applied in practice. This paper proposes a general multi-agent reinforcement learning (MARL) method that integrates a heuristic-based delay priority strategy to improve the efficiency of the solution and the generalisation of the model. The delay priority strategy is used to reduce the potential learning task and thus training difficulty. This study explores what features of the delay priority strategy are better suited to the MARL method. A long short-term memory (LSTM) network is integrated into a deep q-learning network (DQN) to ensure the model compatible with arbitrary DCB instances and to facilitate agents to identify key sectors. This study is conducted as a part of a large-scale European DCB research project, where real data from French and Spanish airspace are used for experimentation. Results suggest that the proposed method has advantages in generalisation, optimisation performance and computational performance over state-of-the-art RL-based DCB methods.
Highlights A long short-term memory network improves the proposed method’s generalisation. A heuristic-based delay priority strategy is incorporated to reduce the agent’s learning difficulty. The experiments are based on real data from French and Spanish airspace.
General multi-agent reinforcement learning integrating heuristic-based delay priority strategy for demand and capacity balancing
2023-06-12
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Traffic signal priority control based on shared experience multi‐agent deep reinforcement learning
Wiley | 2023
|Traffic signal priority control based on shared experience multi‐agent deep reinforcement learning
DOAJ | 2023
|