To effectively solve Demand and Capacity Balancing (DCB) in large-scale and high-density scenarios through the Ground Delay Program (GDP) in the pre-tactical stage, a sequential decision-making framework based on a time window is proposed. On this basis, the problem is transformed into Markov Decision Process (MDP) based on local observation, and then Multi-Agent Reinforcement Learning (MARL) method is adopted. Each flight is regarded as an independent agent to decide whether to implement GDP according to its local state observation. By designing the reward function in multiple combinations, a Mixed Competition and Cooperation (MCC) mode considering fairness is formed among agents. To improve the efficiency of MARL, we use the double Q-Learning Network (DQN), experience replay technology, adaptive ϵ-greedy strategy and Decentralized Training with Decentralized Execution (DTDE) framework. The experimental results show that the training process of the MARL method is convergent, efficient and stable. Compared with the Computer-Assisted Slot Allocation (CASA) method used in the actual operation, the number of flight delays and the average delay time is reduced by 33.7% and 36.7% respectively.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Demand and Capacity Balancing Technology Based on Multi-agent Reinforcement Learning


    Beteiligte:
    Chen, Yutong (Autor:in) / Xu, Yan (Autor:in) / Hu, Minghua (Autor:in) / Yang, Lei (Autor:in)


    Erscheinungsdatum :

    2021-10-03


    Format / Umfang :

    2106886 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Multi-Agent Reinforcement Learning for Autonomous On Demand Vehicles

    Boyali, Ali / Hashimoto, Naohisa / John, Vijay et al. | IEEE | 2019



    Multiagent Reinforcement Learning Methods for Resolving Demand - Capacity Imbalances

    Kravaris, Theocharis / Spatharis, Christos / Blekas, Konstantions et al. | IEEE | 2018