With the continuous increase in flight flows, the flight conflict risk in the airspace has increased. Aiming at the problem of conflict resolution in actual operation, this paper proposes a tactical conflict resolution strategy based on Deep Reinforcement Learning. The process of the controllers resolving conflicts is modelled as the Markov Decision Process. The Deep Q Network algorithm trains the agent and obtains the resolution strategy. The agent uses the command of altitude adjustment, speed adjustment, or heading adjustment to resolve a conflict, and the design of the reward function fully considers the air traffic control regulations. Finally, simulation experiments were performed to verify the feasibility of the strategy given by the conflict resolution model, and the experimental results were statistically analyzed. The results show that the conflict resolution strategy based on Deep Reinforcement Learning closely reflected actual operations regarding flight safety and conflict resolution rules.


    Access

    Download


    Export, share and cite



    Title :

    Conflict resolution strategy based on deep reinforcement learning for air traffic management


    Contributors:
    Sui, Dong (author) / Ma, Chenyu (author) / Dong, Jintao (author)

    Publication date :

    2023-10-19


    Remarks:

    doi:10.3846/aviation.2023.19720
    Aviation; Vol 27 No 3 (2023); 177–186 ; 1822-4180 ; 1648-7788



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629





    Deep Reinforcement Learning for Air Traffic Conflict Resolution Under Traffic Uncertainties

    Mukherjee, Anurag / Guleria, Yash / Alam, Sameer | IEEE | 2022


    Deep reinforcement learning based conflict detection and resolution in air traffic control

    Wang, Zhuang / Li, Hui / Wang, Junfeng et al. | IET | 2019

    Free access

    Deep reinforcement learning based conflict detection and resolution in air traffic control

    Wang, Zhuang / Li, Hui / Wang, Junfeng et al. | Wiley | 2019

    Free access