A method is provided for avoiding a conflict during a flight of an aircraft that includes a defined route of travel. The method includes receiving observations of states of the aircraft and a nearby obstacle in an environment of the aircraft as the aircraft travels the defined route. The method includes applying the states to a reinforcement learning framework to predict states of the aircraft to avoid a conflict between the aircraft and the nearby obstacle. The reinforcement learning framework determines maneuvers of the aircraft to avoid the conflict, using a policy trained using a surrogate model of the environment in which movements of the aircraft and the nearby obstacle are simulated, and determines the predicted states of the aircraft from the maneuvers. A collision avoidance trajectory is generated from the predicted states of the aircraft, and output for guidance, navigation or control of the aircraft.
REINFORCEMENT LEARNING-BASED MID-AIR COLLISION AVOIDANCE
2023-08-03
Patent
Electronic Resource
English
IPC: | G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
Pedestrian Collision Avoidance Using Deep Reinforcement Learning
Springer Verlag | 2022
|ICAS2014_0892: A REINFORCEMENT LEARNING BASED UAVS AIR COLLISION AVOIDANCE
British Library Conference Proceedings | 2014
|A Deep Reinforcement Learning Approach to Collision Avoidance
TIBKAT | 2022
|