Active traffic management with autonomous vehicles offers the potential for reduced congestion and improved traffic flow. However, developing effective algorithms for real-world scenarios requires overcoming challenges related to infinite-horizon traffic flow and partial observability. To address these issues and further decentralize traffic management, we propose an asymmetric actor-critic model that learns decentralized cooperative driving policies for autonomous vehicles using single-agent reinforcement learning. By employing attention neural networks with masking, our approach efficiently manages real-world traffic dynamics and partial observability, eliminating the need for predefined agents or agent-specific experience buffers in multi-agent reinforcement learning. Extensive evaluations across various traffic scenarios demonstrate our method's significant potential in improving traffic flow at critical bottleneck points. Moreover, we address the challenges posed by conservative autonomous vehicle driving behaviors that adhere strictly to traffic rules, showing that our cooperative policy effectively alleviates potential slowdowns without compromising safety.
Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving
2024
accepted by IROS 2024
Preprint
Electronic Resource
English
| European Patent Office | 2024
Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution
| DOAJ | 2023
Agent-Based Cooperative Decentralized Airplane-Collision Avoidance
| Online Contents | 2011
Agent-Based Cooperative Decentralized Airplane-Collision Avoidance
| Tema Archive | 2011