This paper studies the traffic monitoring problem in a road network using a team of aerial robots. The problem is challenging due to two main reasons. First, the traffic events are stochastic, both temporally and spatially. Second, the problem has a non-homogeneous structure as the traffic events arrive at different locations of the road network at different rates. Accordingly, some locations require more visits by the robots compared to other locations. To address these issues, we define an uncertainty metric for each location of the road network and formulate a path planning problem for the aerial robots to minimize the network's average uncertainty. We express this problem as a partially observable Markov decision process (POMDP) and propose a distributed and scalable algorithm based on deep reinforcement learning to solve it. We consider two different scenarios depending on the communication mode between the agents (aerial robots) and the traffic management center (TMC). The first scenario assumes that the agents continuously communicate with the TMC to send/receive realtime information about the traffic events. Hence, the agents have global and real-time knowledge of the environment. However, in the second scenario, we consider a challenging setting where the observation of the aerial robots is partial and limited to their sensing ranges. Moreover, in contrast to the first scenario, the information exchange between the aerial robots and the TMC is restricted to specific time instances. We evaluate the performance of our proposed algorithm in both scenarios for a real road network topology and demonstrate its functionality in a traffic monitoring system.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Distributed Deep Reinforcement Learning for Intelligent Traffic Monitoring with a Team of Aerial Robots


    Contributors:


    Publication date :

    2021-09-19


    Size :

    1450212 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Motion Control in Multi-Rotor Aerial Robots Using Deep Reinforcement Learning

    Shetty, Gaurav / Ramezani, Mahya / Habibi, Hamed et al. | IEEE | 2025


    Intelligent Traffic Light via Policy-based Deep Reinforcement Learning

    Zhu, Yue / Cai, Mingyu / Schwarz, Chris W. et al. | Springer Verlag | 2022



    Intercepting Unauthorized Aerial Robots in Controlled Airspace Using Reinforcement Learning

    Giral, Francisco / Gómez, Ignacio / Clainche, Soledad Le | ArXiv | 2024

    Free access