A sudden roadblock on highways due to many reasons such as road maintenance, accidents, and car repair is a common situation we encounter almost daily. Autonomous Vehicles (AVs) equipped with sensors that can acquire vehicle dynamics such as speed, acceleration, and location can make intelligent decisions to change lanes before reaching a roadblock. A number of literature studies have examined car-following models and lane-changing models. However, only a few studies proposed an integrated car-following and lane-changing model, which has the potential to model practical driving maneuvers. Hence, in this paper, we present an integrated car-following and lane-changing decision-control system based on Deep Reinforcement Learning (DRL) to address this issue. Specifically, we consider a scenario where sudden construction work will be carried out along a highway. We model the scenario as a Markov Decision Process (MDP) and employ the well-known DQN algorithm to train the RL agent to make the appropriate decision accordingly (i.e., either stay in the same lane or change lanes). To overcome the delay and computational requirement of DRL algorithms, we adopt an MEC-assisted architecture where the RL agents are trained on MEC servers. We utilize the highly reputable SUMO simulator and OPENAI GYM to evaluate the performance of the proposed model under two policies; {\epsilon}-greedy policy and Boltzmann policy. The results unequivocally demonstrate that the DQN agent trained using the {\epsilon}-greedy policy significantly outperforms the one trained with the Boltzmann policy.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques


    Beteiligte:
    Figetakis, Emanuel (Autor:in) / Bello, Yahuza (Autor:in) / Refaey, Ahmed (Autor:in) / Lei, Lei (Autor:in) / Moussa, Medhat (Autor:in)

    Erscheinungsdatum :

    2023


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization

    Garg, Deepeka / Chli, Maria / Vogiatzis, George | IEEE | 2019


    Adaptive Optimization of Traffic Signal Timing via Deep Reinforcement Learning

    Zibo Ma / Tongchao Cui / Wenxing Deng et al. | DOAJ | 2021

    Freier Zugriff

    Adaptive Traffic Control Using Deep Reinforcement Learning

    N, Dhashyanth / R, Hemchand / R, Priyanga et al. | IEEE | 2024


    Deep reinforcement learning traffic light control method

    KONG YAN / LI YING / CHIH-CHAO YANG | Europäisches Patentamt | 2024

    Freier Zugriff

    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023