A sudden roadblock on highways due to many reasons such as road maintenance, accidents, and car repair is a common situation we encounter almost daily. Autonomous Vehicles (AVs) equipped with sensors that can acquire vehicle dynamics such as speed, acceleration, and location can make intelligent decisions to change lanes before reaching a roadblock. A number of literature studies have examined car-following models and lane-changing models. However, only a few studies proposed an integrated car-following and lane-changing model, which has the potential to model practical driving maneuvers. Hence, in this paper, we present an integrated car-following and lane-changing decision-control system based on Deep Reinforcement Learning (DRL) to address this issue. Specifically, we consider a scenario where sudden construction work will be carried out along a highway. We model the scenario as a Markov Decision Process (MDP) and employ the well-known DQN algorithm to train the RL agent to make the appropriate decision accordingly (i.e., either stay in the same lane or change lanes). To overcome the delay and computational requirement of DRL algorithms, we adopt an MEC-assisted architecture where the RL agents are trained on MEC servers. We utilize the highly reputable SUMO simulator and OPENAI GYM to evaluate the performance of the proposed model under two policies; {\epsilon}-greedy policy and Boltzmann policy. The results unequivocally demonstrate that the DQN agent trained using the {\epsilon}-greedy policy significantly outperforms the one trained with the Boltzmann policy.


    Access

    Download


    Export, share and cite



    Title :

    Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques


    Contributors:

    Publication date :

    2023


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Adaptive Optimization of Traffic Signal Timing via Deep Reinforcement Learning

    Zibo Ma / Tongchao Cui / Wenxing Deng et al. | DOAJ | 2021

    Free access

    A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization

    Garg, Deepeka / Chli, Maria / Vogiatzis, George | IEEE | 2019


    Deep reinforcement learning traffic light control method

    KONG YAN / LI YING / CHIH-CHAO YANG | European Patent Office | 2024

    Free access

    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023


    Adaptive Traffic Control Using Deep Reinforcement Learning

    N, Dhashyanth / R, Hemchand / R, Priyanga et al. | IEEE | 2024