Battery swapping stations (BSS) have recently grabbed the attention of transportation firms as a viable method for accelerating the deployment of electric vehicles. However, most existing literature considered model-based approaches lacking dynamicity to optimize their swapping systems. To address this problem, this paper introduces a model-free optimal dynamic operations framework for BSS using novel deep reinforcement learning (DRL) approaches. The main goal is to minimize the BSS’s running costs by controlling the charging/discharging and swapping actions. First, the system is formulated as a Markov decision process. Then, two DRL approaches, the double buffer deep deterministic policy gradient (DB-DDPG) and twin delayed DDPG (TD3), are utilized to achieve optimal control of the BSS operations. Unlike existing methods, the charging characteristics, the swapping time, and the battery degradation are considered in the proposed framework to obtain realistic results. The proposed approach is model-free and can adaptively learn an optimal policy. Hence, it is more robust to uncertainties than existing model-based methods that require previous knowledge of the uncertainty distribution. Simulation results considering real-world data verify the effectiveness of the proposed solution and show that the proposed DRL approaches outperform the classical DDPG method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Model-Free Dynamic Operations Management for EV Battery Swapping Stations: A Deep Reinforcement Learning Approach




    Publication date :

    2023-08-01


    Size :

    3374897 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    INTEGRATED RELAY PLATFORM OF BATTERY SWAPPING STATIONS

    JANG KWAN SOON / KIM HYUN JIN / KIM YOUNG JUN | European Patent Office | 2024

    Free access


    Planning Battery Swapping Stations for Urban Electrical Taxis

    Wang, Yang / Huang, Liusheng / Wei, Hao et al. | IEEE | 2015


    Deployment optimization of battery swapping stations accounting for taxis’ dynamic energy demand

    Zhang, Tian-yu / Yao, En-jian / Yang, Yang et al. | Elsevier | 2023


    Battery swapping platform, battery swapping station and battery swapping method

    LI YONGJIE / ZHANG NING / CAO JIA et al. | European Patent Office | 2020

    Free access