Abstract The past decade has witnessed a significant growth of electric vehicles (EVs) deployment in public and private transportation sectors. Dynamic electric vehicle routing aims to plan the routes of EVs to serve dynamically generated customers’ requests while ensuring the battery level by visiting the recharge stations. This paper studies the dynamic electric vehicle routing problem with simultaneous pick-up and delivery and soft time windows (DEVRP-STW). We design a graph-based spatio-temporal multi-agent reinforcement learning (GMIX) framework consisting of a spatio-temporal graph attention network (ST-GAT) and a value decomposition-based multi-agent reinforcement learning algorithm (Graph-QMIX). Graph-QMIX derives a multi-agent soft policy gradient based on QMIX and Soft Actor–Critic and utilises a graph-based mixing network proposed to enhance the interaction of agents. Extensive experiments including a case study using real-world taxi data from New York City and a simulation study are conducted. The proposed GMIX outperforms the baseline algorithms on the request–response ratio (RRO), the average travelling distance per completed request (ATR), the out of energy ratio (OER) and the average waiting time per completed request (AWR).

    Highlights This paper studies the dynamic electric vehicle routing problem with simultaneous pick-up and delivery and soft time windows (DEVRP-STW). We design a graph-based spatio-temporal multi-agent reinforcement learning (GMIX) framework consisting of a spatio-temporal graph attention network (ST-GAT) and a value decomposition-based multi-agent reinforcement learning algorithm (Graph-QMIX). The proposed GMIX outperforms the baseline algorithms on the request–response ratio (RRO), the average travelling distance per completed request (ATR), the out-of-energy ratio (OER) and the average waiting time per completed request (AWR).


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    GMIX: Graph-based spatial–temporal multi-agent reinforcement learning for dynamic electric vehicle dispatching system


    Beteiligte:
    Zhou, Tao (Autor:in) / Kris, M.Y. Law (Autor:in) / Creighton, Douglas (Autor:in) / Wu, Changzhi (Autor:in)


    Erscheinungsdatum :

    2022-09-12




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    MULTI-AGENT REINFORCEMENT LEARNING FOR ORDER-DISPATCHING VIA ORDER-VEHICLE DISTRIBUTION MATCHING

    WANG CHENXI / QIN ZHIWEI | Europäisches Patentamt | 2020

    Freier Zugriff

    MULTI-AGENT REINFORCEMENT LEARNING FOR ORDER-DISPATCHING VIA ORDER-VEHICLE DISTRIBUTION MATCHING

    WANG CHENXI / QIN ZHIWEI | Europäisches Patentamt | 2020

    Freier Zugriff

    Multi-agent reinforcement learning for order-dispatching via order-vehicle distribution matching

    WANG CHENXI / QIN ZHIWEI | Europäisches Patentamt | 2023

    Freier Zugriff

    Dynamic Dispatching Control Model Based on Multi-Agent System

    He, Zengzhen / Zhang, Qisen / Xu, Yang | ASCE | 2009


    Dynamic Dispatching Control Model Based on Multi-Agent System

    He, Z. / Zhang, Q. / Xu, Y. et al. | British Library Conference Proceedings | 2009