The imbalance of vehicle supply and demand is a common phenomenon that influences the efficiency of online ride-hailing systems greatly. To address this problem, a three-level hierarchical mixed deep reinforcement learning method (HMDRL) is proposed to reposition idle vehicles. A manager operates at the top level, where action-abstraction is conducted from the time dimension and is adaptive for spatially scalable and time-varying systems. Coordinators locate at the middle level and a parallel coordination mechanism that is independent of the decision order is designed to improve the efficiency of the repositioning. The bottom level is composed of executive workers to reposition vehicles with mixed states and the states contain spatiotemporal information of agents’ neighbor areas. Two reward functions are designed for the manager and the coordinators, respectively, aiming to improve the training effect by avoiding sparse rewards. A simulator based on real orders is designed and HMDRL is compared with six methods. Experimental results demonstrate that HMDRL outperforms all the other methods. In three comparison experiments, the order response rate is increased by 0.62% to 8.29%, 1.5% to 7.78%, 1.18% to 4.75%, respectively.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand


    Beteiligte:
    Xi, Jinhao (Autor:in) / Zhu, Fenghua (Autor:in) / Ye, Peijun (Autor:in) / Lv, Yisheng (Autor:in) / Tang, Haina (Autor:in) / Wang, Fei-Yue (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-11-01


    Format / Umfang :

    3185372 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | Springer Verlag | 2022


    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | TIBKAT | 2023


    Multiagent Reinforcement Learning-Based Taxi Predispatching Model to Balance Taxi Supply and Demand

    Yongjian Yang / Xintao Wang / Yuanbo Xu et al. | DOAJ | 2020

    Freier Zugriff

    Multi-target man-vehicle sharing control method based on hierarchical deep reinforcement learning

    CHEN HUIQIN / TANG YUNHAN / ZHU JIAQI et al. | Europäisches Patentamt | 2024

    Freier Zugriff