The imbalance of vehicle supply and demand is a common phenomenon that influences the efficiency of online ride-hailing systems greatly. To address this problem, a three-level hierarchical mixed deep reinforcement learning method (HMDRL) is proposed to reposition idle vehicles. A manager operates at the top level, where action-abstraction is conducted from the time dimension and is adaptive for spatially scalable and time-varying systems. Coordinators locate at the middle level and a parallel coordination mechanism that is independent of the decision order is designed to improve the efficiency of the repositioning. The bottom level is composed of executive workers to reposition vehicles with mixed states and the states contain spatiotemporal information of agents’ neighbor areas. Two reward functions are designed for the manager and the coordinators, respectively, aiming to improve the training effect by avoiding sparse rewards. A simulator based on real orders is designed and HMDRL is compared with six methods. Experimental results demonstrate that HMDRL outperforms all the other methods. In three comparison experiments, the order response rate is increased by 0.62% to 8.29%, 1.5% to 7.78%, 1.18% to 4.75%, respectively.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand


    Contributors:
    Xi, Jinhao (author) / Zhu, Fenghua (author) / Ye, Peijun (author) / Lv, Yisheng (author) / Tang, Haina (author) / Wang, Fei-Yue (author)

    Published in:

    Publication date :

    2022-11-01


    Size :

    3185372 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Multiagent Reinforcement Learning-Based Taxi Predispatching Model to Balance Taxi Supply and Demand

    Yongjian Yang / Xintao Wang / Yuanbo Xu et al. | DOAJ | 2020

    Free access

    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | TIBKAT | 2023


    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | Springer Verlag | 2022


    i-Rebalance: Personalized Vehicle Repositioning for Supply Demand Balance

    Chen, Haoyang / Sun, Peiyan / Song, Qiyuan et al. | ArXiv | 2024

    Free access