The imbalance of vehicle supply and demand is a common phenomenon that influences the efficiency of online ride-hailing systems greatly. To address this problem, a three-level hierarchical mixed deep reinforcement learning method (HMDRL) is proposed to reposition idle vehicles. A manager operates at the top level, where action-abstraction is conducted from the time dimension and is adaptive for spatially scalable and time-varying systems. Coordinators locate at the middle level and a parallel coordination mechanism that is independent of the decision order is designed to improve the efficiency of the repositioning. The bottom level is composed of executive workers to reposition vehicles with mixed states and the states contain spatiotemporal information of agents’ neighbor areas. Two reward functions are designed for the manager and the coordinators, respectively, aiming to improve the training effect by avoiding sparse rewards. A simulator based on real orders is designed and HMDRL is compared with six methods. Experimental results demonstrate that HMDRL outperforms all the other methods. In three comparison experiments, the order response rate is increased by 0.62% to 8.29%, 1.5% to 7.78%, 1.18% to 4.75%, respectively.
HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand
IEEE Transactions on Intelligent Transportation Systems ; 23 , 11 ; 21861-21872
2022-11-01
3185372 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Hierarchical Reinforcement Learning Under Mixed Observability
Springer Verlag | 2022
|Hierarchical Reinforcement Learning Under Mixed Observability
TIBKAT | 2023
|Multiagent Reinforcement Learning-Based Taxi Predispatching Model to Balance Taxi Supply and Demand
DOAJ | 2020
|Multi-target man-vehicle sharing control method based on hierarchical deep reinforcement learning
Europäisches Patentamt | 2024
|Supply Chain Synchronization Through Deep Reinforcement Learning
Springer Verlag | 2022
|