Abstract Dynamic pricing is a widely applied strategy by ride-hailing companies, such as Uber and Lyft, to match the trip demand with the availability of drivers. Deciding proper pricing policies is challenging and existing reinforcement learning (RL)-based solutions are restricted in solving small-scale problems. In this study, we contribute to RL-based approaches that can address the dynamic pricing problem in real-world-scale ride-hailing systems. We first characterize the dynamic pricing problem with a clear distinction between historical prices and current prices. We then translate our dynamic pricing problem into Markov Decision Process (MDP) and prove the existence of a deterministic stationary optimal policy. Our solutions are based on an off-policy reinforcement learning algorithm called twin-delayed deep determinant policy gradient (TD3) that performs offline learning of the optimal pricing policy using historical data and applies the learned policy to the next time slot, e.g., one week. We enhance TD3 by creating three mechanisms to reduce our model complexity and enhance training effectiveness. Extensive numerical experiments are conducted on both small grid networks (16 zones) and the NYC network (242 zones) to demonstrate the performance of the proposed algorithm. The results show our algorithm can efficiently find the optimal pricing policy for both the small and large networks, and can significantly enhance the platform profit and service efficiency.

    Highlights Developed scalable RL-based approaches for dynamic pricing problem in ride-hailing. Defined the problem with a clear distinction between historical and current prices. Proved the existence of a deterministic stationary optimal policy. Improved an existing RL algorithm named TD3 with three novel mechanisms. Empirically validated the proposed approaches in both small and large problems.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Scalable reinforcement learning approaches for dynamic pricing in ride-hailing systems


    Beteiligte:


    Erscheinungsdatum :

    2023-10-12




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    RIDE-HAILING SYSTEM AND RIDE-HAILING METHOD

    KAMATA NOBUHIDE / UEHARA YASUO / TANIMORI SHUNSUKE et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Dynamic pricing for ride-hailing services considering relocation and mode choice

    Iacobucci, Riccardo / Schmocker, Jan-Dirk | IEEE | 2021


    RIDE-HAILING SERVICE MANAGEMENT DEVICE, RIDE-HAILING SERVICE MANAGEMENT METHOD, AND RIDE-HAILING SERVICE MANAGEMENT SYSTEM

    KUROSAWA TAKAYOSHI / WAKIMIZU MAKOTO / ADACHI HIROSHI et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Real-world ride-hailing vehicle repositioning using deep reinforcement learning

    Jiao, Yan / Tang, Xiaocheng / Qin, Zhiwei (Tony) et al. | Elsevier | 2021


    RIDE-HAILING SYSTEM

    YOKOYAMA DAIKI / SUGIYAMA KOSEKI / MIYAGAWA ATSUSHI | Europäisches Patentamt | 2021

    Freier Zugriff