Skip to main content

A Deep Reinforcement Learning Based Dynamic Pricing Algorithm in Ride-Hailing

  • Conference paper
  • First Online:
Database Systems for Advanced Applications (DASFAA 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13246))

Included in the following conference series:

Abstract

Online ride-hailing has become one of the most important transportation ways in the modern city. In the ride-hailing system, the vehicle supply and riding demand is different in different regions, and thus the passengers’ willingness to take a riding service will change dynamically. Traditional pricing strategies cannot make reasonable decisions to set the riding prices with respect to the dynamical supply and demand in different regions, and they cannot make adaptive responses to the real-time unbalanced supply and demand. In addition, the ride-hailing platform usually intends to maximize the long-term profit. In this paper, we use deep reinforcement learning to design a multi-region dynamic pricing algorithm to set the differentiate unit price for different regions in order to maximize the long-term profit of the platform. Specifically, we divide the ride-hailing area into several non-overlapping regions, and then propose a model to characterize the passenger’s price acceptance probability. We further model the pricing issue as a Markov decision-making process, and then use deep reinforcement learning to design a multi-region dynamic pricing algorithm (MRDP) to maximize the platform’s long-term profit. We further run extensive experiments based on realistic data to evaluate the effectiveness of the proposed algorithm against some typical benchmark approaches. The experimental results show that MRDP can set the price effectively based on supply and demand to make more profit and can balance the supply and demand to some extent.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://outreach.didichuxing.com/research/opendata/.

References

  1. Asghari, M., Deng, D., Shahabi, C., Demiryurek, U., Li, Y.: Price-aware real-time ride-sharing at scale: an auction-based approach. In: Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–10 (2016)

    Google Scholar 

  2. Asghari, M., Shahabi, C.: An on-line truthful and individually rational pricing mechanism for ride-sharing. In: Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–10 (2017)

    Google Scholar 

  3. Asghari, M., Shahabi, C.: Adapt-pricing: a dynamic and predictive technique for pricing to maximize revenue in ridesharing platforms. In: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 189–198 (2018)

    Google Scholar 

  4. Chen, H., et al.: InBEDE: integrating contextual bandit with TD learning for joint pricing and dispatch of ride-hailing platforms. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 61–70 (2019)

    Google Scholar 

  5. Chen, L., Shang, S., Yao, B., Li, J.: Pay your trip for traffic congestion: dynamic pricing in traffic-aware road networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 582–589 (2020)

    Google Scholar 

  6. Chen, L., Gao, Y., Liu, Z., Xiao, X., Jensen, C.S., Zhu, Y.: PTRider: a price-and-time-aware ridesharing system. Proc. VLDB Endow. 11(12), 1938–1941 (2018)

    Article  Google Scholar 

  7. Chen, M., Shen, W., Tang, P., Zuo, S.: Dispatching through pricing: modeling ride-sharing and designing dynamic prices. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, 10–16 August 2019, pp. 165–171 (2019)

    Google Scholar 

  8. Gan, J., An, B., Wang, H., Sun, X., Shi, Z.: Optimal pricing for improving efficiency of taxi systems. In: 23rd International Joint Conference on Artificial Intelligence, pp. 2811–2818 (2013)

    Google Scholar 

  9. Liu, J.X., Ji, Y.D., Lv, W.F., Xu, K.: Budget-aware dynamic incentive mechanism in spatial crowdsourcing. J. Comput. Sci. Technol. 32(5), 890–904 (2017)

    Article  Google Scholar 

  10. Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math. 5(1), 32–38 (1957)

    Article  MathSciNet  Google Scholar 

  11. Schröder, M., Storch, D.M., Marszal, P., Timme, M.: Anomalous supply shortages from dynamic pricing in on-demand mobility. Nat. Commun. 11(1), 1–8 (2020)

    Article  Google Scholar 

  12. Tong, Y., She, J., Ding, B., Chen, L., Wo, T., Xu, K.: Online minimum matching in real-time spatial data: experiments and analysis. Proc. VLDB Endow. 9(12), 1053–1064 (2016)

    Article  Google Scholar 

  13. Tong, Y., Wang, L., Zhou, Z., Chen, L., Du, B., Ye, J.: Dynamic pricing in spatial crowdsourcing: a matching-based approach. In: Proceedings of the 2018 International Conference on Management of Data, pp. 773–788 (2018)

    Google Scholar 

  14. Xu, Z., et al.: Large-scale order dispatch in on-demand ride-hailing platforms: a learning and planning approach. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 905–913 (2018)

    Google Scholar 

  15. Zhang, J., Wen, D., Zeng, S.: A discounted trade reduction mechanism for dynamic ridesharing pricing. IEEE Trans. Intell. Transp. Syst. 17(6), 1586–1595 (2015)

    Article  Google Scholar 

  16. Zheng, L., Chen, L., Ye, J.: Order dispatch in price-aware ridesharing. Proc. VLDB Endow. 11(8), 853–865 (2018)

    Article  Google Scholar 

  17. Zheng, L., Cheng, P., Chen, L.: Auction-based order dispatch and pricing in ridesharing. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 1034–1045 (2019)

    Google Scholar 

Download references

Acknowledgment

This paper was funded by the Humanity and Social Science Youth Research Foundation of Ministry of Education (Grant No. 19YJC790111), the Philosophy and Social Science Post-Foundation of Ministry of Education (Grant No. 18JHQ060) and Shenzhen Fundamental Research Program (Grant No. JCYJ20190809175613332).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bing Shi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shi, B., Cao, Z., Luo, Y. (2022). A Deep Reinforcement Learning Based Dynamic Pricing Algorithm in Ride-Hailing. In: Bhattacharya, A., et al. Database Systems for Advanced Applications. DASFAA 2022. Lecture Notes in Computer Science, vol 13246. Springer, Cham. https://doi.org/10.1007/978-3-031-00126-0_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-00126-0_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-00125-3

  • Online ISBN: 978-3-031-00126-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics