Abstract
Online ride-hailing has become one of the most important transportation ways in the modern city. In the ride-hailing system, the vehicle supply and riding demand is different in different regions, and thus the passengers’ willingness to take a riding service will change dynamically. Traditional pricing strategies cannot make reasonable decisions to set the riding prices with respect to the dynamical supply and demand in different regions, and they cannot make adaptive responses to the real-time unbalanced supply and demand. In addition, the ride-hailing platform usually intends to maximize the long-term profit. In this paper, we use deep reinforcement learning to design a multi-region dynamic pricing algorithm to set the differentiate unit price for different regions in order to maximize the long-term profit of the platform. Specifically, we divide the ride-hailing area into several non-overlapping regions, and then propose a model to characterize the passenger’s price acceptance probability. We further model the pricing issue as a Markov decision-making process, and then use deep reinforcement learning to design a multi-region dynamic pricing algorithm (MRDP) to maximize the platform’s long-term profit. We further run extensive experiments based on realistic data to evaluate the effectiveness of the proposed algorithm against some typical benchmark approaches. The experimental results show that MRDP can set the price effectively based on supply and demand to make more profit and can balance the supply and demand to some extent.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Asghari, M., Deng, D., Shahabi, C., Demiryurek, U., Li, Y.: Price-aware real-time ride-sharing at scale: an auction-based approach. In: Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–10 (2016)
Asghari, M., Shahabi, C.: An on-line truthful and individually rational pricing mechanism for ride-sharing. In: Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–10 (2017)
Asghari, M., Shahabi, C.: Adapt-pricing: a dynamic and predictive technique for pricing to maximize revenue in ridesharing platforms. In: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 189–198 (2018)
Chen, H., et al.: InBEDE: integrating contextual bandit with TD learning for joint pricing and dispatch of ride-hailing platforms. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 61–70 (2019)
Chen, L., Shang, S., Yao, B., Li, J.: Pay your trip for traffic congestion: dynamic pricing in traffic-aware road networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 582–589 (2020)
Chen, L., Gao, Y., Liu, Z., Xiao, X., Jensen, C.S., Zhu, Y.: PTRider: a price-and-time-aware ridesharing system. Proc. VLDB Endow. 11(12), 1938–1941 (2018)
Chen, M., Shen, W., Tang, P., Zuo, S.: Dispatching through pricing: modeling ride-sharing and designing dynamic prices. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, 10–16 August 2019, pp. 165–171 (2019)
Gan, J., An, B., Wang, H., Sun, X., Shi, Z.: Optimal pricing for improving efficiency of taxi systems. In: 23rd International Joint Conference on Artificial Intelligence, pp. 2811–2818 (2013)
Liu, J.X., Ji, Y.D., Lv, W.F., Xu, K.: Budget-aware dynamic incentive mechanism in spatial crowdsourcing. J. Comput. Sci. Technol. 32(5), 890–904 (2017)
Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math. 5(1), 32–38 (1957)
Schröder, M., Storch, D.M., Marszal, P., Timme, M.: Anomalous supply shortages from dynamic pricing in on-demand mobility. Nat. Commun. 11(1), 1–8 (2020)
Tong, Y., She, J., Ding, B., Chen, L., Wo, T., Xu, K.: Online minimum matching in real-time spatial data: experiments and analysis. Proc. VLDB Endow. 9(12), 1053–1064 (2016)
Tong, Y., Wang, L., Zhou, Z., Chen, L., Du, B., Ye, J.: Dynamic pricing in spatial crowdsourcing: a matching-based approach. In: Proceedings of the 2018 International Conference on Management of Data, pp. 773–788 (2018)
Xu, Z., et al.: Large-scale order dispatch in on-demand ride-hailing platforms: a learning and planning approach. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 905–913 (2018)
Zhang, J., Wen, D., Zeng, S.: A discounted trade reduction mechanism for dynamic ridesharing pricing. IEEE Trans. Intell. Transp. Syst. 17(6), 1586–1595 (2015)
Zheng, L., Chen, L., Ye, J.: Order dispatch in price-aware ridesharing. Proc. VLDB Endow. 11(8), 853–865 (2018)
Zheng, L., Cheng, P., Chen, L.: Auction-based order dispatch and pricing in ridesharing. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 1034–1045 (2019)
Acknowledgment
This paper was funded by the Humanity and Social Science Youth Research Foundation of Ministry of Education (Grant No. 19YJC790111), the Philosophy and Social Science Post-Foundation of Ministry of Education (Grant No. 18JHQ060) and Shenzhen Fundamental Research Program (Grant No. JCYJ20190809175613332).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Shi, B., Cao, Z., Luo, Y. (2022). A Deep Reinforcement Learning Based Dynamic Pricing Algorithm in Ride-Hailing. In: Bhattacharya, A., et al. Database Systems for Advanced Applications. DASFAA 2022. Lecture Notes in Computer Science, vol 13246. Springer, Cham. https://doi.org/10.1007/978-3-031-00126-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-00126-0_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-00125-3
Online ISBN: 978-3-031-00126-0
eBook Packages: Computer ScienceComputer Science (R0)