skip to main content
10.1145/3523227.3547379acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
invited-talk

Recommending for a multi-sided marketplace with heterogeneous contents

Published: 13 September 2022 Publication History

Editorial Notes

The authors have requested minor, non-substantive changes to the Version of Record and, in accordance with ACM policies, a Corrected Version of Record was published on September 19, 2022. For reference purposes, the VoR may still be accessed via the Supplemental Material section on this page.

Abstract

Many online personalization platforms today are recommending heterogeneous contents in a multi-sided marketplace consisting of consumers, merchants and other partners. For a recommender system to be successful in these contexts, it faces two main challenges. First, each side in the marketplace has different and potentially conflicting utilities. Recommending for a multi-sided marketplace therefore entails jointly optimizing multiple objectives with trade-offs. Second, the off-the-shelf recommendation algorithms are not applicable to the heterogeneous content space, where a recommendation item could be an aggregation of other recommendation items. In this work, we develop a general framework for recommender systems in a multi-sided marketplace with heterogeneous and hierarchical contents. We propose a constrained optimization framework with machine learning models for each objective as inputs, and a probabilistic structural model for users’ engagement patterns on heterogeneous contents. Our proposed structural modeling approach ensures consistent user experience across different levels of aggregation of the contents, and provides levels of transparency to the merchants and content providers. We further develop an efficient optimization solution for ranking and recommendation in large-scale online systems in real time. We implement the framework at Uber Eats, one of the largest online food delivery platforms in the world and a three-sided marketplace consisting of eaters, restaurant partners and delivery partners. Online experiments demonstrate the effectiveness of our framework in ranking heterogeneous contents and optimizing for the three sides in the marketplace. Our framework has been deployed globally as the recommendation algorithm for Uber Eats’ homepage.

Supplementary Material

PDF File (3547379-vor.pdf)
Version of Record for "Recommending for a multi-sided marketplace with heterogeneous content" by Wang et al., Proceedings of the 16th ACM Conference on Recommender Systems (RecSys '22).

References

[1]
Himan Abdollahpouri, Gediminas Adomavicius, Robin Burke, Ido Guy, Dietmar Jannach, Toshihiro Kamishima, Jan Krasnodebski, and Luiz Pizzato. 2020. Multistakeholder recommendation: Survey and research directions. User Modeling and User-Adapted Interaction 30, 1 (2020), 127–158.
[2]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE transactions on knowledge and data engineering 17, 6(2005), 734–749.
[3]
Deepak Agarwal, Bee-Chung Chen, Pradheep Elango, and Xuanhui Wang. 2012. Personalized click shaping through lagrangian duality for online recommendation. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval. 485–494.
[4]
Chris Alvino and Justin Basilico. 2015. Learning a personalized homepage. The Netflix Tech Blog 9(2015).
[5]
Lars Backstrom and Jure Leskovec. 2011. Supervised random walks: predicting and recommending links in social networks. In Proceedings of the fourth ACM international conference on Web search and data mining. 635–644.
[6]
James Bennett, Stan Lanning, 2007. The netflix prize. In Proceedings of KDD cup and workshop, Vol. 2007. New York, NY, USA., 35.
[7]
Giuseppe Burtini, Jason Loeppky, and Ramon Lawrence. 2015. A survey of online experiment design with the stochastic multi-armed bandit. arXiv preprint arXiv:1510.00757(2015).
[8]
Yuxin Chen and Song Yao. 2017. Sequential search with refinement: Model and application with click-stream data. Management Science 63, 12 (2017), 4345–4365.
[9]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Recsys’ 16. 191–198.
[10]
Paramveer S Dhillon and Sinan Aral. 2021. Modeling Dynamic User Interests: A Neural Matrix Factorization Approach. Marketing Science 40, 6 (2021), 1059–1080.
[11]
Anindya Ghose, Panagiotis G Ipeirotis, and Beibei Li. 2012. Designing ranking systems for hotels on travel search engines by mining user-generated and crowdsourced content. Marketing Science 31, 3 (2012), 493–520.
[12]
Chris Jaffe. 2020. Building YouTube Shorts, a new way to watch & create on YouTube. https://blog.youtube/news-and-events/building-youtube-shorts/
[13]
Zhepeng Li, Xiao Fang, Xue Bai, and Olivia R Liu Sheng. 2017. Utility-based link recommendation for online social networks. Management Science 63, 6 (2017), 1938–1952.
[14]
Tie-Yan Liu 2009. Learning to rank for information retrieval. Foundations and Trends® in Information Retrieval 3, 3(2009), 225–331.
[15]
Hao Ma, Xueqing Liu, and Zhihong Shen. 2016. User fatigue in online news recommendation. In Proceedings of the 25th International Conference on World Wide Web. 1363–1372.
[16]
Bradley N Miller, Istvan Albert, Shyong K Lam, Joseph A Konstan, and John Riedl. 2003. Movielens unplugged: experiences with an occasionally connected recommender system. In Proceedings of the 8th international conference on Intelligent user interfaces. 263–266.
[17]
Jakob Nielsen. 2006. ” F-Shaped Pattern For Reading Web Content,” Jakob Nielsen’s Alertbox. http://www. useit. com/alertbox/reading_pattern. html (2006).
[18]
Anastasios Noulas, Salvatore Scellato, Neal Lathia, and Cecilia Mascolo. 2012. A random walk around the city: New venue recommendation in location-based social networks. In 2012 International Conference on Privacy, Security, Risk and Trust (PASSAT). IEEE Computer Society, 144–153.
[19]
Bhavik Pathak, Robert Garfinkel, Ram D Gopal, Rajkumar Venkatesan, and Fang Yin. 2010. Empirical analysis of the impact of recommender systems on sales. Journal of Management Information Systems 27, 2 (2010), 159–188.
[20]
Shankar Prawesh and Balaji Padmanabhan. 2014. The “most popular news” recommender: Count amplification and manipulation resistance. Information Systems Research 25, 3 (2014), 569–589.
[21]
Brent Smith and Greg Linden. 2017. Two decades of recommender systems at Amazon. com. Ieee internet computing 21, 3 (2017), 12–18.
[22]
Raluca M Ursu. 2018. The power of rankings: Quantifying the effect of rankings on online consumer search and purchase decisions. Marketing Science 37, 4 (2018), 530–552.
[23]
Bo Xiao and Izak Benbasat. 2007. E-commerce product recommendation agents: Use, characteristics, and impact. MIS quarterly (2007), 137–209.
[24]
Xing Xie. 2010. Potential friend recommendation in online social network. In 2010 IEEE/ACM Int’l Conference on Green Computing and Communications & Int’l Conference on Cyber, Physical and Social Computing. IEEE, 831–835.
[25]
Tongxiao (Catherine) Zhang, Ritu Agarwal, and Henry C Lucas Jr. 2011. The value of IT-enabled retailer learning: personalized product recommendations and customer store loyalty in electronic markets. Mis Quarterly (2011), 859–881.

Cited By

View all
  • (2024)Reinforcement Learning to Personalize User eXperience within Digital Business Ecosystems2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00085(584-593)Online publication date: 2-Jul-2024
  • (2024)User Experiments on the Effect of the Diversity of Consumption on News ServicesIEEE Access10.1109/ACCESS.2024.336777012(31841-31852)Online publication date: 2024
  • (undefined)A Unified Framework for Personalizing Product RankingsSSRN Electronic Journal10.2139/ssrn.3649342

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems
September 2022
743 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2022

Check for updates

Author Tags

  1. multi-objective recommendation
  2. multi-sided marketplace

Qualifiers

  • Invited-talk
  • Research
  • Refereed limited

Conference

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)69
  • Downloads (Last 6 weeks)10
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Reinforcement Learning to Personalize User eXperience within Digital Business Ecosystems2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00085(584-593)Online publication date: 2-Jul-2024
  • (2024)User Experiments on the Effect of the Diversity of Consumption on News ServicesIEEE Access10.1109/ACCESS.2024.336777012(31841-31852)Online publication date: 2024
  • (undefined)A Unified Framework for Personalizing Product RankingsSSRN Electronic Journal10.2139/ssrn.3649342

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media