Wenchao Xiu
ABSTRACT
Learning-to-Rank(LTR) is widely used in many Information Retrieval(IR) scenarios, including web search and Location Based Services(LBS) search. However, most existing LTR techniques mainly focus on homogeneous ranking. Taking QAC in Dianping search as an example, heterogeneous documents including suggested queries (SQ) and Point-of-Interests(POI) need to be ranked and presented to enhance user experience. New challenges are faced when conducting heterogeneous ranking, including inconsistent feature space and more serious position bias caused by distinct representation spaces. Therefore, we propose Deep Debiasing Experts Network (DDEN), a novel heterogeneous LTR approach based on Mixture-of-Experts architecture and gating network, to deal with the inconsistent feature space of documents in ranking system. Furthermore, DDEN mitigates the position bias by adopting adversarial-debiasing framework embedded with heterogeneous LTR techniques. We conduct reproducible experiments on industrial datasets from Dianping, one of the largest local life platforms, and deploy DDEN in online application. Results show that DDEN substantially improves ranking performance in offline evaluation and boost the overall click-through rate in online A/B test by 2.1%.
- Aman Agarwal, Ivan Zaitsev, Xuanhui Wang, Cheng Li, Marc Najork, and Thorsten Joachims. 2019. Estimating position bias without intrusive interventions. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. 474--482.Google Scholar
Digital Library
- Ziv Bar-Yossef and Naama Kraus. 2011. Context-sensitive query auto-completion. In Proceedings of the 20th international conference on World wide web. 107--116.Google ScholarDigital Library
- Christopher JC Burges. 2010. From ranknet to lambdarank to lambdamart: An overview. Learning 11, 23--581 (2010), 81.Google Scholar
- Cai, Fei, de, Rijke, and Maarten. 2016. A Survey of Query Auto Completion in Information Retrieval. Now Publishers Inc.PUB4850Hanover, MA, USA. 3--q7 pages.Google Scholar
- Rich Caruana. 1993. Multitask Learning: A Knowledge-Based Source of Inductive Bias. In Machine Learning, Proceedings of the Tenth International Conference, University of Massachusetts, Amherst, MA, USA, June 27--29, 1993.Google Scholar
- Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems. 191--198.Google ScholarDigital Library
- Antonino Freno. 2017. Practical lessons from developing a large-scale recommender system at Zalando. In Proceedings of the Eleventh ACM Conference on Recommender Systems. 251--259.Google ScholarDigital Library
- Katja Hofmann, Bhaskar Mitra, Filip Radlinski, Shokouhi, and Milad. 2014. An Eye-tracking Study of User Interactions with Query Auto Completion. In Acm International Conference on Conference on Information Knowledge Management.Google Scholar
- Jyun-Yu Jiang and Pu-Jen Cheng. 2016. Classifying user search intents for query auto-completion. In Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval. 49--58.Google ScholarDigital Library
- Sofia Ira Ktena, Alykhan Tejani, Lucas Theis, Pranay Kumar Myana, Deepak Dilipkumar, Ferenc Huszár, Steven Yoo, and Wenzhe Shi. 2019. Addressing delayed feedback for continuous training with neural networks in CTR prediction. In Proceedings of the 13th ACM Conference on Recommender Systems. 187--195.Google ScholarDigital Library
- Ho Chang Lee, Hae Chang Rim, and Do Gil Lee. 2019. Learning to rank products based on online product reviews using a hierarchical deep neural network. Electronic Commerce Research and Applications 36 (2019), 100874.Google ScholarDigital Library
- Pengcheng Li, Runze Li, Qing Da, An-Xiang Zeng, and Lijun Zhang. 2020. Improving Multi-Scenario Learning to Rank in E-commerce by Exploiting Task Relationships in the Label Space. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2605--2612.Google ScholarDigital Library
- LiYing, HuangJizhou, LeiJinyi, FanMiao, WangHaifeng, and ChenEnhong. 2020. Personalized Query Auto-Completion for Large-Scale POI Search in Baidu Maps. (2020).Google Scholar
- Jiaqi Ma, Zhe Zhao, Xinyang Yi, Jilin Chen, Lichan Hong, and Ed H Chi. 2018. Modeling task relationships in multi-task learning with multi-gate mixture-ofexperts. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1930--1939.Google ScholarDigital Library
- Ayan Sinha, David F Gleich, and Karthik Ramani. 2017. Deconvolving feedback loops in recommender systems. arXiv preprint arXiv:1703.01049 (2017).Google Scholar
- Aston Zhang, Amit Goyal, Weize Kong, Hongbo Deng, Anlei Dong, Yi Chang, Carl A Gunter, and Jiawei Han. 2015. adaqac: Adaptive query auto-completion via implicit negative feedback. In Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. 143--152.Google ScholarDigital Library
- Zhe Zhao, Lichan Hong, Li Wei, Jilin Chen, Aniruddh Nath, Shawn Andrews, Aditee Kumthekar, Maheswaran Sathiamoorthy, Xinyang Yi, and Ed Chi. 2019. Recommending what video to watch next: a multitask ranking system. In Proceedings of the 13th ACM Conference on Recommender Systems. 43--51.Google ScholarDigital Library
Index Terms
- DDEN: A Heterogeneous Learning-to-Rank Approach with Deep Debiasing Experts Network
Recommendations
Learning to re-rank: query-dependent image re-ranking using click data
WWW '11: Proceedings of the 20th international conference on World wide webOur objective is to improve the performance of keyword based image search engines by re-ranking their original results. To this end, we address three limitations of existing search engines in this paper. First, there is no straight-forward, fully ...
Rank aggregation using ant colony approach for metasearch
Metasearch engines provide a plethora of information to the user through World Wide Web. They are the prominent sources of query-based search and centralized human---world interactions. Metasearch engine shows a list of Web sites to a particular query ...
Learning to rank: new approach with the layered multi-population genetic programming on click-through features
Users' click-through data is a valuable source of information about the performance of Web search engines, but it is included in few datasets for learning to rank. In this paper, inspired by the click-through data model, a novel approach is proposed for ...
Comments