Shashank Gupta
ABSTRACT
Monitoring and predicting user engagement is essential to gauge the overall health of an E-commerce platform. A healthy active user base indicates that the platform is able to retain users and is performing well on the user satisfaction metric. To measure long-term user satisfaction, predicting the return rate of a user is essential. The frequent return of the user indicates that they are overall satisfied with the platform. To this end, we consider the problem of predicting users’ return time on the platform given their historical interactions.
The current state-of-the-art models for user return time prediction are based on recurrent neural network, which models the sequence of user interactions and predicts the return time using a Temporal Point Process based formulation. However, it is well-known that the inference time for these models grows as the sequence length increases, due to the complex recurrent and gating mechanisms, which deems them unfit to be used in a real-time prediction setting. Towards this end, we propose a lightweight and simple neural bag-of-words-based model for user return time prediction, which considers the user activity trail as a bag-of-words embedding model and performs a simple aggregation operation, used for the final prediction. We perform experiments on interaction log data from a major e-commerce company, and our proposed bag-of-words model outperforms the complex recurrence-based neural network by 6.14% and 4.81% on average, in terms of the Root-Mean-Squared-Error and Mean-Absolute-Error, respectively. We also compare the inference time of our method to the recurrent neural network-based method, with an overall reduction of 78.5% in terms of the wall-clock time.
- Odd Aalen, Ornulf Borgan, and Hakon Gjessing. 2008. Survival and event history analysis: a process point of view. Springer Science & Business Media.Google Scholar
- Pinkesh Badjatiya, Shashank Gupta, Manish Gupta, and Vasudeva Varma. 2017. Deep learning for hate speech detection in tweets. In Proceedings of the 26th International Conference on World Wide Web Companion. 759–760.Google ScholarDigital Library
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).Google Scholar
- Inci M Baytas, Cao Xiao, Xi Zhang, Fei Wang, Anil K Jain, and Jiayu Zhou. 2017. Patient subtyping via time-aware lstm networks. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 65–74.Google ScholarDigital Library
- Paul N Bennett, Ryen W White, Wei Chu, Susan T Dumais, Peter Bailey, Fedor Borisyuk, and Xiaoyuan Cui. 2012. Modeling the impact of short-and long-term behavior on search personalization. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval. 185–194.Google ScholarDigital Library
- Lucky Dhakad, Mrinal Das, Chiranjib Bhattacharyya, Samik Datta, Mihir Kale, and Vivek Mehta. 2017. SOPER: Discovering the Influence of Fashion and the Many Faces of User from Session Logs using Stick Breaking Process. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1609–1618.Google ScholarDigital Library
- Nan Du, Hanjun Dai, Rakshit Trivedi, Utkarsh Upadhyay, Manuel Gomez-Rodriguez, and Le Song. 2016. Recurrent marked temporal point processes: Embedding event history to vector. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1555–1564.Google ScholarDigital Library
- Georg L Grob, Ângelo Cardoso, CH Liu, Duncan A Little, and Benjamin Paul Chamberlain. 2018. A recurrent neural network survival model: Predicting web user return time. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 152–168.Google Scholar
- Shashank Gupta, Philipp Hager, Jin Huang, Ali Vardasbi, and Harrie Oosterhuis. 2023. Recent Advances in the Foundations and Applications of Unbiased Learning to Rank. arXiv preprint arXiv:2305.02914 (2023).Google Scholar
- Shashank Gupta and Subhadeep Maji. 2020. Predicting Session Length for Product Search on E-commerce Platform. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1713–1716.Google ScholarDigital Library
- Udit Gupta, Samuel Hsia, Vikram Saraph, Xiaodong Wang, Brandon Reagen, Gu-Yeon Wei, Hsien-Hsin S Lee, David Brooks, and Carole-Jean Wu. 2020. DeepRecSys: A System for Optimizing End-To-End At-scale Neural Recommendation Inference. arXiv preprint arXiv:2001.02772 (2020).Google Scholar
- Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2016. Bag of tricks for efficient text classification. arXiv preprint arXiv:1607.01759 (2016).Google Scholar
- Komal Kapoor, Mingxuan Sun, Jaideep Srivastava, and Tao Ye. 2014. A hazard based approach to user return time prediction. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 1719–1728.Google ScholarDigital Library
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google Scholar
- Shichen Liu, Fei Xiao, Wenwu Ou, and Luo Si. 2017. Cascade ranking for operational e-commerce search. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1557–1565.Google ScholarDigital Library
- Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017).Google Scholar
- Jürgen Schmidhuber. 1997. Long short-term memory. Neural Comput 9, 8 (1997), 1735–1780.Google ScholarDigital Library
- Yang Song, Xiaolin Shi, and Xin Fu. 2013. Evaluating and predicting user engagement change with degraded search relevance. In Proceedings of the 22nd international conference on World Wide Web. 1213–1224.Google ScholarDigital Library
- Jiaxi Tang, Francois Belletti, Sagar Jain, Minmin Chen, Alex Beutel, Can Xu, and Ed H. Chi. 2019. Towards neural mixture recommender for long range dependent user sequences. In The World Wide Web Conference. 1782–1793.Google Scholar
- Junchi Yan. 2019. Recent advance in temporal point process: from machine learning perspective.Google Scholar
Index Terms
- A Neural Bag-of-Words Point Process Model for User Return Time Prediction in E-commerce
Recommendations
Modeling User Return Time Using Inhomogeneous Poisson Process
Advances in Information RetrievalAbstractFor Intelligent Assistants (IA), user activity is often used as a lag metric for user satisfaction or engagement. Conversely, predictive leading metrics for engagement can be helpful with decision making and evaluating changes in satisfaction ...
A Bayesian Point Process Model for User Return Time Prediction in Recommendation Systems
UMAP '18: Proceedings of the 26th Conference on User Modeling, Adaptation and PersonalizationIn order to sustain the user-base for a web service, it is important to know the return time of a user to the service. We propose a Bayesian point process, log Gaussian Cox process (LGCP), to model and predict return time of users. It allows encoding ...
A Recurrent Neural Network Survival Model: Predicting Web User Return Time
Machine Learning and Knowledge Discovery in DatabasesAbstractThe size of a website’s active user base directly affects its value. Thus, it is important to monitor and influence a user’s likelihood to return to a site. Essential to this is predicting when a user will return. Current state of the art ...
Comments