skip to main content
10.1145/3340531.3411952acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Deep Time-Aware Item Evolution Network for Click-Through Rate Prediction

Published: 19 October 2020 Publication History

Abstract

For better user satisfaction and business effectiveness, Click-Through Rate (CTR) prediction is one of the most important tasks in E-commerce. It is often the case that users' interests different from their past routines may emerge or impressions such as promotional items may burst in a very short period. In essence, such changes relate to item evolution problem, which has not been investigated by previous studies. The state-of-the-art methods in the sequential recommendation, which use simple user behaviors, are incapable of modeling these changes sufficiently. It is because, in the user behaviors, outdated interests may exist and the popularity of an item over time is not well represented. To address these limitations, we introduce time-aware item behaviors for addressing the recommendation of emerging preference. The time-aware item behavior for an item is a set of users who interact with this item with timestamps. The rich interaction information of users for an item may help to model its evolution. In this work, we propose a CTR prediction model TIEN based on the time-aware item behavior. In TIEN, by leveraging the interaction time intervals, information of similar users in a short time interval helps identify the emerging user interest of the target user. By using the sequential time intervals, the item's popularity over time can be captured in evolutionary item dynamics. Noisy users who interact with items accidentally are further eliminated thus learning robust personalized item dynamics. To the best of our knowledge, this is the first study to the item evolution problem for E-commerce CTR prediction. We conduct extensive experiments on five real-world CTR prediction datasets. The results show that the TIEN model consistently achieves remarkable improvements to the state-of-the-art methods.

Supplementary Material

MP4 File (3340531.3411952.mp4)
Click-Through Rate (CTR) prediction is one of the most important tasks in E-commerce. It is often the case that users' interests different from their past routines may emerge or impressions such as promotional items may burst in a very short period. In essence, such changes relate to item evolution problem. The state-of-the-art methods in the sequential recommendation, which use simple user behaviors, are incapable of modeling these changes sufficiently. To address these limitations, we introduce time-aware item behaviors for addressing the recommendation of emerging preference. In this work, we propose a CTR prediction model TIEN based on the time-aware item behavior. To the best of our knowledge, this is the first study to the item evolution problem for E-commerce CTR prediction. We conduct extensive experiments on five real-world CTR prediction datasets. The results show that the TIEN model consistently achieves remarkable improvements to the state-of-the-art methods.

References

[1]
Deepak Agarwal, Bee-Chung Chen, and Pradheep Elango. 2009. Spatio-temporal models for estimating click-through rate. In WWW. ACM, 21--30.
[2]
Fedor Borisyuk, Liang Zhang, and Krishnaram Kenthapadi. 2017. LiJAR: A system for job application redistribution towards efficient career marketplace. In SIGKDD. 1397--1406.
[3]
Justin Cheng, Lada Adamic, P Alex Dow, Jon Michael Kleinberg, and Jure Leskovec. 2014. Can cascades be predicted?. In WWW. 925--936.
[4]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for YouTube recommendations. In Recsys. 191--198.
[5]
Nan Du, Hanjun Dai, Rakshit Trivedi, Utkarsh Upadhyay, Manuel Gomez-Rodriguez, and Le Song. 2016. Recurrent marked temporal point processes:Embedding event history to vector. In KDD. ACM, 1555--1564.
[6]
Guibing Guo, Shichang Ouyang, Xiaodong He, Fajie Yuan, and Xiaohua Liu. 2019. Dynamic item block and prediction enhancing block for sequential recommendation. In IJCAI. AAAI Press, 1373--1379.
[7]
Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In WWW. 507--517.
[8]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2016. Session-based recommendations with recurrent neural networks. ICLR(2016).
[9]
Bo Jiang, Jiguang Liang, Ying Sha, Rui Li, Wei Liu, Hongyuan Ma, and Lihong Wang. 2016. Retweeting behavior prediction based on one-class collaborative filtering in social networks. In SIGIR. 977--980.
[10]
Bo Jiang, Jiguang Liang, Ying Sha, and Lihong Wang. 2015. Message clustering based matrix factorization model for retweeting behavior prediction. In CIKM. 1843--1846.
[11]
Diederick P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR.
[12]
Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD. 426--434.
[13]
Yehuda Koren. 2009. Collaborative filtering with temporal dynamics. In KDD. ACM, 447--456.
[14]
Yudan Liu, Kaikai Ge, Xu Zhang, and Leyu Lin. 2019. Real-time Attention Based Look-alike Model for Recommender System. In KDD. ACM.
[15]
Julian McAuley, Christopher Targett, Qinfeng Shi, and Anton Van Den Hengel. 2015. Image-based recommendations on styles and substitutes. In SIGIR. 43--52.
[16]
H Brendan McMahan, Gary Holt, David Sculley, Michael Young, Dietmar Ebner, Julian Grady, Lan Nie, Todd Phillips, Eugene Davydov, Daniel Golovin, et al. 2013. Ad click prediction: a view from the trenches. In KDD. 1222--1230.
[17]
Yabo Ni, Dan Ou, Shichen Liu, Xiang Li, Wenwu Ou, Anxiang Zeng, and Luo Si. 2018. Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Tasks. In KDD. 596--605.
[18]
Kyo-Joong Oh, Won-Jo Lee, Chae-Gyun Lim, and Ho-Jin Choi. 2014. Personalized news recommendation using classified keywords to capture user preference. In ICACT. 1283--1287.
[19]
Sasa Petrovic, Miles Osborne, and Victor Lavrenko. 2011. RT to Win! Predicting Message Propagation in Twitter. In ICWSM.
[20]
Yanru Qu, Han Cai, Kan Ren, Weinan Zhang, Yong Yu, Ying Wen, and Jun Wang. 2016. Product-based neural networks for user response prediction. In ICDM. IEEE, 1149--1154.
[21]
Kan Ren, Jiarui Qin, Yuchen Fang, Weinan Zhang, Lei Zheng, Weijie Bian, GuoruiZhou, Jian Xu, Yong Yu, Xiaoqiang Zhu, et al. 2019. Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction. In SIGIR. 565--574.
[22]
Kan Ren, Weinan Zhang, Yifei Rong, Haifeng Zhang, Yong Yu, and Jun Wang.2016. User response learning for directly optimizing campaign performance in display advertising. In CIKM. ACM, 679--688.
[23]
Steffen Rendle. 2010. Factorization machines. In ICDM. IEEE, 995--1000.
[24]
Bongwon Suh, Lichan Hong, Peter Pirolli, and Ed H Chi. 2010. Want to be retweeted? large scale analytics on factors impacting retweet in twitter network. In ICSC. IEEE, 177--184.
[25]
Yong Kiam Tan, Xinxing Xu, and Yong Liu. 2016. Improved recurrent neural networks for session-based recommendations. In Recsys. 17--22.
[26]
Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In WSDM. 565--573.
[27]
Aaron Van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In NIPS. 2643--2651.
[28]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NIPS. 5998--6008.
[29]
Jia Wang, Vincent W Zheng, Zemin Liu, and Kevin Chen-Chuan Chang. 2017. Topological recurrent neural network for diffusion prediction. In ICDM. IEEE, 475--484.
[30]
Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J Smola, and How Jing. 2017. Recurrent recommender networks. In WSDM. ACM, 495--503.
[31]
Qingyuan Zhao, Murat A Erdogdu, Hera Y He, Anand Rajaraman, and JureLeskovec. 2015. Seismic: A self-exciting point process model for predicting tweet popularity. In KDD. ACM, 1513--1522.
[32]
Chang Zhou, Jinze Bai, Junshuai Song, Xiaofei Liu, Zhengchao Zhao, Xiusi Chen,and Jun Gao. 2018. ATRank: An attention-based user behavior modeling frame-work for recommendation. In AAAI.
[33]
Guorui Zhou, Na Mou, Ying Fan, Qi Pi, Weijie Bian, Chang Zhou, Xiaoqiang Zhu, and Kun Gai. 2019. Deep interest evolution network for click-through rate prediction. In AAAI, Vol. 33. 5941--5948.
[34]
Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep interest network for click-through rate prediction. In KDD. ACM, 1059--1068.

Cited By

View all
  • (2025)Efficient Personalization in E-Commerce: Leveraging Universal Customer Representations with EmbeddingsJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer2001001220:1(12)Online publication date: 16-Jan-2025
  • (2024)It’s Not Always about Wide and Deep Models: Click-Through Rate Prediction with a Customer Behavior-Embedding RepresentationJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer1901000819:1(135-151)Online publication date: 12-Jan-2024
  • (2024)Deep Evolutional Instant Interest Network for CTR Prediction in Trigger-Induced RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635829(846-854)Online publication date: 4-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management
October 2020
3619 pages
ISBN:9781450368599
DOI:10.1145/3340531
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. attention
  2. e-commerce recommendation
  3. information dissemination
  4. recurrent neural network
  5. sequential recommendation

Qualifiers

  • Research-article

Conference

CIKM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)62
  • Downloads (Last 6 weeks)4
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Efficient Personalization in E-Commerce: Leveraging Universal Customer Representations with EmbeddingsJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer2001001220:1(12)Online publication date: 16-Jan-2025
  • (2024)It’s Not Always about Wide and Deep Models: Click-Through Rate Prediction with a Customer Behavior-Embedding RepresentationJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer1901000819:1(135-151)Online publication date: 12-Jan-2024
  • (2024)Deep Evolutional Instant Interest Network for CTR Prediction in Trigger-Induced RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635829(846-854)Online publication date: 4-Mar-2024
  • (2024)User Response Modeling in Reinforcement Learning for Ads AllocationCompanion Proceedings of the ACM Web Conference 202410.1145/3589335.3648310(131-140)Online publication date: 13-May-2024
  • (2024)Push4Rec: Temporal and Contextual Trend-Aware Transformer Push Notification RecommenderICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10447336(6625-6629)Online publication date: 14-Apr-2024
  • (2024)Target - Attention Network for Click - Through Rate Prediction2024 IEEE 3rd International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA)10.1109/EEBDA60612.2024.10486031(366-370)Online publication date: 27-Feb-2024
  • (2024)An Innovative Personalized Recommendation Approach Based on Deep Learning and User Review ContentIEEE Access10.1109/ACCESS.2024.344774712(118214-118226)Online publication date: 2024
  • (2024)STAR: A session-based time-aware recommender systemNeurocomputing10.1016/j.neucom.2023.127104573(127104)Online publication date: Mar-2024
  • (2023)TEE: Real-Time Purchase Prediction Using Time Extended Embeddings for Representing Customer BehaviorJournal of Theoretical and Applied Electronic Commerce Research10.3390/jtaer1803007018:3(1404-1418)Online publication date: 17-Aug-2023
  • (2023)MDDL: A Framework for Reinforcement Learning-based Position Allocation in Multi-Channel FeedProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3592018(2159-2163)Online publication date: 19-Jul-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media