Qiaojun Chen
ABSTRACT
Click-through rate prediction is a core research issue in recommendation systems and online advertising, playing a pivotal role in the entire Internet field. This article mainly integrates the LSTM module and the attention module into the DeepFM framework, and proposes LDeepFM and LADeepFM which can extract time series information more effectively. We use real data sets to evaluate the prediction performance of the model. The experiment results demonstrate that our proposed approach can increase the accuracy of click-through rate prediction more effectively than traditional models.
- Richardson M, Dominowska E, Ragno R. Predicting clicks: estimating the click-through rate for new ads[C]//Proceedings of the 16th international conference on World Wide Web. 2007: 521--530.Google Scholar
- McMahan H B, Holt G, Sculley D, et al. Ad click prediction: a view from the trenches[C]//Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 2013: 1222--1230.Google Scholar
- McMahan H B, Holt G, Sculley D, et al. Ad click prediction: a view from the trenches[C]//Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 2013: 1222--1230.Google Scholar
- Blondel M, Ishihata M, Fujino A, et al. Polynomial networks and factorization machines: New insights and efficient training algorithms[J]. arXiv preprint arXiv:1607.08810, 2016.Google Scholar
- Rendle S. Factorization machines[C]//2010 IEEE International Conference on Data Mining. IEEE, 2010: 995--1000.Google Scholar
- Zhang W, Du T, Wang J. Deep learning over multi-field categorical data[C]//European conference on information retrieval. Springer, Cham, 2016: 45--57.Google Scholar
- Qu Y., Cai H., Ren K., et al. Product-based neural networks for user response prediction[C]. Data Mining (ICDM), 2016 IEEE 16th International Conference on, 2016, IEEE: 1149--1154Google ScholarCross Ref
- Cheng H T, Koc L, Harmsen J, et al. Wide & Deep Learning for Recommender Systems[J]. 2016.Google ScholarDigital Library
- Guo H, Tang R, Ye Y, et al. DeepFM: a factorization-machine based neural network for CTR prediction[J]. arXiv preprint arXiv:1703.04247, 2017.Google Scholar
- Oentaryo R J, Lim E P, Low J W, et al. Predicting response in mobile advertising with hierarchical importance-aware factorization machine[C]//Proceedings of the 7th ACM international conference on Web search and data mining. 2014: 123--132.Google Scholar
- Juan Y, Zhuang Y, Chin W S, et al. Field-aware factorization machines for CTR prediction[C]//Proceedings of the 10th ACM Conference on Recommender Systems. 2016: 43--50.Google Scholar
- Graepel T, Candela J Q, Borchert T, et al. Web-scale bayesian click-through rate prediction for sponsored search advertising in microsoft's bing search engine[C]. Omnipress, 2010.Google Scholar
- Koren Y. Factorization meets the neighborhood: a multifaceted collaborative filtering model[C]//Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 2008: 426--434.Google Scholar
- Wang R, Fu B, Fu G, et al. Deep & cross network for ad click predictions[M]//Proceedings of the ADKDD'17. 2017: 1--7.Google Scholar
- Zaremba W, Sutskever I, Vinyals O. Recurrent neural network regularization[J]. arXiv preprint arXiv:1409.2329, 2014.Google Scholar
- Hochreiter S, Schmidhuber J. Long short-term memory[J]. Neural computation, 1997, 9(8): 1735--1780.Google ScholarDigital Library
- Greff K, Srivastava R K, Koutník J, et al. LSTM: A search space odyssey[J]. IEEE transactions on neural networks and learning systems, 2016, 28(10): 2222--2232.Google Scholar
- Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate[J]. arXiv preprint arXiv:1409.0473, 2014.Google Scholar
- Mnih V, Heess N, Graves A. Recurrent models of visual attention[C]//Advances in neural information processing systems. 2014: 2204--2212.Google Scholar
- Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate[J]. arXiv preprint arXiv:1409.0473, 2014.Google Scholar
- Li L, Greene T, Hu B. A simple method to estimate the time-dependent receiver operating characteristic curve and the area under the curve with right censored data[J]. Statistical methods in medical research, 2018, 27(8): 2264--2278.Google Scholar
- Vovk V. The fundamental nature of the log loss function[M]//Fields of Logic and Computation II. Springer, Cham, 2015: 307--318.Google Scholar
Index Terms
- Improved CTR Prediction Algorithm based on LSTM and Attention
Recommendations
An Attention-based Deep Network for CTR Prediction
ICMLC '20: Proceedings of the 2020 12th International Conference on Machine Learning and ComputingClick-through rate (CTR) prediction is a crucial topic in online advertising system. Early researchers proposed numerous shallow models to analyze this issue, such as logistic regression, factorization machines and Gradient boosting decision tree. In ...
Predicting CTR of new ads via click prediction
CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge managementPredicting CTR of ads on the search result page is an urgent topic. The reason for this is that choosing the right advertisement greatly affects revenue of the search engine and advertisers and user's satisfaction. For ads with the large click history ...
Deep Spatio-Temporal Attention Network for Click-Through Rate Prediction
Intelligent Computing MethodologiesAbstractIn online advertising systems, predicting the click-through rate (CTR) is an important task. Many studies only consider targeted advertisements in isolation, but do not focus on its relationship with other ads that may affect the CTR. We look at a ...
Comments