Abstract
Due to the absence of historical ratings of new users/items, cold-start recommendation remains a challenge for collaborative filtering. Many matrix factorization based methods are used to predict new user’s/item’s latent profile before predicting ratings. This kind of methods is usually non-convex. In this work, we design a new convex framework for cold-start recommendations, multi-level preference regression (MPR), directly to predict the ratings rather than latent profiles. We suppose that ratings are mainly affected by three components: (1) correlation between user’s attributes (such as age and gender) and item’s attributes (such as genre and producer); (2) each user’s preference on item’s attributes; (3) item’s popularity in a group of users with some attributes. Adjusting the impact of the three components, we can tackle three cold-start scenarios of user, item, and system. In the MPR framework, three different learning strategies are discussed: pointwise regression, pairwise regression, and large-margin learning. Experimental results on three datasets demonstrate that the proposed model can achieve the state of the art in the user cold-start scenario and the best performance in other scenarios.
Similar content being viewed by others
References
Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J (1994) Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings of the 1994 ACM conference on computer supported cooperative work. ACM, pp 175–186
Park DH, Kim HK, Choi IY, Kim JK (2012) A literature review and classification of recommender systems research. Expert Syst Appl 39(11):10059–10072
Ricci F, Rokach L, Shapira B (2015) Recommender systems: introduction and challenges. In: Recommender systems handbook. Springer, pp 1–34
Lu J, Wu D, Mao M, Wang W, Zhang G (2015) Recommender system application developments: a survey. Decis Support Syst 74:12–32
Park Y, Park S, Jung W, Lee SG (2015) Reversed cf: a fast collaborative filtering algorithm using a k-nearest neighbor graph. Expert Syst Appl 42(8):4022–4028
Rao N, Yu HF, Ravikumar PK, Dhillon IS (2015) Collaborative filtering with graph information: Consistency and scalable methods. In: Advances in neural information processing systems, pp 2107–2115
Lee J, Sun M, Lebanon G (2012) A comparative study of collaborative filtering algorithms. arXiv:1205.3193 [cs.IR] (arXiv preprint)
Park ST, Chu W (2009) Pairwise preference regression for cold-start recommendation. In: Proceedings of the third ACM conference on recommender systems. ACM, pp 21–28
Gantner Z, Drumond L, Freudenthaler C, Rendle S, Schmidt-Thieme L (2010) Learning attribute-to-feature mappings for cold-start recommendations. In: 2010 IEEE 10th international conference on data mining (ICDM), pp 176–185
Trevisiol M, Aiello LM, Schifanella R, Jaimes A (2014) Cold-start news recommendation with domain-dependent browse graph. In: Proceedings of the 8th ACM conference on recommender systems, RecSys ’14. ACM, pp 81–88
Ji K, Shen H (2015) Addressing cold-start: scalable recommendation with tags and keywords. Knowl-Based Syst 83:42–50
Wang Z, Liang J, Li R, Qian Y (2016) An approach to cold-start link prediction: establishing connections between non-topological and topological information. IEEE Trans Knowl Data Eng 28(11):2857–2870
Zhang X, Cheng J, Qiu S, Zhu G, Lu H (2015) DualDS: a dual discriminative rating elicitation framework for cold start recommendation. Knowl-Based Syst 73:161–172
Houlsby N, Hernandez-lobato JM, Ghahramani Z (2014) Cold-start active learning with robust ordinal matrix factorization. In: Proceedings of the 31st international conference on machine learning, pp 766–774
Sun M, Li F, Lee J, Zhou K, Lebanon G, Zha H (2013) Learning multiple-question decision trees for cold-start recommendation. In: Proceedings of the sixth ACM international conference on Web search and data mining. ACM, pp 445–454
Elahi M, Ricci F, Rubens N (2016) A survey of active learning in collaborative filtering recommender systems. Comput Sci Rev 20:29–50
Yan M, Sang J, Xu C, Hossain MS (2016) A unified video recommendation by cross-network user modeling. ACM Trans Multimed Comput Commun Appl 12(4):53
Sedhain S, Sanner S, Braziunas D, Xie L, Christensen J (2014) Social collaborative filtering for cold-start recommendations. In: Proceedings of the 8th ACM conference on recommender systems. ACM, pp 345–348
Qian X, Feng H, Zhao G, Mei T (2014) Personalized recommendation combining user interest and social circle. IEEE Tran Knowl Data Eng 26(7):1763–1777
Al-Shamri MYH (2016) User profiling approaches for demographic recommender systems. Knowl-Based Syst 100:175–187
Pereira ALV, Hruschka ER (2015) Simultaneous co-clustering and learning to address the cold start problem in recommender systems. Knowl-Based Syst 82:11–19
Ocepek U, Rugelj J, Bosnić Z (2015) Improving matrix factorization recommendations for examples in cold start. Expert Syst Appl 42(19):6784–6794
Zhao WX, Li S, He Y, Wang L, Wen JR, Li X (2016) Exploring demographic information in social media for product recommendation. Knowl Inf Syst 49(1):61–89
Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1235–1244
Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651
Li L, Li T (2013) News recommendation via hypergraph learning: encapsulation of user behavior and news content. In: Proceedings of the sixth ACM international conference on web search and data mining. ACM, pp 305–314
Lu K, Zhang Y, Zhang L, Wang S (2015) Exploiting user and business attributes for personalized business recommendation. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 891–894
Barjasteh I, Forsati R, Masrour F, Esfahanian AH, Radha H (2015) Cold-start item and user recommendation with decoupled completion and transduction. In: Proceedings of the 9th ACM conference on recommender systems, ACM, pp 91–98
Agarwal D, Chen BC (2009) Regression-based latent factor models. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining, New York, NY, USA. ACM, pp 19–28
Zhang L, Agarwal D, Chen BC (2011) Generalizing matrix factorization through flexible regression priors. In: Proceedings of the Fifth ACM conference on recommender systems, New York, NY, USA. ACM, pp 13–20
Peng F, Lu J, Wang Y, Yi-Da Xu R, Ma C, Yang J (2016) N-dimensional markov random field prior for cold-start recommendation. Neurocomputing 191:187–199
Saveski M, Mantrach A (2014) Item cold-start recommendations: learning local collective embeddings. In: Proceedings of the 8th ACM conference on recommender systems, pp 89–96
Herbrich R, Graepel T, Obermayer K (1999) Large margin rank boundaries for ordinal regression. In: Advances in neural information processing systems, pp 115–132
Lee CP, Lin CJ (2014) Large-scale linear ranksvm. Neural Comput 26(4):781–817
Bokde D, Girase S, Mukhopadhyay D (2015) Matrix factorization model in collaborative filtering algorithms: a survey. Proc Comput Sci 49:136–146
Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl-Based Syst 46:109–132
Barjasteh I, Forsati R, Ross D, Esfahanian AH, Radha H (2016) Cold-start recommendation with provable guarantees: a decoupled approach. IEEE Trans Knowl Data Eng 28(6):1462–1474
Nag B, Solutions SD (2008) Vibes: a platform-centric approach to building recommender systems. IEEE Data Eng Bull 31(2):23–31
Park ST, Pennock D, Madani O, Good N, DeCoste D (2006) Naïve filterbots for robust cold-start recommendations. In: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 699–705
Kula M (2015) Metadata embeddings for user and item cold-start recommendations. arXiv:1507.08439 [cs.IR] (arXiv preprint)
Cai JF, Candès EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982
Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of the 22th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, pp 785–794
Acknowledgements
This work is supported in part by the National Natural Science Foundation of China (NSFC) (Nos. 61233011 and 61672332), by Jiangsu Natural Science Foundation (No. BK20131351), by Science Foundation for The Excellent Youth Scholars of Ministry of Education of China (No. 61322211), by Program for the Innovative Talents of Higher Learning Institutions of Shanxi (No. 02150116072021), and Shanjin Scholars Program.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Peng, F., Lu, X., Ma, C. et al. Multi-level preference regression for cold-start recommendations. Int. J. Mach. Learn. & Cyber. 9, 1117–1130 (2018). https://doi.org/10.1007/s13042-017-0635-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-017-0635-2