Skip to main content
SpringerLink
Log in

Enhanced knowledge transfer for collaborative filtering with multi-source heterogeneous feedbacks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Collaborative filtering (CF) is a widely used method in recommender systems due to its simplicity and efficiency. But most existing CF methods suffer from data scarcity, which arises from the situation with only a limited number of interactions between users and items. One solution to address is how to introduce Transfer Learning (TL)-based CF methods with heterogeneous feedbacks to deal with multi-source and heterogeneous data, such as rating vs. clicks or rating vs. purchase. However, in some applications, extremely sparse (i.e., sparsity level ≤ 0.1%) target data could cause under-transfer and negative transfer. To address the above issue, we propose an Enhanced Knowledge Transfer for Collaborative Filtering with Multi-Source Heterogeneous Feedbacks (EKT). Specifically, we first propose a weighted collective matrix tri-factorization framework. The proposed framework constrains the auxiliary data and the target data to share the same latent factors of users and items as well as partial cluster-level user-item rating pattern in order to enhance knowledge transfer and alleviate the under-transfer issue. Then, to alleviate the negative transfer issue, we integrate the graph co-regularization terms into a proposed framework, which contains the neighborhood structure information of users and items. At last, we simultaneously minimize the objective function of EKT, which consists of weighted collective matrix tri-factorization and the graph co-regularization of user and item graphs. Since the EKT framework is a non-convex optimization problem, we use an alternating optimization procedure to solve it and further prove its convergence. The experimental results on two benchmark datasets show that our proposed EKT method performs better than other baseline methods at almost all sparsity levels except for the denser case of 1% on ML10M and Netflix.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. http://grouplens.org/datasets/movielens/

  2. http://www.netflix.com.

References

  1. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749

    Article  Google Scholar 

  2. Belkin M, Niyogi P (2002) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Proc 16th con Adv Neural inform Process Syst (NIPS), Vancouver, British Columbia, Canada, pp 585–591

  3. Bell RM, Koren Y (2007) Scalable collaborative filtering with jointly derived neighborhood interpolation weights. In: Proc 7th IEEE int Conf Data min (ICDM), Omaha Nebraska, vol 7, pp 43–52

  4. Cai D, He X, Han J, Huang TS (2010) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560

    Google Scholar 

  5. Cai D, He X, Wang X, Bao H, Han J (2009) Locality preserving nonnegative matrix factorization. In: Proc 21st int Joint conf Artif Intell (IJCAI), Pasadena, California, USA, pp 1010–1015

  6. Chen G, Wang F, Zhang C (2009) Collaborative filtering using orthogonal nonnegative matrix tri-factorization. Inform Process Manag 45(3):368–379

    Article  Google Scholar 

  7. Chen J, Zhang H, He X, Nie L, Liu W, Chua TS (2017) Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In: Proc 40th int ACM SIGIR conf Res Dev Inform Retrieval, Tokyo, Japan, pp 335–344

  8. Covington P, Adams J, Sargin E (2016) Deep neural networks for youtube recommendations. In: Proc 10th ACM conf Rec Syst (recsys), Boston,USA, pp 191–198

  9. Deshpande M, Karypis G (2004) Item-based top-n recommendation algorithms. ACM Trans Inform Syst (TOIS) 22(1):143–177

    Article  Google Scholar 

  10. Gao S, Luo H, Chen D, Li S, Gallinari P, Guo J (2013) Cross-domain recommendation via cluster-level latent factor model. In: Proc Eur Conf Mach Learn Knowl Disc Databases (ECML/PKDD), Prague, Czech Republic, pp 161–176

  11. Gu Q, Zhou J, Ding C (2010) Collaborative filtering: Weighted nonnegative matrix factorization incorporating user and item graphs. In: Proc 10th SIAM int Conf on data mining(SDM), Columbus, USA, pp 199–210

  12. Hao P, Zhang G, Martinez L, Lu J (2017) Regularizing knowledge transfer in recommendation with tag-inferred correlation. IEEE Trans Cybern 49 (1):83–96

    Article  Google Scholar 

  13. He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: Proc 26th int Conf World wide web(WWW), Perth, Western Australia, Australia, pp 173–182

  14. Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a bayesian probabilistic model. Knowl-Based Syst 97:188– 202

    Article  Google Scholar 

  15. Hu G, Zhang Y, Yang Q (2018) Conet: Collaborative cross networks for cross-domain recommendation. In: Proc 27th ACM int Conf Inform Knowl Manag (CIKM), Turin, Italy, pp 667–676

  16. Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. In: Proc 15th adv Neural inform Process Syst (NIPS), Vancouver, British Columbia, Canada, pp 556–562

  17. Li B (2011) Cross-domain collaborative filtering: A brief survey. In: Proc. 23rd IEEE int Conf Tools artif Intell (ICTAI), Boca Raton, Florida, USA, pp 1085–1086

  18. Li B, Yang Q, Xue X (2009) Can movies and books collaborate? cross-domain collaborative filtering for sparsity reduction. In: Proc 21st int Joint conf Artif Intell (IJCAI), Pasadena, California, USA, pp 2052–2057

  19. Li B, Yang Q, Xue X (2009) Transfer learning for collaborative filtering via a rating-matrix generative model. In: Proc 26th annu Int Conf Mach Learn (ICML), Montreal, QC, Canada, pp 617–624

  20. Li B, Zhu X, Li R, Zhang C (2014) Rating knowledge sharing in cross-domain collaborative filtering. IEEE Trans Cybern 45(5):1068–1082

    Google Scholar 

  21. Long M, Wang J, Ding G, Shen D, Yang Q (2013) Transfer learning with graph co-regularization. IEEE Trans Knowl Data Eng 26(7):1805–1818

    Article  Google Scholar 

  22. Lu Z, Zhong E, Zhao L, Xiang EW, Pan W, Yang Q (2013) Selective transfer learning for cross domain recommendation. In: Proc 13th SIAM int Conf Data mining(SDM), Austin, Texas, USA, pp 641– 649

  23. Ma H, Yang H, Lyu MR, King I (2008) Sorec: Social recommendation using probabilistic matrix factorization. In: Proc 17th ACM conf Inform Knowl Manag (CIKM), Napa, California, USA, pp 931–940

  24. Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization. In: Proc Adv Neural inform Process Syst (NIPS), Vancouver, Canada, pp 1257–1264

  25. Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  26. Pan W (2016) A survey of transfer learning for collaborative recommendation with auxiliary data. Neurocomputing 177:447–453

    Article  Google Scholar 

  27. Pan W, Liu NN, Xiang EW, Yang Q (2011) Transfer learning to predict missing ratings via heterogeneous user feedbacks. In: Proc 22nd int Joint conf Artif Intell (IJCAI), Barcelona, Catalonia, Spain, pp 2318–2323

  28. Pan W, Ming Z (2014) Interaction-rich transfer learning for collaborative filtering with heterogeneous user feedback. IEEE Intell Syst 29(6):48–54

    Article  Google Scholar 

  29. Pan W, Xia S, Liu Z, Peng X, Ming Z (2016) Mixed factorization for collaborative recommendation with heterogeneous explicit feedbacks. Inform Sci 332:84–93

    Article  Google Scholar 

  30. Pan W, Xiang EW, Liu NN, Yang Q (2010) Transfer learning in collaborative filtering for sparsity reduction. In: 230–235

  31. Pan W, Yang Q (2013) Transfer learning in heterogeneous collaborative filtering domains. Artif Intell 197:39–55

    Article  MathSciNet  Google Scholar 

  32. Sarwar BM, Karypis G, Konstan JA, Riedl J, et al. (2001) Item-based collaborative filtering recommendation algorithms. In: Proc 10th int Conf World wide web (WWW), Hong Kong, China, vol 1, pp 285–295

  33. Shi J, Long M, Liu Q, Ding G, Wang J (2013) Twin bridge transfer learning for sparse collaborative filtering. In: Pacific-asia conf Knowl Discov Data mining, Gold Coast, Australia, pp 496–507

  34. Sindhwani V, Bucak S, Hu J, Mojsilovic A (2009) A family of non-negative matrix factorizations for one-class collaborative filtering problems. In: Proc 3rd ACM conf Rec Syst, (recsys). New york, NY, USA

  35. Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: Proc. 14th ACM SIGKDD int Conf Knowl Discov Data mining(KDD), Las Vegas, NV, USA, pp 650–658

  36. Smith B, Linden G (2017) Two decades of recommender systems at amazon. com. IEEE Int Comput 21(3):12–18

    Article  Google Scholar 

  37. Srebro N, Rennie J, Jaakkola TS (2005) Maximum-margin matrix factorization. In: Proc 19th conf Adv Neural inform Process Syst (NIPS), Vancouver, British Columbia, Canada, pp 1329–1336

  38. Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009(4)

  39. Wu L, Sun P, Hong R, Ge Y, Wang M (2018) Collaborative neural social recommendation. IEEE Trans Syst Man Cybern Syst 1–13

  40. Yang B, Lei Y, Liu J, Li W (2016) Social collaborative filtering by trust. IEEE Trans Pattern Anal Mach Intell 39(8):1633–1647

    Article  Google Scholar 

  41. Zhang H, Ni W, Li X, Yang Y (2018) Modeling the heterogeneous duration of user interest in time-dependent recommendation: A hidden semi-markov approach. IEEE Trans Syst Man Cybern Syst 48(2):177–194

    Article  Google Scholar 

  42. Zhang M, Guo X, Chen G (2016) Prediction uncertainty in collaborative filtering: Enhancing personalized online product ranking. Decis Support Syst 83:10–21

    Article  Google Scholar 

  43. Zhang Q, Lu J, Wu D, Zhang G (2019) A cross-domain recommender system with kernel-induced knowledge transfer for overlapping entities. IEEE Trans Neural Netw 30(7):1998–2012

    Article  Google Scholar 

  44. Zhang Q, Wu D, Lu J, Liu F, Zhang G (2017) A cross-domain recommender system with consistent information transfer. Decis Support Syst 104:49–63

    Article  Google Scholar 

  45. Zhang S, Wang W, Ford J, Makedon F (2006) Learning from incomplete ratings using non-negative matrix factorization. In: Proc 6th SIAM int Conf Data min (SDM), Bethesda, MD, USA, pp 549–553

  46. Zhao L, Pan SJ, Yang Q (2017) A unified framework of active transfer learning for cross-system recommendation. Artif Intell 245:38–55

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the Foundation for Innovative Research Groups of the National Natural Science Foundation of China (71421001), and in part by the National Natural Science Foundation of China (61772111).

Author information

Authors and Affiliations

  1. School of Information and Communication Engineering, Dalian University of Technology, Dalian, 116024, China

    Hongwei Zhang

  2. School of Mathematics, Tonghua Normal University, Tonghua, 134002, China

    Hongwei Zhang

  3. Department of Data Science and Engineering Management, Zhejiang University, Hangzhou, 310058, China

    Xiangwei Kong

  4. School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, 19104-6391, USA

    Yujia Zhang

Authors
  1. Hongwei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiangwei Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yujia Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiangwei Kong.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, H., Kong, X. & Zhang, Y. Enhanced knowledge transfer for collaborative filtering with multi-source heterogeneous feedbacks. Multimed Tools Appl 80, 24245–24270 (2021). https://doi.org/10.1007/s11042-021-10834-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10834-y

Keywords

Search

Navigation