skip to main content
10.1145/3123266.3123361acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Deep Low-rank Sparse Collective Factorization for Cross-Domain Recommendation

Published:19 October 2017Publication History

ABSTRACT

In cross-domain recommendation, data sparsity becomes more and more serious when the ratings are expressed numerically, e.g., 5-star grades. In this work, we focus on borrowing the knowledge from other domains in the form of binary ratings, such as likes and dislikes for certain items. Most existing works conventionally assume that multiple domains share some common latent information across users and items. In practice, however, the related domains not only share the common latent feature of users and items, but also share some knowledge of rating patterns. Furthermore, conventional methods did not consider the hierarchical structures (i.e., genre, sub genre, detailed-category) in real-world recommendation system. In this paper, we propose a novel Deep Low-rank Sparse Collective Factorization (DLSCF) to facilitate the cross-domain recommendation. Specifically, the low-rank sparse decomposition is adopted to capture the most shared rating patterns with low-rank constraint while integrating the domain-specific patterns with group-sparse scheme. Furthermore, we factorize the rating pattern matrix in multiple layers to obtain the user/item latent category affiliation matrices, which could indicate the affiliation relation between latent categories and latent sub-categories. Experimental results on MoviePilot and Netfilx datasets demonstrate the effectiveness of our proposed algorithm at various sparsity levels, by comparing it with several state-of-the-art approaches.

References

  1. Fabian Abel, Eelco Herder, Geert-Jan Houben, Nicola Henze, and Daniel Krause. 2013. Cross-system user modeling and personalization on the social web. User Modeling and User-Adapted Interaction Vol. 23, 2--3 (2013), 169--209.Google ScholarGoogle ScholarCross RefCross Ref
  2. Shlomo Berkovsky, Tsvi Kuflik, and Francesco Ricci. 2008. Mediation of user models for enhanced personalization in recommender systems. User Modeling and User-Adapted Interaction Vol. 18, 3 (2008), 245--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jian-Feng Cai, Emmanuel J Candès, and Zuowei Shen. 2010. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization Vol. 20, 4 (2010), 1956--1982.Google ScholarGoogle ScholarCross RefCross Ref
  4. Bin Cao, Nathan N Liu, and Qiang Yang. 2010. Transfer learning for collective link prediction in multiple heterogenous domains Proceedings of the 27th International Conference on Machine Learning (ICML-10). 159--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Paolo Cremonesi and Massimo Quadrana. 2014. Cross-domain recommendations without overlapping data: myth or reality? Proceedings of the 8th ACM Conference on Recommender systems. ACM, 297--300. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Paolo Cremonesi, Antonio Tripodi, and Roberto Turri. 2011. Cross-domain recommender systems. In 11th International Conference on Data Mining Workshops. IEEE, 496--503. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Zhengming Ding and Yun Fu. 2014. Low-Rank Common Subspace for Multi-view Learning. IEEE International Conference on Data Mining. IEEE, 110--119. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Zhengming Ding, Ming Shao, and Yun Fu. 2014. Latent Low-Rank Transfer Subspace Learning for Missing Modality Recognition Twenty-Eighth AAAI Conference on Artificial Intelligence. 1192--1198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Zhengming Ding, Ming Shao, and Yun Fu. 2016. Deep Robust Encoder Through Locality Preserving Low-Rank Dictionary European Conference on Computer Vision. Springer, 567--582.Google ScholarGoogle Scholar
  10. Manuel Enrich, Matthias Braunhofer, and Francesco Ricci. 2013. Cold-start management with cross-domain collaborative filtering and tags. E-Commerce and Web Technologies.Google ScholarGoogle Scholar
  11. Ignacio Fernández-Tobías and Iván Cantador. 2014. Exploiting social tags in matrix factorization models for cross-domain collaborative filtering Proceedings of the 1st Workshop on New Trends in Content-based Recommender Systems, Foster City, California, USA. 34--41.Google ScholarGoogle Scholar
  12. Sheng Gao, Hao Luo, Da Chen, Shantao Li, Patrick Gallinari, and Jun Guo. 2013. Cross-domain recommendation via cluster-level latent factor model. Machine Learning and Knowledge Discovery in Databases. Springer, 161--176.Google ScholarGoogle Scholar
  13. Liang Hu, Jian Cao, Guandong Xu, Longbing Cao, Zhiping Gu, and Can Zhu. 2013. Personalized recommendation via cross-domain triadic factorization Proceedings of the 22nd international conference on World Wide Web. International World Wide Web Conferences Steering Committee, 595--606. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Shuhui Jiang, Xueming Qian, Tao Mei, and Yun Fu. 2016 a. Personalized travel sequence recommendation on multi-source big social media. IEEE Transactions on Big Data Vol. 2, 1 (2016), 43--56.Google ScholarGoogle ScholarCross RefCross Ref
  15. Shuhui Jiang, Xueming Qian, Jialie Shen, Yun Fu, and Tao Mei. 2015. Author topic model-based collaborative filtering for personalized POI recommendations. IEEE Transactions on Multimedia Vol. 17, 6 (2015), 907--918.Google ScholarGoogle ScholarCross RefCross Ref
  16. Shuhui Jiang, Ming Shao, Chengcheng Jia, and Yun Fu. 2016 b. Consensus Style Centralizing Auto-Encoder for Weak Style Classification. AAAI. 1223--1229. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Shuhui Jiang, Yue Wu, and Yun Fu. 2016 c. Deep Bi-directional Cross-triplet Embedding for Cross-Domain Clothing Retrieval Proceedings of the 2016 ACM on Multimedia Conference. ACM, 52--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Raghunandan Keshavan, Andrea Montanari, and Sewoong Oh. 2009. Matrix completion from noisy entries. In Advances in Neural Information Processing Systems. 952--960. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yehuda Koren. 2010. Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 4, 1 (2010), 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. C-H Lee, Y-H Kim, and P-K Rhee. 2001. Web personalization expert with combining collaborative filtering and association rule mining technique. Expert Systems with Applications Vol. 21, 3 (2001), 131--137.Google ScholarGoogle ScholarCross RefCross Ref
  21. Bin Li, Qiang Yang, and Xiangyang Xue. 2009 a. Can Movies and Books Collaborate? Cross-Domain Collaborative Filtering for Sparsity Reduction. IJCAI, Vol. Vol. 9. 2052--2057. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Bin Li, Qiang Yang, and Xiangyang Xue. 2009 b. Transfer learning for collaborative filtering via a rating-matrix generative model Proceedings of the 26th Annual International Conference on Machine Learning. ACM, 617--624. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Sheng Li, Jaya Kawale, and Yun Fu. 2015. Deep Collaborative Filtering via Marginalized Denoising Auto-encoder Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 811--820. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Guangcan Liu, Zhouchen Lin, and Yong Yu. 2010 a. Robust subspace segmentation by low-rank representation Proceedings of the 27th international conference on machine learning (ICML-10). 663--670. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Nathan N Liu, Evan W Xiang, Min Zhao, and Qiang Yang. 2010 b. Unifying explicit and implicit feedback for collaborative filtering Proceedings of the 19th ACM international conference on Information and knowledge management. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Yan-Fu Liu, Cheng-Yu Hsu, and Shan-Hung Wu. 2015. Non-Linear Cross-Domain Collaborative Filtering via Hyper-Structure Transfer. ICML. 1190--1198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Kai Lu, Guanyuan Zhang, Rui Li, Shuai Zhang, and Bin Wang. 2012. Exploiting and exploring hierarchical structure in music recommendation. Information Retrieval Technology. Springer, 211--225.Google ScholarGoogle Scholar
  28. Marcin Maleszka, Bernadetta Mianowska, and Ngoc Thanh Nguyen. 2013. A method for collaborative recommendation using knowledge integration tools and hierarchical structure of user profiles. Knowledge-Based Systems Vol. 47 (2013), 1--13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Andriy Mnih and Ruslan Salakhutdinov. 2007. Probabilistic matrix factorization. In Advances in neural information processing systems. 1257--1264. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Orly Moreno, Bracha Shapira, Lior Rokach, and Guy Shani. 2012. Talmud: transfer learning for multiple domains. In Proceedings of the 21st ACM international conference on Information and knowledge management. ACM, 425--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Weike Pan, Nathan N Liu, Evan W Xiang, and Qiang Yang. 2011. Transfer learning to predict missing ratings via heterogeneous user feedbacks IJCAI Proceedings-International Joint Conference on Artificial Intelligence, Vol. Vol. 22. 2318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Weike Pan, Evan Wei Xiang, Nathan Nan Liu, and Qiang Yang. 2010. Transfer Learning in Collaborative Filtering for Sparsity Reduction. AAAI, Vol. Vol. 10. 230--235. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Weike Pan and Qiang Yang. 2013. Transfer learning in heterogeneous collaborative filtering domains. Artificial intelligence Vol. 197 (2013), 39--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Shaghayegh Sahebi and Peter Brusilovsky. 2015. It takes two to tango: An exploration of domain pairs for cross-domain collaborative filtering Proceedings of the 9th ACM Conference on Recommender Systems. ACM, 131--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2000. Application of dimensionality reduction in recommender system-a case study. Technical Report. DTIC Document.Google ScholarGoogle Scholar
  36. Bracha Shapira, Lior Rokach, and Shirley Freilikhman. 2013. Facebook single and cross domain data for recommendation systems. User Modeling and User-Adapted Interaction Vol. 23, 2--3 (2013).Google ScholarGoogle ScholarCross RefCross Ref
  37. Ajit P Singh and Geoffrey J Gordon. 2008. Relational learning via collective matrix factorization Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 650--658. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Amit Tiroshi, Shlomo Berkovsky, Mohamed Ali Kaafar, Terence Chen, and Tsvi Kuflik. 2013. Cross social networks interests predictions based ongraph features Proceedings of the 7th ACM conference on Recommender systems. ACM, 319--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. George Trigeorgis, Konstantinos Bousmalis, Stefanos Zafeiriou, and Bjoern Schuller. 2014. A deep semi-nmf model for learning hidden representations Proceedings of the 31st International Conference on Machine Learning (ICML-14). 1692--1700. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Suhang Wang, Jiliang Tang, Yilin Wang, and Huan Liu. 2015. Exploring implicit hierarchical structures for recommender systems Proceedings of 24th International Joint Conference on Artificial Intelligence. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Zhangyang Wang, Shiyu Chang, Yingzhen Yang, Ding Liu, and Thomas S Huang. 2016. Studying very low resolution recognition using deep networks Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4792--4800.Google ScholarGoogle Scholar
  42. Yue Wu, Jun Li, Yu Kong, and Yun Fu. 2016. Deep Convolutional Neural Network with Independent Softmax for Large Scale Face Recognition Proceedings of the 2016 ACM on Multimedia Conference. ACM, 1063--1067. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Xin Xin, Zhirun Liu, Chin-Yew Lin, Heyan Huang, Xiaochi Wei, and Ping Guo. 2015. Cross-Domain Collaborative Filtering with Review Text. IJCAI. 1827--1834. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Junfeng Yang, Wotao Yin, Yin Zhang, and Yilun Wang. 2009. A fast algorithm for edge-preserving variational multichannel image restoration. SIAM Journal on Imaging Sciences Vol. 2, 2 (2009), 569--592. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Yu Zhang, Bin Cao, and Dit-Yan Yeung. 2012. Multi-domain collaborative filtering. arXiv preprint arXiv:1203.3535 (2012).Google ScholarGoogle Scholar
  46. Yi Zhang and Jiazhong Nie. 2010. Probabilistic latent relational model for integrating heterogeneous information for recommendation. Technical Report. Technical report, School of Engineering, UCSC.Google ScholarGoogle Scholar

Index Terms

  1. Deep Low-rank Sparse Collective Factorization for Cross-Domain Recommendation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '17: Proceedings of the 25th ACM international conference on Multimedia
      October 2017
      2028 pages
      ISBN:9781450349062
      DOI:10.1145/3123266

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 October 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      MM '17 Paper Acceptance Rate189of684submissions,28%Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader