Ye Yuan
ABSTRACT
Recommender systems (RSs) commonly describe its user-item preferences with a high-dimensional and sparse (HiDS) matrix filled with non-negative data. A non-negative latent factor (NLF) model relying on a single latent factor-dependent, non-negative and multiplicative update (SLF-NMU) algorithm is frequently adopted to process such an HiDS matrix. However, an NLF model mostly adopts Euclidean distance for its objective function, which is naturally a special case of α-β-divergence. Moreover, it frequently suffers slow convergence. For addressing these issues, this study proposes a generalized and fast-converging non-negative latent factor (GFNLF) model. Its main idea is two-fold: a) adopting α-β-divergence for its objective function, thereby enhancing its representation ability for HiDS data; b) deducing its momentum-incorporated non-negative multiplicative update (MNMU) algorithm, thereby achieving its fast convergence. Empirical studies on two HiDS matrices emerging from real RSs demonstrate that with carefully-tuned hyperparameters, a GFNLF model outperforms state-of-the-art models in both computational efficiency and prediction accuracy for missing data of an HiDS matrix.
- Paul Resnick and Hal R. Varian. 1997. Recommender systems. Communications of the ACM 40, 3 (1997), 56-59.Google Scholar
Digital Library
- Chao Wang, Qi Liu, Runze Wu, Enhong Chen, Chuanren Liu, Xunpeng Huang, and Zhenya Huang. 2018. Confidence-Aware Matrix Factorization for Recommender Systems. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI). 434-442.Google Scholar
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings Of the 26th International Conference on World Wide Web (WWW). 173-182.Google ScholarDigital Library
- Gábor Takács, István Pilászy, Bottyán Németh, and Domonkos Tikk. 2009. Scalable Collaborative Filtering Approaches for Large Recommender Systems. Journal of Machine Learning Research 10, 623-656.Google ScholarDigital Library
- Tianqiao Liu, Zhiwei Wang, Jiliang Tang, Songfan Yang, Gale Yan Huang, and Zitao Liu. 2019. Recommender Systems with Heterogeneous Side Information. In Proceedings Of the 28th International Conference on World Wide Web (WWW). 3027-3033.Google ScholarDigital Library
- Cen Chen, Peilin Zhao, Longfei Li, Jun Zhou, Xiaolong Li, and Minghui Qiu. 2017. Locally connected deep learning framework for industrial-scale recommender systems. In Proceedings Of the 26th International Conference on World Wide Web (WWW). 769-770.Google ScholarDigital Library
- Xin Luo, Mengchu Zhou, Shuai Li, Zhuhong You, Yunni Xia, and Qingsheng Zhu. 2016. A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction Method. IEEE Transactions on Neural Networks and Learning Systems 27, 3 (2016), 579-592.Google ScholarCross Ref
- Trong Dinh Thac Do and Longbing Cao. 2018. Coupled poisson factorization integrated with user/item metadata for modeling popular and sparse ratings in scalable recommendation. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI). 2918-2925.Google Scholar
- Jing Lin, Weike Pan, and Zhong Ming. 2018. MF-DMPC: Matrix Factorization with Dual Multiclass Preference Context for Rating Prediction. In Proceedings of the International Conference on Web Services (ICWS). 337-349.Google ScholarDigital Library
- James Chambua, Zhendong Niu, and Yifan Zhu. 2019. User preferences prediction approach based on embedded deep summaries. Expert Systems with Applications 132, 87-98.Google ScholarDigital Library
- Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. In Proceedings of the 28th International Conference on World Wide Web (WWW). 151-161.Google ScholarDigital Library
- Qiang Liu, Shu Wu, Liang Wang. 2017. DeepStyle: Learning user preferences for visual recommendation. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 841-844.Google ScholarDigital Library
- Xin Luo, MengChu Zhou, Yunni Xia, Qingsheng Zhu, Ahmed Chiheb Ammari, and Ahmed Alabdulwahab. 2016. Generating Highly Accurate Predictions for Missing QoS Data via Aggregating Nonnegative Latent Factor Models. IEEE Transactions on Neural Networks and Learning Systems 27, 3 (2016), 524-537.Google ScholarCross Ref
- Xin Dong, Lei Yu, Zhonghuo Wu, Yuxia Sun, Lingfeng Yuan, and Fangxi Zhang. 2017. A hybrid collaborative filtering model with deep structure for recommender systems. In Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI). 1309-1315.Google Scholar
- Hao Ma, Irwin King, and Michael R. Lyu. 2009. Learning to recommend with social trust ensemble. in Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 203-210.Google Scholar
- Tavi Nathanson, Ephrat Bitton, and Kenneth Y. Goldberg. 2007. Eigentaste 5.0: constant-time adaptability in a recommender system using item clustering. In Proceedings of the ACM conference on Recommender systems (RecSys). 149-152.Google Scholar
- Dimitrios Rafailidis and Alexandros Nanopoulos. 2015. Modeling users preference dynamics and side information in recommender systems. IEEE Transactions on Systems, Man, and Cybernetics 46, 6 (2015), 782-792.Google ScholarCross Ref
- Guangneng Hu, Xinyu Dai, Fengyu Qiu, Rui Xia, Tao Li, Shujian Huang, and Jiajun Chen. 2018. Collaborative filtering with topic and social latent factors incorporating implicit feedback. ACM Transactions on Knowledge Discovery from Data 12, 2 (2018), 1-23.Google Scholar
- Yehuda Koren, Robert M. Bell, and Chris Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. IEEE Computer 42, 8 (2009), 30-37.Google ScholarDigital Library
- Ye Yuan, Xin Luo, and Mingsheng Shang. 2018. Effects of preprocessing and training biases in latent factor models for recommender systems. Neurocomputing 275, 2019-2030.Google ScholarDigital Library
- Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan S. Kankanhalli. 2018. Aspect-aware latent factor model: Rating prediction with ratings and reviews. In Proceedings Of the 27th International Conference on World Wide Web (WWW). 639-648.Google Scholar
- Guibing Guo, Jie Zhang, and Neil Yorke-Smith. 2015. TrustSVD: collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI). 123-129.Google Scholar
- Hao Li, Keqin Li, Jiyao An, Weihua Zheng, and Kenli Li. 2019. An efficient manifold regularized sparse non-negative matrix factorization model for large-scale recommender systems on GPUs. Information Sciences 496, 464-484.Google ScholarCross Ref
- Jing Lin, Weike Pan, and Zhong Ming. 2018. MF-DMPC: Matrix Factorization with Dual Multiclass Preference Context for Rating Prediction. In Proceedings of International Conference on Web Services (ICWS). 337-349.Google ScholarDigital Library
- Sheng Zhang, Weihong Wang, James Ford, and Fillia Makedon. 2006. Learning from Incomplete Ratings Using Non-negative Matrix Factorization. In Proceedings of the International Conference on Data Mining (ICDM). 549-553.Google ScholarCross Ref
- Daniel D. Lee and H. Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 788-791.Google ScholarCross Ref
- Yangyang Xu, Wotao Yin, Zaiwen Wen, and Yin Zhang. 2012. An alternating direction algorithm for matrix completion with nonnegative factors. Frontiers of Mathematics in China 7, 2 (2012), 365-384.Google ScholarCross Ref
- Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 8th International Conference on Data Mining (ICDM). 263-272.Google ScholarDigital Library
- Antonio Hernando, Jesús Bobadilla, and Fernando Ortega. 2016. A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowledge-Based Systems 97, 188-202.Google ScholarDigital Library
- Andrzej Cichocki, Sergio Cruces, and Shun-ichi Amari. 2011. Generalized alpha-beta divergences and their application to robust nonnegative matrix factorization. Entropy 13, 1 (2011), 134-170.Google ScholarCross Ref
- Jin Shang and Mingxuan Sun. 2018. Local Low-Rank Hawkes Processes for Temporal User-Item Interactions. In Proceedings of the International Conference on Data Mining (ICDM). 27-436.Google ScholarCross Ref
- Stephen Boyd and Lieven Vandenberghe. 2009. Convex Optimization. Cambridge University Press.Google ScholarDigital Library
- Jonathan L. Herlocker, Joseph A. Konstan, Loren G. Terveen, and John Riedl. 2004. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems 22, 1 (2004), 5-53.Google ScholarDigital Library
- Joseph A. Konstan, Bradley N. Miller, David Maltz, Jonathan L. Herlocker, Lee R. Gordon, and John Riedl. 1997. GroupLens: applying collaborative filtering to Usenet news. Communications of the ACM 40, 3 (1997), 77-87.Google ScholarDigital Library
- Lukas Brozovsky and Vaclav Petricek. 2007. Recommender system for online dating service. eprint arXiv:cs/0703042.Google Scholar
- Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. AutoRec: Autoencoders Meet Collaborative Filtering. In Proceedings of the 24th International Conference on World Wide Web. 111-112.Google ScholarDigital Library
- Qingxian Wang, Binbin Peng, Xiaoyu Shi, Tianqi Shang, and Mingsheng Shang. 2019. DCCR: Deep Collaborative Conjunctive Recommender for Rating Prediction. IEEE Access 7, 60186-60198.Google ScholarCross Ref
- Pablo Ribalta Lorenzo, Jakub Nalepa, Michal Kawulok, Luciano Sánchez Ramos, and José Ranilla Pastor. 2017. Particle swarm optimization for hyper-parameter selection in deep neural networks. In Proceedings of the ACM International Conference on Genetic and Evolutionary Computation (GECCO). 481-488.Google ScholarDigital Library
- Shuai Li, Alexandros Karatzoglou, and Claudio Gentile. 2016. Collaborative filtering bandits. In Proceedings of the 39th International conference on Research and Development in Information Retrieval (SIGIR). 539-548.Google ScholarDigital Library
- Claudio Gentile, Shuai Li, Purushottam Kar, Alexandros Karatzoglou, Giovanni Zappella, and Evans Etrue. 2017. On Context-Dependent Clustering of Bandits. In Proceedings of the 34th International Conference on Machine Learning (ICML). 1253-1262.Google Scholar
- Antoine Bordes, Nicolas Usunier, Alberto García Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of advances in neural information processing systems (NIPS). 2787-2795.Google Scholar
Index Terms
- A Generalized and Fast-converging Non-negative Latent Factor Model for Predicting User Preferences in Recommender Systems
Index terms have been assigned to the content through auto-classification.
Recommendations
A New Approach for Recommender System
ICACS '17: Proceedings of the 1st International Conference on Algorithms, Computing and SystemsIn today's e-commerce environment, Collaborative Filtering (CF) is a widely used algorithm for recommender system, which is to identify the users who have similar preferences to the target user, and to predict the preference of the target user according ...
Improving collaborative filtering recommendations by estimating user preferences from clickstream data
Highlights- We propose a method for creating a user-item rating matrix of high quality.
- Our ...
AbstractFor practical applications of collaborative filtering, we need a user-item rating matrix that encodes user preferences for items. However, estimation of user preferences is inevitably affected by some degree of noise, which can ...
Incorporating user rating credibility in recommender systems
AbstractThere have been many research efforts aimed at improving recommendation accuracy with Collaborative Filtering (CF). Yet there is still a lack of investigation into the integration of CF algorithms with the analysis of users’ rating behaviors. In ...
Comments