Hangbin Zhang
Skip Abstract Section
Abstract
E-commerce platforms heavily rely on automatic personalized recommender systems, e.g., collaborative filtering models, to improve customer experience. Some hybrid models have been proposed recently to address the deficiency of existing models. However, their performances drop significantly when the dataset is sparse. Most of the recent works failed to fully address this shortcoming. At most, some of them only tried to alleviate the problem by considering either user side or item side content information. In this article, we propose a novel recommender model called Hybrid Variational Autoencoder (HVAE) to improve the performance on sparse datasets. Different from the existing approaches, we encode both user and item information into a latent space for semantic relevance measurement. In parallel, we utilize collaborative filtering to find the implicit factors of users and items, and combine their outputs to deliver a hybrid solution. In addition, we compare the performance of Gaussian distribution and multinomial distribution in learning the representations of the textual data. Our experiment results show that HVAE is able to significantly outperform state-of-the-art models with robust performance.
- Haoli Bai, Zhuangbin Chen, Michael R. Lyu, Irwin King, and Zenglin Xu. 2018. Neural relational topic models for scientific article analysis. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management.27–36. DOI:https://doi.org/10.1145/3269206.3271696Google Scholar
Digital Library
- Ziqiang Cao, Sujian Li, Yang Liu, Wenjie Li, and Heng Ji. 2015. A novel neural topic model and its supervised extension. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2210–2216.Google Scholar
- Dallas Card, Chenhao Tan, and Noah A Smith. 2017. A neural framework for generalized topic models. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.25.Google Scholar
- Dong-Kyu Chae, Jung Ah Shin, and Sang-Wook Kim. 2019. Collaborative adversarial autoencoders: An effective collaborative filtering model under the GAN framework. IEEE Access 7 (2019), 37650–37663.Google ScholarCross Ref
- Hung-Hsuan Chen. 2018. Behavior2Vec: Generating distributed representations of users’ behaviors on products for recommender systems. ACM Transactions on Knowledge Discovery from Data 12, 4 (2018), 43:1–43:20. DOI:https://doi.org/10.1145/3184454Google ScholarDigital Library
- Jindong Chen, Yizhou Hu, Jingping Liu, Yanghua Xiao, and Haiyun Jiang. 2019. Deep short text classification with knowledge powered attention. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, 21th Innovative Applications of Artificial Intelligence Conference,and 19th AAAI Symposium on Educational Advances in Artificial Intelligence. AAAI Press, 6252–6259. DOI:https://doi.org/10.1609/aaai.v33i01.33016252Google Scholar
- Yifan Chen and Maarten de Rijke. 2018. A collective variational autoencoder for top-n recommendation with side information. In Proceedings of the 3rd Workshop on Deep Learning for Recommender Systems. 3–9.Google ScholarDigital Library
- Adji B. Dieng, Chong Wang, Jianfeng Gao, and John W. Paisley. 2017. TopicRNN: A recurrent neural network with long-range semantic dependency. In Proceedings of the 5th International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=rJbbOLcex.Google Scholar
- Ali Mamdouh Elkahky, Yang Song, and Xiaodong He. 2016. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In Proceedings of the 24th International Conference on World Wide Web.278–288. DOI:https://doi.org/10.1145/2736277.2741667Google Scholar
- Le Fang, Chunyuan Li, Jianfeng Gao, Wen Dong, and Changyou Chen. 2019. Implicit deep latent variable models for text generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.), Association for Computational Linguistics, 3944–3954. DOI:https://doi.org/10.18653/v1/D19-1407Google Scholar
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT press.Google ScholarDigital Library
- Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Communications of the ACM 63, 11 (2020), 139–144. DOI:https://doi.org/10.1145/3422622Google ScholarDigital Library
- Palash Goyal and Emilio Ferrara. 2018. Graph embedding techniques, applications, and performance: A survey. Knowledge-Based Systems 151 (2018), 78–94. DOI:https://doi.org/10.1016/j.knosys.2018.03.022Google ScholarCross Ref
- Kilol Gupta, Mukund Yelahanka Raghuprasad, and Pankhuri Kumar. 2018. A hybrid variational autoencoder for collaborative filtering. arXiv:1808.01006. Retrieved from http://arxiv.org/abs/1808.01006.Google Scholar
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. Rick Barrett, Rick Cummings, Eugene Agichtein, and Evgeniy Gabrilovich (Eds.), International World Wide Web Conferences Steering Committee, ACM, 173–182. DOI:https://doi.org/10.1145/3038912.3052569Google ScholarDigital Library
- Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In Proceedings of the 22nd ACM International Conference on Information and Knowledge Management. ACM, 2333–2338.Google ScholarDigital Library
- Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. In Proceedings of the 2nd International Conference on Learning Representations (ICLR’14), Y. Bengio and Y. LeCun (Eds.).Google Scholar
- Yehuda Koren. 2009. Collaborative filtering with temporal dynamics. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 447–456.Google ScholarDigital Library
- Yehuda Koren, Robert M. Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37. DOI:https://doi.org/10.1109/MC.2009.263Google ScholarDigital Library
- Chenliang Li, Xichuan Niu, Xiangyang Luo, Zhenzhong Chen, and Cong Quan. 2019. A review-driven neural model for sequential recommendation. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI’19). ijcai.org, 2866–2872.Google ScholarCross Ref
- Xiaopeng Li and James She. 2017. Collaborative variational autoencoder for recommender systems. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 305–314. DOI:https://doi.org/10.1145/3097983.3098077Google ScholarDigital Library
- Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational autoencoders for collaborative filtering. In Proceedings of the 2018 World Wide Web Conference on World Wide Web.Pierre-Antoine Champin, Fabien Gandon, Mounia Lalmas, and Panagiotis G. Ipeirotis (Eds.), ACM, 689–698. DOI:https://doi.org/10.1145/3178876.3186150Google ScholarDigital Library
- Danyang Liu, Jianxun Lian, Shiyin Wang, Ying Qiao, Jiun-Hung Chen, Guangzhong Sun, and Xing Xie. 2020. KRED: Knowledge-aware document representation for news recommendations. In Proceedings of the14th ACM Conference on Recommender Systems, Virtual Event. Rodrygo L. T. Santos, Leandro Balby Marinho, Elizabeth M. Daly, Li Chen, Kim Falk, Noam Koenigstein, and Edleno Silva de Moura (Eds.), ACM, 200–209. DOI:https://doi.org/10.1145/3383313.3412237Google Scholar
- Donghua Liu, Jing Li, Bo Du, Jun Chang, and Rong Gao. 2019. DAML: Dual attention mutual learning between ratings and reviews for item recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 344–352.Google ScholarDigital Library
- Jianxin Ma, Chang Zhou, Peng Cui, Hongxia Yang, and Wenwu Zhu. 2019. Learning disentangled representations for recommendation. In Proceedings of the 32nd Annual Conference on Neural Information Processing Systems. Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.), 5712–5723. Retrieved from https://proceedings.neurips.cc/paper/2019/hash/a2186aa7c086b46ad4e8bf81e2a3a19b-Abstract.html.Google Scholar
- Chris J. Maddison, Andriy Mnih, and Yee Whye Teh. 2017. The concrete distribution: A continuous relaxation of discrete random variables. In Proceedings of the 5th International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=S1jE5L5gl.Google Scholar
- Yunchen Pu, Zhe Gan, Ricardo Henao, Xin Yuan, Chunyuan Li, Andrew Stevens, and Lawrence Carin. 2016. Variational autoencoder for deep learning of images, labels and captions. In Proceedings of the 30th International Conference on Neural Information Processing Systems. 2352–2360.Google Scholar
- Ahmed Rashed, Shayan Jawed, Lars Schmidt-Thieme, and Andre Hintsches. 2020. MultiRec: A multi-relational approach for unique item recommendation in auction systems. In Proceedings of the 14th ACM Conference on Recommender Systems, Virtual Event.Rodrygo L. T. Santos, Leandro Balby Marinho, Elizabeth M. Daly, Li Chen, Kim Falk, Noam Koenigstein, and Edleno Silva de Moura (Eds.), ACM, 230–239. DOI:https://doi.org/10.1145/3383313.3412242Google Scholar
- Salah Rifai, Pascal Vincent, Xavier Muller, Xavier Glorot, and Yoshua Bengio. 2011. Contractive auto-encoders: Explicit invariance during feature extraction. In Proceedings of the 28th International Conference on Machine Learning.Lise Getoor and Tobias Scheffer (Eds.), Omnipress, 833–840. Retrieved from https://icml.cc/2011/papers/455_icmlpaper.pdf.Google Scholar
- R. Salakhutdinov and A. Mnih. 2007. Probabilistic matrix factorization.In Proceedings of the 20th International Conference on Neural Information Processing Systems. 1257–1264. DOI:https://doi.org/10.1145/1390156.1390267Google Scholar
- Akash Srivastava and Charles A. Sutton. 2017. Autoencoding variational inference for topic models. In Proceedings of the 5th International Conference on Learning Representations. Retrieved from https://openreview.net/forum?id=BybtVK9lg.Google Scholar
- Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research 11, 110 (2010), 3371–3408. Retrieved from http://portal.acm.org/citation.cfm?id=1953039.Google ScholarDigital Library
- Maksims Volkovs, Guangwei Yu, and Tomi Poutanen. 2017. Dropoutnet: Addressing cold start in recommender systems. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 4957–4966.Google Scholar
- Chengwei Wang, Tengfei Zhou, Chen Chen, Tianlei Hu, and Gang Chen. 2019. CAMO: A collaborative ranking method for content based recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence. 5224–5231.Google ScholarCross Ref
- Chong Wang and David M Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 448–456.Google ScholarDigital Library
- Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1235–1244. DOI:https://doi.org/10.1145/2783258.2783273Google ScholarDigital Library
- Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. 2017. Irgan: A minimax game for unifying generative and discriminative information retrieval models. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 515–524.Google ScholarDigital Library
- Qinyong Wang, Hongzhi Yin, Hao Wang, Quoc Viet Hung Nguyen, Zi Huang, and Lizhen Cui. 2019. Enhancing collaborative filtering with generative augmentation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 548–556.Google ScholarDigital Library
- Jian Wei, Jianhua He, Kai Chen, Yi Zhou, and Zuoyin Tang. 2016. Collaborative filtering and deep learning based hybrid recommendation for cold start problem. In Proceedings of the 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, and 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress.IEEE Computer Society, 874–877. DOI:https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.149Google Scholar
- Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys 52, 1 (2019), 5:1–5:38. DOI:https://doi.org/10.1145/3285029Google ScholarDigital Library
- Shuai Zhang, Lina Yao, and Xiwei Xu. 2017. AutoSVD++: An efficient hybrid collaborative filtering model via contractive auto-encoders. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. Noriko Kando, Tetsuya Sakai, Hideo Joho, Hang Li, Arjen P. de Vries, and Ryen W. White (Eds.), ACM, 957–960. DOI:https://doi.org/10.1145/3077136.3080689Google Scholar
- Xinyuan Zhang, Yi Yang, Siyang Yuan, Dinghan Shen, and Lawrence Carin. 2019. Syntax-infused variational autoencoder for text generation. In Proceedings of the 57th Conference of the Association for Computational Linguistics.Anna Korhonen, David R. Traum, and Lluís Màrquez (Eds.), Association for Computational Linguistics, 2069–2078. DOI:https://doi.org/10.18653/v1/p19-1199Google ScholarCross Ref
- Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019. ERNIE: Enhanced language representation with informative entities. In Proceedings of the 57th Conference of the Association for Computational Linguistics.Anna Korhonen, David R. Traum, and Lluís Màrquez (Eds.), Association for Computational Linguistics, 1441–1451. DOI:https://doi.org/10.18653/v1/p19-1139Google ScholarCross Ref
- Qiannan Zhu, Xiaofei Zhou, Zeliang Song, Jianlong Tan, and Li Guo. 2019. Dan: Deep attention neural network for news recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence. 5973–5980.Google ScholarCross Ref
- Tianyu Zhu, Guannan Liu, and Guoqing Chen. 2020. Social collaborative mutual learning for item recommendation. ACM Transactions on Knowledge Discovery from Data 14, 4 (2020), 43:1–43:19. DOI:https://doi.org/10.1145/3387162Google Scholar
Index Terms
- Hybrid Variational Autoencoder for Recommender Systems
Recommendations
Collaborative Variational Autoencoder for Recommender Systems
KDD '17: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningModern recommender systems usually employ collaborative filtering with rating information to recommend items to users due to its successful performance. However, because of the drawbacks of collaborative-based methods such as sparsity, cold start, etc., ...
A Scalable, Accurate Hybrid Recommender System
WKDD '10: Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data MiningRecommender systems apply machine learning techniques for filtering unseen information and can predict whether a user would like a given resource. There are three main types of recommender systems: collaborative filtering, content-based filtering, and ...
Hybrid Recommender Systems: Survey and Experiments
Recommender systems represent user preferences for the purpose of suggesting items to purchase or examine. They have become fundamental applications in electronic commerce and information access, providing suggestions that effectively prune large ...
Comments