Abstract
Recently, metric learning has shown its advantage in Collaborative Filtering (CF). Most works capture data relationships based on the measure of Euclidean distance. However, in the high-dimensional space of the data embedding, the directionality between data, that is, the angular relationship, also reflects the important relevance among data. In this paper, we propose Sphere Embedding for Collaborative Filtering (SphereCF) which learns the relationship between cosine metric learning and collaborative filtering. SphereCF maps the user and item latent vectors into the hypersphere manifold and predicts by learning the cosine similarity between the user and item latent vector. At the same time, we propose a hybrid loss that combines triplet loss and logistic loss. The triplet loss makes the inter-class angle between the positive and negative samples of a user as large as possible, and the logistic loss makes the intra-class angle of the positive user-item pairs as small as possible. We consider the user and item latent vector as a point on the hypersphere, which makes the margin in the triplet loss only depend on the angle, thus improving the performance of the model. Extensive experiments show that our model significantly outperforms state-of-the-art methods on four real-world datasets.
H. Liu, M. Li, Y. Wang and W. Chen—Equal contribution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bayer, I., He, X., Kanagal, B., Rendle, S.: A generic coordinate descent framework for learning from implicit feedback. In: WWW, pp. 1341–1350 (2017)
Cheng, H.-T., et al.: Wide & deep learning for recommender systems. In: Proceedings of the Recsys, pp. 7–10 (2016)
Elkahky, A.M., Song, Y., He, X.: A multi-view deep learning approach for cross domain user modeling in recommendation systems. In: WWW, pp. 278–288 (2015)
He, X., Chen, T., Kan, M.-Y., Chen, X.: TriRank: review-aware explainable recommendation by modeling aspects. In: CIKM, pp. 1661–1670 (2015)
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.-S.: Neural collaborative filtering. In: WWW, pp. 173–182 (2017)
He, X., Zhang, H., Kan, M.-Y., Chua, T.-S.: Fast matrix factorization for online recommendation with implicit feedback. In: SIGIR, pp. 549–558 (2016)
Hsieh, C.-K., Yang, L., Cui, Y., Lin, T.-Y., Belongie, S., Estrin, D.: Collaborative metric learning. In: WWW, pp. 193–201 (2017)
Hu, J., Lu, J., Tan, Y.-P.: Discriminative deep metric learning for face verification in the wild. In: CVPR, pp. 1875–1882 (2014)
Ji, S., Feng, Y., Ji, R., Zhao, X., Tang, W., Gao, Y.: Dual channel hypergraph collaborative filtering. In: SIGKDD, pp. 2020–2029 (2020)
Jiang, X., Hu, B., Fang, Y., Shi, C.: Multiplex memory network for collaborative filtering. In: SDM, pp. 91–99 (2020)
Kedem, D., Tyree, S., Sha, F., Lanckriet, G.R., Weinberger, K.Q.: Non-linear metric learning. In: NIPS, pp. 2573–2581 (2012)
Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: SIGKDD, pp. 426–434 (2008)
Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)
Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: AAAI (2015)
Mnih, V., Heess, N., Graves, A., et al.: Recurrent models of visual attention. In: NIPS, pp. 2204–2212 (2014)
Song, H.O., Xiang, Y., Jegelka, S., Savarese, S.: Deep metric learning via lifted structured feature embedding. In: CVPR, pp. 4004–4012 (2016)
Rendle, S.: Factorization machines. In: ICDM, pp. 995–1000 (2010)
Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, pp. 452–461 (2009)
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: CVPR, pp. 815–823 (2015)
Tay, Y., Tuan, L.A., Hui, S.C.: Latent relational metric learning via memory based attention for collaborative ranking. In: WWW, pp. 729–739 (2018)
Tran, V.-A., Hennequin, R., Royo-Letelier, J., Moussallam, M.: Improving collaborative metric learning with efficient negative sampling. In: SIGIR, pp. 1201–1204 (2019)
Xing, E.P., Jordan, M.I., Russell, S.J., Ng, A.Y.: Distance metric learning with application to clustering with side-information. In: NIPS, pp. 521–528 (2003)
Zabihzadeh, D., Monsefi, R., Yazdi, H.S.: Sparse Bayesian approach for metric learning in latent space. Knowl.-Based Syst. 178, 11–24 (2019)
Acknowledgement
This research is supported by National Natural Science Foundation of China (Grant No. 61773229 and 6201101015), Alibaba Innovation Research (AIR) programme, Natural Science Foundation of Guangdong Province (Grant No. 2021A1515012640), the Basic Research Fund of Shenzhen City (Grand No. JCYJ20210324120012033 and JCYJ20190813165003837), and Overseas Cooperation Research Fund of Tsinghua Shenzhen International Graduate School (Grant No. HW2021008).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, H., Li, M., Wang, Y., Chen, W., Zheng, HT. (2021). SphereCF: Sphere Embedding for Collaborative Filtering. In: Mantoro, T., Lee, M., Ayu, M.A., Wong, K.W., Hidayanto, A.N. (eds) Neural Information Processing. ICONIP 2021. Lecture Notes in Computer Science(), vol 13108. Springer, Cham. https://doi.org/10.1007/978-3-030-92185-9_47
Download citation
DOI: https://doi.org/10.1007/978-3-030-92185-9_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92184-2
Online ISBN: 978-3-030-92185-9
eBook Packages: Computer ScienceComputer Science (R0)