Skip to main content
SpringerLink
Log in

Leveraging side information as adjusting embedding to improve user representation for recommendations

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Embedding is the cornerstone of recommendation system, and the embedding of users or items is directly related to the accuracy of recommendation. However, many recommendation methods directly use the ID of the user or item as the source of embedding. The advantage of doing so is simple and direct, and the fatal defect is that the meaning of embedding is single, rigid and lack of connotation. In this paper, we propose leveraging Side Information as Adjusting Embedding to improve user representation for recommendation. Our work is to add the attribute embedding of an item to the users initial embedding to create a high-order embedding when the user evaluates an item. In this way, the potential preferences of users can be mined more deeply. We add the main attribute embedding of the item and the users embedding layer by layer to adjust the users embedding. By constantly adjusting the size and direction of the user embedding vector, the user embedding becomes a customized high-level user embedding for different items. In other words, when a user evaluates different items, the user embedding is not fixed, but adapted to the item after adjustment. We do a lot of experiments on three real datasets, and prove that adjusting embedding can improve the ac curacy of the algorithm. Finally, it should be noted that our proposed adjusting embedding representation method can be applied to a variety of interaction processes or graph structures, including biomedical science, transportation, social networks, etc., in addition to a wide variety of recommendation situations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Wang X, He X, Wang M, Feng F, Chua TS (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR 2019, Paris, France. pp. 21–25, 165–174

  2. Wu C, Wu F, An M, Huang J, Huang Y, Xie X (2019) Npa: neural news recommendation with personalized attention. In: The 25th ACM SIGKDD conference on knowledge discovery and data mining, KDD. ACM. pp 2576–2584

  3. Wang H, Zhang F, Xing X, Guo M (2018) Dkn: Deep knowledge-aware network for news recommendation. In: WWW.InternationalWorldWideWebConferencesSteeringCommittee. pp 1835–1844

  4. Wang X, Wang D, Xu C, He X, Cao Y, Chua TS (2019) Explainable reasoning over knowledge graphs for recommendation. In: Proceedings of the AAAI conference on artificial intelligence. pp 5329–5336

  5. Zhou X, Chen L, Zhang Y, Qin D, Cao L, Huang G, Wang C (2017) Enhancing online video recommendation using social user interactions. VLDB J Int J Very Large Data Bases 26(5):637–656, 26(5):1–20

  6. Zhou G, Mou N, Fan Y, Pi Q, Bian W, Zhou C, Zhu X, Gai K. Deep interest evolution network for click-through rate prediction. In: Proceedings of the AAAI conference on artificial intelligence. pp 5941–5948

  7. Wang J, Zhang T, Song J, Sebe N, Shen HT (2016) A survey on learning to hash. IEEE Trans Pattern Anal Mach Intell 40(4):769–790, (99):1

  8. Wu CY, Ahmed A, Beutel A, Smola AJ, Jing H (2017) Recurrent recommender networks. In: Proceedings of the 10th ACM international conference on web search and data mining. ACM. pp. 495–503

  9. Wu Q, Zhang H, Gao X, He P, Weng P, Gao H, Chen G (2019) Dual graph attention networks for deep latent representation of multifaceted social effects in recommender systems. In: The world wide web conference. pp 2091–2102

  10. Li C, Feng W (2013) Preference-based clustering reviews for augmenting e-commerce recommendation. Knowl-Based Syst 50(C):44–59

    Google Scholar 

  11. He X, Liao L, Zhang H, Nie L, Chua TS (2017) Neural collaborative filtering. In International world wide web conferences steering committee, proceedings of the 26th international conference on world wide web pp. 173–182

  12. Strub F, Gaudel R, Mary J (2016) Hybrid recommender system based on autoencoders. In Proc. the 1st workshop on deep learning for recommender systems. pp 11–16

  13. Yue L, Sun XX, Gao WZ, Feng GZ, Zhang BZ (2018) Multiple auxiliary information based deep model for collaborative filtering. J Comput Sci Technol 33(4):668–681

    Article  Google Scholar 

  14. Sheng L, Kawale J, Yun F (2015) Deep collaborative filtering via marginalized denoising auto-encoder. ACM Int 15:811–820

    Google Scholar 

  15. Shi C, Zhang Z, Luo P, Yu PS, Yue Y, Wu B (2015) Semantic path based personalized recommendation on weighted heterogeneous information networks. Acm Int Conf Inf Knowl Manag 15(453–462):2015

    Google Scholar 

  16. Sun X, Zhang L, Wang Y, Yu M, Yin M, Zhang B (2020) Attribute-aware deep attentive recommendation. J Supercomput 77:5510–5527

    Article  Google Scholar 

  17. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) Bpr: bayesian personalized ranking from implicit feedback. In: UAI 2009, proceedings of the 25th conference on uncertainty in artificial intelligence, Montreal, QC, Canada. pp 18–21, 452–461

  18. Ning X, Karypis G (2011) Slim: sparse linear methods for top-n recommender systems. In: 11th IEEE international conference on data mining, ICDM 2011, Vancouver, BC, Canada. pp 11–14, 497–506

  19. Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Comput Sci. Available: arxiv:1409.0473

  20. Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining. pp 701–710

  21. Barkan O, Koenigstein N (2016) Item2vec: neural item embedding for collaborative filtering. In: IEEE 26th international workshop on machine learning for signal processing (MLSP). pp 397–406

  22. Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805

  23. Jhamb Y, Fang Y (2017) A dual-perspective latent factor model for group-aware social event recommendation. Inf Process Manag 53(3):559–576

    Article  Google Scholar 

  24. Jian W, He J, Kai C, Yi Z, Tang Z (2017) Collaborative filtering and deep learning based hybrid recommendation for cold start problem. Expert Syst. Appl. 69:29–39

    Article  Google Scholar 

  25. Oord AVD, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. Adv Neural Inf Process Syst 2643–2651

  26. Blei DM, Ng A, Jordan M (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022

    MATH  Google Scholar 

  27. Mcauley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Acm conference on recommender systems. pp 165–172

  28. Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In Proceedings of the 8th ACM conference on recommender systems. pp 105–112

  29. Ren Z, Liang S, Li P, Wang S, Rijke MD (2017) Social collaborative viewpoint regression with explainable recommendations. In: The tenth ACM international conference, web search data mining. pp 485–494

  30. Yang D, Qu B, Yang J, Cudre-Mauroux P (2019) Revisiting user mobility and social relationships in lbsns: a hypergraph embedding approach. In: Proceedings of the 2019 world wide web conference on world wide web. ACM Press, New York, pp 2147–2157

  31. Fan W, Li Q, Min C (2018) Deep modeling of social relations for recommendation. In: Proceedings of the 32nd AAAI conference on artificial intelligence. AAAI Press, Menlo Park, CA, pp. 8075–8076

  32. Sun Z, Yang J, Zhang J, Bozzon A, Huang LK, Xu C (2018) Recurrent knowledge graph embedding for effective recommendation. In: Proceedings of the 13th ACM conference on recommender systems. pp 297–305

  33. Catherine R, Cohen W (2016) Personalized recommendations using knowledge graphs: a probabilistic logic programming approach. In: Proceedings of the 11th ACM conference on recommender systems. ACM Press, New York, pp 325–332

  34. Cao Y, Xiang W, He X, Hu Z, Chua TS Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences. In: The world wide web conference. pp 151–161

  35. Bordes A, Usunier N, Garcia-Duran Alberto, Weston J, Yakhnenko O (2013). Translating embeddings for modeling multi-relational data. In: Advances in neural information processing systems. South Lake Tahoe, CA. pp 2787–2795

  36. Veloso B, Leal F, Malheiro B, Burguillo JC (2019) On-line guest profiling and hotel recommendation. Electron Commer Res Appl 34:100–832

    Article  Google Scholar 

  37. Diao Q, Qiu M, Wu CY, Smola AJ, Chong W (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. pp 193–202

  38. Safoury L, Salah A (2013) Exploiting user demographic attributes for solving cold-start problem in recommender system. Lect Notes Softw Eng 1(3):303–307

    Article  Google Scholar 

  39. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining. pp 425–434

Download references

Acknowledgements

This work was funded by: 1.The Science and Technology Development Plan Project of Jilin Provincial Science and Technology Department (No. 20190302028GX). 2. Project of “112” Doctoral Promotion Project of College of Humanities & Sciences, Northeast Normal University (No:201906). 3. Jilin Provincial Education Department 2020 Teaching Reform Project (New Engineering)—Online Learning Behavior Analysis Based On Data Mining and Teaching Strategy Research. 4.Project library of Changchun Humanities and Sciences College in 2022.

Author information

Authors and Affiliations

  1. Changchun Humanities and Sciences College, Changchun, 130117, China

    SuHua Wang, ZhiQiang Ma, HuiNan Zhao, XiuZhuo Wei, Rui Ma & Bo Tang

  2. College of Information Science and Technology, Northeast Normal University, Changchun, 130117, China

    XiaoXin Sun

Authors
  1. SuHua Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. ZhiQiang Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. XiaoXin Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. HuiNan Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. XiuZhuo Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rui Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bo Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to XiaoXin Sun.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, S., Ma, Z., Sun, X. et al. Leveraging side information as adjusting embedding to improve user representation for recommendations. J Supercomput 78, 19322–19345 (2022). https://doi.org/10.1007/s11227-022-04635-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04635-9

Keywords

Search

Navigation