Skip to main content
Springer Nature Link
Log in

Key attribute generation from review texts based on in-context learning for recommender systems

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

User review texts provide valuable information for recommender systems, as they express various dimensions and perspectives regarding the experience of a user with a specific item. Consequently, many studies have proposed recommender systems based on review texts. However, because review texts typically contain a high proportion of noise that is not related to user preferences or item characteristics, existing studies that input the entire review text into the model are vulnerable to noise issues. Therefore, this study proposes a methodology for extracting key attributes based on in-context learning(ICL) to fundamentally address the noise problem in review texts. We used zero-shot, one-shot, and few-shot large language model (LLM) ICL to generate key attributes that define user preferences and item characteristics from integrated review texts, and we trained a recommender system to predict user ratings on items using the generated key attributes as new input. Our proposed research is the first to create and utilize new user and item characteristics through LLM ICL for a recommender system. Experiments demonstrate that our methodology effectively generates key attributes related to user preferences and item characteristics from review texts and achieves superior predictive performance compared to existing review-based recommender systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Availability of Supporting Data

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Notes

  1. http://jmcauley.ucsd.edu/data/amazon

References

  1. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl Based Syst 46:109–132

    Article  Google Scholar 

  2. Song Y, Wang T, Cai P, Mondal SK, Sahoo JP (2023) A comprehensive survey of few-shot learning: evolution, applications, challenges, and opportunities. ACM Comput Surv. https://doi.org/10.1145/3582688

    Article  Google Scholar 

  3. Ma Y, Chen G, Wei Q (2017) Finding users preferences from large-scale online reviews for personalized recommendation. Electron Commer Res 17:3–29

    Article  Google Scholar 

  4. Sundermann CV, Domingues MA, Sinoara RA, Marcacini RM, Rezende SO (2019) Using opinion mining in context-aware recommender systems: a systematic review. Information 10(2):42

    Article  Google Scholar 

  5. Gupta S, Gupta A (2019) Dealing with noise problem in machine learning data-sets: a systematic review. Proc Comput Sci 161:466–474

    Article  Google Scholar 

  6. Liu D, Li J, Du B, Chang J, Gao R (2019) Daml: dual attention mutual learning between ratings and reviews for item recommendation. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp 344–352

  7. Seo S, Huang J, Yang H, Liu Y (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems. https://doi.org/10.1145/3109859.3109890

  8. Chen C, Zhang M, Liu Y, Ma S (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 world wide web conference. WWW ’18, pp 1583–1592. https://doi.org/10.1145/3178876.3186070

  9. Nsir DB, Brahim AB, Masri H (2022) Topic modeling and sentiment analysis-based recommender system: a literature review. In: 2022 8th International conference on control, decision and information technologies (CoDIT), vol 1, pp 903–907. https://doi.org/10.1109/CoDIT55151.2022.9804079

  10. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining. WSDM ’17, pp 425–434. https://doi.org/10.1145/3018661.3018665

  11. He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web. WWW ’17, pp 173–182. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE. https://doi.org/10.1145/3038912.3052569

  12. Kim Y (2014) Convolutional neural networks for sentence classification. In: Moschitti A, Pang B, Daelemans W (eds) Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1746–1751. Association for Computational Linguistics, Doha, Qatar. https://doi.org/10.3115/v1/D14-1181https://aclanthology.org/D14-1181

  13. Rendle S (2012) Factorization machines with libfm. ACM Trans Intell Syst Technol 3(3):1–22. https://doi.org/10.1145/2168752.2168771

    Article  Google Scholar 

  14. Li C, Quan C, Peng L, Qi Y, Deng Y, Wu L (2019) A capsule network for recommendation and explaining what you like and dislike. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval. SIGIR’19, pp 275–284. https://doi.org/10.1145/3331184.3331216

  15. Liu D, Li J, Du B, Chang J, Gao R (2019) Dual attention mutual learning between ratings and reviews for item recommendation. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. KDD ’19, pp 344–352. https://doi.org/10.1145/3292500.3330906

  16. Catherine R, Cohen W (2017) Transnets: learning to transform for recommendation. In: Proceedings of the eleventh ACM conference on recommender systems. RecSys ’17, pp 288–296. https://doi.org/10.1145/3109859.3109878

  17. Liu H, Wang Y, Peng Q, Wu F, Gan L, Pan L, Jiao P (2020) Hybrid neural recommendation with joint deep representation learning of ratings and reviews. Neurocomputing 374:77–85. https://doi.org/10.1016/j.neucom.2019.09.052

    Article  Google Scholar 

  18. Xi W-D, Huang L, Wang C-D, Zheng Y-Y, Lai J-H (2022) Deep rating and review neural network for item recommendation. IEEE Trans Neural Netw Learn Syst 33(11):6726–6736. https://doi.org/10.1109/TNNLS.2021.3083264

    Article  Google Scholar 

  19. Chin JY, Zhao K, Joty S, Cong G (2018) Anr: aspect-based neural recommender. In: Proceedings of the 27th ACM international conference on information and knowledge management. CIKM ’18, pp 147–156. https://doi.org/10.1145/3269206.3271810

  20. Yang Z, Wang X, Cheng Y, Liu G (2021) Aspect-based capsule network with mutual attention for recommendations. IEEE Trans Artif Intell 2(3):228–237

    Article  Google Scholar 

  21. Acharya A, Singh B, Onoe N (2023) Llm based generation of item-description for recommendation system. In: Proceedings of the 17th ACM conference on recommender systems, pp 1204–1207

  22. Li Y, Ildiz ME, Papailiopoulos D, Oymak S (2023) Transformers as algorithms: generalization and stability in in-context learning. In: International conference on machine learning, pp 19565–19594. PMLR

  23. Liu H, Tam D, Muqeeth M, Mohta J, Huang T, Bansal M, Raffel CA (2022) Few-shot parameter-efficient fine-tuning is better and cheaper than in-context learning. Adv Neural Inf Process Syst 35:1950–1965

    Google Scholar 

  24. Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877–1901

    Google Scholar 

  25. Patil R, Gudivada V (2024) A review of current trends, techniques, and challenges in large language models (llms). Appl Sci 14(5):2074

    Article  Google Scholar 

  26. Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543. https://doi.org/10.3115/v1/D14-1162

  27. He X, Chua T-S (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th International ACM SIGIR conference on research and development in information retrieval, pp 355–364. https://doi.org/10.1145/3077136.3080777

  28. McAuley J, Pandey R, Leskovec J (2015) Inferring networks of substitutable and complementary products. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. KDD ’15, pp 785–794

  29. Wiegreffe S, Pinter Y (2019) Attention is not not explanation. In: Inui K, Jiang J, Ng V, Wan X (eds) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 11–20. Association for Computational Linguistics, Hong Kong, China. https://doi.org/10.18653/v1/D19-1002https://aclanthology.org/D19-1002

Download references

Acknowledgements

This study was supported by Research Program funded by the SeoulTech

Funding

This study was supported by Research Program funded by the SeoulTech

Author information

Authors and Affiliations

  1. Idea Lab, Corporate Business Strategy Office, LG Electronics, 128, Yeouidae-ro, Yeongdeungpo-gu, Seoul, 07336, Republic of Korea

    Jungmin Park

  2. Department of Industrial Engineering, Seoul National University of Science and Technology, 232, Gongneung-ro, Nowon-gu, Seoul, 01811, Republic of Korea

    Younghoon Lee

Authors
  1. Jungmin Park
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Younghoon Lee
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Jungmin Park made contributions to the conception of the work and analysis of data, Younghoon Lee contributions to the analysis of data and drafted the work.

Corresponding author

Correspondence to Younghoon Lee.

Ethics declarations

Competing Interests

The authors declare that they have no competing interests as defined by Springer

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Park, J., Lee, Y. Key attribute generation from review texts based on in-context learning for recommender systems. Appl Intell 54, 10194–10205 (2024). https://doi.org/10.1007/s10489-024-05698-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05698-2

Keywords