Skip to main content
SpringerLink
Log in

A multi-task dual attention deep recommendation model using ratings and review helpfulness

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The existing review-based recommendation methods usually employ the same model to learn the review representation of users and items. However, for different user-item pairs, the same words or similar reviews may deliver different information, and hence have different degrees of importance. Besides, many reviews are often noisy and even misleading. Hence, this paper proposes a multi-task Dual Attention Recommendation Model using Reviews and their Helpfulness (DARMH). The model separately constructs the local and interactive attentions to extract the personalized preference of specific users for specific items. By defining the helpfulness of a review, the attention weight of the review is acquired to better extract the features of the items review. However, many reviews do not have helpfulness ratings. Therefore, DARMH simultaneously performs multi-task learning of review helpfulness and rating prediction. The results of the experiments performed on four real datasets of Amazon show that the proposed DARMH model has a lower mean square error (MSE), and it achieves a performance improvement of 3.9%-5.4% compared to other review-based rating prediction algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://jmcauley.ucsd.edu/data/amazon/links.html

References

  1. Resnick P, Varian HR (1997) Recommender systems. Commun ACM 40(3):56–58

    Article  Google Scholar 

  2. Schafer JB, Frankowski D, Herlocker J, Sen S (2007) Collaborative filtering recommender systems, the adaptive web. Lecture Notes in Computer Science 4321:291–324

    Article  Google Scholar 

  3. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42:30–37

    Article  Google Scholar 

  4. Xia H, Wang Z, Du B, Zhang L, Chen S (2019) Leveraging ratings and reviews with gating mechanism for recommendation. In: Proceedings of the 28th ACM international conference on information and knowledge management (CIKM), pp 1573– 1582

  5. Guan X, Cheng Z, He X, Zhang Y, et al. (2019) Attentive aspect modeling for review-aware recommendation. ACM Transactions on Information Systems 37(3):1–27

    Article  Google Scholar 

  6. Ling G, Lyu MR, King I (2014) Ratings meet reviews, a combined approach to recommend. In: Proceedings of the 8th ACM conference on recommender systems (RecSys), pp 105–112

  7. LeCun Y, Bengio Y, Hinton G (2015) Deep Learning. Nature 521:436–444

    Article  Google Scholar 

  8. Govind BSS, Tene R, Saideep KL (2018) Novel recommender systems using personalized sentiment mining. In: Proceedings of the IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), pp 1–5

  9. McAuley J, Leskovec J (2013) Hidden factors and hidden topics:Understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on recommender systems (RecSys), pp 165–172

  10. Tay Y, Luu AT, Hui SH (2018) Multi-pointer co-attention networks for recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 2309–2318

  11. Almahairi A, Kastner K, Cho K, A.Courville (2015) Learning distributed representations from reviews for collaborative filtering. In: Proceedings of the 9th ACM conference on recommender systems (RecSys), pp 147–154

  12. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the 10th ACM international conference on web search and data mining (WSDM), pp 425–434

  13. Deng D, Jing L, Yu J, Sun S, Zhou H (2018) Neural gaussian mixture model for review-based rating prediction. In: Proceedings of the 12th ACM conference on recommender systems (RecSys), pp 113–121

  14. Glorot X, Bordes A, Bengio Y (2010) Deep sparse rectifier neural networks. J Mach Learn Res 15:315–323

    Google Scholar 

  15. Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining (KDD), pp 1235–1244

  16. Bansal T, Belanger D, Mccallum A (2017) Ask the GRU: Multi-task learning for deep text recommendations. In: Proceedings of the 11th ACM Conference on Recommender Systems (RecSys), pp 107–114

  17. Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems (RecSys), pp 233–240

  18. Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: Proceedings of the advances in neural information processing systems, pp 5998–6008

  19. Chang L, Chen W, Huang J, et al. (2020) Exploiting multi-attention network with contextual influence for point-of-interest recommendation. Appl Intell. https://doi.org/10.1007/s10489-020-01868-0

  20. Li H, Duan H, Zheng Y, et al. (2020) A CTR prediction model based on user interest via attention mechanism. Appl Intell 50:1192–1203

    Article  Google Scholar 

  21. Catherine R, Cohen W (2017) TransNets: learning to transform for recommendation. In: Proceedings of the 11th ACM conference on recommender systems(RecSys), pp 288–296

  22. Seo S, Huang J, Yang H, Liu Y (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the 11th ACM conference on recommender systems(RecSys), pp 297–305

  23. Chen C, Zhang M, Liu Y, Ma S (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 World Wide Web conference(WWW), pp 1583–1592

  24. Wu C, Wu F, Liu J, Huang Y (2019) Hierarchical user and item representation with three-tier attention for recommendation. In: Proceedings of the annual conference of the north american chapter of the association for computational linguistics, pp 1818–1826

  25. Wu L, Quan C, Li C, Wang Q, Zheng B, et al. (2019) A context-aware user-item representation learning for item recommendation. ACM Trans Inf Sys 37:1–29

    Google Scholar 

  26. Liu H, Wu F, Wang W, Wang X, Jiao P, Wu C (2019) NRPA: neural recommendation with personalized attention. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval (SIGIR), pp 1233–1236

  27. Lu Y, Dong R, Smyth B (2018) Coenvolutionary recommendation model: mutual learning between ratings and reviews. In: Proceedings of the 2018 World Wide Web Conference (WWW), pp 773–782

  28. Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization, Neural Information Processing Systems(NeurIPS), pp 1257–1264

Download references

Author information

Authors and Affiliations

  1. School of Computer and Information Technology, Beijing Jiaotong University, Beijing, 100044, China

    Zhen Liu & Baoxin Yuan

  2. State Information Center, Beijing, 100045, China

    Ying Ma

Authors
  1. Zhen Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Baoxin Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ying Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Liu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported by the National Key R&D Program of China under grant No.2019YFB2102500.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Z., Yuan, B. & Ma, Y. A multi-task dual attention deep recommendation model using ratings and review helpfulness. Appl Intell 52, 5595–5607 (2022). https://doi.org/10.1007/s10489-021-02666-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02666-y

Keywords

Search

Navigation