Skip to main content
SpringerLink
Log in

Heterogeneous Graph Network Embedding for Sentiment Analysis on Social Media

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Nowadays, more people are used to express their attitudes on different entities in online social networks, forming user-to-entity sentiment links. These sentiment links imply positive or negative semantics. Most of current user sentiment analysis literature focuses on making a positive, neutral, or negative sentiment decision according to users’ text descriptions. Such approach, however, often fails to retrieve users’ hidden real attitudes. We design a powerful sentiment link analysis framework named graph network embedding for sentiment analysis (NESA). NESA first utilizes variational auto-encoder (VAE) to learn joint representations of users’ social relationship by preserving both the structural proximity and attribute proximity. Then, a multi-view correlation learning–based VAE is proposed to fuse the joint representation and the user-entity sentiment polarity network. By jointly optimizing the two components in a holistic learning framework, the embedding of network node information and multi-network contents is integrated and mutually reinforced. The first experimental results verify the effectiveness of adopting user, entity attributes, and social relationships for sentiment link analysis. Then we demonstrate the superiority of NESA over state-of-the-art network embedding baselines on link prediction. The last experimental results further validate that NESA model outperforms the traditional text-based sentiment prediction methods. We propose to perform sentiment analysis from network perspective; the proposed NESA model applies heterogeneous graph network embedding to fuse multi-networks information with considering their correlations and then to retrieve users’ hidden real attitudes in social networks. It provides a novel angle to resolve the sentiment analysis problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Sánchez-Rada J, Iglesias C. Social context in sentiment analysis: formal definition, overview of current trends and framework for comparison. INFORM FUSION. 2019: 344–356.

  2. Valdivia A, Luzn MV, Herrera F. Sentiment analysis in trip advisor. IEEE Intell Syst. 2017;32(4):72–7.

    Article  Google Scholar 

  3. Jin Z, Yang Y, Liu Y. Stock closing price prediction based on sentiment analysis and LSTM. Neural Comput Appl. 2019:1–17.

  4. Song K, Gao W, Feng S. Recommendation vs sentiment analysis: a text-driven latent factor model for rating prediction with cold-start awareness. The 26th International Joint Conference on Artificial Intelligence. 2017:2744–2750.

  5. Sirisha DJ, Nandyala SP, Reddy PVB. A novel approach for sentiment analysis of public posts. Innovations in Computer Science and Engineering. 2019:161–167.

  6. Brown PF, deSouza PV, Mercer RL, Pietra VJD, Lai JC. Class-based n-gram models of natural language. Comput Linguist. 1992;18(4):467–79.

    Google Scholar 

  7. Thewall M, Buckley K, Paltoglou G. Sentiment strength detection for the social web. J Am Soc Inf Sci Tec. 2012;61(1):163–73.

    Article  Google Scholar 

  8. Pang B, Lee L, Vaithyanathan S. Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing. 2002:79–86.

  9. Park S, Kim Y. Building thesaurus lexicon using dictionary based approach for sentiment classification. 2016 IEEE 14th International Conference on Software Engineering Research Management and Applications. 2016:39–44.

  10. Zhang SX, Wei ZL, Wang Y. Sentiment analysis of Chinese micro-blog text based on extended sentiment dictionary. Future Gener Comp Sy. 2018;81:395–403.

    Article  Google Scholar 

  11. Tang D, Wei F, Qin B, Zhou M, Liu T. Building large-scale twitter specific sentiment lexicon: a representation learning approach. In Proceedings of the 25th International Conference on Computational Linguistics. 2014:172–182.

  12. Felipe V, Mario S, Sergio C, et al. Exploiting semantic relationships for unsupervised expansion of sentiment lexicons. Information Systems. 2020.

  13. Wang S, Manning CD. Baselines and bigrams: simple, good sentiment and topic classification. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. 2012. p. 90–94.

  14. Wang G, Sun J, Ma J, et al. Sentiment classification: the contribution of ensemble learning. Decis Support Syst. 2014;57:77–93.

    Article  Google Scholar 

  15. Mikolov T, Chen K, Corrado G., Dean J. Efficient estimation of word representations in vector space. In Proceedings of Workshop at International Conference on Learning Representations (ICLR) 2013.

  16. Pennington J, Socher R, Manning CD. GloVe: Global vectors for word representation. In Proceedings of the Empirical Methods in Natural Language Processing. 2014:1532−1543

  17. Peters M E , Neumann M , Iyyer M, et al. Deep contextualized word representations. In Proceedings of the56th Annual Meeting of the Association for Computational Linguistics. ACL, 2018:2227–2237.

  18. Devlin J, Chang M W, Lee K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv: Computation and Language. 2018.

  19. Kim Y. Convolutional neural networks for sentence classification. arXiv preprint arXiv. 2014:1746–1751.

  20. Socher R, Perelygin A, Wu JY, Chuang J, Manning CD, Ng AY, et al. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 2013:1631–1642.

  21. Zhu X, Sobhani P, Guo H. Long short-term memory over recursive structures. In Proceedings of the 32nd International Conference on Machine Learning, ICML. 2015: 1604–1612

  22. Tang D, Qin B, Liu T. Learning semantic representations of users and products for document level sentiment classification. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. ACL, 2015:1014–1023.

  23. Chen H, Sun M, Tu C, et al. Neural sentiment classification with user and product attention. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP. 2016: 1650–1659.

  24. Chen T, Xu R, He Y, Xia Y, Wang X. Learning user and product distributed representations using a sequence model for sentiment analysis. IEEE Comput Intell Mag. 2016;11(3):34–44.

    Article  Google Scholar 

  25. Dou Z. Capturing user and product information for document level sentiment analysis with deep memory network. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 2017: 521–526.

  26. Wu Z, Dai X Y, Yin C, et al. Improving review representations with user attention and product attention for sentiment classification. Thirty-second AAAI conference on artificial intelligence. 2018.

  27. Wang ZQ, Liang JY, Li R. Exploiting user-to-user topic inclusion degree for link prediction in social-information networks. Expert Syst Appl. 2018;108:143–58.

    Article  Google Scholar 

  28. Xiao YP, Li XX, Liu YN, Liu H, Li Q. Correlations multiplexing for link prediction in multidimensional network spaces. Sci China Inform Sci. 2018;61(11):112103.

    Article  Google Scholar 

  29. Huang W, Wang Q, Cao J. Tracing public opinion propagation and emotional evolution based on public emergencies in social networks. Int J Comput Commun. 2018;13(1):129–42.

    Article  Google Scholar 

  30. Zhao K, Zhang Y, Zhang Y, et al. Learning from user social relation for document sentiment classification. International Conference on Database Systems for Advanced Applications. Springer, 2019: 86–103.

  31. Leskovec J, Huttenlocher D, Kleinberg J. Signed networks in social media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2010:1361–1370.

  32. Grover A, Leskovec J, Node2vec: Scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016:855–864.

  33. Perozzi B, Al-Rfou R, Skiena S. Deep walk: online learning of social representation. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014:701–710.

  34. Tang J, Qu M, Wang MZ, Zhang M, Yan J, Mei QZ. Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. 2015:1067–1077.

  35. Yuan S, Wu X, Xiang Y. SNE: signed network embedding. Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2017:183–195.

  36. Wang S, Tang J, Aggarwal C, Chang Y, Liu H. Signed network embedding in social media. In: Proceedings of the 2017 SIAM International Conference on Data Mining. 2017:327–335.

  37. Shen X, Chung F. Deep network embedding for graph representation learning in signed networks [J]. IEEE Transactions on Cybernetics. 2020;50(4):1556–68.

    Article  Google Scholar 

  38. Wang H, Zhang F, Hou M. Shine: Signed heterogeneous information network embedding for sentiment link prediction. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. 2018:592–600.

  39. Wang J. Geometric structure of high-dimensional data and dimensionality reduction. Heidelberg: Springer; 2012. p. 203–20.

    Book  Google Scholar 

  40. Belkin M, Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv Neural Inf Process Syst. 2002;14(6):585–91.

    Google Scholar 

  41. Cao SS, Lu W, Xu QK. Grarep: Learning graph representations with global structural information. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 2015:891–900.

  42. Wang DX, Cui P, Zhu WW. Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016:1225–1234.

  43. Wang X, Cui P, Wang J, Pei J, Zhu WW, Yang SQ, et al. Community preserving network embedding. In Proceedings of the 31st AAAI Conference on Aritificial Intelligence. AAAI, 2017:1–7.

  44. Rozemberczki B, Davies R, Sarkar R, Sutton C. Gemsec: Graph embedding with self-clustering. In: Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. 2019:65–72.

  45. Chen JF, Zhang Q, Huang XJ. Incorporate group information to enhance network embedding. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 2016:1901–1904.

  46. Tu CC, Zhang WC, Liu ZY, Sun M. Max-margin deepwalk: discriminative learning of network representation. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. IJCAI ,2016:3889–3895.

  47. Chang SY, Han W, Tang JL, Qi GJ, Aggarwal CC, Huang TS, et al. Heterogeneous network embedding via deep architectures. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2015:119–128.

  48. Huang X, Li JD, Hu X. Label informed attributed network embedding. In: Proceedings of the 10th ACM International Conference on Web Search and Data Mining. 2017:731–739.

  49. Kingma DP, Welling M. Auto-encoding variational bayes arXiv preprint arXiv. 2013;1312:6114.

    Google Scholar 

  50. Liao L, He X, Zhang H, Chua TS. Attributed social network embedding. IEEE T Knowl Data En. 2018;30(12):2257–70.

    Article  Google Scholar 

Download references

Funding

This study was funded by the National Natural Science Foundation of China (No. 71502125).

Author information

Authors and Affiliations

  1. School of Electrical and Information Engineering, Tianjin University, Tianjin, China

    Zhigang Jin & Xiaofang Zhao

  2. Dept. of Computer Science and Engineering, Santa Clara University, Santa Clara, USA

    Yuhong Liu

Authors
  1. Zhigang Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaofang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuhong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuhong Liu.

Ethics declarations

Conflict of Interest

The authors declare that they have no competing interests.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, Z., Zhao, X. & Liu, Y. Heterogeneous Graph Network Embedding for Sentiment Analysis on Social Media. Cogn Comput 13, 81–95 (2021). https://doi.org/10.1007/s12559-020-09793-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-020-09793-7

Keywords

Search

Navigation