Skip to main content
SpringerLink
Log in

SKG-Learning: a deep learning model for sentiment knowledge graph construction in social networks

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Traditional sentiment analysis methods pay little attention to the inseparable relations between evaluation words and evaluation aspects, and the relations between evaluation words and topics. There have been many studies of knowledge graph (KG), which can effectively store and manage massive amounts of information and is suitable to associate emotion words with evaluation aspects and topics. This study proposes SKG-Learning based on a deep learning model to construct a sentiment knowledge graph (SKG) for sentiment analysis. Entity and relation are the cornerstones of SKG; thus, the task of SKG-Learning is divided into named entity recognition and relation extraction. We propose a bidirectional long short-term memory model (Bi-LSTM) with background knowledge embedding and co-extraction of features (BBC-LSTM) to extract entities. BBC-LSTM completes the embedding of background knowledge such as topic and emotion information and uses three-dimensional tensors to co-extract the deep features of aspect entities and sentiment entities. It solves the problems that it is difficult to recognize entities from insufficient context, and traditional models usually neglect the relevance between sentiment entities and aspect entities. A relation extraction model based on an encoder–decoder model (ED-Learning) is proposed to extract and classify the relation between sentiment and aspect entity, that is, the emotional tendency of sentiment entity toward aspect entity. Experiments show that the proposed methods can more efficiently extract entities and relations from social network texts. We confirm the validity of an SKG constructed by the SKG-Learning model in an emotional analysis task.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Do HH, Prasad P, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118:272–299

    Article  Google Scholar 

  2. Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307

    Article  Google Scholar 

  3. Xu G, Yu Z, Yao H, Li F, Meng Y, Wu X (2019) Chinese text sentiment analysis based on extended sentiment dictionary. IEEE Access 7:43749–43762

    Article  Google Scholar 

  4. Manurung R, et al. (2008) Machine learning-based sentiment analysis of automatic indonesian translations of english movie reviews. In: Proceedings of the International Conference on Advanced Computational Intelligence and Its Applications (ICACIA), pp. 1–6. Citeseer

  5. Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong T-L (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int J Mach Learn Cybern 10(8):2131–2142

    Article  Google Scholar 

  6. Basiri ME, Nemati S, Abdar M, Cambria E, Acharya UR (2021) Abcdm: An attention-based bidirectional cnn-rnn deep model for sentiment analysis. Future Gener Comput Syst 115:279–294

    Article  Google Scholar 

  7. Ma R, Wang K, Qiu T, Sangaiah AK, Lin D, Liaqat HB (2019) Feature-based compositing memory networks for aspect-based sentiment classification in social internet of things. Future Gener Comput Syst 92:879–888

    Article  Google Scholar 

  8. Guo X, Zhang G, Wang S, Chen Q (2020) Multi-way matching based fine-grained sentiment analysis for user reviews. Neural Comput Appl 32(10):5409–5423

    Article  Google Scholar 

  9. Nguyen HL, Vu DT, Jung JJ (2020) Knowledge graph fusion for smart systems: a survey. Inf Fusion 61:56–70

    Article  Google Scholar 

  10. Fares M, Moufarrej A, Jreij E, Tekli J, Grosky W (2019) Unsupervised word-level affect analysis and propagation in a lexical knowledge graph. Knowledge-Based Syst 165:432–459

    Article  Google Scholar 

  11. Unanue IJ, Borzeshi EZ, Piccardi M (2017) Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition. J Biomed Inf 76:102–109

    Article  Google Scholar 

  12. Zheng S, Hao Y, Lu D, Bao H, Xu J, Hao H, Xu B (2017) Joint entity and relation extraction based on a hybrid neural network. Neurocomputing 257:59–66

    Article  Google Scholar 

  13. Zheng S, Wang F, Bao H, Hao Y, Zhou P, Xu B (2017) Joint extraction of entities and relations based on a novel tagging scheme. arXiv preprint arXiv:1706.05075

  14. Saedi C, Branco A, Rodrigues J, Silva J (2018) Wordnet embeddings. In: Proceedings of the Third Workshop on Representation Learning for NLP, pp. 122–131

  15. Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250

  16. Lassila O, Swick RR et al. (1998) Resource description framework (rdf) model and syntax specification

  17. Jia Y, Qi Y, Shang H, Jiang R, Li A (2018) A practical approach to constructing a knowledge graph for cybersecurity. Engineering 4(1):53–60

    Article  Google Scholar 

  18. Xie C, Yu B, Zeng Z, Yang Y, Liu Q (2020) Multilayer internet-of-things middleware based on knowledge graph. IEEE Internet Things J 8(4):2635–2648

    Article  Google Scholar 

  19. Qiu L, Zhang H (2017) Review of development and construction of Uyghur knowledge graph. In: 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), vol. 1, pp. 894–897 . IEEE

  20. Zhou J, Huang JX, Hu QV, He L (2020) Sk-gcn: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Syst 205:106292

    Article  Google Scholar 

  21. Al-Khatib K, Hou Y, Wachsmuth H, Jochim C, Bonin F, Stein B (2020) End-to-end argumentation knowledge graph construction. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 7367–7374

  22. Huang X, Zhang J, Li D, Li P (2019) Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113

  23. Dietz L, Kotov A, Meij E (2018) Utilizing knowledge graphs for text-centric information retrieval. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 1387–1390

  24. Zhao Y, Xiang L, Zhu J, Zhang J, Zhou Y, Zong C (2020) Knowledge graph enhanced neural machine translation via multi-task learning on sub-entity granularity. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 4495–4505

  25. Kanimozhi U, Manjula D (2017) A crf based machine learning approach for biomedical named entity recognition. In: 2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM), pp. 335–342 . IEEE

  26. MAK, RS, Bijaksana MA, Huda AF (2019) Person entity recognition for the Indonesian qur‘an translation with the approach hidden Markov model-viterbi. Procedia Comput Sci, 157, 214–220

  27. Lample G, Ballesteros M, Subramanian S, Kawakami K, Dyer C (2016) Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360

  28. Chiu JP, Nichols E (2016) Named entity recognition with bidirectional lstm-cnns. Trans Assoc Comput Linguist 4:357–370

    Article  Google Scholar 

  29. Wang D, Peng N, Duh K (2017) A multi-task learning approach to adapting bilingual word embeddings for cross-lingual named entity recognition. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 383–388

  30. Hasegawa T, Sekine S, Grishman R (2004) Discovering relations among named entities from large corpora. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pp. 415–422

  31. Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 2335–2344

  32. Sun T, Zhang C, Ji Y, Hu Z (2019) Reinforcement learning for distantly supervised relation extraction. IEEE Access 7:98023–98033

    Article  Google Scholar 

  33. Qu J, Ouyang D, Hua W, Ye Y, Li X (2018) Distant supervision for neural relation extraction integrated with word attention and property features. Neural Netw 100:59–69

    Article  Google Scholar 

  34. Sun C, Yang Z, Wang L, Zhang Y, Lin H, Wang J, Yang L, Xu K, Zhang Y (2018) Hierarchical recurrent convolutional neural network for chemical-protein relation extraction from biomedical literature. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 765–766 . IEEE

  35. Li P, Mao K (2019) Knowledge-oriented convolutional neural network for causal relation extraction from natural language texts. Expert Syst Appl 115:512–523

    Article  Google Scholar 

  36. Katiyar A, Cardie C (2017) Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 917–928

  37. Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3–4):169–200

    Article  Google Scholar 

  38. Cambria E, Poria S, Bajpai R, Schuller B (2016) Senticnet 4: A semantic resource for sentiment analysis based on conceptual primitives. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2666–2677

  39. Wang W, Pan SJ, Dahlmeier D, Xiao X (2017) Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31

  40. Qin Y, Shen G-W, Zhao W-B, Chen Y-P, Yu M, Jin X (2019) A network security entity recognition method based on feature template and cnn-bilstm-crf. Front Inf Technol Electron Eng 20(6):872–884

    Article  Google Scholar 

  41. Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S (2014) SemEval-2014 task 4: Aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35. Association for Computational Linguistics, Dublin, Ireland . https://doi.org/10.3115/v1/S14-2004. https://aclanthology.org/S14-2004

  42. Fan Z, Wu Z, Dai X, Huang S, Chen J (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers), pp. 2509–2518

  43. He R, Lee WS, Ng HT, Dahlmeier D (2018) Exploiting document knowledge for aspect-level sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China under Grant 61802258, Grant 61572326, in part by the Natural Science Foundation of Shanghai under Grant 18ZR1428300.

Author information

Authors and Affiliations

  1. College of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai, 200234, China

    Bo Zhang, Yue Hu, Duo Xu, Maozhen Li & Meizi Li

  2. Institute of Artificial Intelligence on Education, Shanghai Normal University, Shanghai, 200234, China

    Bo Zhang

  3. Department of Electronic and Electrical Engineering, Brunel University London, Uxbridge, UB8 3PH, UK

    Maozhen Li

  4. Shanghai Engineering Research Center of Intelligent Education and Bigdata, Shanghai Normal University, Shanghai, 200234, China

    Bo Zhang

Authors
  1. Bo Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yue Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Duo Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maozhen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Meizi Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Meizi Li.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relations that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, B., Hu, Y., Xu, D. et al. SKG-Learning: a deep learning model for sentiment knowledge graph construction in social networks. Neural Comput & Applic 34, 11015–11034 (2022). https://doi.org/10.1007/s00521-022-07028-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07028-4

Keywords

Search

Navigation