Skip to main content
SpringerLink
Log in

A text sentiment classification model using double word embedding methods

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Sentiment analysis is an important topic in natural language processing (NLP) and text classifications. The existing algorithms of lexicon-based sentiment classification can deal with small corpus datasets or simple semantic texts. With the growth of text corpus data, word embedding methods have been gaining more attention. However, the single static word vector obtained by these methods can not accurately express the semantic information of the text. To optimize the word vector, we propose a text sentiment classification model using the double word embedding methods (DWE), which combines two models, GloVe and Word2vec, to represent the text to form a combinatory input of dual channels of convolution neural network (CNN). Based on the word vector fine-tuning strategy, the initial word vector is continuously learned and adjusted to find the CNN sentiment classification model with better combination input than a single vector representation. Experiment results show that DWE can effectively improve the accuracy of sentiment classification, which reaches 94.8%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Alharbi ASM, de Doncker E (2019) Twitter sentiment analysis with a deep neural network: an enhanced approach using user behavioral information. Cogn Syst Res 54(5):50–61

    Article  Google Scholar 

  2. Araque O, Corcuera-Platas I, Sánchez-Rada JF, Iglesias CA (2017) Enhancing deep learning sentiment analysis with ensemble techniques in social applications. Expert Syst Appl 77(6):236–246

    Article  Google Scholar 

  3. Barkan O, Koenigstein N (2016) Item2vec: neural item embedding for collaborative filtering. In: 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP), Italy. IEEE, pp 1–6

  4. Catal C, Nangir M (2017) A sentiment classification model based on multiple classifiers. Appl Soft Comput 50:135–141

    Article  Google Scholar 

  5. Do HH, Prasad PWC, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118(10):272–299

    Article  Google Scholar 

  6. Giatsoglou M, Vozalis MG, Diamantaras K, Vakali A, Sarigiannidis G, Chatzisavvas KC (2017) Sentiment analysis leveraging emotions and word embeddings. Expert Syst Appl 69(3):214–224

    Article  Google Scholar 

  7. Hailong Z, Wenyan G, Bo J (2014) Machine learning and lexicon based methods for sentiment classification: A survey. In: 2014 11th web information system and application conference, Tianjin, China. IEEE, pp 262–265

  8. Hinton GE (1986) Learning distributed representations of concepts. Proceedings of the eighth annual conference of the cognitive science society, Amherst, pp 12–23

    Google Scholar 

  9. Huang S-L, Cheng W-C (2015) Discovering Chinese sentence patterns for feature-based opinion summarization. Electron Commer Res Appl 14(6):582–591

    Article  Google Scholar 

  10. Jain V, Kumar DS, Mahanti P (2018) Sentiment recognition in customer reviews using deep learning. Int J Enterp Inf Syst 14(2):77–86

    Article  Google Scholar 

  11. Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, pp 1746–1751

    Chapter  Google Scholar 

  12. Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International conference on machine learning, USA. IEEE, pp 1188–1196

  13. Li Z, Fan Y, Jiang B, Lei T, Liu W (2019) A survey on sentiment analysis and opinion mining for social multimedia. Multimed Tools Appl 78(6):6939–6967

    Article  Google Scholar 

  14. Li Q, Wu Q, Liu X (2019) Multi-scale and hierarchical embedding for polarity shift sensitive sentiment classification. In: International Conference on Artificial Intelligence and Security, New York, USA. Springer, pp 227–238

  15. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, Nevada, USA. Curran Associates, pp 3111–3119

  16. Naderalvojoud B, Sezer EA (2020) Sentiment aware word embeddings using refinement and senti-contextualized learning approach. Neurocomputing 405(10):149–160

    Article  Google Scholar 

  17. Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar. ACL, pp 1532–1543

  18. Polpinij J, Srikanjanapert N, Wongsin C (2016) Concept-based sentiment analysis for opinion texts with multiple-languages. In: Recent advances in information and communication technology 2016, vol 463. Springer, Cham, pp 27–36

    Chapter  Google Scholar 

  19. Ravi K, Ravi V (2015) A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowl-Based Syst 89(11):14–46

    Article  Google Scholar 

  20. Rezaeinia S, Rahmani R, Ghodsi A, Veisi H (2018) Sentiment analysis based on improved pre-trained word Embeddings. Expert Syst Appl 117:139–147

    Article  Google Scholar 

  21. Shrivastava K, Kumar S, Jain DK (2019) An effective approach for emotion detection in multimedia text data using sequence based convolutional neural network. Multimed Tools Appl 78(20):29607–29639

    Article  Google Scholar 

  22. Wang X, Liu Y, Sun C-J, Wang B, Wang X (2015) Predicting polarities of tweets by composing word embeddings with long short-term memory. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing. ACL, pp 1343–1353

  23. Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, Austin, Texas. ACL, pp 606–615

  24. Xia Y, Cambria E, Hussain A, Zhao H (2015) Word polarity disambiguation using Bayesian model and opinion-level features. Cogn Comput 7(3):369–380

    Article  Google Scholar 

  25. Xiao L, Hu X, Chen Y, Xue Y, Gu D, Chen B, Zhang T (2020) Targeted sentiment classification based on Attentional encoding and graph convolutional networks. Appl Sci 10:957

    Article  Google Scholar 

  26. Xiong Y, Chen S, Qin H, Cao H, Shen Y, Wang X, Chen Q, Yan J, Tang B (2020) Distributed representation and one-hot representation fusion with gated network for clinical semantic textual similarity. BMC Med Inf Decision Making 20(S1):72–78

    Article  Google Scholar 

  27. Zhang Y, Zhang Z, Miao D, Wang J (2019) Three-way enhanced convolutional neural networks for sentence-level sentiment classification. Inf Sci 477(11):55–64

    Google Scholar 

Download references

Funding

This work was supported in part by the National Nature Science Foundation of China under Grant 61802360 and 61701051.

Author information

Authors and Affiliations

  1. College of Computer Science, Chongqing University, Chongqing, China

    Mingqiang Zhou, Dan Liu, Yanhui Zheng, Qingsheng Zhu & Ping Guo

  2. Chongqing Key Laboratory of Software Theory and Technology, Chongqing, China

    Mingqiang Zhou, Dan Liu, Yanhui Zheng, Qingsheng Zhu & Ping Guo

Authors
  1. Mingqiang Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanhui Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qingsheng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ping Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mingqiang Zhou.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, M., Liu, D., Zheng, Y. et al. A text sentiment classification model using double word embedding methods. Multimed Tools Appl 81, 18993–19012 (2022). https://doi.org/10.1007/s11042-020-09846-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09846-x

Keywords

Search

Navigation