Skip to main content
Log in

Improving sentiment analysis efficacy through feature synchronization

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Social media platforms are becoming a rich source of valuable information through sharing and publishing user generated reviews and comments. The identification and extraction of subjective information from a piece of text is a crucial challenge in sentiment analysis. Numerous techniques have been proposed that aimed to analyze the sentiments of the text. However, accuracy was compromised due to inadequate identification of intensity, sentiments shifter and negation of words as well as divergence between tweets and their associated labels. In this study, Prescriptive Sentiment Analysis (PSA) based on features synchronization has been introduced for increasing accuracy in text sentiment analysis. At first, pre-processing has been performed which includes removal of stop words and tokenizing the text into sentiment words, intensity words, sentiment shifters and negation words. Secondly; polarity of intensity words, clauses and sentiment shifters in the text are calculated. Identification and removal of ambiguity between extracted features and their associated labels have been accomplished through feature synchronization. The K-Nearest Neighbor (KNN) has been implemented to predict text trend based on synchronized features. The proposed approach has been evaluated on publicly available datasets of twitter and movie reviews. Experimental results show significant improvement in sentiment analysis efficiency as compared to other baseline methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. http://cs.stanford.edu/people/alecmgo/trainingandtestdata.zip

References

  1. Ahmed M, Chen Q, Li Z (2020) Constructing domain-dependent sentiment dictionary for sentiment analysis. Neural Comput Appl:1–14

  2. Alelyani S, Tang J, Liu H (2013) Feature selection for clustering: A review. Data Clustering: Algorithms and Applications 29:110–121

    Google Scholar 

  3. Basant A, Namita M, Pooja B, Garg S (2015) Sentiment analysis using common-sense and context information. Hindawi Publishing Corporation Computational Intelligence and Neuroscience

  4. Berka P (2020) Sentiment analysis using rule-based and case-based reasoning. Journal of Intelligent Information Systems:1–16

  5. Chaovalit, P. and Zhou, L., 2005, January. Movie review mining: A comparison between supervised and unsupervised classification approaches. In System Sciences, 2005, Proceedings of the 38th Annual Hawaii International Conference on, pp. 112c-112c

  6. da Silva NF, Hruschka ER, Hruschka ER (2014) Tweet sentiment analysis with classifier ensembles. Decision Support Systems 66:170–179

    Article  Google Scholar 

  7. Dang NC, Moreno-García MN, De la Prieta F (2020) Sentiment analysis based on deep learning: A comparative study. Electronics 9(3):483

    Article  Google Scholar 

  8. Elloumi S (2020) A new approach for textual feature selection based on N-composite isolated labels. Nat Lang Eng 26(2):221–243

    Article  Google Scholar 

  9. Gautam G, Yadav D (2014, August) Sentiment analysis of twitter data using machine learning approaches and semantic analysis. In Contemporary Computing (IC3), 2014 Seventh International Conference on (pp. 437–442). IEEE

  10. Go A, Bhayani R, Huang L (2009) Twitter sentiment classification using distant supervision. CS224N Project Report. Stanford 1:12–16

    Google Scholar 

  11. Haochen Z, Fei S (2015) Aspect-level sentiment analysis based on a generalized probabilistic topic and syntax model. Proceedings of the Twenty-Eighth International Florida Artificial Intelligence Research Society Conference. Association for the Advancement of Artificial Intelligence

  12. Hu M, Liu B (2004) Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 168–177

  13. Huang M, Xie H, Rao Y, Feng J, Wang FL (2020) Sentiment strength detection with a context-dependent lexicon-based convolutional neural network. Information Sciences 520:389–399

    Article  Google Scholar 

  14. Hussein DMEDM (2018) A survey on sentiment analysis challenges. J King Saud Univ Eng Sci 30(4):330–338

    Google Scholar 

  15. Hutto CJ, Gilbert E (2014)Vader: A parsimonious rule-based model for sentiment analysis of social media text. In 8th International AAAI conference on weblogs and social media

  16. Jeyapriya, A. and Selvi, K., 2015, February. Extracting aspects and mining opinions in product reviews using supervised learning algorithm. In Electronics and Communication Systems (ICECS), 2015 2nd International Conference on (pp. 548–552). IEEE.

  17. Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for Twitter sentiment analysis. IEEE Access:23253–23260

  18. Jindal N, Liu B (2008) Opinion spam and analysis. In Proceedings of the 2008 international conference on web search and data mining, pp 219–230

  19. Khan FH, Qamar U, Javed MY (2014) Sentiview: A visual sentiment analysis framework. In Information Society (i-Society), 2014 International Conference on (pp. 291–296). IEEE

  20. Khan J, Jeong BS, Lee YK, Alam A (2016) Sentiment analysis at sentence level for heterogeneous datasets. In Proceedings of the Sixth International Conference on Emerging Databases: Technologies, Applications, and Theory, pp 159–163

  21. Koehler M, Greenhalgh S, Zellner A (2015, March) Potential applications of sentiment analysis in educational research and practice–is SITE the friendliest conference? In Society for Information Technology & Teacher Education International Conference 1348–1354

  22. Kumar A, Garg G (2019) Sentiment analysis of multimodal twitter data. Multimed Tools Appl:1–17

  23. Lin K-C, Zhang K-Y, Huang Y-H, Hung JC, Yen N (2016) Feature selection based on an improved cat swarm optimization algorithm for big data classification. J Supercomput:1–12

  24. Liu B (2011) Opinion mining and sentiment analysis. In: Web data mining, pp 459–526

    Chapter  Google Scholar 

  25. Liu B (2012) Sentiment analysis and opinion mining. Synthesis Lectures on Human Lang Tech 5(1):1–167

    Article  Google Scholar 

  26. Lizhen L, Wei S, Hanshi W, Chuchu L, Jingli L (2016) A novel feature-based method for sentiment analysis of Chinese product reviews. in China Communications 11(3):154–164

    Article  Google Scholar 

  27. Merriam-Webster (2004) Merriam-Webster’s collegiate dictionary. Merriam-Webster, Springfield

    Google Scholar 

  28. Minaee S, Kalchbrenner N, Cambria E, Nikzad N, Chenaghlu M, Gao J (2020) Deep learning-based text classification: A comprehensive review. arXiv preprint arXiv:2004.03705

  29. Mohamed H, Atia A, Sami M (2017) Mood miner: sentiment mining of financial market. ESOLEC:115–121

  30. Nikos E, Angeliki L, Georgios P, Konstantinos C (2011) ELS: a word-level method for entity-level sentiment analysis. In: In: WIMS ‘11 Proceedings of the International Conference on Web Intelligence. Semantics, Mining and

    Google Scholar 

  31. Pang B, Lee L, Vaithyanathan S (2002, July) Thumbs up?: sentiment classification using machine learning techniques. In Proceedings of the ACL-02 conference on Empirical methods in natural language processing, pp79–86

  32. Sebastiani F (2002) Machine learning in automated text categorization. ACM computing surveys (CSUR). 34(1):1–47

    Article  Google Scholar 

  33. Song Y, Jeong S, Kim H (2017) Semi-automatic construction of a named entity dictionary for entity-based sentiment analysis in social media. Multimed Tools Appl 76(9):11319–11329

    Article  Google Scholar 

  34. Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. In Proceedings of the 2008 ACM symposium on Applied computing, pp 1556–1560

  35. Tripathy A, Agrawal A, Rath SK (2015) Classification of sentimental reviews using machine learning techniques. Procedia Comput Sci 57:821–829

    Article  Google Scholar 

  36. Turney PD (2002 Jul 6) Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th annual meeting on association for computational linguistics, pp 417–424

  37. Xiang L, Yang S, Liu Y, Li Q, Zhu C (2020) Novel linguistic steganography based on character-level text generation. Mathematics 8(9):1558

    Article  Google Scholar 

  38. Yadollahi A, Shahraki AG, Zaiane OR (2017) Current state of text sentiment analysis from opinion to emotion mining. ACM Computing Surveys (CSUR) 50, 25(2)

  39. Yang B, Cardie C (2014) Context-aware learning for sentence-level sentiment analysis with Posterior regularization. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, pp 325–335

  40. Zhang L, Liu B (2016) Sentiment analysis and opinion mining. Encyclopedia of Machine Learning and Data Mining, pp 1–10

  41. Zhang Z, Miao D, Yuan B (2014) Context-dependent sentiment classification using antonym pairs and double expansion. In International Conference on Web-Age Information Management, pp 711–722

  42. Zheng F, Webb GI (2010) Tree augmented naive Bayes. Encyclopedia of Machine Learning, pp 990–991

Download references

Acknowledgments

We thank our colleagues from MNS University of Agriculture, Pakistan who provided insight and sharing their expertise with us during this research work. We would also like to show our gratitude to the anonymous reviewers for their careful reading of manuscript and their valuable comments and suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdul Razzaq.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, Z., Razzaq, A., Ali, S. et al. Improving sentiment analysis efficacy through feature synchronization. Multimed Tools Appl 80, 13325–13338 (2021). https://doi.org/10.1007/s11042-020-10383-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10383-w

Keywords

Navigation