Skip to main content

Opinion Mining System for Twitter Sentiment Analysis

  • Conference paper
  • First Online:
Hybrid Artificial Intelligent Systems (HAIS 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12344))

Included in the following conference series:

Abstract

After the paradigm shift produced by Web 2.0, the volume of opinion on the Internet has increased exponentially. The expansion of social media, whose textual content is somewhat subjective and comes loaded with opinions and assessments, can be very useful for recommending a product or brand. This information is an interesting challenge from the perspective of natural language processing, but is also an aspect of deep interest and great value not only as a marketing strategy for companies and political campaigns, but also as an indicator measuring consumer satisfaction with a product or service. In this paper, we present an opinion mining system that uses text mining techniques and natural language processing to automatically obtain useful knowledge about opinions, preferences and user trends. We studied improvements in the quality of opinion classification by using a voting system to choose the best classification of each tweet, base on of the absolute majority of the votes of the algorithms considered. In addition we developed a visualization tool that automatically combines these algorithms to assist end-user decision making. The opinion mining tool makes it possible to analyze and visualize data published on Twitter, to understand the sentiment analysis of users in relation to a product or service, by identifying the positive or negative sentiment expressed in Twitter messages.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://twitter.com/.

  2. 2.

    http://blippr.tumblr.com/.

  3. 3.

    http://www.nltk.org.

  4. 4.

    http://scikit-learn.org/.

  5. 5.

    https://nodejs.org/.

  6. 6.

    http://www.mysql.com/.

  7. 7.

    http://www.tweepy.org.

  8. 8.

    https://pythonprogramming.net/.

References

  1. Sharma, A., Shubhamoy, D.: Using self-organizing maps for sentiment analysis (2013)

    Google Scholar 

  2. Augustyniak, L., et al.: Simpler is better? lexicon-based ensemble sentiment classification beats supervised methods. In: International Conference on 2014 IEEE/ACM. [S.l.]. Advances in Social Networks Analysis and Mining (ASONAM), pp. 924–929. IEEE (2014)

    Google Scholar 

  3. Basant, A., Namita, M., Pooja, B., Sonal G.: Sentiment analysis using common-sense and context information. Hindawi Publishing Corporation Computational Intelligence and Neuroscience (2015)

    Google Scholar 

  4. Bermingham, A., Smeaton, A. F.: Classifying sentiment in microblogs: is brevity an advantage? In: Proceedings of the 19th ACM International Conference on Information and Knowledge Management. [S.l.], pp. 1833–1836. ACM (2010)

    Google Scholar 

  5. Bermingham, A., Smeaton, A.: On using Twitter to monitor political sentiment and predict election results. In: Proceedings of the Workshop on Sentiment Analysis where AI meets Psychology (SAAIP 2011) (2011)

    Google Scholar 

  6. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123–140 (1996)

    MATH  Google Scholar 

  7. Cardie, C.: Automatic feature set selection for case-based learning of linguistic knowledge. In: Conference on Empirical Methods in Natural Language Processing, pp. 113–126 (1996)

    Google Scholar 

  8. Choy, M., Cheong, M.L.F., Nang Laik, M., Ping Shung, K.: A sentiment analysis of Singapore Presidential Election 2011 using Twitter data with census correction. CoRR, abs/1108 5520 (2011)

    Google Scholar 

  9. Duchowski, A.T.: A Breadth-first survey of eye tracking applications. Behav. Res. Methods Instrum. Comput. (BRMIC) 34(4), 455–470 (2002). https://doi.org/10.3758/BF03195475

    Article  Google Scholar 

  10. Fersini, E., Messina, E., Pozzi, F.: Sentiment analysis: Bayesian ensemble learning. Decis. Support Syst. 68, 26–38 (2014)

    Article  Google Scholar 

  11. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2004, pp. 168–177. ACM, New York(2004)

    Google Scholar 

  12. Intxaurrondo, A., Surdeanu, M., López de Lacalle Lekuona, O., Agirre Bengoa, E.: Removing noisy mentions for distant supervision. Procesamiento del Lenguaje Natural. N. 51, pp. 41–48 (2013). ISSN 1135–5948

    Google Scholar 

  13. Go, A., Huang, L., Bhayani, R.: Twitter sentiment analysis. Final Projects from CS224N for Spring 2008/2009 at The Stanford Natural Language Processing Group (2009)

    Google Scholar 

  14. Kotsiantis, S.B.: Supervised machine learning: a review of classification techniques. Informatica 31(3), 249–268 (2007). Slovene Society Informatika

    MathSciNet  MATH  Google Scholar 

  15. Kouloumpis, E., Wilson, T., Moore, J.: Twitter sentiment analysis: the good the bad and the omg! In: ICWSM, vol. 11, pp. 538–541 (2011)

    Google Scholar 

  16. Manning, C.D., Schuetze, H.: Foundations of Statistical Language Processing. MIT Press, Cambridge (1999)

    Google Scholar 

  17. Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? sentiment classification using machine learning techniques. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 79–86 (2002)

    Google Scholar 

  18. Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retrieval 2(1–2), 1–135 (2008)

    Article  Google Scholar 

  19. Perkins, J.: Python 3 Text Processing with NLTK 3 Cookbook. Packt Publishing (2014). ISBN 13: 9781782167853

    Google Scholar 

  20. Prabowo, R., Thelwall, M.: Sentiment analysis: a combined approach. J. Informetrics 3(2), 143–157 (2009)

    Article  Google Scholar 

  21. Quinlan, J.R.: Bagging, boosting, and c4.5. In: Proceedings of the 13th National Conference on Artificial Intelligence, pp. 725–730 (1996)

    Google Scholar 

  22. Read, J.: Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In: Proceedings of ACL-05, 43nd Meeting of the Association for Computational Linguistics. Association for Computational Linguistics (2005)

    Google Scholar 

  23. Salton, G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw-Hill, Inc., New York (1986)

    MATH  Google Scholar 

  24. Schapire, R.E.: The strength of weak learnability. Mach. Learn. 5(2), 197–227 (1990)

    Google Scholar 

  25. Sebastiani, F.: Machine learning in automated text categorization. ACM Comput. Surv. 34(1), 1–47 (2002)

    Article  Google Scholar 

  26. Turney, P.: Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the Association for Computational Linguistics (ACL), pp. 417–424 (2002)

    Google Scholar 

  27. Tsytsarau, M., Palpanas, T.: Survey on mining subjective data on the web. Data Min. Knowl. Disc. 24, 478–514 (2012). https://doi.org/10.1007/s10618-011-0238-6

    Article  MATH  Google Scholar 

  28. Wang, G., Sunc, J., Mac, J., Xue, K., Gud, J.: Sentiment classification: the contribution of ensemble learning. Decis. Support Syst. 57, 77–93 (2014)

    Article  Google Scholar 

  29. Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., Liu, B.: Combining lexicon-based and learning-based methods for twitter sentiment analysis. Hewlett-Packard Laboratories. Technical report HPL-2011-89 (2011)

    Google Scholar 

  30. Zhou, Z.-H.: Ensemble Methods: Foundations and Algorithms. Chapman & Hall (2012)

    Google Scholar 

Download references

Acknowledgments

This paper has been partially supported by the research project: Movilidad inteligente y sostenible soportada por Sistemas Multi-agentes y Edge Computing (InEDGEMobility). Reference: RTI2018-095390-B-C32.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Pâmella A. Aquino , Vivian F. López , María N. Moreno , María D. Muñoz or Sara Rodríguez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Aquino, P.A., López, V.F., Moreno, M.N., Muñoz, M.D., Rodríguez, S. (2020). Opinion Mining System for Twitter Sentiment Analysis. In: de la Cal, E.A., Villar Flecha, J.R., Quintián, H., Corchado, E. (eds) Hybrid Artificial Intelligent Systems. HAIS 2020. Lecture Notes in Computer Science(), vol 12344. Springer, Cham. https://doi.org/10.1007/978-3-030-61705-9_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-61705-9_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-61704-2

  • Online ISBN: 978-3-030-61705-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics