Skip to main content

Contextual Sentiment Analysis in Social Media Using High-Coverage Lexicon

  • Conference paper
  • First Online:
Research and Development in Intelligent Systems XXX (SGAI 2013)

Abstract

Automatically generated sentiment lexicons offer sentiment information for a large number of terms and often at a more granular level than manually generated ones. While such rich information has the potential of enhancing sentiment analysis, it also presents the challenge of finding the best possible strategy to utilising the information. In SentiWordNet, negation terms and lexical valence shifters (i.e. intensifier and diminisher terms) are associated with sentiment scores. Therefore, such terms could either be treated as sentiment-bearing using the scores offered by the lexicon, or as sentiment modifiers that influence the scores assigned to adjacent terms. In this paper, we investigate the suitability of both these approaches applied to sentiment classification. Further, we explore the role of non-lexical modifiers common to social media and introduce a sentiment score aggregation strategy named SmartSA. Evaluation on three social media datasets show that the strategy is effective and outperform the baseline of using aggregate-and-average approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://nlp.stanford.edu/software/corenlp.shtml

  2. 2.

    http://www.ark.cs.cmu.edu/TweetNLP

  3. 3.

    The dataset are obtained from the cyberemotions project: http://www.cyberemotions.eu

  4. 4.

    Available from http://www.sentiment140.com

References

  1. Agrawal, S., Siddiqui, T.: Using syntactic and contextual information for sentiment polarity analysis. In: Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human, ICIS ’09, pp. 620–623. ACM, New York, NY, USA (2009)

    Google Scholar 

  2. Benamara, F., Cesarano, C., Picariello, A., Reforgiato, D., Subrahmanian, V.: Sentiment analysis: Adjectives and adverbs are better than adjectives alone. In: Proceeding of ICWSM. (2007)

    Google Scholar 

  3. Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. In: Seventh International World-Wide Web Conference (WWW 1998) (1998)

    Google Scholar 

  4. Denecke, K.: Using sentiwordnet for multilingual sentiment analysis. In: ICDE Workshop (2008)

    Google Scholar 

  5. Devitt, A., Ahmad, K.: Sentiment polarity identification in financial news: A cohesion-based approach. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pp. 984–991. Prague, Czech Republic (2007)

    Google Scholar 

  6. Esuli, A., Baccianella, S., Sebastiani, F.: Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the Seventh conference on International, Language Resources and Evaluation (LREC10) (2010)

    Google Scholar 

  7. Esuli, A., Sebastiani, F.: Determining term subjectivity and term orientation for opinion mining. In: Proceedings of EACL-06, 11th Conference of the European Chapter of the Association for Computational Linguistics, Trento, IT. (2006)

    Google Scholar 

  8. Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press (1998)

    Google Scholar 

  9. Gimpel, K., Schneider, N., O’Connor, B., Das, D., Mills, D., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., Smith, N.A.: Part-of-speech tagging for twitter: annotation, features, and experiments. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2, HLT ’11, pp. 42–47. Association for Computational Linguistics, Stroudsburg, PA, USA (2011)

    Google Scholar 

  10. Go, A., Bhayani, R., Huang, L.: Twitter sentiment classification using distant supervision. Processing pp. 1–6 (2009)

    Google Scholar 

  11. Hatzivassiloglou, V., McKeown, K.R.: Predicting the semantic orientation of adjectives. In: Proceedings of the 35th Annual Meeting of the ACL and the 8th Conference of the European Chapter of the ACL, pp. 174–181. New Brunswick, NJ (1997)

    Google Scholar 

  12. Heerschop, B., Goossen, F., Hogenboom, A., Frasincar, F., Kaymak, U., de Jong, F.: Polarity analysis of texts using discourse structure. In: Proceedings of the 20th ACM international conference on Information and knowledge management CIKM’11, pp. 1061–1070. ACM, Glasgow UK (2011)

    Google Scholar 

  13. Hogenboom, A., van Iterson, P., Heerschop, B., Frasincar, F., Kaymak, U.: Determining negation scope and strength in sentiment analysis. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pp. 2589–2594 (2011)

    Google Scholar 

  14. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 168–177 (2004)

    Google Scholar 

  15. Kaplan, A.M., Haenlein, M.: Users of the world, unite! the challenges and opportunities of social media. Business Horizons 53(1), 59–68 (2010)

    Google Scholar 

  16. Kennedy, A., Inkpen, D.: Sentiment classification of movie reviews using contextual valence shifters. Computational Intelligence 22, 2006 (2006)

    Google Scholar 

  17. Mann, W., Thompson, S.: Rhetorical structure theory: Toward a functional theory of text organization. Text 8(3), 243–281 (1998)

    Google Scholar 

  18. Mukherjee, S., Bhattacharyya, P.: Sentiment analysis in twitter with lightweight discourse analysis. In: Proceedings of the 24th International Conference on Computational Linguistics (COLING 2012) (2012)

    Google Scholar 

  19. Mukras, R., Wiratunga, N., Lothian, R.: Selecting bi-tags for sentiment analysis of text. In: Proceedings of the Twenty-seventh SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence (2007)

    Google Scholar 

  20. Ohana, B., Tierney, B.: Sentiment classification of reviews using sentiwordnet. In: 9th IT &T Conference, Dublin, Ireland (2009)

    Google Scholar 

  21. Paltoglou, G., Thelwall, M.: Twitter, myspace, digg: Unsupervised sentiment analysis in social media. ACM Transactions on Intelligent Systems and Technology 3(4) (2012)

    Google Scholar 

  22. Paltoglou, G., Thelwall, M., Buckley, K.: Online textual communications annotated with grades of emotion strength. In: Proceedings of 31st International Workshop of Emotion: Corpora for research emotion and affect (2010)

    Google Scholar 

  23. Pang, B., Lee, L.: Polarity dataset v2.0, 2004. online (2004). http://www.cs.cornell.edu/People/pabo/movie-review-data/.

  24. Pang, B., Lee, L.: Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales. In: Proceedings of ACL, pp. 115–124 (2005)

    Google Scholar 

  25. Pang, B., Lee, L.: Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2(1), 1–135 (2008)

    Google Scholar 

  26. Pera, M., Qumsiyeh, R., Ng, Y.K.: An unsupervised sentiment classifier on summarized or full reviews. In: Proceedings of the 11th International Conference on Web Information, Systems Engineering, pp. 142–156 (2010)

    Google Scholar 

  27. Polanyi, L., Zaenen, A.: Contextual valence shifters, vol. 20. Springer, Dordrecht, The Netherlands (2004)

    Google Scholar 

  28. Riloff, E., Patwardhan, S., Wiebe, J.: Feature subsumption for opinion analysis. In: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP-06) (2006)

    Google Scholar 

  29. Santos, R.L., He, B., Macdonald, C., Ounis, I.: Integrating proximity to subjective sentences for blog opinion retrieval. In: Proceedings of the 31st European Conference on Research on Advances in Information Retrieval (ECIR’09) (2009)

    Google Scholar 

  30. Stone, P.J., Dexter, D.C., Marshall, S.S., Daniel, O.M.: The General Inquirer: A Computer Approach to Content Analysis. MIT Press, Cambridge, MA (1966)

    Google Scholar 

  31. Taboada, M., Brooke, J., Tofiloski, M., Voll, K., Stede, M.: Lexicon-based methods for sentiment analysis. Computational Linguistics 37, 267–307 (2011)

    Google Scholar 

  32. Thelwall, M., Buckley, K., Paltoglou, G.: Sentiment strength detection for the social web. Journal of the American Society for Information Science and Technology 63(1), 163–173 (2012)

    Google Scholar 

  33. Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A.: Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology 61(12), 2444–2558 (2010)

    Google Scholar 

  34. Turney, P.D.: Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the Annual Meeting of the Association for, Computational Linguistics, pp. 417–424 (2002)

    Google Scholar 

  35. Whitelaw, C., Garg, N., Argamon., S.: Using appraisal groups for sentiment analysis. In: 14th ACM International Conference on Information and Knowledge Management (CIKM 2005), pp. 625–631 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aminu Muhammad .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Muhammad, A., Wiratunga, N., Lothian, R., Glassey, R. (2013). Contextual Sentiment Analysis in Social Media Using High-Coverage Lexicon. In: Bramer, M., Petridis, M. (eds) Research and Development in Intelligent Systems XXX. SGAI 2013. Springer, Cham. https://doi.org/10.1007/978-3-319-02621-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02621-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02620-6

  • Online ISBN: 978-3-319-02621-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics