skip to main content
10.1145/2526188.2526196acmotherconferencesArticle/Chapter ViewAbstractPublication PageswebmediaConference Proceedingsconference-collections
research-article

Measuring sentiments in online social networks

Published: 05 November 2013 Publication History

Abstract

Sentiment analysis has being used in several applications including the analysis of the repercussion of events in online social networks (OSNs), as well as to summarize public perception about products and brands on discussions on those systems. There are multiple methods to measure sentiments, varying from lexical-based approaches to machine learning methods. Despite the wide use and popularity of some those methods, it is unclear which method is better for identifying the polarity (i.e. positive or negative) of a message, as the current literature does not provide a comparison among existing methods. This comparison is crucial to allow us to understand the potential limitations, advantages, and disadvantages of popular methods in the context of OSNs messages. This work aims at filling this gap by presenting a comparison between 8 popular sentiment analysis methods. Our analysis compares these methods in terms of coverage and in terms of correct sentiment identification. We also develop a new method that combines existing approaches in order to provide the best coverage results with competitive accuracy. Finally, we present iFeel, a Web service which provides an open API for accessing and comparing results across different sentiment methods for a given text.

References

[1]
Msn messenger emoticons. http://messenger.msn.com/Resource/Emoticons.aspx.
[2]
Omg! oxford english dictionary grows a heart: Graphic symbol for love (and that exclamation) are added as words. tinyurl.com/klv36p.
[3]
Sentistrength 2.0. http://sentistrength.wlv.ac.uk/Download.
[4]
Yahoo messenger emoticons. http://messenger.yahoo.com/features/emoticons.
[5]
Amazon. Amazon mechanical turk. https://www.mturk.com/. Accessed June 17, 2013.
[6]
F. Benevenuto, G. Magno, T. Rodrigues, and V. Almeida. Detecting spammers on twitter. In Collaboration, Electronic messaging, Anti-Abuse and Spam Conference (CEAS), 2010.
[7]
J. Bollen, A. Pepe, and H. Mao. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. CoRR, abs/0911.1583, 2009.
[8]
M. M. Bradley and P. J. Lang. Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report, Center for Research in Psychophysiology, University of Florida, Gainesville, Florida, 1999.
[9]
E. Cambria, A. Hussain, C. Havasi, C. Eckl, and J. Munro. Towards crowd validation of the uk national health service. In ACM Web Science Conference (WebSci), 2010.
[10]
E. Cambria, R. Speer, C. Havasi, and A. Hussain. Senticnet: A publicly available semantic resource for opinion mining. In AAAI Fall Symposium Series, 2010.
[11]
M. Cha, H. Haddadi, F. Benevenuto, and K. P. Gummadi. Measuring User Influence in Twitter: The Million Follower Fallacy. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
[12]
P. S. Dodds and C. M. Danforth. Measuring the happiness of large-scale written expression: songs, blogs, and presidents. Journal of Happiness Studies, 11(4):441--456, 2009.
[13]
Esuli and Sebastiani. Sentwordnet: A publicly available lexical resource for opinion mining. In In Conference on Language Resources and Evaluation, 2006.
[14]
P. Goncalves and F. Benevenuto. O que tweets contendo emoticons podem revelar sobre sentimentos coletivos? In II Brazilian Workshop on Social Network Analysis and Mining (BraSNAM), 2013.
[15]
P. Goncalves, W. Dores, and F. Benevenuto. Panas-t: Uma escala psicometrica para analise de sentimentos no twitter. In I Brazilian Workshop on Social Network Analysis and Mining (BraSNAM), 2012.
[16]
A. Hannak, E. Anderson, L. F. Barrett, S. Lehmann, A. Mislove, and M. Riedewald. Tweetin' in the rain: Exploring societal-scale effects of weather on mood. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2012.
[17]
G. A. Miller. Wordnet: a lexical database for english. Communications of the ACM, 38(11):39--41, 1995.
[18]
J. Park, V. Barash, C. Fink, and M. Cha. Emoticon style: Interpreting differences in emoticons across cultures. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2013.
[19]
J. Read. Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In ACL Student Research Workshop, pages 43--48, 2005.
[20]
S. Somasundaran, J. Wiebe, and J. Ruppenhofer. Discourse level opinion interpretation. In Int'l Conference on Computational Linguistics (COLING), pages 801--808, 2008.
[21]
Y. R. Tausczik and J. W. Pennebaker. The psychological meaning of words: Liwc and computerized text analysis methods. Journal of Language and Social Psychology, 29(1):24--54, 2010.
[22]
M. Thelwall. Heart and soul: Sentiment strength detection in the social web with sentistrength. http://migre.me/fHgj9.
[23]
H. Wang, D. Can, A. Kazemzadeh, F. Bar, and S. Narayanan. A system for real-time twitter sentiment analysis of 2012 u.s. presidential election cycle. In ACL System Demonstrations, 2012.
[24]
D. Watson and L. Clark. Development and validation of brief measures of positive and negative affect: the panas scales. Journal of Personality and Social Psychology, 54(1):1063--1070, 1985.
[25]
K. Wickre. Celebrating twitter7. http://migre.me/fHgjA.
[26]
T. Wilson, P. Hoffmann, S. Somasundaran, J. Kessler, J. Wiebe, Y. Choi, C. Cardie, E. Riloff, and S. Patwardhan. Opinionfinder: a system for subjectivity analysis. In HLT/EMNLP on Interactive Demonstrations, 2005.

Cited By

View all
  • (2022)Expressing the Experience: An Analysis of Airbnb Customer SentimentsTourism and Hospitality10.3390/tourhosp30300423:3(685-705)Online publication date: 3-Aug-2022
  • (2021)A Mobile Tool for Collecting and Labeling Data on Twitter's Network Sociability PracticesProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479438(25-28)Online publication date: 5-Nov-2021
  • (2021)A Systematic Process for Computing Bourdieusian Social Capital within Institutional Profiles on TwitterProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479437(17-24)Online publication date: 5-Nov-2021
  • Show More Cited By

Index Terms

  1. Measuring sentiments in online social networks

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      WebMedia '13: Proceedings of the 19th Brazilian symposium on Multimedia and the web
      November 2013
      360 pages
      ISBN:9781450325592
      DOI:10.1145/2526188
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      • SBC: Brazilian Computer Society

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 November 2013

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. análise de sentimentos
      2. emoticons
      3. redes sociais
      4. twitter

      Qualifiers

      • Research-article

      Conference

      WebMedia '13
      Sponsor:
      • SBC

      Acceptance Rates

      WebMedia '13 Paper Acceptance Rate 29 of 87 submissions, 33%;
      Overall Acceptance Rate 270 of 873 submissions, 31%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 03 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2022)Expressing the Experience: An Analysis of Airbnb Customer SentimentsTourism and Hospitality10.3390/tourhosp30300423:3(685-705)Online publication date: 3-Aug-2022
      • (2021)A Mobile Tool for Collecting and Labeling Data on Twitter's Network Sociability PracticesProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479438(25-28)Online publication date: 5-Nov-2021
      • (2021)A Systematic Process for Computing Bourdieusian Social Capital within Institutional Profiles on TwitterProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479437(17-24)Online publication date: 5-Nov-2021
      • (2021)Social Security Reform in Brazil: A Twitter Sentiment AnalysisElectronic Government and the Information Systems Perspective10.1007/978-3-030-86611-2_11(143-154)Online publication date: 3-Sep-2021
      • (2020)Neutrality may matter: sentiment analysis in reviews of Airbnb, Booking, and Couchsurfing in Brazil and USASocial Network Analysis and Mining10.1007/s13278-020-00656-510:1Online publication date: 10-Jun-2020
      • (2018)Neutral or Negative?Proceedings of the 24th Brazilian Symposium on Multimedia and the Web10.1145/3243082.3243091(347-354)Online publication date: 16-Oct-2018
      • (2017)TATMasterProceedings of the 23rd Brazillian Symposium on Multimedia and the Web10.1145/3126858.3131601(205-208)Online publication date: 17-Oct-2017
      • (2016)Sentiment Analysis for Brazilian Portuguese over a Skewed Class CorporaComputational Processing of the Portuguese Language10.1007/978-3-319-41552-9_14(134-138)Online publication date: 21-Jun-2016
      • (2014)Multi-Entity Polarity Analysis in Financial DocumentsProceedings of the 20th Brazilian Symposium on Multimedia and the Web10.1145/2664551.2664574(115-122)Online publication date: 18-Nov-2014

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media