Skip to main content
SpringerLink
Log in

Sentiment Discovery of Social Messages Using Self-Organizing Maps

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Introduction Predicting the sentiments and emotions of people from their texts is a critical issue in cognitive computing. The explosive growth of social network services has led to a tremendous increase of textual data, increasing the demand of the advanced analysis of these data. Sentiment analysis on textual social media data emerged in recent years to fulfill the needs of areas such as national security, business, politics, and economics; however, text messages from social networks are rather different from those of traditional text documents, especially in presentation style and lengths. Therefore, it is difficult but essential to develop an effective method to explore the sentiments of social messages. Methods In this study, we first applied a self-organizing map (SOM) algorithm to cluster social messages as well as sentiment keywords. An association discovery process was then applied to discover the associations between a message and some sentiment keywords, and the sentiment of a message was determined according to such associations. Results We performed experiments on collected Twitter messages and the results’ accuracy outperformed that of a similar approach. Conclusions A sentiment analysis approach based on SOMs was proposed. The associations between messages and keywords were derived using the proposed method. The novelty of this work arises from the adoption of association discovery process in sentiment analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.pewinternet.org/fact-sheet/social-media/

  2. https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/

  3. See footnote 2

  4. https://www.omnicoreagency.com/twitter-statistics/

  5. http://www.hollywoodreporter.com/news/japan-smashes-tweets-second-world-599381

  6. Downloaded from http://www.cs.uic.edu/~liub/FBS/opinion-lexicon-English.rar

References

  1. Cambria E, Hussain A. Sentic Computing. Cogn Comput 2015;7(2):183–185. https://doi.org/10.1007/s12559-015-9325-0.

    Article  Google Scholar 

  2. Oneto L, Bisio F, Cambria E, Anguita D. SLT-Based ELM for Big Social Data Analysis. Cogn Comput 2017;9(2):259–274. Available from: https://doi.org/10.1007/s12559-016-9440-6.

    Article  Google Scholar 

  3. Asghar MZ, Khan A, Bibi A, Kundi FM, Ahmad H. Sentence-Level Emotion Detection Framework Using Rule-Based Classification. Cogn Comput 2017;9(6):868–894. Available from: https://doi.org/10.1007/s12559-017-9503-3.

    Article  Google Scholar 

  4. Feng S, Wang Y, Song K, Wang D, Yu G. 2017. Detecting Multiple Coexisting Emotions in Microblogs with Convolutional Neural Networks. Cognitive Computation. Available from: https://doi.org/10.1007/s12559-017-9521-1.

  5. Kohonen T. Self-Organizing Maps. Berlin: Springer-Verlag; 2001.

    Book  Google Scholar 

  6. Oja M, Kaski S, Kohonen T. Bibliography of Self-Organizing map (SOM) papers: 1998-2001 addendum. Neural Comput Surv 2003;3:1–156.

    Google Scholar 

  7. Liu YC, Liu M, Wang XL. 2012. Application of self-organizing maps in text clustering: a review. In: Applications of Self-Organizing Maps. InTech.

  8. Greenwood S, Perrin A, Duggan M. Social Media Update 2016. http://assets.pewresearch.org/wp-content/uploads/sites/14/2016/11/10132827/PI_2016.11.11_Social-Media-Update_FINAL.pdf.

  9. Casey S. Nielsen Social Media Report; 2017. http://www.nielsen.com/us/en/insights/reports/2017/2016-nielsen-social-media-report.html. 2016.

  10. Pang B, Lee L. Opinion Mining and Sentiment Analysis. Found Trends Inf Retr 2008;2(1-2):1–135. Available from: https://doi.org/10.1561/1500000011.

    Article  Google Scholar 

  11. Calvo RA, D’Mello S. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Trans Affect Comput 2010;1(1):18–37.

    Article  Google Scholar 

  12. Vinodhini G, Chandrasekaran R. Sentiment analysis and opinion mining: a survey. Int J Adv Res Comput Sci Softw Eng 2012;2(6):282–292.

    Google Scholar 

  13. Medhat W, Hassan A, Korashy H. Sentiment analysis algorithms and applications: A survey. Ain Shams Eng J 2014;5(4):1093–1113.

    Article  Google Scholar 

  14. Cambria E. Affective computing and sentiment analysis. IEEE Intell Syst 2016;31(2):102–107.

    Article  Google Scholar 

  15. Poria S, Cambria E, Bajpai R, Hussain. Review of affective computing: From unimodal analysis to multimodal fusion. Inf Fusion 2017;37:98–125.

    Article  Google Scholar 

  16. Turney PD. Thumbs Up or Thumbs Down?: Semantic Orientation Applied to Unsupervised Classification of Reviews. Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. ACL ’02. Stroudsburg: Association for Computational Linguistics; 2002. p. 417–424. Available from: https://doi.org/10.3115/1073083.1073153.

  17. Pang B, Lee L, Vaithyanathan S. Thumbs Up?: Sentiment Classification Using Machine Learning Techniques. Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing - Volume 10. EMNLP ’02. Stroudsburg: Association for Computational Linguistics; 2002. p. 79–86. Available from: https://doi.org/10.3115/1118693.1118704.

  18. Pang B, Lee L. Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales. Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics. ACL ’05. Stroudsburg: Association for Computational Linguistics; 2005. p. 115–124. Available from: https://doi.org/10.3115/1219840.1219855.

  19. Snyder B, Barzilay R. Multiple Aspect Ranking using the Good Grief Algorithm. In: Proceedings of the Joint Human Language Technology/North American Chapter of the ACL Conference (HLT-NAACL); 2007. p. 300–307.

  20. Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A. Sentiment in Short Strength Detection Informal Text. J Am Soc Inf Sci Technol 2010;61(12):2544–2558. Available from: https://doi.org/10.1002/asi.v61:12.

    Article  Google Scholar 

  21. Kim SM, Hovy E. Identifying and Analyzing Judgment Opinions. Proceedings of the Main Conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics. HLT-NAACL ’06. Stroudsburg: Association for Computational Linguistics; 2006. p. 200–207. Available from: https://doi.org/10.3115/1220835.1220861.

  22. Cheong M, Lee V. A study on detecting patterns in Twitter intra-topic user and message clustering. In: Proceedings of 2010 20th International Conference on Pattern Recognition (ICPR). IEEE; 2010. p. 3125–3128.

  23. Cheong M, Lee VC. A microblogging-based approach to terrorism informatics: Exploration and chronicling civilian sentiment and response to terrorism events via Twitter. Inf Syst Front 2011;13(1):45–59.

    Article  Google Scholar 

  24. Claster WB, Hung DQ, Shanmuganathan S. Unsupervised artificial neural nets for modeling movie sentiment. In: Proceedings of 2010 Second International Conference on Computational Intelligence, Communication Systems and Networks (CICSyN). IEEE; 2010, p. 349–354.

  25. Sharma A, Dey S. Using Self-Organizing maps for sentiment analysis. Proceedings of Knowledge and Information Management Conference(KIM2013). In: Sassman R and Lehaney B, editors. Meriden: The OR Society; 2013. p. 300–314.

  26. Pang B, Lee L. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the 42nd annual meeting on Association for Computational Linguistics. Association for Computational Linguistics; 2004. p. 271.

  27. Nguyen T, Phung D, Adams B, Tran T, Venkatesh S. Classification and pattern discovery of mood in weblogs. In: Zaki M J, Yu J X, Ravindran B, and Pudi V, editors. Berlin: Springer Berlin Heidelberg; 2010. p. 283–290.

  28. Akay A, Dragomir A, Erlandsson BE. Network-based modeling and intelligent data mining of social media for improving care. IEEE J Biomed Health Inf 2015;19(1):210–218.

    Article  Google Scholar 

  29. dos Santos CN, Gatti M. Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts. In: COLING; 2014. p. 69–78.

  30. Severyn A, Moschitti A. Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM; 2015. p. 959–962.

  31. Poria S, Cambria E, Gelbukh A. Aspect extraction for opinion mining with a deep convolutional neural network. Knowl-Based Syst 2016;108:42–49.

    Article  Google Scholar 

  32. Poria S, Cambria E, Gelbukh A. Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; 2015. p. 2539–2544.

  33. Zadeh A, Chen M, Poria S, Cambria E, Morency LP. Tensor fusion network for multimodal sentiment analysis. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen; 2017. p. 1103–1114.

  34. Salton G, McGill MJ. Introduction to modern information retrieval. New York: McGraw-Hill; 1983.

    Google Scholar 

  35. Kohonen T, Kaski S, Lagus K, Salojärvi J, Honkela J, Paatero V, et al. Self organization of a massive document collection. IEEE Trans Neural Netw 2000;11(3):574–585.

    Article  CAS  PubMed  Google Scholar 

  36. Isa D, Kallimani VP, Lee LH. Using the self organizing map for clustering of text documents. Expert Syst Appl 2009;36(5):9584 – 9591. Available from: http://www.sciencedirect.com/science/article/pii/S0957417408004879.

    Article  Google Scholar 

  37. Floridi L, Taddeo M. What is data ethics? Philosophical Transactions of the Royal Society of London A: Mathematical. Physical and Engineering Sciences. 2016;374(2083). Available from: http://rsta.royalsocietypublishing.org/content/374/2083/20160360.

  38. Hildebrandt M, Gutwirth S. Profiling the European citizen. Berlin: Springer; 2008.

    Book  Google Scholar 

  39. Schuller B, Ganascia JG, Devillers L. Multimodal sentiment analysis in the wild: Ethical considerations on data collection, annotation, and exploitation. In: ETHI-CA2 2016: ETHics In Corpus Collection, Annotation & Application Workshop Programme; 2016, p. 29–34.

  40. Hu M, Liu B. Mining and Summarizing Customer Reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’04. New York: ACM; 2004. p. 168–177. Available from: https://doi.org/10.1145/1014052.1014073.

  41. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bullet 1971;76(5):378–382.

    Article  Google Scholar 

  42. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977:159–174.

  43. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measur 1960;20(1):37–46.

    Article  Google Scholar 

Download references

Acknowledgements

The authors like to thank Prof. Cathy S. Lin for her advices on ethical issues of this work.

Funding

This study was funded by National Science Council (grant number 101-2221-E-390-032).

Author information

Authors and Affiliations

  1. Department of Information Management, National University of Kaohsiung, Kaohsiung, Taiwan

    Hsin-Chang Yang & Chun-Yen Wu

  2. Department of Electrical Engineering, National Kaohsiung University of Science and Technology, Kaohsiung, Taiwan

    Chung-Hong Lee

Authors
  1. Hsin-Chang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chung-Hong Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chun-Yen Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hsin-Chang Yang.

Ethics declarations

Conflict of interests

Hsin-Chang Yang declares that he has no conflict of interest. Chung-Hong Lee declares that he/she has no conflict of interest. Chun-Yen Wu declares that he has no conflict of interest.

Additional information

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, HC., Lee, CH. & Wu, CY. Sentiment Discovery of Social Messages Using Self-Organizing Maps. Cogn Comput 10, 1152–1166 (2018). https://doi.org/10.1007/s12559-018-9576-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-018-9576-7

Keywords

Search

Navigation