Skip to main content
Log in

Tracking the evolution of social emotions with topic models

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Many of today’s online news Web sites have enabled users to specify different types of emotions (e.g., angry or shocked) they have after reading news. Compared with traditional user feedbacks such as comments and ratings, these specific emotion annotations are more accurate for expressing users’ personal emotions. In this paper, we propose to exploit these users’ emotion annotations for online news in order to track the evolution of emotions, which plays an important role in various online services. A critical challenge is how to model emotions with respect to time spans. To this end, we propose a time-aware topic modeling perspective for solving this problem. Specifically, we first develop two models named emotion-Topic over Time (eToT) and mixed emotion-Topic over Time (meToT), in which the topics of news are represented as a beta distribution over time and a multinomial distribution over emotions. While they can uncover the latent relationship among news, emotion and time directly, they cannot capture the evolution of topics. Therefore, we further develop another model named emotion-based Dynamic Topic Model (eDTM), where we explore the state space model for tracking the evolution of topics. In addition, we demonstrate that all of proposed models could enable several potential applications, such as emotion prediction, emotion-based news recommendations, and emotion anomaly detections. Finally, we validate the proposed models with extensive experiments with a real-world data set.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. http://news.sina.com.cn/.

  2. http://news.sina.com.cn/society/.

  3. http://emotiondata.sinaapp.com/.

References

  1. Abrams D, Hogg MA (2006) Social identifications: a social psychology of intergroup relations and group processes. Routledge

  2. Azzopardi L, Girolami M, van Risjbergen K, (2003) Investigating the relationship between language model perplexity and ir precision-recall measures. In: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 369–370

  3. Bao S, Zhang L, Yan R, Su Z, Han D, Yu Y (2009) Joint emotion-topic modeling for social affective text mining. In: ICDM’09, pp 699–704

  4. Blei DM, Lafferty JD (2006) Dynamic topic models. In: Proceedings of the 23rd international conference on machine learning. ACM, pp 113–120

  5. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022

    MATH  Google Scholar 

  6. Chaumartin F-R (2007) Upar7: a knowledge-based system for headline sentiment tagging. In: Proceedings of the 4th international workshop on semantic evaluations. Association for Computational Linguistics, pp 422–425

  7. Das AS, Datar M, Garg A, Rajaram S (2007) Google news personalization: scalable online collaborative filtering. In: Proceedings of the 16th international conference on World Wide Web. ACM, pp 271–280

  8. Heinrich G (2005) Parameter estimation for text analysis. http://www.arbylon.net/publications/text-est.pdf

  9. Iwata T, Watanabe S, Yamada T, Ueda N (2009a) Topic tracking model for analyzing consumer purchase behavior. In: IJCAI, vol 9, pp 1427–1432

  10. Iwata T, Watanabe S, Yamada T, Ueda N (2009b) Topic tracking model for analyzing consumer purchase behavior. In: IJCAI, vol 9, pp 1427–1432

  11. Iwata T, Yamada T, Sakurai Y, Ueda N (2012) Sequential modeling of topic dynamics with multiple timescales. ACM Trans Knowl Discov Data (TKDD) 5(4):19

    Google Scholar 

  12. Koren Y (2010) Collaborative filtering with temporal dynamics. Commun. ACM 53(4):89–97

    Article  Google Scholar 

  13. Kozareva Z, Navarro B, Vázquez S, Montoyo A (2007) Ua-zbsa: a headline emotion classification through web information. In: Proceedings of the 4th international workshop on semantic evaluations. Association for Computational Linguistics, pp 334–337

  14. Le Bon G (1897) The crowd: a study of the popular mind. Macmillan, London

    Google Scholar 

  15. Li B, Zhu X, Li R, Zhang C, Xue X, Wu X (2011) Cross-domain collaborative filtering over time. In: Proceedings of the twenty-second international joint conference on artificial intelligence-volume volume three. AAAI Press, pp 2293–2298

  16. Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on Information and knowledge management. ACM, pp 375–384

  17. Lin KH-Y, Chen H-H (2008) Ranking reader emotions using pairwise loss minimization and emotional distribution regression. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 136–144

  18. Lin KH-Y, Yang C, Chen H-H (2007) What emotions do news articles trigger in their readers? In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 733–734

  19. Liu J, Dolan P, Pedersen ER (2010) Personalized news recommendation based on click behavior. In: Proceedings of the 15th international conference on intelligent user interfaces. ACM, pp 31–40

  20. Liu K-L, Li W-J, Guo M (2012) Emoticon smoothed language models for twitter sentiment analysis. In: AAAI

  21. Liu Q, Ge Y, Li Z, Chen E, Xiong H (2011) Personalized travel package recommendation. In: Data mining (ICDM), 2011 IEEE 11th international conference on. IEEE, pp 407–416

  22. Mei Q, Ling X, Wondra M, Su H, Zhai C (2007) Topic sentiment mixture: modeling facets and opinions in weblogs. In: Proceedings of the 16th international conference on World Wide Web, ACM, pp 171–180

  23. Minka T (2000) Estimating a dirichlet distribution, Technical report, MIT

  24. Mishne G, de Rijke M (2006) Capturing global mood levels using blog posts. In: AAAI spring symposium: computational approaches to analyzing weblogs, pp 145–152

  25. Mishne G, Glance N (2006) Leave a reply: an analysis of weblog comments. In: Third annual workshop on the Weblogging ecosystem. Edinburgh, Scotland

  26. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol 10, pp 79–86

  27. Paul M, Girju R (2009) Cross-cultural analysis of blogs and forums with mixed-collection topic models. In: Proceedings of the 2009 conference on empirical methods in natural language processing, vol 3. Association for Computational Linguistics, pp 1408–1417

  28. Paul M, Girju R (2010) A two-dimensional topic-aspect model for discovering multi-faceted topics. Urbana 51:61801

    Google Scholar 

  29. Pinto et al JPGdS (2008) Detection methods for blog trends. Report of Dissertation Master in Informatics and Computing Engineering

  30. Tang H, Tan S, Cheng X (2009) A survey on sentiment detection of reviews. Expert Syst Appl 36(7):10760–10773

    Article  Google Scholar 

  31. Titov I, McDonald R (2008) A joint model of text and aspect ratings for sentiment summarization. Urbana 51:61801

    Google Scholar 

  32. Wang C, Blei D, Heckerman D (2012) Continuous time dynamic topic models. arXiv preprint. arXiv:1206.3298

  33. Wang X, McCallum A (2006) Topics over time: a non-Markov continuous-time model of topical trends. In: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 424–433

  34. Wang X, McCallum A, Wei X (2007) Topical n-grams: phrase and topic discovery, with an application to information retrieval. In: Data mining, 2007. ICDM 2007. Seventh IEEE international conference on. IEEE, pp 697–702

  35. Yang C, Lin KH-Y, Chen H-H (2007) Building emotion lexicon from weblog corpora. In: Proceedings of the 45th annual meeting of the ACL on interactive poster and demonstration sessions. Association for Computational Linguistics, pp 133–136

  36. Yano T, Smith NA (2010) What’s worthy of comment? Content and comment volume in political blogs. In: ICWSM

  37. Yu H, Hatzivassiloglou V (2003) Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In: Proceedings of the 2003 conference on empirical methods in natural language processing, pp 129–136

  38. Zhao J, Dong L, Wu J, Xu K (2012) Moodlens: an emoticon-based sentiment analysis system for chinese tweets. In: Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1528–1531

  39. Zhu H, Chen E, Xiong H, Cao H, Tian J (2014) Mobile app classification with enriched contextual information. IEEE Trans Mobile Comput 13(7):1550–1563

    Article  Google Scholar 

  40. Zhu H, Xiong H, Ge Y, Chen E (2014) Mobile app recommendations with security and privacy awareness. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD. ACM, New York, NY, USA, pp 951–960. doi:10.1145/2623330.2623705

Download references

Acknowledgments

This research was partially supported by grants from the National Science Foundation for Distinguished Young Scholars of China (Grant No. 61325010), the National High Technology Research and Development Program of China (Grant No. 2014AA015203), the Fundamental Research Funds for the Central Universities of China (Grant No. WK2350000001), the Natural Science Foundation of China (Grant No. 61403358), NIH R21AA02395-01, and the Anhui Provincial Natural Science Foundation (Grant No. 1408085QF110).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Enhong Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, C., Zhu, H., Ge, Y. et al. Tracking the evolution of social emotions with topic models. Knowl Inf Syst 47, 517–544 (2016). https://doi.org/10.1007/s10115-015-0865-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-015-0865-0

Keywords

Navigation