Skip to main content
SpringerLink
Log in

Neural Emotion Detection via Personal Attributes

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

There has been a recent line of work to automatically detect the emotions of posts in social media. In literature, studies treat posts independently and detect their emotions separately. Different from previous studies, we explore the dependence among relevant posts via authors’ backgrounds, since the authors with similar backgrounds, e.g., “gender”, “location”, tend to express similar emotions. However, personal attributes are not easy to obtain in most social media websites. Accordingly, we propose two approaches to determine personal attributes and capture personal attributes between different posts for emotion detection: the Joint Model with Personal Attention Mechanism (JPA) model is used to detect emotion and personal attributes jointly, and capture the attributes-aware words to connect similar people; the Neural Personal Discrimination (NPD) model is employed to determine the personal attributes from posts and connect the relevant posts with similar attributes for emotion detection. Experimental results show the usefulness of personal attributes in emotion detection, and the effectiveness of the proposed JPA and NPD approaches in capturing personal attributes over the state-of-the-art statistic and neural models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Roberts K, Roach M, Johnson J, Guthrie J, Harabagiu S. EmpaTweet: Annotating and detecting emotions on Twitter. In Proc. the 8th International Conference on Language Resources and Evaluation, May 2012, pp.3806-3813.

  2. Hasan M, Rundensteiner A, Agu E. Automatic emotion detection in text streams by analyzing Twitter data. Int. J. Data Sci. Anal., 2019, 7(1): 27-31. https://doi.org/10.1007/s41060-018-0096-z.

    Article  Google Scholar 

  3. Abdul-Mageed M, Ungar L. EmoNet: Fine-grained emotion detection with gated recurrent neural networks. In Proc. the 55th Annual Meeting of the Association for Computational Linguistics, July 2017, pp.718-728. https://doi.org/10.18653/v1/P17-1067.

  4. Gupta U, Chatterjee A, Srikanth R, Agrawal P. A sentiment-and-semantics-based approach for emotion detection in textual conversations. arXiv:1707.06996, 2017. https://arxiv.org/abs/1707.06996, Jan. 2021.

  5. Lazarsfeld P, Merton R. Friendship as a social process: A substantive and methodological analysis. Freedom and Control in Modern Society, 1954, 18(1): 18-66.

    Google Scholar 

  6. Thelwall M. Emotion homophily in social network site messages. First Monday, 2010, 15(4): Article No. 3. https://doi.org/10.5210/fm.v15i4.2897.

  7. Tan C, Lee L, Tang J, Jiang L, Zhou M, Li P. User-level sentiment analysis incorporating social networks. In Proc. the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Aug. 2018, pp.1397-1405. https://doi.org/10.1145/2020408.2020614.

  8. Li J, Yang H, Zong C. Sentiment classification of social media text considering user attributes. In Proc. the 5th CCF Conference on Natural Language Processing and Chinese Computing and the 24th International Conference on Computer Processing of Oriental Languages, December 2016, pp.583-594. https://doi.org/10.1007/978-3-319-50496-4_52.

  9. Du H, Yu Z, Wang Z. Visualization system of microblog sentiment. China Science Paper, 2014, 10(9): 1144-1148. https://doi.org/10.3969/j.issn.2095-2783.2014.10.011. (in Chinese)

  10. Deng Y, Chang, L, Yang M, Huo M, Zhou R. Gender differences in emotional response: Inconsistency between experience and expressivity. PLoSOne, 2016, 11(6): Article No. e0158666. https://doi.org/10.1371/journal.pone.0158666.

  11. Tsai J, Sims T. Emotional aging in different cultures: Implications of affect valuation theory. In Emotion, Aaging, and Health (1st edition), Ong A D, Löckenhoff C E (eds.), American Psychological Association, 2016, pp.119-143. https://doi.org/10.1037/14857-007.

  12. Wang Z, Li S, Shi H, Zhou G. Skill inference with personal and skill connections. In Proc. the 25th International Conference on Computational Linguistics, August 2014, pp.520-529. https://doi.org/10.13140/2.1.5189.7601.

  13. Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In Proc. the 3rd International Conference on Learning Representations, May 2015.

  14. Wang Z, Zhang Y, Lee S, Li S, Zhou G. A bilingual attention network for code-switched emotion prediction. In Proc. the 26th International Conference on Computational Linguistics, December 2016, pp.1624-1634.

  15. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville C A, Bengio Y. Generative adversarial nets. In Proc. the 27th International Conference on Neural Information Processing Systems, Dec. 2014, pp.2672-2680.

  16. Chen X, Athiwaratkun B, Sun Y, Weinberger Q K. Adversarial deep averaging networks for cross-lingual sentiment classification. Trans. Assoc. Comput. Linguistics, 2018, 6: 557-570. https://doi.org/10.1162/tacl_a_00039.

    Article  Google Scholar 

  17. Zhou X, Wang Z, Li S, Zhou G, Zhang M. Emotion detection with neural personal discrimination. In Proc. the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Nov. 2019, pp.5498-5506. https://doi.org/10.18653/v1/D19-1552.

  18. Andrew J. Evolution of facial expression. Science, 1963, 142(3595): 1034-1041.https://doi.org/10.1126/science.142.3595.1034.

    Article  Google Scholar 

  19. Ekman P. Facial expression and emotion. American Psychologist, 1993, 48(4): 384-392/ https://doi.org/10.1037/0003-066x.48.4.384/.

  20. Olson I, Plotzker A, Ezzyat Y. The enigmatic temporal pole: A review of findings on social and emotional processing. Brain, 2007, 130(7): 1718-1731. https://doi.org/10.1093/brain/awm052.

    Article  Google Scholar 

  21. Hervé P Y, Razafimandimby A, Vigneau M, Mazoyer B, Tzourio-Mazoyer N. Disentangling the brain networks supporting affective speech comprehension. NeuroImage, 2012, 61(4): 1255-1267. https://doi.org/10.1016/j.neuroimage.2012.03.073.

    Article  Google Scholar 

  22. Smith C A, Kirby L D. Toward delivering on the promise of appraisal theory. In Appraisal Processes in Emotion: Theory, Methods, Research, Scherer K, Schorr A, Johnsone T (eds.), Oxford University Press, 2001, pp.121-138.

  23. Bridge D, Chian J, Paller K. Emotional context at learning systematically biases memory for facial information. Memory & Cognition, 2010, 38(2): 125-133. https://doi.org/10.3758/MC.38.2.125.

    Article  Google Scholar 

  24. Yang C, Lin K, Chen H. Emotion classification using web blog corpora. In Proc. the 2007 IEEE/WIC/ACM International Conference on Web Intelligence, Nov. 2007, pp.275-278. https://doi.org/10.1109/WI.2007.51.

  25. Strapparava C, Mihalcea R. Learning to identify emotions in text. In Proc. the 2008 ACM Symposium on Applied Computing, Mar. 2008, pp.1556-1560. https://doi.org/10.1145/1363686.1364052.

  26. Bhowmick P, Basu A, Mitra P, Prasad A. Multi-label text classification approach for sentence level news emotion analysis. In Proc. the 3rd International Conference on Pattern Recognition and Machine Intelligence, Dec. 2009. pp.261-266. https://doi.org/10.1007/978-3-642-11164-8_42.

  27. Balabantaray R, Mohammad M, Sharma N. Multi-class Twitter emotion classification: A new approach. International Journal of Applied Information Systems, 2012, 4(1): 48-53. https://doi.org/10.5120/ijais12-450651.

    Article  Google Scholar 

  28. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 2011, 12: 2493-2537.

    MATH  Google Scholar 

  29. Goldberg Y. A primer on neural network models for natural language processing. Journal of Artificial Intelligence Research, 2016, 57(1): 345-420. https://doi.org/10.1613/jair.4992.

    Article  MathSciNet  MATH  Google Scholar 

  30. Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences. arXiv:1404.2188, 2014. https://arxiv.org/abs/1404.2188, Jan. 2021.

  31. Jabreel M, Moreno A. Target-dependent sentiment analysis of tweets using a bi-directional gated recurrent unit. In Proc. the 13th International Conference on Web Information Systems and Technologies, Apr. 2017, pp.80-87. https://doi.org/10.5220/0006299900800087.

  32. Ma Y, Peng H, Cambria E. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In Proc. the 32nd AAAI Conference on Artificial Intelligence, Feb. 2018, pp.5876-5883.

  33. Colneric N, Demšar J. Emotion recognition on Twitter: Comparative study and training a unison model. IEEE Transactions on Affective Computing, 2020, 11(3): 433-446. https://doi.org/10.1109/TAFFC.2018.2807817.

    Article  Google Scholar 

  34. Zhang L, Wu L, Li S, Wang Z, Zhou G. Cross-lingual emotion classification with auxiliary and attention neural networks. In Proc. the 7th CCF International Conference on Natural Language Processing and Chinese Computing, Aug. 2018, pp.429-441, https://doi.org/10.1007/978-3-319-99495-6_36.

  35. He H, Xia R. Joint binary neural network for multilabel learning with applications to emotion classification. In Proc. the 7th CCF International Conference on Natural Language Processing and Chinese Computing, Aug. 2018, pp.250-259, https://doi.org/10.1007/978-3-319-99495-6_21.

  36. Mislove A, Lehmann S, Ahn Y, Onnela J, Rosenquist J. Understanding the demographics of Twitter users. In Proc. the 5th International Conference on Weblogs and Social Media, July 2012, pp.554-557.

  37. Nguyen D, Gravel R, Trieschnigg D, Meder T. “How old do you think I am?” A study of language and age in Twitter. In Proc. the 7th International Conference on Weblogs and Social Media, July 2013.

  38. Volkova S, Wilson T, Yarowsky D. Exploring demographic language variations to improve multilingual sentiment analysis in social media. In Proc. the 2013 Conference on Empirical Methods in Natural Language Processing, Oct. 2013, pp.1815-1827.

  39. Dirk H. Demographic factors improve classification performance. In Proc. the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, July 2015, pp.752-762, https://doi.org/10.3115/v1/P15-1073.

  40. Chaumartin F. UPAR7: A knowledge-based system for headline sentiment tagging. In Proc. the 4th International Workshop on Semantic Evaluations, June 2007, pp.422-425.

  41. Balahur A, Hermida J, Montoyo A. Detecting implicit expressions of sentiment in text based on commonsense knowledge. In Proc. the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis, June 2011, pp.53-60.

  42. Wang X, Zheng Q. Text emotion classification research based on improved latent semantic analysis algorithm. In Proc. the 2nd International Conference on Computer Science and Electronics Engineering, March 2013, pp.210-213. https://doi.org/10.2991/iccsee.2013.55.

  43. Vosoughi S, Zhou H, Roy D. Enhanced Twitter sentiment classification using contextual information. arXiv:1605.05195, 2016. http://arxiv.org/abs/1605.05195, Jan. 2021.

  44. Wang A, Lee S, Li S, Zhou G. Emotion detection in codeswitching texts via bilingual and sentimental information. In Proc. the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, July 2015, pp.763-768, https://doi.org/10.3115/v1/P15-2125.

  45. Dosovitskiy A, Springenberg J, Brox T. Learning to generate chairs with convolutional neural networks. In Proc. the 2015 IEEE Conference on Computer Vision and Pattern Recognition, June 2015, pp.1538-1546. https://doi.org/10.1109/CVPR.2015.7298761.

  46. Denton E, Chintala S, Szlam A, Fergus R. Deep generative image models using a Laplacian pyramid of adversarial networks. In Proc. the 28th International Conference on Neural Information Processing Systems, Dec. 2015, pp.1486-1494.

  47. Donahue J, Krähenbühl P, Darrell T. Adversarial feature learning. In Proc. the 5th International Conference on Learning Representations, Apr. 2017.

  48. Mirza M, Osindero S. Conditional generative adversarial nets. arXiv:1411.1784, 2014. https://arxiv.org/abs/1411.1784, Nov. 2020.

  49. Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Lavioletter F, Marchand M, Lempitsky V. Domain adversarial training of neural networks. The Journal of Machine Learning Research, 2016, 17(1): 2096-2030.

    MathSciNet  MATH  Google Scholar 

  50. Ajakan H, Germain P, Larochelle H, Lavioletter F, Marchand M. Domain-adversarial neural networks. arXiv:1412.4446, 2014. https://arxiv.org/abs/1412.4446, Dec. 2020.

  51. Bousmalis K, Trigeorgis G, Silberman N, Krishnan D, Erhan D. Domain separation networks. In Proc. the 30th International Conference on Neural Information Processing Systems, Dec. 2016, pp.343-351.

  52. Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T. Deep domain confusion: Maximizing for domain invariance. arXiv:1412.3474, 2014. https://arxiv.org/abs/1412.3474, Dec. 2020.

  53. Long M, Cao Y, Wang J, Jordan M. Learning transferable features with deep adaptation networks. In Proc. the 32nd International Conference on International Conference on Machine Learning, July 2015. pp.97-105.

  54. Zhang Y, Barzilay R, Jaakkola T. Aspect-augmented adversarial networks for domain adaptation. Transactions of the Association for Computational Linguistics, 2017, 5: 515-528. https://doi.org/10.1162/tacl_a_00077.

    Article  Google Scholar 

  55. Gui T, Zhang Q, Huang H, Peng M, Huang X. Part-of-speech tagging for twitter with adversarial neural networks. In Proc. the 2017 Conference on Empirical Methods in Natural Language Processing, Sept. 2017, pp.2411-2420. https://doi.org/10.18653/v1/D17-1256.

  56. Liu P, Qiu X, Huang X. Adversarial multi-task learning for text classification. In Proc. the 55th Annual Meeting of the Association for Computational Linguistics, July 2017, pp.1-10. https://doi.org/10.18653/v1/P17-1001.

  57. Wang Z, Lee S, Li S, Zhou G. Emotion analysis in codeswitching text with joint factor graph model. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2017, 25(3): 469-480. https://doi.org/10.1109/TASLP.2016.2637280.

    Article  Google Scholar 

  58. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735.

    Article  Google Scholar 

  59. Mikolov T, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality. In Proc. the 26th International Conference on Neural Information Processing Systems, Dec. 2013, pp.3111-3119.

  60. Duchi J, Hazan E, Singer Y. Adaptive sub-gradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 2011, 12(7): 2121-2159.

    MathSciNet  MATH  Google Scholar 

  61. Tomas M, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality. In Proc. the 26th International Conference on Neural Information Processing Systems, Dec. 2013, pp.3111-3119.

  62. Lee S, Chen Y, Huang C, Li S. Detecting emotion causes with a linguistic rule-based approach. Computational Intelligence, 2013, 29(3): 390-416. https://doi.org/10.1111/j.1467-8640.2012.00459.x.

    Article  MathSciNet  Google Scholar 

  63. Cheng J, Dong L, Lapata M. Long short-term memory networks for machine reading. arXiv:1601.06733, 2016. https://arxiv.org/abs/1601.06733, Jan. 2020.

  64. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A, Kaiser L, Polosukhin I. Attention is all you need. In Proc. the 31st International Conference on Neural Information Processing Systems, Dec. 2017, pp.6000-6010.

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Soochow University, Suzhou, 215006, China

    Xia-Bing Zhou, Zhong-Qing Wang, Min Zhang & Guo-Dong Zhou

  2. Konka AIOT Research Laboratory, Konka Group Company Limited, Shenzhen, 518053, China

    Xing-Wei Liang

Authors
  1. Xia-Bing Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhong-Qing Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xing-Wei Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Min Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guo-Dong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhong-Qing Wang.

Supplementary Information

ESM 1

(PDF 279 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, XB., Wang, ZQ., Liang, XW. et al. Neural Emotion Detection via Personal Attributes. J. Comput. Sci. Technol. 37, 1146–1160 (2022). https://doi.org/10.1007/s11390-021-0606-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-021-0606-7

Keywords

Search

Navigation