Skip to main content

Emotion Recognition in VAD Space During Emotional Events Using CNN-GRU Hybrid Model on EEG Signals

  • Conference paper
  • First Online:
Intelligent Human Computer Interaction (IHCI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13741))

Included in the following conference series:

Abstract

Emotion recognition from brain signals is an emerging area of interest in the scientific community. We used EEG signals to classify emotional events on different combinations of valence(V), arousal(A) and dominance(D) dimensions and compared their results. DENS data is used for this purpose which is primarily recorded on the Indian population. STFT is used for feature extraction and used in the classification model consisting of CNN-GRU hybrid layers. Two classification models were evaluated to classify emotional feelings in valence-arousal-dominance space (eight classes) and valence-arousal space (four classes). The results show that VAD space’s accuracy is 97.50% and VA space is 96.93%. We conclude that having precise information about emotional feelings improves the classification accuracy in comparison to long-duration EEG signals which might be contaminated by mind-wandering. In addition, our results suggest the importance of considering the dominance dimension during the emotion classification.

M. Asif, M. T. Vinodbhai, S. Mishra, A. Gupta—These authors contributed equally to this work and author sequence is random.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Koelstra, S., et al.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3, 18–31 (2011)

    Article  Google Scholar 

  2. Zheng, W., Lu, B.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Ment. Dev. 7, 162–175 (2015)

    Article  Google Scholar 

  3. Katsigiannis, S., Ramzan, N.: DREAMER: a database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. IEEE J. Biomed. Health Inform. 22, 98–107 (2018)

    Article  Google Scholar 

  4. Miranda-Correa, J., Abadi, M., Sebe, N., Patras, I.: AMIGOS: a dataset for affect, personality and mood research on individuals and groups. IEEE Trans. Affect. Comput. 12, 479–493 (2021)

    Article  Google Scholar 

  5. Jerram, M., Lee, A., Negreira, A., Gansler, D.: The neural correlates of the dominance dimension of emotion. Psychiatry Res. Neuroimaging 221, 135–141 (2014)

    Article  Google Scholar 

  6. Verma, G., Tiwary, U.: Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals. Neuroimage 102, 162–172 (2014)

    Article  Google Scholar 

  7. Barrett, L., Russell, J.: The structure of current affect: controversies and emerging consensus. Curr. Dir. Psychol. Sci. 8, 10–14 (1999)

    Article  Google Scholar 

  8. Blascovich, J., Mendes, W.: Challenge and Threat Appraisals: The Role of Affective Cues. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  9. Mishra, S., Srinivasan, N., Tiwary, U.: Affective film dataset from India (AFDI): creation and validation with an Indian sample. (PsyArXiv 2021)

    Google Scholar 

  10. Mishra, S., Srinivasan, N., Tiwary, U.: Cardiac–brain dynamics depend on context familiarity and their interaction predicts experience of emotional arousal. Brain Sci. 12 (2022). https://www.mdpi.com/2076-3425/12/6/702

  11. Kehtarnavaz, N.: CHAPTER 7 - Frequency Domain Processing. Digital Signal Processing System Design (2nd Edn), pp. 175–196 (2008). https://www.sciencedirect.com/science/article/pii/B9780123744906000076

  12. Krishnan, S.: 5 - Advanced analysis of biomedical signals. Biomed. Signal Anal. Connected Healthcare, pp. 157–222 (2021). https://www.sciencedirect.com/science/article/pii/B9780128130865000037

  13. Li, Z., Liu, F., Yang, W., Peng, S., Zhou, J.: A survey of convolutional neural networks: analysis, applications, and prospects. IEEE Trans. Neural Netw. Learn. Syst. (2021)

    Google Scholar 

  14. O’Shea, K., Nash, R.: An introduction to convolutional neural networks. ArXiv Preprint ArXiv:1511.08458 (2015)

  15. Golmohammadi, M., et al.: Gated recurrent networks for seizure detection. 2017 IEEE Signal Processing In Medicine and Biology Symposium (SPMB), pp. 1–5 (2017)

    Google Scholar 

  16. Rana, R.: Gated recurrent unit (GRU) for emotion classification from noisy speech. ArXiv Preprint ArXiv:1612.07778 (2016)

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Mohammad Asif , Majithia Tejas Vinodbhai or Sudhakar Mishra .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Asif, M., Vinodbhai, M.T., Mishra, S., Gupta, A., Tiwary, U.S. (2023). Emotion Recognition in VAD Space During Emotional Events Using CNN-GRU Hybrid Model on EEG Signals. In: Zaynidinov, H., Singh, M., Tiwary, U.S., Singh, D. (eds) Intelligent Human Computer Interaction. IHCI 2022. Lecture Notes in Computer Science, vol 13741. Springer, Cham. https://doi.org/10.1007/978-3-031-27199-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27199-1_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27198-4

  • Online ISBN: 978-3-031-27199-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics