Abstract
Emotion recognition plays a vital role in Brain-Computer Interaction. To extract and employ the inherent information implied by functional connections among EEG electrodes, we propose a multichannel EEG emotion recognition method using convolutional neural network (CNN) with functional connectivity as input. Specifically, the phase synchronization indices are employed to compute the EEG functional connectivity matrices. Then a CNN is proposed to effectively extract the classification information of these functional connections. The experimental results based on the DEAP and SEED datasets validate the superior performance of the proposed method, compared with the input of raw EEG data. The code of the proposed model is available at https://github.com/deep-bci/ERBCPSI.
This work was supported in part by the National Natural Science Foundation of China under Grants 61703065, 61906048 and 61901077. Chongqing Research Program of Application Foundation and Advanced Technology under Grant cstc2018jcyjAX0151, the Science and Technology Research Program of Chongqing Municipal Education Commission under Grant KJQN201800612.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abiri, R., Borhani, S., Sellers, E.W., Jiang, Y., Zhao, X.: A comprehensive review of EEG-based brain-computer interface paradigms. J. Neural Eng. 16(1), 011001 (2019)
de Abril, I.M., Yoshimoto, J., Doya, K.: Connectivity inference from neural recording data: challenges, mathematical bases and research directions. Neural Networks 102, 120–137 (2018)
Chaudhary, P., Agrawal, R.: Brain computer interface: a new pathway to human brain. In: Mallick, P.K., Pattnaik, P.K., Panda, A.R., Balas, V.E. (eds.) Cognitive Computing in Human Cognition. LAIS, vol. 17, pp. 99–125. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-48118-6_10
Ding, Y., et al.: Tsception: a deep learning framework for emotion detection using EEG. arXiv preprint arXiv:2004.02965 (2020)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiV:abs/1412.6980 (2014)
Koelstra, S., et al.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2011)
Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)
Lee, Y.Y., Hsieh, S.: Classifying different emotional states by means of EEG-based functional connectivity patterns. PloS one 9(4), e95415 (2014)
Li, P., et al.: EEG based emotion recognition by combining functional connectivity network and local activations. IEEE Trans. Biomed. Eng. 66(10), 2869–2881 (2019)
Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)
Wang, Y., Chiew, V.: On the cognitive process of human problem solving. Cogn. Syst. Res. 11(1), 81–92 (2010)
Xu, T., Yin, R., Shu, L., Xu, X.: Emotion recognition using frontal EEG in VR affective scenes. In: 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC), vol. 1, pp. 1–4. IEEE (2019)
Zheng, W.L., Lu, B.L.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Mental Dev. 7(3), 162–175 (2015)
Zheng, W.L., Zhu, J.Y., Lu, B.L.: Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans. Affect. Comput. 10, 417 (2017)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, H., Liu, K., Qi, F., Deng, X., Li, P. (2021). EEG-Based Emotion Recognition Using Convolutional Neural Network with Functional Connections. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_3
Download citation
DOI: https://doi.org/10.1007/978-981-16-2336-3_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-2335-6
Online ISBN: 978-981-16-2336-3
eBook Packages: Computer ScienceComputer Science (R0)