Abstract
Emotion recognition based on EEG is a critical issue in Brain-Computer Interface (BCI). It also plays an important role in the e-healthcare systems, especially in the detection and treatment of patients with depression by classifying the mental states. Unlike previous works that feature extraction using multiple frequency bands leads to a redundant use of information, where similar and noisy features extracted. In this paper, we attempt to overcome this limitation with the proposed architecture, Channel Attention-based Emotion Recognition Networks (CAERN). It can capture more critical and effective EEG emotional features based on the use of attention mechanisms. Further, we employ deep residual networks (ResNets) to capture richer information and alleviate gradient vanishing. We evaluate the proposed model on two datasets: DEAP database and SJTU emotion EEG database (SEED). Compared to other EEG emotion recognition networks, the proposed model yields better performance. This demonstrates that our approach is capable of capturing more effective features for EEG emotion recognition.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Shu, L., Xie, J., Yang, M., et al.: A review of emotion recognition using physiological signals. Sensors 18(7), 2074 (2018)
De Nadai, S., Dinca, M., Parodi, F., et al.: Enhancing safety of transport by road by on-line monitoring of driver emotions. In: Service Oriented Software Engineering, pp. 1–4 (2016)
Guo, R., Li, S., He, L., et al.: Pervasive and unobtrusive emotion sensing for human mental health. In: International Conference on Pervasive Computing, pp. 436–439 (2013)
Verschuere, B., Crombez, G., Koster, E.H., et al.: Psychopathy and physiological detection of concealed information: a review. Psychologica Belgica 46, 99–116 (2006)
Zhang, Y., Yang, Z., Lu, H., et al.: Facial emotion recognition based on biorthogonal wavelet entropy, fuzzy support vector machine, and stratified cross validation. IEEE Access 4, 8375–8385 (2016)
Mao, Q., Dong, M., Huang, Z., et al.: Learning salient features for speech emotion recognition using convolutional neural networks. IEEE Trans. Multimed. 16(8), 2203–2213 (2014)
Wang, X.W., Nie, D., Lu, B.L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129(apr.10), 94–106 (2014)
Cheng, B., Liu, G.: Emotion recognition from surface EMG signal using wavelet transform and neural network. In: International Conference on Bioinformatics and Biomedical Engineering, pp. 1363–1366 (2008)
Juárez-Castillo, E., Acosta-Mesa, H.G., Fernandez-Ruiz, J., et al.: A feature selection method based on a neighborhood approach for contending with functional and anatomical variability in fMRI group analysis of cognitive states. Intell. Data Anal. 21(3), 661–677 (2017)
Tak, S., Ye, J.C.: Statistical analysis of fNIRS data: a comprehensive review. Neuroimage 85, 72–91 (2014)
Craik, A., He, Y., Contreras-Vidal, J.L.: Deep learning for Electroencephalogram (EEG) classification tasks: a review. J. Neural Eng. 16, 031001 (2019). https://doi.org/10.1088/1741-2552/ab0ab5
Duan, R., Zhu, J., Lu, B., et al.: Differential entropy feature for EEG-based emotion classification. In: International IEEE/EMBS Conference on Neural Engineering, pp. 81–84 (2013)
Zheng, W., Lu, B.: Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Mental Dev. 7(3), 162–175 (2015)
Tripathi, S., Acharya, S., Sharma, R.D., et al.: Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset. In: Innovative Applications of Artificial Intelligence, pp. 4746–4752 (2017)
Yang, Y., Wu, Q., Fu, Y., et al.: Continuous convolutional neural network with 3D input for EEG-based emotion recognition. In: International Conference on Neural Information Processing, pp. 433–443 (2018)
Piqueira, J.R.C.: Network of phase-locking oscillators and a possible model for neural synchronization. Commun. Nonlinear Sci. Numer. Simul. 16(9), 3844–3854 (2011)
Wang, Z., Tong, Y., Heng, X., et al.: Phase-locking value based graph convolutional neural networks for emotion recognition. IEEE Access 7, 93711–93722 (2019)
Chao, H., Dong, L., Liu, Y., Lu, B.: Emotion recognition from multiband EEG signals using CapsNet. Sensors 19, 2212 (2019)
Guo, S., Lin, Y., Feng, N., et al.: Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 922–929 (2019)
Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., Hu, Q.: ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks (2019)
He, K., Zhang, X., Ren, S., et al.: Deep residual learning for image recognition. In: Computer Vision and Pattern Recognition, pp. 770–778 (2016)
He, K., Zhang, X., Ren, S., Sun, J.: Identity mappings in deep residual networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 630–645. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_38
Koelstra, S., Muhl, C., Soleymani, M., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)
Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 42(8), 2011–2023 (2020). https://doi.org/10.1109/TPAMI.2019.2913372
Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: ICML (2010)
Acknowledgment
This research is supported by National Natural Science Foundation of China (41571401), Chongqing Natural Science Foundation (cstc2019jscx-mbdxX0021).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, X., Du, T., Zhang, Z. (2021). EEG Emotion Recognition Based on Channel Attention for E-Healthcare Applications. In: Lokoč, J., et al. MultiMedia Modeling. MMM 2021. Lecture Notes in Computer Science(), vol 12573. Springer, Cham. https://doi.org/10.1007/978-3-030-67835-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-67835-7_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-67834-0
Online ISBN: 978-3-030-67835-7
eBook Packages: Computer ScienceComputer Science (R0)