Abstract
With the development of deep learning, many motor imagery brain-computer interfaces based on convolutional neural networks (CNNs) show outstanding performances. However, the trial number of EEG in the training set is usually limited, and redundancy extensively exists in multiple channel EEG. Thus, overfitting often appears in CNN based motor imagery recognition model and greatly affects the performances of model. In this paper, channel drop out is proposed to address this problem by data augmentation and ensemble learning. Specifically, one of all EEG channels will be dropped and replaced by the mean signal of all EEG channels. In this way, the trial number in the training set was enlarged by channel drop out. And at the testing stage, all the EEG trials processed by channel drop out were fed to the CNN model and the average output probabilities of them were applied to determine the prediction. The experiments were conducted on two popular CNN models applied in motor imagery BCI and BCI Competition IV datasets 2a to verify the performances of the proposed channel drop out approach. The results show that average improvements provided by channel drop out in two-category or four-category motor imagery classification are 2.83% and 2.65% compared with the original CNN model. So the channel drop out approach significantly improves the performances of motor imagery based BCI.
Supported by the National Natural Science Foundation of China, grants 61906152 and 61976177 and Key Research and Development Program of Shaanxi (Program No. 2021GY-080).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Edelman, B.J., et al.: Noninvasive neuroimaging enhances continuous neural tracking for robotic device control. Sci. Robot. 4(31), eaaw6844 (2019)
Penaloza, C.I., Nishio, S.: BMI control of a third arm for multitasking. Sci. Robot. 3(20), eaat1228 (2018)
Luo, J., Wang, J., Xu, R., Xu, K.: Class discrepancy-guided sub-band filter-based common spatial pattern for motor imagery classification. J. Neurosci. Methods 323, 98–107 (2019)
Lemm, S., Blankertz, B., Curio, G., Muller, K.: Spatio-spectral filters for improving the classification of single trial EEG. IEEE Trans. Biomed. Eng. 52(9), 1541–1548 (2005)
Ang, K.K., Chin, Z.Y., Wang, C., Guan, C., Zhang, H.: Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b. Front. Neurosci. 6, 39 (2012)
Luo, J., Gao, X., Zhu, X., Wang, B., Lu, N., Wang, J.: Motor imagery EEG classification based on ensemble support vector learning. Comput. Methods Programs Biomed. 193, 105464 (2020)
Shahid, S., Prasad, G.: Bispectrum-based feature extraction technique for devising a practical brain-computer interface. J. Neural Eng. 8(2), 025014 (2011)
Morioka, H., et al.: Learning a common dictionary for subject-transfer decoding with resting calibration. Neuroimage 111, 167–178 (2015)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
Clevert, D.-A., Unterthiner, T., Hochreiter, S.: Fast and accurate deep network learning by exponential linear units (ELUS). arXiv preprint arXiv:1511.07289 (2015)
Schirrmeister, R.T., et al.: Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38(11), 5391–5420 (2017)
Lawhern, V.J., Solon, A.J., Waytowich, N.R., Gordon, S.M., Hung, C.P., Lance, B.J.: EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. J. Neural Eng. 15(5), 056013 (2018)
Ren, Y., Wu, Y.: Convolutional deep belief networks for feature extraction of EEG signal. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 2850–2853. IEEE (2014)
Sakhavi, S., Guan, C., Yan, S.: Parallel convolutional-linear neural network for motor imagery classification. In: 2015 23rd European Signal Processing Conference (EUSIPCO), pp. 2736–2740. IEEE (2015)
Tabar, Y.R., Halici, U.: A novel deep learning approach for classification of EEG motor imagery signals. J. Neural Eng. 14(1), 016003 (2016)
Tang, Z., Li, C., Sun, S.: Single-trial EEG classification of motor imagery using deep convolutional neural networks. Optik 130, 11–18 (2017)
Dai, G., Zhou, J., Huang, J., Wang, N.: HS-CNN: a CNN with hybrid convolution scale for EEG motor imagery classification. J. Neural Eng. 17(1), 016025 (2020)
Tangermann, M., et al.: Review of the BCI competition IV. Front. Neurosci. 6, 55 (2012)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems, pp. 8026–8037 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Luo, J., Wang, Y., Xu, R., Liu, G., Wang, X., Gong, Y. (2021). Channel Drop Out: A Simple Way to Prevent CNN from Overfitting in Motor Imagery Based BCI. In: Zeng, J., Qin, P., Jing, W., Song, X., Lu, Z. (eds) Data Science. ICPCSEE 2021. Communications in Computer and Information Science, vol 1451. Springer, Singapore. https://doi.org/10.1007/978-981-16-5940-9_34
Download citation
DOI: https://doi.org/10.1007/978-981-16-5940-9_34
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-5939-3
Online ISBN: 978-981-16-5940-9
eBook Packages: Computer ScienceComputer Science (R0)