Skip to main content
SpringerLink
Log in

MIDNN- a classification approach for the EEG based motor imagery tasks using deep neural network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In recent times, Motor Imagery (MI) tasks have gained great attraction among researchers in the field of Brain-Computer Interface (BCI). The MI tasks are the core field of the human brain in which the person imagines the movement of the body parts without performing actual movement of the body. MI tasks cause the activation of lakhs of neurons in the brain to interact with each other. The activation of the neurons generates electrical signals that can be captured through electroencephalogram (EEG) devices. The MI-EEG-based signals can move the external devices such as a wheelchair, moving cursors, etc., and hence, are very helpful to design and develop personal assistants for the disabled person for interaction and communication to the outside world. In this paper, MI-EEG data for left-hand(LH) and right-hand(RH) movements are recorded using a multi-channel EEG device. Further, a Deep Neural Network (DNN) model (MIDNN) is proposed for the binary-class classification of the collected dataset. The performance of the proposed model has been tested on the BCI benchmark dataset BCI competition III V dataset for LH and RH MI tasks.The fifth order low pass Butterworth filter is used to denoise the raw signals and then decomposed into six frequency sub-bands of (0.5–4) Hz, (4–8) Hz, (8–12) Hz, (12–16) Hz, (16–24) Hz, and (24–40) Hz using Butterworth bandpass filter of same order. The sub-bands are used to extract features from MI-EEG signals of LH and RH movement using welch power spectral density (PSD). The accuracy obtained by the MIDNN model is around 70% on the local dataset and 72.51% on the BCI dataset using PSD as features from each channel for classification of LH and RH tasks. To further improve the performance of the model, the spectral features from the estimated PSD of each of the six sub-band are obtained in the form of band power. The accuracy obtained by the same MIDNN model using band power as features is 88.89% on the local dataset and 82.48% on the V dataset of BCI competition III. The proposed MIDNN model acheived a significant increase in classification accuracy by 13.7% and 26.9% on BCI and Emotiv dataset respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Bansal D, Mahajan R (2019) EEG-based brain-computer Interfaces: cognitive analysis and control applications. Academic Press, New York

    Google Scholar 

  2. Tan D, Nijholt A (2010) Brain-computer interfaces and human-computer interaction. In: Brain-computer interfaces. Springer, pp 3–19

  3. Yuan H, He B (2014) Brain–computer interfaces using sensorimotor rhythms: current state and future perspectives. IEEE Trans Biomed Eng 61(5):1425–1435

    Article  Google Scholar 

  4. Niedermeyer E, Lopes da Silva FH (2005) Electroencephalography: basic principles, clinical applications, and related fields. Lippincott Williams & Wilkins

  5. Panicker RC, Puthusserypady S, Sun Y (2011) An asynchronous p300 bci with ssvep-based control state detection. IEEE Trans Biomed Eng 58(6):1781–1788

    Article  Google Scholar 

  6. Thomas E, Dyson M, Clerc M (2013) An analysis of performance evaluation for motor-imagery based bci. J Neural Eng 10(3):031001

    Article  Google Scholar 

  7. Wang M, Daly I, Allison BZ, Jin J, Zhang Y, Chen L, Wang X (2015) A new hybrid bci paradigm based on p300 and ssvep. J Neurosci Methods 244:16–25

    Article  Google Scholar 

  8. Formaggio E, Storti SF, Cerini R, Fiaschi A, Manganotti P (2010) Brain oscillatory activity during motor imagery in EEG-fmri coregistration. Magn Reson Imaging 28(10):1403–1412

    Article  Google Scholar 

  9. Hipp JF, Hawellek DJ, Corbetta M, Siegel M, Engel AK (2012) Large-scale cortical correlation structure of spontaneous oscillatory activity. Nat Neurosci 15(6):884

    Article  Google Scholar 

  10. Bashashati H, Ward RK, Birch GE, Bashashati A (2015) Comparing different classifiers in sensory motor brain computer interfaces. PloS ONE 10(6):e0129435

    Article  Google Scholar 

  11. Johnstone SJ, Blackman R, Bruggemann JM (2012) EEG from a single-channel dry-sensor recording device. Clin EEG Neurosci 43(2):112–120

    Article  Google Scholar 

  12. Saeed U, Muhammad S, Anwar SM, Majid M, Awais M, Alnowami M (2018) Selection of neural oscillatory features for human stress classification with single channel EEG headset. BioMed Res Int pp 2018

  13. Dilmaghani R, Ghavami M, Cumar K, Dualeh A, Sousa SG, Mohd RS, Sekanderzada M, Koke H (2010) Design and implementation of a wireless multi-channel EEG recording. In: 2010 7th international symposium on communication systems, networks & digital signal processing (CSNDSP 2010). IEEE, pp 741–746

  14. Mirkovic B, Debener S, Jaeger M, De Vos M (2015) Decoding the attended speech stream with multi-channel eeg: implications for online, daily-life applications. J Neural Eng 12(4):046007

    Article  Google Scholar 

  15. Tonin L, Carlson T, Leeb R, Millán JDR (2011) Brain-controlled telepresence robot by motor-disabled people. In: 2011 Annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 4227–4230

  16. Hossain SM, Amin SU, Alsulaiman M, Muhammad G (2019) Applying deep learning for epilepsy seizure detection and brain mapping visualization. ACM Trans Multimed Comput Commun Appl (TOMM) 15(1s):1–17

    Article  Google Scholar 

  17. Long J, Li Y, Yu T, Gu Z (2011) Target selection with hybrid feature for bci-based 2-d cursor control. IEEE Trans Biomed Eng 59(1):132–140

    Article  Google Scholar 

  18. Long J, Li Y, Wang H, Yu T, Pan J, Li F (2012) A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans Neural Syst Rehabil Eng 20 (5):720–729

    Article  Google Scholar 

  19. Meng J, Zhang S, Bekyo A, Olsoe J, Baxter B, He B (2016) Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks. Sci Rep 6:38565

    Article  Google Scholar 

  20. Almonacid M, Ibarrola J, Cano-Izquierdo JM (2014) Voting strategy to enhance multimodel eeg-based classifier systems for motor imagery bci. IEEE Syst J 10(3):1082–1088

    Article  Google Scholar 

  21. Bhatti MH, Khan J, Khan MUG, Iqbal R, Aloqaily M, Jararweh Y, Gupta B (2019) Soft computing-based EEG classification by optimal feature selection and neural networks. IEEE Trans Ind Inform 15(10):5747–5754

    Article  Google Scholar 

  22. Jia H, Wang S, Zheng D, Qu X, Fan S (2019) Comparative study of motor imagery classification based on bp-nn and svm. J Eng 2019(23):8646–8649

    Article  Google Scholar 

  23. Wu D, King JT, Chuang CH, Lin CT, Jung TP (2017) Spatial filtering for eeg-based regression problems in brain–computer interface (bci). IEEE Trans Fuzzy Syst 26(2):771–781

    Article  Google Scholar 

  24. Miao M, Zhang W, Hu W, Wang R (2020) An adaptive multi-domain feature joint optimization framework based on composite kernels and ant colony optimization for motor imagery eeg classification. Biomed Sig Process Control 61:101994

    Article  Google Scholar 

  25. Chatterjee R, Maitra T, Hafizul Islam SK, Hassan MM, Alamri A, Fortino G (2019) A novel machine learning based feature selection for motor imagery eeg signal classification in internet of medical things environment. Futur Gener Comput Syst 98:419–434

    Article  Google Scholar 

  26. Ali MA, Ucuncu D, Atas PK, Ozogur-Akyuz S (2019) Classification of motor imagery task by using novel ensemble pruning approach. IEEE Trans Fuzzy Syst

  27. Majidov I, Whangbo T (2019) Efficient classification of motor imagery electroencephalography signals using deep learning methods. Sensors 19(7):1736

    Article  Google Scholar 

  28. Jiang A, Shang J, Liu X, Tang Y, Kwan HK, Zhu Y (2020) Efficient csp algorithm with spatio-temporal filtering for motor imagery classification. IEEE Trans Neural Syst Rehabil Eng 28 (4):1006–1016

    Article  Google Scholar 

  29. Rahman MKM, Joadder MAM (2020) A space-frequency localized approach of spatial filtering for motor imagery classification. Health Inf Sci Syst 8:1–8

    Article  Google Scholar 

  30. Meziani A, Djouani K, Medkour T, Chibani A (2019) A lasso quantile periodogram based feature extraction for eeg-based motor imagery. J Neurosci Methods 328:108434

    Article  Google Scholar 

  31. Kevric J, Subasi A (2017) Comparison of signal decomposition methods in classification of eeg signals for motor-imagery bci system. Biomed Sig Process Control 31:398–406

    Article  Google Scholar 

  32. Wang Z, Ma Z, Du X, Dong Y, Liu W (2020) Research on the key technologies of motor imagery eeg signal based on deep learning. J Auton Intell 2(4):1–14

    Google Scholar 

  33. Abbaspour H, Mehrshad N, Razavi SM (2020) Identifying motor imagery activities in brain computer interfaces based on the intelligent selection of most informative timeframe. SN Appl Sci 2(2):232

    Article  Google Scholar 

  34. Tang X, Li W, Li X, Ma W, Dang X (2020) Motor imagery eeg recognition based on conditional optimization empirical mode decomposition and multi-scale convolutional neural network. Expert Syst Appl 149:113285

    Article  Google Scholar 

  35. Sreeja SR, Samanta D et al (2020) Distance-based weighted sparse representation to classify motor imagery eeg signals for bci applications. Multimed Tools Appl pp 1–19

  36. Luo J, Gao X, Zhu X, Wang B, Lu N, Wang J (2020) Motor imagery EEG classification based on ensemble support vector learning. Comput Methods Prog Biomed 193:105464

    Article  Google Scholar 

  37. de Cheveigné A, Nelken I (2019) Filters: when, why, and how (not) to use them. Neuron 102(2):280–293

    Article  Google Scholar 

  38. Kingma DP, Adam JB (2014) A method for stochastic optimization. arXiv:1412.6980

  39. Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M et al (2016) Tensorflow: A system for large-scale machine learning. In: 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16), pp 265–283

  40. Géron A (2019) Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O’Reilly Media

  41. Galán F, Oliva F, Guardia J (2005) Bci competition iii. data set v: Algorithm description. Brain computer interfaces competition III

  42. Chacon-Murguia MI, Olivas-Padilla BE, Ramirez-Quintana J (2020) A new approach for multiclass motor imagery recognition using pattern image features generated from common spatial patterns. SIViP pp 1–9

  43. Bhattacharya S, Haddad RJ, Ahad M (2016) A multiuser EEG based imaginary motion classification using neural networks. In: SoutheastCon 2016. IEEE, pp 1–5

  44. Agarwal SK, Shah S, Kumar R (2015) Classification of mental tasks from eeg data using backtracking search optimization based neural classifier. Neurocomputing 166:397–403

    Article  Google Scholar 

  45. Opałka S, Szajerman D, Wojciechowski A (2019) Lstm multichannel neural networks in mental task classification. COMPEL-The International journal for computation and mathematics in electrical and electronic engineering

  46. Siuly S, Zarei R, Wang H, Zhang Y (2017) A new data mining scheme for analysis of big brain signal data. In: Australasian database conference. Springer, pp 151–164

  47. Masood N, Farooq H (2017) Emotiv-based low-cost brain computer interfaces: A survey. In: Advances in neuroergonomics and cognitive engineering, Springer, pp 133–142

  48. Homan RW, Herman J, Purdy P (1987) Cerebral location of international 10–20 system electrode placement. Electroencephalogr Clin Neurophysiol 66(4):376–382

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Engineering, Bennett University, Greater Noida, India

    Smita Tiwari, Shivani Goel & Arpit Bhardwaj

Authors
  1. Smita Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shivani Goel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arpit Bhardwaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Smita Tiwari.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tiwari, S., Goel, S. & Bhardwaj, A. MIDNN- a classification approach for the EEG based motor imagery tasks using deep neural network. Appl Intell 52, 4824–4843 (2022). https://doi.org/10.1007/s10489-021-02622-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02622-w

Keywords

Search

Navigation