Skip to main content
Log in

EEG signal classification using improved intuitionistic fuzzy twin support vector machines

  • S.I.: Improving Healthcare outcomes using Multimedia Big Data Analytics
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Support-vector machines (SVMs) have been successfully employed to diagnose neurological disorders like epilepsy and sleep disorders via electroencephalogram (EEG) signal classification. However, EEG signals are susceptible to noise and outliers while recording. Thus, classification of EEG signals require efficient methods that is robust to noise and outliers. SVMs suffer in the presence of noise and outliers as it treats each sample to be of equal importance. Fuzzy membership function has been successful in dealing with noise and outliers. Fuzzy support vector machine uses fuzzy membership to give the appropriate weight to each sample for reducing the effect of noise and outliers. To reduce the effect of noise and outliers, intuitionistic fuzzy twin support vector machines (IFTWSVM) uses both membership and non-membership weights to subsidise the effect of outliers. Moreover, IFTWSVM solves smaller size quadratic programming problems which makes it comparatively efficient than fuzzy support vector machines. However, IFTWSVM suffers as (i) it involves the computation of matrix inverses which makes it intractable as the size of the data increases. (ii) it solves different problems for linear and nonlinear cases, and nonlinear case with linear kernel does not reduce to the linear case. Thus, it can only solve the approximate formulation not the exact formulation. To overcome these issues, we propose improved intuitionistic fuzzy twin support vector machine (IIFTWSVM). The proposed IIFTWSVM introduces different Lagrangian functions to avoid the computation of matrix inverses. Also, in nonlinear case, kernel trick is applied directly and hence, the exact formulation is solved. We employed the proposed IIFTWSVM for the classification of EEG signals. The experimental results and statistical analysis show that the proposed IIFTWSVM model is better compared to the given baseline models. Also, we evaluate the performance of the models on KEEL datasets to check the robustness of the proposed IIFTWSVM model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Adeli H, Zhou Z, Dadmehr N (2003) Analysis of EEG records in an epileptic patient using wavelet transform. J Neurosci Methods 123(1):69–87

    Article  Google Scholar 

  2. Alcalá-Fdez J, Fernández A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) Keel data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Mult.-Valued Log Soft Comput 17:255–287

    Google Scholar 

  3. Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907

    Article  Google Scholar 

  4. Bollegala D, Matsuo Y, Ishizuka M (2010) A web search engine-based approach to measure semantic similarity between words. IEEE Trans Knowl Data Eng 23(7):977–990

    Article  Google Scholar 

  5. Chang KW, Hsieh CJ, Lin CJ (2008) Coordinate descent method for large-scale l2-loss linear support vector machines. J Mach Learn Res 9(7):1369–1398

    MathSciNet  Google Scholar 

  6. Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30

    MathSciNet  Google Scholar 

  7. Ganaie M, Tanveer M, Lin CT (2022) Large scale fuzzy least squares twin SVMs for class imbalance learning. IEEE Trans Fuzzy Syst https://doi.org/10.1109/TFUZZ.2022.3161729

    Article  Google Scholar 

  8. Gao BB, Wang JJ, Wang Y, Yang, CY (2015) Coordinate descent fuzzy twin support vector machine for classification. In: 2015 IEEE 14th international conference on machine learning and applications (ICMLA). IEEE, pp 7–12

  9. Ha M, Wang C, Chen J (2013) The support vector machine based on intuitionistic fuzzy number and kernel function. Soft Comput 17(4):635–641

    Article  Google Scholar 

  10. Hsieh CJ, Chang KW, Lin CJ, Keerthi SS, Sundararajan S (2008) A dual coordinate descent method for large-scale linear SVM. In: Proceedings of the 25th international conference on machine learning, pp 408–415

  11. Huang X, Shi L, Suykens JA (2013) Support vector machine classifier with pinball loss. IEEE Trans Pattern Anal Mach Intell 36(5):984–997

    Article  Google Scholar 

  12. Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910

    Article  Google Scholar 

  13. Joachims T (1999) Making large-scale support vector machine learning practical, advances in kernel methods. Support Vector Learning

  14. Khemchandani R, Chandra S et al (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88

    Article  MathSciNet  Google Scholar 

  15. Kullback S (1997) Information theory and statistics. Courier Corporation, North Chelmsford

    Google Scholar 

  16. Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543

    Article  Google Scholar 

  17. Laxmi S, Gupta SK (2020) Intuitionistic fuzzy proximal support vector machines for pattern classification. Neural Process Lett 51(3):2701–2735

    Article  Google Scholar 

  18. Li CN, Huang YF, Wu HJ, Shao YH, Yang ZM (2016) Multiple recursive projection twin support vector machine for multi-class classification. Int J Mach Learn Cybern 7(5):729–740

    Article  Google Scholar 

  19. Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471

    Article  Google Scholar 

  20. Mangasarian OL, Wild EW (2005) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74

    Article  Google Scholar 

  21. Ocak H (2008) Optimal classification of epileptic seizures in EEG using wavelet analysis and genetic algorithm. Signal Process 88(7):1858–1867

    Article  Google Scholar 

  22. Osuna E, Freund R, Girosit F (1997) Training support vector machines: an application to face detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 130–136 (1997)

  23. Pal M, Mather P (2005) Support vector machines for classification in remote sensing. Int J Remote Sens 26(5):1007–1011

    Article  Google Scholar 

  24. Panup W, Ratipapongton W, Wangkeeree R (2022) A novel twin support vector machine with generalized pinball loss function for pattern classification. Symmetry 14(2):289

    Article  Google Scholar 

  25. Platt J (1998) Sequential minimal optimization: a fast algorithm for training support vector machines

  26. Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recognit 46(1):305–316

    Article  Google Scholar 

  27. Rezvani S, Wang X, Pourpanah F (2019) Intuitionistic fuzzy twin support vector machines. IEEE Trans Fuzzy Syst 27(11):2140–2151

    Article  Google Scholar 

  28. Richhariya B, Tanveer M (2018) EEG signal classification using universum support vector machine. Expert Syst Appl 106:169–182

    Article  Google Scholar 

  29. Richhariya B, Tanveer M (2018) A robust fuzzy least squares twin support vector machine for class imbalance learning. Appl Soft Comput 71:418–432

    Article  Google Scholar 

  30. Rosso O, Hyslop W, Gerlach R, Smith R, Rostas J, Hunter M (2005) Quantitative EEG analysis of the maturational changes associated with childhood absence epilepsy. Physica A 356(1):184–189

    Article  Google Scholar 

  31. Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968

    Article  Google Scholar 

  32. Shen X, Niu L, Qi Z, Tian Y (2017) Support vector machine classifier with truncated pinball loss. Pattern Recognit 68:199–210

    Article  Google Scholar 

  33. Subasi A, Gursoy MI (2010) EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Syst Appl 37(12):8659–8666

    Article  Google Scholar 

  34. Tanveer M, Gautam C, Suganthan PN (2019) Comprehensive evaluation of twin SVM based classifiers on UCI datasets. Appl Soft Comput 83:105617

    Article  Google Scholar 

  35. Tanveer M, Khan MA, Ho SS (2016) Robust energy-based least squares twin support vector machines. Appl Intell 45(1):174–186

    Article  Google Scholar 

  36. Tanveer M, Rajani T, Rastogi R, Shao, Y, Ganaie M (2022) Comprehensive review on twin support vector machines. Ann Oper Res pp 1–46. https://doi.org/10.1007/s10479-022-04575-w

    Article  Google Scholar 

  37. Tanveer M, Sharma A, Suganthan PN (2019) General twin support vector machine with pinball loss function. Inf Sci 494:311–327

    Article  MathSciNet  Google Scholar 

  38. Tanveer M, Sharma S, Muhammad K (2021) Large-scale least squares twin SVMs. ACM Trans Internet Technol 21(2):1–19

    Article  Google Scholar 

  39. Tanveer M, Tiwari A, Choudhary R, Ganaie MA (2021) Large-scale pinball twin support vector machines. Mach Learn. https://doi.org/10.1007/s10994-021-06061-z

    Article  Google Scholar 

  40. Tanveer M, Tiwari A, Choudhary R, Jalan S (2019) Sparse pinball twin support vector machines. Appl Soft Comput 78:164–175

    Article  Google Scholar 

  41. Theodoridis S, Koutroumbas K (2009) Chapter 5—feature selection. In: Pattern recognition, 4th edn. Academic Press, Boston, pp 261–322

  42. Vapnik Vladimir N (1995) The nature of statistical learning theory

  43. Wang H, Xu Y, Zhou Z (2021) Twin-parametric margin support vector machine with truncated pinball loss. Neural Comput Appl 33(8):3781–3798

    Article  Google Scholar 

  44. Wilcoxon F (1992) Individual comparisons by ranking methods. In: Breakthroughs in statistics. Springer, pp 196–202

  45. Yang L, Dong H (2018) Support vector machine with truncated pinball loss and its application in pattern recognition. Chemom Intell Lab Syst 177:89–99

    Article  Google Scholar 

  46. Yang ZM, Wu HJ, Li CN, Shao YH (2016) Least squares recursive projection twin support vector machine for multi-class classification. Int J Mach Learn Cybern 7(3):411–426

    Article  Google Scholar 

  47. Zhang Y, Duchi J, Wainwright M (2015) Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. J Mach Learn Res 16(1):3299–3340

    MathSciNet  Google Scholar 

  48. Zhou MM, Li L, Lu YL (2009) Fuzzy support vector machine based on density with dual membership. In: 2009 international conference on machine learning and cybernetics, vol 2. IEEE, pp 674–678

Download references

Acknowledgements

This work is funded by Government of India, Science and Engineering Research Board (SERB) under Ramanujan Fellowship Scheme, Grant No. SB/S2/RJN-001/2016, Department of Science and Technology under Interdisciplinary Cyber Physical Systems (ICPS) Scheme grant no. DST/ICPS/CPS-Individual/2018/276 and National Supercomputing Mission under DST and Miety, Govt. of India under Grant No. DST/NSM/R &D_HPC_Appl/2021/03.29. We acknowledge Council of Scientific & Industrial Research (CSIR), New Delhi, INDIA for Extra Mural Research (EMR) grant, under grant no. 22(0751)/17/EMR-II. Ms. Anuradha Kumari (File no - 09/1022 (12437)/2021-EMR-I) and Mr. Ashwani kumar Malik (File no - 09/1022 (0075)/2019-EMR-I) acknowledge the financial support given as scholarship by Council of Scientific and Industrial Research (CSIR), New Delhi, India. We are grateful for the facilities and support given by Indian Institute of Technology Indore, India.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Tanveer.

Ethics declarations

Conflict of interest

None.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ganaie, M.A., Kumari, A., Malik, A.K. et al. EEG signal classification using improved intuitionistic fuzzy twin support vector machines. Neural Comput & Applic 36, 163–179 (2024). https://doi.org/10.1007/s00521-022-07655-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07655-x

Keywords

Navigation