Abstract
Support-vector machines (SVMs) have been successfully employed to diagnose neurological disorders like epilepsy and sleep disorders via electroencephalogram (EEG) signal classification. However, EEG signals are susceptible to noise and outliers while recording. Thus, classification of EEG signals require efficient methods that is robust to noise and outliers. SVMs suffer in the presence of noise and outliers as it treats each sample to be of equal importance. Fuzzy membership function has been successful in dealing with noise and outliers. Fuzzy support vector machine uses fuzzy membership to give the appropriate weight to each sample for reducing the effect of noise and outliers. To reduce the effect of noise and outliers, intuitionistic fuzzy twin support vector machines (IFTWSVM) uses both membership and non-membership weights to subsidise the effect of outliers. Moreover, IFTWSVM solves smaller size quadratic programming problems which makes it comparatively efficient than fuzzy support vector machines. However, IFTWSVM suffers as (i) it involves the computation of matrix inverses which makes it intractable as the size of the data increases. (ii) it solves different problems for linear and nonlinear cases, and nonlinear case with linear kernel does not reduce to the linear case. Thus, it can only solve the approximate formulation not the exact formulation. To overcome these issues, we propose improved intuitionistic fuzzy twin support vector machine (IIFTWSVM). The proposed IIFTWSVM introduces different Lagrangian functions to avoid the computation of matrix inverses. Also, in nonlinear case, kernel trick is applied directly and hence, the exact formulation is solved. We employed the proposed IIFTWSVM for the classification of EEG signals. The experimental results and statistical analysis show that the proposed IIFTWSVM model is better compared to the given baseline models. Also, we evaluate the performance of the models on KEEL datasets to check the robustness of the proposed IIFTWSVM model.
Similar content being viewed by others
References
Adeli H, Zhou Z, Dadmehr N (2003) Analysis of EEG records in an epileptic patient using wavelet transform. J Neurosci Methods 123(1):69–87
Alcalá-Fdez J, Fernández A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) Keel data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Mult.-Valued Log Soft Comput 17:255–287
Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907
Bollegala D, Matsuo Y, Ishizuka M (2010) A web search engine-based approach to measure semantic similarity between words. IEEE Trans Knowl Data Eng 23(7):977–990
Chang KW, Hsieh CJ, Lin CJ (2008) Coordinate descent method for large-scale l2-loss linear support vector machines. J Mach Learn Res 9(7):1369–1398
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Ganaie M, Tanveer M, Lin CT (2022) Large scale fuzzy least squares twin SVMs for class imbalance learning. IEEE Trans Fuzzy Syst https://doi.org/10.1109/TFUZZ.2022.3161729
Gao BB, Wang JJ, Wang Y, Yang, CY (2015) Coordinate descent fuzzy twin support vector machine for classification. In: 2015 IEEE 14th international conference on machine learning and applications (ICMLA). IEEE, pp 7–12
Ha M, Wang C, Chen J (2013) The support vector machine based on intuitionistic fuzzy number and kernel function. Soft Comput 17(4):635–641
Hsieh CJ, Chang KW, Lin CJ, Keerthi SS, Sundararajan S (2008) A dual coordinate descent method for large-scale linear SVM. In: Proceedings of the 25th international conference on machine learning, pp 408–415
Huang X, Shi L, Suykens JA (2013) Support vector machine classifier with pinball loss. IEEE Trans Pattern Anal Mach Intell 36(5):984–997
Jayadeva, Khemchandani R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910
Joachims T (1999) Making large-scale support vector machine learning practical, advances in kernel methods. Support Vector Learning
Khemchandani R, Chandra S et al (2009) Optimal kernel selection in twin support vector machines. Optim Lett 3(1):77–88
Kullback S (1997) Information theory and statistics. Courier Corporation, North Chelmsford
Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36(4):7535–7543
Laxmi S, Gupta SK (2020) Intuitionistic fuzzy proximal support vector machines for pattern classification. Neural Process Lett 51(3):2701–2735
Li CN, Huang YF, Wu HJ, Shao YH, Yang ZM (2016) Multiple recursive projection twin support vector machine for multi-class classification. Int J Mach Learn Cybern 7(5):729–740
Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471
Mangasarian OL, Wild EW (2005) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74
Ocak H (2008) Optimal classification of epileptic seizures in EEG using wavelet analysis and genetic algorithm. Signal Process 88(7):1858–1867
Osuna E, Freund R, Girosit F (1997) Training support vector machines: an application to face detection. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 130–136 (1997)
Pal M, Mather P (2005) Support vector machines for classification in remote sensing. Int J Remote Sens 26(5):1007–1011
Panup W, Ratipapongton W, Wangkeeree R (2022) A novel twin support vector machine with generalized pinball loss function for pattern classification. Symmetry 14(2):289
Platt J (1998) Sequential minimal optimization: a fast algorithm for training support vector machines
Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recognit 46(1):305–316
Rezvani S, Wang X, Pourpanah F (2019) Intuitionistic fuzzy twin support vector machines. IEEE Trans Fuzzy Syst 27(11):2140–2151
Richhariya B, Tanveer M (2018) EEG signal classification using universum support vector machine. Expert Syst Appl 106:169–182
Richhariya B, Tanveer M (2018) A robust fuzzy least squares twin support vector machine for class imbalance learning. Appl Soft Comput 71:418–432
Rosso O, Hyslop W, Gerlach R, Smith R, Rostas J, Hunter M (2005) Quantitative EEG analysis of the maturational changes associated with childhood absence epilepsy. Physica A 356(1):184–189
Shao YH, Zhang CH, Wang XB, Deng NY (2011) Improvements on twin support vector machines. IEEE Trans Neural Netw 22(6):962–968
Shen X, Niu L, Qi Z, Tian Y (2017) Support vector machine classifier with truncated pinball loss. Pattern Recognit 68:199–210
Subasi A, Gursoy MI (2010) EEG signal classification using PCA, ICA, LDA and support vector machines. Expert Syst Appl 37(12):8659–8666
Tanveer M, Gautam C, Suganthan PN (2019) Comprehensive evaluation of twin SVM based classifiers on UCI datasets. Appl Soft Comput 83:105617
Tanveer M, Khan MA, Ho SS (2016) Robust energy-based least squares twin support vector machines. Appl Intell 45(1):174–186
Tanveer M, Rajani T, Rastogi R, Shao, Y, Ganaie M (2022) Comprehensive review on twin support vector machines. Ann Oper Res pp 1–46. https://doi.org/10.1007/s10479-022-04575-w
Tanveer M, Sharma A, Suganthan PN (2019) General twin support vector machine with pinball loss function. Inf Sci 494:311–327
Tanveer M, Sharma S, Muhammad K (2021) Large-scale least squares twin SVMs. ACM Trans Internet Technol 21(2):1–19
Tanveer M, Tiwari A, Choudhary R, Ganaie MA (2021) Large-scale pinball twin support vector machines. Mach Learn. https://doi.org/10.1007/s10994-021-06061-z
Tanveer M, Tiwari A, Choudhary R, Jalan S (2019) Sparse pinball twin support vector machines. Appl Soft Comput 78:164–175
Theodoridis S, Koutroumbas K (2009) Chapter 5—feature selection. In: Pattern recognition, 4th edn. Academic Press, Boston, pp 261–322
Vapnik Vladimir N (1995) The nature of statistical learning theory
Wang H, Xu Y, Zhou Z (2021) Twin-parametric margin support vector machine with truncated pinball loss. Neural Comput Appl 33(8):3781–3798
Wilcoxon F (1992) Individual comparisons by ranking methods. In: Breakthroughs in statistics. Springer, pp 196–202
Yang L, Dong H (2018) Support vector machine with truncated pinball loss and its application in pattern recognition. Chemom Intell Lab Syst 177:89–99
Yang ZM, Wu HJ, Li CN, Shao YH (2016) Least squares recursive projection twin support vector machine for multi-class classification. Int J Mach Learn Cybern 7(3):411–426
Zhang Y, Duchi J, Wainwright M (2015) Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. J Mach Learn Res 16(1):3299–3340
Zhou MM, Li L, Lu YL (2009) Fuzzy support vector machine based on density with dual membership. In: 2009 international conference on machine learning and cybernetics, vol 2. IEEE, pp 674–678
Acknowledgements
This work is funded by Government of India, Science and Engineering Research Board (SERB) under Ramanujan Fellowship Scheme, Grant No. SB/S2/RJN-001/2016, Department of Science and Technology under Interdisciplinary Cyber Physical Systems (ICPS) Scheme grant no. DST/ICPS/CPS-Individual/2018/276 and National Supercomputing Mission under DST and Miety, Govt. of India under Grant No. DST/NSM/R &D_HPC_Appl/2021/03.29. We acknowledge Council of Scientific & Industrial Research (CSIR), New Delhi, INDIA for Extra Mural Research (EMR) grant, under grant no. 22(0751)/17/EMR-II. Ms. Anuradha Kumari (File no - 09/1022 (12437)/2021-EMR-I) and Mr. Ashwani kumar Malik (File no - 09/1022 (0075)/2019-EMR-I) acknowledge the financial support given as scholarship by Council of Scientific and Industrial Research (CSIR), New Delhi, India. We are grateful for the facilities and support given by Indian Institute of Technology Indore, India.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
None.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ganaie, M.A., Kumari, A., Malik, A.K. et al. EEG signal classification using improved intuitionistic fuzzy twin support vector machines. Neural Comput & Applic 36, 163–179 (2024). https://doi.org/10.1007/s00521-022-07655-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07655-x