Skip to main content
SpringerLink
Log in

Twin support vector machines based on fruit fly optimization algorithm

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Twin support vector machine (TWSVM), which solves classification problems through constructing two nonparallel planes by solving two related SVM-type problems, has become a hot spot in the field of machine learning. In addition to keeping the advantages of SVM, the classification performance of TWSVM is also significantly better than that of SVM. However, there are at least two parameters in TWSVM which need to specify. These parameters make great difference to the classification result of TWSVM and to find the optimal parameters is an important but difficult work. In order to overcome this deficiency, in this paper, we propose the twin support vector machines based on Fruit Fly Optimization Algorithm (FOA-TWSVM). This algorithm uses FOA-TWSVM, which has high optimization ability and small computation complexity, to select the parameters for TWSVM. The experimental results show that this algorithm is able to find the suitable parameters, and has higher classification accuracy compared with some other algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Cristianini N, Taylor JS (2004) An Introduction to support vector machines and other kernel-based learning methods. Translated by Li Guozheng, Wang Meng, Zeng Huajun. Publishing House of Electronics Industry, Beijing

  2. Shifei D, Bingjuan Q, HongYan T (2011) An overview on theory and algorithm of support vector machines. J Univ Electron Sci Technol China 40(1):2–10

    Google Scholar 

  3. Vapnik VN (2000) The nature of statistical learning theory. Translated by Zhang Xuegong. Tsinghua University Press, Beijing

    Book  Google Scholar 

  4. Vapnik VN (2004) Statistical learning theory. Translated by Xu Jianhua, Zhang Xuegong. Publishing House of Electronics Industry, Beijing

  5. Hui L, Shifei D (2013) Research of individual neural network generation and ensemble algorithm based on quotient space granularity clustering. Appl Math Inf Sci 7(2):701–708

    Article  Google Scholar 

  6. Hui L, Shifei D (2013) Research and development of granular neural networks. Appl Math Inf Sci 7(3):1251–1261

    Article  Google Scholar 

  7. Wang X, He Q, Chen D, Yeung D (2005) A genetic algorithm for solving the inverse problem of support vector machines. Neurocomputing 68:225–238

    Article  Google Scholar 

  8. Wang X, Lu S, Zhai J (2008) Fast fuzzy multi-category SVM based on support vector domain description. Int J Pattern Recognit Artif Intell 22(1):109–120

    Article  Google Scholar 

  9. Fung G, Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings 7th ACMSIFKDD international conference on knowledge discovery and data mining. pp 77–86

  10. Mangasarian OL, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28(1):69–74

  11. Jayadeva, Khemchandni R, Chandra S (2007) Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910

  12. Ding S, Junzhao Y, Bingjuan Q (2014) An overview on twin support vector machines. Artif Intell Rev 42(2):245–252

    Article  Google Scholar 

  13. Shao YH, Wang Z, Chen WJ et al (2013) A regularization for the projection twin support vector machine. Knowl-Based Syst 37:203–210

    Article  Google Scholar 

  14. Yu J, Ding S, Jin F, Huang H, Han Y (2012) Twin support vector machines based on rough sets. Int J Digit Content Technol Appl 6(20):493–500

    Article  Google Scholar 

  15. Chen J, Ji G (2010) Weighted least squares twin support vector machines for pattern classification. In: 2010 The 2nd international conference on computer and automation engineering, Singapore: [s.n.], vol 2. pp 242–246

  16. Ye Q, Zhao C, Gao S (2012) Weighted twin support vector machines with local information and its application. Neural Netw 35:31–39

    Article  MATH  Google Scholar 

  17. Ding S, Wu F, Shi Z (2014) Wavelet twin support vector machine [J]. Neural Comput Appl 25:1241–1247

    Article  Google Scholar 

  18. Chen W, Shao Y, Deng N (2014) Least squares twin support vector machine for semi-supervised classification. Neuro Comput 145:465–476

    Google Scholar 

  19. Tian YJ, Ju XC, Qi ZQ, Shi Y (2014) Improved twin support vector machine. Sci China Math 57(2):417–432

    Article  MathSciNet  MATH  Google Scholar 

  20. Wang Y, Zhao X, Tian Y (2013) Local and global regularized twin SVM. Proced Comput Sci 18:1710–1719

    Article  Google Scholar 

  21. Qi Z, Tian Y, Shi Y (2013) Robust twin support vector machine for pattern classification. Pattern Recogn 46(1):305–316

    Article  MATH  Google Scholar 

  22. Xie X, Sun S (2015) Multitask centroid twin support vector machines. Neurocomputing 149:1085–1091

    Article  Google Scholar 

  23. Tanveer M (2015) Robust and sparse linear programming twin support vector machines. Cognit Comput 7(1):137–149

    Article  Google Scholar 

  24. Ganesh RN, Dinesh KK, Jayadeva (2010) Twin SVM for gesture classification using the surface electromyogram. IEEE Trans Inf Technol Biomed 14(2):301–308

    Article  Google Scholar 

  25. Arjunan SP, Kumar DK, Naik GR (2010) A machine learning based method for classification of fractal features of forearm sEMG using twin support vector machines. In: Engineering in medicine and biology society (EMBC), 2010 annual international conference of the IEEE. pp 4821–4824

  26. Cong H, Yang C, Pu X (2008) Efficient speaker recognition based on multi-class twin support vector machines and GMMs. In: 2008 IEEE conference on robotics, automation and mechatronics. pp 348–352

  27. Wang Z, Shao YH, Wu TR (2013) A GA-based model selection for smooth twin parametric-margin support vector machine. Pattern Recogn 46(8):2267–2277

    Article  MATH  Google Scholar 

  28. Ding S, Yu J, Huang H, Zhao H (2013) Twin support vector machine based particle swarm optimization. J Comput 8(9):2296–2303

    Article  Google Scholar 

  29. Ding S, Wu F, Yu J, Huang H, Zhao H (2013) Twin support vector machines based on quantum particle swarm optimization. J Softw 8(7):1743–1750

    Article  Google Scholar 

  30. Pan WT (2012) A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl Based Syst 26:69–74

    Article  Google Scholar 

  31. Wang L, Shi Y, Liu S (2015) An improved fruit fly optimization algorithm and its application to joint replenishment problems. Expert Syst Appl 42(9):4310–4323

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No. 61379101).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, China

    Shifei Ding, Xiekai Zhang & Junzhao Yu

  2. Jiangsu Key Laboratory of Mine Mechanical and Electrical Equipment, China University of Mining and Technology, Xuzhou, China

    Shifei Ding & Xiekai Zhang

Authors
  1. Shifei Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiekai Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junzhao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shifei Ding.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, S., Zhang, X. & Yu, J. Twin support vector machines based on fruit fly optimization algorithm. Int. J. Mach. Learn. & Cyber. 7, 193–203 (2016). https://doi.org/10.1007/s13042-015-0424-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-015-0424-8

Keywords

Search

Navigation