Skip to main content
SpringerLink
Log in

Automatic support vector data description

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Event handlers have wide range of applications such as medical assistant systems and fire suppression systems. These systems try to provide accurate responses based on the least information. Support vector data description (SVDD) is one of the appropriate tools for such detections, which should handle lack of information. Therefore, many efforts have been done to improve SVDD. Unfortunately, the existing descriptors suffer from weak data characteristic in sparse data sets and their tuning parameters are organized improperly. These issues cause reduction of accuracy in event handlers when they are faced with data shortage. Therefore, we propose automatic support vector data description (ASVDD) based on both validation degree, which is originated from fuzzy rough set to discover data characteristic, and assigning effective values for tuning parameters by chaotic bat algorithm. To evaluate the performance of ASVDD, several experiments have been conducted on various data sets of UCI repository. The experimental results demonstrate superiority of the proposed method over state-of-the-art ones in terms of classification accuracy and AUC. In order to prove meaningful distinction between the accuracy results of the proposed method and the leading-edge ones, the Wilcoxon statistical test has been conducted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Allahyari Y, Sadoghi-Yazdi H (2012) Quasi support vector data description (QSVDD). Int J Signal Process Image Process Pattern Recogn 5:65–74

    Google Scholar 

  • Altameem TA, Nikolić V, Shamshirband S, Petković D, Javidnia H, Kiah MLM, Gani A (2015) Potential of support vector regression for optimization of lens system. Comput Aided Des 62:57–63

    Article  Google Scholar 

  • Bian H, Mazlack L (2003) Fuzzy-rough nearest-neighbor classification approach. In: 22nd international conference of the North American Fuzzy Information Processing Society, 2003. NAFIPS 2003. IEEE, pp 500–505

  • Camci F, Chinnam RB (2008) General support vector representation machine for one-class classification of non-stationary classes. Pattern Recogn 41:3021–3034

    Article  MATH  Google Scholar 

  • Cha M, Kim JS, Baek J-G (2014) Density weighted support vector data description. Expert Syst Appl 41:3343–3350

    Article  Google Scholar 

  • Cha M, Kim JS, Park SH, Baek J-G (2012) Nonparametric control chart using density weighted support vector data description. In: Proceedings of World Academy of Science, Engineering and Technology (WASET), p 1020

  • Changdar C, Pal RK, Mahapatra GS (2016) A genetic ant colony optimization based algorithm for solid multiple travelling salesmen problem in fuzzy rough environment. Soft Comput 1–15. doi:10.1007/s00500-016-2075-4

  • Chen D, Yang W, Li F (2008) Measures of general fuzzy rough sets on a probabilistic space. Inf Sci 178:3177–3187

    Article  MathSciNet  MATH  Google Scholar 

  • Derrac J, Verbiest N, García S, Cornelis C, Herrera F (2013) On the use of evolutionary feature selection for improving fuzzy rough set based prototype selection. Soft Comput 17:223–238

    Article  Google Scholar 

  • Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets*. Int J Gen Syst 17:191–209

    Article  MATH  Google Scholar 

  • El Boujnouni M, Jedra M, Zahid N (2014) Support vector domain description with a new confidence coefficient. In: 2014 9th international conference on intelligent systems: theories and applications (SITA-14). IEEE, pp 1–8

  • Forghani Y, Yazdi HS, Effati S (2012) An extension to fuzzy support vector data description (FSVDD*). Pattern Anal Appl 15:237–247

    Article  MathSciNet  Google Scholar 

  • Forghani Y, Yazdi HS, Effati S, Tabrizi RS (2011) Support vector data description by using hyper-ellipse instead of hyper-sphere. In: 2011 1st international econference on computer and knowledge engineering (ICCKE). IEEE, pp 22–27

  • Gandomi AH, Yang X-S (2014) Chaotic bat algorithm. J Comput Sci 5:224–232

    Article  MathSciNet  Google Scholar 

  • GhasemiGol M, Sabzekar M, Monsefi R, Naghibzadeh M, Yazdi HS (2010) A new support vector data description with fuzzy constraints. In: 2010 international conference on intelligent systems, modelling and simulation (ISMS). IEEE, pp 10–14

  • Hamidzadeh J, Monsefi R, Yazdi HS (2015) IRAHC: instance reduction algorithm using hyperrectangle clustering. Pattern Recogn 48:1878–1889

    Article  MATH  Google Scholar 

  • Hamidzadeh J (2015) IRDDS: instance reduction based on distance-based decision surface. J AI Data Min 3:121–130

    Google Scholar 

  • Huang G-X, Chen H-F, Yin F (2010) Improved support vector data description. In: 2010 international conference on machine learning and cybernetics (ICMLC). IEEE, pp 1459–1463

  • Huang G, Chen H, Zhou Z, Yin F, Guo K (2011) Two-class support vector data description. Pattern Recogn 44:320–329

    Article  MATH  Google Scholar 

  • Hu Y, Liu JN, Wang Y, Lai L (2012) A weighted support vector data description based on rough neighborhood approximation. In: 2012 IEEE 12th international conference on data mining workshops (ICDMW). IEEE, pp 635–642

  • Inuiguchi M, Wu W-Z, Cornelis C, Verbiest N (2015) Fuzzy-rough hybridization. In: Kacprzyk J, Pedrycz W (eds) Springer handbook of computational intelligence. Springer, Berlin, Heidelberg, pp 425–451

  • Jeong Y-S, Jayaraman R (2015) Support vector-based algorithms with weighted dynamic time warping kernel function for time series classification. Knowl Based Syst 75:184–191

    Article  Google Scholar 

  • Jiang Y, Wang Y, Luo H (2015) Fault diagnosis of analog circuit based on a second map SVDD. Analog Integr Circuits Signal Process 85:395–404

    Article  Google Scholar 

  • Jiang Q, Yan X (2014) Probabilistic weighted NPE-SVDD for chemical process monitoring. Control Eng Pract 28:74–89

    Article  Google Scholar 

  • Lee K, Kim D-W, Lee D, Lee KH (2005) Improving support vector data description using local density degree. Pattern Recogn 38:1768–1771

    Article  MATH  Google Scholar 

  • Lee K, Kim D-W, Lee KH, Lee D (2007) Density-induced support vector data description. IEEE Trans Neural Netw 18:284–289

    Article  Google Scholar 

  • Le T, Tran D, Ma W (2013) Fuzzy multi-sphere support vector data description. In: Pei J, Tseng VS, Cao L, Motoda H, Xu G (eds) Advances in knowledge discovery and data mining. Lecture notes in computer science, vol 7819. Springer, Berlin, Heidelberg, pp 570–581

  • Lichman M (2013) UCI machine learning repository. http://archive.ics.uci.edu/ml

  • Li S, Shao M, Fu Y (2014) Low-rank outlier detection. In: Fu Y (ed) Low-rank and sparse modeling for visual analysis. Springer, pp 181–202

  • Liu Y-H, Liu Y-C, Chen Y-J (2010) Fast support vector data descriptions for novelty detection. IEEE Trans Neural Netw 21:1296–1313

    Article  Google Scholar 

  • Liu Z, Dezert J, Pan Q, Mercier G (2011) Combination of sources of evidence with different discounting factors based on a new dissimilarity measure. Decis Support Syst 52:133–141

    Article  Google Scholar 

  • Liu B, Xiao Y, Cao L, Hao Z, Deng F (2013) Svdd-based outlier detection on uncertain data. Knowl Inf Syst 34:597–618

    Article  Google Scholar 

  • Liu Z, Pan Q, Dezert J, Mercier G (2015) Credal c-means clustering method based on belief functions. Knowl Based Syst 74:119–132

    Article  Google Scholar 

  • Liu Z, Pan Q, Dezert J, Martin A (2016) Adaptive imputation of missing values for incomplete pattern classification. Pattern Recogn 52:85–95

    Article  Google Scholar 

  • Martinez W, Gray JB (2016) Noise peeling methods to improve boosting algorithms. Comput Stat Data Anal 93:483–497

    Article  MathSciNet  Google Scholar 

  • Mohammadi K, Shamshirband S, Anisi MH, Alam KA, Petković D (2015) Support vector regression based prediction of global solar radiation on a horizontal surface. Energy Convers Manag 91:433–441

    Article  Google Scholar 

  • Mohammadi K, Shamshirband S, Tong CW, Arif M, Petković D, Ch S (2015) A new hybrid support vector machine-wavelet transform approach for estimation of horizontal global solar radiation. Energy Convers Manag 92:162–171

    Article  Google Scholar 

  • Mygdalis V, Iosifidis A, Tefas A, Pitas I (2014) Video summarization based on Subclass support vector data description. In: 2014 IEEE symposium on computational intelligence for engineering solutions (CIES). IEEE, pp 183–187

  • Mygdalis V, Iosifidis A, Tefas A, Pitas I (2015) Exploiting subclass information in one-class support vector machine for video summarization, In: 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2259–2263

  • Pawlak Z (1982) Rough sets. Int J Comput Inf Sci 11:341–356

    Article  MATH  Google Scholar 

  • Peng JX, Tan JX (2015) EL-SVDD: an improved and localized multi-class classification algorithm. Appl Mech Mater 713:1693–1698

    Article  Google Scholar 

  • Peng X, Xu D (2012) Efficient support vector data descriptions for novelty detection. Neural Comput Appl 21:2023–2032

    Article  Google Scholar 

  • Petković D, Shamshirband S, Saboohi H, Ang TF, Anuar NB, Rahman ZA, Pavlović NT (2014) Evaluation of modulation transfer function of optical lens system by support vector regression methodologies—a comparative study. Infrared Phys Technol 65:94–102

    Article  Google Scholar 

  • Petković D, Shamshirband S, Saboohi H, Ang TF, Anuar NB, Pavlović ND (2014) Support vector regression methodology for prediction of input displacement of adaptive compliant robotic gripper. Appl Intell 41:887–896

    Article  Google Scholar 

  • Phaladiganon P, Kim SB, Chen VC (2014) A density-focused support vector data description method. Qual Reliab Eng Int 30:879–890

    Article  Google Scholar 

  • Piri J, Shamshirband S, Petković D, Tong CW, ur Rehman MH (2015) Prediction of the solar radiation on the earth using support vector regression technique. Infrared Phys Technol 68:179–185

    Article  Google Scholar 

  • Radzikowska AM, Kerre EE (2002) A comparative study of fuzzy rough sets. Fuzzy Sets Syst 126:137–155

    Article  MathSciNet  MATH  Google Scholar 

  • Shafer G (1976) A mathematical theory of evidence. Princeton University Press, Princeton

    MATH  Google Scholar 

  • Shamshirband S, Petković D, Amini A, Anuar NB, Nikolić V, Ćojbašić Ž, Kiah MLM, Gani A (2014) Support vector regression methodology for wind turbine reaction torque prediction with power-split hydrostatic continuous variable transmission. Energy 67:623–630

    Article  Google Scholar 

  • Shamshirband S, Petkovic D, Javidnia H, Gani A (2015) Sensor data fusion by support vector regression methodology—a comparative study. IEEE Sens J 15:850–854

    Article  Google Scholar 

  • Shamshirband S, Petković D, Pavlović NT, Ch S, Altameem TA, Gani A (2015) Support vector machine firefly algorithm based optimization of lens system. Appl Opt 54:37–45

    Article  Google Scholar 

  • Sheskin DJ (2003) Handbook of parametric and nonparametric statistical procedures. CRC Press, Boca Raton

    Book  MATH  Google Scholar 

  • Tavakkoli A, Nicolescu M, Nicolescu M, Bebis G (2008) Incremental SVDD training: improving efficiency of background modeling in videos. In: Proceedings of the 10th IASTED international conference, 2008, p 92

  • Tax DM, Duin RP (1999) Data domain description using support vectors. In: ESANN, pp 251–256

  • Tax DM, Laskov P (2003) Online SVM learning: from classification to data description and back. In: 2003 IEEE 13th workshop on neural networks for signal processing, 2003. NNSP’03. IEEE, pp 499–508

  • Tax DM, Duin RP (1999) Support vector domain description. Pattern Recogn Lett 20:1191–1199

    Article  Google Scholar 

  • Tax DM, Duin RP (2004) Support vector data description. Mach Learn 54:45–66

    Article  MATH  Google Scholar 

  • Theljani F, Laabidi K, Zidi S, Ksouri M (2015) Tennessee Eastman process diagnosis based on dynamic classification with SVDD. J Dyn Syst Meas Control 137(9):091006

  • Verbiest N, Cornelis C, Herrera F (2013) FRPS: a fuzzy rough prototype selection method. Pattern Recogn 46:2770–2782

    Article  MATH  Google Scholar 

  • Wang Z, Zhao Z, Weng S, Zhang C (2015) Solving one-class problem with outlier examples by SVM. Neurocomputing 149:100–105

  • Wu W-Z, Leung Y, Zhang W-X (2002) Connections between rough set theory and Dempster–Shafer theory of evidence. Int J General Syst 31:405–430

    Article  MathSciNet  MATH  Google Scholar 

  • Wu M, Ye J (2009) A small sphere and large margin approach for novelty detection using training data with outliers. IEEE Trans Pattern Anal Mach Intell 31:2088–2092

    Article  Google Scholar 

  • Xiao Y, Liu B, Hao Z, Cao L (2014) A K-Farthest-Neighbor-based approach for support vector data description. Appl Intell 41:196–211

    Article  Google Scholar 

  • Xiao Y, Liu B, Cao L (2010) K-farthest-neighbors-based concept boundary determination for support vector data description. In: Proceedings of the 19th ACM international conference on information and knowledge management. ACM, pp 1701–1704

  • Yang X-S (2010) A new metaheuristic bat-inspired algorithm. In: González JR, Pelta DA, Cruz C, Terrazas G, Krasnogor N (eds) Nature inspired cooperative strategies for optimization (NICSO 2010). Springer, Berlin, Heidelberg, pp 65–74

  • Yao YY, Lingras PJ (1998) Interpretations of belief functions in the theory of rough sets. Inf Sci 104:81–106

    Article  MathSciNet  MATH  Google Scholar 

  • Zadeh LA (1965) Fuzzy sets. Inf Control 8:338–353

    Article  MATH  Google Scholar 

  • Zhai J (2011) Fuzzy decision tree based on fuzzy-rough technique. Soft Comput 15:1087–1096

    Article  Google Scholar 

  • Zhang Y, Chi Z-X, Li K-Q (2009) Fuzzy multi-class classifier based on support vector data description and improved PCM. Expert Syst Appl 36:8714–8718

    Article  Google Scholar 

  • Zheng S (2016) Smoothly approximated support vector domain description. Pattern Recogn 49:55–64

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Imam Reza International University, Mashhad, Iran

    Reza Sadeghi

  2. Faculty of Computer Engineering and Information Technology, Sadjad University of Technology, Mashhad, Iran

    Javad Hamidzadeh

Authors
  1. Reza Sadeghi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Javad Hamidzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Javad Hamidzadeh.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sadeghi, R., Hamidzadeh, J. Automatic support vector data description. Soft Comput 22, 147–158 (2018). https://doi.org/10.1007/s00500-016-2317-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-016-2317-5

Keywords

Search

Navigation