Skip to main content
SpringerLink
Log in

Adaptive three-phase support vector data description

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

We add a new phase, called reforming phase, to support vector data description (SVDD) between the training and testing phases. The reforming phase enables us to reconsider the SVDD’s assumption of the uniformity of features in calculating the distance of an object to the center of hypersphere. In the reforming phase, the features are assumed as a group of experts who have different impacts in overall outlier detection. In doing so, the proportion of each feature in the distance of an object to the center of hypersphere is specified. Subsequently, the opinions of the experts about the label of the corresponding object are determined based on these measured proportions. By using different group decision-making methods for aggregating the opinions of the experts, a large variety of new models are obtained based on one SVDD’s trained model. Specially, we utilize a kind of ordered weighted averaging operator as group decision-making method and introduce cDFS-SVDD based on this method. cDFS-SVDD performs runtime feature selection and calculates the distance of an object to the center of hypersphere dynamically at test time based on these selected features. We apply the method to the anomaly detection problem in mobile ad hoc networks as well as two UCI datasets by which the performance of SVDD improves significantly in separating the target and outlier objects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. In this section, we use the terms normal and attack instead of target and outlier, respectively, because of the special application to which we involved.

References

  1. Tax DMJ (2001) One class classification. Ph.D. thesis, Delft University of Technology

  2. Krawczyk B, Wozniak M (2015) One-class classifiers with incremental learning and forgetting for data streams with concept drift. Soft Comput 19(12):3387–3400

    Article  Google Scholar 

  3. Krawczyk B, Wozniak M (2015) Incremental weighted one-class classifier for mining stationary data streams. J Comput Sci 9:19–25

    Article  Google Scholar 

  4. Nguyen DT, Cios KJ (2015) Rule-based oneclass-ds learning algorithm. Appl Soft Comput 35:267–279

    Article  Google Scholar 

  5. Bishop C (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

    MATH  Google Scholar 

  6. Duda RO, Hart PE, Stork DG (2000) Pattern Classification, 2nd edn. Wiley, New York

    MATH  Google Scholar 

  7. Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185

    MathSciNet  Google Scholar 

  8. Scholkopf B, Platt JC, Taylor JS, Smola AJ, Williamson RC (2001) Estimating the support of a high dimensional distribution. Neural Comput 13:1443–1471

    Article  MATH  Google Scholar 

  9. Tax DMJ, Duin RPW (1999) Support vector domain description. Pattern Recognit Lett 20:1191–1199

    Article  Google Scholar 

  10. Tax DMJ, Duin RPW (2004) Support vector data description. Mach Learn 54(1):45–66

    Article  MATH  Google Scholar 

  11. Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice-Hall, Englewood Cliffs

    MATH  Google Scholar 

  12. Kohonen T (1995) The handbook of brain theory and neural networks. MIT Press, Cambridge

    Google Scholar 

  13. Jolliffe I (2002) Principal component analysis, 2nd edn. Springer, Berlin

    MATH  Google Scholar 

  14. Kohonen T (2001) Self-organizing maps, 3rd edn. Springer, Berlin

    Book  MATH  Google Scholar 

  15. Krawczyk B (2015) One-class classifier ensemble pruning and weighting with firefly algorithm. Neurocomput 150:490–500

    Article  Google Scholar 

  16. Krawczyk B, Wozniak M, Herrera F (2015) On the usefulness of one-class classifier ensembles for decomposition of multi-class problems. Pattern Recognit 48(12):3969–3982

    Article  Google Scholar 

  17. Krawczyk B, Wozniak M, Cyganek B (2014) Clustering-based ensembles for one-class classification. Inf Sci 264:182–195

    Article  MathSciNet  MATH  Google Scholar 

  18. Krawczyk B, Wozniak M (2014) Diversity measures for one-class classifier ensembles. Neurocomput 126:36–44

    Article  Google Scholar 

  19. Cyganek B (2012) One-class support vector ensembles for image segmentation and classification. J Math Imaging Vis 42(2):103–117

    Article  MathSciNet  MATH  Google Scholar 

  20. Wilk T, Wozniak M (2012) Soft computing methods applied to combination of one-class classifiers. Neurocomput 75(1):185–193

    Article  Google Scholar 

  21. Rahmanimanesh M, Jalili S, Sharafat AR (2013) Fusion of one-class classifiers for protocol-based anomaly detection in aodv-based mobile ad hoc networks. Int J Ad Hoc Ubiquitous Comput 14(3):158–171

    Article  Google Scholar 

  22. Tax DMJ, Juszczak P (2003) Kernel whitening for one-class classification. Int J Pattern Recognit Artif Intell 17(3):333–347

    Article  MATH  Google Scholar 

  23. Guo SM, Chen LC, Tsai JSH (2009) A boundary method for outlier detection based on support vector domain description. Pattern Recognit 42:77–83

    Article  MATH  Google Scholar 

  24. Lee K, Kim D, Lee KH, Lee D (2007) Density-induced support vector data description. IEEE Trans Neural Netw 18(1):284–289

    Article  Google Scholar 

  25. Yager RR (1988) On ordered weighted averaging aggregation operators in multi-criteria decision making. IEEE Trans Syst Man Cybern 18:183–190

    Article  MATH  Google Scholar 

  26. Merigo JM, Gil-Lafuente AM (2011) Fuzzy induced generalized aggregation operators and its application in multi-person decision making. Expert Syst Appl 38:9761–9772

    Article  Google Scholar 

  27. Merigo JM, Casanovas M (2011) Decision-making with distance measures and induced aggregation operators. Comput Ind Eng 60:66–76

    Article  MATH  Google Scholar 

  28. Huang HP, Liu YH (2002) Fuzzy support vector machines for pattern recognition and data mining. Int J Fuzzy Syst 4(3):826–835

    MathSciNet  Google Scholar 

  29. Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471

    Article  Google Scholar 

  30. Zhang Y, Chi ZX, Li KQ (2009) Fuzzy multi-class classifier based on support vector data description and improved pcm. Expert Syst Appl 36:8714–8718

    Article  Google Scholar 

  31. Forghani Y, Yazdi HS, Effati S (2011) An extension to fuzzy support vector data description (fsvdd*). Pattern Anal Appl. doi:10.1007/s10044-011-0208-z

    Article  Google Scholar 

  32. Liu B, Xiao Y, Cao L, Hao Z, Deng F (2013) Svdd-based outlier detection on uncertain data. Knowl Inf Syst 34(3):597–618

    Article  Google Scholar 

  33. Huang G, Chen H, Zhou Z, Yin F, Guo K (2011) Two-class support vector data description. Pattern Recognit 44:320–329

    Article  MATH  Google Scholar 

  34. GhasemiGol M, Monsefi R, Yazdi HS (2010) Intrusion detection by ellipsoid boundary. J Netw Syst Manag 18:265–282

    Article  Google Scholar 

  35. Peng X, Xu D (2012) Efficient support vector data descriptions for novelty detection. Neural Comput Appl 21(8):2023–2032

    Article  Google Scholar 

  36. Liu YH, Liu YC, Chen YJ (2010) Fast support vector data description for novelty detection. IEEE Trans Neural Netw 21(8):1296–1313

    Article  Google Scholar 

  37. Perkins C, Royer E (1999) Ad hoc on demand distance vector routing. In: Proceedings of second IEEE Workshop on mobile computing systems and applications (WMCSA 99), pp 90–100

  38. Perkins C, Belding-Royer E, Das S (2003) Ad hoc on demand distance vector routing. IETF RFC 3561

  39. Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27:1–27:27. http://www.csie.ntu.edu.tw/~cjlin/libsvm

  40. (2010) Ns-2 (network simulator version 2.34). http://www.isi.edu/nsnam/ns/ns-documentation

  41. Bache K, Lichman M (2013) Uci machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Islamic Republic of Iran

    M. Rahmanimanesh

  2. Iranian Research Institute for Information Science and Technology (IRANDOC), Tehran, Islamic Republic of Iran

    J. A. Nasiri

  3. Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Islamic Republic of Iran

    S. Jalili & N. Moghaddam Charkari

Authors
  1. M. Rahmanimanesh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. A. Nasiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. Jalili
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. N. Moghaddam Charkari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Rahmanimanesh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rahmanimanesh, M., Nasiri, J.A., Jalili, S. et al. Adaptive three-phase support vector data description. Pattern Anal Applic 22, 491–504 (2019). https://doi.org/10.1007/s10044-017-0646-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-017-0646-3

Keywords

Search

Navigation