Skip to main content

Fast Opposite Maps: An Iterative SOM-Based Method for Building Reduced-Set SVMs

  • Conference paper
Intelligent Data Engineering and Automated Learning - IDEAL 2012 (IDEAL 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7435))

  • 1544 Accesses

Abstract

Opposite Maps (OM) is a method that can be used to induce sparse SVM-based and LS-SVM-based classifiers. The main idea behind the OM method is to train two Self-Organizing Maps (SOM), one for each class, \(\mathcal{C}_{-1}\) and \(\mathcal{C}_{+1}\), in a binary classification context and then, for the patterns of one class, say \(\mathcal{C}_{-1}\), to find the closest prototypes among those belonging to the SOM trained with patterns of the other class, say \(\mathcal{C}_{+1}\). The subset of patterns mapped to the selected prototypes in both SOMs form the reduced set to be used for training SVM and LSSVM classifiers. In this paper, an iterative method based on the OM, called Fast Opposite Maps, is introduced with the aim of accelerating OM training time. Comprehensive computer simulations using synthetic and real-world datasets reveal that the proposed approach achieves similar results to the original OM, at a much faster pace.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Carvalho, B.P.R., Braga, A.P.: IP-LSSVM: A two-step sparse classifier. Pattern Recognition Letters 30, 1507–1515 (2009)

    Article  Google Scholar 

  2. D’Amato, L., Moreno, J.A., Mujica, R.: Reducing the Complexity of Kernel Machines with Neural Growing Gas in Feature Space. In: Lemaître, C., Reyes, C.A., González, J.A. (eds.) IBERAMIA 2004. LNCS (LNAI), vol. 3315, pp. 799–808. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  3. Hoegaerts, L., Suykens, J.A.K., Vandewalle, J., De Moor, B.: A Comparison of Pruning Algorithms for Sparse Least Squares Support Vector Machines. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds.) ICONIP 2004. LNCS, vol. 3316, pp. 1247–1253. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  4. Hussain, A., Shahbudin, S., Husain, H., Samad, S.A., Tahir, N.M.: Reduced set support vector machines: Application for 2-dimensional datasets. In: Proc. of the Second International Conf. on Signal Processing and Communication Systems (2008)

    Google Scholar 

  5. Kohonen, T.K.: Self-Organizing Maps. Springer (1997)

    Google Scholar 

  6. Lee, Y.-J., Mangasarian, O.L.: SSVM: A smooth support vector machine for classification. Computational Optimization and Applications 20(1), 5–22 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  7. Li, Y., Lin, C., Zhang, W.: Letters: Improved sparse least-squares support vector machine classifiers. Neurocomputing 69, 1655–1658 (2006)

    Article  Google Scholar 

  8. Platt, J.C.: Fast training of support vector machines using sequential minimal optimization. MIT Press, Cambridge (1999)

    Google Scholar 

  9. Rocha Neto, A.R., Barreto, G.A.: On the application of ensembles of classifiers to the diagnosis of pathologies of the vertebral column: A comparative analysis. IEEE Latin America Transactions 7(4), 487–496 (2009)

    Article  Google Scholar 

  10. Rocha Neto, A.R., Barreto, G.A.: A Novel Heuristic for Building Reduced-Set SVMs Using the Self-Organizing Map. In: Cabestany, J., Rojas, I., Joya, G. (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 97–104. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  11. Steinwart, I.: Sparseness of support vector machines. Journal of Machine Learning Research 4, 1071–1105 (2003)

    MathSciNet  Google Scholar 

  12. Suykens, J.A.K., Lukas, L., Vandewalle, J.: Sparse approximation using least squares support vector machines. In: Proceedings of 2000 IEEE International Symposium on Circuits and Systems, Geneva, Switzerland, pp. 757–760 (2000)

    Google Scholar 

  13. Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Processing Letters 9(3), 293–300 (1999)

    Article  MathSciNet  Google Scholar 

  14. Tang, B., Mazzoni, D.: Multiclass reduced-set support vector machines. In: Proc. of the 23rd International Conf. on Machine Learning, pp. 921–928 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

da Rocha Neto, A.R., Barreto, G.A. (2012). Fast Opposite Maps: An Iterative SOM-Based Method for Building Reduced-Set SVMs. In: Yin, H., Costa, J.A.F., Barreto, G. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2012. IDEAL 2012. Lecture Notes in Computer Science, vol 7435. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32639-4_86

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32639-4_86

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32638-7

  • Online ISBN: 978-3-642-32639-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics