Abstract
Opposite Maps (OM) is a method that can be used to induce sparse SVM-based and LS-SVM-based classifiers. The main idea behind the OM method is to train two Self-Organizing Maps (SOM), one for each class, \(\mathcal{C}_{-1}\) and \(\mathcal{C}_{+1}\), in a binary classification context and then, for the patterns of one class, say \(\mathcal{C}_{-1}\), to find the closest prototypes among those belonging to the SOM trained with patterns of the other class, say \(\mathcal{C}_{+1}\). The subset of patterns mapped to the selected prototypes in both SOMs form the reduced set to be used for training SVM and LSSVM classifiers. In this paper, an iterative method based on the OM, called Fast Opposite Maps, is introduced with the aim of accelerating OM training time. Comprehensive computer simulations using synthetic and real-world datasets reveal that the proposed approach achieves similar results to the original OM, at a much faster pace.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Carvalho, B.P.R., Braga, A.P.: IP-LSSVM: A two-step sparse classifier. Pattern Recognition Letters 30, 1507–1515 (2009)
D’Amato, L., Moreno, J.A., Mujica, R.: Reducing the Complexity of Kernel Machines with Neural Growing Gas in Feature Space. In: Lemaître, C., Reyes, C.A., González, J.A. (eds.) IBERAMIA 2004. LNCS (LNAI), vol. 3315, pp. 799–808. Springer, Heidelberg (2004)
Hoegaerts, L., Suykens, J.A.K., Vandewalle, J., De Moor, B.: A Comparison of Pruning Algorithms for Sparse Least Squares Support Vector Machines. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds.) ICONIP 2004. LNCS, vol. 3316, pp. 1247–1253. Springer, Heidelberg (2004)
Hussain, A., Shahbudin, S., Husain, H., Samad, S.A., Tahir, N.M.: Reduced set support vector machines: Application for 2-dimensional datasets. In: Proc. of the Second International Conf. on Signal Processing and Communication Systems (2008)
Kohonen, T.K.: Self-Organizing Maps. Springer (1997)
Lee, Y.-J., Mangasarian, O.L.: SSVM: A smooth support vector machine for classification. Computational Optimization and Applications 20(1), 5–22 (2001)
Li, Y., Lin, C., Zhang, W.: Letters: Improved sparse least-squares support vector machine classifiers. Neurocomputing 69, 1655–1658 (2006)
Platt, J.C.: Fast training of support vector machines using sequential minimal optimization. MIT Press, Cambridge (1999)
Rocha Neto, A.R., Barreto, G.A.: On the application of ensembles of classifiers to the diagnosis of pathologies of the vertebral column: A comparative analysis. IEEE Latin America Transactions 7(4), 487–496 (2009)
Rocha Neto, A.R., Barreto, G.A.: A Novel Heuristic for Building Reduced-Set SVMs Using the Self-Organizing Map. In: Cabestany, J., Rojas, I., Joya, G. (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 97–104. Springer, Heidelberg (2011)
Steinwart, I.: Sparseness of support vector machines. Journal of Machine Learning Research 4, 1071–1105 (2003)
Suykens, J.A.K., Lukas, L., Vandewalle, J.: Sparse approximation using least squares support vector machines. In: Proceedings of 2000 IEEE International Symposium on Circuits and Systems, Geneva, Switzerland, pp. 757–760 (2000)
Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Processing Letters 9(3), 293–300 (1999)
Tang, B., Mazzoni, D.: Multiclass reduced-set support vector machines. In: Proc. of the 23rd International Conf. on Machine Learning, pp. 921–928 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
da Rocha Neto, A.R., Barreto, G.A. (2012). Fast Opposite Maps: An Iterative SOM-Based Method for Building Reduced-Set SVMs. In: Yin, H., Costa, J.A.F., Barreto, G. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2012. IDEAL 2012. Lecture Notes in Computer Science, vol 7435. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32639-4_86
Download citation
DOI: https://doi.org/10.1007/978-3-642-32639-4_86
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32638-7
Online ISBN: 978-3-642-32639-4
eBook Packages: Computer ScienceComputer Science (R0)