Abstract
In this work, a general framework for developing learning rules with an added term (perturbation term) is presented. Many learning rules commonly cited in the specialized literature can be derived from this general framework. This framework allows us to introduce some knowledge about vector quantization (as an optimization problem) in the distortion function in order to derive a new learning rule that uses that information to avoid certain local minima of the distortion function, leading to better performance than classical models. Computational experiments in image compression show that our proposed rule, derived from this general framework, can achieve better results than simple competitive learning and other models, with codebooks of less distortion.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gray, R.M.: Vector quantization. IEEE ASSP Magazine 1, 4–29 (1980)
Linde, Y., Buzo, A., Gray, R.M.: An algorithm for vector quantizer design. IEEE Trans. on Communications 28(1), 84–95 (1980)
Ahalt, S.C., Krishnamurthy, A.K., Chen, P., Melton, D.E.: Competitive learning algorithms for vector quantization. Neural Networks 3, 277–290 (1990)
Yair, E.K., Zeger, K., Gersho, A.: Competitive learning and soft competition for vector quantizer design. IEEE Trans. Signal Processing 40(2), 294–308 (1992)
Pal, N.R., Bezdek, J.C., Tsao, E.C.: Generalized clustering networks and kohonen’s self-organizing scheme. IEEE Trans. Neural Networks 4(4), 549–557 (1993)
Xu, L., Krzyzak, A., Oja, E.: Rival penalized competitive learning for clustering analysis, rbf net, and curve detection. IEEE Trans. Neural Networks 4(4), 636–649 (1993)
Ueda, N., Nakano, R.: A new competitive learning approach based on an equidistortion principle for designing optimal vector quantizers. Neural Networks 7(8), 1211–1227 (1994)
Uchiyama, T., Arbib, M.: Color image segmentation using competitive learning. IEEE Trans. on Pattern Analysis and Machine Intelligence 16(2), 1197–1206 (1994)
Mao, J., Jain, A.K.: A self-organizing network for hyperellipsoidal clustering (hec). IEEE Trans. Neural Networks 7, 16–29 (1996)
Gómez-Ruiz, J.A., Muñoz-Pérez, J., López-Rubio, E., Garcia-Bernal, M.A.: Expansive and competitive neural networks. In: Mira, J., Prieto, A.G. (eds.) IWANN 2001. LNCS, vol. 2084, p. 355. Springer, Heidelberg (2001)
Muñoz Pérez, J., Gómez-Ruiz, J.A., López-Rubio, E., García-Bernal, M.A.: Expansive and competitive learning for vector quantization. Neural Processing Letters 15, 261–273 (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Mérida-Casermeiro, E., López-Rodríguez, D., Galán-Marín, G., Ortiz-de-Lazcano-Lobato, J.M. (2007). Improved Production of Competitive Learning Rules with an Additional Term for Vector Quantization. In: Beliczynski, B., Dzielinski, A., Iwanowski, M., Ribeiro, B. (eds) Adaptive and Natural Computing Algorithms. ICANNGA 2007. Lecture Notes in Computer Science, vol 4431. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71618-1_51
Download citation
DOI: https://doi.org/10.1007/978-3-540-71618-1_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71589-4
Online ISBN: 978-3-540-71618-1
eBook Packages: Computer ScienceComputer Science (R0)