Abstract
In this paper we evaluate and compare the performance of self-organizing neural networks applied to the task of image compression. The networks investigated are two-layered architectures with linear neurons, and variants of Hebbian learning rules are used to reduce the dimensionality of the inputs while preserving a maximum of information in the output units. Although in theory all networks considered are effectively equivalent to performing the Karhunen-Loève transform, which is the optimal image compression method in the sense that it allows linear reconstruction of the input information with minimal squared error, the results obtained in practice reveal significant differences between the networks. An experimental study has been conducted to demonstrate these differences and thus some light is shed on the suitability of self-organizing neural networks for image compression, particularly in comparison to more conventional methods.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
G. Cottrell, P. Munro and D. Zipser. Image Compression by Backpropagation: An Example of Extensional Programming. In: Advances in Cognitive Science, Vol. 3, Norwood, 1987.
Digital Equipment Corporation. JPEG Still Picture Compression Standard, Communications of the ACM, 34:31–44, 1991.
P. Földiák. Adaptive Network for Optimal Linear Feature Extraction. In: Proceedings of the International Joint Conference on Neural Networks. San Diego, SOS Printing, pp. 401–405, 1989.
A.K. Jain. Image Data Compression: A Review. Proceedings of the IEEE, 69(3):349–389, 1981.
I.T. Jolliffe. Principal Component Analysis. Springer-Verlag, 1986.
T.K. Leen. Dynamics of Learning in Feature-Discovery Networks. Networks, 2, pp. 85–105, 1991.
L.K. Liu and P.A. Limogenides. Unsupervised Orthogonalization Neural Network for Image Compression. Proceedings of the SPIE'92 Conference on Intelligent Robots and Computer Vision XI, Vol. 1826, pp. 215–225, 1992.
M. Mougeot, R. Azencott and B. Angeniol. Image Compression With Back Propagation: Improvement of the Visual Restoration Using Different Cost Functions. Neural Networks 4, pp. 467–476, 1991.
E. Oja. A Simplified Neuron Model as a Principal Component Analyzer. Journal of Mathematical Biology, 15, pp. 267–273, 1982.
E. Oja. Neural Networks, Principal Components, and Subspaces. International Journal of Neural Systems 1, pp. 61–68, 1989.
J. Rubner and P. Tavan. A Self-Organizing Network for Principal-Component Analysis. Europhysics Letters 10, pp. 693–698, 1989.
T.D. Sanger. Optimal Unsupervised Learning in a Single-Layer Linear Feedforward Neural Network. Neural Networks 2, pp. 459–473, 1989.
L.P. Yaroslavsky. Digital Picture Processing. Springer-Verlag, 1985.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Freisleben, B., Mengel, M. (1993). Image compression with self-organizing networks. In: Mira, J., Cabestany, J., Prieto, A. (eds) New Trends in Neural Computation. IWANN 1993. Lecture Notes in Computer Science, vol 686. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-56798-4_218
Download citation
DOI: https://doi.org/10.1007/3-540-56798-4_218
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-56798-1
Online ISBN: 978-3-540-47741-9
eBook Packages: Springer Book Archive