Abstract
For efficient cellular communication channel usage, we propose a neural computation model for image coding. In a constant-time unsupervised learning, our neural model approximates optimal pattern clustering from training example images through a memory adaptation process, and builds a compression codebook in its synaptic weight matrix. This neural codebook can be distributed to both ends of a transmission channel for fast codec operations on general images. The transmission is merely the indices of the codebook entries best matching the patterns in the image to be transmitted. These indices can further be compressed through a classical entropy coding method to yield even more transmission reduction. Other advantages of our model are the low training time complexity, high utilization of neurons, robust pattern clustering capability, and simple computation. A VLSI implementation is also highly suitable for the intrinsic parallel nature of neural networks. Our compression results are competitive compared to JPEG and wavelet methods. We also reveal the general codebook's cross-compression results, filtering effects by special training methods, and learning enhancement techniques for obtaining a compact codebook to yield both high compression and picture quality.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bradley, J.N., Brislawn, C.M. and Hopper, T, “The FBI wavelet/scalar quantization standard for gray-scale fingerprint image compression”, SPIE Proceedings: Visual Information Processing II, vol. 1961, pp. 128–137, 1993.
Cottrell, G.W., Munro, P., and Zipser, D. “Image compression by back propagation: an example of extensional programming”, in Model of Cognition: A Review of Cognitive Science, N.E.Sharkey (Ed.), Ablex Publishing, Norwood, New Jersey, vol. 1, pp. 208–240, 1988.
Chang, W., Soliman, H.S., and Sung, A.H. “Image data compression using counterpropagation network”, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, pp. 405–409, 1992.
Chang, W., Soliman, H.S., and Sung, A.H., “Preserving visual perception by learning natural clustering”, Proceedings of IEEE International Conference on Neural Networks, vol. 2, pp. 661–666, 1993.
Chang, W., Soliman, H.S., and Sung, A.H., “A learning vector quantization neural model for image data compression,” Proceedings of IEEE Data Compression Conference, p. 493, 1994.
Chang, W., Soliman, H.S., and Sung, A.H., “A Vector quantization neural model to compress still monochromatic images”, Proceedings of IEEE International Conference on Neural Networks, vol. 6, pp. 4163–4168, 1994.
Daubechies, I., Ten Lectures on Wavelets, Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania, 1992.
Davis, H.F. and Snider, A.D., Introduction to Vector Analysis, Wm. C. Brown Publishers, Dubuque, Iowa, 1988.
Fang, W.-C., Sheu, B.J., Chen, O.T.-C. and Choi, J., “A VLSI neural processor for image data compression using self-organization networks”, IEEE Transactions on Neural Networks, vol. 3, pp. 506–518, 1992.
Gersho, A. and Ramamurthi, B., “Image coding using vector quantization”, Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 428–431, Paris, 1982.
Gray, R.M., “Vector quantization”, IEEE Acoustics, Speech, and Signal Processing, vol. 1, no. 2, pp. 4–29, 1984.
Hecht-Nielsen, R., “Applications of counter-propagation networks”, IEEE Transactions on Neural Networks, vol. 1, pp. 131–141, 1988.
Hudson, G.P., Yasuda, H., and Sebestyen, I., “The international standardization of a still picture compression technique”, Proceedings of IEEE Global Telecommunications, pp. 1016–1021, 1988.
Jolion, J.-M., Meer, P. and Bataouche, S., “Robust clustering with applications in computer vision”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 791–802, 1991.
Kohonen, T., Kangas, J., Laaksonen, J., and Torkkola, K., “LVQ-PAK: a program package for the correct application of learning vector quantization algorithms”, Proceedings of IEEE International Joint Conference on Neural Networks, vol. 1, pp. 725–730, 1992.
Kohonen, T., “Self-organized formation of topologically correct feature maps”, Biological Cybernetics, vol. 43, pp. 59–69, 1982.
Kohonen, T., “Self-Organization and Associative Memory, Springer-Verlag, New York, New York, 1982.
Kosko, B., Neural Networks and Fuzzy Systems, Prentice-Hall, Englewood Cliffs, New Jersey, 1992.
Lelewer, D. and Hirschberg, D., “Data compression”, ACM Computing Surveys, vol. 19, pp. 261–292, 1987.
Linsker, R., “Self-organization in a perceptual network”, Computer, vol. 21, pp. 105–117, 1988.
Mougeot, M., Azencott, R., and Angeniol, B., “Image compression with back propagation: improvement of the visual restoration using different cost functions”, IEEE Transactions on Neural Networks, vol. 4, pp. 467–476, 1991.
Nasrabadi, N.N. and King, R.A., “Image coding using vector quantization: a review”, IEEE Transactions on Communications, vol. 36, no. 8, pp. 957–971, 1988.
Oja, E., “A simplified neuron model as a principal component analyzer”, Journal of Mathematical Biology, vol. 15, pp. 267–273, 1982.
Pratt, W.K., Digital Image Processing, Wiley Publishing, New York, New York, 1978.
Ramamurthi, B. and Gersho, A., “Classified vector quantization of images”, IEEE Transactions on Communications, vol. 34, no. 11, pp. 1105–1115, 1986.
Rumelhart, D.E. and Zipser, D., “Feature discovery by competitive learning”, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 2, pp. 151–193, MIT Press, 1986.
Wallace, G.K., “The JPEG still picture compression standard”, IEEE Transaction on Consumer Electronics, 1991.
Wickerhauser, M.V., “High-resolution still picture compression”, Washington University, Department of Mathematics, Research Report, 1992.
Wu, Z. and Leahy, R., “An optimal graph theoretic approach to data clustering: theory and its application to image segmentation”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1103–1113, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Chang, W., Soliman, H.S. A neural synaptic compression codec for efficient image transmission. Wireless Personal Communications 3, 199–214 (1996). https://doi.org/10.1007/BF00354870
Issue Date:
DOI: https://doi.org/10.1007/BF00354870