Skip to main content
SpringerLink
Log in

Codebook Design for Vector Quantization Based on a Kernel Fuzzy Learning Algorithm

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

Vector quantization (VQ) is an efficient technique for data compression and has been successfully used in various applications. The methods most commonly used to generate a codebook are the Linde, Buzo, Gray (LBG) algorithm, fuzzy vector quantization (FVQ) algorithm, Kekre‘s Fast Codebook Generation (KFCG) algorithm, discrete cosine transform based (DCT-based) codebook generation method, and k-principle component analysis (K-PCA) algorithm. However, if the separation boundaries in codebook generation are nonlinear, their performance can degrade fast. In this paper, we present a kernel fuzzy learning (KFL) algorithm, which takes advantages of the distance kernel trick and the gradient-based fuzzy clustering method, to create a codebook automatically. Experiments with real data show that the proposed algorithm is more efficient in its performance compared to that of the LBG, FVQ, KFCG, and DCT-based method, and to the K-PCA algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. P. Bao, X.H. Ma, Image adaptive watermarking using wavelet domain singular value decomposition. IEEE Trans. Circuits Syst. Video Technol. 15, 96–102 (2005)

    Article  Google Scholar 

  2. Y.K. Chan, H.F. Wang, C.F. Lee, A refined VQ-based image compression method. Fundam. Inform. 61, 213–221 (2004)

    MathSciNet  MATH  Google Scholar 

  3. C.Y. Chang, D.F. Zhuang, A fuzzy-based learning vector quantization neural network for recurrent nasal papilloma detection. IEEE Trans. Circuits. Syst. I, Regul. Pap. 54, 2619–2627 (2007)

    Article  Google Scholar 

  4. C.H. Chang, P.F. Xu, R. Xiao, T. Srikanthan, New adaptive color quantization method based on self-organizing maps. IEEE Trans. Neural Netw. 16, 237–249 (2005)

    Article  Google Scholar 

  5. C.C. Chang, W.L. Tai, C.C. Lin, A reversible data hiding scheme based on side match vector quantization. IEEE Trans. Circuits Syst. Video Technol. 16, 1301–1308 (2006)

    Article  Google Scholar 

  6. R.N. Dave, R. Krishnapuram, Robust clustering methods: a unified view. Neural Comput. 5, 270–293 (1997)

    Google Scholar 

  7. M. Grana, I. Echave, J. Ruiz-Cabello, VQ based Bayesian image filtering, in Proceedings of the IEEE International Conference on Image Processing, vol. 2 (2000), pp. 451–454

    Google Scholar 

  8. D. Graves, W. Pedrycz, Performance of kernel-based fuzzy clustering. Electron. Lett. 43, 25–26 (2007)

    Article  Google Scholar 

  9. D. Graves, W. Pedrycz, Fuzzy c-means, Gustafson-Kessel FCM, and kernel-based FCM: a comparative study. Adv. Soft Comput. 41, 140–149 (2007)

    Article  Google Scholar 

  10. R.J. Hathaway, Y.K. Hu, Density-weighted fuzzy c-means clustering. IEEE Trans. Fuzzy Syst. 17, 243–252 (2009)

    Article  Google Scholar 

  11. H.C. Huang, J.S. Pan, Z.M. Lu, S.H. Sun, H.M. Hang, Vector quantization based on genetic simulated annealing. Signal Process. 81, 1513–1523 (2001)

    Article  MATH  Google Scholar 

  12. H.B. Kekre, T.K. Sarode, Speech data compression using vector quantization. Int. J. Comput. Inf. Sci. Eng. 2, 251–254 (2008)

    Google Scholar 

  13. H.B. Kekre, T.K. Sarode, 2-level vector quantization method for codebook design using Kekre’s median codebook generation algorithm. Adv. Comput. Sci. Technol. 2, 1–8 (2009)

    Google Scholar 

  14. H.B. Kekre, T.K. Sarode, Vector quantized codebook optimization using K-means. Int. J. Comput. Inf. Sci. Eng. 1, 283–290 (2009)

    Google Scholar 

  15. H.B. Kekre, T.K. Sarode, S.D. Thepade, Image retrieval using color-texture features from DCT on VQ codevectors obtained by Kekre’s fast codebook generation. ICGST-GVIP J. 9, 1–8 (2009)

    Google Scholar 

  16. H.B. Kekre, T.K. Sarode, Fast codebook search algorithm for vector quantization using sorting technique, in Proceedings of the International Conference on Advances in Computing, Communication and Control, vol. 1 (2009), pp. 317–325

    Chapter  Google Scholar 

  17. H.B. Kekre, T.K. Sarode, Color image segmentation using Kekre’s fast codebook generation algorithm based on energy ordering concept, in Proceedings of the International Conference on Advances in Computing, Communication and Control, vol. 1 (2009), pp. 357–362

    Chapter  Google Scholar 

  18. R. Krishnamoorthi, N. Kannan, Codebook generation for vector quantization on orthogonal polynomials based transform coding. Int. J. Signal. Process. 5, 67–73 (2009)

    Google Scholar 

  19. D. Kim, K. Lee, D. Lee, K.H. Lee, Evaluation of the performance of clustering algorithms in kernel-induced feature space. Pattern Recognit. 38, 607–611 (2005)

    Article  Google Scholar 

  20. J.F. Kolen, T. Hutcheson, Reducing the time complexity of the fuzzy C-Means algorithm. IEEE Trans. Fuzzy Syst. 10, 263–267 (2002)

    Article  Google Scholar 

  21. J. Leski, Towards a robust fuzzy clustering. Fuzzy Sets Syst. 137, 215–233 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  22. Z.M. Lu, H. Burkhardt, Colour image retrieval based on DCT-domain vector quantisation index histograms. Electron. Lett. 41, 2176–2176 (2005)

    Google Scholar 

  23. C. Lv, K-PCA: a semi-universal encoder for image compression. Int. J. Pervasive Comput. Commun. 3, 205–220 (2007)

    Article  Google Scholar 

  24. C. Lv, Q. Zhao, A universal PCA for image compression, in Lecture Notes in Computer Science, vol. 3824 (2005), pp. 910–919

    Google Scholar 

  25. K. Mizutani, S. Miyamoto, Possibilistic approach to kernel-based fuzzy c-means clustering with entropy regularization, in Lecture Notes in Computer Science: MDAI, vol. 3558 (2005), pp. 144–155

    Google Scholar 

  26. K.R. Muller, S. Mika, G. Ratsch, K. Tsuda, B. Scholkopf, An introduction to kernel-based learning algorithms. IEEE Trans. Neural Netw. 12, 181–202 (2001)

    Article  Google Scholar 

  27. J.S. Pan, F.R. McInnes, M.A. Jack, Fast clustering algorithms for vector quantization. Pattern Recognit. 29, 511–518 (1996)

    Article  Google Scholar 

  28. J.S. Pan, F.R. McInnes, M.A. Jack, VQ codebook design using genetic algorithms. IEE Electron. Lett. 32, 194 (1996)

    Article  Google Scholar 

  29. D. Park, C.N. Tran, S. Park, Gradient based fuzzy c-means algorithm with a mercer kernel, in Lecture Notes in Computer Science: ISNN, vol. 3971 (2006), pp. 1038–1043

    Google Scholar 

  30. T.D. Pham, D.T. Tran, X. Zhou, S.T.C. Wong, A microscopic image classification system for high-throughput cell-cycle screening. Int. J. Intell. Comput. Med. Sci. Image Process. 1, 67–77 (2007)

    Google Scholar 

  31. J. Shanbehzadeh, P.O. Ogunbona, On the computational complexity of the LBG and PNN algorithms. IEEE Trans. Image Process. 6, 614–616 (1997)

    Article  Google Scholar 

  32. P.C. Su, C.C. Chen, H.M. Chang, Towards effective content authentication for digital videos by employing feature extraction and quantization. IEEE Trans. Circuits Syst. Video Technol. 19, 668–677 (2009)

    Article  Google Scholar 

  33. S.P. Voukelatos, J.J. Soraghan, Multiresolution adaptive VQ based still image codec with application to progressive image transmission. Signal Process. Image Commun. 13, 135–143 (1998)

    Article  Google Scholar 

  34. T. Wedi, Adaptive interpolation filters and high-resolution displacements for video coding. IEEE Trans. Circuits Syst. Video Technol. 16, 484–491 (2006)

    Article  Google Scholar 

  35. L. Zhang, P. Bao, X.L. Wu, Multiscale LMMSE-based image denoising with optimal wavelet selection. IEEE Trans. Circuits Syst. Video Technol. 15, 469–481 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electronic and Information Engineering, South China University of Technology, Guangzhou, 510641, P.R. China

    Zongbo Xie & Jiuchao Feng

Authors
  1. Zongbo Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiuchao Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zongbo Xie.

Additional information

This work was supported by the National Natural Science Foundation of China (Grant No. 60872123), the Joint Fund of the National Natural Science Foundation and the Guangdong Provincial Natural Science Foundation (Grant No. U0835001), the Doctorate Foundation of South China University of Technology, the Post-Doc Foundation of South China University of Technology, the Basic Scientific Research Fund of South China University of Technology for Youth, Nature Science Fund of South China University of Technology for Youth, Natural Science Foundation of Guangdong Province, and by the China Postdoctoral Science Foundation (Grant No. 20100480049).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xie, Z., Feng, J. Codebook Design for Vector Quantization Based on a Kernel Fuzzy Learning Algorithm. Circuits Syst Signal Process 30, 999–1010 (2011). https://doi.org/10.1007/s00034-011-9271-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-011-9271-3

Keywords

Search

Navigation