Abstract
This paper introduces the use of relevance vector machines (RVMs) for content-based image classification and compares it with the conventional support vector machine (SVM) approach. Different wavelet kernels are included in the formulation of the RVM. We also propose a new wavelet-based feature extraction method that extracts lesser number of features as compared to other wavelet-based feature extraction methods. Experimental results confirm the superiority of RVM over SVM in terms of the trade-off between slightly reduced accuracy but substantially enhanced sparseness of the solution, and also the ease of free parameters tuning.
Similar content being viewed by others
References
Camps-Valls G, Rojo-Alvarez JL, Martnez-Ramon M (2007) Kernel methods in bioengineering, signal and image processing. Idea Group Publishing, USA
Chen W, Cui W, Zhu C (2006a) Wavelet support vector machine with universal approximation and its application. In: Proceedings of IEEE information theory workshop, pp 360–364
Chen WS, Yuen PC, Fang B, Lai J (2006b) Shannon wavelet kernel based subspace LDA approach in face recognition. In: Proceedings of international conference on computational intelligence and security, vol 1, pp 708–713
Chen Y, Wang JZ (2004) Image categorization by learning and reasoning with regions. J Mach Learning Res 5:913–939
Johansson R, Nugues P (2005) Sparse bayesian classification of predicate arguments. In: Proceedings of the ninth conference on computational natural language learning (CoNLL-2005), Association for Computational Linguistics, pp 177–180
Li Y, Chen X, Fu X, Belkasim S (2007) Multi-level discrete cosine transform for content-based image retrieval by support vector machines. In: IEEE international conference on image processing(ICIP07), vol 6, pp 21–24
MacKay DJC (1992a) Bayesian interpolation. Neural Comput 4(3):415–447
MacKay DJC (1992b) The evidence framework applied to classification networks. Neural Comput 4(5):720–736
Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790
Nabney IT (1999) Efficient training of rbf networks for classification. In: Proceedings of 9th ICANN, vol 1, pp 210–215
Scholkopf B, Smola A (2002) Learning with kernels—support vector machines, regularization, optimization and beyond. MIT Press Series, USA
Scholkopf B, Burges C, Smola A (1998) Advances in kernel methods: support vector machines. MIT Press, USA
Sebald DJ, Bucklew JA (2000) Support vector machine techniques for nonlinear equalization. IEEE Trans Signal Process 48:379–423
Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, Cambridge
Tipping ME (2000) The relevance vector machine. In: Solla SA, Leen TK, Müller K-R (eds) Advances in neural information processing systems, vol 12. MIT Press, USA, pp 652–658
Tipping ME (2001) Sparse bayesian learning and the relevance vector machine. J Mach Learning Res 1:211–244
Tzotsos A (2006) A support vector machine approach for object based image analysis. In: Proceedings of international conference on object-based image analysis (OBIA06)
Vapnik V (1995) The nature of statistical learning theory. Springer, New York
Wang JZ, Wiederhold G, Firschein O, Wei SX (1998) Content-based image indexing and searching using daubechies wavelets. Int J Digital Libr 1(4):311–328
Wang JZ, Li J, Wiederhold G (2001) Simplicity: semantics-sensitive integrated matching for picture libraries. IEEE Trans Pattern Anal Mach Intell 23(9):947–963
Wei L, Yang Y, Nishikawa R, Wernick M, Edwards A (2005) Rvm for automatic detection of clustered microcalcifications. IEEE Trans Med Imaging 24(10):1278–1285
Williams O, Blake A, Cipolla R (2005) Sparse bayesian learning for efficient visual tracking. IEEE Trans Pattern Anal Mach Intell 27(8):1292–1304
Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE Trans Syst Man Cybern 34(1):34–39
Acknowledgments
The authors would like to thank anonymous reviewers for their constructive comments.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article can be found at http://dx.doi.org/10.1007/s00500-009-0477-2
Rights and permissions
About this article
Cite this article
Tolambiya, A., Venkatraman, S. & Kalra, P.K. Content-based image classification with wavelet relevance vector machines. Soft Comput 14, 129–136 (2010). https://doi.org/10.1007/s00500-009-0439-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-009-0439-8