Abstract
In this paper, a probabilistic framework for ordinal prediction is proposed, which can be used in modeling ordinal regression. A sparse Bayesian treatment for ordinal regression is given by us, in which an automatic relevance determination prior over weights is used. The inference techniques based on Laplace approximation is adopted for model selection. By this approach accurate prediction models can be derived, which typically utilize dramatically fewer basis functions than the comparable supported vector based and Gaussian process based approaches while offering a number of additional advantages. Experimental results on the real-world data set show that the generalization performance competitive with support vector-based method and Gaussian process-based method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kramer, S., Widmer, G., Pfahringer, B., DeGroeve, M.: Prediction of Ordinal Classes Using Regression Trees. Fundamenta Informaticae, 1–13 (2001)
Frank, E., Hall, M.: A Simple Approach to Ordinal Classification. In: Proceedings of the European Conference on Machine Learning, pp. 145–165 (2001)
Crammer, K., Singer, Y.: Pranking with Ranking. In: Proceedings of the conference on Neural Information Processing Systems (2001)
Harrington, E.F.: Online Ranking/Collaborative Filtering Using the Perceptron Algorithm. In: Proceedings of the Twentieth International Conference on Machine Learning, pp. 250–257 (2003)
Shashua, A., Levin, A.: Ranking with Large Margin Principle: Two Approaches. Advances In Neural Information Processing Systems, 961–968 (2003)
Chu, W., Keerthi, S.S.: New Approaches to Support Vector Ordinal Regression. In: Proceedings of the 22nd International Conference on Machine Learning, pp.145–152 (2005)
Shevade, S.K., Chu, W.: Minimum Enclosing Spheres Formulations for Support Vector Ordinal Regression. In: Proceedings of IEEE International Conference on Data Mining, ICDM, pp. 1054–1058 (2007)
Li, L., Lin, H.: Ordinal Regression by Extended Binary Classification. Advances In Neural Information Processing Systems 19, 865 (2007)
Chu, W., Ghahramani, Z.: Gaussian Processes for Ordinal Regression. Journal of Machine Learning Research 6, 23 (2005)
Tipping, M.E.: Sparse Bayesian Learning and the Relevance Vector Machine. Journal of Machine Learning Research 1, 211–244 (2001)
Williams, O., Blake, A., Cipolla, R.: Sparse Bayesian Learning for Efficient Visual Tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 1292–1304 (2005)
Agarwal, A., Triggs, B.: 3D Human Pose from Silhouettes by Relevance Vector Regression. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 882–888 (2004)
Cawley, G.C., Talbot, N.L.C., Janacek, G.J., Peck, M.W.: Sparse Bayesian Kernel Survival Analysis for Modeling the Growth Domain of Microbial Pathogens. IEEE Transactions on Neural Networks 17, 471–481 (2006)
Peng, J.Y., Aston, J.A.D., Gunn, R.N., Liou, C.Y., Ashburner, J.: Dynamic Positron Emission Tomography Data-driven Analysis Using Sparse Bayesian Learning. IEEE Transactions on Medical Imaging 27, 1356–1369 (2008)
Wei, L.Y., Yang, Y.Y., Nishikawa, R.M.: A relevance Vector Machine Technique for Automatic Detection of Clustered Microcalcifications, pp. 831–839 (2005)
Li, Y., Campbell, C., Tipping, M.: Bayesian Automatic Relevance Determination Algorithms for Classifying Gene Expression Data. Bioinformatics 18, 1332–1339 (2002)
MacKay, D.J.C.: Bayesian Nonlinear Modeling for the Prediction Competition. ASHRAE Transactions 100, 1053–1062 (1994)
Neal, R.M.: Bayesian Learning for Neural Networks. Springer, Heidelberg (1996)
MacKay, D.J.C.: A Practical Bayesian Framework for Backpropagation Networks. Neural Computation 4, 448–472 (1992)
Liu, T.Y., Xu, J., Qin, T., Xiong, W., Li, H.: Letor: Benchmark Dataset for Research on Learning to Rank for Information Retrieval. In: Proceedings of SIGIR 2007 Workshop on Learning to Rank for Information Retrieval (2007)
Hersh, W., Buckley, C., Leone, T.J., Hickam, D.: OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research. In: Proceedings of the Seventeenth Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, vol. 358, pp. 192–201 (1994)
Kekalainen, J.: Binary and Graded Relevance in IR Evaluations - Comparison of the Effects on Ranking of IR Systems. Information Processing & Management 41, 1019–1033 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chang, X., Zheng, Q., Lin, P. (2009). Ordinal Regression with Sparse Bayesian. In: Huang, DS., Jo, KH., Lee, HH., Kang, HJ., Bevilacqua, V. (eds) Emerging Intelligent Computing Technology and Applications. With Aspects of Artificial Intelligence. ICIC 2009. Lecture Notes in Computer Science(), vol 5755. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04020-7_63
Download citation
DOI: https://doi.org/10.1007/978-3-642-04020-7_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04019-1
Online ISBN: 978-3-642-04020-7
eBook Packages: Computer ScienceComputer Science (R0)