skip to main content
10.1145/1102351.1102369acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmlConference Proceedingsconference-collections
Article

Preference learning with Gaussian processes

Published: 07 August 2005 Publication History

Abstract

In this paper, we propose a probabilistic kernel approach to preference learning based on Gaussian processes. A new likelihood function is proposed to capture the preference relations in the Bayesian framework. The generalized formulation is also applicable to tackle many multiclass problems. The overall approach has the advantages of Bayesian methods for model selection and probabilistic prediction. Experimental results compared against the constraint classification approach on several benchmark datasets verify the usefulness of this algorithm.

References

[1]
Aiolli, F., & Sperduti, A. (2004). Learning preferences for multiclass problems. Advances in Neural Information Processing Systems 17.
[2]
Bahamonde, A., Bayón, G. F., Díez, J., Quevedo, J. R., Luaces, O., del Coz, J. J., Alonso, J., & Goyache, F. (2004). Feature subset selection for learning preferences: A case study. Proceedings of the 21th International Conference on Machine Learning (pp. 49--56).
[3]
Brinker, K. (2004). Active learning of label ranking functions. Proceedings of the 21th International Conference on Machine Learning (pp. 129--136).
[4]
Chu, W., & Ghahramani, Z. (2004). Gaussian processes for ordinal regression (Technical Report). Gatsby Computational Neuroscience Unit, University College London. http://www.gatsby.ucl.ac.uk/~chuwei/paper/gpor.pdf.
[5]
Csató, L., & Opper, M. (2002). Sparse online Gaussian processes. Neural Computation, 14, 641--668.
[6]
Dekel, O., Keshet, J., & Singer, Y. (2004). Log-linear models for label ranking. Proceedings of the 21st International Conference on Machine Learning (pp. 209--216).
[7]
Doyle, D. (2004). Prospects of preferences. Computational Intelligence, 20, 111--136.
[8]
Fiechter, C.-N., & Rogers, S. (2000). Learning subjective functions with large margins. Proc. 17th International Conf. on Machine Learning (pp. 287--294).
[9]
Fürnkranz, J., & Hüüllermeier, E. (2003). Pairwise preference learning and ranking. Proceedings of the 14th European Conference on Machine Learning (pp. 145--156).
[10]
Fürnkranz, J., & Hüüllermeier, E. (2005). Preference learning. Künstliche Intelligenz. in press.
[11]
Har-Peled, S., Roth, D., & Zimak, D. (2002). Constraint classification: A new approach to multiclass classification and ranking. Advances in Neural Information Processing Systems 15.
[12]
Herbrich, R., Graepel, T., Bollmann-Sdorra, P., & Obermayer, K. (1998). Learning preference relations for information retrieval. Proc. of Workshop Text. Categorization and Machine Learning, ICML (pp. 80--84).
[13]
Hersh, W., Buckley, C., Leone, T., & Hickam, D. (1994). Ohsumed: An interactive retrieval evaluation and new large test collection for research. Proceedings of the 17th Annual ACM SIGIR Conference (pp. 192--201).
[14]
Lawrence, N. D., Seeger, M., & Herbrich., R. (2002). Fast sparse Gaussian process methods: The informative vector machine. Advances in Neural Information Processing Systems 15 (pp. 609--616).
[15]
MacKay, D. J. C. (1994). Bayesian methods for backpropagation networks. Models of Neural Networks III, 211--254.
[16]
McCallum, A. K. (1996). Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. http://www.cs.cmu.edu/~mccallum/bow.
[17]
Neal, R. M. (1996). Bayesian learning for neural networks. Lecture Notes in Statistics. Springer.
[18]
Schölkopf, B., & Smola, A. J. (2002). Learning with kernels. Cambridge, MA: The MIT Press.
[19]
Williams, C. K. I., & Barber, D. (1998). Bayesian classification with Gaussian processes. IEEE Trans. on Pattern Analysis and Machine Intelligence, 20, 1342--1351.
[20]
Williams, C. K. I., & Rasmussen, C. E. (1996). Gaussian processes for regression. Advances in Neural Information Processing Systems (pp. 598--604). MIT Press.
[21]
Wu, T.-F., Lin, C.-J., & Weng, R. C. (2004). Probability estimates for multi-class classification by pairwise coupling. Journal of Machine Learning Research, 5, 975--1005.

Cited By

View all
  • (2024)Response time improves Gaussian process models for perception and preferencesProceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence10.5555/3702676.3702826(3211-3226)Online publication date: 15-Jul-2024
  • (2024)Linearly constrained Gaussian processes are SkewGPsProceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence10.5555/3702676.3702691(333-348)Online publication date: 15-Jul-2024
  • (2024)The Blind and the Elephant: A Preference-aware Edge Video Analytics Scheduler for Maximizing System BenefitProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673081(317-326)Online publication date: 12-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICML '05: Proceedings of the 22nd international conference on Machine learning
August 2005
1113 pages
ISBN:1595931805
DOI:10.1145/1102351
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2005

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Acceptance Rates

Overall Acceptance Rate 140 of 548 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)145
  • Downloads (Last 6 weeks)14
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Response time improves Gaussian process models for perception and preferencesProceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence10.5555/3702676.3702826(3211-3226)Online publication date: 15-Jul-2024
  • (2024)Linearly constrained Gaussian processes are SkewGPsProceedings of the Fortieth Conference on Uncertainty in Artificial Intelligence10.5555/3702676.3702691(333-348)Online publication date: 15-Jul-2024
  • (2024)The Blind and the Elephant: A Preference-aware Edge Video Analytics Scheduler for Maximizing System BenefitProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673081(317-326)Online publication date: 12-Aug-2024
  • (2024)Learning Crowd Motion Dynamics with CrowdsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36513027:1(1-17)Online publication date: 13-May-2024
  • (2024)SwipeGANSpace: Swipe-to-Compare Image Generation via Efficient Latent Space ExplorationProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645141(675-685)Online publication date: 18-Mar-2024
  • (2024)Hot off the Press: Towards Practical Preferential Bayesian Optimization with Skew Gaussian ProcessesProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3638530.3664060(59-60)Online publication date: 14-Jul-2024
  • (2024)Sign-Averaging Covariance Matrix Adaptation Evolution StrategyProceedings of the Genetic and Evolutionary Computation Conference10.1145/3638529.3654065(694-702)Online publication date: 14-Jul-2024
  • (2024)Hybrid Regret Minimization: A Submodular ApproachIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.3328596(1-14)Online publication date: 2024
  • (2024)The Augmented Intelligence Perspective on Human-in-the-Loop Reinforcement Learning: Review, Concept Designs, and Future DirectionsIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.346737054:6(762-777)Online publication date: Dec-2024
  • (2024)Coactive Preference-Guided Multi-Objective Bayesian Optimization: An Application to Policy Learning in Personalized Plasma MedicineIEEE Control Systems Letters10.1109/LCSYS.2024.35219658(3081-3086)Online publication date: 2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media