Abstract
Personalization for real-world machine-learning applications usually has to incorporate user feedback. Unfortunately, user feedback often suffers from sparsity and possible inconsistencies. Here we present an algorithm that exploits feedback for learning only when it is consistent. The user provides feedback on a small subset of the data. Based on the data representation alone, our algorithm employs a statistical criterion to trigger learning when user feedback is significantly different from random. We evaluate our algorithm in a challenging audio classification task with relevance to hearing aid applications. By restricting learning to an informative subset, our algorithm substantially improves the performance of a recently introduced classification algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Büchler, M., Allegro, S., Launer, S., Dillier, N.: Sound classification in hearing aids inspired by auditory scene anlysis. Journal of Applied Signal Processing 18, 2991–3002 (2005)
Moh, Y., Orbanz, P., Buhmann, J.: Music preference learning with partial information. In: ICASSP (2008)
Zolter, J.Z., Maloof, M.A.: Using additive expert ensembles to cope with concept drift. In: Proceedings of the 22nd Intl Conference on Machine Learning (2005)
Chapelle, O., Schölkopf, B., Zien, A. (eds.): Semi-Supervised Learning. MIT Press, Cambridge (2006)
Belkin, M., Niyogi, P.: Using manifold structure for partially labelled classification. In: Advances in NIPS, vol. 15 (2003)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Infomation Processing Systems, vol. 16, pp. 321–328. MIT Press, Cambridge (2004)
Ellis, D.: Classifying music audio with timbral and chroma features. In: Proc. Int. Conf. on Music Information Retrieval, Vienna, Austria (September 2007)
Ellis, D.: PLP and RASTA (and MFCC, and inversion) in Matlab, online web resource (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Moh, Y., Einhäuser, W., Buhmann, J.M. (2008). Automatic Detection of Learnability under Unreliable and Sparse User Feedback. In: Rigoll, G. (eds) Pattern Recognition. DAGM 2008. Lecture Notes in Computer Science, vol 5096. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69321-5_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-69321-5_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69320-8
Online ISBN: 978-3-540-69321-5
eBook Packages: Computer ScienceComputer Science (R0)