Abstract
In this paper we use SVMs to classify spoken and written documents. We show that classification accuracy for written material is improved by the utilization of strings of sub-word units with dramatic gains for small topic categories. The classification of spoken documents for large categories using sub-word units is only slightly worse than for written material, with a larger drop for small topicc ategories. Finally it is possible, without loss, to train SVMs on syllables generated from written material and use them to classify audio documents. Our results confirm the strong promise that SVMs hold for robust audio document classification, and suggest that SVMs can compensate for speech recognition error to an extent that allows a significant degree of topic independence to be introduced into the system.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Drucker, H, Wu, D., Vapnik, V. Support vector machines for spam categorization. IEEE Transactions on Neural Networks, 10(5): 1048–1054, 1999.
Dumais, S., Platt, J., Heckerman, D., Sahami, M. (1998): Inductive learning algorithms and representations for text categorization. In: 7th International Conference on Information and Knowledge Management, 1998.
Gelman, A., Carlin J. B., Stern, H. S., Rubin, D. B.: Bayesian Data Analysis. Chapman, Hall, London, 1995.
Glavitsch, U., Schäuble, P. (1992): A System for Retrieving Speech Documents, SIGIR 1992.
Haussler, David (1999): Convolution Kernels on Discrete Structures, UCSL-CRL-99-10.
Joachims, T. (1998). Text categorization with support vector machines: learning with many relevant features. Proc. ECML’ 98, (pp. 137–142).
Klabbers, E., Stöber, K., Veldhuis, R. Wagner, P., Breuer, S.: Speech synthesis development made easy: The Bonn Open Synthesis System, EUROSPEECH 2001.
Larson, M.: Sub-word-based language models for speech recognition: implications for spoken document retrieval, Proc. Workshop on Language Modeling and IR. Pittsburgh 2001.
Leopold, E., Kindermann, J.: Text Categorization with Support Vector Machines. How to Represent Texts in Input Space? Machine Learning, 46, 2002, 423–444.
Leslie, Christa, Eskin, Eleazar, Noble, William Stafford (2002): The Spectrum Kernel: A String Kernel SVM Protein Classification. To appear: Pacific Symposium on Biocomputing.
Lodhi, Huma, Shawe-Taylor, John, Cristianini, Nello & Watkins, Chris (2001) Text classification using kernels, NIPS 2001, pp. 563–569. MIT Press.
Manning, Christopher D., Schütze (2000): Foundations of Statistical Natural Language Processing, MIT Press.
Watkins, Chris (1998): Dynamicalign ment Kernels. Technical report, Royal Holloway, University of London. CSD-TR-98-11.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Paaß, G., Leopold, E., Larson, M., Kindermann, J., Eickeler, S. (2002). SVM Classification Using Sequences of Phonemes and Syllables. In: Elomaa, T., Mannila, H., Toivonen, H. (eds) Principles of Data Mining and Knowledge Discovery. PKDD 2002. Lecture Notes in Computer Science, vol 2431. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45681-3_31
Download citation
DOI: https://doi.org/10.1007/3-540-45681-3_31
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44037-6
Online ISBN: 978-3-540-45681-0
eBook Packages: Springer Book Archive