Abstract
Data sparseness and unseen words are two major problems in short text classification. In such a case, it is unsuitable to directly use the vector space model (VSM) which focuses on the statistical occurrence of the terms to represent the text. To solve these problems, we present a novel short text classification method based on semantics. The method of K-Means is used to perform it. In the experiments, we exploit the continuous word embeddings which were trained on very large unrelated corpora to represent the semantic relationships. The experimental results on an open dataset show that the application of semantics greatly improves the performance in short text classification, comparing with a state-of-the-art baseline in VSM; and that the proposed method can reduce the costs of collecting the training data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Phan, X.H., Nguyen, L.M., Horiguchi, S.: Learning to classify short and sparse text & web with hidden topics from large-scale data collections. In: Proceedings of the 17th International Conference on World Wide Web, pp. 91–100. ACM (2008)
Banerjee, S., Ramanathan, K., Gupta, A.: Clustering short texts using wikipedia. In: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 787–788. ACM (2007)
Bollegala, D., Matsuo, Y., Ishizuka, M.: Measuring semantic similarity between words using web search engines. WWW 7, 757–766 (2007)
Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)
Clinchant, S., Perronnin, F.: Aggregating continuous word embeddings for information retrieval, p. 100. ACL (2013)
Chengqing, Z.: Statistical Natural Language Processing. Tsinghua University Press, Beijing (2008)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Mikolov, T., Yih, W.T., Zweig, G.: Linguistic regularities in continuous space word representations. In: Proceedings of NAACL-HLT, pp. 746–751 (2013)
Rosso, P., Ferretti, E., Jiménez, D., Vidal, V.: Text categorization and information retrieval using wordnet senses. In: Proceedings of the Second International Conference of the Global WordNet Association, pp. 299–304 (2004)
Wu, X.D., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G.J., Ng, A., Liu, B., Philip, S.Y.: Top 10 algorithms in data mining. Knowl. Inf. Syst. 14, 1–37 (2008)
Berger, A.L., Pietra, V.J.D., Pietra, S.A.D.: A maximum entropy approach to natural language processing. Comput. Linguist. 22, 39–71 (1996)
Joachims, T.: Text Categorization with Support Vector Machines: Learning with Many Relevant Features. Joachims, Thorsten (1998)
Sun, A.: Short text classification using very few words. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1145–1146. ACM (2012)
Chen, M., Jin, X.M., Shen, D.: Short text classification improved by learning multigranularity topics. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 3, pp. 1776–1781. AAAI Press (2011)
Jones, K.S.: Readings in Information Retrieval. Morgan Kaufmann, San Francisco (1997)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ma, C., Wan, X., Zhang, Z., Li, T., Zhang, Y. (2015). Short Text Classification Based on Semantics. In: Huang, DS., Han, K. (eds) Advanced Intelligent Computing Theories and Applications. ICIC 2015. Lecture Notes in Computer Science(), vol 9227. Springer, Cham. https://doi.org/10.1007/978-3-319-22053-6_49
Download citation
DOI: https://doi.org/10.1007/978-3-319-22053-6_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22052-9
Online ISBN: 978-3-319-22053-6
eBook Packages: Computer ScienceComputer Science (R0)