Abstract
Text classification, aiming to predict the category of a given text based on it's semantic information, is a fundamental part of natural language procession applications such as spam detection and user intention classification. Existing Chinese short text classification models mostly use neural network methods to extract text classification features, but still, there are problems of insufficient feature extraction and poor classification results. This paper constructs a Chinese short text classification model that incorporates multi-level semantic features. The model first uses Convolutional Neural Network(CNN) and Bidirectional Gated Recurrent Unit (BiGRU) to extract character and word features of texts; secondly, it builds a multi-level semantic extraction network to produce multi-level semantic representation by capturing local features and context features of texts, screening them, and fusing them with the character and word feature; finally, classify texts with a Softmax classifier. The experimental results on THUCNews are inclined to show that our model’s performance is further improved compared with existing models, and the classification accuracy reaches 93.59%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) ECML 1998. LNCS, vol. 1398, pp. 137–142. Springer, Heidelberg (1998). https://doi.org/10.1007/BFb0026683
Kim, S.B., Rim, H.C., Yook, D.S., et al.: Effective methods for improving naive bayes text classifiers. In: Ishizuka, M., Sattar, A. (eds.) PRICAI 2002: Trends in Artificial Intelligence. PRICAI 2002. LNCS, vol. 2417, pp. 414–423. Springer, Berlin, Heidelberg (2002). https://doi.org/10.1007/3-540-45683-X_45
Wang, Z., Sun, X., Zhang, D.: An optimal text categorization algorithm based on SVM. In: 2006 International Conference on Communications, Circuits and Systems. IEEE, 2006, vol. 3, pp. 2137–2140 (2006)
Zhou, P., Qi, Z., Zheng, S., et al.: Text classification improved by integrating bidirectional LSTM with two-dimensional max pooling. arXiv preprint arXiv:1611.06639 (2016)
Liu, P., Qiu, X., Huang, X.: Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101 (2016)
Liu, G., Guo, J.: Bidirectional LSTM with attention mechanism and convolutional layer for text classification. Neurocomputing 337, 325–338 (2019)
Johnson, R., Zhang, T.: Deep pyramid convolutional neural networks for text categorization. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 562–570 (2017)
He, K., Zhang, X., Ren, S., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, pp. 770–778 (2016)
Wenzhen, J., Hong, Z., Guocai, Y.: An efficient character-level and word-level feature fusion method for chinese text classification. J. Phys. Conf. Ser. 1229(1), 012057. IOP Publishing (2019)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781 (2013)
Liu, J., Yang, Y., He, H.: Multi-level semantic representation enhancement network for relationship extraction. Neurocomputing 403, 282–293 (2020)
Sun, M., et al.: THUCTC: An Efficient Chinese Text Classifier (2016)
Acknowledgment
This work is supported by the Scientific Research Project Foundation of Fujian University of Technology (GY-Z20046).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, F., Sun, S., Xu, S., Zhang, Z., Chang, KC. (2022). Chinese Short Text Classification Based on Multi-level Semantic Feature Extraction. In: Hassanien, A.E., Snášel, V., Chang, KC., Darwish, A., Gaber, T. (eds) Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2021. AISI 2021. Lecture Notes on Data Engineering and Communications Technologies, vol 100. Springer, Cham. https://doi.org/10.1007/978-3-030-89701-7_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-89701-7_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89700-0
Online ISBN: 978-3-030-89701-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)