Abstract
In the multi-label classification task (Automatic Tagging of Zhihu Questions), we present a classification system which includes five processes. Firstly, we use a preprocessing step to solve the problem that there is too much noise in the training dataset. Secondly, we choose several neural network models which proved effective in text classification task. Then we introduce k-max pooling structure to these models to fit this task. Thirdly, in order to obtain a better performance in ensemble process, we use an experiment-designing process to obtain classification results that are not similar to each other and all achieve relatively high scores. Fourthly, we use an ensemble process. Finally, we propose a method to estimate how many labels should be chosen. With these processes, our F1 score achieves 0.5194, which ranked No. 3.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Saha, A.K., Saha, R.K., Schneider., K.A.: A discriminative model approach for suggesting tags automatically for stack overflow questions. In: 10th IEEE Working Conference on Mining Software Repositories, San Francisco, pp. 73–76 (2013)
Yang, Z., Yang, D., Dyer, C., He, X., Smola A., Hovy, E.: Hierarchical attention networks for document classification. In: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, pp. 1480–1489 (2017)
Conneau, A., Schwenk, H., Cun, Y.L.: Very Deep Convolutional Networks for Text Classification. arXiv preprint arXiv:1606.01781 (2017)
Johnson, R., Zhang, T.: Semi-supervised convolutional neural networks for text categorization via region embedding. Adv. Neural. Inf. Process. Syst. 28, 919–927 (2015)
Zhou, Y., Xu, B., Xu, J., Yang, L., Li, C., Xu, B.: Compositional recurrent neural networks for Chinese short text classification. In: 2016 IEEE, Omaha, pp. 137–144 (2016)
Kim, Y.: Convolutional Neural Networks for Sentence Classification. Eprint Arxiv (2014)
Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: AAAI Conference on Artificial Intelligence, Austin, pp. 2267–2273 (2015)
Jouling, A., Grave, E., Bojanowshi, P., Mikolov, T.: Bag of Tricks for Efficient Text Classification. arXiv preprint arXiv:1607.01759 (2016)
Zhou, Z.H.: Machine Learning. Tsinghua University Press, Beijing (2016)
Sundermeyer, M., SchlÜter, R., Ney, H.: LSTM neural networks for language modeling. Interspeech 31(43), 601–608 (2012)
Li, W., Wu, Y.: Multi-level gated recurrent neural network for dialog act classification. In: COLING 2016, Osaka, pp. 1970–1979 (2016)
Peng, H., Li, J.X., Song, Y.Q., Liu, Y.P.: Incrementally learning the hierarchical softmax function for neural language models. In: 2016, AAAI, Feinikesi (2016)
Kalchbrenner, N., Grefenstette, E., Blunsom, P.: A Convolutional Neural Network for Modelling Sentences. arXiv preprint arXiv:1404.2188 (2014)
Sennrich, R., Haddow, B., Birch, A.: Edinburgh neural machine translation systems for WMT 16. WMT16 Shared Task System Description (2016)
Acknowledgements
This work was supported in part by the National Project (2016YFB0801306) and the open source project (PyTorchText in GitHub). The authors would like to thank anonymous reviewers, Le Bo, Jiqiang Liu, Qiang Wang, YinQiao Li, YuXuan Rong and Chunliang Zhang for their comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Xiang, Y., Wang, H., Ji, D., Zhang, Z., Zhu, J. (2018). NEUTag’s Classification System for Zhihu Questions Tagging Task. In: Zhang, M., Ng, V., Zhao, D., Li, S., Zan, H. (eds) Natural Language Processing and Chinese Computing. NLPCC 2018. Lecture Notes in Computer Science(), vol 11108. Springer, Cham. https://doi.org/10.1007/978-3-319-99495-6_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-99495-6_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99494-9
Online ISBN: 978-3-319-99495-6
eBook Packages: Computer ScienceComputer Science (R0)
