Abstract
Named entity recognition (NER) is one of the most fundamental tasks in a variety of natural language applications. Due to the lack of delimiters in the Chinese language, Chinese NER task has been suffering from the shortage of word boundary information. Recently, incorporating word information has been proven an effective mechanism to alleviate this problem. However, how to integrate word information into the character-based model more effectively and efficiently is still a challenge. In this work, we propose a hierarchical lexicon embedding architecture for Chinese NER task. The words matched by the input sentence are divided into two categories, i.e., main words and auxiliary words, to help the model better capture useful information. In addition, the modification mainly lies in the embedding layer, as such it can be easily incorporated with different sequence modeling architectures. Experimental studies on four Chinese NER datasets have shown our method’s promising potential.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The source code is available at https://github.com/BUAAJustin/HLEA.
- 2.
- 3.
Jieba is a Chinese word segmentation module and can give the POS of each character after segmentation. Please refer to https://github.com/fxsjy/jieba/formoreinformation.
References
Aliod, D.M., van Zaanen, M., Smith, D.: Named entity recognition for question answering. In: Proceedings of the 2006 Australasian Language Technology Workshop, pp. 51–58 (2006)
Babych, B., Hartley, A.: Improving machine translation quality with automatic named entity recognition. In: Proceedings of the 7th International EAMT workshop on MT and Other Language Technology Tools, Improving MT through other Language Technology Tools, Resource and Tools for Building MT (2003)
Cao, P., Chen, Y., Liu, K., Zhao, J., Liu, S.: Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 182–192 (2018)
Che, W., Wang, M., Manning, C.D., Liu, T.: Named entity recognition with bilingual constraints. In: Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 52–62 (2013)
Ding, R., Xie, P., Zhang, X., Lu, W., Li, L., Si, L.: A neural multi-digraph model for Chinese NER with gazetteers. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp. 1462–1467 (2019)
Etzioni, O., et al.: Unsupervised named-entity extraction from the web: an experimental study. Artif. Intell. 165(1), 91–134 (2005)
Forney, G.D.: The Viterbi algorithm. Proc. IEEE 61(3), 268–278 (1973)
Gui, T., et al.: A lexicon-based graph neural network for Chinese NER. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 1040–1050 (2019)
He, J., Wang, H.: Chinese named entity recognition and word segmentation based on character. In: Proceedings of the 3rd International Joint Conference on Natural Language Processing, pp. 128–132 (2008)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of 3rd International Conference on Learning Representations (2015)
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C.: Neural architectures for named entity recognition. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 260–270 (2016)
Levow, G.: The third international chinese language processing bakeoff: word segmentation and named entity recognition. In: Proceedings of the 5th Workshop on Chinese Language Processing, pp. 108–117 (2006)
Li, H., Hagiwara, M., Li, Q., Ji, H.: Comparison of the impact of word segmentation on name tagging for Chinese and Japanese. In: Proceedings of the 9th International Conference on Language Resources and Evaluation, pp. 2532–2536 (2014)
Li, X., Yan, H., Qiu, X., Huang, X.: FLAT: Chinese NER using flat-lattice transformer. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6836–6842 (2020)
Liu, L., et al.: Empower sequence labeling with task-aware neural language model. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 5253–5260 (2018)
Liu, W., Xu, T., Xu, Q., Song, J., Zu, Y.: An encoding strategy based word-character LSTM for Chinese NER. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 2379–2389 (2019)
Ma, R., Peng, M., Zhang, Q., Wei, Z., Huang, X.: Simplify the usage of lexicon in Chinese NER. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5951–5960 (2020)
Nadeau, D., Sekine, S.: A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1), 3–26 (2007)
Peng, N., Dredze, M.: Named entity recognition for Chinese social media with jointly trained embeddings. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 548–554 (2015)
Vaswani, A., et al.: Attention is all you need. In: Proceedings of 2017 Annual Conference on Neural Information Processing Systems, pp. 5998–6008 (2017)
Wang, M., Che, W., Manning, C.D.: Effective bilingual constraints for semi-supervised learning of named entity recognizers. In: Proceedings of the 27th AAAI Conference on Artificial Intelligence, pp. 919–925 (2013)
Xu, N.: Chinese word segmentation as character tagging. Int. J. Comput. Linguist. Chin. Lang. Process. 8(1), 29–48 (2003)
Yang, J., Teng, Z., Zhang, M., Zhang, Y.: Combining discrete and neural features for sequence labeling. In: Proceedings of 17th International Conference on Computational Linguistics and Intelligent Text Processing, pp. 140–154 (2016)
Zhang, Y., Yang, J.: Chinese NER using lattice LSTM. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 1554–1564 (2018)
Acknowledgments
This work was partially supported by the National Key Research and Development Program of China (No. 2018YFB2101502) and the National Natural Science Foundation of China (No. 61977002).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Hu, J., Ouyang, Y., Li, C., Wang, C., Rong, W., Xiong, Z. (2021). Hierarchical Lexicon Embedding Architecture for Chinese Named Entity Recognition. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2021. ICANN 2021. Lecture Notes in Computer Science(), vol 12895. Springer, Cham. https://doi.org/10.1007/978-3-030-86383-8_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-86383-8_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86382-1
Online ISBN: 978-3-030-86383-8
eBook Packages: Computer ScienceComputer Science (R0)