Abstract
The Chinese language is evolving over the centuries. In order to study the changes of Chinese language using computational methods, segmentation and PoS tagging of Chinese are essential. However, segmentation and PoS tagging methods developed for Modern Standard Chinese do not perform well for Classical Chinese. The cost of segmenting and annotation is high if they are done manually. In this work, we present a CRF based method for PoS tagging for Classical Chinese text in the Ming and Qing dynasties. One of the key issues is the preparation of the training data for CRF. Our initial experiment shows that PoS tagging based on Modern Standard Chinese text can achieve a precision of 83%; and by adding as little as 12,000-word annotated Classical Chinese texts, we were able to improve the precision to over 90%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Academia Sinica Tagged Corpus of Early Mandarin Chinese. http://app.sinica.edu.tw/cgi-bin/kiwi/pkiwi/kiwi.sh
Chang, C.-H., Chen, C.-D.: HMM-based part-or-speech tagging for Chinese corpora. In: Proceedings of the Workshop on Very Large Corpora, Columbus, OH, pp. 40–47, June 1993
Xiong, D., Lu, Q., Lo, F., Shi, D., Chiu, T.-S., Li, W.: Specification for segmentation and named entity annotation of chinese classics in the ming and qing dynasties. In: Ji, D., Xiao, G. (eds.) CLSW 2012. LNCS, vol. 7717, pp. 280–293. Springer, Heidelberg (2013)
Xiong, D., Lu, Q., Lo, F., Shi, D., Chiu, T.-S.: Quality assurance for segmentation and annotation of Chinese novels in the ming and qing dynasties. In: Proceedings of 2012 International Conference on Asian Language Processing (IALP 2012), November 13–15, 2012, Hanoi, Vietnam, pp. 77–80 (2012)
Ng, H.T., Low, J.K.: Chinese part-of-speech tagging: one-at-a-time or all-at-once? Word-based or character-based? In: EMNLP 2004, pp. 277–284 (2004)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 282–289. Morgan Kaufmann, San Francisco (2001)
Zhou, Q., Yu, S.: Blending segmentation with tagging in Chinese language corpus processing. In: COLING 1994, pp. 1274–1278 (1994)
Yu, S., Duan, H., Zhu, X., Swen, B., Chang, B.: Specification for Corpus Processing at Peking University: Word Segmentation, POS Tagging and Phonetic Notation. Journal of Chinese Language and Computing 13(2), 121–158 (2003). (in Chinese)
Chou, F.-C., Tseng, C.-Y., Chen, K.-J., Fen, Q.: A Chinese text-to-speech system based on part-of-speech analysis, prosodic modeling and non-uniform units. In: Proceedings of Acoustics, Speech, and Signal Processing, (ICASSP 1997), April 21–24 1997, vol. 2, Munich, pp. 923–926 (1997)
Schlunz, G.I., Barnard, E., van Huyssteen, G.B.: Part-of-speech effects on text-to-speech synthesis. In: 21st Annual Symposium of the Pattern Recognition Association of South Africa (PRASA), November 22–23 2010, pp. 257–262, Stellenbosch, South Africa (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Chiu, Ts., Lu, Q., Xu, J., Xiong, D., Lo, F. (2015). PoS Tagging for Classical Chinese Text. In: Lu, Q., Gao, H. (eds) Chinese Lexical Semantics. CLSW 2015. Lecture Notes in Computer Science(), vol 9332. Springer, Cham. https://doi.org/10.1007/978-3-319-27194-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-319-27194-1_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27193-4
Online ISBN: 978-3-319-27194-1
eBook Packages: Computer ScienceComputer Science (R0)