Specification for Segmentation and Named Entity Annotation of Chinese Classics in the Ming and Qing Dynasties

Abstract

The quality of text segmentation and annotation plays a significant role in Natural Language Processing especially in downstream applications. This paper presents the specification for word segmentation and named entity annotation targeted for novels in the Ming and Qing dynasties. The purpose of this work is to build the foundational work for computer-aided lexical semantic analysis of classical Chinese literature, especially the transition of Chinese literature from its traditional forms such as traditional verses and vernacular styles to modern Chinese. To assist in literature study, an elaborate named entity annotation scheme is specially developed for classical Chinese. Computer-aided segmentation and named entity annotation are conducted on some famous Ming and Qing Chinese classics. The specification for the segmentation and annotation is produced based on the studies of the morphology and semantics differences as well as similarities between classical Chinese and modern Chinese with reference to the existing standards for modern Chinese processing widely used in Mainland China and Taiwan.