Abstract
Named entity recognition in inherent-vowel alphabetic languages such as Burmese, Khmer, Lao, Tamil, Telugu, Bali, and Thai, is difficult since there are no explicit boundaries among words or sentences. This paper presents a novel method to exploit the concept of character clusters, a sequence of inseparable characters, to group characters into clusters, utilize statistics among characters and their clusters to extract Thai words and then recognize named entities, simultaneously. Integrated of two phases, the word-segmentation model and the named-entity-recognition model, context features are exploited to learn parameters for these two discriminative probabilistic models, i.e., CRFs, to rank a set of word and named entity candidates generated. The experimental result shows that our method significantly increases the performance of segmenting word and recognizing entities with the F-measure of 96.14% and 83.68%, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Daniels, P.T., Bright, W.: The World’s Writing Systems. Oxford University Press (1996)
Huor, C.S., Rithy, T., Hemy, R.P., Navy, V.: Detection and correction of homophonous error word for khmer language (2006), http://www.panl10n.net/english/outputs/Working%20Papers/Cambodia/Microsoft%20Word%20-%204_E_N_248.pdf
Koanantakool, T.H., Karoonboonyanan, T., Wutiwiwatchai, C.: Computers and the thai language. IEEE Ann. Hist. Comput. 31(1), 46–61 (2009)
Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: ICML 2001: Proceedings of the 18th Int’l Conference on Machine Learning, pp. 282–289. Morgan Kaufmann Publishers Inc., San Francisco (2001)
Li, L., Zhou, R., Huang, D.: Two-phase biomedical named entity recognition using crfs. Computational Biology and Chemistry 33(4), 334–338 (2009), http://www.sciencedirect.com/science/article/B73G2-4WRD3DM-1/2/c56643f1540c4e379d80119594d7a799
Liu, D.C., Nocedal, J.: On the limited memory bfgs method for large scale optimization. Math. Program. 45(3), 503–528 (1989)
Nadeau, D., Sekine, S.: A survey of named entity recognition and classification. Linguisticae Investigationes 30(1), 3–26 (2007), http://www.ingentaconnect.com/content/jbp/li/2007/00000030/00000001/art00002
Okazaki, N.: Crfsuite: A fast implementation of conditional random fields (crfs) (2007), http://www.chokkan.org/software/crfsuite/
Theeramunkong, T., Boriboon, M., Haruechaiyasak, C., Kittiphattanabawon, N., Kosawat, K., Onsuwan, C., Siriwat, I., Suwanapong, T., Tongtep, N.: THAI-NEST: A Framework for Thai Named Entity Tagging Specification and Tools. In: CILC 2010: Proceedings of the 2nd Int’l Conference on Corpus Linguistics (CILC 2010), May 13-15, pp. 895–908 (2010)
Theeramunkong, T., Sornlertlamvanich, V., Tanhermhong, T., Chinnan, W.: Character cluster based thai information retrieval. In: IRAL 2000: Proceedings of the 5th Int’l Workshop on Information Retrieval with Asian Languages, pp. 75–80. ACM, New York (2000)
Thet, T.T., Jin-Cheon, N., Ko, W.K.: Word segmentation for the myanmar language. J. Inf. Sci. 34(5), 688–704 (2008)
Tongtep, N., Theeramunkong, T.: A Feature-Based Approach for Relation Extraction from Thai News Documents. In: Chen, H., Yang, C.C., Chau, M., Li, S.-H. (eds.) PAISI 2009. LNCS, vol. 5477, pp. 149–154. Springer, Heidelberg (2009)
Tongtep, N., Theeramunkong, T.: Pattern-based Extraction of Named Entities in Thai News Documents. Thammasat International Journal of Science and Technology 15(1), 70–81 (2010)
Whitelaw, C., Patrick, J.: Named entity recognition using a character-based probabilistic approach. In: Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL 2003, pp. 196–199. ACL, Morristown (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tongtep, N., Theeramunkong, T. (2011). Simultaneous Character-Cluster-Based Word Segmentation and Named Entity Recognition in Thai Language. In: Theeramunkong, T., Kunifuji, S., Sornlertlamvanich, V., Nattee, C. (eds) Knowledge, Information, and Creativity Support Systems. Lecture Notes in Computer Science(), vol 6746. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24788-0_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-24788-0_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24787-3
Online ISBN: 978-3-642-24788-0
eBook Packages: Computer ScienceComputer Science (R0)