Abstract
Chinese spell checking is an important research topic, and it is needed in several applications, such as optical character recognition, speech recognition, and search engines. Due to the specialties of Chinese characters, such as shape and pronunciation similarity, it is still a problem for the computer to detect and correct Chinese spell errors automatically. In this paper, we propose a hybrid approach to detecting and correcting a common class of Chinese word errors, called auxiliary word errors. First, to address the lack of dataset containing Chinese auxiliary errors, we generate artificial dataset of auxiliary errors by an auxiliary confusion set and a large Web corpus. Second, we propose a neural network detection model which adopts BERT as the embedding layer, and combines BiLSTM with CRF. Third, we utilize an auxiliary confusion set and a recurrent neural network language model (RNNLM) to correct auxiliary errors in text. Experimental results on different test datasets show our hybrid approach achieves better performance than traditional baseline methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chang, C.H.: A new approach for automatic Chinese spelling correction. In: Proceedings of Natural Language Processing Pacific Rim Symposium, pp. 278–283 (1995)
Ren, F., Shi, H., Zhou, Q.: A hybrid approach to automatic Chinese text checking and error correction. In: 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat. No. 01CH37236), pp. 1693–1698 (2001)
Huang, C.M., Mei-Chen, W., Chang, C.C.: Error detection and correction based on Chinese phonemic alphabet in Chinese text. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) Modeling Decisions for Artificial Intelligence, pp. 463–476. Springer, Berlin, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73729-2_44
Chiu, H.W., Wu, J.C., Chang, J.S.: Chinese spelling checker based on statistical machine translation. In: Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, pp. 49–53 (2013)
Jia, Z., Wang, P., Zhao, H.: Graph model for Chinese spell checking. In: Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, pp. 88–92 (2013)
Han, D., Chang, B.: A maximum entropy approach to Chinese spelling check. In: Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, pp. 74–78 (2013)
Yu, J., Li, Z.: Chinese spelling error detection and correction based on language model, pronunciation, and shape. In: Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 220–223 (2014)
Yeh, J.F., Lu, Y.Y., Lee, C.H., Yu, Y.H., Chen, Y.T.: Chinese word spelling correction based on rule induction. In: Proceedings of The Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 139–145 (2014)
Lin, C.J., Chu, W.C.: A study on Chinese spelling check using confusion sets and N-gram statistics. Int. J. Comput. Linguist. Chin. Langu. Process. 20(1), 23–48 (2015)
Yeh, J.F., Chang, L.T., Liu, C.Y., Hsu, T.W.: Chinese spelling check based on n-gram and string matching algorithm. In: Proceedings of the 4th Workshop on Natural Language Processing Techniques for Educational Applications, pp. 35–38 (2017)
Yu, C.H., Chen, H.H.: Detecting word ordering errors in Chinese sentences for learning Chinese as a foreign language. In: Proceedings of COLING, pp. 3003–3018 (2012)
Wang, Y.R., Liao, Y.F., Wu, Y.K., Chang, L.C.: Conditional random field-based parser and language model for traditional Chinese spelling checker. In: Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, pp. 69–73 (2013)
Chiu, H.W., Wu, J.C., Chang, J.S.: Chinese spell checking based on noisy channel model. In: Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 202–209 (2014)
Devlin, J., et al.: BERT: pre-training of deep bidirectional transformers for language understanding. CoRR abs/1810.04805 (2018)
Zaremba, W., Sutskever, I., Vinyals, O.: Recurrent neural network regularization. In: Proceedings of International Conference on Learning Representations 2015, pp. 1310–1318, San Diego, California (2015)
Jelinek, F.: Statistical Methods for Speech Recognition. MIT press, USA (1998)
Mikolov, Tomáš, et al.:Recurrent neural network based language model. In: Eleventh Annual Conference of the International Speech Communication Association, pp. 1045–1048 (2010)
Liu, L., Cao, C.: A seed-based method for generating Chinese confusion sets. ACM Trans. Asian Low-Resour. Lang. Inf. Process. (TALLIP) 16(1), 1–16 (2016). https://doi.org/10.1145/2933396
Yu, L.C., Lee, L.H., Tseng, Y.H., Chen, H.H.: Overview of SIGHAN 2014 bake-off for Chinese spelling check. In: Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 126–132 (2014)
Tseng, Y.H., Lee, L.H., Chang, L.P., Chen, H.H.: Introduction to SIGHAN 2015 bake-off for Chinese spelling check. In: Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing, pp. 32–37(2015)
Lafferty, J., McCallum, A., Pereira, F.C.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th International Conference on Machine Learning, vol. 951, pp. 282–289 (2001)
Huang, Z., Xu, W., Yu, K.: Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 (2015)
Chiu, J.P., Nichols, E.: Named entity recognition with bidirectional LSTM-CNNs. Trans. Assoc. Comput. Linguist. 4, 357–370 (2016)
Acknowledgements
The work are supported by the National Key Research and Development Program of China (Grants no. 2017YFC1700302 and 2017YFB1002300) and Beijing NOVA Program (Cross‐discipline, grant no. 191100001119014).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Cao, Y., Wang, S. (2021). An Efficient Hybrid Approach to Detecting and Correcting Auxiliary Word Errors in Chinese Text. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management. KSEM 2021. Lecture Notes in Computer Science(), vol 12817. Springer, Cham. https://doi.org/10.1007/978-3-030-82153-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-82153-1_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82152-4
Online ISBN: 978-3-030-82153-1
eBook Packages: Computer ScienceComputer Science (R0)