Abstract
Ancient minority language character recognition could be challenging due to limited documentation, but it is always critical to better understand history and conduct social science researches. As an important minority language, Manchu language is confronted with the similar challenges due to the lack of systematic document studies. Recently, more researches focus on solving this problem through different approaches, such as document digitalization or character image segmentation. However, there are still some limitations. On one hand, existing digitalized Manchu documents are carried out based upon machine-printed style, which is not common in real historical documents and can cause severe recognition bias. On the other hand, most of Manchu identification methods are based on coarse image segmentation and may result in recognition error since it is difficult to consistently cut the words accurately. To tackle these two challenges, we propose a segmentation-free method for Manchu recognition with a medium scale dataset of Woodblock-printed Manchu Words (WMW). We first develop WMW based-upon woodblock-printed Manchu words, which are more common in ancient documents. With the developed dataset, we conduct document mining and carry out a framework, namely AMRE, with Attention-based Convolutional Recurrent Neural Network. AMRE leverages attention mechanism by weighted aggregation of the convolution results from differently sized kernels and more effectively mine the valid information of morphed words in recognition process. By implementing our proposed AMRE, the digitalized characters can be more accurately recognized. The experiment results show that the word recognition accuracy of AMRE exceeds the baseline by more than 5\(\%\).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shivakumara, P., Phan, T.Q., Tan, C.L.: A gradient difference based technique for video text detection. In: 2009 10th International Conference on Document Analysis and Recognition, pp. 156–160. IEEE (2009)
Mosleh, A., Bouguila, N., Hamza, A.B.: Image text detection using a bandlet-based edge detector and stroke width transform. In: BMVC, pp. 1–12 (2012)
Pan, Y.F., Hou, X., Liu, C.L.: A hybrid approach to detect and localize texts in natural scene images. IEEE Trans. Image Process. 20(3), 800–813 (2010)
Ye, Q., Huang, Q., Gao, W., et al.: Fast and robust text detection in images and video frames. Image Vis. Comput. 23(6), 565–576 (2005)
Rodríguez-Serrano, J.A., Perronnin, F.: A model-based sequence similarity with application to handwritten word spotting. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2108–2120 (2012)
Wang, D., Li, Y., Wang, L., Gong, B.: Neural networks are more productive teachers than human raters: active mixup for data-efficient knowledge distillation from a blackbox model. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1498–1507 (2020)
Wang, D., Zhang, S., Wang, L.: Deep epidemiological modeling by black-box knowledge distillation: an accurate deep learning model for COVID-19. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 17, pp. 15424–15430 (2021)
Wang, D., Liu, Q., Wu, D., et al.: Meta domain generalization for smart manufacturing: tool wear prediction with small data. J. Manuf. Syst. 62, 441–449 (2022)
Yang, Y., Xing, W., Wang, D., et al.: AEVRNet: adaptive exploration network with variance reduced optimization for visual tracking. Neurocomputing 449, 48–60 (2021)
Wei, X., Wei, X., Kong, X., et al.: FMixCutMatch for semi-supervised deep learning. Neural Netw. 133, 166–176 (2021)
Lu, S., Rao, B.B., Wei, X., et al.: Log-based abnormal task detection and root cause analysis for spark. In: 2017 IEEE International Conference on Web Services (ICWS), pp. 389–396. IEEE (2017)
Lu, S., Wei, X., Rao, B., et al.: LADRA: log-based abnormal task detection and root-cause analysis in big data processing with Spark. Future Gener. Comput. Syst. 95, 392–403 (2019)
Yao, J., Wang, D., Hu, H., Xing, W., Wang, L.: ADCNN: towards learning adaptive dilation for convolutional neural networks. Pattern Recogn. 123, 108369 (2022)
Yao, J., Xing, W., Wang, D., Xing, J., Wang, L.: Active dropblock: method to enhance deep model accuracy and robustness. Neurocomputing 454, 189–200 (2021)
Shi, B., Yang, M., Wang, X., et al.: ASTER: an attentional scene text recognizer with flexible rectification. IEEE Trans. Pattern Anal. Mach. Intell. 41(9), 2035–2048 (2018)
Xu, Y., Wang, Y., Zhou, W., et al.: TextField: learning a deep direction field for irregular scene text detection. IEEE Trans. Image Process. 28(11), 5566–5579 (2019)
Kang, Y., Wei, H., Zhang, H., et al.: Woodblock-printing Mongolian words recognition by bi-LSTM with attention mechanism. In: 2019 International Conference on Document Analysis and Recognition (ICDAR), pp. 910–915. IEEE (2019)
Wei, H., Gao, G.: A holistic recognition approach for woodblock-print Mongolian words based on convolutional neural network. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 2726–2730. IEEE (2019)
Kass, D., Vats, E.: AttentionHTR: handwritten text recognition based on attention encoder-decoder networks. arXiv preprint arXiv:2201.09390 (2022)
Mei, J., Dai, L., Shi, B., et al.: Scene text script identification with convolutional recurrent neural networks. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 4053–4058. IEEE (2016)
Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(11), 2298–2304 (2016)
Graves, A., Fernández, S., Gomez, F., et al.: Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 369–376 (2006)
Liao, M., Shi, B., Bai, X., et al.: TextBoxes: a fast text detector with a single deep neural network. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)
Liao, M., Shi, B., Bai, X.: TextBoxes++: a single-shot oriented scene text detector. IEEE Trans. Image Process. 27(8), 3676–3690 (2018)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)
Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Jiang, Y., Jiang, Z., He, L., et al.: Text recognition in natural scenes based on deep learning. Multimedia Tools Appl. 81(8), 10545–10559 (2022). https://doi.org/10.1007/s11042-022-12024-w
Cui, S.D., Su, Y.L., Ji, Y.T.: An end-to-end network for irregular printed Mongolian recognition. Int. J. Doc. Anal. Recogn. (IJDAR) 25, 41–50 (2022). https://doi.org/10.1007/s10032-021-00388-y
Zhang, G., Li, J., Wang, A.: A new recognition method for the handwritten Manchu character unit. In: 2006 International Conference on Machine Learning and Cybernetics, pp. 3339–3344. IEEE (2006)
Xu, S., Qi, G.Q., Li, M., et al.: An improved Manchu character recognition method (2016)
Li, M., Zheng, R., Xu, S., et al.: Manchu word recognition based on convolutional neural network with spatial pyramid pooling. In: 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1–6. IEEE (2018)
Acknowledgement
This research was supported by NSF of China (62006016).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, Z., Lu, S., Wang, M., Wei, X., Qi, Y. (2023). AMRE: An Attention-Based CRNN for Manchu Word Recognition on a Woodblock-Printed Dataset. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Lecture Notes in Computer Science, vol 13624. Springer, Cham. https://doi.org/10.1007/978-3-031-30108-7_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-30108-7_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30107-0
Online ISBN: 978-3-031-30108-7
eBook Packages: Computer ScienceComputer Science (R0)