Abstract
In digital paleography, recent technology advancements are used to support paleographers in the study and analysis of ancient documents. One main goal of paleographers is to identify the different scribes (writers) who wrote a given manuscript. Deep learning has recently been applied to many domains. However, in order to overcome its requirement of large amount of labeled data, transfer learning have been used. This approach typically uses previously trained large deep networks as starting points to solve specific classification problems. In this paper, we present a two step deep transfer learning based tool to help paleographers identify the parts of a manuscript that were written by the same writer. The suggested approach has been tested on a set of digital images from a Bible of the XII century. The achieved results confirmed the effectiveness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Afzal, M.Z., et al.: Deepdocclassifier: document classification with deep convolutional neural network. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 1111–1115, August 2015
Antonacopoulos, A., Downton, A.C.: Special issue on the analysis of historical documents. IJDAR 9(2–4), 75–77 (2007)
Bria, A., Marrocco, C., Karssemeijer, N., Molinara, M., Tortorella, F.: Deep cascade classifiers to detect clusters of microcalcifications. In: Tingberg, A., Lång, K., Timberg, P. (eds.) IWDM 2016. LNCS, vol. 9699, pp. 415–422. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41546-8_52
Bria, A., et al.: Improving the automated detection of calcifications by combining deep cascades and deep convolutional nets. In: Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 10718 (2018)
Bria, A., Marrocco, C., Molinara, M., Tortorella, F.: A ranking-based cascade approach for unbalanced data. In: 2012 21st International Conference on Pattern Recognition (ICPR), pp. 3439–3442. IEEE (2012)
Ciresan, D.C., Meier, U., Schmidhuber, J.: Transfer learning for Latin and Chinese characters with deep neural networks. In: The 2012 International Joint Conference on Neural Networks (IJCNN), pp. 1–6 (2012)
De-Stefano, C., Maniaci, M., Fontanella, F., Scotto di Freca, A.: Reliable writer identification in medieval manuscripts through page layout features: the “avila” bible case. Eng. Appl. Artif. Intell. 72, 99–110 (2018)
De Stefano, C., Maniaci, M., Fontanella, F., Scotto di Freca, A.: Layout measures for writer identification in mediaeval documents. Measurement 127, 443–452 (2018)
De Stefano, C., Fontanella, F., Maniaci, M., Scotto di Freca, A.: A method for scribe distinction in medieval manuscripts using page layout features. In: Maino, G., Foresti, G.L. (eds.) ICIAP 2011. LNCS, vol. 6978, pp. 393–402. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-24085-0_41
De Stefano, C., Fontanella, F., Maniaci, M., Scotto di Freca, A.: Exploiting page layout features for scribe distinction in medieval manuscripts. In: Proceedings of the 15th International Graphonomics Society Conference (IGS 2011). pp. 106–109 (2011)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Li, F.F.: Imagenet: a large-scale hierarchical image database. In: CVPR, pp. 248–255. IEEE Computer Society (2009). http://dblp.uni-trier.de/db/conf/cvpr/cvpr2009.html#DengDSLL009
Granet, A., Morin, E., Mouchère, H., Quiniou, S., Viard-Gaudin, C.: Transfer learning for handwriting recognition on historical documents. In: International Conference on Pattern Recognition Applications and Methods. Madeira, Portugal, January 2018. https://hal.archives-ouvertes.fr/hal-01681126
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CoRR abs/1512.03385 (2015). http://dblp.uni-trier.de/db/journals/corr/corr1512.html#HeZRS15
Kölsch, A., Mishra, A., Varshneya, S., Liwicki, M.: Recognizing challenging handwritten annotations with fully convolutional networks. CoRR abs/1804.00236 (2018). http://arxiv.org/abs/1804.00236
Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48
Ni, K., Callier, P., Hatch, B.: Writer identification in noisy handwritten documents. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). vol. 00, pp. 1177–1186, March 2017. doi.ieeecomputersociety.org/10.1109/WACV.2017.136
Oliveira, S.A., Seguin, B., Kaplan, F.: dhsegment: a generic deep-learning approach for document segmentation. CoRR abs/1804.10371 (2018). http://arxiv.org/abs/1804.10371
Russakovsky, O., et al.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vision 115(3), 211–252 (2015)
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.C.: Mobilenetv 2: inverted residuals and linear bottlenecks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018
Simistira, F., Seuret, M., Eichenberger, N., Garz, A., Liwicki, M., Ingold, R.: Diva-hisdb: a precisely annotated large dataset of challenging medieval manuscripts. In: 2016 15th International Conference on Frontiers in Handwriting Recognition(ICFHR), vol. 00, pp. 471–476, October 2016
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014). http://dblp.uni-trier.de/db/journals/corr/corr1409.html#SimonyanZ14a
Szegedy, C., Ioffe, S., Vanhoucke, V.: Inception-v4, inception-resnet and the impact of residual connections on learning. CoRR abs/1602.07261 (2016). http://dblp.uni-trier.de/db/journals/corr/corr1602.html#SzegedyIV16
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015). http://dblp.uni-trier.de/db/journals/corr/corr1512.html#SzegedyVISW15
Trovini, G., et al.: A deep learning framework for micro-calcification detection in 2D mammography and c-view. In: Progress in Biomedical Optics and Imaging - Proceedings of SPIE, vol. 10718 (2018)
Tushar, A.K., Ashiquzzaman, A., Afrin, A., Islam, M.R.: A novel transfer learning approach upon Hindi, Arabic, and Bangla numerals using convolutional neural networks. CoRR abs/1707.08385 (2017). http://arxiv.org/abs/1707.08385
Zoph, B., Vasudevan, V., Shlens, J., Le, Q.V.: Learning transferable architectures for scalable image recognition. CoRR abs/1707.07012 (2017). http://dblp.uni-trier.de/db/journals/corr/corr1707.html#ZophVSL17
Acknowledgment
The authors gratefully acknowledge the support of NVIDIA Corporation for the donation of the Titan Xp GPUs.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Cilia, N.D., De Stefano, C., Fontanella, F., Marrocco, C., Molinara, M., Scotto Di Freca, A. (2019). A Two-Step System Based on Deep Transfer Learning for Writer Identification in Medieval Books. In: Vento, M., Percannella, G. (eds) Computer Analysis of Images and Patterns. CAIP 2019. Lecture Notes in Computer Science(), vol 11679. Springer, Cham. https://doi.org/10.1007/978-3-030-29891-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-29891-3_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29890-6
Online ISBN: 978-3-030-29891-3
eBook Packages: Computer ScienceComputer Science (R0)