Abstract
Chinese calligraphic images have important historical and artistic value, but natural weathering and man-made decay severely damage these works, thus image denoising is an important topic to be addressed. Traditional denoising methods still leave room for improvement. In this paper, image denoising is modeled as generation of clean image by using GAN (Goodfellow I et al. Advances in Neural Information Processing Systems 2672–2680, 2014) with an embedment of residual dense blocks (Zhang Y et al. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018) that was formerly used for super resolution reconstruction. Meanwhile, a new type of noise is defined to simulate the real noise, and is used for compensation of unpaired data in the training set for GAN. The new structure, used with some preprocessing and training methods, yield satisfactory results compared to known denoising methods.
Similar content being viewed by others
References
Abadi M, Barham P, Chen J et al (2016) Tensorflow: a system for large-scale machine learning. OSDI. 16:265–283
Arjovsky M, Chintala S, Bottou L (2017) Wasserstein generative adversarial networks. International Conference on Machine Learning:214–223
Dabov K, Foi A, Katkovnik V et al (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095
Gatys L A, Ecker A S, Bethge M (2016) Image style transfer using convolutional neural networks. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 2414–2423
Girshick R, Donahue J, Darrell T, et al (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587
Goodfellow I, Pouget-Abadie J, Mirza M et al (2014) Generative adversarial nets. Adv Neural Inf Proces Syst:2672–2680
Guemri K, Drira F (2014) Adaptative shock filter for image characters enhancement and denoising. Soft Computing and Pattern Recognition (SoCPaR), 2014 6th International Conference of. IEEE, pp. 279–283
Gulrajani I, Ahmed F, Arjovsky M et al (2017) Improved training of wasserstein gans. Adv Neural Inf Proces Syst:5767–5777
Huang G, Liu Z, Van Der Maaten L et al (2017) Densely Connected Convolutional Networks. CVPR. 1(2):3
Isola P, Zhu JY, Zhou T et al (2017) Image-To-Image Translation With Conditional Adversarial Networks. Proc IEEE Conf Comput Vis Pattern Recognit:1125–1134
Jiao J, Tu W C, He S, et al (2017) Formresnet: formatted residual learning for image restoration. 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, pp. 1034–1042
Kandemir C, Kalyoncu C, Toygar Ö (2015) A weighted mean filter with spatial-bias elimination for impulse noise removal. Digital Signal Processing 46:164–174
Kingma D P, Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
Krizhevsky A, Sutskever I, Hinton G E (2012) Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. pp. 1097–1105
Li C, Wand M (2016) Precomputed real-time texture synthesis with markovian generative adversarial networks. In: European Conference on Computer Vision. Springer, Cham, pp 702–716
Liu CL, Jaeger S, Nakagawa M (2004) Online recognition of Chinese characters: the state-of-the-art. IEEE Trans Pattern Anal Mach Intell 26(2):198–213
Liu CL, Yin F, Wang DH et al (2013) Online and offline handwritten Chinese character recognition: benchmarking on new databases. Pattern Recogn 46(1):155–162
Liu H, Zhou N (2012) An improved filtering algorithm based on median filtering algorithm and medium filtering algorithm. 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI), IEEE, pp. 574–578
Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. Proc ICML 30(1):3
Mao X, Li Q, Xie H, et al (2017) Least squares generative adversarial networks. 2017 IEEE International Conference on Computer Vision (ICCV). IEEE, pp. 2813–2821
Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784
Nguyen H T, Linh-Trung N (2010) The Laplacian pyramid with rational scaling factors and application on image denoising. 2010 10th International Conference on Information Sciences Signal Processing and their Applications (ISSPA), IEEE, pp. 468–471
Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241
Shi Z, Xu B, Zheng X et al (2016) An integrated method for ancient Chinese tablet images de-noising based on assemble of multiple image smoothing filters. Multimed Tools Appl 75(19):12245–12261
Shi Z, Xu B, Zheng X et al (2017) A Chinese character structure preserved denoising method for Chinese tablet calligraphy document images based on KSVD dictionary learning. Multimed Tools Appl 76(13):14921–14936
Ulyanov D, Vedaldi A, Lempitsky V. Instance Normalization: The Missing Ingredient for Fast Stylization. 2016.
Wang Z, Bovik AC, Sheikh HR et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang SZ, Lee HJ (2001) Dual-binarization and anisotropic diffusion of Chinese characters in calligraphy documents. Document Analysis and Recognition, 2001. Proceedings. Sixth International Conference on. IEEE, pp. 271–275
Wang L, Qian X, Zhang Y et al (2019) Enhancing Sketch-Based Image Retrieval by CNN Semantic Re-ranking. IEEE Transactions on Cybernetics
Zhang Y, Tian Y, Kong Y et al (2018) Residual dense network for image super-resolution. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Zhang K, Zuo W, Chen Y et al (2017) Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Trans Image Process 26(7):3142–3155
Zhong Z, Jin L, Xie Z (2015) High performance offline handwritten chinese character recognition using googlenet and directional feature maps. 2015 13th International Conference on Document Analysis and Recognition (ICDAR). IEEE, 846–850
Zhu JY, Park T, Isola P et al (2017) Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. IEEE International Conference on Computer Vision
Zhu L, Shen J, Xie L et al (2016) Unsupervised topic hypergraph hashing for efficient mobile image retrieval. IEEE Transactions on Cybernetics 47(11):3941–3954
Acknowledgements
This work is supported by the National Key Research and Development Plan(No.2017YFB1402103); Xi’an science and technology bureau project (201805037YD15CG21(6)); Beilin science and technology special project No. GX1917.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, J., Guo, M. & Fan, J. A novel generative adversarial net for calligraphic tablet images denoising. Multimed Tools Appl 79, 119–140 (2020). https://doi.org/10.1007/s11042-019-08052-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-08052-8