Abstract
Document image quality assessment (DIQA), which predicts the visual quality of the document images, can not only be applied to estimate document’s optical character recognition (OCR) performance prior to any actual recognition, but also provides immediate feedback on whether the documents meet the quality requirements for other high level document processing and analysis tasks. In this work, we present a deep neural network (DNN) to accomplish the DIQA task, where a Saimese based deep convolutional neural network (DCNN) is employed with customized losses to improve system’s capability of linearity and monotonicity to predict the quality of document images. Based on the proposed network along with the new losses, the obtained DCNN achieves the state-of-the-art quality assessment performance on the public datasets. The source codes and pre-trained models are available at https://gitlab.com/xujun.peng/DIQA-linearity-monotonicity.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alaei, A.: A new document image quality assessment method based on hast derivations. In: 15th International Conference on Document Analysis and Recognition (ICDAR), pp. 1244–1249 (2019)
Alaei, A., Conte, D., Martineau, M., Raveaux, R.: Blind document image quality prediction based on modification of quality aware clustering method integrating a patch selection strategy. Expert Syst. Appl. 108, 183–192 (2018)
Ba, J., Caruana, R.: Do deep nets really need to be deep? In: Advances in Neural Information Processing Systems, vol. 27, pp. 2654–2662 (2014)
Blando, L.R., Kanai, J., Nartker, T.A.: Prediction of OCR accuracy using simple image features. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 319–322 (1995)
Bui, Q.A., Molard, D., Tabbone, S.: Predicting mobile-captured document images sharpness quality. In: 13th IAPR International Workshop on Document Analysis Systems (DAS), pp. 275–280 (2018)
Cannon, M., Hochberg, J., Kelly, P.: Quality assessment and restoration of typewritten document images. Int. J. Doc. Anal. Recogn. 2(2), 80–89 (1999). https://doi.org/10.1007/s100320050039
Garg, R., Chaudhury, S.: Automatic selection of parameters for document image enhancement using image quality assessment. In: 12th IAPR Workshop on Document Analysis Systems (DAS), pp. 422–427 (2016)
Gorissen, D., Couckuyt, I., Demeester, P., Dhaene, T., Crombecq, K.: A surrogate modeling and adaptive sampling toolbox for computer based design. J. Mach. Learn. Res. 11, 2051–2055 (2010)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
Jiang, X., Shen, L., Yu, L., Jiang, M., Feng, G.: No-reference screen content image quality assessment based on multi-region features. Neurocomputing 386, 30–41 (2020)
Kang, L., Ye, P., Li, Y., Doermann, D.: A deep learning approach to document image quality assessment. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 2570–2574 (2014)
Kumar, J., Chen, F., Doermann, D.: Sharpness estimation for document and scene images. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3292–3295 (2012)
Kumar, J., Ye, P., Doermann, D.: A dataset for quality assessment of camera captured document images. In: Iwamura, M., Shafait, F. (eds.) CBDAR 2013. LNCS, vol. 8357, pp. 113–125. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-05167-3_9
Li, H., Zhu, F., Qiu, J.: CG-DIQA: no-reference document image quality assessment based on character gradient. In: 24th International Conference on Pattern Recognition (ICPR), pp. 3622–3626 (2018)
Li, H., Zhu, F., Qiu, J.: Towards document image quality assessment: a text line based framework and a synthetic text line image dataset. In: 15th International Conference on Document Analysis and Recognition (ICDAR), pp. 551–558 (2019)
Li, P., Peng, L., Cai, J., Ding, X., Ge, S.: Attention based RNN model for document image quality assessment. In: 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 01, pp. 819–825 (2017)
Lu, T., Dooms, A.: A deep transfer learning approach to document image quality assessment. In: 15th International Conference on Document Analysis and Recognition (ICDAR), pp. 1372–1377 (2019)
Ma, K., Liu, W., Liu, T., Wang, Z., Tao, D.: dipIQ: blind image quality assessment by learning-to-rank discriminable image pairs. IEEE Trans. Image Process. 26(8), 3951–3964 (2017)
Nayef, N., Luqman, M.M., Prum, S., Eskenazi, S., Chazalon, J., Ogier, J.: SmartDoc-QA: a dataset for quality assessment of smartphone captured document images - single and multiple distortions. In: 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 1231–1235 (2015)
Peng, X., Cao, H., Natarajan, P.: Document image OCR accuracy prediction via latent Dirichlet allocation. In: 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 771–775 (2015)
Peng, X., Cao, H., Natarajan, P.: Document image quality assessment using discriminative sparse representation. In: 12th IAPR Workshop on Document Analysis Systems (DAS), pp. 227–232 (2016)
Peng, X., Cao, H., Subramanian, K., Prasad, R., Natarajan, P.: Automated image quality assessment for camera-captured OCR. In: 18th IEEE International Conference on Image Processing, pp. 2621–2624 (2011)
Rai, P.K., Maheshwari, S., Gandhi, V.: Document quality estimation using spatial frequency response. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1233–1237 (2018)
Rai, P.K., Maheshwari, S., Mehta, I., Sakurikar, P., Gandhi, V.: Beyond OCRs for document blur estimation. In: 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 01, pp. 1101–1107 (2017)
Singh, P., Vats, E., Hast, A.: Learning surrogate models of document image quality metrics for automated document image processing. In: 13th IAPR International Workshop on Document Analysis Systems (DAS), pp. 67–72 (2018)
Souza, A., Cheriet, M., Naoi, S., Suen, C.Y.: Automatic filter selection using image quality assessment. In: Proceedings of Seventh International Conference on Document Analysis and Recognition, vol. 1, pp. 508–512 (2003)
Xu, J., Ye, P., Li, Q., Liu, Y., Doermann, D.: No-reference document image quality assessment based on high order image statistics. In: IEEE International Conference on Image Processing (ICIP), pp. 3289–3293 (2016)
Xu, L., Li, J., Lin, W., Zhang, Y., Zhang, Y., Yan, Y.: Pairwise comparison and rank learning for image quality assessment. Displays 44, 21–26 (2016)
Ye, P., Doermann, D.: Learning features for predicting OCR accuracy. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3204–3207 (2012)
Ye, P., Doermann, D.: Document image quality assessment: a brief survey. In: 12th International Conference on Document Analysis and Recognition, pp. 723–727 (2013)
Zagoruyko, S., Komodakis, N.: Learning to compare image patches via convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4353–4361 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Peng, X., Wang, C. (2020). Camera Captured DIQA with Linearity and Monotonicity Constraints. In: Bai, X., Karatzas, D., Lopresti, D. (eds) Document Analysis Systems. DAS 2020. Lecture Notes in Computer Science(), vol 12116. Springer, Cham. https://doi.org/10.1007/978-3-030-57058-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-57058-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-57057-6
Online ISBN: 978-3-030-57058-3
eBook Packages: Computer ScienceComputer Science (R0)