Abstract
We present a generic blind image quality assessment method that is able to detect common operations that affect image quality as well as estimate parameters of these operations (e.g. JPEG compression quality). For this purpose, we propose a CNN architecture for multi-label classification and integrate patch predictions to obtain continuous parameter estimates. We train this architecture using softmax layers that support multi-label classification and simultaneous training on multiple datasets with heterogeneous labels. Experimental results show that the resulting multi-label CNNs perform similarly to multiple individually trained CNNs while being several times more efficient, and that common image operations and their parameters can be estimated with high accuracy. Furthermore, we demonstrate that the learned features are discriminative for subjective image quality assessment, achieving state-of-the-art results on the LIVE2 dataset via transfer learning. The proposed CNN architecture supports any multi-label classification problem.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Assuming convolutions are implemented via matrix multiplication.
References
Bosse, S., Maniry, D., Wiegand, T., Samek, W.: A deep neural network for image quality assessment. In: IEEE International Conference on Image Processing, pp. 3773–3777 (2016)
Chen, M.-J., Bovik, A.C.: No-reference image blur assessment using multiscale gradient. EURASIP J. Image Video Process. 2011, 3 (2011)
Dang-Nguyen, D.-T., Pasquini, C., Conotter, V., Boato, G.: A raw images dataset for digital image forensics. In: ACM Multimedia Systems Conference, pp. 219–224 (2015)
Gong, Y., Jia, Y., Leung, T., Toshev, A., Ioffe, S.: Deep Convolutional Ranking for Multilabel Image Annotation. CoRR abs/1312.4894 (2013)
Ioffe, S., Szegedy, C.: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. CoRR abs/1502.03167 (2015)
Kang, L., Ye, P., Li, Y., Doermann, D.: Convolutional neural networks for no-reference image quality assessment. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1733–1740 (2014)
Li, C., Bovik, A.C., Wu, X.: Blind image quality assessment using a general regression neural network. IEEE Trans. Neural Netw. 22, 793–799 (2011)
Mittal, A., Soundararajan, R., Bovik, A.C.: Making a "Completely Blind" image quality analyzer. IEEE Signal Process. Lett. 20, 209–212 (2013)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: British Machine Vision Conference (2015)
Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15, 3440–3451 (2006)
Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR abs/1409.1556 (2014)
Wang, J., et al.: CNN-RNN: A unified framework for multi-label image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2285–2294 (2016)
Wei, Y., et al.: CNN: Single-label to Multi-label. CoRR abs/1406.5726 (2014)
Xue, W., Zhang, L., Mou, X.: Learning without human scores for blind image quality assessment. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 995–1002 (2013)
Zhang, P., Zhou, W., Wu, L., Li, H.: Semantic obviousness metric for image quality assessment. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2394–2402 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Pramerdorfer, C., Kampel, M. (2017). Deep Objective Image Quality Assessment. In: Felsberg, M., Heyden, A., Krüger, N. (eds) Computer Analysis of Images and Patterns. CAIP 2017. Lecture Notes in Computer Science(), vol 10425. Springer, Cham. https://doi.org/10.1007/978-3-319-64698-5_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-64698-5_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-64697-8
Online ISBN: 978-3-319-64698-5
eBook Packages: Computer ScienceComputer Science (R0)