Skip to main content
SpringerLink
Log in

Image Quality Assessment Using a Combination of Hand-Crafted and Deep Features

  • Conference paper
  • First Online:
Intelligent Technologies and Applications (INTAP 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1198))

Included in the following conference series:

Abstract

No-reference image quality assessment is an important area of research and has gained significant interest over the past years. Full-reference image quality assessment is not feasible in some scenarios where the reference image is not available. Hand-crafted features are statistics of natural scene images which are used to train a regression algorithm. Deep learning based approaches learn discriminatory features from images. This paper proposes a hybrid method to Image Quality Assessment (IQA) which uses combination of hand-crafted and deep features. The hand-crafted features are extracted in multi-scale and color space configuration in order to capture greater details. Deep features are extracted using transfer learning of Vgg19. Dimensionality reduction is achieved using principal component analysis and features with 95% variance are retained and a final feature set of 102 transformed features is obtained. Gaussian process regression using the squared exponential kernel is used for modeling. The final model is tested on seven benchmark databases for correlation of estimated image quality and mean of subjective score. A comparison with twelve state-of-the-art methods is performed and superior performance is achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ghadiyaram, D., et al.: Subjective and objective quality assessment of mobile videos with in-capture distortions. In: IEEE International Conference on Acoustics, Speech and Signal Processing (2017)

    Google Scholar 

  2. Wang, Z., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  3. Bosse, S., et al.: Deep neural networks for no-reference and full-reference image quality assessment. IEEE Trans. Image Process. 27(1), 206–219 (2017)

    Article  MathSciNet  Google Scholar 

  4. Ghadiyaram, D., Bovik, A.C.: Perceptual quality prediction on authentically distorted images using a bag of features approach. J. Vis. 17(1), 32 (2017)

    Article  Google Scholar 

  5. Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: The Thirty-Seventh Asilomar Conference on Signals, Systems & Computers, 2003. IEEE (2003)

    Google Scholar 

  6. Girod, B.: What’s wrong with mean-squared error? In: Watson, A.B. (ed.) Digital Images and Human Vision, pp. 207–220. MIT Press, Cambridge (1993)

    Google Scholar 

  7. Gao, F., et al.: DeepSim: deep similarity for image quality assessment. Neurocomputing 257, 104–114 (2017)

    Article  Google Scholar 

  8. Pei, S.-C., Chen, L.-H.: Image quality assessment using human visual DOG model fused with random forest. IEEE Trans. Image Process. 24(11), 3282–3292 (2015)

    Article  MathSciNet  Google Scholar 

  9. Reisenhofer, R., et al.: A Haar wavelet-based perceptual similarity index for image quality assessment. Signal Process. Image Commun. 61, 33–43 (2018)

    Article  Google Scholar 

  10. Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)

    Article  MathSciNet  Google Scholar 

  11. Moorthy, A.K., Bovik, A.C.: A two-step framework for constructing blind image quality indices. IEEE Signal Process. Lett. 17(5), 513–516 (2010)

    Article  Google Scholar 

  12. Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)

    Article  MathSciNet  Google Scholar 

  13. Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)

    Article  MathSciNet  Google Scholar 

  14. Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)

    Article  Google Scholar 

  15. Ghadiyaram, D., Bovik, A.C.: Feature maps driven no-reference image quality prediction of authentically distorted images. In: Human Vision and Electronic Imaging XX. International Society for Optics and Photonics (2015)

    Google Scholar 

  16. Ye, P., Doermann, D.: No-reference image quality assessment using visual codebooks. IEEE Trans. Image Process. 21(7), 3129–3138 (2012)

    Article  MathSciNet  Google Scholar 

  17. Zhang, L., et al.: Training quality-aware filters for no-reference image quality assessment. IEEE Multimedia 21(4), 67–75 (2014)

    Article  Google Scholar 

  18. Kang, L., et al.: Convolutional neural networks for no-reference image quality assessment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2014)

    Google Scholar 

  19. Kim, J., Lee, S.: Fully deep blind image quality predictor. IEEE J. Sel. Top. Sign. Process. 11(1), 206–220 (2017)

    Article  Google Scholar 

  20. Xu, J., et al.: Local feature aggregation for blind image quality assessment. In: Visual Communications and Image Processing (VCIP), 2015. IEEE (2015)

    Google Scholar 

  21. Bianco, S., et al.: On the use of deep learning for blind image quality assessment. SIViP 12(2), 355–362 (2018)

    Article  Google Scholar 

  22. Ma, K., et al.: dipIQ: blind image quality assessment by learning-to-rank discriminable image pairs. IEEE Trans. Image Process. 26(8), 3951–3964 (2017)

    Article  MathSciNet  Google Scholar 

  23. Xue, W., et al.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)

    Article  MathSciNet  Google Scholar 

  24. Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)

    Article  MathSciNet  Google Scholar 

  25. Xu, J., et al.: Blind image quality assessment based on high order statistics aggregation. IEEE Trans. Image Process. 25(9), 4444–4457 (2016)

    Article  MathSciNet  Google Scholar 

  26. ITU-T RECOMMENDATION P. Subjective video quality assessment methods for multimedia applications. International telecommunication union (1999)

    Google Scholar 

  27. Liu, L., et al.: Blind image quality assessment by relative gradient statistics and AdaBoosting neural network. Signal Process. Image Commun. 40, 1–15 (2016)

    Article  Google Scholar 

  28. Shlens, J.: A tutorial on principal component analysis. arXiv preprint arXiv:1404.1100 (2014)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, UET Lahore, Lahore, Pakistan

    Nisar Ahmed & Hafiz Muhammad Shahzad Asif

  2. Pakistan Space and Upper Atmosphere Research Commission, Karachi, Pakistan

    Hassan Khalid

Authors
  1. Nisar Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hafiz Muhammad Shahzad Asif
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hassan Khalid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nisar Ahmed .

Editor information

Editors and Affiliations

  1. Islamia University of Bahawalpur, Baghdad, Pakistan

    Imran Sarwar Bajwa

  2. Metropolitan University, Belgrade, Serbia

    Tatjana Sibalija

  3. University of Technology Malaysia, Johor Bahru, Malaysia

    Dayang Norhayati Abang Jawawi

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ahmed, N., Asif, H.M.S., Khalid, H. (2020). Image Quality Assessment Using a Combination of Hand-Crafted and Deep Features. In: Bajwa, I., Sibalija, T., Jawawi, D. (eds) Intelligent Technologies and Applications. INTAP 2019. Communications in Computer and Information Science, vol 1198. Springer, Singapore. https://doi.org/10.1007/978-981-15-5232-8_51

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-5232-8_51

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-5231-1

  • Online ISBN: 978-981-15-5232-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation