Skip to main content
SpringerLink
Log in

A no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

For majorities of no-reference image quality assessment (NRIQA) algorithms, prior knowledge about image distortion types is needed. However, the source distortions in the image are actually not given in most cases. In this paper, we propose a no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics without any prior knowledge about the distortions of the original image. Because the means of (\(\log _{2}\) of) subband coefficient amplitudes (MLSCAs) of the natural images have certain statistical properties independent of their contents, a predicted MLSCAs based on these properties can be considered as a reference index for assessment. A subband distortion is then defined as the difference between the reference and the real MLSCA of the distorted image. As against most NRIQA algorithms that are distortion specific, the subband distortion determined is independent of distortion types. Therefore, the proposed method is capable of assessing the quality of a distorted image across multiple distortion categories without any prior knowledge about the distortions of the original image. Finally, a set of weights for each subband, trained from the subjective mean opinion scores in the LIVE image database, is used to combine the subband distortions into a quality score for evaluating the distorted images. Experimental results show that the proposed method outperforms five no-reference algorithms using natural scene statistics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Wu HR, Rao KR (2006) Digital video image quality and perceptual coding. CRC Press, Boca Raton

    Google Scholar 

  2. Lin W, Kuo CCJ (2011) Perceptual visual quality metrics: a survey. J Vis Commun Image Represent 22:297–312

    Article  Google Scholar 

  3. Chikkerur S, Sundaram V, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans Broadcast 57:165–182

    Article  Google Scholar 

  4. Liu M, Yang X (2008) Image quality assessment by decision fusion. IEICE Electron Express 5(15):537–542

    Article  Google Scholar 

  5. Angelis AD, Moschitta A, Russo F, Carbone P (2009) A vector approach for image quality assessment and some metrological considerations. IEEE Trans Instrum Meas 58(1):14–25

    Article  Google Scholar 

  6. Aznaveh AM, Mansouri A, Azar FT, Eslami M (2009) Image quality measurement besides distortion type classifying. Opt Rev 16(1):30–34

    Article  Google Scholar 

  7. Laparra V, Munoz-Mari J, Malo J (2010) Divisive normalization image quality metric revisited. J Opt Soc of Am A 27(4):852–864

    Article  Google Scholar 

  8. Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. J Electron Imaging 19(1):011006-1–011006-21

    Google Scholar 

  9. Lu F, Zhao Q, Yang G (2010) Color image quality assessment based on structural similarity. J Donghua Univ (Eng Ed) 27(4):443–450

    Google Scholar 

  10. Lubin J (1993) The use of psychophysical data and models in the analysis of display system performance. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 163–178

    Google Scholar 

  11. Daly S (1993) The visible differences predictor: an algorithm for the assessment of image fidelity. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 179–206

    Google Scholar 

  12. Teo PC, Heeger DJ (1994) Perceptual image distortion. In: Proceedings of IEEE international conference on image processing, pp 982–986

  13. Winkler S (2000) Vision models and quality metrics for image processing applications. Ph.D., EPFL-PSE

  14. Yu Z, Wu HR, Winkler S, Chen T (2002) Vision model based impairment metric to evaluate blocking artifacts in digital video. In: Proceedings of the IEEE, vol 90, pp 154–169

  15. Wang Z, Simoncelli EP (2005) Reduced-reference image quality assessment using a wavelet-domain natural image statistics model. In: Proceedings of the IS&T/SPIE’s 17th annual symposium on electronic imaging, vol 5666, pp 149–159

  16. Gao X, Lu W, Tao D, Li X (2009) Image quality assessment based on multiscale geometric analysis. IEEE Trans Image Process 18(7):1409–1423

    Article  MathSciNet  Google Scholar 

  17. Wu HR, Yuen M (1997) A generalized block-edge impairment metric (GBIM) for video coding. IEEE Signal Process Lett 4:317–320

    Article  Google Scholar 

  18. Wang Z, Sheikh HR, Bovik AC (2002) No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of the IEEE international conference on image processing, pp I-477–I-480

  19. Sheikh HR, Bovik AC, Cormack L (2005) No-reference quality assessment using natural scene statistics: JPEG2000. IEEE Trans Image Process 14(11):1918–1927

    Article  Google Scholar 

  20. Romberg JK (2003) Multiscale geometric image processing. PhD dissertation, Dept Elect Comput Eng, Rice Univ, Houston, TX

  21. Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation. In: Proceedings of the IEEE international conference on image processing, Washington DC, pp 444–447

  22. Candes EJ, Donoho DL (2000) Curvelets—a surprizingly effective nonadaptive representation for objects with edges. In: Cohen A, Rabut C, Schumaker LL (eds) Curve and surface fitting. Vanderbuilt University Press, Nashville, pp 105–120

    Google Scholar 

  23. Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106

    Article  MathSciNet  Google Scholar 

  24. Cunha AL, Zhou J, Do MN (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE Trans Image Process 15(10):3089–3101

    Article  Google Scholar 

  25. Lu W, Zeng K, Tao D, Yuan Y, Gao X (2010) No-reference image quality assessment in contourlet domain. Neurocomputing 73:784–794

    Article  Google Scholar 

  26. Sheikh HR, Wang Z, Cormack L, Bovik AC (2006) LIVE image quality assessment database, Release 2. http://live.ece.utexas.edu/research/quality/

  27. Coifman RR, Donoho DL (1995) Translation invariant de-noising. In: Antoniadis A, Oppenheim G (eds) Wavelets and statistics. Springer, Berlin, pp 125–150

    Chapter  Google Scholar 

  28. Lu F, Zhao Q, Yang G (2011) Nonsubsampled contourlet transform based algorithm for no-reference image quality assessment. Opt Eng 50(6):067010-1–067010-10

    Article  Google Scholar 

  29. Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516

    Article  Google Scholar 

  30. Saad MA, Bovik AC, Charrier C (2010) A DCT statistics-based blind image quality index. IEEE Signal Process Lett 17(6):583–586

    Article  Google Scholar 

  31. Mittal A, Moorthy A, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708

  32. Ye P, Doermann D (2012) No-reference image quality assessment using visual codebooks. IEEE Trans Image Process 21:3129–3138

    Article  MathSciNet  Google Scholar 

  33. Li Z (1998) A neural model of contour in integration in the primary visual cortex. Neural Comput 10(4):903–940

    Article  Google Scholar 

  34. Watson AB (1998) Toward a perceptual video quality metric. In: Proceedings of the SPIE conference on human vision electronic imaging III, vol 3299, pp 139–147

  35. Olshausen BA, Field DJ (2005) How close are we to understanding V1? Neural Comput 17(8):1665–1699

    Article  MATH  Google Scholar 

  36. Freeman WT, Adelson EH (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906

    Article  Google Scholar 

  37. Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ (1992) Shiftable multiscale transforms. IEEE Trans Inf Theory 38:587–607

    Article  MathSciNet  Google Scholar 

  38. Portilla J, Simoncelli EP (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40:49–70

    Article  MATH  Google Scholar 

  39. Montoya-Zegarra JA, Leite NJ, Torres RdaS (2007) Rotation-invariant and scale-invariant steerable pyramid decomposition for texture image retrieval. In: SIBGRAPI 2007. XX Brazilian symposium on computer graphics and image processing, Minas Gerais, pp 121–128

  40. Fliegel K (2007) Perceptual assessment of image quality in multimedia technology. In: Proceedings of SPIE, mathematics of data/image pattern recognition, compression, coding, and encryption X, with applications, pp 670008-1–670008-8

  41. Bro P, Jong S (1997) A fast non-negativity-constrained least squares algorithm. J Chemom 11(5):393–401

    Article  Google Scholar 

Download references

Acknowledgments

The authors want to thank Dr. Wang and Mr. Liu for offering valuable comments and suggestions. This work is supported by the Talented People Introduction Foundation of Shanghai University of Electric Power (No. K2014-020); Shanghai Municipal Natural Science  Foundation (No. 12ZR1412000).

Author information

Authors and Affiliations

  1. Department of Automation, Shanghai Jiao Tong University, Shanghai, 200240, China

    Fangfang Lu, Qunfei Zhao & Genke Yang

  2. College of Computer Science and Technology, Shanghai University of Electric Power, Shanghai, 200090, China

    Fangfang Lu

Authors
  1. Fangfang Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qunfei Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Genke Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fangfang Lu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, F., Zhao, Q. & Yang, G. A no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics. Neural Comput & Applic 26, 77–90 (2015). https://doi.org/10.1007/s00521-014-1699-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-014-1699-5

Keywords

Search

Navigation