Skip to main content
SpringerLink
Log in

Sparsity-based no-reference image quality assessment for automatic denoising

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In image and video denoising, a quantitative measure of genuine image content, noise, and blur is required to facilitate quality assessment, when the ground truth is not available. In this paper, we present a no-reference image quality assessment for denoising applications, which examines local image structure using orientation dominancy and patch sparsity. We propose a fast method to find the dominant orientation of image patches, which is used to decompose them into singular values. Combining singular values with the sparsity of the patch in the transform domain, we measure the possible image content and noise of the patches and of the whole image. We show that the proposed method is useful to select parameters of denoising algorithms automatically in different noise scenarios such as white Gaussian and processed noise. Our objective and subjective results confirm the correspondence between the measured quality and the ground truth. We show that the proposed method rivals related state-of-the-art no-reference quality assessment approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Chen, M., Bovik, A.: No-reference image blur assessment using multiscale gradient. In: International Workshop on Quality of Multimedia Experience, pp. 70–74 (2009)

  2. Dabov, K., Foi, A., Egiazarian, K.: Video denoising by sparse 3D transform-domain collaborative filtering. In: Proceedings of 15th European Signal Processing Conference, vol. 1, p. 7 (2007)

  3. Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)

    Article  MathSciNet  Google Scholar 

  4. Demmel, J., Kahan, W.: Accurate singular values of bidiagonal matrices. SIAM J. Sci. Stat. Comput. 11, 873–912 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  5. Deng, C., Ma, L., Lin, W., Ngan, K.N.: Visual Signal Quality Assessment. Springer, Berlin (2016)

    Google Scholar 

  6. Elad, M., Aharon, M.: Image denoising via learned dictionaries and sparse representation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 895–900 (2006)

  7. Feichtenhofer, C., Fassold, H., Schallauer, P.: A perceptual image sharpness metric based on local edge gradient analysis. Signal Process. Lett. IEEE 20(4), 379–382 (2013)

    Article  Google Scholar 

  8. Feng, X., Milanfar, P.: Multiscale principal components analysis for image local orientation estimation. In: Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, vol. 1, pp. 478–482 (2002)

  9. Ferzli, R., Karam, L.: A no-reference objective image sharpness metric based on the notion of just noticeable blur ( JNB). IEEE Trans. Image Process. 18(4), 717–728 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  10. Gu, K., Wang, S., Zhai, G., Ma, S., Yang, X., Zhang, W.: Content-weighted mean-squared error for quality assessment of compressed images. Signal Image Video Process. 10(5), 803–810 (2016)

    Article  Google Scholar 

  11. Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016). https://doi.org/10.1109/TCYB.2015.2401732

    Article  Google Scholar 

  12. Gu, K., Zhai, G., Lin, W., Yang, X., Zhang, W.: No-reference image sharpness assessment in autoregressive parameter space. IEEE Trans on Image Process. 24(10), 3218–3231 (2015). https://doi.org/10.1109/TIP.2015.2439035

    Article  MathSciNet  Google Scholar 

  13. Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)

    Article  Google Scholar 

  14. Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circuits Syst. Video Technol. 25(9), 1480–1494 (2015). 10.1109/TCSVT.2014.2372392

    Article  Google Scholar 

  15. Hassen, R., Wang, Z., Salama, M.: Image sharpness assessment based on local phase coherence. IEEE Trans. Image Process. 22(7), 2798–2810 (2013)

    Article  Google Scholar 

  16. He, L., Gao, X., Lu, W., Li, X., Tao, D.: Image quality assessment based on s-cielab model. Signal Image Video Process. 5(3), 283–290 (2011)

    Article  Google Scholar 

  17. Knaus, C., Zwicker, M.: Progressive image denoising. IEEE Trans. Image Process. 23(7), 3114–3125 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  18. Mittal, A., Moorthy, A., Bovik, A.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  19. Moorthy, A., Bovik, A.: A two-step framework for constructing blind image quality indices. Signal Process. Lett. IEEE 17(5), 513–516 (2010)

    Article  Google Scholar 

  20. Narvekar, N., Karam, L.: A no-reference image blur metric based on the cumulative probability of blur detection ( CPBD). IEEE Trans. Image Process. 20(9), 2678–2683 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  21. Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al.: Image database TID2013: peculiarities, results and perspectives. Signal Process. Image Commun. 30, 57–77 (2015)

    Article  Google Scholar 

  22. Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes 3rd Edition: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007)

    MATH  Google Scholar 

  23. Ramani, S., Blu, T., Unser, M.: Monte-carlo SURE: a black-box optimization of regularization parameters for general denoising algorithms. IEEE Trans. Image Process. 17(9), 1540–1554 (2008)

    Article  MathSciNet  Google Scholar 

  24. Soundararajan, R., Bovik, A.C.: Survey of information theory in visual quality assessment. Signal Image Video Process. 7(3), 391–401 (2013)

    Article  Google Scholar 

  25. Takeda, H., Farsiu, S., Milanfar, P.: Kernel regression for image processing and reconstruction. IEEE Trans. Image Process. 16(2), 349–366 (2007)

    Article  MathSciNet  Google Scholar 

  26. Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision, pp. 839–846 (1998)

  27. Vu, C., Phan, T., Chandler, D.: S3: a spectral and spatial measure of local perceived sharpness in natural images. IEEE Trans. Image Process. 21(3), 934–945 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  28. Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  29. Xue, W., Mou, X., Zhang, L., Bovik, A.C., Feng, X.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  30. Zh, X., Milanfar, P.: IEEE Trans. Image Process. Automatic parameter selection for denoising algorithms using a no-reference measure of image content 19(12), 3116–3132 (2010)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical and Computer Engineering Department, Concordia University, Montreal, QC, Canada

    Meisam Rakhshanfar & Maria A. Amer

Authors
  1. Meisam Rakhshanfar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria A. Amer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Meisam Rakhshanfar.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 3923 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rakhshanfar, M., Amer, M.A. Sparsity-based no-reference image quality assessment for automatic denoising. SIViP 12, 739–747 (2018). https://doi.org/10.1007/s11760-017-1215-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-017-1215-3

Keywords

Search

Navigation