Skip to main content
Log in

SWVFS: a saliency weighted visual feature similarity metric for image quality assessment

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

In this paper, a saliency weighted visual feature similarity (SWVFS) metric is proposed for full reference image quality assessment (IQA). Instead of traditional spatial pooling strategies, a visual saliency-based approach is employed for better compliance with properties of the human visual system, where the saliency allocation is closely related to the activity of posterior parietal cortex and the pluvial nuclei of the thalamus. Assuming that the saliency map actually represents the contribution of locally computed visual distortions to the overall image quality, the gradient similarity and the textural congruency are merged into the final image quality indicator. The gradient and texture comparison play complementary roles in characterizing the local image distortion. Extensive experiments conducted on seven publicly available image databases show that the performance of SWVFS is competitive with the state-of-the-art IQA algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wang Z, Bovik A C. Modern image quality assessment. Synthesis Lectures on Image, Video, and Multimedia Processing, 2006, 2(1): 1–156

    Article  Google Scholar 

  2. Farnand S, Gaykema F. Special section guest editorial: image quality assessment. Journal of Electronic Imaging, 2010, 19(1): 1–2

    Google Scholar 

  3. Lin W, Jay Kuo C C. Perceptual visual quality metrics: a survey. Journal of Visual Communication and Image Representation, 2011, 22(4): 297–312

    Article  Google Scholar 

  4. Damera-Venkata N, Kite T D, Geisler W S, Evans B L, Bovik A C. Image quality assessment based on a degradation model. IEEE Transactions on Image Processing, 2000, 9(4): 636–650

    Article  Google Scholar 

  5. Chandler D M, Hemami S S. VSNR: A wavelet-based visual signal-tonoise ratio for natural images. IEEE Transactions on Image Processing, 2007, 16(9): 2284–2298

    Article  MathSciNet  Google Scholar 

  6. Sheikh H R, Bovik A C, De Veciana G. An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Transactions on Image Processing, 2005, 14(12): 2117–2128

    Article  Google Scholar 

  7. Sheikh H R, Bovik A C. Image information and visual quality. IEEE Transactions on Image Processing, 2006, 15(2): 430–444

    Article  Google Scholar 

  8. Liu A, Lin W, Narwaria M. Image quality assessment based on gradient similarity. IEEE Transactions on Image Processing, 2012, 21(4): 1500–1512

    Article  MathSciNet  Google Scholar 

  9. Zhang L, Zhang L, Mou X, Zhang D. FSIM: a feature similarity index for image quality assessment. IEEE Transactions on Image Processing, 2011, 20(8): 2378–2386

    Article  MathSciNet  Google Scholar 

  10. Wang Z, Bovik A C, Sheikh H R, Simoncelli E P. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600–612

    Article  Google Scholar 

  11. Wang Z, Bovik A C, Sheikh H R, Simoncelli E P. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600–612

    Article  Google Scholar 

  12. Li C, Bovik A C. Content-partitioned structural similarity index for image quality assessment. Signal Processing: Image Communication, 2010, 25(7): 517–526

    Google Scholar 

  13. Wang Z, Li Q. Information content weighting for perceptual image quality assessment. IEEE Transactions on Image Processing, 2011, 20(5): 1185–1198

    Article  MathSciNet  Google Scholar 

  14. Cui L, Allen A R. An image quality metric based on corner, edge and symmetry maps. In: Proceedings of the 2008 British Machine Vision Conference. 2008, 1–10

    Google Scholar 

  15. Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(11): 1254–1259

    Article  Google Scholar 

  16. Liu H, Heynderickx I. Visual attention in objective image quality assessment: based on eye-tracking data. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(7): 971–982

    Article  Google Scholar 

  17. You J, Perkis A, Hannuksela M M, Gabbouj M. Perceptual quality assessment based on visual attention analysis. In: Proceedings of the 17th ACM International Conference on Multimedia. 2009, 561–564

    Google Scholar 

  18. Tong Y, Konik H, Cheikh F A, Trémeau A. Full reference image quality assessment based on saliency map analysis. Journal of Imaging Science and Technology, 2010, 54(3): 1–14

    Article  Google Scholar 

  19. Gu K, Zhai G, Yang X, Chen L, Zhang W. Nonlinear additive model based saliency map weighting strategy for image quality assessment. In: Proceedings of the IEEE 14th International Workshop on Multimedia Signal Processing. 2012, 313–318

    Google Scholar 

  20. Roberts L G. Machine perception of three-dimensional solids. Technical Report, DTIC Document, 1963

    Google Scholar 

  21. Manjunath B S, Ma W Y. Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(8): 837–842

    Article  Google Scholar 

  22. Chandler D, Hemami S. A57 database, http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html, 2007

    Google Scholar 

  23. Ninassi A, Le Callet P, Autrusseau F. Subjective quality assessment-IVC database, http://www2.irccyn,ec-nanates,fr/ivcdb

  24. Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Carli M, Battisti F. TID2008-A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics, 2009, 10(4): 30–45

    Google Scholar 

  25. Horita Y, Shibata K, Kawayoke Y, Sazzad Z P. Mict image quality evaluation database, http://mict,eng.u-toyama.ac.jp/mictdb,html, 2011

    Google Scholar 

  26. Sheikh H R, Wang Z, Bovik A C, Cormack L. Image and video quality assessment research at live. http://live.ece.utexas.edu/research/quality, 2003

    Google Scholar 

  27. Larson E, Chandler D. Categorical image quality (CSIQ) database. http://vision.okstate.edu/csiq, 2010

    Google Scholar 

  28. Engelke U, Kusuma T, Zepernick H. Wireless imaging quality (WIQ) database. http://www,bth.se/tek,/rcg,nsf/pa-ges/wiq-db, 2010

    Google Scholar 

  29. ITU-R Recommendation BT.500-13. Technical report, International Telecommunication Union, Geneva, Switzerland, 2002

  30. Subjective video quality assessment methods for multimedia applications. Technical Report, ITU-T recommendation P.910, 1999

  31. Tourancheau S, Le Callet P, Barba D. Image and video quality assessment using lCD: comparisons with CRT conditions. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2008, 91(6): 1383–1391

    Article  Google Scholar 

  32. Subjective assessment of standard definition digital television (SDTV) systems. Technical Report, ITU-R recommendation BT.1129-2, 1998

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Li Cui.

Additional information

Li Cui received his BE from Xidian University, China, in 2002, his ME degree in Communication and Information System from Xidian University, China, in 2005, and his PhD from Aberdeen University, UK, in 2009. He is a lecturer in School of Electronics and Information, Northwestern Polytechnical University, China. His areas of research include visual quality assessment and human vision system modeling.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cui, L. SWVFS: a saliency weighted visual feature similarity metric for image quality assessment. Front. Comput. Sci. 8, 145–155 (2014). https://doi.org/10.1007/s11704-013-2213-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-013-2213-4

Keywords

Navigation