Skip to main content
Log in

DCT-based objective quality assessment metric of 2D/3D image

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the increasing growth of multimedia applications over the networking in recent years, users have put forward much higher requirements for multimedia quality of experience (QoE) than before. One of the representative requirements is the image quality. Therefore, the image quality assessment ranging from two-dimension (2D) image to three-dimension (3D) image has been getting much attention. In this paper, an efficient objective image quality assessment metric in block-based discrete cosine transform (DCT) coding is proposed. The metric incorporates properties of human visual system (HVS) to improve its validity and reliability in evaluating the quality of stereoscopic image. This is fulfilled by calculating the local pixel-based distortions in frequency domain, combining the simplified models of local visibility properties embodied in frequency domain, which consist of region of interest (ROI) mechanism (visual sensitivity), contrast sensitivity function (CSF) and contrast masking effect. The performance of the proposed metric is compared with other currently state-of-the-art objective image quality assessment metrics. The experimental results have demonstrated that the proposed metric is highly consistent with the subjective test scores. Moreover, the performance of the metric is also confirmed with the popular IRCCyN/IVC database. Therefore, the proposed metric is promising in term of the practical efficiency and reliability for real-life multimedia applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Akhter R, Sazzad ZMP, Horita Y, Baltes J (2010) No-reference stereoscopic image quality assessment. Proc SPIE 7524, stereoscopic displays and applications XXI, San Jose, California

  2. Arican Z, Yea S, Sullivan A, Vetro A (2009) Intermediate view generation for perceived depth adjustment of stereo video. SPIE Applications of Digital Image Processing XXXII, San Diego, 7443(1), CA, USA. doi:10.1117/12.829381

  3. Boev A, Gotchev A, Egiazarian K, Aksay A, Akar GB (2006) Towards compound stereo-video quality metric: a specific encoder-based framework. Proceeding of IEEE Southwest Symposium on Image Analysis and Interpretation, Denver, Colorado, USA, pp 218–222

  4. Brandão T, Queluz MP (2008) No-reference image quality assessment based on DCT domain statistics. J Signal Process 88(4):822–833. doi:10.1016/j.sigpro.2007.09.017

    Article  MATH  Google Scholar 

  5. Callet PL, Autrusseau F (2005) Subjective quality assessment IRCCyN/IVC database, available: http://www.irccyn.ec-nantes.fr/ivcdb/

  6. Chen W, Fournier J, Barkowsky M, Callet P-Le (2010) New requirements of subjective video quality assessment methodologies for 3DTV. Proceeding of International Workshop Video Processing Quality Metrics, Scottsdale, USA

  7. Dabov K, Foi R, Katkovnik V, Egiazarian K (2008) Image restoration by sparse 3D transform –domain collaborative filtering. Proc. SPIE Electronic Imaging, no. 6812–07, San Jose, USA

  8. Egiazarian K, Astola J, Ponomarenko N, Lukin V, Battisti F, Carli M (2006) A new full-reference quality metrics based on HVS. International Workshop on Video Processing and Quality Metrics, Scottsdale, USA

  9. Ha K, Kim M (2011) A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video. Proceeding of ICIP, Brussel, Belguim, pp 2525–2528

  10. Hewage CTER, Martini MG (2010) Reduced-reference quality metric for 3D depth map transmission. IEEE Int Conf Image Processing, Hong Kong, China

  11. ITU-R BT. 500-11 (2002), Methodology for the subjective assessment of the quality of television pictures, International Telecommunication Union (ITU) Radio Communication Sector, Geneva, Switzerland

  12. Jin L, Boev A, Gotchev A, Egiazarian K (2011) 3D-DCT based perceptual quality assessment of stereo video. 18th IEEE International Conference on Image Processing (ICIP2011), Brussels, pp 2521–2524

  13. Joveluro P, Malekmohamadi H, Fernando WAC, Kondoz AM (2010) Perceptual video quality metric for 3D video quality assessment. 3DTV-Conference: the true vision –capture, transmission and display of 3D video (3DTV-CON), pp 1–4

  14. Kim D, Min D, Oh J, Jeon S, Sohn K (2009) Depth map quality metric for three-dimensional video. Stereoscopic Displays and Applications XX, vol 7237, San Jose, CA. doi:10.1117/12.806898

  15. Kim DHH, Ryu S, Sohn KHW (2012) Depth perception and motion cue based 3D video Quality assessment. IEEE Int. Symposium on Broadband on Multimedia Systems and Broadcasting (BMSM), Seoul, South Korea, pp 1–4

  16. Ma L, Li S, Ngan KN (2012) Reduced-reference image quality assessment in reorganized DCT domain. Signal Process Image Commun, in press. doi:10.1016/j.image.2012.08.001

  17. Mannos JL, Sakrison DJ (1974) The effects of a visual fidelity criterion on the encoding of images. IEEE Trans Inf Theory 20(4):525–536

    Article  MATH  Google Scholar 

  18. Moorthy AK, Su CC, Mittal A, Bovik AC (2012) Subjective evaluation of stereoscopic image quality. Signal Process Image Commun 28(8):870–883. doi:10.1016/j.image.2012.08.004

    Google Scholar 

  19. Park PK, Oh KJ, Ho YS (2008) Efficient view-temporal prediction structures for multi-view video coding. Electron Lett 44(2):102–103. doi:10.1049/el:20082082

    Article  Google Scholar 

  20. Pinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322. doi:10.1109/TBC.2004.834028

    Article  Google Scholar 

  21. Ponomarenko N, Silvestri F, Egiazarian K, Carli M, Astola J, Lukin V (2007) On between-coefficient contrast masking of DCT basis functions, Int. Workshop on Video Processing and Quality Metrics, USA

  22. Sazzad ZMP, Yamanaka S, Kawayoke Y, Horita Y (2009) Stereoscopic image quality prediction. Proc IEEE QoMEX, San Diego, USA, pp 180–185

  23. Seo J, Liu X, Kim D, Sohn K (2012) An objective video quality metric for compressed stereoscopic video. Circ Syst Signal Proc (Springer J) 31(3):1089–1107. doi:10.1007/s00034-011-9369-7

    Article  Google Scholar 

  24. Sheikh HR, Bovik AC (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430–444. doi:10.1109/TIP.2005.859378

    Article  Google Scholar 

  25. Smolic A, Mueller K, Stefanoski N, Ostermann J et al (2007) Coding algorithms for 3DTV – a survey. IEEE Trans Circ Syst Video Technol 17(11):1606–1621. doi:10.1109/TCSVT.2007.909972

    Article  Google Scholar 

  26. Smolic A, Muller K, Merkle P, Käuff P, Wiegand T (2009) An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution. Proc Picture Coding Symposium (PCS), Chicago, USA, pp 1–4

  27. Solomon JA, Watson AB, Ahumada AJ (1994) Visibility of DCT basis functions: effects of contrast masking. Proceeding of Data Compression Conference, Snowbird, Utah, pp 361–370

  28. Tsung PK, Ding LF, Chen WY, Chuang TD, Chen YH, Hsuao PH, Chien SY, Chen LG (2010) Video encoder design for high-definition 3D video communication systems. IEEE Commun Mag 48(4):76–86. doi:10.1109/MCOM.2010.5439080

    Article  Google Scholar 

  29. Wang Z, Bovik A (2002) A universal image quality index. IEEE Trans Sig Process Lett 9:81–84. doi:10.1109/97.995823

    Article  Google Scholar 

  30. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612. doi:10.1109/TIP.2003.819861

    Article  Google Scholar 

  31. Wang Z, Simoncelli EP, Bovik AC (2003) Multiscale structural similarity for image quality assessment. IEEE Asilomar Conf Signals Syst Comput 2:1398–1402. doi:10.1109/ACSSC.2003.1292216

    Google Scholar 

  32. Winkler S (1892) Visual model and quality metrics for image processing applications, PH.D Thesis 2000J, A treatise on electronic and magnetism, 3rd edn, vol 2. Clarendon, Oxford, pp 68–73

  33. Wu HR, Rao KR (2006) Digital video image quality and perceptive coding. CRC Press Taylor & Francis Group Boca Raton, London

    Google Scholar 

  34. Xing L, You J, Ebrahimi T, Perkis A (2010) An objective metric for assessing quality of experience on stereoscopic images. Proceeding of MMSP, Saint-Malo, USA, pp 373–378

  35. Yang J, Hou C, Zhou Y, Zhang Z, Guo J (2009) Objective quality assessment method of stereo images, 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D video, pp 1–4

  36. Zhu Z, Wang Y (2009) Perceptual distortion metric for stereo video quality evaluation. WSEAS Trans Signal Process 5(7):241–250

    Google Scholar 

Download references

Acknowledgments

The work was supported by Fundamental Research Funds for the Central Universities on the grant ZYGX2012J028, and also supported by the China Postdoctoral Science Foundation funded Project on the grant 2013M530396.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xingang Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, X., Sun, C. & Yang, L.T. DCT-based objective quality assessment metric of 2D/3D image. Multimed Tools Appl 74, 2803–2820 (2015). https://doi.org/10.1007/s11042-013-1698-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1698-z

Keywords

Navigation