Skip to main content

Advertisement

SpringerLink
Log in

No-reference stereo image quality assessment based on discriminative sparse representation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The quality of images could be degraded through processing, compression, and transmission. This has created a fundamental need for perceptual quality assessment methods in multimedia services. The use of 3D stereo imaging is rapidly increasing. The quality assessment of stereo images is different from their 2D counterparts. Various algorithms have been devised in this field, mainly based on feature extraction. However, the objective quality scores are not sufficiently correlated with human judgments, or they are not fast enough because of using stereo matching and fusion techniques. In this paper, a fast-efficient algorithm is proposed for blind quality assessment of stereoscopic images. A supervised dictionary learning approach for discriminative sparse representation is applied as an automatic feature discovery framework. Based on this framework, discriminative distortion-specific bases are learned on structural features from stereoscopic images based upon discriminative dictionary learning. The over-complete bases are suitable for sparse representation of samples from the same distortion class. Given these features, an SVR is trained for the no-reference quality assessment of stereoscopic images. The experimental results show that the proposed method has achieved an overall correlation of 97% with subjective scores on common datasets so that its superiority compared to the state-of-the-art methods is up to 2%. Furthermore, our method is computationally efficient and evaluates the quality of stereo images much faster than the competing methods making it qualified for real-time applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Aharon M, Elad M, Bruckstein A (2006) K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322

    Article  Google Scholar 

  2. Akhter R, Sazzad ZP, Horita Y, Baltes J (2010) No-reference stereoscopic image quality assessment. Stereoscopic Disp Appl XXI 7524:75240T

    Article  Google Scholar 

  3. Appina B, Khan S, Channappayya SS (2016) No-reference stereoscopic image quality assessment using natural scene statistics. Signal Process Image Comm 43:1–14

    Article  Google Scholar 

  4. Benoit A, Le Callet P, Campisi P, Cousseau R (2009) Quality assessment of stereoscopic images. EURASIP J Image Video Process 2008(1):659024

  5. Bensalma R, Larabi MC (2010) Towards a perceptual quality metric for color stereo images. In 17th IEEE Int Conf Image Process (ICIP 2010) 4037–4040

  6. Chen MJ, Su CC, Kwon DK, Cormack LK, Bovik AC (2013) Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process Image Commun 28(9):1143–1155

    Article  Google Scholar 

  7. Chen M-J, Cormack LK, Bovik AC (2013) No-reference quality assessment of natural stereopairs. IEEE Trans Image Process 22(9):3379–3391

    Article  MathSciNet  Google Scholar 

  8. Hachicha W, Kaaniche M, Beghdadi A, Cheikh FA (2017) No-reference stereo image quality assessment based on joint wavelet decomposition and statistical models. Signal Process Image Commun 54:107–117

  9. Jiang G, Xu H, Yu M, Luo T, Zhang Y (2017) Stereoscopic image quality assessment by learning non-negative matrix factorization-based color visual characteristics and considering binocular interactions”. J Vis Commun Image Represent 46:269–279

    Article  Google Scholar 

  10. Jiang Q, Shao F, Gao W, Chen Z, Jiang G, Ho YS (2018) Unified no-reference quality assessment of singly and multiply distorted stereoscopic images. IEEE Trans Image Process 28(4):1866–1881

    Article  MathSciNet  Google Scholar 

  11. Jiang Z, Lin Z, Davis LS (2013) Label consistent K-SVD: Learning a discriminative dictionary for recognition. IEEE Trans Pattern Anal Mach Intell 35(11):2651–2664

    Article  Google Scholar 

  12. Karimi M, Samavi S, Karimi N, Soroushmehr SR, Lin W, Najarian K (2018) Pyramidal modeling of geometric distortions for retargeted image quality evaluation. Multimed Tools Appl 77(11):13799–13820

    Article  Google Scholar 

  13. Karimi M, Soltanian N, Samavi S, Najarian K, Karimi N, Soroushmehr SR (2019) Blind stereo image quality assessment inspired by brain sensory-motor fusion. Digit Signal Process 91:91–104

    Article  Google Scholar 

  14. Karimi M, Nejati M, Soroushmehr SR, Samavi S, Karimi N, Najarian K (2017) Blind stereo quality assessment based on learned features from binocular combined images. IEEE Trans Multimed 19(11):2475–89

    Article  Google Scholar 

  15. Liao X, Yin J, Chen M, Qin Z (2020) Adaptive payload distribution in multiple images steganography based on image texture features. IEEE Trans Dependable Secure Comput

  16. Liao X, Li K, Zhu X, Liu KR (2020) Robust detection of image operator chain with two-stream convolutional neural network. IEEE J Sel Top Signal Process 14(5):955–968

    Article  Google Scholar 

  17. Lin YH, Wu JL (2014) Quality assessment of stereoscopic 3D image compression by binocular integration behaviors. IEEE Trans Image Process 23(4):1527–1542

    Article  MathSciNet  Google Scholar 

  18. Lin Y, Yang J, Lu W, Meng Q, Lv Z, Song H (2017) Quality index for stereoscopic images by jointly evaluating cyclopean amplitude and cyclopean phase. IEEE J Sel Top Signal Process 11(1):89–101

    Article  Google Scholar 

  19. Liu L, Liu B, Su C, Huang H, Bovik AC (2017) Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment. Signal Process Image Commun 58:287–299

    Article  Google Scholar 

  20. Liu TJ, Lin CT, Liu HH, Pei SC (2019) Blind stereoscopic image quality assessment based on hierarchical learning. IEEE Access 7:8058–8069

    Article  Google Scholar 

  21. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  22. Liu C, Yuen J, Torralba A (2011) Sift flow: Dense correspondence across scenes and its applications. IEEE Trans Pattern Anal Mach Intell 33(5):978–994

    Article  Google Scholar 

  23. Ma J, An P, Shen L, Li K (2018) Reduced-reference stereoscopic image quality assessment using natural scene statistics and structural degradation. IEEE Access 6:2768–2780

    Article  Google Scholar 

  24. Mairal J, Bach F, Ponce J (2012) Task-driven dictionary learnin. IEEE Trans Pattern Anal Mach Intell 34(4):791–804

    Article  Google Scholar 

  25. Messai O, Hachouf F, Seghir ZA (2020) AdaBoost neural network and cyclopean view for no-reference stereoscopic image quality assessment. Signal Process Image Commun 82:115772

  26. Mittal A, Moorthy AK, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708

    Article  MathSciNet  Google Scholar 

  27. Moorthy AK, Bovik AC (2011) Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE Trans Image Process 20(12):3350–3364

    Article  MathSciNet  Google Scholar 

  28. Moorthy A, Su CC, Chen MJ, Mittal A, Cormack LK, Bovik AC (2013a) LIVE 3D image quality database Phase I. [Online]. Available: http://live.ece.utexas.edu/research/quality/live_3dimage_phase1.html

  29. Moorthy A, Su CC, Chen MJ, Mittal A, Cormack LK, Bovik AC (2013b) LIVE 3D image quality database Phase II. [Online]. Available: http://live.ece.utexas.edu/research/quality/live_3dimage_phase2.html

  30. Nejati M, Samavi S, Karimi N, Soroushmehr SR, Najarian K (2016) Boosted dictionary learning for image compression. IEEE Trans Image Process 25(10):4900–4915

    Article  MathSciNet  Google Scholar 

  31. Nejati M, Samavi S, Derksen H, Najarian K (2016) Denoising by low-rank and sparse representations. J Vis Commun Image Represent 36:28–39

    Article  Google Scholar 

  32. Pati YC, Rezaiifar R, Krishnaprasad PS (1993) Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In 1993 Conference Record of the Twenty-Seventh Asilomar. IEEE Conf Signals Syst Comput 40–44

  33. Saad MA, Bovik AC, Charrier C (2010) A DCT statistics-based blind image quality index. IEEE Signal Process Lett 17(6):583–586

    Article  Google Scholar 

  34. Shao F, Lin W, Gu S, Jiang G, Srikanthan T (2013) Perceptual full-reference quality assessment of stereoscopic images by considering binocular visual characteristics. IEEE Trans Image Process 22(5):1940–1953

    Article  MathSciNet  Google Scholar 

  35. Shao F, Li K, Lin W, Jiang G, Yu M, Dai Q (2015) Full-reference quality assessment of stereoscopic images by learning binocular receptive field properties. IEEE Trans Image Process 24(10):2971–2983

    Article  MathSciNet  Google Scholar 

  36. Shao F, Li K, Lin W, Jiang G, Yu M (2015) Using binocular feature combination for blind quality assessment of stereoscopic images. IEEE Signal Process Lett 22(10):1548–1551

    Article  Google Scholar 

  37. Shao F, Li K, Lin W, Jiang G, Dai Q (2016) Learning blind quality evaluator for stereoscopic images using joint sparse representation. IEEE Trans Multimed 18(10):2104–2114

    Article  Google Scholar 

  38. Shi Y, Guo W, Niu Y, Zhan J (2020) No-reference stereoscopic image quality assessment using a multi-task CNN and registered distortion representation. Pattern Recognit 100:107168

  39. Su C-C, Cormack LK, Bovik AC (2015) Oriented correlation models of distorted natural images with application to natural stereopair quality evaluation. IEEE Trans Image Process 24(5):1685–1699

    Article  MathSciNet  Google Scholar 

  40. Wan Z, Gu K, Zhao D (2019) Reduced Reference Stereoscopic Image Quality Assessment Using Sparse Representation and Natural Scene Statistics. IEEE Trans Multimed

  41. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  42. Wang Z, Simoncelli EP, Bovik AC (2004) Multi-scale structural similarity for image quality assessment. In the 37th Asilomar Conf Signals Syst Comput 1398–1402

  43. Wang J, Rehman A, Zeng K, Wang S, Wang Z (2015) Quality prediction of asymmetrically distorted stereoscopic 3D images. IEEE Trans Image Process 24(11):3400–3414

    Article  MathSciNet  Google Scholar 

  44. Yang J, Liu Y, Gao Z, Chu R, Song Z (2015) A perceptual stereoscopic image quality assessment model accounting for binocular combination behavior. J Vis Commun Image Represent 31:138–145

    Article  Google Scholar 

  45. Zhou W, Zhang S, Pan T, Yu L, Qiu W, Zhou Y, Luo T (2017) Blind 3D image quality assessment based on self-similarity of binocular features. Neurocomputing 224:128–134

    Article  Google Scholar 

  46. Zhou W, Yu L (2016) Binocular responses for no-reference 3D image quality assessment. IEEE Trans Multimed 18(6):1077–1084

    Article  MathSciNet  Google Scholar 

  47. Zhou W, Qiu W, Wu MW (2017) Utilizing dictionary learning and machine learning for blind quality assessment of 3-D images. IEEE Trans Broadcast 63(2):404–415

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Shahrekord University, 88186-34141, Shahrekord, Iran

    Maryam Karimi

  2. Department of Electrical and Computer Engineering, Isfahan University of Technology, 84156-83111, Isfahan, Iran

    Mansour Nejati & Nader Karimi

  3. Department of Computer Science, Seattle University, Seattle, 98122, USA

    Pejman Khadivi

  4. Department of Electrical and Computer Engineering, Isfahan University of Technology, 84156-83111, Isfahan, Iran

    Shadrokh Samavi

  5. Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON, L8S 4L8, Canada

    Shadrokh Samavi

Authors
  1. Maryam Karimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mansour Nejati
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pejman Khadivi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nader Karimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shadrokh Samavi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pejman Khadivi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karimi, M., Nejati, M., Khadivi, P. et al. No-reference stereo image quality assessment based on discriminative sparse representation. Multimed Tools Appl 80, 33033–33053 (2021). https://doi.org/10.1007/s11042-021-11322-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11322-z

Keywords

Search

Navigation