Skip to main content
SpringerLink
Log in

Evaluate mobile video quality in hybrid spatial and temporal domain

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Mobile video quality assessment plays an essential role in multimedia systems and services. In the case of scalable video coding, which enables dynamic adaptation based on terminal capabilities and heterogeneous network, variable resolution is one of the most prominent types of video distortions. In this paper, we propose a new hybrid spatial and temporal distortion metric for evaluating video streaming quality with variable spatio-temporal resolution. The key idea is to project video sequence into feature domain and calculate the distortion of content information from the projected principal component matrix and its eigenvectors. This metric can measures the degree of content information degradation especially in spatio-temporal resolution scalable video. The performance of the proposed metric is evaluated and compared to some state-of-the-art quality evaluation metrics in the literature. Our results show that the proposed metric achieves good correlations with the subjective evaluations of the EPFL scale video database.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Chan C, Wee S, Apostolopoulos J (2008) Multiple distortion measures for packetized scalable media. IEEE Trans Multimed 10(8):1671–1686

    Article  Google Scholar 

  2. Chandler DM, Hemami SS (2007) Vsnr: A wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans Image Process 16(9):2284–2298

    Article  MathSciNet  Google Scholar 

  3. Ji W, Li Z (2010) Joint layered video and digital fountain coding for multi-channel video broadcasting. Conf ACM Multimedia 2010:1223–1226

    Google Scholar 

  4. Ji W, Li Z, Chen Y (2011) Joint scalable video and digital fountain coding for heterogeneous qos video broadcasting. In: Multimedia and Expo (ICME), 2011 IEEE International Conference on , pp 1–6

  5. Lee J-S, Simone FD, Ramzan N, Zhao Z, Kurutepe E, Sikora T, Ostermann J, Izquierdo E, Ebrahimi T (2010) Subjective evaluation of scalable video coding for content distribution. In: Proceedings of the ACM Multimedia, pp 65–72

  6. Li Z, SGM, Katsaggelos A, B G (2005) Rate-distortion optimal video summary generation. IEEE Trans Image Process 14(10):1550–1560

    Article  Google Scholar 

  7. Pinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcasting 50(3):312–322

    Article  Google Scholar 

  8. R. I.-T. J.249, Perceptual video quality measurement techniques for digital cable television in the presence of a reduced reference, 2010

  9. Schwarz H, Wiegand D (2007) Overview of the scalable video coding extension of the h.264/avc standard. IEEE Trans Circuits Syst Video Technol 17(9):1103–1120

    Article  Google Scholar 

  10. Segal A Study of upsampling/down-sampling for spatial scalability. Joint Video Team, Doc.JVT-Q083

  11. Segall C, Sullivan G (2007) Spatial scalability within the h.264/avc scalable video coding extension. IEEE Trans Circuits Syst Video Technol 17(9):1121–1135

    Article  Google Scholar 

  12. Seshadrinathan K, Bovik A (2010) Motion tuned spatio-temporal quality assessment of natural videos. IEEE Trans Image Process 19(2):335–350

    Article  MathSciNet  Google Scholar 

  13. Sheikh H, Bovik A, de Veciana G (2005) An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans Image Process 14 (12):2117–2128

    Article  Google Scholar 

  14. Sohn H, Yoo H, Neve WD, Kim CS, Ro YM (2010) Full-reference video quality metric for fully scalable and mobile svc content. IEEE Trans Broadcast 56(3):269–280

    Article  Google Scholar 

  15. Sun S, Reichel J Ahg report on spatial scalability resampling. Joint Video Team, Doc.JVT-R006

  16. VQEG (2003) Final Report from the Video Quality Experts Group on the Validation of Objective Quality Metrics for Video Quality Assessment, [Online]. Available: http://www.its.bldrdoc.gov/vqeg/projects/frtv-phase-ii/frtv-phase-ii.aspx

  17. Vranjes D, Vranjes M, Rimac-Drlje S (2013) Spatial upscaling of scalable coded video for mobile applications. In: ELMAR, 2013 55th International Symposium, pp 287–290

  18. Wang L, Zhang Y, Feng J (2005) On the euclidean distance of images. IEEE Trans. Pattern Anal Mach Intell 27(8):1334–1339

    Article  Google Scholar 

  19. Wang Y, van der Schaar M, Chang S-F, Loui A (2005) Classification-based multidimensional adaptation prediction for scalable video coding using subjective quality evaluation. IEEE Trans Circuits Syst Video Technol 15(10):1270–1279

    Article  Google Scholar 

  20. Wang Z, Simoncelli EP, Bovik AC (2003) Multi-scale structural similarity for image quality assessment. In: IEEE Asilomar Conference on Signals, Systems, and Computers, pp 9–12

  21. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  22. Winkler S (2005) Digital video quality-vision models and metrics. Wiley

  23. Wulf S, Zolzer U (2013) The impact of temporal pooling and spatio-temporal quality interaction on the prediction accuracy of video quality metrics. Signal Processing Algorithms, Architectures, Arrangements, and Applications (SPA):26–31

  24. Xue Y, Erkin B, Yao W (2015) A novel no-reference video quality metric for evaluating temporal jerkiness due to frame freezing. IEEE Trans Multimed 17(1):134–139

    Article  Google Scholar 

  25. Yang X, Lin W, Lu Z, Ong E, Yao S (2005) Just noticeable distortion model and its applications in video coding. SPIC 20(7):662–680

    Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (61572466).

Author information

Authors and Affiliations

  1. Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Chao Chen, Wen Ji & Yiqiang Chen

  2. Department of Multimedia, Sungkyul University, Anyang, South Korea

    Seungmin Rho

  3. Department of Electrical Engineering, Princeton University, Princeton, NJ, USA

    Bo-Wei Chen

Authors
  1. Chao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seungmin Rho
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bo-Wei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yiqiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wen Ji.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, C., Ji, W., Rho, S. et al. Evaluate mobile video quality in hybrid spatial and temporal domain. Multimed Tools Appl 75, 14507–14524 (2016). https://doi.org/10.1007/s11042-015-2992-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2992-8

Keywords

Search

Navigation