Skip to main content
Log in

Content driven QoE assessment for video frame rate and frame resolution reduction

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video bit rate reduction is very important for all video streaming applications. One possibility involves quantization domain and the majority of the work devoted to bit rate reduction focuses on this aspect only. The other possibility is to modify a video in time or space domain i.e. change the frames per second FPS rate or frame resolution FR. In this paper we present two no reference metrics mapping FPS rate and FR into MOS (Mean Opinion Scale). The performance of both models is significantly improved by incorporating content characteristics such as spatial information SI and temporal information TI. The impact on Quality of Experience (QoE) of both content characteristics is discussed with relation to the FPS rate and FR changes and general conclusions are drawn. The models were estimated and verified upon results of subjective experiments performed using video sequences of diverse spatial and temporal variability. The considered FPS rate was changed from 5 to 30 and the considered FR was changed from SQCIF to SD.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Armstrong M, Flynn D, Hammond M, Jolly S, Salmon R (2008) High frame-rate television. Research white paper WHP 169, British Broadcasting Corporation (BBC)

  2. Brownlow K (1980) Silent films: what was the right speed? Sight Sound 3(49):164–167

    Google Scholar 

  3. Chen J, Thropp J (2007) Review of low frame rate effects on human performance. IEEE Trans Syst Man Cybern Syst Hum 37(6):1063–1076

    Article  Google Scholar 

  4. Fenimore C, Libert J, Wolf S (1998) Perceptual effects of noise in digital video compression. In: 140th SMPTE technical conference, Pasadena, CA, pp 28–31

  5. Inazumi Y, Yoshida T, Sakai Y, Yuukou H (2003) Estimation of the optimal frame rate for video communications under bit-rate constraints. Electron Commun Jpn, Part 1 Commun 86(12):54–67

    Article  Google Scholar 

  6. International Telecommunications Union—Telecommunication Sector (1999) Subjective video quality assessment methods for multimedia applications. Recommendation ITU-R P.910

  7. Janowski L, Papir Z (2009) Modeling subjective tests of quality of experience with a generalized linear model. In: QoMEX 2009, first international workshop on quality of multimedia experience, California, San Diego

  8. Leszczuk M, Janowski L, Romaniak P, Głowacz A, Mirek R (2011) Quality assessment for a license plate recognition task based on a video streamed in limited networking conditions. In: 4th international conference on multimedia communications, services and security, Krakow, Poland

  9. Lu Z, Lin W, Boon CS, Kato S, Ong EP, Yao S (2007) Perceptual quality evaluation on periodic frame-dropping video. In: ICIP (3). IEEE, pp 433–436

  10. McCullagh P, Nelders J (2009) Generalized linear models, 2nd edn. Chapman & Hall, London, UK

    Google Scholar 

  11. Ou YF, Liu T, Zhao Z, Ma Z, Wang Y (2008) Modeling the impact of frame rate on perceptual quality of video. In: ICIP. IEEE, pp 689–692

  12. Teahyung L, Seshandrinathan K, Caviedes J (2010) Framework for the design of resolution scalable no-reference quality metrics. In: The fifth international workshop on video processing and quality metrics for consumer electronics VPQM-2010

  13. The VQEG sequence description. ftp://vqeg.its.bldrdoc.gov/SDTV/VQEG_PhaseI/TestSequences/Reference/Thu%mbNails/TestSequencesIndex.pdf. Accessed May 2010

  14. Video Quality Expert Group (2010) http://www.vqeg.org. Accessed May 2010

  15. VQEG (2009) Test plan for evaluation of video quality models for use with high definition TV content

Download references

Acknowledgements

The presented work was supported by the Polish Ministry of Science and Higher Education under the European Regional Development Fund, Grant No. POIG.01.01.02-00-045/09-00 Future Internet Engineering. Subjective tests were supported by European Regional Development Fund within INSIGMA project no. POIG.01.01.02-00-062/09.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Piotr Romaniak.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Janowski, L., Romaniak, P. & Papir, Z. Content driven QoE assessment for video frame rate and frame resolution reduction. Multimed Tools Appl 61, 769–786 (2012). https://doi.org/10.1007/s11042-011-0932-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0932-9

Keywords

Navigation