Skip to main content

Tackling the Sheer Scale of Subjective QoE

  • Conference paper
Mobile Multimedia Communications (MobiMedia 2011)

Abstract

Maximum Likelihood Difference Scaling (MLDS) used as a method for subjective assessment of video quality alleviates the inconveniencies associated with high variation and biases common in rating methods. However, the number of tests in a MLDS study rises fairly quickly with the number of samples that we want to test. This makes the MLDS studies not scalable for the diverse video delivery environments commonly met in pervasive media networks. To tackle this issue we have developed an active learning approach that decreases the number of MLDS tests and improves the scalability of this method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Watson, A.B.: Proposal: Measurement of a JND scale for video quality. IEEE G-2.1. 6 Subcommittee on Video Compression Measurements (2000)

    Google Scholar 

  2. Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: Thirty-Seventh Asilomar Conference on Record of the Signals, Systems and Computers, vol. 2, pp. 1398–1402 (2003)

    Google Scholar 

  3. Hekstra, A.P., et al.: PVQM-A perceptual video quality measure. Signal Processing: Image Communication 17(10), 781–798 (2002)

    Google Scholar 

  4. Seshadrinathan, K., Bovik, A.C.: Motion-based perceptual quality assessment of video. In: Proc. SPIE-Human Vision and Electronic Imaging (2009)

    Google Scholar 

  5. Gunawan, I.P., Ghanbari, M.: Efficient reduced-reference video quality meter. IEEE Transactions on Broadcasting 54(3), 669–679 (2008)

    Article  Google Scholar 

  6. Winkler, S., Mohandas, P.: The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics. IEEE Transactions on Broadcasting 54(3), 660–668 (2008)

    Article  Google Scholar 

  7. Kalpana Seshadrinathan, A., Rajiv Soundararajan, B., Alan, C.B.B., Lawrence, K.C.B.: A Subjective Study to Evaluate Video Quality Assessment Algorithms

    Google Scholar 

  8. Krantz, D.H., Luce, R.D., Suppes, P., Tversky, A.: Foundations of measurement, vol. 1: Additive and polynomial representations. Academic, New York (1971)

    MATH  Google Scholar 

  9. Shepard, R.N.: On the status of’direct’psychophysical measurement. Minnesota Studies in the Philosophy of Science 9, 441–490

    Google Scholar 

  10. Shepard, R.N.: Psychological relations and psychophysical scales: on the status of direct. Journal of Mathematical Psychology 24(1), 21–57 (1981)

    Article  MathSciNet  MATH  Google Scholar 

  11. Ehrenstein, W.H., Ehrenstein, A.: Psychophysical methods. Modern Techniques in Neuroscience Research, 1211–1241 (1999)

    Google Scholar 

  12. Knoblauch, K., Maloney, L.T.: MLDS: Maximum likelihood difference scaling in R. Journal of Statistical Software 25(2), 1–26 (2008)

    Article  Google Scholar 

  13. Green, D.M., Swets, J.A.: Signal detection theory and psychophysics (1966)

    Google Scholar 

  14. Menkovski, V., Exarchakos, G., Liotta, A.: The value of relative quality in video delivery. Eindhoven University of Technology, Eindhoven (2011)

    Google Scholar 

  15. Charrier, C., Maloney, L.T., Cherifi, H., Knoblauch, K.: Maximum likelihood difference scaling of image quality in compression-degraded images. Journal of the Optical Society of America A 24(11), 3418–3426 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Menkovski, V., Exarchakos, G., Liotta, A. (2012). Tackling the Sheer Scale of Subjective QoE. In: Atzori, L., Delgado, J., Giusto, D. (eds) Mobile Multimedia Communications. MobiMedia 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 79. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30419-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30419-4_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30418-7

  • Online ISBN: 978-3-642-30419-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics