skip to main content
10.1145/2684083.2684090acmotherconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
tutorial

Automation of Subjective Video Quality Measurements

Authors Info & Claims
Published:18 September 2014Publication History

ABSTRACT

Quality of Experience is utterly important in Communication Systems, especially in audiovisual services. Audio and video quality, as perceived by the users, is one of the most important aspects that affect the Quality of Experience. The most accurate methods for measuring the perceived audio and video quality of a video clip are the subjective tests, where the video sequences are presented to different viewers, and opinions are averaged. Subjective measurements are also necessary to develop and calibrate objective models for video quality estimation. Different methods for performing these tests are standardized, and normally require many manual setups, data-entry and/or special hardware devices. This paper presents the design, development and deployment of a software based system to automate the subjective tests for video quality measurement. The application is available for download and use for the academic community.

References

  1. Reiter, U. "Quality of experience: a buzzword or the key to successful multimedia delivery across networks?", Proceedings of the 6th Latin America Networking Conference, October 2011(pp. 20--24). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. J. Joskowicz, R. Sotelo y J. Ardao, "Towards a General Parametric Model for Perceptual Video Quality Estimation", IEEE Transactions on Broadcasting, vol. 59, n° 4, pp. 569--579, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  3. Casadesus, L., Fernández-Navajas, J., Sequeira, L., Quintana, I., Saldana, J., & Ruiz-Mas, J.. "IPTV Quality assessment system", Proceedings of the 7th Latin American Networking Conference, October 2012 (pp. 52--58). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. ITU, "Recommendation ITU-R BT.500-13, Methodology for the subjective assessment of the quality of television pictures", Jan. 2012.Google ScholarGoogle Scholar
  5. ITU, "Recommnedation ITU-R BT.710-4 Subjective Assessment Methods for Image Quality in High Definition Television", Nov. 1998.Google ScholarGoogle Scholar
  6. ITU, "Recommendation ITU-T P.910 Subjective video quality assessment methods", April 2008.Google ScholarGoogle Scholar
  7. ITU, "Recommendation ITU-T P.913 Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment", January 2014.Google ScholarGoogle Scholar
  8. B. P. van den Berge, "Influence of level of motion on perceived video quality in MPEG-2 coding," Master Thesis, Faculty of Industrial Engineering & Innovation Sciences, Human Technology Interaction, Eindhoven University of Technology, 2009.Google ScholarGoogle Scholar
  9. Q. Huynh-Thu, M.-N. Garcia, F. Speranza, P. Corriveau and A. Raake, "Study of Rating Scales for Subjective Quality Assessment of High-Definition Video", IEEE Transactions on Broadcasting, vol. 57, no. 1, March 2011.Google ScholarGoogle ScholarCross RefCross Ref
  10. K. Seshadrinathan, R. Soundararajan, A. Conrad Bovik and L. K. Cormack, "Study of Subjective and Objective Quality Assessment of Video", IEEE Transactions on Image Processing, vol. 19, no. 6, June 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. O. Nemethova, M. Ries and D. Antitza, "Test Equipment of Time-Variant Subjective Perceptual Video Quality in Mobile Terminals," proceedings of HCI, Phoenix, USA, November 14--16, 2005.Google ScholarGoogle Scholar
  12. T. Liu, G. Cash, N. Narvekar and J. Bloom, "Continuous mobile video subjective quality assessment using gaming steering wheel," Sixth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), January 2012..Google ScholarGoogle Scholar
  13. V. L. Organization, "VLC Media Player," {Online}. Available: http://www.videolan.org/vlc/. (Accessed: 9 June 2014)Google ScholarGoogle Scholar
  14. "VQI: Video Quality Indicators for DTV," {Online}. Available: http://www2.um.edu.uy/ingenieria/vqi/. (Accessed: 9 June 2014)Google ScholarGoogle Scholar

Index Terms

  1. Automation of Subjective Video Quality Measurements

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      LANC '14: Proceedings of the Latin America Networking Conference on LANC 2014
      September 2014
      91 pages
      ISBN:9781450332804
      DOI:10.1145/2684083

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 September 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • tutorial
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader