Subjective Multimedia Quality Assessment

Matthew D. BROTHERTON
Quan HUYNH-THU
David S. HANDS
Kjell BRUNNSTROM

Publication
IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences   Vol.E89-A    No.11    pp.2920-2932
Publication Date: 2006/11/01
Online ISSN: 1745-1337
DOI: 10.1093/ietfec/e89-a.11.2920
Print ISSN: 0916-8508
Type of Manuscript: Special Section INVITED PAPER (Special Section on Image Media Quality)
Category: 
Keyword: 
subjective assessment,  multimedia quality,  VQEG,  

Full Text: PDF(1000.1KB)>>
Buy this Article



Summary: 
The Video Quality Experts Group (VQEG) is preparing a programme of subjective multimedia quality tests. The results from these tests will be used to evaluate the performance of competing objective multimedia quality metrics. The reliability of the subjective test data is of great importance for VQEG's task. This paper provides an overview of VQEG's multimedia ad-hoc group. The work of this group will require subjective tests to be performed by laboratories located in Europe, Asia and North America. For VQEG's multimedia work to be successful, the subjective assessment methodology must be precisely defined and produce reliable and repeatable subjective quality data. Although international standards covering multimedia quality assessment methods are in force, there remains some uncertainty regarding the most effective approach to assessing the subjective quality of multimedia. A review of existing methods is provided. Two experiments are presented investigating the suitability of alternative subjective assessment methods (single-stimulus ACR and SAMVIQ). The results of these experiments are discussed within the context of the VQEG multimedia testing programme.


open access publishing via