Performance comparison of video quality metrics

Kotevski Zoran; Mitrevski Pece

doi:10.1117/12.853442

26 February 2010 Performance comparison of video quality metrics

Kotevski Zoran, Mitrevski Pece

Proceedings Volume 7546, Second International Conference on Digital Image Processing; 75460G (2010) https://doi.org/10.1117/12.853442
Event: Second International Conference on Digital Image Processing, 2010, Singapore, Singapore

Abstract

The development of digital video technology, due to its nature, introduced new approach to the objective video quality estimation. Basically there are two types of metrics for measuring the quality of digital video: purely mathematically defined video quality metrics (DELTA, MSAD, MSE, SNR and PSNR) where the error is mathematically calculated as a difference between the original and processed pixel, and video quality metrics that have similar characteristics as the Human Visual System (SSIM, NQI, VQM), where the perceptual quality is also considered in the overall quality estimation. The metrics from the first group are more technical ones and because the visual quality of perception is more complex than pixel error calculation, many examples show that their video quality estimation is deficiently accurate. The second group of metrics work in a different manner compared to previous, calculating the scene structure in the overall video quality estimation. This paper is concerned with experimental comparison of the performance of Structural Similarity (SSIM) and Video Quality Metric (VQM) metrics for objective video quality estimation. For the purpose of this experiment, more than 300 short video sequences were prepared. The measurements of these video sequences are used to draw the metrics dependence to common changes in processed video sequences. These changes include changes in: brightness, contrast, hue, saturation and noise. This paper pinpoints the key characteristics of each metric, gives the conclusion of the better performing one and gives directions for improvement of objective video quality estimation.

Citation Download Citation

Kotevski Zoran and Mitrevski Pece "Performance comparison of video quality metrics", Proc. SPIE 7546, Second International Conference on Digital Image Processing, 75460G (26 February 2010); https://doi.org/10.1117/12.853442

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available