Abstract
Video quality assessment (VQA) is very important in many video processing applications. For example, the rate-distortion (RD) optimization in video coding needs an efficient distortion metric to assess the RD cost of candidate coding parameters. However, most existing metrics employ little visual perceptual information, or some are too complex to meet real-time requirement. In this paper we propose a new model called saliency and distortion weighted structural similarity index with temporal pooling strategy (SDTW-SSIM). In the proposed model, spatial and temporal saliency is obtained from the referenced video. Besides, a distortion weighting map is employed to give a full description of visual attention. To better present the perceptual properties of videos, both frame and sequence level saliency features are taken into account. Experimental results show that, compared with state-of-the-art methods, the proposed method performs well on both computational efficiency and assessment accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Seshadrinathan, K., Soundararajan, R., et al.: Study of Subjective and Objective Quality Assessment of Video. IEEE Trans. on Image Processing 19, 1427–1441 (2010)
Moorthy, A.K., Seshadrinathan, K., et al.: Wireless Video Quality Assessment A Study of Subjective Scores and Objective Algorithms. IEEE Trans. on Circuits Systems for Video Technology 20, 587–599 (2010)
Lin, W., Jay Kuo, C.-C.: Perceptual Visual Quality Metrics: A Survey. J. of Visual Communication and Image Representation 22, 297–312 (2011)
Wang, Z., Bovik, A.C., et al.: Image Quality Assessment: From Error Measurement to Structural Similarity. IEEE Trans. on Image Processing 13, 600–612 (2004)
Sheikh, H.R., Bovik, A.C.: Image Information and Visual Quality. IEEE Trans. on Image Processing 15, 430–444 (2006)
Zhang, L., Zhang, L., et al.: FSIM: A Feature Similarity Index for Image Quality Assessment. IEEE Trans. on Image Processing 20, 2378–2386 (2011)
Wang, Z., Li, Q.: Information Content Weighting for Perceptual Image Quality Assessment. IEEE Trans. on Image Processing 20, 1185–1198 (2011)
Wang, Z., Lu, L., et al.: Video Quality Assessment Based on Structural Distortion Measurement. Signal Processing: Image Communication 19, 121–132 (2004)
Seshadrinathan, K., Bovik, A.C.: Motion Tuned Spatio-temporal Quality Assessment of Natural Videos. IEEE Trans. on Image Processing 19, 335–350 (2010)
Engelke, U., Kaprykowsky, H., et al.: Visual Attention in Quality Assessment. IEEE Signal Processing Magazine 28, 50–59 (2011)
Ma, L., Li, S., et al.: Motion Trajectory Based Visual Saliency for Video Quality Assessment. In: IEEE International Conference on Image Processing, pp. 233–236 (2011)
Wang, Z., Shang, X.: Spatial Pooling Strategies for Perceptual Image Quality Assessment. In: IEEE International Conference on Image Processing, pp. 2945–2948 (2006)
Guo, C., Ma, Q., et al.: Spatio-temporal Saliency Detection Using Phase Spectrum of Quaternion Fourier Transform. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Ell, T.A., Sangwine, S.J.: Hypercomplex Fourier Transforms for Color Images. IEEE Trans. on Image Processing 16, 22–35 (2007)
Gaubatz, M., Hemami, S.S.: MeTriX MuX Visual Quality Assessment Package, http://foulard.ece.cornell.edu/gaubatz/metrix_mux
Moorthy, A.K., Bovik, A.C.: Efficient Video Quality Assessment Along Temporal Trajectories. IEEE Trans. on Circuits and Systems for Video Technology 20, 1653–1658 (2010)
VQEG: Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment (2000), http://www.vqeg.org/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, L., Su, L., Huang, Q., Qi, H. (2012). Visual Saliency and Distortion Weighting Based Video Quality Assessment. In: Lin, W., et al. Advances in Multimedia Information Processing – PCM 2012. PCM 2012. Lecture Notes in Computer Science, vol 7674. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34778-8_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-34778-8_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34777-1
Online ISBN: 978-3-642-34778-8
eBook Packages: Computer ScienceComputer Science (R0)