Abstract
The Video Quality Assessment (VQA) has been attracting attentions of image processing community due to its applications in evaluation and optimization of user experience during video playback. Until now, the researches on VQA mainly focus on short video sequences less than 10 s that have similar quality representations to images. In this work, we propose a VQA model for the medium-length video sequences by considering the user perception, expectation and memory. Firstly, we aggregate the popular perception-based VQA metrics to develop a hybrid metric with high consistency to subjective scores. Secondly, we exploit the impact of user expectation on quality evaluation and further utilize it to refine our model. Thirdly, the exponential decay law of user memory is introduced to generate the final model, namely, Expectation and Memory-based VQA (EM-VQA). Experimental results show that the proposed model achieves superior performance than the state-of-the-art VQA models.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Eswara, N., Ashique, S., Panchbhai, A., Chakraborty, S., Sethuram, H.P.: Streaming video QoE modeling and prediction: a long short-term memory approach. IEEE Trans. Circ. Syst. Video Technol. 30(3), 661–673 (2019)
Duanmu, Z., Zeng, K., Ma, K., Rehman, A., Wang, Z.: A quality-of-experience index for streaming video. IEEE J. Sel. Top. Signal Process. 11(1), 154–166 (2017)
Duanmu, Z., Rehman, A., Wang, Z.: A quality-of-experience database for adaptive video streaming. IEEE Trans. Broadcast. 64(2), 474–487 (2018)
Seufert, M., Slanina, M., Egger, S., Kottkamp, M.: “to pool or not to pool”: a comparison of temporal pooling methods for http adaptive video streaming. In: International Workshop on Quality of Multimedia Experience (QoMEX), pp. 52–57 (2013)
Chen, C., Choi, L.K., de Veciana, G., Caramanis, C., Heath, R.W., Bovik, A.C.: Modeling the time-varying subjective quality of http video streams with rate adaptations. IEEE Trans. Image Process. 23(5), 2206–2221 (2014)
Shen, Y., Liu, Y., Liu, Q., Yang, D.: A method of QoE evaluation for adaptive streaming based on bitrate distribution. In: IEEE International Conference on Communications Workshops (ICC), pp. 551–556 (2014)
Papadopoulos, M.A., Katsenou, A.V., Agrafiotis, D., Bull, D.R.: A multi-metric approach for block-level video quality assessment. Signal Process. Image Commun. 78, 152–158 (2019)
Li, Z., Aaron, A., Manohara, M.: Toward a practical perceptual video quality metric (2016). http://techblog.netflix.com/2016/06/toward-practical-perceptual-video.html
Hosek, J., Ries, M., Vajsar, P., Nagy, L., Penizek, R.: User’s happiness in numbers: Understanding mobile youtube quality expectations. In: International Conference on Telecommunications and Signal Processing (TSP), pp. 607–611 (2015)
Deora, V., Shao, J., Gray, W., Fiddian, N.: A quality of service management framework based on user expectations. In: International Conference on Service-Oriented Computing (ICSOC), pp. 104–114 (2003)
Yu, S., Tao, R., Hou, Y.: Modeling for short-form http adaptive streaming considering memory effect. In: International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA), pp. 82–87 (2015)
Ghadiyaram, D., Pan, J., Bovik, A.C.: Learning a continuous-time streaming video QoE model. IEEE Trans. Image Process. 27(5), 2257–2271 (2018)
Bampis, C., Li, Z., Bovik, A.C.: Continuous prediction of streaming video QoE using dynamic networks. IEEE Signal Process. Lett. 24(7), 1083–1087 (2017)
Smola, A., Schölkopf, B.: A tutorial on support vector regression. Stat. Comput. 14, 199–222 (2004)
Xue, J., Zhang, D.Q., Yu, H., Chen, C.W.: Assessing quality of experience for adaptive http video streaming. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6 (2014)
Ma, C., Yang, C.Y., Yang, X., Yang, M.H.: Learning a no-reference quality metric for single-image super-resolution. Comput. Vision Image Underst. 158, 1–16 (2017)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)
Xu, J., Ye, P., Li, Q., Du, H., Liu, Y.: Blind image quality assessment based on high order statistics aggregation. IEEE Trans. Image Process. 25(9), 4444–4457 (2016)
Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)
BT. 500–13, I.R.: Methodology for the subjective assessment of the quality of television pictures (2012)
Acknowledgments
This work is partially supported by grants from Natural Science Foundation of China (No. 62001404) and Fujian Provincial Education Department (No. JAT200024).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ji, S., Lin, L., Xu, Y., Chen, W., Chen, N., Zhao, T. (2021). Video Playback Quality Evaluation Based on User Expectation and Memory. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12890. Springer, Cham. https://doi.org/10.1007/978-3-030-87361-5_60
Download citation
DOI: https://doi.org/10.1007/978-3-030-87361-5_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87360-8
Online ISBN: 978-3-030-87361-5
eBook Packages: Computer ScienceComputer Science (R0)