Edip Demirbilek
ABSTRACT
We present the INRS audiovisual quality dataset made of 160 unique configurations for audiovisual content including various media compression and network distortion parameters such as video frame rate, quantization and noise reduction parameters, and packet loss rate. The compression and network distortion parameter range values are selected to match real-time communications use cases. The H.264 video codec in 720p resolution and the AMR-WB audio codec are used for encoding video and audio streams. Thirty observers have rated the overall audiovisual quality on the Absolute Category Rating (ACR) 5-level quality scale in a controlled environment. The dataset includes MOS values, packet loss rates measured at bit stream level for both video and audio streams, compression parameters and various packet header information. We have used open source software for producing source audiovisual sequences, end-to-end streaming and a custom video player. These tools and the dataset are free to public access for research and development purposes.
- E. Demirbilek. The inrs audiovisual quality dataset. https://github.com/edipdemirbilek/TheINRSAudiovisualQualityDataset, 2016. Google Scholar
Digital Library
- E. Demirbilek. Gstreamer multimedia quality testbed. https://github.com/edipdemirbilek/GStreamerMultimediaQualityTestbed, 2016.Google Scholar
- E. Demirbilek. Subjective assesment video player. https://github.com/edipdemirbilek/SubjectiveAssesmentVideoPlayer, 2016.Google Scholar
- M.-N. Garcia. Parametric Packet-based Audiovisual Quality Model for IPTV Services. Springer, 2014. Google ScholarDigital Library
- M. Goudarzi, L. Sun, and E. Ifeachor. Audiovisual quality estimation for video calls in wireless applications. In Global Telecommunications Conference (GLOBECOM 2010), 2010 IEEE, pages 1--5. IEEE, 2010.Google ScholarCross Ref
- J. D. Hunter et al. Matplotlib: A 2d graphics environment. Computing in science and engineering, 9(3):90--95, 2007. Google ScholarDigital Library
- G. ITU-T RECOMMENDATION. 1071: Opinion model for network planning of video and audio streaming applications. 2015.Google Scholar
- P. ITU-T RECOMMENDATION. 911: Subjective audiovisual quality assessment methods for multimedia applications. International Telecommunications Union, Geneva, 1998.Google Scholar
- P. ITU-T RECOMMENDATION. 1201: Parametric non-intrusive assessment of audiovisual media streaming quality. 2012.Google Scholar
- C. Keimel, A. Redl, and K. Diepold. The tum high definition video datasets. In Quality of Multimedia Experience (QoMEX), 2012 Fourth International Workshop on, pages 97--102. IEEE, 2012.Google ScholarCross Ref
- T. Maki, D. Kukolj, D. Dordevic, and M. Varela. A reduced-reference parametric model for audiovisual quality of iptv services. In Quality of Multimedia Experience (QoMEX), 2013 Fifth International Workshop on, pages 6--11. IEEE, 2013.Google ScholarCross Ref
- M. Pinson. The consumer digital video library {best of the web}. Signal Processing Magazine, IEEE, 30(4):172--174, 2013.Google ScholarCross Ref
- M. Pinson, C. Schmidmer, L. Janowski, R. Pépion, Q. Huynh-Thu, P. Corriveau, A. Younkin, P. Le Callet, M. Barkowsky, and W. Ingram. Subjective and objective evaluation of an audiovisual subjective dataset for research and development. In Quality of Multimedia Experience (QoMEX), 2013 Fifth International Workshop on, 2013.Google ScholarCross Ref
- M. H. Pinson, L. Janowski, R. Pépion, Q. Huynh-Thu, C. Schmidmer, P. Corriveau, A. Younkin, P. L. Callet, M. Barkowsky, and W. Ingram. The influence of subjects and environment on audiovisual subjective tests: An international study. Selected Topics in Signal Processing, IEEE Journal of, 6(6):640--651, 2012.Google Scholar
- W. Robitza, Y. Pitrey, M. Nezveda, S. Buchinger, and H. Hlavacs. Made for mobile: a video database designed for mobile television. In Sixth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), 2012.Google Scholar
- G. Team. Gstreamer: open source multimedia framework.Google Scholar
- S. Zielinski. On some biases encountered in modern listening tests. Proc. of Spatial Audio & Sensory Evaluation Techniques, 2006.Google Scholar
Index Terms
- INRS Audiovisual Quality Dataset
Recommendations
Machine Learning--Based Parametric Audiovisual Quality Prediction Models for Real-Time Communications
In order to mechanically predict audiovisual quality in interactive multimedia services, we have developed machine learning--based no-reference parametric models. We have compared Decision Trees--based ensemble methods, Genetic Programming and Deep ...
Real-time objective quality assessment based on coding parameters extracted from H.264/AVC bitstream
In this paper, we propose a new method for objective video quality assessment from coding parameters of an H.264/AVC bitstream as a hybrid/bitstream category. Conventional image and video quality assessment methods evaluate image or video quality using ...
Perceived Audiovisual Quality of Low-Bitrate Multimedia Content
This paper studies the quality of multimedia content at very low bitrates. We carried out subjective experiments for assessing audiovisual, audio-only, and video-only quality. We selected content and encoding parameters that are typical of mobile ...
Comments