tutorial

Mixing Tile Resolutions in Tiled Video: A Perceptual Quality Assessment

Authors:

Hui Wang,

Vu-Thanh Nguyen,

Wei Tsang Ooi,

Mun Choon ChanAuthors Info & Claims

NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop

Pages 25 - 30

https://doi.org/10.1145/2597176.2578267

Published: 19 March 2014 Publication History

Get Access

Abstract

The mismatch between increasingly large video resolution and constrained screen size of mobile devices has led to the proposal of zoomable video systems based on tiled video. In the current system, a tiled video frame is constructed from multiple tiles in a single resolution stream. In this paper, we explore the perceptual effect of mixed-resolution tiles in tiled video, in which tiles within a video frame could come from streams with different resolutions, with the aim to tradeoff bandwidth and perceptual video quality. To understand how users perceive the video quality of mixed-resolution tiled video, we conducted a psychophysical study with 50 participants on tiled videos where the tile resolutions are randomly chosen from two resolution levels with equal probability. The experiment results show that in many cases, we can mix tiles from HD (1920×1080p) stream and tiles from 1600×900p stream without being noticed by the viewers. Even when participants notice quality degradation in videos combined with tiles from HD stream and tiles from 960×540p stream, the majority of participants still accept the degradation when viewing videos with low and medium motion; and greater than 40% of participants accept the quality degradation when viewing video with dense motion.

References

[1]

D Varuna SX De Silva, Warnakulasuriya Anil Chandana Fernando, Gokce Nur, Erhan Ekmekcioglu, and Stewart T Worrall. 3d video assessment with just noticeable difference in depth evaluation. In Image Processing (ICIP), 2010 17th IEEE International Conference on, pages 4013--4016. IEEE, 2010.

Crossref

Google Scholar

[2]

Wu-chi Feng, Thanh Dang, John Kassebaum, and Tim Bauman. Supporting region-of-interest cropping through constrained compression. In Proceedings of the 16th ACM international conference on Multimedia, pages 745--748. ACM, 2008.

Digital Library

Google Scholar

[3]

Wu-chi Feng, Thanh Dang, John Kassebaum, and Tim Bauman. Supporting region-of-interest cropping through constrained compression. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 7(3):17, 2011.

Digital Library

Google Scholar

[4]

George A Gescheider. Psychophysics: the fundamentals. Psychology Press, 1997.

Google Scholar

[5]

Aditya Mavlankar, Pierpaolo Baccichet, David Varodayan, and Bernd Girod. Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality. In EUSIPCO, 2007.

Google Scholar

[6]

Aditya Mavlankar, David Varodayan, and Bernd Girod. Region-of-interest prediction for interactively streaming regions of high resolution video. In Packet Video. IEEE, 2007.

Google Scholar

[7]

Ngo Quang Minh Khiem, Guntur Ravindra, Axel Carlier, and Wei Tsang Ooi. Supporting zoomable video streams with dynamic region-of-interest cropping. In MMSys. ACM, 2010.

Digital Library

Google Scholar

[8]

Ngo Quang Minh Khiem, Guntur Ravindra, and Wei Tsang Ooi. Adaptive encoding of zoomable video streams based on user access pattern. In MMSys. ACM, 2011.

Digital Library

Google Scholar

[9]

Aniruddha Sinha, Gaurav Agarwal, and Alwin Anbu. Region-of-interest based compressed domain video transcoding scheme. In Acoustics, Speech, and Signal Processing, 2004. Proceedings.(ICASSP'04). IEEE International Conference on, volume 3, pages iii--161. IEEE, 2004.

Google Scholar

[10]

Ray van Brandenburg, Omar Niamut, Martin Prins, and Hans Stokking. Spatial segmentation for immersive media delivery. In ICIN. IEEE, 2011.

Crossref

Google Scholar

[11]

Haohong Wang and Khaled El-Maleh. Joint adaptive background skipping and weighted bit allocation for wireless video telephony. In Wireless Networks, Communications and Mobile Computing, 2005 International Conference on, volume 2, pages 1243--1248. IEEE, 2005.

Google Scholar

[12]

Haohong Wang, Yi Liang, and Khaled El-Maleh. Real-time region-of-interest video coding using content-adaptive background skipping with dynamic bit reallocation. In Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings. 2006 IEEE International Conference on, volume 2, pages II--II. IEEE, 2006.

Google Scholar

[13]

Wanmin Wu, Ahsan Arefin, Gregorij Kurillo, Pooja Agarwal, Klara Nahrstedt, and Ruzena Bajcsy. Color-plus-depth level-of-detail in 3d tele-immersive video: a psychophysical approach. In Proceedings of the 19th ACM international conference on Multimedia, pages 13--22. ACM, 2011.

Digital Library

Google Scholar

Cited By

View all

Yaqoob AMuntean G(2023)Advanced Predictive Tile Selection Using Dynamic Tiling for Prioritized 360° Video VR StreamingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/360314620:1(1-28)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1145/3603146
Han YAldaif AYuan HZhong YZheng YLiao YLi Q(2023)QoE-aware 360-degree Video Streaming for Autonomous Vehicles2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring)10.1109/VTC2023-Spring57618.2023.10201215(1-5)Online publication date: Jun-2023
https://doi.org/10.1109/VTC2023-Spring57618.2023.10201215
Mahmoud MRizou SPanayides AKantartzis NKaragiannidis GLazaridis PZaharis Z(2023)A Survey on Optimizing Mobile Delivery of 360° Videos: Edge Caching and MulticastingIEEE Access10.1109/ACCESS.2023.329233511(68925-68942)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3292335
Show More Cited By

Index Terms

Mixing Tile Resolutions in Tiled Video: A Perceptual Quality Assessment
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
  2. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

Tile Rate Allocation for 360-Degree Tiled Adaptive Video Streaming
MM '20: Proceedings of the 28th ACM International Conference on Multimedia

360-degree video streaming commonly encodes and transmits the video as independently-decodable tiles to conserve bandwidth of regions out of the viewer's field of view (FoV). The bitrate of the tiles, however, can vary significantly across the tiles, ...
Mixing Tile Resolutions in Tiled Video: A Perceptual Quality Assessment
NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop

The mismatch between increasingly large video resolution and constrained screen size of mobile devices has led to the proposal of zoomable video systems based on tiled video. In the current system, a tiled video frame is constructed from multiple tiles ...
On tile assignment for region-of-interest video streaming in a wireless LAN
NOSSDAV '12: Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and Video

We consider the following problem in this paper: A video is encoded as a set of tiles T and is streamed to multiple users via a one-hop wireless LAN. Each user selects a region-of-interest (RoI), represented as a subset of T, in the video to watch. The ...

Comments

Information & Contributors

Information

Published In

NOSSDAV '14: Proceedings of Network and Operating System Support on Digital Audio and Video Workshop

March 2014

125 pages

ISBN:9781450327060

DOI:10.1145/2597176

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial
Research
Refereed limited

Conference

MMSys '14

Sponsor:

SIGMM

MMSys '14: Multimedia Systems Conference 2014

March 19 - 21, 2014

Singapore, Singapore

Acceptance Rates

NOSSDAV '14 Paper Acceptance Rate 18 of 56 submissions, 32%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
409
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yaqoob AMuntean G(2023)Advanced Predictive Tile Selection Using Dynamic Tiling for Prioritized 360° Video VR StreamingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/360314620:1(1-28)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1145/3603146
Han YAldaif AYuan HZhong YZheng YLiao YLi Q(2023)QoE-aware 360-degree Video Streaming for Autonomous Vehicles2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring)10.1109/VTC2023-Spring57618.2023.10201215(1-5)Online publication date: Jun-2023
https://doi.org/10.1109/VTC2023-Spring57618.2023.10201215
Mahmoud MRizou SPanayides AKantartzis NKaragiannidis GLazaridis PZaharis Z(2023)A Survey on Optimizing Mobile Delivery of 360° Videos: Edge Caching and MulticastingIEEE Access10.1109/ACCESS.2023.329233511(68925-68942)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3292335
Wang SYang SLi HZhang XZhou CXu CQian FWang NXu Z(2022)SalientVRProceedings of the 28th Annual International Conference on Mobile Computing And Networking10.1145/3495243.3517018(542-555)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.1145/3495243.3517018
Fan CHung THsu C(2022)Modeling the User Experience of Watching 360° Videos with Head-Mounted DisplaysACM Transactions on Multimedia Computing, Communications, and Applications10.1145/346382518:1(1-23)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3463825
Vats SPark JNahrstedt KZink MSitaraman RHellwagner H(2022)Semantic-Aware View Prediction for 360-Degree Videos at the 5G Edge2022 IEEE International Symposium on Multimedia (ISM)10.1109/ISM55400.2022.00025(121-128)Online publication date: Dec-2022
https://doi.org/10.1109/ISM55400.2022.00025
Park J(2021)Multi-Session Multicasting for 360-Degree Video Multicast over OFDMA SystemsInternational Journal of Digital Multimedia Broadcasting10.1155/2021/55603122021(1-19)Online publication date: 16-Jun-2021
https://doi.org/10.1155/2021/5560312
Long KCui YYe CLiu Z(2021)Optimal Wireless Streaming of Multi-Quality 360 VR Video By Exploiting Natural, Relative Smoothness-Enabled, and Transcoding-Enabled Multicast OpportunitiesIEEE Transactions on Multimedia10.1109/TMM.2020.302988023(3670-3683)Online publication date: 2021
https://doi.org/10.1109/TMM.2020.3029880
Hristova HSimon GCorbillon XDevlic ASwaminathan V(2021)Heterogeneous Spatial Quality for Omnidirectional VideoIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.300762031:4(1411-1424)Online publication date: Apr-2021
https://doi.org/10.1109/TCSVT.2020.3007620
Shang SWang YLiu Y(2021)Gbk360: A Game Among Tiles In 360 Video Based On Kalman Filter2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW53276.2021.9455996(1-6)Online publication date: 5-Jul-2021
https://doi.org/10.1109/ICMEW53276.2021.9455996
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Tile Rate Allocation for 360-Degree Tiled Adaptive Video Streaming