Maarten Wijnants
Gustavo Rovelo
ABSTRACT
The bulk of contemporary online video traffic is encoded in a traditional manner, hereby neglecting most, if not all, of the semantics of the underlying visual scene. One essential piece of semantic information in the context of video streaming is awareness of the objects that jointly constitute the scene. A canonical example of a benefit associated with such object awareness is the ability to subdivide a video fragment in respectively a background and one or more foreground objects. This paper reports on a pragmatically designed video streaming approach that exploits object-related knowledge in order to improve the real-time adaptability of video streaming sessions (manifested in the form of increased granularity in terms of streaming quality control). The proposed approach is completely compliant with present-day video codecs and HTTP Adaptive Streaming schemes, most notably H.264 and MPEG-DASH. Findings from subjecting the proposed video streaming technique to a comparative subjective evaluation suggest that scenarios exist where the presented approach holds the capacity to improve on traditional streaming in terms of user-perceived video quality.
- Adobe After Effects CC tutorials. Use the Roto Brush. Online, https://helpx.adobe.com/after-effects/how-to/aftereffects-roto-brush-cc.html, 2016.Google Scholar
- P. R. Alface, J.-F. Macq, F. Lee, and W. Bailer. Adaptive coding of high-resolution panoramic video using visual saliency. In Proceedings of the 1st International Workshop on Interactive Content Consumption at EuroITV 2013, June 2013.Google Scholar
- S. A. Goor and L. Murphy. An adaptive MPEG-4 streaming system based on object prioritisation. In Proceedings of Irish Signals and Systems Conference, July 2003.Google Scholar
- A. Hakeem, K. Shafique, and M. Shah. An object-based video coding framework for video sequences obtained from static cameras. In Proceedings of ACM MULTIMEDIA '05, pages 608--617, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
- M.-H. Hsiao, H.-P. Kuo, H.-C. Wu, Y.-K. Chen, and S.-Y. Lee. Object-based video streaming technique with application to intelligent transportation systems. In IEEE International Conference on Networking, Sensing and Control, volume 1, pages 315--320, March 2004.Google ScholarCross Ref
- ISO/IEC 14496--2:1999. Information technology -- Coding of audio-visual objects -- Part 2: Visual, 1999.Google Scholar
- ISO/IEC 23009--1. Information technology -- Dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats, 2014.Google Scholar
- ITU-T P.910. Subjective video quality assessment methods for multimedia applications, April 2008.Google Scholar
- D. Kimber, T. Dunnigan, A. Girgensohn, F. Shipman, T. Turner, and T. Yang. Trailblazing: Video playback control by direct object manipulation. In 2007 IEEE International Conference on Multimedia and Expo, pages 1015--1018, July 2007.Google ScholarCross Ref
- C. Nguyen, Y. Niu, and F. Liu. Direct manipulation video navigation in 3D. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, pages 1169--1172, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- S. Péchard, R. Pépion, and P. L. Callet. Suitable methodology in subjective video quality assessment: A resolution dependent paradigm. In International Workshop on Image Media Quality and its Applications, IMQA2008, Kyoto, Japan, September 2008.Google Scholar
- S. Poullot and S. Satoh. VabCut: A video extension of GrabCut for unsupervised video foreground object segmentation. In 2014 International Conference on Computer Vision Theory and Applications, volume 2, pages 362--371, January 2014.Google Scholar
- A. Puri and A. Eleftheriadis. MPEG-4: An object-based multimedia coding standard supporting mobile applications. Mobile Networks and Applications, 3(1):5--32, June 1998. Google ScholarDigital Library
- P. Quax, P. Issaris, W. Vanmontfort, and W. Lamotte. Evaluation of distribution of panoramic video sequences in the eXplorative Television project. In 22nd International Workshop on Network and Operating System Support for Digital Audio and Video, NOSSDAV '12, pages 45--50, New York, NY, USA, 2012. ACM. Google ScholarDigital Library
- H. Schwarz, D. Marpe, and T. Wiegand. Overview of the Scalable Video Coding extension of the H.264/AVC standard. IEEE Transactions on Circuits and Systems for Video Technology, 17(9):1103--1120, September 2007. Google ScholarDigital Library
- A. Vetro and H. Sun. An overview of MPEG-4 object-based encoding algorithms. In International Conference on Information Technology: Coding and Computing, pages 366--369, April 2001. Google ScholarDigital Library
- A. Vetro, H. Sun, and Y. Wang. Object-based transcoding for adaptable video content delivery. IEEE Transactions on Circuits and Systems for Video Technology, 11(3):387--401, March 2001. Google ScholarDigital Library
- W3C Candidate Recommendation. Media Source Extensions. Online, https://www.w3.org/TR/media-source/, November 2015.Google Scholar
- H. Wang, V.-T. Nguyen, W. T. Ooi, and M. C. Chan. Mixing tile resolutions in tiled video: A perceptual quality assessment. In 24th International Workshop on Network and Operating System Support on Digital Audio and Video, NOSSDAV '14, pages 25--30, New York, NY, USA, 2014. ACM. Google ScholarDigital Library
- J. Wuenschmann, T. Roll, C. Feller, and A. Rothermel. Analysis and improvements to the object based video encoder MPEG 4 part 25. In 2011 IEEE International Conference on Consumer Electronics - Berlin, pages 115--119, September 2011.Google ScholarCross Ref
Index Terms
- A Pragmatically Designed Adaptive and Web-compliant Object-based Video Streaming Methodology: Implementation and Subjective Evaluation
Recommendations
Standards-compliant HTTP adaptive streaming of static light fields
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyStatic light fields are an effective technology to precisely visualize complex inanimate objects or scenes, synthetic and real-world alike, in Augmented, Mixed and Virtual Reality contexts. Such light fields are commonly sampled as a collection of 2D ...
An evaluation of dynamic adaptive streaming over HTTP in vehicular environments
MoVid '12: Proceedings of the 4th Workshop on Mobile VideoMPEGs' Dynamic Adaptive Streaming over HTTP (MPEG-DASH) is an emerging standard designed for media delivery over the top of existing infrastructures and able to handle varying bandwidth conditions during a streaming session. This requirement is very ...
Split & Dual Screen Comparison of Classic vs Object-based Video
MM '19: Proceedings of the 27th ACM International Conference on MultimediaOver-the-top (OTT) streaming services like YouTube and Netflix induce massive amounts of video data, hereby putting substantial pressure on network infrastructure. This paper describes a demonstration of the object-based video (OBV) methodology that ...
Comments