ABSTRACT
Video over the internet has drastically grown these past years, currently representing more than 80% of the internet bandwidth [3]. The massive usage of unicast delivery leads to network congestion that can result in poor quality of experience for the viewer, high delivery cost for operators and increased energy consumption. The current methods for adaptive video streaming rely more on maximizing the video quality for a given bandwidth rather than minimizing the end-to-end (from video server to end-user display) energy consumption for a given level of quality. This paper aims at leveraging recently standardized delivery and coding technologies to maintain the video quality while monitoring and reducing video energy footprint and delivery costs.
The Versatile Video Coding (VVC) [2] recently issued by ISO/IEC and ITU-T is used to further reduce video services bandwidth over previous video coding solutions, in particular its predecessor HEVC [10]. Compared to HEVC, VVC enables around 50% of bandwidth saving, at an equivalent video quality [12]. This performance is achieved by extending existing HEVC coding tools and by introducing new ones. VVC also brings new high-level features to better address new use-cases and applications (e.g variable resolution, scalability, 360° and screen-content coding). This paper uses ATEME Titan encoder while the decoding is performed by a real time software decoder OpenVVC. This latter is a cross-platform library that provides consumers with real time decoding capability under different OS including MAC OS, Windows, Linux and Android on Intel x86 and ARM platforms.
A dynamic video format selection is proposed to limit the distribution bandwidth and energy cost based on quality/complexity tradeoffs sent to the player. The carriage of such metadata is achieved by using the Green-MPEG [6] and DASH standard. A content mapping and video artefacts masking is implemented to counterbalance video degradation with post-processing. These are based on SEI messages such as CTI and Grain Synthesis recently standardized in the VSEI specification [5]. An energy reporting solution is proposed in order for the end-viewer to be informed of the energy impact and enabling manual adjustment the energy/quality tradeoff.
The Common Media Application Format (CMAF) is used to deliver the video segments over the network [5]. The carriage of video, audio and green metadata is based on the ISO/IEC Base Media File Format [7] (ISOBMFF). To save network traffic, the video segments can be either sent in unicast for low-audience services or in multicast for highly popular ones. The DASH/FLUTE stack is implemented as multicast protocol. The OTT services are delivered in the context of 3GPP Release 17 [1] and DVB-MABR Phase 2 network [4], including delivery over managed networks (IPTV) and mobile (4G-Lte and 5G).
The estimated energy saving for the proposed delivery infrastructure is the following. First, the bitrate saving brought by improved compression is estimated to be .05-0.1 Wh/bit for 1 bit of transmitted video [11], representing 37.5-75kWh saving for a 5Mbps HEVC HD service. Usage of SL-HDR is estimated to save 15-20% of display energy [9], and even more for a receiver fully leveraging Green metadata. For an average TV set [8], it represents a 21kWh saving. Finally, radio saving is more complex to estimate, but preliminary results show that saving from multicast starts from 1-8 User-Equipment (UE) in a cell.
This paper proposes an OTT delivery solution enabling operators and end-users to monitor and control their energy impact. At the headend side, metadata are generated by a pre-processing block and embedded in SEI messages. The encoder is leveraging VVC and CMAF to encapsulate video services together with the metadata. The delivery network is optimized by using DASH/FLUTE profile of DVB-MABR to save bandwidth when OTT content are delivered over IPTV or mobile networks. On end-user side, a real-time software VVC decoding and post-decoding processing are demonstrated. An end-to-end demonstrator is provided and evaluated to assess the relevance of the proposed method in a real environment.
- 3GPP TR 23.757. 2020. Study on architectural enhancements for 5G multicast-broadcast services.Google Scholar
- Benjamin Bross, Ye-Kui Wang, Yan Ye, Shan Liu, Jianle Chen, Gary J Sullivan, and Jens-Rainer Ohm. 2021. Overview of the versatile video coding (VVC) standard and its applications. IEEE Transactions on Circuits and Systems for Video Technology 31, 10 (2021), 3736--3764.Google ScholarCross Ref
- Cisco. 2020. Global - 2021 Forecast Highlights. https://www.cisco.com/c/dam/m/en_us/solutions/service-provider/vni-forecast-highlights/pdf/Global_2021_Forecast_Highlights.pdfGoogle Scholar
- DVB. 2020. Next steps confirmed for DVB work on Multicast ABR and Native IP. https://dvb.org/news/next-steps-confirmed-for-dvb-work-on-multicast-abr-and-native-ip/Google Scholar
- ITU-T Rec. H.274 (ex H.SEI) | ISO/IEC 23002-7:2020. 2020. Versatile supplemental enhancement information messages for coded video bitstreams.Google Scholar
- Felix C Fernandes, Xavier Ducloux, Zhan Ma, Esmaeil Faramarzi, Patrick Gendron, and Jiangtao Wen. 2015. The green metadata standard for energy-efficient video consumption. IEEE MultiMedia 22, 1 (2015), 80--87.Google ScholarDigital Library
- ISO/IEC. 2020. 23000-19:2020 Information technology - Multimedia application format (MPEG-A) - Part 19: Common Media Application Format (CMAF) for segmented media.Google Scholar
- Eco Cost Savings. 2021. TV Wattage - 2022's Most Efficient TVs Revealed [With Data]. https://ecocostsavings.com/tv-wattage/Google Scholar
- Michael Scholand, Robert Harrison, and Marie Baton. 2017. Measurement of automatic brightness control in televisions - critical for effective policy-making. In eceee Summer Study Proceedings. European Council for an Energy Efficient Economoy (ECEEE).Google Scholar
- Gary J Sullivan, Jens-Rainer Ohm, Woo-Jin Han, and Thomas Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on circuits and systems for video technology 22, 12 (2012), 1649--1668.Google ScholarDigital Library
- Carbon Trust. 2021. Carbon impact of video streaming. https://www.carbontrust.com/resources/carbon-impact-of-video-streamingGoogle Scholar
- Mathias Wien and Vittorio Baroncini. 2021. VVC Verification Test Report for High Definition (HD) and 360 Standard Dynamic Range (SDR) Video Content. In doc. JVET-V2020 of ITU-T/ISO/IEC Joint Video Experts Team (JVET), 22st JVET meeting: April.Google Scholar
Index Terms
- Sustainable OTT video distribution powered by 5G-multicast/unicast delivery and versatile video coding
Recommendations
Live OTT services delivery with Ad-insertion using VVC, CMAF-LL and ROUTE: an end-to-end chain
MHV '22: Proceedings of the 1st Mile-High Video ConferenceDuring the past decade, broadcasting has been challenged by OTT services, offering a more personalized and flexible way of experiencing the content. The on-demand features paved the way for new media delivery paradigms, replacing traditional MPEG-TS ...
Delivering universal TV services in a multi-network and multi-device world with DVB-I
MHV '22: Proceedings of the 1st Mile-High Video ConferenceThe TV landscape went through significant changes during the past decades. The traditional broadcast switched from analog to digital thanks to new modulation, transport and coding systems. In the meantime, internet brought new ways of experiencing TV ...
Multi-view video coding based on high efficiency video coding
PSIVT'11: Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part IIMultiview video coding is one of the key techniques to realize the 3D video system. MPEG started a standardization activity on 3DVC (3D video coding) in 2007. 3DVC is based on multiview video coding. MPEG finalized the standard for multiview video ...
Comments