skip to main content
10.1145/3503161.3548543acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

OpenHardwareVC: An Open Source Library for 8K UHD Video Coding Hardware Implementation

Published: 10 October 2022 Publication History

Abstract

The hardware-accelerated real-time compression of 8K Ultra-High-Definition (UHD) video is an exemplary application that empowered by the latest video coding standard. However, the coding tools added to the recently released third-generation audio video coding standard (AVS3) greatly increase the coding complexity, which seriously hinders the efficient implementation of hardware encoder. In order to break the known bottleneck, this paper presents the first open source software library for 8K UHD video coding hardware implementation, namely OpenHardwareVC. Specifically, based on the analysis of the original AVS3 software algorithm, we provide the hardware acceleration designs of the four major coding stages, including coding unit (CU) partition, intra prediction, transform and entropy coding, in this library. Simulation results on Xilinx VU440 FPGA show that the real-time compression of 8K UHD videos at 30 frames per second (fps) can be easily supported based on software-described modules packaged in this library. The release of this library is quite favorable for the hardware design and system implementation of UHD video coding, which is also beneficial to the promotion of the new coding standard. The open source library for OpenHardwareVC is available at https://git.openi.org.cn/OpenHardwareVC.

Supplementary Material

MP4 File (MM22-os12.mp4)
Presentation video

References

[1]
Nasir Ahmed, T_ Natarajan, and Kamisetty R Rao. 1974. Discrete cosine transform. IEEE transactions on Computers 100, 1 (1974), 90--93.
[2]
G. Bjøntegaard. VCEG, Austin, TX, USA, Doc. VCEG-M33, 2018. Calculation of average PSNR differences between RD-curves. (VCEG, Austin, TX, USA, Doc. VCEG-M33, 2018).
[3]
Zhanyuan Cai and Wei Gao. 2021. Efficient Fast Algorithm and Parallel Hardware Architecture for Intra Prediction of AVS3. In International Symposium on Circuits and Systems (ISCAS). IEEE, 1--5.
[4]
Young-Kyu Choi, Hyuk-Jae Lee, and Soo-Ik Chae. 2021. High Throughput CBAC Hardware Encoder With Bin Merging for AVS 2.0 Video Coding. IEEE Transactions on Circuits and Systems for Video Technology 31, 11 (2021), 4439--4453. https://doi.org/10.1109/TCSVT.2020.3047925
[5]
Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM 51, 1 (Jan. 2008), 107--113. https://doi.org/10.1145/1327452.1327492
[6]
Wen Gao and Siwei Ma. 2014. An overview of AVS2 standard. Advanced Video Coding Systems 22 (Jan. 2014), 35--49.
[7]
Yang Guo, Wei Gao, Siwei Ma, and Ge Li. 2022. Accelerating Transform Algorithm Implementation for Efficient Intra Coding of 8K UHD Videos. ACM Trans. Multimedia Comput. Commun. Appl. 18, 4, Article 113 (mar 2022), 20 pages. https://doi.org/10.1145/3507970
[8]
Z. Liu, X. Yu, Y. Gao, S. Chen, X. Ji, and D. Wang. 2016. CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network. IEEE Transactions on Image Processing 25, 11 (2016), 5088--5103. https://doi.org/10.1109/TIP.2016.2601264
[9]
Grzegorz Pastuszak. 2019. Generative multi-symbol architecture of the binary arithmetic coder for UHDTV video encoders. IEEE Transactions on Circuits and Systems I: Regular Papers 67, 3 (2019), 891--902.
[10]
Grzegorz Pastuszak. 2020. Multisymbol architecture of the entropy coder for H.265/HEVC video encoders. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 28, 12 (2020), 2573--2583.
[11]
PP8KLite 2021. Peking University and Peng Cheng Laboratory 8K Dataset - Lite Version. Retrieved Jan, 2022 from https://git.openi.org.cn/gaowei262/PP8KLite
[12]
Masayuki Sugawara, Seo-Young Choi, and David Wood. 2014. Ultra-High-Definition Television (Rec. ITU-R BT.2020): A Generational Leap in the Evolution of Television [Standards in a Nutshell]. IEEE Signal Processing Magazine 31, 3 (2014), 170--174. https://doi.org/10.1109/MSP.2014.2302331
[13]
G.J. Sullivan and T. Wiegand. 1998. Rate-distortion optimization for video compression. IEEE Signal Processing Magazine 15, 6 (1998), 74--90. https://doi.org/10.1109/79.733497
[14]
Heming Sun, Dajiang Zhou, Landan Hu, Shinji Kimura, and Satoshi Goto. 2017. Fast Algorithm and VLSI Architecture of Rate Distortion Optimization in H.265/HEVC. IEEE Transactions on Multimedia 19, 11 (2017), 2375--2390. https://doi.org/10.1109/TMM.2017.2700629
[15]
Lvfang Tao and Wei Gao. 2022. Low Power Entropy Coding Hardware Design for H.264/AVC Baseline Profile Encoder. In IEEE International Conference on Multimedia and Expo (in press).
[16]
Vivado 2019. UltraScale FPGA Product Tables and Product Selection Guide. Retrieved Aug, 2021 from https://www.xilinx.com/support/documentation/selection-guides/ultrascale-fpga-product-selection-guide.pdf
[17]
Meng Wang, Junru Li, Li Zhang, Kai Zhang, Hongbin Liu, Shiqi Wang, Sam Kwong, and Siwei Ma. 2020. Extended Coding Unit Partitioning for Future Video Coding. IEEE Transactions on Image Processing 29 (2020), 2931--2946. https://doi.org/10.1109/TIP.2019.2955238
[18]
Audio Video Coding Standard Workgroup. 2019. AVS Proposal M4772: Implicit selection of transforms for intra coding. ftp://47.93.196.121/Public/avsdoc/1906_Chengdu/contrib/M4772.zip. Accessed in May 2022.
[19]
Jiaqi Zhang, Chuanmin Jia, Meng Lei, Shanshe Wang, Siwei Ma, and Wen Gao. 2019. Recent development of AVS video coding standard: AVS3. In Picture Coding Symposium (PCS). IEEE, 1--5.
[20]
Jia Zhu, Zhenyu Liu, Dongsheng Wang, Qingrui Han, and Yang Song. 2013. Fast prediction mode decision with hadamard transform based rate-distortion cost estimation for HEVC intra coding. In 2013 IEEE International Conference on Image Processing. 1977--1981. https://doi.org/10.1109/ICIP.2013.6738407.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '22: Proceedings of the 30th ACM International Conference on Multimedia
October 2022
7537 pages
ISBN:9781450392037
DOI:10.1145/3503161
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 8k uhd
  2. hardware implementation
  3. open source software
  4. real-time coding
  5. video coding

Qualifiers

  • Short-paper

Funding Sources

  • Shenzhen Fundamental Research Program
  • The Major Key Project of PCL
  • Shenzhen Science and Technology Plan Basic Research Project
  • National Key R&D Program of China
  • Natural Science Foundation of China
  • Guangdong Basic and Applied Basic Research Foundation

Conference

MM '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)3
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media