skip to main content
10.1145/3447450.3447479acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicvipConference Proceedingsconference-collections
research-article

On the Performance Evaluation of State-of-the-art Rate Control Algorithms for Practical Video Coding and Transmission Systems

Published: 09 April 2021 Publication History

Abstract

The existing rate control (RC) algorithms are actually evaluated using single objectives, however many aspects can jointly affect the performances of practical video coding and transmission systems. In this paper, we first identify the key factors for RC performance assessment, and then introduce the joint RC performance (JRCP) evaluation method for comprehensive consideration of involved many objectives. Second, we investigate the effective strategies to normalize each item from the comparative perspective to make them aggregated for fair comparison. Finally, we conduct experiments based on the latest H.265/HEVC reference software to evaluate the performances of different state-of-the-art RC algorithms, and demonstrate the usage and applicability of proposed method. Additionally, the weighting strategy can be easily and flexibly configured according to the particular demands of practical video applications. Based on the proposed method, we also would like to draw the attention from the video coding and communication community, and the video encoder and transmission systems can be better optimized for visual experience enhancement in practical systems.

References

[1]
G. J. Sullivan, J. R. Ohm, W.-J. Han, and T. Wiegand, “Overview of the High Efficiency Video Coding (HEVC) standard,” IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1649-1668, Dec. 2012.
[2]
J.-R. Ohm, G. J. Sullivan, H. Schwarz, T. K. Tan, and T. Wiegand, “Comparison of the coding efficiency of video coding standards - Including High Efficiency Video Coding (HEVC),” IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1668-1683, Dec. 2012.
[3]
T. Wiegand, H. Schwarz, A. Joch, F. Kossentini and G. J. Sullivan, “Rate-constrained coder control and comparison of video coding standards,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 688-703, July 2003.
[4]
G. J. Sullivan and T. Wiegand, “Rate-distortion optimization for video compression,” IEEE Signal Processing Magazine, vol. 15, no. 6, pp. 74-90, Nov. 1998.
[5]
A. Ortega and K. Ramchandran, “Rate-distortion methods for image and video compression,” IEEE Signal Processing Magazine, vol. 15, no. 6, pp. 23-50, Nov. 1998.
[6]
W. Gao, S. Kwong, H. Yuan and X. Wang, “DCT coefficient distribution modeling and quality dependency analysis based frame-level bit allocation for HEVC,” IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 1, pp. 139-153, Jan. 2016.
[7]
W. Gao, S. Kwong, Y. Zhou and H. Yuan, “SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation,” IEEE Trans. Multimedia, vol. 18, no. 6, pp. 988-999, Jun. 2016.
[8]
B. Li, H. Li, L. Li and J. Zhang, “λ Domain Rate Control Algorithm for High Efficiency Video Coding,” IEEE Trans. Image Process., vol. 23, no. 9, pp. 3841-3854, Sept. 2014.
[9]
C. Seo, J. Moon and J. Han, “Rate Control for Consistent Objective Quality in High Efficiency Video Coding,” IEEE Trans. Image Process., vol. 22, no. 6, pp. 2442-2454, June 2013.
[10]
M. Wang, K. N. Ngan and H. Li, “Low-Delay Rate Control for Consistent Quality Using Distortion-Based Lagrange Multiplier,” IEEE Trans. Image Process., vol. 25, no. 7, pp. 2943-2955, July 2016.
[11]
W. Gao, S. Kwong and Y. Jia, “Joint Machine Learning and Game Theory for Rate Control in High Efficiency Video Coding,” IEEE Trans. Image Process., vol. 26, no. 12, pp. 6074-6089, Dec. 2017.
[12]
W. Gao, S. Kwong, Q. Jiang, C. Fong, P. H. W. Wong and W. Y. F. Yuen, “Data-Driven Rate Control for Rate-Distortion Optimization in HEVC Based on Simplified Effective Initial QP Learning,” IEEE Trans. Broadcast., vol. 65, no. 1, pp. 94-108, March 2019.
[13]
Multi-objective optimization. [Online]. Available: https://en.wikipedia.org/wiki/Multi-objective_optimization.
[14]
H. Ishibuchi, N. Tsukamoto and Y. Nojima, “Evolutionary many-objective optimization: A short review,” 2008 IEEE Congress on Evolutionary Computation, Hong Kong, 2008, pp. 2419-2426.
[15]
C. Purshouse and P. J. Fleming, “On the evolutionary optimization of many conflicting objectives,” IEEE Trans. Evolutionary Computation, vol. 11, no. 6, pp. 770-784, Dec. 2007.
[16]
G. Bjøntegaard, Calculation of Average PSNR Differences Between RD Curves, document VCEG-M33, Austin, TX, USA, Apr. 2001.
[17]
HEVC Reference Software HM-16.19. [Online]. Available: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/ tags/HM-16.19.
[18]
W. Gao, L. Tao, L. Zhou, D. Yang, X. Zhang and Z. Guo, “Low-rate Image Compression with Super-resolution Learning,” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 2020, pp. 607-610.
[19]
Yuan, S. Kwong, X. Wang, W. Gao and Y. Zhang, “Rate Distortion Optimized Inter-View Frame Level Bit Allocation Method for MV-HEVC,” IEEE Transactions on Multimedia, vol. 17, no. 12, pp. 2134-2146, Dec. 2015.
[20]
W. Gao and S. Kwong, “Phase Congruency based edge saliency detection and rate control for perceptual image and video coding,” 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, 2016, pp. 264-269.
[21]
M. Zhou, “SSIM-Based Global Optimization for CTU-Level Rate Control in HEVC,” IEEE Transactions on Multimedia, vol. 21, no. 8, pp. 1921-1933, Aug. 2019.
[22]
Q. Jiang, F. Shao, W. Gao, Z. Chen, G. Jiang and Y. Ho, “Unified No-Reference Quality Assessment of Singly and Multiply Distorted Stereoscopic Images,” IEEE Transactions on Image Processing, vol. 28, no. 4, pp. 1866-1881, April 2019.
[23]
Q. Jiang, F. Shao, W. Gao, H. Li and Y. Ho, “A Risk-Aware Pairwise Rank Learning Approach for Visual Discomfort Prediction of Stereoscopic 3D,” IEEE Signal Processing Letters, vol. 26, no. 11, pp. 1588-1592, Nov. 2019.
[24]
Q. Jiang, “Blind Image Quality Measurement by Exploiting High-Order Statistics With Deep Dictionary Encoding Network,” IEEE Transactions on Instrumentation and Measurement, vol. 69, no. 10, pp. 7398-7410, Oct. 2020.
[25]
W. Gao, “A Multi-Objective Optimization Perspective for Joint Consideration of Video Coding Quality,” 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Lanzhou, China, 2019, pp. 986-991.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICVIP '20: Proceedings of the 2020 4th International Conference on Video and Image Processing
December 2020
255 pages
ISBN:9781450389075
DOI:10.1145/3447450
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Comprehensive Performance Evaluation
  2. Practical Video Coding and Transmission Systems
  3. Rate Control Optimization

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Shenzhen Science and Technology Plan Basic Research Project
  • Start-up Fund of Shenzhen Graduate School of Peking University
  • Ministry of Science and Technology of China - Science and Technology Innovations 2030
  • Open Projects Program of National Laboratory of Pattern Recognition (NLPR)
  • CCF-Tencent Open Fund
  • Guangdong Basic and Applied Basic Research Foundation
  • Open Project Program of the State Key Lab of CAD&CG, Zhejiang University
  • Tencent Holdings Ltd (Tencent Basic Platform Project)
  • Natural Science Foundation of China

Conference

ICVIP 2020

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media