Skip to main content
SpringerLink
Log in

A low delay rate control method for screen content coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

A Correction to this article was published on 24 July 2020

This article has been updated

Abstract

Unlike conventional camera captured video (CCV), the screen content video (SCV) is generated by computer, like text, animation, or graphics. The SCV contents are discontinuous, as one abrupt frame is often followed by many static frames. These distinct characteristics bring challenges to the implementation of rate control in screen content coding (SCC). This paper proposes a low delay rate control method for SCC in HEVC (High Efficiency Video Coding). Firstly, a bit allocation scheme considering buffer status and picture complexity is proposed. Then, an R − MAD (Rate-Mean Absolute Difference)model is built to estimate frame QP (quantization parameter) according to allocated bits. Finally, a dynamical adjusting scheme is designed to fix the error of the estimated frame QP. Experimental results show that the proposed method could effectively avoid buffer overflow and improve the coding efficiency over the recommended rate control scheme in HEVC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Change history

  • 24 July 2020

    In the original publication, the corresponding author���s affiliation was incorrect. The correct affiliation is presented in this erratum. The author regrets this mistake.

Notes

  1. complexity is measured by MAD [10]

References

  1. Ahn Y-J, Wu X, Sim D, Ryu H (2015) Improvement of coding efficiency for rate control under the constraint of HRD, Document: JCTVC-V0078, Geneva

  2. Ahn Y-J, Wu X, Sim D, Ryu H (2015) Target bits saturation to avoid CPB overflow and underflow under the constraint of HRD, Document: JCTVC-U0132, Warsaw

  3. Baroncini V, Yu H, Joshi R, Liu S, Xiu X, Xu J (2017) Draft of final report on SCC verification test, Document: JCTVC-AA0040, Hobart

  4. Bhoi SK, Khilar PM, Singh M, Sahoo RR, Swain RR (2018) A routing protocol for urban vehicular ad hoc networks to support non-safety applications. Digital Commun Netw 4(3):189–199

    Article  Google Scholar 

  5. Bjøntegaard G (2001) Calculation of Average PSNR Differences between RD-Curves, Document: VCEG-M33

  6. Bross B, Han W-J, Sullivan GJ, Ohm J-R, Wiegand T (2012) High Efficiency Video Coding (HEVC) Text Specification Draft 8, Document: JCTVC-J1003, Stockholm

  7. Chiang T, Zhang Y-Q (1997) A new rate control scheme using quadratic rate distortion model. IEEE Trans Circ Syst Video Technol 7(1):246–250

    Article  Google Scholar 

  8. Dong J, Ling N (2009) Context-adaptive prediction scheme for parameter estimation in h.264/AVC macroblock layer rate control. IEEE Trans Circ Syst Video Technol 19(8):1108–1117

    Article  Google Scholar 

  9. Guo Y, Li B, Sun S, Xu J (2015) Rate control for screen content coding based on picture classification. In: IEEE Visual Communications and Image Processing, pp 1–4

  10. Guo Y, Li B, Sun S, Xu J (2015) Rate control for screen content coding in HEVC. In: IEEE International Symposium on Circuits and Systems, pp 1118–1121

  11. HEVC reference software, https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.10+SCM-8.0/

  12. He Z, Kim YK, Mitra SK (2001) Low-delay rate control for DCT video coding via ρ-domain source modeling. IEEE Trans Circ Syst Video Technol 11(8):928–940

    Article  Google Scholar 

  13. Hu S, Wang H, Kwong S, Zhao T, Kuo C-CJ (2011) Rate control optimization for temporal-layer scalable video coding. IEEE Trans Circ Syst Video Technol 21(8):1152–1162

    Article  Google Scholar 

  14. Lan C, Shi G, Wu F (2010) Compress compound images in h.264/MPEG-4 AVC by exploiting spatial correlation. IEEE Trans Image Process 19(4):946–957

    Article  MathSciNet  Google Scholar 

  15. Li Z, Pan F, Pang K (2003) Adaptive basic unit layer rate control for JVT JVT-g012. Pattaya II, Thailand

    Google Scholar 

  16. Li B, Li H, Li L (2013) Adaptive bit allocation for R-λ model rate control in HM, Document: JCTVC-M0036, Incheon

  17. Li B, Li H, Li L, Zhang J (2014) λ-domain based rate control for high efficiency video coding, vol 23

  18. Li J, Li B, Xu J, Xiong R (2015) An Adaptive Hierarchical QP Setting for Screen Content Coding. In: IEEE Visual Communications and Image Processing, pp 1–4

  19. Li S, Xu M, Deng X, Wang Z (2015) Weight-based R-λ rate control for perceptual HEVC coding on conversational videos. Signal Process Image Commun 38:127–140

    Article  Google Scholar 

  20. Li S, Xu M, Wang Z (2015) A novel method on optimal bit allocation at LCU level for rate control in HEVC. In: IEEE International Conference on Multimedia and Expo, pp 1–6

  21. Liu Y, Li Z, Soh YC (2007) A novel rate control scheme for low delay video communication of h.264/AVC standard. IEEE Trans Circ Syst Video Technol 17 (1):68–78

    Article  Google Scholar 

  22. Liu Y, Li Z, Soh YC (2007) A novel rate control scheme for low delay video communication of h.264/AVC standard. IEEE Trans Circ Syst Video Technol 17 (1):68–78

    Article  Google Scholar 

  23. Liu M, Guo Y, Li H, Chen CW (2010) Low-complexity rate control based on ρ-domain model for scalable video coding. In: IEEE International Conference on Image Processing, pp 1277–1280

  24. Ma S, Gao W, Lu Y (2005) Rate-distortion analysis for h.264/AVC video coding and its application to rate control. IEEE Trans Circ Syst Video Technol 15 (12):1533–1544

    Article  Google Scholar 

  25. Peng W-H, Walls FG, Cohen R, Xu J, Ostermann J, MacInnis A, Lin T (2016) Overview of screen content video coding: technologies, Standards, and Beyond. IEEE Trans Circ Syst Video Technol 6(4):393–408

    Google Scholar 

  26. Pitrey Y, Babel M, Deforges O (2009) One-pass bitrate control for MPEG-4 scalable video coding using ρ-domain. In: IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp 1–5

  27. Rosewarne C, Sharman K, Flynn D (2014) Common test conditions and software reference configurations for HEVC range extensions, Document: JCTVC-P1006, San Jose

  28. Seo C-W, Moon J-H, Han J-K (2013) Rate control for consistent objective quality in high efficiency video coding. IEEE Trans Image Process 22(6):2442–2454

    Article  MathSciNet  Google Scholar 

  29. Sullivan GJ, Ohm J, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22 (12):1649–1668

    Article  Google Scholar 

  30. Sun L, Au OC, Zhao C, Huang FH (2014) Rate distortion modeling and adaptive rate control scheme for high efficiency video coding (HEVC). In: IEEE International Symposium on Circuits and Systems, pp 1933–1936

  31. Tan YH, Yeo C, Li Z (2012) Single-pass rate control with texture and non-texture rate-distortion models. IEEE Trans Circ Syst Video Technol 22(8):1236–1245

    Article  Google Scholar 

  32. Wang M, Ngan KN (2015) Optimal bit allocation in HEVC for real-time video communications. In: IEEE International Conference on Image Processing, pp 2665-2669

  33. Wang M, Ngan KN, Li H (2015) An efficient frame-content based intra frame rate control for high efficiency video coding. IEEE Signal Process Lett 22(7):896–900

    Article  Google Scholar 

  34. Wang S, Li J, Wang S, Ma S, Gao W (2018) A Frame Level Rate Control Algorithm For Screen Content Coding. In: IEEE International Symposium on Circuits and Systems, pp 1–4

  35. Wen J, Fang M, Tang M, Wu K (2015) R-λ Model Based Improved Rate Control for HEVC with Pre-Encoding. In: IEEE Data Compression Conference, pp 53–62

  36. Wiegand T, Sullivan GJ, Bjøntegaard G., Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circ Syst Video Technol 13(7):560–576

    Article  Google Scholar 

  37. Xiao J, Li B, Sun S, Xu J (2017) Rate control with delay constraint for screen content coding. In: IEEE Visual Communications and Image Processing, pp 1–4

  38. Xie B, Zeng W (2006) A sequence-based rate control framework for consistent quality real-time video. IEEE Trans Circ Syst Video Technol 16(1):56–71

    Article  Google Scholar 

  39. Xu X, Liu S, Chuang T-D, Huang Y-W, Lei S-M (2016) Intra block copy in HEVC screen content coding extensions. IEEE J Emerging Sel Top Circ Syst 6(4):409–419

    Article  Google Scholar 

  40. Yu H, Cohen R, Rapaka K, Xu J (2016) Common test conditions for screen content coding, Document: JCTVC-X1015, Geneva

Download references

Acknowledgments

”This work is partially supported by the National Key Research and Development Program of China (under Grant 2017YFA0700900, 2017YFA0700903), and the NSF of China (under Grants 61672491, 61732020).”

Author information

Authors and Affiliations

  1. Communication Institute, Chongqing University of Posts and Telecommunications, Chongqing, China

    Tong Tang

  2. Institute of Software, Chinese Academy of Sciences, Beijing, China

    Ling Li

  3. University of Chinese Academy of Sciences, Beijing, China

    Ling Li

Authors
  1. Tong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ling Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tong Tang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tang, T., Li, L. A low delay rate control method for screen content coding. Multimed Tools Appl 78, 28231–28256 (2019). https://doi.org/10.1007/s11042-019-07910-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07910-9

Keywords

Search

Navigation