Skip to main content
SpringerLink
Log in

Perceptual sensitivity-based rate control method for high efficiency video coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The newest video coding standard--high efficiency video coding (HEVC) optimizes its coding efficiency in terms of sum of square error (SSE), which does not fully consider the perceptual characteristic of the input video. Thus, the HEVC is not effective in the sense of perceptual video coding. To address this problem, an efficient perceptual sensitivity-based rate control (PSRC) method for HEVC is proposed based on the human visual system (HVS) observation that the region with less perceptual sensitivity can tolerate more distortion. In the first stage, the proposed method develops a perceptual sensitivity measurement to evaluate the perceptual sensitivity of each coding tree unit (CTU) and each frame, which is then used to guide the bit allocation so that more bits will be allocated to those regions with higher perceptual sensitivity. To meet the target bits, an improved R-λ model is utilized to determine the quantization parameter (QP). Experimental results have shown that the proposed method is able to improve the perceptual coding performance, compared with the original rate control in HEVC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. An C, Nguyen TQ (2008) Iterative rate-distortion optimization of H.264 with constant bit rate constraint. IEEE Trans Image Process 17(9):1605–1615

    Article  MathSciNet  Google Scholar 

  2. Bhat A, Kannangara S, Zhao Y, Richardson I (2012) A full reference quality metric for compressed video based on mean squared error and video content. IEEE Trans Circ Syst Video Technol 22(2):165–173

    Article  Google Scholar 

  3. Bjontegaard G (2001) Calculation of average PSNR differences between RD-Curves. Document VCEG-M33, VCEG 13th meeting

  4. Bossen F (2012) Common test conditions and software reference configurations. Document JCTVC-J1100

  5. Chen Z, Ngan KN (2007) Recent advances in rate control for video coding. Signal Process Image Commun 22(1):19–38

    Article  Google Scholar 

  6. Chiang T, Zhang Y-Q (1997) A new rate control scheme using quadratic rate distortion model. IEEE Trans Circ Syst Video Technol 7(1):246–250

    Article  Google Scholar 

  7. Choi H, Nam J, Yoo J, Sim D, Bajić IV (2012) Rate control based on unified RQ model for HEVC. Joint Collaborative Team on Video Coding (JCT-VC), ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting, pp. 1–10

  8. Dong J, Ling N (2009) A context-adaptive prediction scheme for parameter estimation in H.264/AVC macroblock layer rate control. IEEE Trans Circ Syst Video Technol 19(8):1108–1117

    Article  Google Scholar 

  9. Girod B (1993) What’s wrong with mean squared error. In: Digital Images and Human Vision. Cambridge, Ma: MIT Press, pp. 207–220

  10. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 (2010) Advanced video coding for generic audiovisual services. JCTVC-A202, Dresden, Germany

  11. Kwon D-K, Shen M-Y, Kuo C-CJ (2007) Rate control for H.264 video with enhanced rate and distortion models. IEEE Trans Circ Syst Video Technol 17(5):517–529

    Article  Google Scholar 

  12. Lee B, Kim M, Nguyen TQ (2014) A frame-level rate control scheme based on texture and non-texture rate models for high efficiency video coding. IEEE Trans Circ Syst Video Technol 24(3):465–479

    Article  Google Scholar 

  13. Li B, Li HQ, Li L, Zhang JL (2014) Lambda domain rate control algorithm for high efficiency video coding. IEEE Trans Image Process 23(9):3841–3854

    Article  MathSciNet  Google Scholar 

  14. Li Y, Liao W, Huang J, He D, Chen Z (2014) Saliency based perceptual HEVC. IEEE International Conference on Multimedia & Expo Workshops (ICMEW), pp. 1–5

  15. Li S, Xu M, Deng X, Wang Z (2014) A novel weight-based URQ scheme for perceptual video coding of conversational video in HEVC. IEEE International Conference on Multimedia & Expo, pp. 1–6

  16. Liu Y, Li ZG, Soh YC (2007) A novel rate control scheme for low delay video communication of H.264/AVC standard. IEEE Trans Circ Syst Video Technol 17(1):1152–1162

    Article  Google Scholar 

  17. Oh H, Kim W (2013) Video processing for human perceptual visual quality-oriented video coding. IEEE Trans Image Process 4(4):1526–1535

    Article  MathSciNet  Google Scholar 

  18. Ou T, Huang Y, Chen HH (2011) SSIM-based perceptual rate control for video coding. IEEE Trans Circ Syst Video Technol 21(5):682–691

    Article  Google Scholar 

  19. Ou YF, Ma Z, Liu T, Wang Y (2011) Perceptual quality assessment of video considering both frame rate and quantization artifacts. IEEE Trans Circ Syst Video Technol 21(3):286–298

    Article  Google Scholar 

  20. Seshadrinathan K, Bovik AC (2010) Motion tuned spatio-temporal quality assessment of natural videos. IEEE Trans Image Process 19(2):335–350

    Article  MathSciNet  Google Scholar 

  21. Sullivan J, Ohm JR, Han WJ, Wiegand T (2012) Overview of the High Efficiency Video Coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  22. Tan HL, Li ZG, Tan YH, Rahardja S, Yeo C (2010) A perceptually relevant MSE-based image quality metric. IEEE Trans Image Process 19(2):335–350

    Article  MathSciNet  Google Scholar 

  23. Tsai W-J, Chou T-L (2010) Scene change aware intra-frame rate control for H.264/AVC. IEEE Trans Circ Syst Video Technol 20(12):1882–1886

    Article  Google Scholar 

  24. Ugur K, Andersson K, Fuldseth A, Bjøntegaard G et al (2010) High performance, low complexity video coding and the emerging HEVC standard. IEEE Trans Circ Syst Video Technol 20(12):1688–1697

    Article  Google Scholar 

  25. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  26. Wang S, Ma S, Wang S, Zhao D, Gao W (2013) Rate-GOP based rate control for high efficiency video coding. IEEE J Select Top Signal Process 7(6):1101–1111

    Article  Google Scholar 

  27. Wang S, Rehman A, Wang Z, Ma S, Gao W (2012) SSIM-motivated rate-distortion optimization for video coding. IEEE Trans Circ Syst Video Technol 22(4):516–529

    Article  MathSciNet  Google Scholar 

  28. Wang ZX, Zeng HQ, Chen J, Cai CH (2014) Key techniques of high efficiency video coding standard and its extension. IEEE International Conference on Industrial Electronics and Applications (ICIEA2014), pp. 1169–1173

  29. Wiegand T, Schwarz H, Joch A, Kossentini F, Sullivan GJ (2003) Rate-constrained coder control and comparison of video coding standards. IEEE Trans Circ Syst Video Technol 13(7):688–703

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by a grant from the Research Grants Council of the Hong Kong SAR, China (Project CUHK 415712), in part by the National Natural Science Foundation of China under the Grants 61372107 and 61401167, in part by the Xiamen Key Science and Technology Project Foundation under the Grant 3502Z20133024, in part by the Opening Project of State Key Laboratory of Digital Publishing Technology under the grant FZDP2015-B-001, and in part by the High-Level Talent Project Foundation of Huaqiao University under the Grants 14BS201 and 14BS204.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Huaqiao University, Xiamen, 361021, China

    Huanqiang Zeng & Aisheng Yang

  2. Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China

    King Ngi Ngan & Miaohui Wang

Authors
  1. Huanqiang Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aisheng Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. King Ngi Ngan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Miaohui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huanqiang Zeng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zeng, H., Yang, A., Ngan, K.N. et al. Perceptual sensitivity-based rate control method for high efficiency video coding. Multimed Tools Appl 75, 10383–10396 (2016). https://doi.org/10.1007/s11042-015-2997-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2997-3

Keywords

Search

Navigation