Skip to main content
SpringerLink
Log in

Enhanced SATD-based cost function for mode selection of H.264/AVC intra coding

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In H.264/AVC, the concept of rate-distortion optimization (RDO) mode decision has proven to be an important coding tool. However, this mode decision method makes the encoding process extremely complex, especially in the computation of the rate-distortion cost function, which includes the computations of the sum of squared difference (SSD) between the original and reconstructed image blocks and context-based entropy coding of the block. In this paper, we propose an enhanced low-complexity cost function for H.264/AVC intra 4 × 4 and 8 × 8 mode selections. The enhanced cost function uses sum of absolute Hadamard-transformed differences (SATD) and mean absolute deviation of the residual block to estimate distortion part of the cost function. A threshold-based large coefficients count is also used for estimating the bit-rate part. The proposed method improves the rate-distortion performance of conventional fast cost functions while maintaining low complexity requirement. As a result, the encoding process can be significantly accelerated with the use of the proposed cost function. Simulation results confirm that the proposed method reduces about 83.74 % computation of intra encoding of JM 12.4 encoder with negligible rate-distortion performance degradation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Draft ITU-T Recommendation and Final Draft International Standard of joint video specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC), documents: JVT-G050, 7th Meeting, Pattaya, Thailand, 7–14 March, 2003

  2. Ostermann J., Bormans J., List P., Marpe P., Narroschke M., Pereira F., Stockhammer T., Wedi T.: Video Coding with H.264/AVC: Tools, Performance, and Complexity. IEEE Circuits Syst. Mag. 4, 7–28 (2004)

    Article  Google Scholar 

  3. Chiang T., Zhang Y.Q.: A new rate control scheme using quadratic rate distortion model. IEEE Trans. Circuits Syst. Video Tech. 7(1), 246–250 (1997)

    Article  Google Scholar 

  4. Corbera J.R., Lei S.: Rate control of DCT video coding for low-delay communication. IEEE Trans. Circuits Syst. Video Tech. 9(1), 172–185 (1999)

    Article  Google Scholar 

  5. Tseng C.H., Wang H.M., Yang J.F.: Enhanced Intra 4 × 4 Mode Decision for H.264/AVC Coders. IEEE Trans. Circuits Syst. Video Tech. 16(8), 1027–1032 (2006)

    Article  Google Scholar 

  6. Sarwer M.G., Po L.M.: Fast bit rate estimation for mode decision of H.264/AVC. IEEE Trans. Circuits Syst. Video Tech. 17(10), 1402–1407 (2007)

    Article  Google Scholar 

  7. Kuang Y., Yang J.F., Sun M.T.: Efficient rate-distortion estimation for H.264/AVC coders. IEEE Trans. Circuits Syst. Video Tech. 16(5), 600–611 (2006)

    Article  Google Scholar 

  8. Lee Y.M., Sun Y.T., Lin Y.: SATD-based intra mode decision for H.264/AVC video coding. IEEE Trans. Circuits Syst. Video Tech. 20(3), 463–469 (2010)

    Article  Google Scholar 

  9. Sarwer M.G., Po L.M.: (2007) Bit Rate estimation for cost function of 4 × 4 intra mode decision of H.264/AVC. Proc. of IEEE International Conference on Multimedia and Expo (ICME 2007), Beijing, China, July 2–5, pp. 1579–1582

  10. Wang, O., Zhao, D., Gao, W., Ma, S.: Low complexity RDO mode decision based on a fast coding-bits estimation model for H.264/AVC. Proc. IEEE International Symposium on Circuits and Systems, 2005, Kobe, Japan, May 23–26, 2005, vol. 4, pp. 3467–3470.

  11. Hahm J., Kyung C.M.: Efficient CABAC rate estimation for H.264/AVC mode decision. IEEE Trans. Circuits Syst. Video Tech. 20(2), 310–316 (2010)

    Article  Google Scholar 

  12. Sullivan G.J., Wiegand T.: Rate-distortion optimization for video compression. IEEE Signal Process. Mag. 15, 74–90 (1998)

    Article  Google Scholar 

  13. Po L.M., Guo K.: Transform-domain fast sum of the squared difference computation for H.264 rate-distortion optimization. IEEE Trans. Circuits Syst. Video Tech. 17(6), 765–773 (2007)

    Article  Google Scholar 

  14. Richardson I.E.G.: H.264 and MPEG-4 video compression—video coding for next generation multimedia, Ch. 6, pp. 191–192. Wiley, New York (2003)

    Book  Google Scholar 

  15. Joint Video Team (JVT) reference software version 12.4, available online: http://iphome.hhi.de/suehring/tml/download/old_jm/

  16. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. Presented at the 13th VCEG-M33 Meeting, Austin, TX (2001)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Windsor, 401 Sunset Avenue, Windsor, ON, Canada

    Mohammed Golam Sarwer & Q. M. Jonathan Wu

  2. Department of Electrical and Computer Engineering, Ryerson University, Toronto, ON, Canada

    Mohammed Golam Sarwer & Xiao-Ping Zhang

Authors
  1. Mohammed Golam Sarwer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Q. M. Jonathan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiao-Ping Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Golam Sarwer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sarwer, M.G., Wu, Q.M.J. & Zhang, XP. Enhanced SATD-based cost function for mode selection of H.264/AVC intra coding. SIViP 7, 777–786 (2013). https://doi.org/10.1007/s11760-011-0267-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-011-0267-z

Keywords

Search

Navigation