Skip to main content
Log in

Joint reference frame inter-mode selection for fast H.264 video coding

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The H.264/AVC video coding standard uses multiple reference frames and variable-size macroblock partitions in inter-prediction. This flexibility allows the standard to achieve excellent rate-distortion performance at the cost of high encoding complexity. We present an algorithm for fast joint selection of the reference frames and macroblock partitions in rate-distortion-based coding. Experimental results for eight standard test video sequences show that, compared with exhaustive search, our algorithm can save up to 74.9 % of the encoding time with negligible loss in rate-distortion performance. The presented algorithm is also evaluated using a subjective assessment metric; quality evaluation measures based on user satisfaction. Diverse types of video sequences were used with different frame rates, quantization parameters, and resolutions. The effects of changing bit rate and resolution on compression efficiency and viewers’ satisfaction are also presented. Results show that our algorithm provides high scores of perceptual satisfaction that are significantly affected by the compression technique. As a result, we claim that our algorithm presents original and significant enhancement compared with exhaustive search. In addition, overall test results showed that our technique outperformed three of the best previously proposed methods and gave higher viewer satisfaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Richardson, I.E.G.: H.264 and MPEG-4 video compression. Wiley, Hoboken (2003)

    Book  Google Scholar 

  2. Marpe, D., Wiegand, T., Sullivan, G.J.: The H.264/MPEG4 advanced video coding standard and its applications. IEEE Commun. Mag. 44(8), 134–143 (2006)

    Article  Google Scholar 

  3. Kim, G.-Y., Kim, S.-H., Kim, H.-S., Ho, Y.-S.: Fast mode decision algorithm for H.264 based on motion cost. In: Proceedings of European Signal Processing Conference, Antalya, Turkey (2005)

  4. Zeng, H., Cai, C., Ma, K.-K.: Fast mode decision for H.264/AVC based on macroblock motion activity. IEEE Trans. Circuits Syst. Video Technol. 19, 491–499 (2009)

    Article  Google Scholar 

  5. Kuo, T.-Y., Lu, H.-J.: Efficient reference frame selector for H.264. IEEE Trans. Circuits Syst. Video Technol. 18, 400–405 (2008)

    Article  Google Scholar 

  6. Choi, I., Lee, J., Jeon, B.: Fast coding mode selection with rate distortion optimization for MPEG-4 Part-10 AVC/H.264. IEEE Trans. Circuits Syst. Video Technol. 16, 1557–1561 (2006)

    Article  Google Scholar 

  7. Haitao, L., Jianjun, L., Shokouh, G.S., Samet, R.: A low complexity algorithm for H.264/AVC intra prediction. In: 2013 International Conference on Cyberworlds (CW), pp. 77–81. IEEE (2013)

  8. Hsia, S., Hsu, W., Wu, S.: A fast rate-distortion optimization algorithm for H.264/AVC codec. Signal Image Video Process. 7(5), 939–949 (2013)

    Article  Google Scholar 

  9. Liu, Z., Shen, L., Zhang, Z.: An efficient intermode decision algorithm based on motion homogeneity for H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 19, 128–132 (2009)

    Article  Google Scholar 

  10. Lee, K., Jeon, G., Jeong, J.: Fast reference frame selection algorithm for H.264/AVC. IEEE Trans. Consum. Electron. 55, 773–779 (2009)

    Article  Google Scholar 

  11. Chiang, C.-K., Pan, W.-H., Hwang, C., Zhuang, S.-S., Lai, S.-H.: Fast H.264 encoding based on statistical learning. IEEE Trans. Circuits Syst. Video Technol. 21(9), 1304–1315 (2011)

    Article  Google Scholar 

  12. Sung, Y.-H., Wang, J.-C.: Fast mode decision for H.264/AVC based on rate-distortion clustering. IEEE Trans. Multimed. 14(3), 693–702 (2012)

    Article  Google Scholar 

  13. Wang, W., Xie, Y., Lin, T., Hu, J.: A fast mode decision algorithm and its hardware design for H.264/AVC intra prediction. Adv. Image Graph. Techol. 437, 48–56 (2014)

    Google Scholar 

  14. Wang, C.C., Kao, J.Y., Chen, A.I., Wang, H.C.: A fast H.264 video encoder based on a digital signal processor. In: 2014 International Symposium on Computer, Consumer and Control (IS3C), 10–12 June 2014, pp. 1199–1202

  15. Park, I., Capson, D.W.: Improved motion estimation time using a combination of dynamic reference frame selection and residue-based mode decision. Signal Image Video Process. 6(1), 25–39 (2012)

    Article  Google Scholar 

  16. Kim, H., Lim, S., Koo, N., Yu, S.: Fast reference frame and inter-mode selection method for H.264/AVC. Signal Image Video Process. 8(6), 1087–1093 (2014)

    Article  Google Scholar 

  17. Gorur, P., Amrutur, B.: Skip decision and reference frame selection for low-complexity H.264/AVC surveillance video coding. IEEE Trans. Circuits Syst. Video Technol. 24(7), 1156–1169 (2014)

  18. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, H.264/AVC reference software, version JM 16.0

  19. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. In: ITU-T 13th VCEG Meeting, Doc. VCEG-M33 (2001)

  20. ITU-T, Advanced video coding for generic audiovisual services, ITU-T recommendation H.264, May 2003

  21. Mak, C.-M., Fong, C.-K., Cham, W.-K.: Fast motion estimation for H. 264/AVC in Walsh-Hadamard domain. IEEE Trans. Circuits Syst. Video Technol. 18(6), 735–745 (2008)

    Article  Google Scholar 

  22. Wu, C.-Y., Su, P.-C.: Fast intra-coding for H. 264/AVC by using projection-based predicted block residuals. IEEE Trans. Multimed. 15(5), 1083–1093 (2013)

    Article  Google Scholar 

  23. Chen, C., Chen, J., Xia, T., Ju, Z., Po, L.-M.: An improved hybrid fast mode decision method for H. 264/AVC intra coding with local information. Multimed. Tools Appl. 72, 687–704 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ahmad A. Mazhar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mazhar, A.A., Abdalla, A.M. Joint reference frame inter-mode selection for fast H.264 video coding. SIViP 10, 617–623 (2016). https://doi.org/10.1007/s11760-015-0785-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0785-1

Keywords

Navigation