Abstract
The H.264/AVC video coding standard uses multiple reference frames and variable-size macroblock partitions in inter-prediction. This flexibility allows the standard to achieve excellent rate-distortion performance at the cost of high encoding complexity. We present an algorithm for fast joint selection of the reference frames and macroblock partitions in rate-distortion-based coding. Experimental results for eight standard test video sequences show that, compared with exhaustive search, our algorithm can save up to 74.9 % of the encoding time with negligible loss in rate-distortion performance. The presented algorithm is also evaluated using a subjective assessment metric; quality evaluation measures based on user satisfaction. Diverse types of video sequences were used with different frame rates, quantization parameters, and resolutions. The effects of changing bit rate and resolution on compression efficiency and viewers’ satisfaction are also presented. Results show that our algorithm provides high scores of perceptual satisfaction that are significantly affected by the compression technique. As a result, we claim that our algorithm presents original and significant enhancement compared with exhaustive search. In addition, overall test results showed that our technique outperformed three of the best previously proposed methods and gave higher viewer satisfaction.
Similar content being viewed by others
References
Richardson, I.E.G.: H.264 and MPEG-4 video compression. Wiley, Hoboken (2003)
Marpe, D., Wiegand, T., Sullivan, G.J.: The H.264/MPEG4 advanced video coding standard and its applications. IEEE Commun. Mag. 44(8), 134–143 (2006)
Kim, G.-Y., Kim, S.-H., Kim, H.-S., Ho, Y.-S.: Fast mode decision algorithm for H.264 based on motion cost. In: Proceedings of European Signal Processing Conference, Antalya, Turkey (2005)
Zeng, H., Cai, C., Ma, K.-K.: Fast mode decision for H.264/AVC based on macroblock motion activity. IEEE Trans. Circuits Syst. Video Technol. 19, 491–499 (2009)
Kuo, T.-Y., Lu, H.-J.: Efficient reference frame selector for H.264. IEEE Trans. Circuits Syst. Video Technol. 18, 400–405 (2008)
Choi, I., Lee, J., Jeon, B.: Fast coding mode selection with rate distortion optimization for MPEG-4 Part-10 AVC/H.264. IEEE Trans. Circuits Syst. Video Technol. 16, 1557–1561 (2006)
Haitao, L., Jianjun, L., Shokouh, G.S., Samet, R.: A low complexity algorithm for H.264/AVC intra prediction. In: 2013 International Conference on Cyberworlds (CW), pp. 77–81. IEEE (2013)
Hsia, S., Hsu, W., Wu, S.: A fast rate-distortion optimization algorithm for H.264/AVC codec. Signal Image Video Process. 7(5), 939–949 (2013)
Liu, Z., Shen, L., Zhang, Z.: An efficient intermode decision algorithm based on motion homogeneity for H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 19, 128–132 (2009)
Lee, K., Jeon, G., Jeong, J.: Fast reference frame selection algorithm for H.264/AVC. IEEE Trans. Consum. Electron. 55, 773–779 (2009)
Chiang, C.-K., Pan, W.-H., Hwang, C., Zhuang, S.-S., Lai, S.-H.: Fast H.264 encoding based on statistical learning. IEEE Trans. Circuits Syst. Video Technol. 21(9), 1304–1315 (2011)
Sung, Y.-H., Wang, J.-C.: Fast mode decision for H.264/AVC based on rate-distortion clustering. IEEE Trans. Multimed. 14(3), 693–702 (2012)
Wang, W., Xie, Y., Lin, T., Hu, J.: A fast mode decision algorithm and its hardware design for H.264/AVC intra prediction. Adv. Image Graph. Techol. 437, 48–56 (2014)
Wang, C.C., Kao, J.Y., Chen, A.I., Wang, H.C.: A fast H.264 video encoder based on a digital signal processor. In: 2014 International Symposium on Computer, Consumer and Control (IS3C), 10–12 June 2014, pp. 1199–1202
Park, I., Capson, D.W.: Improved motion estimation time using a combination of dynamic reference frame selection and residue-based mode decision. Signal Image Video Process. 6(1), 25–39 (2012)
Kim, H., Lim, S., Koo, N., Yu, S.: Fast reference frame and inter-mode selection method for H.264/AVC. Signal Image Video Process. 8(6), 1087–1093 (2014)
Gorur, P., Amrutur, B.: Skip decision and reference frame selection for low-complexity H.264/AVC surveillance video coding. IEEE Trans. Circuits Syst. Video Technol. 24(7), 1156–1169 (2014)
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, H.264/AVC reference software, version JM 16.0
Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. In: ITU-T 13th VCEG Meeting, Doc. VCEG-M33 (2001)
ITU-T, Advanced video coding for generic audiovisual services, ITU-T recommendation H.264, May 2003
Mak, C.-M., Fong, C.-K., Cham, W.-K.: Fast motion estimation for H. 264/AVC in Walsh-Hadamard domain. IEEE Trans. Circuits Syst. Video Technol. 18(6), 735–745 (2008)
Wu, C.-Y., Su, P.-C.: Fast intra-coding for H. 264/AVC by using projection-based predicted block residuals. IEEE Trans. Multimed. 15(5), 1083–1093 (2013)
Chen, C., Chen, J., Xia, T., Ju, Z., Po, L.-M.: An improved hybrid fast mode decision method for H. 264/AVC intra coding with local information. Multimed. Tools Appl. 72, 687–704 (2014)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mazhar, A.A., Abdalla, A.M. Joint reference frame inter-mode selection for fast H.264 video coding. SIViP 10, 617–623 (2016). https://doi.org/10.1007/s11760-015-0785-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0785-1