Abstract
The multiple reference frames motion estimation approach used in H.264 is computationally intensive. This paper presents a fast or computationally efficient feature-assisted adaptive early termination approach in order to reduce the computational complexity while maintaining more or less the same video quality. The introduced feature-assisted approach consists of three parts: (1) reduction of the number of available reference frames using predicted motion activity, extracted texture information, and skip mode from neighboring macroblocks, (2) the most probable reference frame prediction based on neighboring macroblocks, and (3) an adaptive early termination threshold derived from a theoretical analysis of all zero block detection. Extensive experimental results are performed to demonstrate the computational gain of the introduced approach over the standard approach for the multiple reference frames motion estimation.




Similar content being viewed by others
References
Bjontegaard, G.: Calculation of average PSNR difference between RD-Curves. Doc. VCEG-M33 (2001)
Chang, A., Au, O.C., Yeung, Y.M.: A novel approach to fast multi-frame selection for H.264 video coding. IEEE Int. Conf. Acoust. Speech Signal Process. 3, 413–416 (2003)
Chen, Z., Xu, J., He, Y., Zheng, J.: Fast integer-pel and fractional-pel motion estimation for H.264/AVC. J. Vis. Commun. Image Represent. 17, 264–290 (2006)
Chen, M., Li, G., Chiang, Y., Hsu, C.: Fast multiframe motion estimation algorithms by motion vector composition for MPEG-4/AVC/H.264 standard. IEEE Trans. Multimed. 8(3), 478–487 (2006)
High definition video sequences. ftp://ftp.ldv.e-technik.tu-uenchen.de/pub/test_sequences/
Huang, Y., Hsieh, B., Chien, S., Ma, S., Chen, L.: Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC. IEEE Trans. Circuit Syst. Video Technol. 16(4), 507–522 (2006)
JM12.2 software. http://iphome.hhi.de/suehring/tml/
Kim, S., Han, J., Kim, J.: An efficient scheme for motion estimation using multireference frames in H.264/AVC. IEEE Trans. Multimed. 8(3), 457–466 (2006)
Li, X., Li, E., Chen, Y.: Fast multi-frame motion estimation algorithm with adaptive search strategies in H.264. IEEE Int. Conf. Acoust. Speech Signal Process. 3, 369–372 (2004)
Li, H., Hsu, C., Chen, M.: Fast multiple reference frame selection method for motion estimation in JVT/H.264. In: The 2004 IEEE Asia-pacific conference on circuits and systems, pp. 605–608 (2004)
Liang, Y., Ahmad I., Luo, J., Sun, Y., Swaminathan, V.: On using hierarchical motion history for motion estimation in H.264/AVC. IEEE Trans. Circuit Syst. Video Technol. 15(12), 1594–1603 (2005)
Lin, S., Lu, M., Chen, H., Pan, C.: Fast multi-frame motion estimation for H.264 and its application to complexity aware streaming. IEEE Int. Symp. Circuits Syst. 2, 1505–1508 (2005)
Liu, X., Liang, D., Srivastava, A.: Image segmentation using local spectral histograms. In: Proceedings of IEEE ICIP, pp. 70–73 (2001)
Moon, Y., Kim, G., Kim, J.: An improved early detection algorithm for all-zero blocks in H.264 video encoding. IEEE Trans. Circuit Syst. Video Technol. 15(8), 1503–1507 (2005)
Pan, F., Lin, X., Susanto, R., Lim, K., Li, Z., Feng, G., Wu, D., Wu, S.: Fast mode decision for intra Prediction. Doc. JVT-G013 (2003)
Shen, L., Liu, Z., Zhang, Z., Wang G.: Video nature considerations for multi-frame selection algorithm in H.264. IEEE/ACS Int. Conf. Comput. Syst. Appl. 13–16, 708–711 (2007)
Tourapis, A.M., Au, O.C., Liou, M.L.: Highly efficient predictive zonal algorithm for fast block-matching motion estimation. IEEE Trans. Circuit Syst. Video Technol. 12, 934–947 (2002)
Uchiyama, T., Mukawa, N., Kaneko, H.: Estimation of homogenous regions for segmentation of textured Images. In: Proceedings of IEEE ICPR, pp. 1072–1075 (2002)
Wang, Y., Chang, S.: Complexity adaptive H.264 encoding for light weight streams. IEEE Int. Conf. Acoust. Speech Signal Process. 2, 25–28 (2006)
Wang, H., Kwong, S., Kok, C.: Efficient prediction algorithm of integer DCT coefficients for H.264/AVC optimization. IEEE Trans. Circuit Syst. Video Technol. 16, 547–552 (2006)
x264 software. http://www.videolan.org/developers/x264.html
Xie, Z., Liu, Y., Liu, J., Yang, T.: A general method for detecting all-zero blocks prior to DCT and quantization. IEEE Trans. Circuit Syst. Video Technol. 17(2), 237–241 (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ren, J., Kehtarnavaz, N. & Budagavi, M. A fast feature-assisted adaptive early termination approach for multiple reference frames motion estimation in H.264. J Real-Time Image Proc 3, 77–88 (2008). https://doi.org/10.1007/s11554-007-0067-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-007-0067-4