Abstract
This paper presents an efficient VLSI architecture for fast implementation of sub-pixel interpolation of H.264/AVC. Several optimization techniques at different design levels, such as parallel processing, vector register, pipeline architecture, and in-place computation, are utilized to reduce the number of memory access and accelerate the interpolation computations. The proposed application-specific processor can meet the real-time constraint of the sub-pixel interpolation algorithm for the 16:9 video format (4,690 × 2,304) at 30 frames per second (fps) at 100 MHz clock rate.







Similar content being viewed by others
References
IITU-T H.264 Series H: Audiovisual and multimedia systems, infrastructure audiovisual services coding of moving video—advanced video coding for generic audiovisual services, March 2005
ISO/IEC International Standard IS 15441-1: JPEG2000 image coding System, December 2000
Schward, H., Wiegand, T.: The emerging JVT/H.26L video coding standard. In: Proceeding of IBC 2002, Amsterdam (2002)
Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. (2003)
Richardson, I.E.G.: H.264 and MPEG-4 Video Compression–Video Coding for Next Generation Multimedia. Wiley, New York (2003)
Chien, S., Huang, Y., Chen, C., Chen, H., Chen, L.: Hardware architecture design of video compression for multimedia communication systems. IEEE Commun. Mag. (August), 123–132 (2005). doi:10.1109/MCOM.2005.1497562
Golston, J.: DM642 media processor. In: Proceeding of SPIE Conference on Image and Video Communications, pp. 700–706 (2003)
Van der Tol, E., Jasper, E., Gelderblom, R.H.: Mapping of H.264 decoding on a multiprocessor architecture. In: Proceeding of SPIE Conference on Image and Video Communications, pp. 707–709 (2003)
Dang, P.: Method and system for fast implementation of sub-pixel interpolation. US Patent Publication US 2006/0133506 A1, 22 June 2006
Dang, P.: Method and apparatus for parallel processing of in-loop deblocking filter for h.264 video compression standard. US Patent Publication US 2006/0078052 A1, 13 April 2006
Dang, P.: A high-performance architecture of an application specific processor for the H.264 deblocking filter. In: The Specific Issue on Application Specific Processor of the IEEE Transactions on VLSI System Design, vol. 16, no. 10, pp. 1321–1334 (2008)
Chen, T.-C., Huang, Y.-W., Chen, L.-G.: Fully utilized and reusable architecture for fractional motion estimation of H.264/AVC. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP ‘04), vol. 5, pp. V-9–V-912 (2004)
Ryu, J., Kim, E.: Fast intra coding method of H.264 for video surveillance system. Int J Comput Sci Netw Secur 7(10), 76–11 (2007)
Dang, P.: A high-performance parallel architecture of H.264 intra prediction for motion estimation. In: Kehtarnavaz, N., Carlsohn, M.F. (eds.) Real-Time Image Processing 2008. Proceedings of SPIE-IS&T Electronic Imaging, vol. 6811, p. 68110C. SPIE (2008)
Wang, R., Huang, C., Li, J., Shen, Y.: Sub-pixel motion compensation interpolation filter in AVS. In: Proceeding of IEEE International Conference on Multimedia and Expo, 2004. ICME’04, vol. 1, pp. 93–96, 27–30 June 2004
Li, M., Wang, R., Wu, W.: High throughput and low memory access design of sub-pixel interpolation for H.264/AVC HDTV decoder. In: Proceedings of IEEE Workshop Signal Processing Systems Design and Implementation, 2005, vol. 51, issue 3, pp. 296–301 (2005)
Wang, R., Li, M., Li, J., Zhang, Y.: High throughput and low memory access sub-pixel interpolation architecture for H.264/AVC HDTV decoder. IEEE Trans Consumer Electron 51(3), 1006–1013 (2005)
Changqi Yang: Goto, S.; Ikenaga, T (2006) High performance VLSI architecture of fractional motion estimation in H.264 for HDTV. In: Proceedings of IEEE International Symposium on Circuits and Systems, ISCAS 2006, pp. 2605–2608, 21–24 May 2006
Koga, T., Linuma, K., Hirano, A., Iijima, Y., Ishiguro, T.: Motion compensated interframe coding for video conferencing. In: Proceeding of National Telecommunication Conference, vol. NTC81, pp. G5.3.1–G5.3.5 (1981)
STMicroelectronics, Inc.: ST120 DSP-MCU—Core Reference Guide (2000)
STMicroelectronics, Inc.: ST100 DSP-MCU Core—Architecture Overview Handbook (2000)
STMicroelectronics, Inc.: ST100 DSP Toolset—User Guide (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dang, P.P. Architecture of an application-specific processor for real-time implementation of H.264/AVC sub-pixel interpolation. J Real-Time Image Proc 4, 43–53 (2009). https://doi.org/10.1007/s11554-008-0094-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-008-0094-9