Bruno Zatt
ABSTRACT
This paper presents a novel run-time adaptive energy-aware Motion and Disparity Estimation (ME, DE) architecture for Multiview Video Coding (MVC). It incorporates efficient memory access and data prefetching techniques for jointly reducing the on/off-chip memory energy consumption. A dynamically expanding search window is constructed at run time to reduce the off-chip memory accesses. Considering the multi-stage processing nature of advanced fast ME/DE schemes, a reduced-sized multi-bank on-chip memory is employed which can be power-gated depending upon the video properties. As a result, when tested for various video sequence, our approach provides a dynamic energy reduction of 82--96% for the off-chip memory and a leakage energy reduction of 57--75% for the on-chip memory compared to the Level-C and Level-C+ [7] prefetching techniques (which are the prominent data reuse and prefetching techniques in ME for video coding). The proposed ME/DE architecture is synthesized using a 65nm IBM low power technology. Compared to state-of-the-art MVC ME/DE hardware [14], our architecture provides 66% and 72% reduction in the area and power consumption, respectively. Moreover, our scheme achieves 30fps ME/DE 4-view HD1080p encoding with a power consumption of 74mW.
- P. Merkle et al., "Efficient Prediction Structures for Multiview Video Coding" IEEE TCSVT, vol. 17, no. 11, pp. 1461--1473, 2007. Google Scholar
Digital Library
- FinePix REAL 3D W3 | FujiFilm Global: http://www.fujifilm.com/products/3d/camera/finepix_real3dw3/.Google Scholar
- Lynx 3D SH-03C: http://www.sharp.co.jp/products/sh03c/index.htmlGoogle Scholar
- Joint Draft 8.0 on Multiview video coding, JVT-AB204, 2008.Google Scholar
- L. Shen et al., "View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding", IEEE TCSVT, vol. 20, no. 6, pp. 925--930, 2010. Google ScholarDigital Library
- H.-C. Chang, et al., "A Dynamic Quality-Adjustable H. 264 Video Encoder for Power-Aware Video Applications", IEEE TCSVT, vol. 19, no. 12, pp. 1739--1754, Dec. 2009. Google ScholarDigital Library
- C.-Y. Chen et al., "Level C+ data reuse scheme for motion estimation with corresponding coding orders", IEEE TCSVT, vol. 16, no. 4, 2006. Google ScholarDigital Library
- S.-H. Wang, S.-H. Tai, T. Chiang, "A Low-Power and Bandwidth-Efficient Motion Estimation IP Core Design Using Binary Search", IEEE TCSVT, vol. 19, no. 5, pp. 760--765, May 2009 Google ScholarDigital Library
- L.-F. Ding, et al., "A 212 MPixels/s 4096x2160p Multiview Video Encoder Chip for 3D/Quad Full HDTV Applications", IEEE Journal of Solid-State Circuits, vol. 45, no. 1, pp. 46--58, Jan. 2010Google ScholarCross Ref
- X. Xu, Y. He, "Fast disparity motion estimation in MVC based on range prediction," IEE ICIP, pp. 2000--2003, 2008.Google Scholar
- H. Shim, C.-M. Kyung, "Selective Search Area Reuse Algorithm for Low External Memory Access Motion Estimation", IEEE TCSVT, vol. 19, no. 7, pp. 1044--1050, July 2009. Google ScholarDigital Library
- S. Saponara, L. Fanucci, "Data-adaptive motion estimation algorithm and VLSI architecture design for low-power video systems", IEE Computers and Digital Techniques, vol. 151, no. 1, pp. 51--59, 2004.Google ScholarCross Ref
- T.-C. Chen, et al., "Fast Algorithm and Architecture Design of Low-Power Integer Motion Estimation for H.264/AVC", IEEE TCSVT, vol. 17, no. 5, pp. 568--577, May 2007. Google ScholarDigital Library
- P.-K. Tsung et al., "Cache-based integer motion/disparity estimation for quad-HD H.264/AVC and HD multiview video coding", IEEE ICASSP, pp. 2013--2016, 2009. Google ScholarDigital Library
- C.-Y. Tsai, et al., "Low Power Cache Algorithm and Architecture Design for Fast Motion Estimation in H.264/AVC Encoder System," IEEE ICASSP, vol.2, pp. II-97--II-100, 2007.Google Scholar
- T. Tuan, et al., "A 90nm Low-Power FPGA for Battery-Powered Applications", ACM FPGA, pp. 3--11, 2006. Google ScholarDigital Library
- S. Yang, W. Wolf, N. Vijaykrishnan, "Power and performance analysis of motion estimation based on hardware and software realizations", IEEE Transactions on Computers, vol. 54, no. 6, pp. 714--726, 2005. Google ScholarDigital Library
- J. Yang et al., "Multiview video coding based on rectified epipolar lines", ICICS, pp. 1--5, 2009. Google ScholarDigital Library
- JMVC 6.0," garcon.ient.rwthaachen.de, Sep. 2009.Google Scholar
- M. Shafique, L. Bauer, J. Henkel, "enBudget: A Run-Time Adaptive Predictive Energy-Budgeting Scheme for Energy-Aware Motion Estimation in H.264/MPEG-4 AVC Video Encoder," IEEE DATE, 2010. Google ScholarDigital Library
- M. Shafique, B. Molkenthin, J. Henkel, "An HVS-based Adaptive Computational Complexity Reduction Scheme for H.264/AVC Video Encoder using Prognostic Early Mode Exclusion," IEEE DATE, 2010. Google ScholarDigital Library
- B. Zatt, M. Shafique, S. Bampi, J. Henkel, "Multi-Level Pipelined Parallel Hardware Architecture for High Throughput Motion and Disparity Estimation in Multiview Video Coding," IEEE DATE, 2011.Google Scholar
Index Terms
- Run-time adaptive energy-aware motion and disparity estimation in multiview video coding
Recommendations
Adaptive power management of on-chip video memory for multiview video coding
DAC '12: Proceedings of the 49th Annual Design Automation ConferenceAn adaptive power management of on-chip video memory for Multiview Video Coding is presented. It leverages texture, motion and disparity properties of objects and their correlations in the 3D-neighborhood. It groups different Macroblocks of a frame and ...
A low-power memory architecture with application-aware power management for motion & disparity estimation in multiview video coding
ICCAD '11: Proceedings of the International Conference on Computer-Aided DesignA low-power architecture for an on-chip multi-banked video memory for motion and disparity estimation in Multiview Video Coding is proposed. The memory organization (size, banks, sectors, etc.) is driven by an extensive analysis of memory-usage behavior ...
Joint depth-motion dense estimation for multiview video coding
The multiview video coding (MVC) extension of H.264/MPEG-4 AVC [1] is one of the most promising visual encoders for three-dimensional television and free viewpoint video applications. In this paper, we propose a joint dense motion/disparity estimation ...
Comments