Abstract
This paper presents an efficient implementation of the High Efficiency Video Coding (HEVC) decoder using Hardware/Software (HW/SW) co-design approach on the Zynq System on Chip (SoC) Platform. The reference software decoder HM 10.0 has been implemented under embedded Linux Operating System (OS). For real-time decoding, we provide hardware acceleration for the most computationally intensive parts of the HEVC decoder, which are the interpolation filters. The proposed design improves the processing throughput targeting on the resolution of 3840 × 2160 at a frame rate of 60 fps. HW/SW validation is achieved and examined in terms of resource utilization, throughput and power consumption. In order to improve the total decoding time, we propose to enable the Direct Memory Access (DMA) mode that can help speed page access and minimize the transfer time between the processor and hardware accelerators.
Similar content being viewed by others
References
Afonso V, Maich H, Agostini L, Franco D (2013) Low cost and high throughput FME interpolation for the HEVC emerging video coding standard. In: 2013 IEEE 4th Latin American Symposium on Circuits and Systems (LASCAS), IEEE, pp. 1–4
Ayadi LA, Damak T, Loukil H, Ayed MAB, Masmoudi N (2018) HEVC decoder analysis on ARM processor. In 2018 15th International Multi-Conference on Systems, Signals & Devices (SSD), IEEE, pp 842–845
Ayadi LA, Loukil H, Ayed MAB, Masmoudi N (2018) Efficient implementation of HEVC decoder on Zynq SoC platform. In 2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), IEEE, pp 1–5
Ayadi LA, Neji N, Loukil H, Ben Ayed MA, Masmoudi N (2016) High-performance hardware interpolation architecture for high efficiency video coding decoder. International Review on Computers and Software 11(9):764–772
Belghith F, Kibeya H, Ayed MAB, Masmoudi N (2015) Statistical analysis and parametrization of HEVC encoded videos. In: 2015 World Congress on Information Technology and Computer Applications (WCITCA), IEEE, pp. 1–5
Bossen F. (2013) JCT-VC-L1100: Common test conditions and soft-ware reference configurations. In: Proceedings of the 12th JCT-VC Meeting, Geneva
Bross B, Han WJ, Ohm JR, Sullivan GJ, Wang YK, Wiegand T (2013) High Efficiency Video Coding (HEVC) Text Specification Draft 10 JCTVC-l1003
CHAPTER 15, Memory Mappingand DMA,,ch15.13676 Page 412
Crockett LH, Elliot RA, Enderwitz MA, Stewart RW (2014) The Zynq Book: Embedded Processing with the Arm Cortex-A9 on the Xilinx Zynq-7000 All Programmable Soc. Strathclyde Academic Media
Device drivers in user space. (2018) https://www.embedded.com/design/operating-systems/4401769/Device-drivers-in-user-space
Diniz CM, Shafique M, Bampi S, Henkel J (2013) High-throughput interpolation hardware architecture with coarse-grained reconfigurable datapaths for HEVC. In: 2013 IEEE International Conference on Image Processing, IEEE, pp 2091–2095
Diniz CM, Shafique M, Bampi S, Henkel J (2015) A reconfigurable hardware architecture for fractional pixel interpolation in high efficiency video coding. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 34 (2):238–251
Guo Z, Zhou D, Goto S (2012) An optimized MC interpolation architecture for HEVC. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp. 1117–1120
He G, Zhou D, Chen Z, Zhang T, Goto S A 995Mpixels/s 0.2nJ/pixel fractional motion estimation architecture in HEVC for Ultra-HD, IEEE Asian Solid-State Circuits Conference (A-SSCC) (Page: 301 Year of Publication: 2013 ISBN: 978-1-4799-0277-4)
He G, Zhou D, Li Y, Chen Z, Zhang T, Goto S (2015) High-throughput power-efficient VLSI architecture of fractional motion estimation for ultra-HD HEVC video encoding. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 23 (12):3138–3142
High Efficiency Video Coding Test Model (HM) 10.0 https://hevc.hhi.fraunhofer.de/trac/hevc/browser/tags/HM-10.0
Huang CT, Juvekar C, Tikekar M, Chandrakasan AP (2013) HEVC interpolation filter architecture for quad full HD decoding. In: 2013 Visual Communications and Image Processing (VCIP), IEEE, pp 1–5
Jin X, Ryoo K (2013) An efficient interpolation hardware architecture for HEVC inter-prediction decoding. Journal of Information and Communication Convergence Engineering 11(2):118–123
Kalali E, Adibelli Y, Hamzaoglu I (2013) A reconfigurable HEVC sub-pixel interpolation hardware. In: 2013 IEEE Third International Conference on Consumer Electronics Berlin (ICCE-Berlin), IEEE, pp. 125–128
Kalali E, Hamzaoglu I (2014) A low energy HEVC sub-pixel interpolation hardware. In: 2014 IEEE International Conference on Image Processing (ICIP), IEEE, pp 1218–1222s
Lian X, Zhou W, Duan Z, Li R (2014) An efficient interpolation filter VLSI architecture for HEVC standard. In: 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP), IEEE, pp. 384–388
Pastuszak G, Trochimiuk M Architecture Design and Efficiency Evaluation for the High-Throughput Interpolation in the HEVC Encoder, Digital System Design (DSD), Euromicro Conference on (Page: 423 Year of Publication: 2013 INSPEC: 13848381)
Pastuszak G., Trochimiuk M (2016) Algorithm and architecture design of the motion estimation for the H. 265/HEVC 4K-UHD encoder. J Real-Time Image Process 12(2):517–529
Pham CDK, Zhou J (2019) Deep learning-based Luma and chroma fractional interpolation in video coding. IEEE Access 7:112535–112543
Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22 (12):1649–1668
Ugur K, Alshin A, Alshina E, Bossen F, Han WJ, Park JH, Lainema J (2013) Motion compensated prediction and interpolation filter design in H. 265/HEVC. IEEE Journal of Selected Topics in Signal Processing 7(6):946–956
Xilinx (2014) Zynq-7000 All Programmable SoC Overview. http://www.xilinx.com/support/documentation/data_sheets/ds190-Zynq-7000-Overview.pdf
Xilinx (2015) Technical Reference Manual Available: http://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf
Yan N, Liu D, Li H, Li B, Li L, Wu F (2018) Convolutional neural network-based fractional-pixel motion compensation. IEEE Trans Circuits and Syst Video Technol 29(3):840–853
Zhang H, Li L, Song L, Yang X, Li Z (2019) Advanced CNN based motion compensation fractional interpolation. In: 2019 IEEE International Conference on Image Processing (ICIP), IEEE, pp 709–713
Zhou W, Zhou X, Lian X, Liu Z, Liu X (2015) An efficient interpolation filter VLSI architecture for HEVC standard. EURASIP J Adv Signal Process 2015(1):95
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ayadi, L.A., Loukil, H., Ayed, M.A.B. et al. Hardware-software implementation of HEVC decoder on Zynq. Multimed Tools Appl 79, 7685–7703 (2020). https://doi.org/10.1007/s11042-019-08548-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-08548-3