Skip to main content

Advertisement

Log in

Hardware-software implementation of HEVC decoder on Zynq

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents an efficient implementation of the High Efficiency Video Coding (HEVC) decoder using Hardware/Software (HW/SW) co-design approach on the Zynq System on Chip (SoC) Platform. The reference software decoder HM 10.0 has been implemented under embedded Linux Operating System (OS). For real-time decoding, we provide hardware acceleration for the most computationally intensive parts of the HEVC decoder, which are the interpolation filters. The proposed design improves the processing throughput targeting on the resolution of 3840 × 2160 at a frame rate of 60 fps. HW/SW validation is achieved and examined in terms of resource utilization, throughput and power consumption. In order to improve the total decoding time, we propose to enable the Direct Memory Access (DMA) mode that can help speed page access and minimize the transfer time between the processor and hardware accelerators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Afonso V, Maich H, Agostini L, Franco D (2013) Low cost and high throughput FME interpolation for the HEVC emerging video coding standard. In: 2013 IEEE 4th Latin American Symposium on Circuits and Systems (LASCAS), IEEE, pp. 1–4

  2. Ayadi LA, Damak T, Loukil H, Ayed MAB, Masmoudi N (2018) HEVC decoder analysis on ARM processor. In 2018 15th International Multi-Conference on Systems, Signals & Devices (SSD), IEEE, pp 842–845

  3. Ayadi LA, Loukil H, Ayed MAB, Masmoudi N (2018) Efficient implementation of HEVC decoder on Zynq SoC platform. In 2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), IEEE, pp 1–5

  4. Ayadi LA, Neji N, Loukil H, Ben Ayed MA, Masmoudi N (2016) High-performance hardware interpolation architecture for high efficiency video coding decoder. International Review on Computers and Software 11(9):764–772

    Google Scholar 

  5. Belghith F, Kibeya H, Ayed MAB, Masmoudi N (2015) Statistical analysis and parametrization of HEVC encoded videos. In: 2015 World Congress on Information Technology and Computer Applications (WCITCA), IEEE, pp. 1–5

  6. Bossen F. (2013) JCT-VC-L1100: Common test conditions and soft-ware reference configurations. In: Proceedings of the 12th JCT-VC Meeting, Geneva

  7. Bross B, Han WJ, Ohm JR, Sullivan GJ, Wang YK, Wiegand T (2013) High Efficiency Video Coding (HEVC) Text Specification Draft 10 JCTVC-l1003

  8. CHAPTER 15, Memory Mappingand DMA,,ch15.13676 Page 412

  9. Crockett LH, Elliot RA, Enderwitz MA, Stewart RW (2014) The Zynq Book: Embedded Processing with the Arm Cortex-A9 on the Xilinx Zynq-7000 All Programmable Soc. Strathclyde Academic Media

  10. Device drivers in user space. (2018) https://www.embedded.com/design/operating-systems/4401769/Device-drivers-in-user-space

  11. Diniz CM, Shafique M, Bampi S, Henkel J (2013) High-throughput interpolation hardware architecture with coarse-grained reconfigurable datapaths for HEVC. In: 2013 IEEE International Conference on Image Processing, IEEE, pp 2091–2095

  12. Diniz CM, Shafique M, Bampi S, Henkel J (2015) A reconfigurable hardware architecture for fractional pixel interpolation in high efficiency video coding. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 34 (2):238–251

    Article  Google Scholar 

  13. Guo Z, Zhou D, Goto S (2012) An optimized MC interpolation architecture for HEVC. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp. 1117–1120

  14. He G, Zhou D, Chen Z, Zhang T, Goto S A 995Mpixels/s 0.2nJ/pixel fractional motion estimation architecture in HEVC for Ultra-HD, IEEE Asian Solid-State Circuits Conference (A-SSCC) (Page: 301 Year of Publication: 2013 ISBN: 978-1-4799-0277-4)

  15. He G, Zhou D, Li Y, Chen Z, Zhang T, Goto S (2015) High-throughput power-efficient VLSI architecture of fractional motion estimation for ultra-HD HEVC video encoding. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 23 (12):3138–3142

    Article  Google Scholar 

  16. High Efficiency Video Coding Test Model (HM) 10.0 https://hevc.hhi.fraunhofer.de/trac/hevc/browser/tags/HM-10.0

  17. Huang CT, Juvekar C, Tikekar M, Chandrakasan AP (2013) HEVC interpolation filter architecture for quad full HD decoding. In: 2013 Visual Communications and Image Processing (VCIP), IEEE, pp 1–5

  18. Jin X, Ryoo K (2013) An efficient interpolation hardware architecture for HEVC inter-prediction decoding. Journal of Information and Communication Convergence Engineering 11(2):118–123

    Article  Google Scholar 

  19. Kalali E, Adibelli Y, Hamzaoglu I (2013) A reconfigurable HEVC sub-pixel interpolation hardware. In: 2013 IEEE Third International Conference on Consumer Electronics Berlin (ICCE-Berlin), IEEE, pp. 125–128

  20. Kalali E, Hamzaoglu I (2014) A low energy HEVC sub-pixel interpolation hardware. In: 2014 IEEE International Conference on Image Processing (ICIP), IEEE, pp 1218–1222s

  21. Lian X, Zhou W, Duan Z, Li R (2014) An efficient interpolation filter VLSI architecture for HEVC standard. In: 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP), IEEE, pp. 384–388

  22. Pastuszak G, Trochimiuk M Architecture Design and Efficiency Evaluation for the High-Throughput Interpolation in the HEVC Encoder, Digital System Design (DSD), Euromicro Conference on (Page: 423 Year of Publication: 2013 INSPEC: 13848381)

  23. Pastuszak G., Trochimiuk M (2016) Algorithm and architecture design of the motion estimation for the H. 265/HEVC 4K-UHD encoder. J Real-Time Image Process 12(2):517–529

    Article  Google Scholar 

  24. Pham CDK, Zhou J (2019) Deep learning-based Luma and chroma fractional interpolation in video coding. IEEE Access 7:112535–112543

    Article  Google Scholar 

  25. Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22 (12):1649–1668

    Article  Google Scholar 

  26. Ugur K, Alshin A, Alshina E, Bossen F, Han WJ, Park JH, Lainema J (2013) Motion compensated prediction and interpolation filter design in H. 265/HEVC. IEEE Journal of Selected Topics in Signal Processing 7(6):946–956

    Article  Google Scholar 

  27. Xilinx (2014) Zynq-7000 All Programmable SoC Overview. http://www.xilinx.com/support/documentation/data_sheets/ds190-Zynq-7000-Overview.pdf

  28. Xilinx (2015) Technical Reference Manual Available: http://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf

  29. Yan N, Liu D, Li H, Li B, Li L, Wu F (2018) Convolutional neural network-based fractional-pixel motion compensation. IEEE Trans Circuits and Syst Video Technol 29(3):840–853

    Article  Google Scholar 

  30. Zhang H, Li L, Song L, Yang X, Li Z (2019) Advanced CNN based motion compensation fractional interpolation. In: 2019 IEEE International Conference on Image Processing (ICIP), IEEE, pp 709–713

  31. Zhou W, Zhou X, Lian X, Liu Z, Liu X (2015) An efficient interpolation filter VLSI architecture for HEVC standard. EURASIP J Adv Signal Process 2015(1):95

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lella Aicha Ayadi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ayadi, L.A., Loukil, H., Ayed, M.A.B. et al. Hardware-software implementation of HEVC decoder on Zynq. Multimed Tools Appl 79, 7685–7703 (2020). https://doi.org/10.1007/s11042-019-08548-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-08548-3

Keywords

Navigation