Abstract
This paper presents an extensive evaluation of the HEVC parallel video coding when using Tiles. The evaluation consists on finding the tiling pattern that yields the maximum possible speedup for a set of video sequences considering several encoding parameters, measuring the coding efficiency variation of using such tiling pattern instead of the uniform tiling pattern, and calculating how far from the uniform tiling the maximum speedup tiling pattern is. To perform these evaluations, a different number of Tiles with different tiling patterns are applied; apart from that, different encoding profiles are employed. The results show that the speedup yielded by the uniform tiling is highly dependent on the video sequence and employed encoding profile. When encoding a set of video sequences with the same encoding parameters, the greater speedup may be up to 25% higher than the minor speedup, whereas when encoding the same video sequence with different encoding profiles, the greater speedup may be up to 21% higher than the minor speedup. When applying the maximum speedup tiling pattern to an encoding, distinct speedup gains may be achieved. While for some video sequences the maximum possible speedup equals the speedup yielded by the uniform tiling pattern, for others, changing from the uniform tiling to a better one may result in more than 40% of speedup gain. The results also show that when changing from the uniform tiling pattern to one that results in the maximum possible speedup, the coding efficiency variation is negligible; therefore, it is rewarding to seek better tiling patterns.
Similar content being viewed by others
References
Cisco: Cisco visual networking index: forecast and methodology 2016–2021 (2017)
Video Codec for Audiovisual Services at px64 kbit/s, ITU-T Rec. H.261
Generic coding of moving pictures and associated audio information—part 2: video, ITU-T Rec. H.262 and ISO/IEC 13818-2 (MPEG 2Video), ITU-T and ISO/IEC JTC 1 (1994)
Video Coding for Low Bit Rate Communication, ITU-T Rec. H.263 (1995)
Advanced Video Coding for Generic Audio-Visual Services, ITU-T Rec. H.264 and ISO/IEC 14496-10 (AVC), ITU-T and ISO/IEC JTC 1 (2003)
Bross, B., Han, W.-J., Sullivan, G.J., Ohm, J.-R., Wiegand, T.: High efficiency video coding (HEVC) text specification draft 9. Document: JCTVC-K1003, Shanghai (2012)
Ohm, J.R., Sullivan, G.J., Schwarz, H., Tan, T.K., Wiegand, T.: Comparison of the coding efficiency of video coding standards—including high efficiency video coding (HEVC). IEEE Trans. Circuits Syst. Video Technol. 22(12), 1669–1684 (2012)
Correa, G., Assuncao, P., Agostini, L., da Silva Cruz, L.A.: Performance and computational complexity assessment of high-efficiency video encoders. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1899–1909 (2012)
Henry, F., Pateux, S.: Wavefront parallel processing. Document: JCTVC-E196, Geneva (2011)
Fuldseth, A., Horowitz, M., Zhou, M.: Tiles. Document: JCTVC-E408, Geneva (2011)
Misra, K., Segall, A., Horowitz, M., Xu, S., Fuldseth, A., Zhou, M.: An overview of tiles in HEVC. IEEE J. Sel. Top. Signal Process. 7(6), 969–977 (2013)
Chi, C.C., et al.: Parallel scalability and efficiency of HEVC parallelization approaches. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1827–1838 (2012)
Shafique, M., Khan, M.U.K., Henkel, J.: Power efficient and workload balanced tiling for parallelized high efficiency video coding. In: 2014 IEEE International Conference on Image Processing (ICIP), Paris, pp. 1253–1257 (2014)
Blumenberg, C., Palomino, D., Bampi, S., Zatt, B.: Adaptive content-based tile partitioning algorithm for the HEVC standard. In: 2013 Picture Coding Symposium (PCS), San Jose, CA, pp. 185–188 (2013)
Jin, X., Dai, Q.: Clustering-based content adaptive tiles under on-chip memory constraints. IEEE Trans. Multimed. 18(12), 2331–2344 (2016)
Ahn, Y.J.; Hwang, T.J., Sim, D.G., Han, W.J.: Complexity model based load-balancing algorithm for parallel tools of HEVC. In: 2013 Visual Communications and Image Processing (VCIP), Kuching, pp. 1–5 (2013)
Storch, I., Palomino, D., Zatt, B., Agostini, L.: Speedup-aware history-based tiling algorithm for the HEVC standard. In: 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, pp. 824–828 (2016)
Storch, I, Zatt, B, Agostini, L, Correa, G, Palomino, D.: Memory-aware tiles workload balance through machine-learnt complexity reduction for HEVC. In: 2018 25th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Bordeaux, pp. 521–524 (2018)
Improve HEVC load-balancing for network streaming using adaptive tile boundary: Anonymous ICME submission. In: 2016 IEEE International Conference on Multimedia and Expo (ICME), Seattle, WA, pp. 1–6 (2016)
High Efficiency Video Coding Test Model 16. https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.0/. Last access: Jan 2019
Bossen, F.: Common test conditions and software reference configurations. Document: JCTVC-L1100, Geneva (2013)
Bjøntergaard, G.: Calculation of average PSNR differences between RD-curves. Technical report. VCEG-M33, ITU-T Video Coding Experts Group (VCEG) (2001)
Acknowledgements
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brasil (CAPES)—Finance Code 001, Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), and Fundação de Amparo à pesquisa do Estado do Rio Grande do Sul Brasil (FAPERGS).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Storch, I., Palomino, D., Zatt, B. et al. Speedup evaluation of HEVC parallel video coding using Tiles. J Real-Time Image Proc 17, 1469–1486 (2020). https://doi.org/10.1007/s11554-019-00900-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-019-00900-y