Skip to main content
SpringerLink
Log in

Coding mode decision algorithm for fast HEVC transrating using heuristics and machine learning

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This article describes a framework to speed up the HEVC encoding decisions for on-demand transrating of bitstreams. The methods proposed collect information from a high-quality reference bitstream which after processing is used to limit the number of modes evaluated in subsequent re-encodings at different bitrates. In this way, the time required to process re-encode-time computing-intensive decisions, such as partitioning and motion estimation is significantly reduced. The methods proposed are a combination of heuristics with a statistical basis and fast decision techniques trained using automatic learning methodologies. Experimental results using the HEVC reference encoder show that jointly the methods proposed reduce the transcoding computational complexity by up to 78.8%, with Bjontegaard bitrate deltas penalties smaller than 1.06%. A comparison with related works showed that the proposed method is able to outperform state-of-the-art solutions in terms of combined rate-distortion–complexity performance indicators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. In: ITU-T Q. 6/SG16 VCEG, 15th Meeting, Austin, Texas (2001)

  2. Bubolz, T.L.A., Conceição, R.A., Grellert, M., Agostini, L., Zatt, B., Correa, G.: Quality and energy-aware hevc transrating based on machine learning. IEEE Trans. Circuits Syst. I: Regul. Papers 66(6), 2124–2136 (2019). https://doi.org/10.1109/TCSI.2019.2903978

    Article  Google Scholar 

  3. Correa, G., Assuncao, P.A., Agostini, L.V., da Silva Cruz, L.A.: Fast hevc encoding decisions using data mining. IEEE Trans. Circuits Syst. Video Technol. 25(4), 660–673 (2015). https://doi.org/10.1109/TCSVT.2014.2363753

    Article  Google Scholar 

  4. De Praeter, J., Díaz-Honrubia, A.J., Van Kets, N., Van Wallendael, G., De Cock, J., Lambert, P., Van de Walle, R.: Fast simultaneous video encoder for adaptive streaming. In: Multimedia Signal Processing, 2015 IEEE 17th International Workshop on, IEEE, pp 1–6 (2015)

  5. Díaz-Honrubia, A.J., Cebrián-Márquez, G., Martínez, J.L., Cuenca, P., Puerta, J.M., Gámez, J.A.: Low-complexity heterogeneous architecture for h. 264/hevc video transcoding. J. Real-Time Image Process. 12(2), 311–327 (2016)

    Article  Google Scholar 

  6. Feurer, M., Hutter, F.: Hyperparameter optimization. Automated Machine Learning, pp. 3–33. Springer, Cham (2019)

    Chapter  Google Scholar 

  7. Goswami, K., Kim, B.: A design of fast high-efficiency video coding scheme based on markov chain monte carlo model and bayesian classifier. IEEE Trans. Ind. Electron. 65(11), 8861–8871 (2018). https://doi.org/10.1109/TIE.2018.2815941

    Article  Google Scholar 

  8. Goswami, K., Kim, B.G.: A design of fast high-efficiency video coding scheme based on markov chain monte carlo model and bayesian classifier. IEEE Trans. Ind. Electron. 65(11), 8861–8871 (2018)

    Article  Google Scholar 

  9. Goswami, K., Lee, J.H., Kim, B.G.: Fast algorithm for the high efficiency video coding (hevc) encoder using texture analysis. Inf. Sci. 364, 72–90 (2016)

    Article  Google Scholar 

  10. Grellert, M., Oliveira, T., Duarte, CR., da Silva Cruz, LA.: Fast HEVC transrating using random forests. In: Proc. of the IEEE International Conference Visual Communications and Image Processing, pp 1–4 (2018a)

  11. Grellert, M., Zatt, B., Bampi, S., da Silva Cruz, L.A.: Fast coding unit partition decision for hevc using support vector machines. IEEE Trans. Circuits Syst. Video Technol. 29(6), 1741–1753 (2018b)

    Article  Google Scholar 

  12. Kim, C.K., Hr, Lee, Tj, Jung, Kim, B.G., Seo, Kd: An efficient delay-constrained arq scheme for mmt packet-based real-time video streaming over ip networks. J. Real-Time Image Process. 12(2), 257–271 (2016)

    Article  Google Scholar 

  13. Mallikarachchi, T., Talagala, D.S., Arachchi, H.K., Fernando, A.: Content-adaptive feature-based cu size prediction for fast low-delay video encoding in hevc. IEEE Trans. Circuits Syst. Video Technol. 28(3), 693–705 (2018). https://doi.org/10.1109/TCSVT.2016.2619499

    Article  Google Scholar 

  14. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., et al.: Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12(Oct), 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  15. Schroeder, D., Ilangovan, A., Reisslein, M., Steinbach, E.: Efficient multi-rate video encoding for HEVC-based adaptive http streaming. IEEE Trans. Circuits Syst. Video Technol. 28(1), 143–157 (2018)

    Article  Google Scholar 

  16. Sharman, K., Sühring, K.: JCTVC-X1100 - Common Test Conditions. In: ITU-T SG16WP3 and ISO/IEC JTC1/SC29/WG11 24th JCT-VC Meeting Docs (2016)

  17. Shen, L., Feng, G.: Content-based adaptive shvc mode decision algorithm. IEEE Trans. Multimed. 21(11), 2714–2725 (2019). https://doi.org/10.1109/TMM.2019.2909859

    Article  Google Scholar 

  18. Stockhammer, T.: Dynamic adaptive streaming over HTTP: standards and design principles. In: Proceedings of the second annual ACM conference on Multimedia systems, ACM, pp. 133–144 (2011)

  19. Van, L.P., De Praeter, J., Van Wallendael, G., Van Leuven, S., De Cock, J., Van de Walle, R.: Efficient bit rate transcoding for high efficiency video coding. IEEE Trans. Multimed. 18(3), 364–378 (2016)

    Article  Google Scholar 

  20. Vetro, A., Christopoulos, C., Sun, H.: Video transcoding architectures and techniques: an overview. IEEE Signal Process. Mag. 20(2), 18–29 (2003)

    Article  Google Scholar 

  21. Wallendael, GV., Cock, JD., de Walle, RV.: Fast transcoding for video delivery by means of a control stream. In: 2012 19th IEEE International Conference on Image Processing, pp. 733–736 (2012)

  22. Xu, Z., Min, B., Cheung, R.C.: A fast inter cu decision algorithm for hevc. Signal Process. Image Commun. 60, 211–223 (2018)

    Article  Google Scholar 

  23. Yang, SH., Zhong, CC.: Fast coding-unit mode decision for HEVC transrating. In: Computer and Information Technology (CIT), 2017 IEEE International Conference on, IEEE, pp. 93–100 (2017)

Download references

Acknowledgements

The authors wish to acknowledge the financial support of the Portuguese research funding agency FCT under project UIDB/EEA/50008/2020.

Author information

Authors and Affiliations

  1. Departmento de Informática e Estatística, Universidade Federal de Santa Catarina, Florianópolis, Brazil

    Mateus Grellert

  2. Departamento de Engenharia Electrotécnica e de Computadores, Instituto de Telecomunicações, Universidade de Coimbra, Coimbra, Portugal

    Luis A. da Silva Cruz

  3. Programa de Pós-Graduação em Computação, Universidade Federal de Pelotas, Pelotas, Brazil

    Bruno Zatt

  4. Institute of Informatics, Federal University of Rio Grande do Sul, Porto Alegre, Brazil

    Sergio Bampi

Authors
  1. Mateus Grellert
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luis A. da Silva Cruz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bruno Zatt
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sergio Bampi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mateus Grellert.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grellert, M., da Silva Cruz, L.A., Zatt, B. et al. Coding mode decision algorithm for fast HEVC transrating using heuristics and machine learning. J Real-Time Image Proc 18, 1881–1896 (2021). https://doi.org/10.1007/s11554-020-01063-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-020-01063-x

Keywords

Search

Navigation