Skip to main content
Springer Nature Link
Log in

A context-adaptive fast intra coding algorithm of high-efficiency video coding (HEVC)

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper proposes a context-adaptive fast intra coding algorithm of high efficiency video coding (HEVC). Intra coding of HEVC improves the coding efficiency of intra coded picture with an exhaustive computation and evaluation. In this paper, the proposed algorithm consists of an adaptive rough mode selection to decrease the prediction modes for rough mode decision (RMD), based on the upper coding unit (CU) and the neighboring prediction units (PU), by minimizing BD-rate increment and encoding complexity. For further complexity reduction, the early termination approaches for RDO and RQT stages are also introduced by the adaptive thresholding based on the average value of rate distortion (RD) costs. In terms of complexity evaluation, experimental results show that the proposed algorithms reduce encoding time at about 40 % with 1.3 % BD-rate loss on average, compared to the reference software of HEVC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. ITU-T SG16 Q6 and ISO/IEC JTC1/SC29/WG11 Coding of Moving Pictures and Audio: Joint call for proposals on videocompression technology. ITU-T SG16 Q6 document VCEG-AM91 and ISO/IEC JTC1/SC29/WG11 document N11113 (2010) [Online]. Available: http://www.itu.int/oth/T4601000002/en

  2. Sullivan, G.J., Ohm, J.R.: Recent developments in standardization of high efficiency video coding (HEVC). In: Proc. 33rd SPIE Appl. Digital Image Process. 7798 (2010)

  3. Wiegand, T., Ohm, J.R., Sullivan, G.J., Han, W.J., Joshi, R., Tan, T.K., Ugur, K.: Special section on the joint call for proposals on high Efficiency video coding (HEVC) standardization. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1661–1666 (2011)

    Article  Google Scholar 

  4. Ahn, Y.J., Sim, D.: Square-type-first inter-CU tree search algorithm for acceleration of HEVC encoder. J. Real Time Image Process. (2015). doi:10.1007/s11554-015-0487-5

    Google Scholar 

  5. ITU-T Rec. H.265 and ISO/IEC 23008-2: High efficiency video coding. Final draft approval (2013) (formally published by ITU-T in June, 2013, and in ISO/IEC in Nov. 2013)

  6. Choi, H., Yoo, J., Nam, J., Sim, D., Bajic, I.V.: Pixel-wise unified rate-quantization model for multi-level rate control. IEEE J. Sel. Topics Signal Process. 7(6), 1112–1123 (2013)

    Article  Google Scholar 

  7. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  8. ITU-T, Recommendation H.265 (04/13): Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services–Coding of Moving Video, High Efficiency Video Coding. [Online]. Available: https://www.itu.int/rec/dologin_pub.asp?lang=f&id=T-REC-H.265-201410-I!!PDF-E&type=items

  9. HEVC Reference Model-14th. [Online]. Available: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-14.0/

  10. McCann, K., Bross, B., Han, W.J., Kim, I.K., Sugimoto, K., Sullivan, G.J.: High Efficiency Video Coding (HEVC) Test Model 14 (HM14) Encoder Description. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-P1002 (2014)

  11. Bossen, F., Drugeon, V., Francois, E., Jung, J., Kanumuri, S., Narroschke, M., Sasai, H., Sole, J., Suzuki, Y., Tan, T.K., Wedi, T., Wittmann, S., Yin, P., Zheng, Y.: Video coding using a simplified block structure and advanced coding techniques. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1667–1675 (2010)

    Article  Google Scholar 

  12. Han, W.J., Min, J., Kim, I.K., Alshina, E., Alshin, A., Lee, T., Chen, J., Seregin, V., Lee, S., Hong, Y.M., Cheon, M.S., Shlyakhov, N., McCann, K., Davies, T., Park, J.H.: Improved video compression efficiency through flexible unit representation and corresponding extension of coding tools. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1709–1720 (2010)

    Article  Google Scholar 

  13. Karczewicz, M., Chen, P., Joshi, R.L., Wang, X., Chien, W.J., Panchal, R., Reznik, Y., Coban, M., Chong, I.S.: A hybrid video coder based on extended macroblock sizes, improved interpolation, and flexible motion representation. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1698–1708 (2010)

    Article  Google Scholar 

  14. Marpe, D., Schwarz, H., Bosse, S., Bross, B., Helle, P., Hinz, T., Kirchoffer, H., Lakshman, H., Nguyen, T., Oudin, S., Siekmann, M., Suhring, K., Winken, M., Wiegand, T.: Video compression using nested quadtree structures, leaf merging, and improved techniques for motion representation and entropy coding. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1676–1687 (2010)

    Article  Google Scholar 

  15. Ugur, K., Andersson, K., Fuldseth, A., Bjontegaard, G., Endresen, L.P., Lainema, J., Hallapuro, A., Ridge, J., Rusanovskyy, D., Zhang, C., Norkin, A., Priddle, C., Rusert, T., Samuelsson, J., Sjoberg, R., Wu, Z.: High performance, low complexity video coding and the emerging HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 20(12), 1688–1697 (2010)

    Article  Google Scholar 

  16. Sze, V., Madhukar, B., Sullivan, G.J.: High efficiency video coding (HEVC): algorithms and architectures. Springer International Publishing, Switzerland (2014)

    Book  Google Scholar 

  17. Ahn, Y.J., Hwang, T.J., Sim, D.G., Han, W.J.: Implementation of fast HEVC encoder based on SIMD and data-level parallelism. EURASIP Journal on Image and Video Processing 2014(1), 1–19 (2014)

    Article  Google Scholar 

  18. Jo, H., Sim, D.G.: Bitstream decoding processor for fast entropy decoding of variable length coding–based multiformat videos. Opt. Eng. 53(6), 063102 (2014). doi:10.1117/1.OE.53.6.063102

    Article  Google Scholar 

  19. Ryu, H., Ahn, Y.J., Mok, J.S., Sim, D.: Performance analysis of HEVC parallelization methods for high-resolution videos. IEIE Trans. Smart Process. Comput. 4(1), 28–34 (2015)

    Article  Google Scholar 

  20. Lee, H., Kang, J.W., Lee, J., Choi, S., Kim, J., Sim, D.G.: Scalable extension of HEVC for flexible high-quality digital video content services. ETRI J. 35(6), 990–1000 (2013)

    Article  Google Scholar 

  21. Kim, I., Min, J., Lee, T., Han, W.J., Park, J.: Block partitioning structure in the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1697–1706 (2012)

    Article  Google Scholar 

  22. Yuan, Y., Kim, I.K., Zheng, X., Liu, L., Cao, X., Lee, S., Cheon, M.S., Lee, T., He, Y., Park, J.H.: Quadtree based nonsquare block structure for inter frame coding in high Efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1707–1719 (2012)

    Article  Google Scholar 

  23. Sole, J., Joshi, R., Nguyen, N., Ji, T., Karczewicz, M., Clare, G., Henry, F., Duenas, A.: Transform Coefficient coding in HEVC. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1765–1777 (2012)

    Article  Google Scholar 

  24. Ismail, M., Jo, H., Sim, D.G.: Fast intra mode decision for HEVC intra coding. In: IEEE International Symposium on Consumer Electronics (ISCE), pp. 1–2 (2014)

  25. Correa, G., Assuncao, P., Agostini, L., Cruz, L.A.S.: Complexity scalability for real-time HEVC encoders. J. Real Time Image Process. (2014). doi:10.1007/s11554-013-0392-8

    Google Scholar 

  26. Zhang, H., Ma, Z.: Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans. Circuits Syst. Video Technol. 24(4), 660–668 (2014)

    Article  Google Scholar 

  27. Lainema, J., Bossen, F., Han, W.J., Min, J., Ugur, K.: Intra coding of the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1792–1801 (2012)

    Article  Google Scholar 

  28. Ma Jonghyun., Sim, D.: Early termination of block vector search for fast encoding of HEVC screen content coding IEIE Trans Smart Process. Comput. 3(6), 388–392 (2014)

  29. Norkin, A., Bjontegaard, G., Fuldseth, A., Narroschke, M., Ikeda, M., Andersson, K., Zhou, M., Auwera, G.V.: HEVC deblocking filter. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1746–1754 (2012)

    Article  Google Scholar 

  30. Fu, C.M., Alshina, E., Alshin, A., Huang, Y.W., Chen, C.Y., Tsai, C.Y., Hsu, C.W., Lei, S.M., Park, J.H., Han, W.J.: Sample adaptive offset in the HEVC standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1755–1764 (2012)

    Article  Google Scholar 

  31. Shi, Y., Au, O.C., Zhang, H., Zhang, X., Jia, L., Dai, W., Zhu, W.: Local saliency detection based fast mode decision for HEVC intra coding. In: IEEE International Workshop on Multimedia Signal Processing (MMSP), pp. 429–433 (2013)

  32. Guilherme, C., Pedro, A., Luciano, A., Cruz, L.A.S.: Performance and computational complexity assessment of high-Efficiency video encoders. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1899–1909 (2012)

    Article  Google Scholar 

  33. Bossen, F., Bross, B.: S¨uhring, K., Flynn, D.: HEVC complexity and implementation analysis. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1685–1696 (2012)

    Article  Google Scholar 

  34. Zhao, L., Zhang, L., Ma, S., Zhao, D.: Fast mode decision algorithm for intra prediction in HEVC. In: IEEE Visual Communications and Image Processing (VCIP), pp. 1–4 (2011)

  35. Alwani, M., Johar, S.: A method for fast rough mode decision in HEVC. In: Data Compression Conference (DCC), pp. 476 (2013)

  36. Zhang, M., Zhao, C., Xu, J.: An adaptive fast intra mode decision in HEVC. In: IEEE International Conference on Image Processing (ICIP), pp. 221–224 (2012)

  37. Ismail, M., Ma, J., Sim, D.G.: Full depth RQT after PU decision for fast encoding of HEVC. In: The IEEE International Symposium on Consumer Electronics (ISCE), pp.1–2 (2014)

  38. Zhang, H., Ma, Z.: Fast intra prediction for high efficiency video coding. Advances in Multimedia Information Processing-PCM 7674, 568–577 (2012)

    Google Scholar 

  39. Zhang, H., Ma, Z.: Early termination schemes for fast intra mode decision in high Efficiency video coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 45–48 (2013)

  40. Zhu, S., Zhao, D.: Fast intra-prediction mode decision algorithm for high efficiency video coding. In: IEEE International Conference on Industrial Electronics and Applications (ICIEA), pp. 936–939 (2014)

  41. Na, S., Lee, W., Yoo, K.: Edge-based fast mode decision algorithm for intra prediction in HEVC. In: IEEE International Conference on Consumer Electronics (ICCE), pp. 11–14 (2014)

  42. Dhollande, N., Meur, O., Guillemot, C.: HEVC intra coding of ultra hd video with reduced complexity. In: IEEE International Conference on Image Processing (ICIP), pp. 41122–4126 (2014)

  43. Liu, Y., Chen, Z., Fang, J., Chang, P.: SVM-based fast intra CU depth decision for HEVC. In: Data Compression Conference (DCC), pp. 458 (2015)

  44. Shen, L., Zhang, Z., Liu, Z.: Effective CU size decision for HEVC intra coding. IEEE Trans. Image Process. 23(10), 4232–4241 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  45. Li, Y., Liu, Y., Yang, H., Yang, D.: Fast CU splitting and pruning method based on online learning for intra coding in HEVC. In: IEEE Visual Communications and Image Processing Conference (VCIP), pp. 450–453 (2014.)

  46. Yang, M., Grecos, C.: Fast intra encoding decisions for high efficiency video coding standard. J. Real-Time Image process. (2014). doi:10.1007/s11554-014-0445-7

    Google Scholar 

  47. Min, B., Cheung, R.C.C.: A fast CU size decision algorithm for the HEVC intra encoder. IEEE Trans. Circuits Syst. Video Technol. 25(5), 892–896 (2015)

    Article  Google Scholar 

  48. Hu, N., Yang, E.H.: Fast mode selection for HEVC intra frame coding with entropy coding refinement based on transparent composite model. IEEE Trans. Circuits Syst. Video Technol. 25(9), 1521–1532 (2015)

    Article  Google Scholar 

  49. Jamali, M., Coulombe, S., Caron, F.: Fast HEVC intra mode decision based on edge detection and SATD costs classification. In: Data Compression Conference (DCC), pp. 43–52 (2015)

  50. Khan, M.U.K., Shafique, M., Henkel, J.: Fast hierarchical intra angular mode selection for high efficiency video coding. In: IEEE International Conference on Image Processing (ICIP), pp. 3681–3685 (2014)

  51. Khan, M.U.K., Shafique, M., Grellert, M., Mateus, Henkel, J.: Hardware-software collaborative complexity reduction scheme for the emerging HEVC intra encoder. In: Design, Automation and Test in Europe Conference & Exhibition (DATE), pp. 125–128 (2013)

  52. Thisa. L.A.S., Cruz, L.A.S., Agostini, L.V.: HEVC intra mode decision acceleration based on tree depth levels relationship. In: Picture Coding Symposium (PCS), pp. 277–280 (2013)

  53. Palomino, D., Cavichioli, E., Susin, A., Agostini, L., Shafique, M., Henkel, J.: Fast HEVC intra mode decision algorithm based on new evaluation order in the coding tree block. In: Picture Coding Symposium (PCS), pp. 209–212 (2013)

  54. Coll, D.R, Adzic, V., Escribano, G.F, Kalva, H., Martinez, J.L., Cuenca, P.: Fast partitioning algorithm for HEVC Intra frame coding using machine learning. In: IEEE International Conference on Image Processing (ICIP), pp. 4112–4116 (2014)

  55. Shi, W., Jiang, X., Song, T., Shimamoto, T.: Edge information based fast selection algorithm for intra prediction of HEVC. In: IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), pp. 17–20 (2014)

  56. Huang, X., Jia, H., Wei, K., Liu, J., Zhu, C., Lv, Z., Xie, D.: Fast algorithm of coding unit depth decision for HEVC intra coding. In: IEEE Visual Communications and Image Processing Conference, pp. 458–461 (2014)

  57. Wang, Y., Fan, X., Zhao, L., Ma, S., Zhao, D., Gao, W.: A fast intra coding algorithm for HEVC. In: IEEE International Conference on Image Processing (ICIP), pp. 4117-4121 (2014)

  58. Zhang, M., Bai, H., Lin, C., Zhang, M., Zhao, Y.: Texture characteristics based fast coding unit partition in HEVC intra coding. In: Data Compression Conference (DCC), pp. 477 (2015)

  59. Bossen, F.: Common HM test conditions and software reference configurations. Joint Collaborative Team on Video Coding (JCT-VC), JCT-VC-L1100 (2013)

  60. Bjontegaard, G.: Improvements of the bd-psnr model. ITU-T Q.6/SG16 Document, VCEG-AI11 (2008)

  61. Hanhart, P., Rerabek, M., Korshunov, P., Ebrahimi, T.: Subjective evaluation of HEVC intra coding for still image compression. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-L0380 (2013)

  62. Ugur, K., Lainema, J.: Updated results on HEVC still picture coding performance. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-M0041 (2013)

  63. Microsof Research, Joulemeter version 1.2 (2011). [Online]. Available: http://research.microsoft.com/en-us/downloads/fe9e10c5-5c5b-450c-a674-daf55565f794/default.aspx

  64. Akramullah, S.: Digital video concepts, method, and metrics: quality, compression, performance, and power trade-off analysis. Apress (2014). [Online]. Available: http://link.springer.com/book/10.1007%2F978-1-4302-6713-3

  65. Kansal, A., Zhao, F., Kothari, N., Bhattacharya, A.A.: Virtual machine power metering and provisioning. In: Proceedings of the 1st ACM Symposium on Cloud computing (SOCC’10), pp. 39–50, (2010)

Download references

Acknowledgments

This research was partly supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (NRF-2014R1A2A1A11052210), the ICT R&D program of MSIP/IITP (B0101-15-295, Development of UHD Realistic Broadcasting, Digital Cinema, and Digital Signage Convergence Service Technology), and the MSIP (Ministry of Science, ICT & Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2015-H8501-15-1005) supervised by the IITP (Institute for Information & communications Technology Promotion).

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Kwangwoon University, 20, Gwangun-ro, Nowon-gu, Seoul, Korea

    Ismail Marzuki, Jonghyun Ma, Yong-Jo Ahn & Donggyu Sim

Authors
  1. Ismail Marzuki
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Jonghyun Ma
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Yong-Jo Ahn
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Donggyu Sim
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Donggyu Sim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Marzuki, I., Ma, J., Ahn, YJ. et al. A context-adaptive fast intra coding algorithm of high-efficiency video coding (HEVC). J Real-Time Image Proc 16, 883–899 (2019). https://doi.org/10.1007/s11554-016-0571-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-016-0571-5

Keywords