Abstract
HEVC (High Efficiency Video Coding) as one of the newest international video coding standard, can achieve about 50% bit rate reduction compared with H.264/AVC (Advanced Video Coding) with the same perceptual quality by the use of flexible CTU (coding tree unit) structure, but at the same time, it also dramatically adds its computational complexity for HEVC. To reduce the computational complexity, a fast intra-prediction mode and CU (Coding Unit) size decision algorithm based on prediction mode and coding bits grouping is presented for HEVC intra-encoding in this paper. The contribution of this paper lies in the fact that we successfully use the prediction mode grouping and coding bits grouping technologies to rapidly realize the optimal prediction mode and size decision for the current CU, thus saving much computation complexity for HEVC. Specifically, in our scheme, first, we use grouping technology to group 35 intra-prediction modes into 5 subsets of candidate modes list according to the texture complexity of current PU (Prediction Unit), and each subset only contains 11 intra-prediction modes, which can greatly reduce the traversing and calculating number of candidate mode in RMD (Rough Mode Decision); second, we use coding bits grouping technology to quickly judge whether the current CU needs to be further divided on the basis of the studying of texture complexity in the current CU, which can reduce many unnecessary prediction and partition operations for the current CU; at last we use the fast intra-mode prediction and CU size decision algorithm above to quickly realize the optimal encoding for the current CU in HEVC. As a result, the high computational complexity in HEVC intra-encoding can be efficiently reduced by our proposed scheme. And the simulation results of our experiments show that our proposed fast intra-coding algorithm based on prediction mode and coding bit grouping in this paper can reduce about 49.10% computational complexity on average only at a cost of 0.92% bit rate increase and 0.065 db PSNR decline compared with the standard reference HM16.1algorithm under all-intra-configuration.
Similar content being viewed by others
References
Sullivan, G.J., Ohm, J., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol 22(12), 1649–1668 (2012). https://doi.org/10.1109/TCSVT.2012.2221191
High Efficiency Video Coding, document ITU-T Rec. H.265 and ISO/IEC 23008-2 (HEVC), ITU-T and ISO/IEC, (2013)
Vanne, J., Viitanen, M., Hämäläinen, T.D., Hallapuro, A.: Comparative rate-distortion-complexity analysis of HEVC and AVC video codecs. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1885–1898 (2012). https://doi.org/10.1109/TCSVT.2012.2223013
Han, W., Min, J., Kim, I., Alshina, E., Alshin, A., et al.: Improved videocompression efficiency through flexible unit representation and corresponding extension of coding tools. IEEE Trans. Circuit Syst. Video Technol. 20(12), 1709–1720 (2010). https://doi.org/10.1109/TCSVT.2010.2092612
Sullivan, G.J., Ohm, J.R.: Recent developments in standardization of high efficiency video coding (HEVC). Proc. SPIE 7798, 77980V (2010). https://doi.org/10.1117/12.863486
Pourazad, M.T., Doutre, C., Azimi, M., Nasiopoulos, P.: HEVC: the new gold standard for video compression: how does HEVC compare with H.264/AVC? IEEE Consum. Electron. Mag 1(3), 36–46 (2012). https://doi.org/10.1109/MCE.2012.2192754
Architectural Outline of Proposed High Efficiency Video Coding Design Elements, document JCTVC-A202, ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, in Proc of 1st Meeting, Dresden, Germany, (2010)
Gao, L., Dong, S., Wang, W., et al.: Fast intra mode decision algorithm based on refinement in hevc. In process of 2015 IEEE International Symposium on Circuits and Systems, (2015). https://doi.org/10.1109/ISCAS.2015.7168684
Na, S., Lee, W., Yoo, K.: Edge-based fast mode decision algorithm for intra prediction in HEVC. In process of 2014 IEEE International Conference on Consumer Electronics (ICCE), IEEE, (2014). https://doi.org/10.1109/ICCE.2014.6775887
Ruiz, D., Fernández-Escribano, G., Martínez, J.L., et al.: Fast intra mode decision algorithm based on texture orientation detection in HEVC. Signal Proc.: Image Commun. 44, 12–28 (2016). https://doi.org/10.1016/j.image.2016.03.002
Heindel, A., Kaup, A.: Fast intra mode decision in HEVC using early distortion estimation. In process of 2015 IEEE China Summit and International Conference on Signal and Information Processing, IEEE, (2015). https://doi.org/10.1109/ICCVW.2011.6130215
Lu, X., Xiao, N., Hu, Y., et al.: Fast mode decision for HEVC intra coding with efficient mode skipping and improved RMD. In process of 2016 IEEE 18th International Workshop on Multimedia Signal Processing, IEEE, (2016). https://doi.org/10.1109/MMSP.2016.7813355
Zhang, H., Ma, Z.: Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans. Circuits Syst. Video Technol. 24(4), 660–668 (2014a). https://doi.org/10.1109/TCSVT.2013.2290578
Fini, M.R., ZargariAsl, F.: A fast intra mode decision method based on reduction of the number of modes in HEVC standard. In process of 2014 7th International Symposium on. Telecommunications, IEEE, (2014). https://doi.org/10.1109/ISTEL.2014.7000820
Yao, Y., Li, X., Lu, Y.: Fast intra mode decision algorithm for HEVC based on dominant edge assent distribution. Multimedia Tools Appl. 75(4), 1963–1981 (2016). https://doi.org/10.1007/s11042-014-2382-7
Jamali, M., Coulombe, S., Caron, F.: Fast HEVC intra mode decision based on edge detection and SATD costs classification, In Proc of IEEE Int. Data Compress. Conf, (2015). https://doi.org/10.1109/DCC.2015.21
Zhang, D., Chen, Y., Izquierdo E.: Fast intra mode decision for HEVC based on texture characteristic from RMD and MPM, In Proc of IEEE Int. Conf. Vis. Commun Image Process, (2014). https://doi.org/10.1109/VCIP.2014.7051618
Lei, J., Li, D., Pan, Z., Sun, Z., Kwong, S., Hou, C.: Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding. IEEE Trans. Broad. 63(1), 48–58 (2017). https://doi.org/10.1109/TBC.2016.2623241
Bichon, M., Le, Tanou, J., Ropert, M., Hammidouche, W., Morin, L., and Zhang, L.: Low complexity joint RDO of prediction units couples for HEVC intra coding. In Proceedings of the IEEE International Conference on Acoustics, Speech & Signal Processing. (2018). https://doi.org/10.1109/ICASSP.2018.8462489
Ryu, S., Kang, J.: Machine learning-based fast angular prediction mode decision technique in video coding. IEEE Trans. Image Proc. 27(11), 5525–5538 (2018). https://doi.org/10.1109/TIP.2018.2857404
Bae, J.H., Sunwoo, M.H.: Adaptive early termination algorithm using coding unit depth history in HEVC. J. Signal Proc. Syst. 91(8), 863–873 (2019). https://doi.org/10.1007/s11265-018-1399-y
Zhang, H., Ma, Z.: Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans. Circ. Syst. Video Technol. 24(4), 660–668 (2014b). https://doi.org/10.1109/TCSVT.2013.2290578
Ha, J.M., Bae, J.H., Sunwoo, M.H.: Texture-based fast CU size decision algorithm for HEVC intra coding. In proc of 2016 IEEE Asia Pacific Conference on Circuits and Systems, (2016). https://doi.org/10.1109/APCCAS.2016.7804070
Ruiz, D., Fernández-Escribano, G., Adzic, V., et al.: Fast CU partitioning algorithm for HEVC intra coding using data mining. Multimedia Tools Appl. 76, 861–894 (2017)
Cen, Y.F., Wang, W.L., Yao, X.W.: A fast CU depth decision mechanism for HEVC. Inform. Proc. Lett. 115(9), 719–724 (2015). https://doi.org/10.1016/j.ipl.2015.04.001
Shen, L., Zhang, Z., Zhang, X., et al.: Fast TU size decision algorithm for HEVC encoders using Bayesian theorem detection. Signal Proc: Image Commun. 32, 121–128 (2015). https://doi.org/10.1016/j.image.2015.01.008
Ahn, S., Lee, B., Kim, M.: A novel fast CU encoding scheme based on spatiotemporal encoding parameters for HEVC inter coding. IEEE Trans. Circuits Syst. Video Technol. 25, 422–435 (2015). https://doi.org/10.1109/TCSVT.2014.2360031
Lee, J., Kim, S., Lim, K., et al.: A fast CU size decision algorithm for HEVC. IEEE Trans. Circuits Syst. Video Technol. 25, 411–421 (2015). https://doi.org/10.1109/TCSVT.2014.233961
Shen, X., Yu, L., and Chen, J.: Fast coding unit size selection for HEVC based on Bayesian decision rule, in proc of Picture Coding Symp, (2012). https://doi.org/10.1109/PCS.2012.6213252
Chen, J., Yu, L.: Effective HEVC intra coding unit size decision based on online progressive Bayesian classification. In Proceedings of the IEEE International Conference on Multimedia and Expo. (ICME’16). (2016). https://doi.org/10.1109/ICME.2016.7552970
Liu, X., Li, Y., Liu, D., Wang, P., Yang, L.T.: An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning. IEEE Trans. Circ. Syst. Video Technol. 29(1), 144–155 (2019). https://doi.org/10.1109/TCSVT.2017.2777903
Liu, Z., Yu, X., Gao, Y., Chen, S., Ji, X., Wang, D.: CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans. Image Proc. 25(11), 5088–5103 (2016). https://doi.org/10.1109/TIP.2016.2601264
Xu, M., Li, T., Wang, Z., Deng, X., Yang, R., Guan, Z., Bossen, F.: Common test conditions and software reference configurations, document JCTVC-G1200, Geneva, Switzerland, (2011)
Zhang, Y., Pan, Z., Li, N., Wang, X., Jiang, G., Kwong, S.: Effective data driven coding unit size decision approaches for HEVC intra coding. IEEE Trans. Circ. Syst. Video Technol. 28(11), 3208–3222 (2018). https://doi.org/10.1109/TCSVT.2017.2747659
Zhang, T., Sun, M.T., Zhao, D., Gao, W.: Fast intra-mode and CU size decision for HEVC. IEEE Trans. Circ. Syst. Video Technol. 27(8), 1714–1724 (2017). https://doi.org/10.1109/TCSVT.2016.2556518
Zhang, Y., Li, N., Kwong, S., Jiang, G., Zeng, H.: Statistical early termination and early skip models for fast mode decision in HEVC INTRA coding. ACM Trans. Multimedia Comput. Commun. Appl (TOMM) 15(3), 70 (2019). https://doi.org/10.1145/3321510
Tseng, C.F., Lai, Y.T.: Fast coding unit decision and mode selection for intra-frame coding in high-efficiency video coding. IET Image Proc. 10(3), 215–221 (2016). https://doi.org/10.1049/iet-ipr.2015.0154
Shang, X., Wang, G., Fan, T., and Li, Y.: Fast CU size decision and PU mode decision algorithm in HEVC intra coding. In Proceedings of the IEEE International Conference on Image Processing (ICIP’15). (2015). https://doi.org/10.1109/ICIP.2015.7351069
Chen, F., Jin, D., Peng, Z., et al.: Fast intra coding algorithm for HEVC based on depth range prediction and mode reduction. Multimedia Tools Appl. 77(21), 28375–28394 (2018). https://doi.org/10.1007/s11042-018-6011-8
Liao, W.H., Chen, Z.Z.: A fast CU partition and mode decision algorithm for HEVC intra coding. Signal Proc.: Image Commun. 67, 140–148 (2018). https://doi.org/10.1016/j.image.2018.06.003
Yue, Ma., et al.: Fast intra coding based on CU size decision and direction mode decision for HEVC. Multimedia Tools Appl. 77(12), 14907–14929 (2018). https://doi.org/10.1007/s11042-017-5074-2
Ke, C.H., Xiaoyang, Z.E., Yibo, F.A.: CNN Oriented Fast CU Partition Decision and PU Mode Decision for HEVC Intra Encoding. In 2018 14th IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT), (2018). https://doi.org/10.1109/ICSICT.2018.8564981
Huade, S., Fan, L., Huanbang, C.: A fast CU size decision algorithm based on adaptive depth selection for HEVC encoder. 2014 IEEE International Conference on Audio, Language and Image Processing. IEEE, (2014). https://doi.org/10.1109/ICALIP.2014.7009774
Liao, W., Yang, D., Chen, Z.: A fast mode decision algorithm for HEVC intra prediction. In proc of 2016 IEEE Visual Communications and Image Processing (VCIP). (2016). https://doi.org/10.1109/VCIP.2016.7805540
JCT-VC. Subversion Repository for the HEVC Test Model Version HM16.1. [Online]. https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.1/.2016
Acknowledgements
Bang Ji contributed equally to this work and is considered co-first authors. The work was supported by the National Natural Science Foundation of China (No. 61602187) and (No. 6180405); the National Key Research and Development Plan (No. 2016YFD0200700); the Guangdong Science and Technology Projects (No. 2019B020219002) and Guangdong Laboratory of Lingnan Modern Agriculture.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, J., Ji, B., Wang, H. et al. Prediction mode grouping and coding bits grouping based on texture complexity for Fast HEVC intra-coding. J Real-Time Image Proc 18, 839–856 (2021). https://doi.org/10.1007/s11554-020-01034-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-020-01034-2