Abstract
High-efficiency video coding (HEVC) is a successor to the H.264/AVC standard as the newest video-coding standard using a quad-tree structure with the three block types of a coding unit (CU), a prediction unit (PU), and a transform unit (TU). This has become popular to apply to smart surveillance systems, because very high-quality image is needed to analyze and extract more precise features. On standard, the HEVC encoder uses all possible depth levels for determination of the lowest rate-distortion (RD) cost block. The HEVC encoder is more complex than the H.264/AVC standard. An efficient CU determination algorithm is proposed using spatial and temporal information in which 13 neighboring coding tree units (CTUs) are defined. Four CTUs are temporally located in the current CTU and the other nine neighboring CTUs are spatially situated in the current CTU. Based on the analysis of conditional probability values for SKIP and Merge modes, an optimal threshold value was determined for judging SKIP or Merge mode according to the CTU condition and an adaptive weighting factor. When SKIP or Merge modes were detected early, other mode searches were omitted. The proposed algorithm achieved approximately 35 % time saving with random-access configuration and 29 % time reduction with low-delay configuration while maintaining comparable rate-distortion performance, compared with HM 12.0 reference software.
Similar content being viewed by others
References
Gubbi J, Buyyab R, Marusic S, Palaniswami M (2013) Internet of Things (IoT): a vision, architectural elements, and future directions. Future Gen Comput Syst 29:1645–1660
Shu C-F, Hampapur A, Lu M, Brown L, Connell J, Senior A, Tian Y (2005) IBM smart surveillance system (S3): a open and extensible framework for event based surveillance. In: IEEE Conference on Advanced Video and Signal Based Surveillance, pp 318–323
Cho Y, Lim SO, Yang HS (2010) Collaborative occupancy reasoning in visual sensor network for scalable smart video surveillance. IEEE Trans Consum Electron 56(3):1997–2003
Nazare AC, dos Santos CE, Ferreira R, Robson Schwartz W (2014) Smart surveillance framework: a versatile tool for video analysis. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp 753–760
Castro-Munoz G, Martinez-Carballido J (2015) Real time human action recognition using full and ultra high definition video. In: International Conference on Computational Science and Computational Intelligence (CSCI), pp 509–514
Bross B, Han W-J, Sullivan GJ, Ohm J-R, Wiegand T (July 2012) High efficiency video coding (HEVC) text specification draft 8, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC-J1003
Sullivan GJ et al (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668
Il-Koo K et al (2012) Block partitioning structure in the HEVC standard. IEEE Trans Circuits Syst Video Technol 22(12):1697–1706
Chiang P-T, Chang TS (2013) Fast zero block detection and early CU termination for HEVC video coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp 1640–1643
Pan Z, Kwong S, Zhang Y, Lei J (2014) Fast coding tree unit depth decision for high efficiency video coding. In: IEEE International Conference on Image Processing (ICIP), pp 3214–3218
Kibeya H, Belghith F, Ben Ayed MA, Masmoudi N (2014) A fast CU partitionning algorithm based on early detection of zero block quantified transform coefficients for HEVC standard. In: IEEE International Conference on Image Processing, Applications and Systems (IPAS), pp 1–5
Schierl T, Hannuksela MM, Wang Y-K, Wenger S (2012) System layer integration of high efficiency video coding (HEVC). IEEE Trans Circuits Syst Video Technol 22(12):1871–1884
Psannis KE, Hadjinicolaou M, Krikelis A (2006) MPEG-2 streaming of full interactive content. IEEE Trans Circuits Syst Video Technol 16(2):280–285
Wenger S (2003) H.264/AVC over IP. IEEE Trans Circuits Syst 13(7):645–656
Stockhamme T, Hannuksela MM, Wiegand T (2003) H.264/AVC in wireless environments. IEEE Trans Circuits Syst Video Technol 13(7):657–673
Psannis K, Ishibashi Y (2008) Efficient flexible macroblock ordering technique. IEICE Trans Commun E91–B(08):2692–2701
Psannis KE (2015) HEVC in wireless environments. J Real Time Image Process. doi:10.1007/s11554-015-0514-6 (online published)
Psannis K, Ishibashi Y (2006) Impact of video coding on delay and jitter in 3G wireless video multicast services. EURASIP J Wirel Commun Netw 2006, Article ID 24616, 1–7
Zhang Y, Wang H, Li Z (2013) Fast coding unit depth decision algorithm for inter-frame coding in HEVC. In: Proceedings of Data Compression Conference, pp 53–62
Shen L, Liu Z, Zhang X, Zhao W, Zhang Z (2013) An effective cu size decision method for HEVC encoders. IEEE Trans Multimed 15(2):465–470
Choi K, Park S-H, Jang ES (2011) Coding tree prunning based CU early termination. Document JCTVC-F092, JCT-VC
Yang J, Kim J, Won K, Lee H, Jeon B (2011) Early SKIP Detection for HEVC, document JCTVC-G543. JCV-VC, Geneva Switzerland
Kim J, Jeong S, Cho K, Choi JS (2012) An efficient bi-prediction algorithm for HEVC. In: International Conference on Consumer Electronics (ICCE), Las Vegas
Xiong J, Li H, Meng F, Zeng B, Zhu S, Wu Q (2014) Fast and efficient inter CU decision for high efficiency video coding In: Proceedings of IEEE International Conference Image Processing, pp 3715–3719
Xiong J, Li H, Zhu S, Wu Q, Zeng B (2014) MRF-based fast HEVC inter CU decision with the variance of absolute differences. IEEE Trans Multimed 16(8):2141–2153
Shen X, Yu L (2013) CU splitting early termination based on weighted SVM. EURASIP J Image Video Process 2013(1):1–11
Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding. IEEE Trans Circuits Syst Video Technol 23(9):1555–1564
Xiong J, Li H, Wu Q, Meng F (2014) A fast HEVC inter CU selection method based on pyramid motion divergence. IEEE Trans Multimed 16(2):559–564
Lee J, Kim S, Lim K, Lee S (2015) A fast CU size decision algorithm for HEVC. IEEE Trans Circuits Syst Video Technol 25(3):411–421
Cassa M, Naccari M, Pereira F (2012) Fast rate distortion optimization for the emerging HEVC standard. In: Proceedings of Picture Coding Symposium (PCS), pp 493–496
Lee B, Kim M (2011) Modeling rates and distortions based on a mixture of laplacian distributions for inter-predicted residues in quadtree coding of HEVC. IEEE Signal Process Lett 18(10):571–574
Pan Z, Kwong S, Zhang Y, Lei J (2014) Fast coding tree unit depth decision for high efficiency video coding. In: IEEE International Conference of Image Processing (ICIP), pp 3214–3218
Li X, Wien M, Ohm JR (2010) Rate-complexity-distortion evaluation for hybrid video coding. In: IEEE International Conference Multimedia and Expo, Singapore, July 19–23
Bossen F (2012) Common test conditions and software reference configurations. Document JCTVC-I1100, JCT-VC, Geneva, Switzerland
Sampaio F, Bampi S, Grellert M, Agostini L, Mattos J (2012) Motion vectors merging: low complexity prediction unit decision heuristic for the inter-prediction of HEVC encoders. In: International Conference on Multimedia and Expo (ICME), pp 657–662
Yang S, Lee H, Shim HJ, Jeon B (2013) Fast inter mode decision process for HEVE encoder. In: The IEEE 11th Image, Video, and Multidimensional Signal Processing (IVMSP) Workshop, pp 1–4
Acknowledgments
This Research was supported by the Sookmyung Women’s University Research Grants (1-1603-2006).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kim, BG. Fast coding unit (CU) determination algorithm for high-efficiency video coding (HEVC) in smart surveillance application. J Supercomput 73, 1063–1084 (2017). https://doi.org/10.1007/s11227-016-1730-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-016-1730-y