Abstract
While almost all down-sampling based video codecs gain additional compression at the expense of image degradation, we set a good example of achieving both large compression and even better reconstruction quality. Such progress is realized by: (i) minimizing the introduction of information loss with a proposed decomposition-based adaptive down-sampling method so that more reserved pixels can be allocated to image details where human visual perception is more sensitive. Specifically, a modified content complexity measurement is put forward and the optimum down-sampling rate is adaptively selected with a customized formula; (ii) maximizing the information compensation via a content-adaptive super-resolution algorithm, which is accelerated and optimized by two stages of pruning to select the closest correlated dictionary pairs. Extensive experiments support that, by using prevailing H.264 codec as benchmark, the proposed scheme achieves 5 times more of additional compression and the reconstruction quality outperforms other state-of-the-art approaches, and even better than decoded non-shrunken frames in human visual perception.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Schwarz, H., Marpe, D., Wiegand, T.: Overview of the scalable video coding extension of the h.264/avc standard. IEEE Trans Circ. Syst. Video Technol. 17(9), 1103–1120 (2007)
Sullivan, G.J., Ohm, J., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ. Syst. Video Technol. 22(12), 1649–1668 (2012)
Shen, M., Xue, P., Wang, C.: Down-sampling based video coding using super-resolution technique. IEEE Trans Circ. Syst. Video Technol. 21(6), 755–765 (2011)
Chang, P.C.: Adaptive down-sampling video coding. In: Proceedings of SPIE - The International Society for Optical Engineering, vol. 24(11), pp. 1957–1968 (2010)
Nguyen, V.A., Tan, Y.P. Lin, W.: Adaptive downsampling/upsampling for better video compression at low bit rate. In: IEEE International Symposium on Circuits and Systems, pp. 1624–1627 (2008)
Alfred, M.B., Elad, M., Kimmel, R.: Down-scaling for better transform compression. IEEE Trans. Image Process. 12(9), 1132–1144 (2003)
Jiang, J.: A low-cost content-adaptive and rate-controllable near-lossless image codec in dpcm domain. IEEE Trans. Image Process. 9(4), 543–554 (2000)
Li, X., Orchard, M.T.: New edge directed interpolation. IEEE Trans. Image Process. 10(10), 1521–1527 (2001). A Publication of the IEEE Signal Processing Society
Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)
Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, pp. 275–282. IEEE Computer Society (2004)
Bevilacqua, M., Roumy, A., Guillemot, C., Alberi-Morel, M.L.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: BMVC (2012)
Timofte, R., De Smet, V., Van Gool, L.: Anchored neighborhood regression for fast example-based super-resolution. In: IEEE International Conference on Computer Vision (ICCV), pp. 1920–1927 (2013)
Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010). A Publication of the IEEE Signal Processing Society
Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27413-8_47
Ren, J., Jiang, J., Chen, J.: Shot boundary detection in MPEG videos using local and global indicators. IEEE Trans. Circ. Syst. Video Technol. 19(19), 1234–1238 (2009)
Ren, J., Jiang, J.: Hierarchical modelling and adaptive clustering for real-time summarization of rush videos. IEEE Trans. Multimed. 11(5), 906–917 (2009)
Min, B., Cheung, R.C.C.: A fast cu size decision algorithm for the HEVC intra encoder. IEEE Trans. Circ. Syst. Video Technol. 25(5), 892–896 (2015)
Zhao, T., Wang, Z., Kwong, S.: Flexible mode selection and complexity allocation in high efficiency video coding. IEEE J. Sel. Topics Signal Process. 7(6), 1135–1144 (2013)
Cho, S., Kim, M.: Fast cu splitting and pruning for suboptimal cu partitioning in HEVC intra coding. IEEE Trans. Circ. Syst. Video Technol. 23(9), 1555–1564 (2013)
Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y.: Soft edge smoothness prior for alpha channel super resolution. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 1–8 (2007)
Kondo, S.: Compressed sensing and redundant dictionaries. IEEE Trans. Inf. Theor. 54(5), 2210–2219 (2008)
Jiang, J., Armstrong, A., Feng, G.C.: Direct content access and extraction from JPEG compressed images. Pattern Recogn. 35(11), 2511–2519 (2002)
Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Zhao, B., Jiang, J. (2017). Adaptive Down-Sampling and Super-Resolution for Additional Video Compression. In: Maglaras, L., Janicke, H., Jones, K. (eds) Industrial Networks and Intelligent Systems. INISCOM 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 188. Springer, Cham. https://doi.org/10.1007/978-3-319-52569-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-52569-3_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-52568-6
Online ISBN: 978-3-319-52569-3
eBook Packages: Computer ScienceComputer Science (R0)