Skip to main content

Adaptive Down-Sampling and Super-Resolution for Additional Video Compression

  • Conference paper
  • First Online:
  • 738 Accesses

Abstract

While almost all down-sampling based video codecs gain additional compression at the expense of image degradation, we set a good example of achieving both large compression and even better reconstruction quality. Such progress is realized by: (i) minimizing the introduction of information loss with a proposed decomposition-based adaptive down-sampling method so that more reserved pixels can be allocated to image details where human visual perception is more sensitive. Specifically, a modified content complexity measurement is put forward and the optimum down-sampling rate is adaptively selected with a customized formula; (ii) maximizing the information compensation via a content-adaptive super-resolution algorithm, which is accelerated and optimized by two stages of pruning to select the closest correlated dictionary pairs. Extensive experiments support that, by using prevailing H.264 codec as benchmark, the proposed scheme achieves 5 times more of additional compression and the reconstruction quality outperforms other state-of-the-art approaches, and even better than decoded non-shrunken frames in human visual perception.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   60.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Schwarz, H., Marpe, D., Wiegand, T.: Overview of the scalable video coding extension of the h.264/avc standard. IEEE Trans Circ. Syst. Video Technol. 17(9), 1103–1120 (2007)

    Article  Google Scholar 

  2. Sullivan, G.J., Ohm, J., Han, W.J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circ. Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  3. Shen, M., Xue, P., Wang, C.: Down-sampling based video coding using super-resolution technique. IEEE Trans Circ. Syst. Video Technol. 21(6), 755–765 (2011)

    Article  Google Scholar 

  4. Chang, P.C.: Adaptive down-sampling video coding. In: Proceedings of SPIE - The International Society for Optical Engineering, vol. 24(11), pp. 1957–1968 (2010)

    Google Scholar 

  5. Nguyen, V.A., Tan, Y.P. Lin, W.: Adaptive downsampling/upsampling for better video compression at low bit rate. In: IEEE International Symposium on Circuits and Systems, pp. 1624–1627 (2008)

    Google Scholar 

  6. Alfred, M.B., Elad, M., Kimmel, R.: Down-scaling for better transform compression. IEEE Trans. Image Process. 12(9), 1132–1144 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  7. Jiang, J.: A low-cost content-adaptive and rate-controllable near-lossless image codec in dpcm domain. IEEE Trans. Image Process. 9(4), 543–554 (2000)

    Article  MathSciNet  Google Scholar 

  8. Li, X., Orchard, M.T.: New edge directed interpolation. IEEE Trans. Image Process. 10(10), 1521–1527 (2001). A Publication of the IEEE Signal Processing Society

    Article  Google Scholar 

  9. Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)

    Article  Google Scholar 

  10. Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, pp. 275–282. IEEE Computer Society (2004)

    Google Scholar 

  11. Bevilacqua, M., Roumy, A., Guillemot, C., Alberi-Morel, M.L.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: BMVC (2012)

    Google Scholar 

  12. Timofte, R., De Smet, V., Van Gool, L.: Anchored neighborhood regression for fast example-based super-resolution. In: IEEE International Conference on Computer Vision (ICCV), pp. 1920–1927 (2013)

    Google Scholar 

  13. Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010). A Publication of the IEEE Signal Processing Society

    Article  MathSciNet  Google Scholar 

  14. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27413-8_47

    Chapter  Google Scholar 

  15. Ren, J., Jiang, J., Chen, J.: Shot boundary detection in MPEG videos using local and global indicators. IEEE Trans. Circ. Syst. Video Technol. 19(19), 1234–1238 (2009)

    Google Scholar 

  16. Ren, J., Jiang, J.: Hierarchical modelling and adaptive clustering for real-time summarization of rush videos. IEEE Trans. Multimed. 11(5), 906–917 (2009)

    Article  Google Scholar 

  17. Min, B., Cheung, R.C.C.: A fast cu size decision algorithm for the HEVC intra encoder. IEEE Trans. Circ. Syst. Video Technol. 25(5), 892–896 (2015)

    Article  Google Scholar 

  18. Zhao, T., Wang, Z., Kwong, S.: Flexible mode selection and complexity allocation in high efficiency video coding. IEEE J. Sel. Topics Signal Process. 7(6), 1135–1144 (2013)

    Article  Google Scholar 

  19. Cho, S., Kim, M.: Fast cu splitting and pruning for suboptimal cu partitioning in HEVC intra coding. IEEE Trans. Circ. Syst. Video Technol. 23(9), 1555–1564 (2013)

    Article  Google Scholar 

  20. Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y.: Soft edge smoothness prior for alpha channel super resolution. In: IEEE Conference on Computer Vision & Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  21. Kondo, S.: Compressed sensing and redundant dictionaries. IEEE Trans. Inf. Theor. 54(5), 2210–2219 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  22. Jiang, J., Armstrong, A., Feng, G.C.: Direct content access and extraction from JPEG compressed images. Pattern Recogn. 35(11), 2511–2519 (2002)

    Article  MATH  Google Scholar 

  23. Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianmin Jiang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Zhao, B., Jiang, J. (2017). Adaptive Down-Sampling and Super-Resolution for Additional Video Compression. In: Maglaras, L., Janicke, H., Jones, K. (eds) Industrial Networks and Intelligent Systems. INISCOM 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 188. Springer, Cham. https://doi.org/10.1007/978-3-319-52569-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-52569-3_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-52568-6

  • Online ISBN: 978-3-319-52569-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics