Skip to main content
SpringerLink
Log in
Book cover

International Conference on Advanced Concepts for Intelligent Vision Systems

ACIVS 2017: Advanced Concepts for Intelligent Vision Systems pp 375–385Cite as

JND-Guided Perceptual Pre-filtering for HEVC Compression of UHDTV Video Contents

  • Conference paper
  • First Online:

  • 2843 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10617))

Abstract

In this paper, two new perceptual filters are presented as pre-processing techniques to reduce the bitrate of HEVC compressed Ultra high-definition (UHD) video contents at constant visual quality. The proposed perceptual filters rely on two novel adaptive filters (called BilAWA and TBil) which combine the good properties of the bilateral and Adaptive Weighted Averaging (AWA) filters. Moreover, these adaptive filters are guided by a just-noticeable distortion (JND) model to adaptively control the strength of the filtering process, taking into account the properties of the human visual system. Extensive psychovisual evaluation tests conducted on several UHD-TV sequences are presented in detail. Results show that applying the proposed pre-filters prior to HEVC encoding of UHD video contents lead to bitrate savings up to 23% for the same perceived visual quality.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Sullivan, G.J., Ohm, J.-R., Han, W., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circu. Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  2. Bae, S.H., Kim, J., Kim, M.: HEVC-based perceptually adaptive video coding using a DCT-based local distortion detection probability model. IEEE Trans. Image Process. 25(7), 3343–3357 (2016)

    Article  MathSciNet  Google Scholar 

  3. Vidal, E., Sturmel, N., Guillemot, C., Corlay, P., Coudoux, F.: New adaptive filters as perceptual preprocessing for rate-quality performance optimization of video coding. Sig. Process. Image Commun. 52, 124–137 (2017)

    Article  Google Scholar 

  4. Ozkan, M., Sezan, I., Tekalp, M.: Adaptive motion-compensated filtering of noisy image sequences. IEEE Trans. Circ. Syst. Video Technol. 3(4), 277–290 (1993)

    Article  Google Scholar 

  5. Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: ICCV, pp. 836–846 (1998)

    Google Scholar 

  6. Vanam, R., Kerofsky, L., Reznik, Y.: Perceptual pre-processing filter for video on demand content delivery. In: IEEE ICIP, pp. 2537–2541, 27–30 October (2014)

    Google Scholar 

  7. Karunaratne, P., Segall, C., Katsaggelos, A.: A rate-distortion optimal video pre-processing algorithm. IEEE ICIP, vol. 1, pp. 481–484 (2001)

    Google Scholar 

  8. Buades, A., Lisani, J.L., Miladinovic, M.: Patch-based video denoising with optical flow estimation. IEEE Trans. Image Process. 25(6), 2573–2586 (2016)

    Article  MathSciNet  Google Scholar 

  9. Shaw, M.Q., Allebach, J.P., Delp, E.J.: Color difference weighted adaptive residual preprocessing using perceptual modeling for video compression. Sig. Process. Image Commun. 39, 355–368 (2015)

    Article  Google Scholar 

  10. Test video sequences available at the Xiph web site. https://media.xiph.org/

  11. Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)

    Article  Google Scholar 

  12. ITU-T Recommendation P.911: Subjective audiovisual quality assessment methods for multimedia applications. Series P, December (1998)

    Google Scholar 

  13. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  14. Lee, J.: Automatic prefilter control by video encoder statistics. IET Electron. Lett. 38, 503–505 (2002)

    Article  Google Scholar 

  15. Jain, C., Sethuraman, S.: A low-complexity, motion-robust, spatio-temporally adaptive video de-noiser with inloop noise estimation. In: IEEE International Conference on Image Processing, pp. 557–560, October (2008)

    Google Scholar 

  16. Song, B., Chun, K.: Motion-compensated temporal filtering for denoising in video encoder. Electron. Lett. 40, 802–804 (2004)

    Article  Google Scholar 

  17. Varghese, G., Wang, Z.: Video denoising based on a spatiotemporal Gaussian mixture model. IEEE Trans. Syst. Circ. Video Technol. 20(7), 1032–1040 (2010)

    Article  Google Scholar 

  18. Segall, C.A., Karunaratne, P., Katsaggelos, A.K.: Pre-processing of compressed digital video. In: SPIE Image and Video Communication and Processing (2001)

    Google Scholar 

  19. Shao-Ping, L., Song-Hai, Z.: Saliency-based fidelity adaptation preprocessing for video coding. J. Comput. Sci. Technol. 26, 195–202 (2011)

    Article  Google Scholar 

  20. Naccari, M., Pereira, F.: Advanced H,264/AVC-based perceptual video coding: architecture, tools, and assessment. IEEE Trans. Circ. Syst. Video Technol. 21(6), 766–782 (2011)

    Article  Google Scholar 

  21. Naccari, M., Pereira, F.: Integrating a spatial just noticeable distortion model in the under development HEVC codec. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 817–820, 22–27 May (2011)

    Google Scholar 

  22. Yang, X., Lin, W., Lu, Z., Ong, E., Yao, S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)

    Article  Google Scholar 

  23. Ding, L., Li, G., Wang, R., Wang, W.: Video pre-processing with JND-based Gaussian filtering of superpixels. In: Proceedings of the SPIE 9410, Visual Information Processing and Communication VI, vol. 941004, 4 March (2015)

    Google Scholar 

  24. Kim, J., Kim, M.: An HEVC-compliant perceptual video coding scheme based on JND models for variable block-sized transform kernels. IEEE Trans. Syst. Circ. Video Technol. 25(11), 1786–1800 (2015)

    Article  Google Scholar 

  25. Wang, S., Rehman, A., Wang, Z., Ma, S., Gao, W.: Perceptual video coding based on SSIM-inspired divisive normalization. IEEE Trans. Image Process. 22(4), 1418–1429 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  26. Kerofsky, L.J., Vanam, R., Reznik, Y.A.: Improved adaptive video delivery system using a perceptual pre-processing filter. In: Proceedings of the GlobalSIP 2014, pp. 1058–1062 (2014)

    Google Scholar 

  27. Vanam, R., Reznik, Y.A.: Perceptual pre-processing filter for user-adaptive coding and delivery of visual information. In: Proceedings of the PCS 2013, December (2013)

    Google Scholar 

  28. Al-Shaykh, O., Mersereau, R.: Lossy compression of noisy images. IEEE Trans. on Image Process. 7(12), 1641–1652 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  29. Oh, H., Kim, W.: Video processing for human perceptual visual quality-oriented video coding. IEEE Trans. Syst. Circ. Video Technol. 22(4), 1526–1535 (2016)

    MathSciNet  MATH  Google Scholar 

  30. Guo, L., Au, O., Ma, M., Wong, P.: Integration of recursive temporal LMMSE denoising filter into video codec. IEEE Trans. Circ. Syst. Video Technol. 20(2), 236–249 (2010)

    Article  Google Scholar 

  31. Watson, A.B.: DCT quantization matrices visually optimized for individual images. In: Proceedings of the SPIE International Society for Optical Engineering, vol. 1913, pp. 202–216 (1993)

    Google Scholar 

  32. Watson, A.B.: Measurement of a JND scale for video quality. VQEG Final Report (2000)

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Elie de Rudder whom internship was the starting point for this work. They also thank Nicolas Braud from TF1, for the UltraHD video test material, Prof. Sylvie Merviel-Leleu, head of Arenberg Creative Mine, for giving access to the audiovisual equipment necessary for the subjective visual assessment tests. This work has been partially supported by the French ANRT (Cifre # 1098/2010) and Digigram.

Author information

Authors and Affiliations

  1. Univ. Valenciennes, CNRS, Univ. Lille, YNCREA, Centrale Lille, UMR 8520 - IEMN, DOAE, 59313, Valenciennes, France

    Eloïse Vidal, François-Xavier Coudoux & Patrick Corlay

  2. Inria, Campus Universitaire de Beaulieu, 35042, Rennes, France

    Christine Guillemot

Authors
  1. Eloïse Vidal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. François-Xavier Coudoux
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patrick Corlay
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christine Guillemot
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to François-Xavier Coudoux .

Editor information

Editors and Affiliations

  1. DGA, Paris, France

    Jacques Blanc-Talon

  2. University of Antwerp, Antwerp, Belgium

    Rudi Penne

  3. Ghent University - imec, Ghent, Belgium

    Wilfried Philips

  4. CSIRO Data 61, Canberra, Aust Capital Terr, Australia

    Dan Popescu

  5. University of Antwerp, Wilrijk, Belgium

    Paul Scheunders

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vidal, E., Coudoux, FX., Corlay, P., Guillemot, C. (2017). JND-Guided Perceptual Pre-filtering for HEVC Compression of UHDTV Video Contents. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2017. Lecture Notes in Computer Science(), vol 10617. Springer, Cham. https://doi.org/10.1007/978-3-319-70353-4_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70353-4_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70352-7

  • Online ISBN: 978-3-319-70353-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation