Abstract
In this paper, two new perceptual filters are presented as pre-processing techniques to reduce the bitrate of HEVC compressed Ultra high-definition (UHD) video contents at constant visual quality. The proposed perceptual filters rely on two novel adaptive filters (called BilAWA and TBil) which combine the good properties of the bilateral and Adaptive Weighted Averaging (AWA) filters. Moreover, these adaptive filters are guided by a just-noticeable distortion (JND) model to adaptively control the strength of the filtering process, taking into account the properties of the human visual system. Extensive psychovisual evaluation tests conducted on several UHD-TV sequences are presented in detail. Results show that applying the proposed pre-filters prior to HEVC encoding of UHD video contents lead to bitrate savings up to 23% for the same perceived visual quality.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Sullivan, G.J., Ohm, J.-R., Han, W., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circu. Syst. Video Technol. 22(12), 1649–1668 (2012)
Bae, S.H., Kim, J., Kim, M.: HEVC-based perceptually adaptive video coding using a DCT-based local distortion detection probability model. IEEE Trans. Image Process. 25(7), 3343–3357 (2016)
Vidal, E., Sturmel, N., Guillemot, C., Corlay, P., Coudoux, F.: New adaptive filters as perceptual preprocessing for rate-quality performance optimization of video coding. Sig. Process. Image Commun. 52, 124–137 (2017)
Ozkan, M., Sezan, I., Tekalp, M.: Adaptive motion-compensated filtering of noisy image sequences. IEEE Trans. Circ. Syst. Video Technol. 3(4), 277–290 (1993)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: ICCV, pp. 836–846 (1998)
Vanam, R., Kerofsky, L., Reznik, Y.: Perceptual pre-processing filter for video on demand content delivery. In: IEEE ICIP, pp. 2537–2541, 27–30 October (2014)
Karunaratne, P., Segall, C., Katsaggelos, A.: A rate-distortion optimal video pre-processing algorithm. IEEE ICIP, vol. 1, pp. 481–484 (2001)
Buades, A., Lisani, J.L., Miladinovic, M.: Patch-based video denoising with optical flow estimation. IEEE Trans. Image Process. 25(6), 2573–2586 (2016)
Shaw, M.Q., Allebach, J.P., Delp, E.J.: Color difference weighted adaptive residual preprocessing using perceptual modeling for video compression. Sig. Process. Image Commun. 39, 355–368 (2015)
Test video sequences available at the Xiph web site. https://media.xiph.org/
Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)
ITU-T Recommendation P.911: Subjective audiovisual quality assessment methods for multimedia applications. Series P, December (1998)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Lee, J.: Automatic prefilter control by video encoder statistics. IET Electron. Lett. 38, 503–505 (2002)
Jain, C., Sethuraman, S.: A low-complexity, motion-robust, spatio-temporally adaptive video de-noiser with inloop noise estimation. In: IEEE International Conference on Image Processing, pp. 557–560, October (2008)
Song, B., Chun, K.: Motion-compensated temporal filtering for denoising in video encoder. Electron. Lett. 40, 802–804 (2004)
Varghese, G., Wang, Z.: Video denoising based on a spatiotemporal Gaussian mixture model. IEEE Trans. Syst. Circ. Video Technol. 20(7), 1032–1040 (2010)
Segall, C.A., Karunaratne, P., Katsaggelos, A.K.: Pre-processing of compressed digital video. In: SPIE Image and Video Communication and Processing (2001)
Shao-Ping, L., Song-Hai, Z.: Saliency-based fidelity adaptation preprocessing for video coding. J. Comput. Sci. Technol. 26, 195–202 (2011)
Naccari, M., Pereira, F.: Advanced H,264/AVC-based perceptual video coding: architecture, tools, and assessment. IEEE Trans. Circ. Syst. Video Technol. 21(6), 766–782 (2011)
Naccari, M., Pereira, F.: Integrating a spatial just noticeable distortion model in the under development HEVC codec. IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 817–820, 22–27 May (2011)
Yang, X., Lin, W., Lu, Z., Ong, E., Yao, S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)
Ding, L., Li, G., Wang, R., Wang, W.: Video pre-processing with JND-based Gaussian filtering of superpixels. In: Proceedings of the SPIE 9410, Visual Information Processing and Communication VI, vol. 941004, 4 March (2015)
Kim, J., Kim, M.: An HEVC-compliant perceptual video coding scheme based on JND models for variable block-sized transform kernels. IEEE Trans. Syst. Circ. Video Technol. 25(11), 1786–1800 (2015)
Wang, S., Rehman, A., Wang, Z., Ma, S., Gao, W.: Perceptual video coding based on SSIM-inspired divisive normalization. IEEE Trans. Image Process. 22(4), 1418–1429 (2013)
Kerofsky, L.J., Vanam, R., Reznik, Y.A.: Improved adaptive video delivery system using a perceptual pre-processing filter. In: Proceedings of the GlobalSIP 2014, pp. 1058–1062 (2014)
Vanam, R., Reznik, Y.A.: Perceptual pre-processing filter for user-adaptive coding and delivery of visual information. In: Proceedings of the PCS 2013, December (2013)
Al-Shaykh, O., Mersereau, R.: Lossy compression of noisy images. IEEE Trans. on Image Process. 7(12), 1641–1652 (1998)
Oh, H., Kim, W.: Video processing for human perceptual visual quality-oriented video coding. IEEE Trans. Syst. Circ. Video Technol. 22(4), 1526–1535 (2016)
Guo, L., Au, O., Ma, M., Wong, P.: Integration of recursive temporal LMMSE denoising filter into video codec. IEEE Trans. Circ. Syst. Video Technol. 20(2), 236–249 (2010)
Watson, A.B.: DCT quantization matrices visually optimized for individual images. In: Proceedings of the SPIE International Society for Optical Engineering, vol. 1913, pp. 202–216 (1993)
Watson, A.B.: Measurement of a JND scale for video quality. VQEG Final Report (2000)
Acknowledgements
The authors would like to thank Elie de Rudder whom internship was the starting point for this work. They also thank Nicolas Braud from TF1, for the UltraHD video test material, Prof. Sylvie Merviel-Leleu, head of Arenberg Creative Mine, for giving access to the audiovisual equipment necessary for the subjective visual assessment tests. This work has been partially supported by the French ANRT (Cifre # 1098/2010) and Digigram.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Vidal, E., Coudoux, FX., Corlay, P., Guillemot, C. (2017). JND-Guided Perceptual Pre-filtering for HEVC Compression of UHDTV Video Contents. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2017. Lecture Notes in Computer Science(), vol 10617. Springer, Cham. https://doi.org/10.1007/978-3-319-70353-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-70353-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70352-7
Online ISBN: 978-3-319-70353-4
eBook Packages: Computer ScienceComputer Science (R0)