Skip to main content

Compression-Based Quality Predictor of 3D-Synthesized Views

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 815))

Abstract

Depth-Image-Based-Rendering (DIBR) is a fundamental technique used in free Viewpoint Videos (FVVs) to create new frames from existing adjacent frames, which can decrease the cost of camera set up. However, it is unavoidable to introduce geometric distortions in the synthesized images because of the warping and rendering operations in DIBR. Only a few Image Quality Assessment (IQA) methods have been proposed for such images and they are all Full-Reference (FR) methods. Nevertheless, reference DIBR-synthesized image is not accessible in real application scenarios, so No-Reference (NR) methods are more valuable than FR methods. In this paper, we propose an effective and efficient NR method based on Joint Photographic Experts Group (JPEG) image compression technology. The proposed method utilizes the difference of the amount of detail information between undistorted areas and geometry distortions areas, which can be achieved by comparing original images and JPEG images. Experiments validate the superiority of our no-reference quality method as compared with prevailing full-, reduced- and no-reference models.

This work was supported in part by National Natural Science Foundation of China under Grants 61533002.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bosc, E., Pepion, R., Callet, P.L., Koppel, M., Nya, P.N., Cedex, R.: Towards a new quality metric for 3-D synthesized view assessment. IEEE J. Select. Top. Signal Process. 5(7), 1332–1343 (2011)

    Article  Google Scholar 

  2. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  3. Wang, Z., Li, Q.: Information content weighting for perceptual image quality assessment. IEEE Trans. Image Process. 20(5), 1185–1198 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  4. Gu, K., Wang, S., Zhai, G., Lin, W., Yang, X., Zhang, W.: Analysis of distortion distribution for pooling in image quality prediction. IEEE Trans. Broadcast. 62(2), 446–456 (2016)

    Article  Google Scholar 

  5. Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  6. Gu, K., Zhai, G., Yang, X., Zhang, W.: An efficient color image quality metric with local-tuned-global model. In: Proceedings of the IEEE International Conference on Image Processing, pp. 506–510, October 2014

    Google Scholar 

  7. Gu, K., Li, L., Lu, H., Min, X., Lin, W.: A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans. Industr. Electron. 64(5), 3903–3912 (2017)

    Article  Google Scholar 

  8. Gao, X., Gao, F., Tao, D., Li, X.: Universal blind image quality assessment metrics via natural scene statistics and multiple kernel learning. IEEE Trans. Neural Netw. Learn. Syst. 24(12), 2013–2026 (2013)

    Article  Google Scholar 

  9. Gu, K., Zhai, G., Yang, X., Zhang, W.: Hybrid no-reference quality metric for singly and multiply distorted images. IEEE Trans. Broadcast. 60(3), 555–567 (2014)

    Article  Google Scholar 

  10. Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)

    Article  MathSciNet  Google Scholar 

  11. Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimedia 17(1), 50–63 (2015)

    Article  Google Scholar 

  12. Gu, K., Zhai, G., Lin, W., Yang, X., Zhang, W.: Learning a blind quality evaluation engine of screen content images. Neurocomputing 196, 140–149 (2016)

    Article  Google Scholar 

  13. Gu, K., Zhai, G., Lin, W., Yang, X., Zhang, W.: No-reference image sharpness assessment in autoregressive parameter space. IEEE Trans. Image Process. 24(10), 3218–3231 (2015)

    Article  MathSciNet  Google Scholar 

  14. Conze, P.H., Robert, P., Morin, L.: Objective view synthesis quality assessment. In: Electronic Imaging - International Society for Optics and Photonics, p. 8288-56, February 2012

    Google Scholar 

  15. Battisti, F., Bosc, E., Carli, M., Le Callet, P.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)

    Article  Google Scholar 

  16. Sandic-Stankovic, D., Kukolj, D., Callet, P.L.: DIBR-synthesized image quality assessment based on morphological wavelets. In: Proceedings of the IEEE International Workshop on Quality of Multimedia Experience, pp. 1–6, January 2015

    Google Scholar 

  17. Sandic-Stankovic, D., Kukolj, D., Le Callet, P.: DIBR-synthesized image quality assessment based on morphological pyramids. In: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1–4, October 2015

    Google Scholar 

  18. Sandic-Stankovic, D., Kukolj, D., Le Callet, P.: Multi-scale synthesized view assessment based on morphological pyramids. J. Electr. Eng. 67(1), 1–9 (2016)

    Google Scholar 

  19. Chandler, D.M., Hemami, S.S.: VSNR: a wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans. Image Process. 16(9), 2284–2298 (2007)

    Article  MathSciNet  Google Scholar 

  20. Soundararajan, R., Bovik, A.C.: RRED indices: reduced-reference entropic differencing for image quality assessment. IEEE Trans. Image Process. 21(2), 517–526 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  21. Narwaria, M., Lin, W., McLoughlin, I.V., Emmanuel, S., Chia, L.T.: Fourier transform-based scalable image quality measure. IEEE Trans. Image Process. 21(8), 3364–3377 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  22. Mittal, A., Soundararajan, R., Bovik, A.C.: Making a ‘completely blind’ image quality analyzer. IEEE Signal Process. Lett. 22(3), 209–212 (2013)

    Article  Google Scholar 

  23. Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19(1), 011006 (2010)

    Article  Google Scholar 

  24. Gu, K., Zhou, J., Qiao, J., Zhai, G., Lin, W., Bovik, A.C.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)

    Article  MathSciNet  Google Scholar 

  25. Gu, K., Tao, D., Qiao, J., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maoshen Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, S., Qiao, J., Liu, M., Wu, L. (2018). Compression-Based Quality Predictor of 3D-Synthesized Views. In: Zhai, G., Zhou, J., Yang, X. (eds) Digital TV and Wireless Multimedia Communication. IFTC 2017. Communications in Computer and Information Science, vol 815. Springer, Singapore. https://doi.org/10.1007/978-981-10-8108-8_29

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-8108-8_29

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-8107-1

  • Online ISBN: 978-981-10-8108-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics