Skip to main content

Latitude-Based Visual Attention in 360-Degree Video Display

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11166))

Abstract

With the ever-growing availability of Virtual Reality (VR) products, the 360-degree video has a widespread application prospect, which also brings new challenges to its quality assessment. Considering its unconventional display environment, the users’ attention on 360-degree video may be significantly different from its conventional 2D version. Recently, the Weighted-to-Spherically-uniform Peak Signal-to-Noise Ratio (WS-PSNR) was developed to weight PSNR by its covered area in 360-degree video display. In this work, we find that the average attention per area still differs subject to its latitude. Thus we propose to utilize this average attention to formulate a latitude-based quality weight matrix. Through experiments, this new matrix outperforms that of WS-PSNR in pooling of PSNR when latitude-based quality fluctuations exist in 360-degree video display.

This research is supported by the National Natural Science Foundation of China (Grant 61671152).

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Chen, Z., Li, Y., Zhang, Y.: Recent advances in omnidirectional video coding for virtual reality: projection and evaluation. Sig. Process. 146, 66–78 (2018)

    Article  Google Scholar 

  2. Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Sig. Process. Image Commun. 19(2), 121–132 (2004)

    Article  Google Scholar 

  3. Chikkerur, S., Sundaram, V., Reisslein, M., Karam, L.J.: Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans. Broadcast. 57(2), 165–182 (2011)

    Article  Google Scholar 

  4. Lin, W., Jay Kuo, C.C.: Perceptual visual quality metrics: a survey. J. Vis. Commun. Image Represent. 22(4), 297–312 (2011)

    Article  Google Scholar 

  5. Xu, M., Li, C., Liu, Y., Deng, X., Lu, J.: A subjective visual quality assessment method of panoramic videos. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), pp. 517–522. IEEE (2017)

    Google Scholar 

  6. Schatz, R., Sackl, A., Timmerer, C., Gardlo, B.: Towards subjective quality of experience assessment for omnidirectional video streaming. In: Proceedings of the 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), pp. 1–6. IEEE (2017)

    Google Scholar 

  7. Sun, Y., Lu, A., Yu, L.: Weighted-to-spherically-uniform quality evaluation for omnidirectional video. IEEE Sig. Process. Lett. 24(9), 1408–1412 (2017)

    Google Scholar 

  8. Yu, M., Lakshman, H., Girod, B.: A framework to evaluate omnidirectional video coding schemes. In: IEEE International Symposium on Mixed and Augmented Reality, pp. 31–36. IEEE (2015)

    Google Scholar 

  9. Zakharchenko, V., Choi, K. P., Park, J. H.: Quality metric for spherical panoramic video. In: Optics and Photonics for Information Processing X, vol. 9970, pp. 99700–99700-9 (2016)

    Google Scholar 

  10. Boyce, J., Alshina, E., Abbas, A.: JVET common test conditions and evaluation procedures for 360 video. In: Joint Video Exploration Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-E1030, Geneva (2017)

    Google Scholar 

  11. Sun, W., Guo, R.: Test sequences for virtual reality video coding from LetinVR. In: Joint Video Exploration Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-D0179, Chengdu, China (2016)

    Google Scholar 

  12. High Efficiency Video Coding (HEVC) reference software HM. Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute (2016). https://hevc.hhi.fraunhofer.de

  13. ITU-R BT.500-13: Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Geneva, Switzerland (2012)

    Google Scholar 

  14. Zhang, W., Liu, H.: Towards a reliable collection of eye-tracking data for image quality research: challenges, solutions and applications. IEEE Trans. Image Process. 26(5), 2424–2437 (2017)

    Article  MathSciNet  Google Scholar 

  15. ITU-R BT.1788: Methodology for the subjective assessment of video quality in multimedia applications, International Telecommunication Union (2007)

    Google Scholar 

  16. Wang, H., Kwong, S.: Rate-discortion optimization of rate control for H.264 with adaptive initial quantization parameter determination. IEEE Trans. Circ. Syst. Video Technol. 18(1), 140–144 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tiesong Zhao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Huang, H., Xu, Y., Chen, J., Song, Y., Zhao, T. (2018). Latitude-Based Visual Attention in 360-Degree Video Display. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11166. Springer, Cham. https://doi.org/10.1007/978-3-030-00764-5_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00764-5_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00763-8

  • Online ISBN: 978-3-030-00764-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics