Skip to main content

Plenoptic Image Compression via Simplified Subaperture Projection

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing – PCM 2018 (PCM 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11165))

Included in the following conference series:

Abstract

In this paper, a generalized encoding architecture is proposed for compressing plenoptic images to reduce the redundancy among the subaperture images. Based on the homography analysis, simplification of subaperture projection is performed due to high correlations among adjacent views. Then, a pseudo-video sequence consisting of central subaperture images and a sequence consisting of residual images between the central image and the adjacent images are generated by the proposed partitioning and reordering methods. They are compressed by temporal coding tools in HEVC. The experimental results demonstrate that the proposed method outperforms state-of-the-art pseudo-video compression methods by an average of 25.3%/27.4%/21.7%/36.7%/5.3% bitrate saving with comparable/lower computational complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lytro. https://www.lytro.com/

  2. Higa, R.S., Chavez, R.F.L., Leite, R.B.: Plenoptic image compression comparison between JPEG, JPEG2000 and SPITH. Cyber J. JSAT 3(6), 1–6 (2013)

    Google Scholar 

  3. Sullivan, G.J., Ohm, J., Han, W.J., et al.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  4. Li, Y., Sjostrom, M., Olsson, R., Jennehag, U.: Coding of focused plenoptic contents by displacement intra prediction. IEEE Trans. Circuits Syst. Video Technol. 26(7), 1308–1319 (2016)

    Article  Google Scholar 

  5. Li, Y., Olsson, R., Sjostrom, M.: Compression of unfocused plenoptic images using a displacement intra prediction. In: IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp. 1–4, July 2016

    Google Scholar 

  6. Liu, D., An, P., Ma, R., et al.: Disparity compensation based 3D holoscopic image coding using HEVC. In: 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 201–205 (2015)

    Google Scholar 

  7. Conti, C., Kovács, P.T., Balogh, T., et al.: Light-field video coding using geometry-based disparity compensation. In: 2014: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1–4. IEEE (2014)

    Google Scholar 

  8. Conti, C., Soares, L.D., Nunes, P.: HEVC-based 3D holoscopic video coding using self-similarity compensated prediction. Sig. Process. Image Commun. 42, 59–78 (2016)

    Article  Google Scholar 

  9. Conti, C., Nunes, P., Soares, L.D.: HEVC-based light field image coding with bi-predicted self-similarity compensation. In: IEEE International Conference on Multimedia Expo Workshop (ICMEW), pp. 1–4, July 2016

    Google Scholar 

  10. Dai, F., Zhang, J., Ma, Y., Zhang, Y.: Lenselet image compression scheme based on subaperture images streaming. In: IEEE International Conference on Image Processing, pp. 4733–4737. IEEE (2015)

    Google Scholar 

  11. Zhao, S., Chen, Z., Yang, K., Huang, H.: Light field image coding with hybrid scan order. In: 2016 Visual Communications and Image Processing (VCIP), Chengdu, pp. 1–4 (2016)

    Google Scholar 

  12. Perra, C., Assuncao, P.: High efficiency coding of light field images based on tiling and pseudo-temporal data arrangement. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–4 (2016)

    Google Scholar 

  13. Perra, C., Giusto, D.: JPEG 2000 compression of unfocused light field images based on lenslet array slicing. In: 2017 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, pp. 27–28 (2017)

    Google Scholar 

  14. Perra, C., Giusto, D.: Raw light field image compression of sliced lenslet array. In: 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Cagliari, pp. 1–5 (2017)

    Google Scholar 

  15. Liu, D., Wang, L., Li, L., et al.: Pseudo-sequence-based light field image compression. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–4 (2016)

    Google Scholar 

  16. Shi, S., Gioia, P., Madec, G.: Efficient compression method for integral images using multi-view video coding. In: 18th IEEE International Conference on Image Processing, pp. 137–140 (2011)

    Google Scholar 

  17. Ahmad, W., Olsson, R., Sjostrom, M.: Interpreting plenoptic images as multi-view sequences for improved compression. In: 2017 IEEE International Conference on Image Process (ICIP), pp. 1–4, September 2017

    Google Scholar 

  18. Zhao, S., Chen, Z.: Light field image coding via linear approximation prior. In: 2017 IEEE International Conference on Image Process (ICIP), pp. 1–4, September 2017

    Google Scholar 

  19. Tabus, I., Helin, P., Astola, P.: Lossy compression of lenslet images from plenoptic cameras combing sparse predictive coding and JPEG2000. In: 2017 IEEE International Conference on Image Process (ICIP), pp. 1–4, September 2017

    Google Scholar 

  20. Lam, E.Y.: Computational photography with plenoptic camera and light field capture: tutorial. J. Opt. Soc. Am. A 32(11), 2021–2032 (2015)

    Article  Google Scholar 

  21. Ng, R.: Digital light field photography. Ph.D. thesis, Stanford University, 2006

    Google Scholar 

  22. Dansereau, D.G., Pizarro, O., Williams, S.B.: Decoding, calibration and rectification for lenselet-based plenoptic cameras. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, , pp. 1027–1034 (2013)

    Google Scholar 

  23. Light Field toolbox. http://www.mathworks.com/matlabcentral/fileexchange/49683-light-fieldtoolbox-v0-4

  24. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)

    MATH  Google Scholar 

  25. Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. Kluwer, Hingham (2004)

    Google Scholar 

  26. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  27. Downloaded from: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.9+SCM-8.0/

  28. Light-field image dataset. http://mmspg.epfl.ch/EPFL-light-field-image-dataset

  29. Ebrahimi, T., Foessel, S., Pereira, F., Schelkens, P.: JPEG Pleno: toward an efficient representation of visual reality. IEEE Multimed. 23(4), 14–20 (2016)

    Article  Google Scholar 

  30. ISO/IEC JTC 1/SC29/WG1 JPEG: JPEG Pleno Call for Proposals on Light Field Coding. Doc. N74014, Geneva, Switzerland, January 2017

    Google Scholar 

  31. Au, O.C., Zhang, X., Pang, C., Wen, X.: Suggested common test conditions and software reference configurations for screen content coding. In: Joint Collaborative Team on Video Coding (JCT-VC), Torino, JCTVC-F696, July 2011

    Google Scholar 

  32. Bjontegaard, G.: Calculation of average PSNR difference between RD-curves. ITU-T VCEG-M33 (2001)

    Google Scholar 

  33. Light field compression evaluation. http://mmspg.epfl.ch/files/content/sites/mmspl/files/shared/LF-GC/CFP.pdf

Download references

Acknowledgement

This work was supported in part by Shenzhen project JCYJ20170307153135771 and Foundation of Science and Technology Department of Sichuan Province 2017JZ0032c, China.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Haixu Han or Jin Xin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Han, H., Xin, J., Dai, Q. (2018). Plenoptic Image Compression via Simplified Subaperture Projection. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11165. Springer, Cham. https://doi.org/10.1007/978-3-030-00767-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00767-6_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00766-9

  • Online ISBN: 978-3-030-00767-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics