Skip to main content
Springer Nature Link
Log in

Multi-directional Hole Filling Method for Virtual View Synthesis

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

In 3D video applications, view synthesis is widely used for generating a virtual viewpoint images. However, the quality of synthesized image is dissimilar to captured color image. Furthermore, noise occurs at object boundary areas in synthesized images. In this paper, we propose a new hole filling method to improve the synthesized image quality. In order to synthesize an image without the noise, we remove the boundary noise by expanding it as a hole region. Based on the expanded hole region, we use proposed hole scanning and directional hole filling method in simultaneous time. Additionally, we compute a cost value among the candidate pixels to find out proper hole filling pixel. We conducted experiments on various test sequences for evaluation of the proposed method. The proposed method produces better objective results than other conventional hole filling methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17

Similar content being viewed by others

References

  1. Redert, A., Op de Beeck, M., Fehn, C., IJsselsteijn, W., Pollefeys, M., Gool, L., Ofek, E., Sexton, I., & Surman, P. (2002). ATTEST: advanced three-dimensional television system technologies. 3D data processing visualization and transmission. doi: 10.1109/TDPVT.2002.1024077.

  2. Fehn, C., Kauff, P., Op de Beeck, M., Ernst, F., IJsselsteijn, W., Pollefeys, M., Van Gool, L., Ofek, E., & Sexton, I. (2002). An evolutionary and optimised approach on 3D-TV. International Broadcast Conference, pp. 357–365.

  3. Tanimoto, M. (2006). FTV (Free Viewpoint Television) for 3D scene reproduction and creation. Proc. of IEEE Computer Vision and Pattern Recognition Workshop (CVPRW), p. 172.

  4. Wilburn, B., Joshi, N., Vaish, V., Talvala, V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M. (2005). High performace imaging using large camera arrays. ACM Transactions on Graphics, 24(3), 765–776.

    Article  Google Scholar 

  5. Cheng, H., An, P., Li, H., & Zhang, Z. (2011). Stereo image rectification algorithm for multi-view 3D display. International conference on 3D Imaging (IC3D), pp. 1–5.

  6. Plath, N., Knorr, S., Goldmann, L., & Sikora, T. (2013). Adaptive image warping for hole prevention in 3D view synthesis. IEEE Transactions on Image Processing, 22(9), 3420–3432.

    Article  MathSciNet  Google Scholar 

  7. Macchiavello, B., Dorea, C., Hung, E.M., & Cheung, G. (2013). Saliency-cognizant robust view synthesis in free viewpoint video streaming. IEEE International Conference on Image Processing (ICIP), pp. 1603–1607.

  8. Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003). Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 560–576.

    Article  Google Scholar 

  9. MPEG. (2009). Introduction to 3D video. ISO/IEC JTC1/SC29/WG11 document N 10357.

  10. Yuan, H., Calic, J., & Kondoz, A. (2014). Facilitating interaction with stereoscopic 3D display devices. 3DTV-Conference: The True Vision –Capture, Transmission and display of 3D Video (3DTV-CON), pp. 1–4.

  11. Vazquez, C., Tam. W. J., & Spernaza, F. (2006). Stereoscopic imaging: filling disoccluded areas in depth image-based rendering. Proc. SPIE, vol. 6392. doi: 10.1117/12.685047.

  12. Lee. C., & Ho, Y.S. (2009). View synthesis using depth map for 3D video. Asia-Pacific Signal and International Processing Association (APSIPA), pp. 1–8.

Download references

Acknowledgments

This research was supported by the‘Cross-Ministry Giga KOREA Project’ of the Ministry of Science, ICT and Future Planning, Republic of Korea (ROK). [GK15C0100, Development of Interactive and Realistic Massive Giga-Content Technology]

Author information

Authors and Affiliations

  1. Gwangju Institute of Science and Technology (GIST), 123 Cheomdan-gwagi-ro, Buk-gu, Gwangju, 61005, Republic of Korea

    Ji-Hun Mun & Yo-Sung Ho

Authors
  1. Ji-Hun Mun
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yo-Sung Ho
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ji-Hun Mun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mun, JH., Ho, YS. Multi-directional Hole Filling Method for Virtual View Synthesis. J Sign Process Syst 85, 211–219 (2016). https://doi.org/10.1007/s11265-015-1069-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-015-1069-2

Keywords