Skip to main content
SpringerLink
Log in

Diminished Reality for Landscape Video Sequences with Homographies

  • Conference paper
Knowledge-Based and Intelligent Information and Engineering Systems (KES 2010)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6278))

Abstract

This paper describes a Diminished Reality application to eliminate occluders on videos capturing distant landscapes. Although many tourist spots have lookouts to see the distant landscape, the video capturing from there usually includes obstructive occluders such as pillar and muntin. The application vanishes the occluders in the video in semi-interactively with homographies of distant landscape among frames. For this purpose, the regions of occluders in every frame are segmented by the GrabCut algorism, and then the each region is recovered by the appropriate texture from another frame which is not occluded in same region.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of the 27th annual inproceedings on Computer graphics and interactive techniques, pp. 417–424. ACM Press/Addison-Wesley Publishing Co., New York (2000)

    Google Scholar 

  2. Chan, T., Shen, J.: Nontexture inpainting by curvature-driven diffusions. Journal of Visual Communication and Image Representation 12(4), 436–449 (2001)

    Article  Google Scholar 

  3. Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th annual inproceedings on Computer graphics and interactive techniques, pp. 479–488. ACM Press/Addison-Wesley Publishing Co, New York (2000)

    Google Scholar 

  4. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  5. Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: IEEE Computer Society inproceedings on Computer Vision and Pattern Recognition, vol. 2, Citeseer (2003)

    Google Scholar 

  6. Wexler, Y., Shechtman, E., Irani, M.: Space-time video completion. In: IEEE Computer Society inproceedings on Computer Vision and Pattern Recognition, vol. 1. IEEE Computer Society, Los Alamitos (2004)

    Google Scholar 

  7. Jia, J., Wu, T.P., Tai, Y.W., Tang, C.K.: Video repairing: Inference of foreground and background under severe occlusion. In: IEEE Computer Society inproceedings on Computer Vision and Pattern Recognition, vol. 1. IEEE Computer Society, Los Alamitos (2004)

    Google Scholar 

  8. Lepetit, V., Berger, M.O.: A semi-automatic method for resolving occlusion in augmented reality. In: IEEE Computer Society in Proceedings on Computer Vision and Pattern Recognition, vol. 2 (2000)

    Google Scholar 

  9. Lowe, D.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)

    Google Scholar 

  10. Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22(3), 277–286 (2003)

    Article  Google Scholar 

  11. Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut / max -flow algorithms for energy minimization in vision. PAMI 26(9), 1124–1137 (2004)

    Google Scholar 

  12. Bugeau, A., Perez, P.: Joint tracking and segmentation of objects using graph cuts. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 628–639. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  13. Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 23(3), 309–314 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Systems Engineering, Wakayama University, 930 Sakaedani, Wakayama, 640-8510, Japan

    Kosuke Takeda & Ryuuki Sakamoto

Authors
  1. Kosuke Takeda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ryuuki Sakamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Engineering, Cardiff University, The Parade, CF24 3AA, Cardiff, UK

    Rossitza Setchi

  2. Dept. of Computer Science and Software Engineering, University of Portsmouth, BUckingham Building, Lion Terrace, PO1 3HE, Portsmouth, UK

    Ivan Jordanov

  3. KES International, 145-157 St. John Street, EC1V 4PY, London, UK

    Robert J. Howlett

  4. School of Electrical and Information Engineering, University of South Australia, Adelaide, Mawson Lakes Campus, 5095, SA, Australia

    Lakhmi C. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Takeda, K., Sakamoto, R. (2010). Diminished Reality for Landscape Video Sequences with Homographies. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2010. Lecture Notes in Computer Science(), vol 6278. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15393-8_56

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15393-8_56

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15392-1

  • Online ISBN: 978-3-642-15393-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation