skip to main content
10.1145/2393347.2396513acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Spacetime freeview generation using image-based rendering, relighting, and augmented telepresence

Published:29 October 2012Publication History

ABSTRACT

This paper proposes an freeview generation technique providing the users to change their viewpoints beyond time and space. The study consists of three technical elements: image-based rendering, relighting, and augmented telepresence. Before now, we have developed two systems relating this study: an augmented telepresence system and a full spherical HDR aerial imaging system.

References

  1. D. Anguelov, C. Dulong, D. Filip, C. Frueh, S. Lafon, R. Lyon, A. Ogale, L. Vincent, and J. Weaver. Google street view: Capturing the world at street level. IEEE Computer Magazine, 43(6):32--38, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre.% Recent advances in augmented reality.% IEEE Computer Graphics and Applications, 21(6):34--47, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. P. Debevec. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. ACM SIGGRAPH'98, pages 189--198, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. Debevec, C. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In Proc. ACM SIGGRAPH'96, pages 11--20, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Hori, M. Kanbara, and N. Yokoya. Arbitrary stereoscopic view generation using multiple omnidirectional image sequences. In Proc. 20th IAPR Int'l Conf. on Pattern Recognition (ICPR'10), pages 286--289, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. N. Igawa, Y. Koga, T. Matsuzawa, and H. Nakamura. Models of sky radiance distribution and sky luminance distribution. Solar Energy, 77:137--157, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  7. M. Jancosek and T. Pajdla. Multi-view reconstruction preserving weakly-supported surfaces. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'11), pages 3121--3128, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Kopf, B. Chen, R. Szeliski, and M. Cohen. Street slide: browsing street level imagery. In Proc. ACM SIGGRAPH'10, pages 96:1--96:8, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. C. Loscos, G. Drettakis, and L. Robert. Interactive virtual relighting of real scenes. IEEE Trans. on Visualization and Computer Graphics, 6(4):289--305, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. V. Masselus, P. Peers, P. Dutré, and Y. Willems. Relighting with 4d incident light fields. In Proc. ACM SIGGRAPH'03, pages 613--620, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In Proc. ACM SIGGRAPH'95, pages 39--46, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. F. Okura, M. Kanbara, and N. Yokoya. Fly-through Heijo palace site: Augmented telepresence using aerial omnidirectional videos. In Proc. ACM SIGGRAPH'11 Posters, page 78, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. F. Okura, M. Kanbara, and N. Yokoya. Full spherical high dynamic range imaging from the sky. In Proc. IEEE Int'l Conf. on Multimedia and Expo (ICME'12), pages 325--332, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Y. Onoe, K. Yamazawa, H. Takemura, and N. Yokoya. Telepresence by real-time view-dependent image generation from omnidirectional video streams. Computer Vision and Image Understanding, 71(2):154--165, 1998.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Y. Yokochi, S. Ikeda, T. Sato, and N. Yokoya. Extrinsic camera parameter estimation based-on feature tracking and GPS data. In Proc. Seventh Asian Conf. on Computer Vision (ACCV'06), volume 1, pages 369--378, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Spacetime freeview generation using image-based rendering, relighting, and augmented telepresence

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MM '12: Proceedings of the 20th ACM international conference on Multimedia
          October 2012
          1584 pages
          ISBN:9781450310895
          DOI:10.1145/2393347

          Copyright © 2012 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 29 October 2012

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate995of4,171submissions,24%

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia
        • Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader