Skip to main content
SpringerLink
Log in

Constructing Virtual Cities by Using Panoramic Images

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Simultaneously acquired omni-directional images contain rays of 360 degree viewing directions. To take advantage of this unique characteristic, we have been developing several methods for constructing virtual cities. In this paper, we first describe a system to generate the appearance of a virtual city; the system, which is based on image-based rendering (IBR) techniques, utilizes the characteristics of omni-directional images to reduce the number of samplings required to construct such IBR images. We then describe a method to add geometric information to the IBR images; this method is based on the analysis of a sequence of omni-directional images. Then, we describe a method to seamlessly superimpose a new building model onto a previously created virtual city image; the method enables us to estimate illumination distributions by using an omni-directional camera. Finally, to demonstrate the methods' effectiveness, we describe how we implemented and applied them to urban scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Antone, M. and Teller, S. 2001. Scalable, absolute position recovery for omni-directional image networks. In CVPR.

  • Bolles, R., Baker, H., and Marimont, D. 1987. Epipolar plane image analysis: An approach to determining structure from motion. Int. J. of Computer Vision, 1:7–55.

    Google Scholar 

  • Chai, J., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. ACM SIGGRAPH, pp. 307–318.

  • Chen, S.E. 1995. QuickTime VR—An image-based approach to virtual enviroment navigation. In Proceedings of ACM SIGGRAPH' 95, pp. 29–38.

  • Fruh, C. and Zakhor, A. 2001. 3D model generation for cities using aerial photographs and ground level laser scans. In CVPR, vol. 2, pp. 31–38.

    Google Scholar 

  • Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M.F. 1996. The lumigraph. ACM SIGGRAPH, pp. 43–54.

  • Hirose, M. and Takaaki, E. 1999. Building a virtual world from the real world. In Proceedings of International Symposium on Mixed Reality, pp. 183–197.

  • Kamijo, S., Matsushita, Y., Ikeuchi, K., and Sakauchi, M. 1999. Incident detection at intersections utilizing hidden Markov model. In 6th World Congress on ITS, Tronto, Canada.

  • Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2001a. Light field rendering for large-scale scenes. In CVPR, Kauai, Hawaii, USA, vol. 2, pp. 64–71.

    Google Scholar 

  • Kawasaki, H., Muro, M., Ikeuchi, K., and Sakauchi, M. 2001b. Enhanced navigation system with real images and real-time information. In 8th World Congress on Intelligent Transport Systems.

  • Kawasaki, H., Yatabe, T., Ikeuchi, K., and Sakauchi, M. 2000. Construction of a 3D city map using EPI analysis and DP matching. In Asian Conf. Computer Vision, vol. 2, pp. 1149–1155.

    Google Scholar 

  • Kurazume, R., Wheeler, M.D., and Ikeuchi, K. 2001. Mapping textures on3Dgeometric model using reflectance image. In Workshop for Data Fusion at IEEE Int. Conf. on Robotics and Automation.

  • Levoy, M. and Hanrahan, P. 1996. Light field rendering. ACM SIGGRAPH, pp. 31–42.

  • Li, S. 2000. Localization along routes based upon panoramic view and GPS in large-scaled outdoor environments. In Asian Conf. Computer Vision, vol. 1, pp. 11–16.

    Google Scholar 

  • Lippman, A. 1990. Movie-maps. An application of the optical videodisc to computer graphics. In Proceedings of ACM SIGGRAPH' 80, pp. 32–43.

  • Naemura, T. and Harashima, H. et al. 1997. Ray-based creation of photo-realistic virtual world. In Virtual Reality and MultiMedia (VSMM'97), pp. 59–68.

  • Nayar, S.K. 1997. Omnidirectional video camera. In Proceedings of Computer Vision and Pattern Recognition.

  • Onoue, Y., Yamasawa, K., Takemura, H., and Yokoya, N. 1998. Telepresence by real-time view-dependent image generation from omnidirectional video streams. CVIU, 71(2):154–165.

    Google Scholar 

  • Sato, I., Sato, Y., and Ikeuchi, K. 1999. Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics, 5(1):1–12.

    Google Scholar 

  • Sato, Y., Wheeler, M., and Ikeuchi, K. 1997. Object shape and re-flectance modeling from observation. In Proceedings of ACMSIGGRAPH 97, pp. 379–387.

  • Shum, H.-Y. and Li-Wei-He. 1999. Rendering with concentric mosaics. ACM SIGGRAPH, pp. 299–306.

  • Stamos, I. and Allen, P. 2000. 3-D model construction using range and image data. In CVPR.

  • Takahashi, T., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2000a. Arbitrary view position and direction rendering for large-scale scenes. In CVPR, vol. 2, pp. 296–303.

    Google Scholar 

  • Takahashi, T., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2000b. Expanding possible view point of virtual environment using panoramic images. In Int. Conf. Pattern Recognition, IAPR 15th, Barcelona, Spain, vol. 4, pp. 468–472.

    Google Scholar 

  • Takahashi, T., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2000c. Virtual driving system with real-world image. In 7th World Congress on Intelligent Transportation Systems, Turin, Italy.

  • Tamura, H., Yamamoto, H., and Katayama, A. 2001. Mixed reality: Future dreams Seenat the border between real and virtual worlds. Computer Graphics and Applications, 21(6):64–70.

    Google Scholar 

  • Teller, S., Antone, M., Bosse, M., Coorg, S., Jethwa, M., and Master, N. 2001. Calibrated, registered images of an extended urban area. In CVPR.

  • Wood, D., Azuma, D., Aldinger, W., Curless, B., Duchamp, T., Salesin, D., and Steutzle, W. 2000. Surface light fields for 3D photography. ACM SIGGRAPH.

  • Yagi, Y. and Kawato, S. 1990. Panorama scene analysis with conic projection. In Proc. Int. Conf. on Intelligent Robots and Systems, pp. 181–187.

  • Yamamoto, M. 1986. Determining three-dimensional structure from image sequences given by horizontal and vertical moving camera. IEICE Trans. Information and Systems(D), J-69(11):1631–1638.

    Google Scholar 

  • Yamasawa, K., Yagi, Y., and Yachida, M. 1993. New real-time omnidirectional image sensor with hyperboloidal mirror. In Proc. 8th Scandinavian Conf. on Image Analysis, pp. 1381–1387.

  • Zhao, H. and Shibasaki, R. 1998. Reconstruction textured urban 3D model by fusing ground-based laser range image and CCD image. In MVA, pp. 232–237.

  • Zheng, J.Y. and Tsuji, S. 1990. Panoramic representation of scenes for route understanding. In Int. Conf. Pattern Recognition, pp. 161–167.

Download references

Author information

Authors and Affiliations

  1. Institute of Industrial Science, The University of Tokyo, 6-4-1 Komaba, Meguro-ku, Tokyo, 153-8505, Japan

    Katsushi Ikeuchi, Masao Sakauchi, Hiroshi Kawasaki & Imari Sato

Authors
  1. Katsushi Ikeuchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masao Sakauchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hiroshi Kawasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Imari Sato
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ikeuchi, K., Sakauchi, M., Kawasaki, H. et al. Constructing Virtual Cities by Using Panoramic Images. International Journal of Computer Vision 58, 237–247 (2004). https://doi.org/10.1023/B:VISI.0000019686.74089.5d

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:VISI.0000019686.74089.5d

Search

Navigation