Skip to main content
SpringerLink
Log in

Surround video: a multihead camera approach

  • original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We describe algorithms for creating, storing and viewing high-resolution immersive surround videos. Given a set of unit cameras designed to be almost aligned at a common nodal point, we first present a versatile process for stitching seamlessly synchronized streams of videos into a single surround video corresponding to the video of the multihead camera. We devise a general registration process onto raymaps based on minimizing a tailored objective function. We review and introduce new raymaps with good sampling properties. We then give implementation details on the surround video viewer and present experimental results on both real-world acquired and computer-graphics rendered full surround videos. We conclude by mentioning potential applications and discuss ongoing related activities.

Video supplements: http://www.csl.sony.co.jp/person/nielsen

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aliaga DG, Funkhouser T, Yanovsky D, Carlbom I (2003) Sea of images: a dense sampling approach for rendering large indoor environments. IEEE Comput Graph Appl 23(6):22–30

    Article  Google Scholar 

  2. Australian Center for the Moving Image (2005) Magic Machines: A History of the Moving Image from Antiquity to 1900. http://www.acmi.net.au/AIC/MAGIC‘MACHINES.html

  3. Benosman R, Kang SB (eds) (2001) Panoramic vision: sensors, theory and applications. Springer, Berlin Heidelberg New York

    Google Scholar 

  4. Cabral B, Olano M, Nemec P (1999) Reflection space image based rendering. Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp 165–170. DOI 10.1145/311535.311553

  5. Chen SE (1995) QuickTime VR: an image-based approach to virtual environment navigation. Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp 29–38. DOI 10.1145/218380.218395

    Google Scholar 

  6. Conrady A (1919) Decentering lens systems. Mon Not R Astron Soc 79:385–390

    Google Scholar 

  7. Coorg S, Teller S (2000) Spherical mosaics with quaternions and dense correlation. Int J Comput Vis 37(3):259–273. DOI 10.1023/A:1008184124789

  8. DodecaTM (2005) camera system. http://www.immersivemedia.com/technology.php

  9. El-Melegy MT, Farag AA (2003) Nonmetric lens distortion calibration: closed-form solutions, robust estimation and model selection. IEEE International Conference on Computer Vision, pp 554–559

    Google Scholar 

  10. Grossberg MD, Nayar SK (2001) A general imaging model and a method for finding its parameters. IEEE International Conference on Computer Vision, pp 108–115

  11. Hsu S, Sawhney HS, Kumar R (2002) Automated mosaics via topology inference, IEEE Comput Graph Appl 22(2):44–54. DOI 10.1109/38.988746

  12. McMillan L, Bishop G (1995) Plenoptic modeling: an image-based rendering system. Proceedings of the 22nd annual conference on computer graphics and interactive techniques, pp 39–46. DOI 10.1145/218380.218398

    Google Scholar 

  13. Milgram DL (1975) Computer methods for creating photomosaics. IEEE Trans Comput C-24:1113–1119

  14. Nalwa VS (1996) A true omnidirectional viewer. Technical report, Bell Laboratories. http://www.fullview.com

  15. Nayar SK, Karmarkar A (2000) 360×360 Mosaics. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2388–2395

  16. Neumann J, Fermuller C, Aloimonos Y (2003) Polydioptric camera design and 3D motion estimation. IEEE Comput Vis Pattern Recogn 2:294–301

    Google Scholar 

  17. Nielsen F (2003) Plenoptic path and its applications. IEEE International Conference on Image Processing 1:793–796

    Google Scholar 

  18. Smolic A, Kimata H (2004) AHG on 3DAV Coding. ISO/IEC JTC1/SC29/WG11, MPEG04/M10795, Redmont, WA, USA, http://www.chiariglione.org/mpeg/

  19. Swaminathan R, Nayar SK (2000) Non-metric calibration of wide-angle lenses and polycameras. IEEE Trans Pattern Anal Mach Intell 22(10):1172–1178

    Article  Google Scholar 

  20. Szeliski R, Shum HY (1997) Creating full view panoramic image mosaics and environment maps. Proceedings of the 24th annual conference on computer graphics and interactive techniques, pp 251–258. DOI 10.1145/258734.258861

  21. Snyder JP, Tobler WR, Yang OH, Yang QH (2000) Map Projection Transformation: Principles and Applications. CRC Press

    Google Scholar 

  22. Tsai RY (1987) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J Robot Automat 3(4):323–344

    Article  Google Scholar 

  23. Wong TT, Luk WS, Heng PA (1997) Sampling with Hammersley and Halton points. J Graph Tools 2(2):9–24

    Article  Google Scholar 

  24. Xiong Y, Turkowski K (1998) Registration, calibration and blending in creating high quality panoramas. IEEE Workshop on Algorithms of Computer Vision, pp 69–74

Download references

Author information

Authors and Affiliations

  1. Sony Computer Science Laboratories, Tokyo, Japan

    Frank Nielsen

Authors
  1. Frank Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frank Nielsen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nielsen, F. Surround video: a multihead camera approach. Vis Comput 21, 92–103 (2005). https://doi.org/10.1007/s00371-004-0273-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-004-0273-z

Keywords

Search

Navigation