Abstract
Free-viewpoint TV (FTV) is an ultimate 3DTV that enables users to view a 3D world by freely changing their viewpoints as if they were there. FTV will bring an epochal change in the history of television since this function has not yet been achieved by conventional TV technology. FTV will greatly contribute to the development of industry, society, life and culture because FTV has an infinite number of viewpoints and hence it has very high sensing and representation capabilities. Tanimoto Lab of Nagoya University proposed the concept of FTV and constructed the world’s first real-time system including the complete chain of operation from image capture to display. We also realized FTV on a single PC and FTV with free listening-point audio. FTV is a ray-based system rather than a pixel-based system. We are creating ray-based image engineering through the development of FTV. MPEG regards FTV as the most challenging 3D media and has been conducting the international standardization activities of FTV. The first phase of FTV was MVC (Multi-view Video Coding) and the second phase of FTV is 3DV (3D Video). MVC was completed in March 2009. 3DV is a standard that targets serving a variety of 3D displays.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Tanimoto, M.: Free viewpoint television. J. Three Dimensional Images 15(3), 17–22 (2001) (in Japanese)
Tanimoto, M.: Free viewpoint television – FTV. In: Picture Coding Symposium 2004, Special Session 5, December 2004
Tanimoto, M.: FTV (free viewpoint television) creating ray-based image engineering. In: Proc. of ICIP2005, pp. II-25–II-28, September 2005
Tanimoto, M.: Overview of free viewpoint television. Signal Proces. Image Commun. 21(6), 454–461 (2006)
Tanimoto, M.: Free viewpoint television. In: OSA Topical Meeting on Digital Holography and Three-Dimensional Imaging, DWD2, June 2007 (Invited Paper)
Tanimoto, M.: FTV (free viewpoint TV) and creation of ray-based image engineering. ECTI Trans. Electr. Eng., Electron. Commun. 6(1), 3–14 (2008) (Invited Paper)
Tanimoto, M.: FTV (free viewpoint TV) and ray-space technology. IBC2008, The Cutting Edge, Part Two, September 2008
Fujii, T.: A basic study on integrated 3-D visual communication. Ph.D dissertation in engineering, The University of Tokyo (1994) (in Japanese)
Fujii, T., Kimoto, T., Tanimoto, M.: Ray space coding for 3D visual communication. In: Picture Coding Symposium 1996, pp. 447–451, March 1996
Tanimoto, M., Nakanishi, A., Fujii, T., Kimoto, T.: The hierarchical ray-space for scalable 3-D image coding. In: Picture Coding Symposium 2001, pp. 81–84, April 2001
Fujii, T., Tanimoto, M.: Free-viewpoint television based on the ray-space representation. In: Proc. SPIE ITCom 2002, pp. 175–189, August 2002
Sekitoh, M., Toyota, K., Fujii, T., Kimoto, T., Tanimoto, M.: Virtual bird’s-eye view system based on real image. EVA 2000 Gifu, 8, pp. 8-1–8-7, October 2000
Sekitoh, M., Fujii, T., Kimoto, T., Tanimoto, M.: Bird’s eye view system for ITS. In: IEEE, Intelligent Vehicle Symposium, pp. 119–123, May 2001
Tehrani, M.P., Niwa, K., Fukushima, N., Hirano, Y., Fujii, T., Tanimoto, M., Takeda, K., Mase, K., Ishikawa, A., Sakazawa, S., Koike, A.: 3DAV integrated system featuring arbitrary listening-point and viewpoint generation. In: Proc. of IEEE Multimedia Signal Processing, MMSP 2008, PID-213, pp. 855–860 (October 2008). (Best paper award)
Introduction to multi-view video coding. ISO/IEC JTC 1/SC 29/WG11, N7328, July 2005. http://www.chiariglione.org/mpeg/technologies/mp-mv/index.htm
Introduction to 3D video. ISO/IEC JTC1/SC29/WG11 N9784, May 2008. http://www.chiariglione.org/mpeg/technologies/mp3d/index.htm
Levoy, M., Hanrahan, P.: Light field rendering. In: Proc. SIGGRAPH (ACM Trans. Graphics), pp. 31–42, August 1996
Shum, H.Y., He, L.W.: Rendering with concentric mosaics. In: Proc. SIGGRAPH (ACM Trans. Graphics), pp. 299–306, August 1999
Na Bangchang, P., Fujii, T., Tanimoto, M.: Experimental system of free viewpoint television. In: Proc. IST/SPIE Symposium on Electronic Imaging, vol. 5006–66, pp. 554–563, Jan. 2003
Na Bangchang, P., Tehrani, M.P., Fujii, T., Tanimoto, M.: Realtime system of free viewpoint television. J. Inst. Image Inform. Televis. Eng. (ITE) 59(8), 63–701 (2005)
Fujii, T., Mori, K., Takeda, K., Mase, K., Tanimoto, M., Suenaga, Y.: Multipoint measuring system for video and sound: 100-camera and microphone system. In: IEEE 2006 International Conference on Multimedia & Expo (ICME), pp. 437–440, July 2006
Matsumoto, K., Yendo, T., Fujii, T., Tanimoto, M.: Multiple-image rectification for FTV. In: Proc. of 3D Image Conference 2006, P-19, pp. 171–174, July 2006
Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: A novel rectification method for two-dimensional camera array by parallelizing locus of feature points. In: Proc. of IWAIT2008, B5-1, January 2008
Yamamoto, K., Yendo, T., Fujii, T., Tanimoto, M.: Colour correction for multiple-camera system by using correspondences. J. Inst. Image Inform. Televis. Eng. 61(2), 213–222 (2007)
He, Y., Ostermann, J., Tanimoto, M., Smolic, A.: Introduction to the special section on multiview video coding. IEEE Trans. Circ. Syst. Video Tech. 17(11), 1433–1435 (2007)
Yamamoto, K., Kitahara, M., Yendo, T., Fujii, T., Tanimoto, M., Shimizu, S., Kamikura, K., Yashima, Y.: Multiview video coding using view interpolation and color correction. IEEE Trans. Circ. Syst. Video Tech. 17(11), 1436–1449 (2007)
Nakanishi, A., Fujii, T., Kimoto, T., Tanimoto, M.: Ray-space data interpolation by adaptive filtering using locus of corresponding points on epipolar plane image. J. Inst. Image Inform. Televis. Eng. (ITE) 56(8), 1321–1327 (2002)
Droese, M., Fujii, T., Tanimoto, M.: Ray-space interpolation based on filtering in disparity domain. In: Proc. 3D Conference 2004, pp. 213–216, Tokyo, Japan, June 2004
Droese, M., Fujii, T., Tanimoto, M.: Ray-Space Interpolation Constraining Smooth Disparities Based On Loopy Belief Propagation. In: Proc. of IWSSIP 2004, pp. 247–250, Poznan, Poland, Sept. 2004
Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: Real-time arbitrary view interpolation and rendering system using ray-space. In: Proc. SPIE Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 250–261, Nov. 2005
Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: An effective partial interpolation method for ray-space. In: Proc. of 3D Image Conference 2006, pp. 85–88, July 2006
Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: Free viewpoint image generation using multi-pass dynamic programming. In: Proc. SPIE Stereoscopic Displays and Virtual Reality Systems XIV, vol. 6490, pp. 460–470, Feb. 2007
Sugawara, M., Kanazawa, M., Mitani, K., Shimamoto, H., Yamashita, T., Okano, F.: Ultrahigh-definition video system with 4000 scanning lines. SMPTE Mot. Imag. J. 112, 339–346 (2003)
Fujii, T., Tanimoto, M.: Real-time ray-space acquisition system. SPIE Electron. Imaging 5291, 179–187 (2004)
Manoh, K., Yendo, T., Fujii, T., Tanimoto, M.: Ray-space acquisition system of all-around convergent views using a rotation mirror. In: Proc. of SPIE, vol. 6778, pp. 67780C-1–8, September 2007
Fujii, T., Yendo, T., Tanimoto, M.: Ray-space transmission system with real-time acquisition and display. In: Proc. of IEEE Lasers and Electro-optics Society Annual Meeting 2007, pp. 78–79, October 2007
Endo, T., Kajiki, Y., Honda, T., Sato, M.: Cylindrical 3-D video display observable from all directions. In: Proc. of Pacific Graphics 2000, pp. 300–306, October 2000
Takano, R., Yendo, T., Fujii, T., Tanimoto, M.: Scene separation in ray-space. In: Proc. of IMPS2005, pp. 31–32, November 2005
Takano, R., Yendo, T., Fujii, T., Tanimoto, M.: Scene separation and synthesis processing in ray-space. In: Proc. of IWAIT2007, P6–23, pp. 878–883, January 2007
Chimura, N., Yendo, T., Fujii, T., Tanimoto, M.: New visual arts by processing ray-space. In: Proc. of Electronic Imaging & the Visual Arts (EVA) 2007 Florence, pp. 170–175, March 2007
Chimura, N., Yendo, T., Fujii, T., Tanimoto, M.: Image generation with special effects by deforming ray-space. In: Proc. of NICOGRAPH, S1–4, November 2007
Tanimoto, M., Fujii, T.: FTV—free viewpoint television. ISO/IEC JTC1/SC29/WG11 M8595, July 2002
Tanimoto, M., Fujii, T., Kimata, H., Sakazawa, S.: Proposal on requirements for FTV. ISO/IEC JTC1/SC29/WG11, M14417, April 2007
Applications and requirements on FTV. ISO/IEC JTC1/SC29/WG11, N9466, October 2007
AHG on FTV (free viewpoint television). ISO/IEC JTC1/SC29/WG11 N8947, April 2007
Tanimoto, M., Fujii, T., Suzuki, K.: Experiment of view synthesis using multi-view depth. ISO/IEC JTC1/SC29/WG11, M14889, October 2007
Mori, Y., Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: View generation with 3D warping using depth information for FTV. Signal Process. Image Commun. 24(1–2) 65–72 (2009)
Applications and requirements on 3D video coding. ISO/IEC JTC 1/SC 29/WG11, N11061, October 2009
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Tanimoto, M. (2010). Free-Viewpoint Television. In: Ronfard, R., Taubin, G. (eds) Image and Geometry Processing for 3-D Cinematography. Geometry and Computing, vol 5. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12392-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-12392-4_3
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12391-7
Online ISBN: 978-3-642-12392-4
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)