Abstract
We propose a new system to visualize depth-dependent patterns and images on solid objects with complex geometry using multiple projectors. The system, despite consisting of conventional passive LCD projectors, is able to project different images and patterns depending on the spatial location of the object. The technique is based on the simple principle that multiple patterns projected from multiple projectors interfere constructively with each other when their patterns are projected on the same object. Previous techniques based on the same principle can only achieve (1) low resolution volume colorization or (2) high resolution images but only on a limited number of flat planes. In this paper, we discretize a 3D object into a number of 3D points so that high resolution images can be projected onto the complex shapes. We also propose a dynamic ranges expansion technique as well as an efficient optimization procedure based on epipolar constraints. Such technique can be used to the extend projection mapping to have spatial dependency, which is desirable for practical applications. We also demonstrate the system potential as a visual instructor for object placement and assembling. Experiments prove the effectiveness of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters Ltd., Natick (2005)
Barnum, P.C., Narasimhan, S.G., Kanade, T.: A multi-layered display with water drops. ACM Trans. Graph. (TOG) 29(4), 76 (2010)
Jurik, J., Jones, A., Bolas, M., Debevec, P.: Prototyping a light field display involving direct observation of a video projector array. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 15–20 (2011)
Nagano, K., Jones, A., Liu, J., Busch, J., Yu, X., Bolas, M., Debevec, P.: An autostereoscopic projector array optimized for 3d facial display. In: ACM SIGGRAPH 2013 Emerging Technologies (SIGGRAPH 2013), p. 3:1 (2013)
Hirsch, M., Wetzstein, G., Raskar, R.: A compressive light field projection system. ACM Trans. Graph. (TOG) 33(4), 58 (2014)
Visentini-Scarzanella, M., Hirukawa, T., Kawasaki, H., Furukawa, R., Hiura, S.: A two plane volumetric display for simultaneous independent images at multiple depths. In: PSIVT Workshop Vision meets Graphics, pp. 1–8 (2015)
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the cave. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 135–142. ACM (1993)
Raskar, R., Welch, G., Fuchs, H.: Seamless projection overlaps using image warping and intensity blending. In: Fourth International Conference on Virtual Systems and Multimedia, Gifu, Japan (1998)
Yang, R., Gotz, D., Hensley, J., Towles, H., Brown, M.S.: Pixelflex: a reconfigurable multi-projector display system. In: Proceedings of the Conference on Visualization 2001, pp. 167–174. IEEE Computer Society (2001)
Chen, Y., Clark, D.W., Finkelstein, A., Housel, T.C., Li, K.: Automatic alignment of high-resolution multi-projector display using an un-calibrated camera. In: Proceedings of the Conference on Visualization 2000, pp. 125–130. IEEE Computer Society Press (2000)
Schikore, D.R., Fischer, R.A., Frank, R., Gaunt, R., Hobson, J., Whitlock, B.: High-resolution multiprojector display walls. IEEE Comput. Graph. Appl. 20(4), 38–44 (2000)
Godin, G., Massicotte, P., Borgeat, L.: High-resolution insets in projector-based display: principle and techniques. In: SPIE Proceedings: Stereoscopic Displays and Virtual Reality Systems XIII, vol. 6055 (2006)
Bimber, O., Emmerling, A.: Multifocal projection: a multiprojector technique for increasing focal depth. IEEE Trans. Vis. Comput. Graph. 12(4), 658–667 (2006)
Nagase, M., Iwai, D., Sato, K.: Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment. Virtual Reality 15(2–3), 119–132 (2011)
Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., Bolas, M.: Synthetic aperture confocal imaging. ACM Trans. Graph. (TOG) 23, 825–834 (2004)
Kagami, S.: Range-finding projectors: visualizing range information without sensors. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 239–240 (2010)
Nakamura, R., Sakaue, F., Sato, J.: Emphasizing 3D structure visually using coded projection from multiple projectors. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010. LNCS, vol. 6493, pp. 109–122. Springer, Heidelberg (2011). doi:10.1007/978-3-642-19309-5_9
Wetzstein, G., Lanman, D., Hirsch, M., Raskar, R.: Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graph. (Proc. SIGGRAPH) 31(4), 1–11 (2012)
Sato, K., Inokuchi, S.: Three-dimensional surface measurement by space encoding range imaging. J. Robot. Syst. 2, 27–39 (1985)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Hirukawa, T., Visentini-Scarzanella, M., Kawasaki, H., Furukawa, R., Hiura, S. (2017). Simultaneous Independent Image Display Technique on Multiple 3D Objects. In: Lai, SH., Lepetit, V., Nishino, K., Sato, Y. (eds) Computer Vision – ACCV 2016. ACCV 2016. Lecture Notes in Computer Science(), vol 10114. Springer, Cham. https://doi.org/10.1007/978-3-319-54190-7_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-54190-7_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54189-1
Online ISBN: 978-3-319-54190-7
eBook Packages: Computer ScienceComputer Science (R0)