Matthias M. Wloka
ABSTRACT
Current state-of-the-art augmented reality systems simply overlay computer-generated visuals on the real-world imagery, for example via video or optical see-through displays. However, overlays are not effective when displaying data in three dimensions, since occlusion between the real and computer-generated objects is not addressed.
We present a video see-through augmented reality system capable of resolving occlusion between real and computer-generated objects. The heart of our system is a new algorithm that assigns depth values to each pixel in a pair of stereo video images in near-real-time. The algorithm belongs to the class of stereo matching algorithms and thus works in fully dynamic environments. We describe our system in general and the stereo matching algorithm in particular.
- 1.Arthur, Kevin. Private Communications (August 1994).Google Scholar
- 2.Azuma, Ronald and Gary Bishop. Improving Static and Dynamic Registration in an Optical See-Through HMD. Proceedings of SIGGRAPH '94 (Orlando. Florida. July 24-29. 1994). In Computer Graphics Proceedings, Annual Conference Series. 1994, ACM SIGGRAPH. New York, 1994, pp. 197-204. Google ScholarDigital Library
- 3.Bajura, Michael, Henry Fuchs, and Ryutarou Ohbuchi. Merging Virtual Objects with the Real World: Seeing Ullrasound Imagery within the Patient. Proceedings of SIGGRAPH '92 (Chicago, Illinois, July 26-31, 1992). In Computer Graphics 26, 2 (July 1992). 203-210. Google ScholarDigital Library
- 4.Bajura, Mike and Uhich Neumann. An Improved Mode'l for Augmented Reality Systems. Technical Report TR-94-022, University of North Carolina at Chapel .Hill, Department of Computer Science, Chapel Hill, NC, 1994.Google Scholar
- 5.Barnard, Stephen T. and Martin A. Fischler. Computational Stereo. ACM Colrzpuring Slcrvqs. 14(4):553-572. December 1982. Google ScholarDigital Library
- 6.Carlbom, Ingrid, William Freeman, Gudrun Klinker. Wiliam E. L.orensen. Richard Szeliski. Dtmetri TerLopoulos, and Keith Waters. Computer Vision for Computer Graphics. Couc;e Notes of Course 03 of SIGGRAPH '94 (Orlando. Florida, July 24-29, 1994).Google Scholar
- 7.Caudell, Thomas P. and David W. Mizell. Augmented Reality: An Application of Heads-Up Display Technology to Ma.nual Manufacturing Processes. HICSS, pages 659-669,1992.Google Scholar
- 8.Dhond, Umesb R. and J. K. Aggarwal. Structure from Stereo - A Review. IEEE Transactions on Systetns, Man, and Cybernetics., 19(6):1489-1510, November 1989.Google ScholarCross Ref
- 9.Feiner, Steven. Blati MacIntyre, and Dorce Seligmann. Knowledge-Based Augmented Reality. Communications of he ACM, 36(7):52-63, July 1993. Google ScholarDigital Library
- 10.Fuchs, Henry, Gary Bishop, Kevin Arthur, Leonard McMiJan. RuzenaBajcsy, Sang Lee, Hany Farid. and Takeo Kanadc. Virtual Space Teleconferencing Using a Sea of Cameras. Technical Report TR-94-033, University of Nortb Carolina at Chapel Hill, Department of Computer Science, Cbapel Hill, NC, June 1994. Google ScholarDigital Library
- 11.Kanade. "Takeo. Development of a Video-Rate Stereo Machine. In Proceedings of '94 ARPA Itmage Underslatxiing Workshop, November 1994.Google Scholar
- 12.Koch, Reinhard. Automatic Reconstruction of Buildings from Stereoscopic Image Sequences. In R. J. Hubbold and R. Juan, editors, Eurographics '93, pages 339-350, Oxford, UK, 1993. Eurographics, Blackwall Publishers.Google Scholar
- 13.Matthies, Larry. Stereo Vision for Planetary Rovers: Stochastic Modeling to Near Real-Time Implementation. fnremational Journal of Cotnputer Vision. 8( 1):7 l-9 1, 1992. Google ScholarDigital Library
- 14.Nishihara., H. K. Real-Time Implementation of a Sign- Correlation Algorithm for Image-Matching. Technical Report 90-2, Telcos Research, February 1990.Google Scholar
- 15.Ross. Bill. A Practical Stereo Vision System. III Proceedings of Cornpurer Vision and Patrem Recognifion '93, 1993.Google Scholar
- 16.Stereograpbics. CrystalEyes Video System. 1994.Google Scholar
- 17.Wloka, hlatthias M. Lag in Multiprocessor Virtual Reality. Presence, 4( 1). 1994. To appear.Google Scholar
Index Terms
- Resolving occlusion in augmented reality
Recommendations
Occlusion in outdoor augmented reality using geospatial building data
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyAligning virtual and real objects in Augmented Reality (AR) is essential for the user experience. Without alignment, the user loses suspension of disbelief and the sense of depth, distance, and size. Occlusion is a key feature to be aligned. Virtual ...
Occlusion based interaction methods for tangible augmented reality environments
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industryTraditional Tangible Augmented Reality (Tangible AR) interfaces combine a mixture of tangible user interface and augmented reality technology, complementing each other for novel interaction methods and real world anchored visualization. However, well ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Comments