Keng Hua Sing
ABSTRACT
Garden is a mixed reality (MR) experience on the Project Tango mounted with the Durovis Dive headset. It allows the player to walk around freely in large spaces and avoid obstacles, while immersed in the virtual world. It achieves this using real-time 3d reconstruction to bring the real world into virtual space. The real world is represented using minecraft-style voxels for easy rendering and texturing. We spawn game elements on tables and on the floors using the scanned geometry to recognize flat features. We also allow users to interact with these objects using just their hands and feet. With these features combined, we enable users to intuitively explore and interact with an alternate, virtual space as they do in the real world.
- Google's Project Tango. Google. https://www.google.com/atap/project-tango/.Google Scholar
- Klingensmith, M., Dryanovski, I., Srinivasa, S., and Xiao, J. 2015. Chisel: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially Hashed Signed Distance Fields. Robotics: Science and Systems XI.Google Scholar
- Matterport 3D Models of Real Interior Spaces. Matterport. http://matterport.com/.Google Scholar
- Microsoft HoloLens. Microsoft HoloLens. https://www.microsoft.com/microsoft-hololens/en-us.Google Scholar
- Miksik, O., Torr, P. H., Vineet, V., et al. 2015. The Semantic Paintbrush. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15.Google ScholarDigital Library
- Newcombe, R. A., Davison, A. J., Izadi, S., et al. 2011. KinectFusion: Real-time dense surface mapping and tracking. 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Google ScholarDigital Library
- Ondruska, P., Kohli, P., and Izadi, S. 2015. MobileFusion: Real-Time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones. IEEE Trans. Visual. Comput. Graphics IEEE Transactions on Visualization and Computer Graphics 21, 11, 1251--1258. Google ScholarDigital Library
- Piekarski, W. and Thomas, B. 2002. ARQuake: the outdoor augmented reality gaming system. Communications of the ACM Commun. ACM 45, 1. Google ScholarDigital Library
- Minecraft. minecraft.net - Home. http://minecraft.net/.Google Scholar
Index Terms
- Garden: a mixed reality experience
Recommendations
Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsGarden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Evaluating Physical Movement as Trigger for Transitioning Between Environments in Virtual Reality
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsVirtual reality allows users to experience unusual immersive environments. There are still several aspect of design for virtual reality that need more investigation, such as transitioning between environments. Multiple studies have shown that physical ...
A survey of visual, mixed, and augmented reality gaming
Theoretical and Practical Computer Applications in EntertainmentVisual mixed and augmented realities have historically been applied to the gaming application domain. This article provides a survey of visual mixed and augmented reality gaming in both the academic and commercial contexts. There is an exploration of ...
Comments