Nishant Bugalia
ABSTRACT
User interfaces that leverages vivid computer graphics and virtual reality technologies provide effective means for exploring and inspecting cultural artifacts. Such virtual inspection systems help experience and disseminate cultural heritage. For such systems to be truly ubiquitous, they need to expose a user-friendly interface that an untrained population can find intuitive and engaging. In this paper, we present one such mixed reality (MR) based interaction system that can be used to visualize as well as explore cultural heritage. The system is demonstrated by an interactive exploration of 15th century 'Vittala Temple' located at a UNESCO world heritage site, Hampi. Our system investigates the augmentation of computer generated imagery with a physical replica to increase immersion and awareness. It uses monoscopic projection mapping on the 3D-printed replica laid out on a tabletop along with a vertical projection wall behind the tabletop, on which a 3D-rendered view is displayed. Projection on the physical layout is synchronized with the 3D rendering to allow projection of texture, navigation path, users current position, etc. on the tabletop. Users can interact with this system by simply waving a laser pointer to select structures or to define a path. We have additionally explored the benefit of using a steering wheel to further control the camera direction. Such a system creates and maintains a semantic relation between users actions and the resulting effect. The UI enables two major functionalities: interactive inspection of an architectural complex and the multimedia data attached to various components and artifacts.
Supplemental Material
Available for Download
Supplemental material.
- Andujar, C., Chica, A., and Brunet, P. 2012. User-interface design for the ripoll monastery exhibition at the national art museum of catalonia. Computers & Graphics 36, 1, 28--37. Google Scholar
Digital Library
- Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., and Weaver, J. 2010. Google street view: Capturing the world at street level.Google Scholar
- Baudisch, P., Good, N., and Stewart, P. 2001. Focus plus context screens: combining display technology with visualization techniques. In Proceedings of the 14th annual ACM symposium on User interface software and technology, ACM, 31--40. Google ScholarDigital Library
- Bettio, F., Gobbetti, E., Marton, F., Tinti, A., Merella, E., and Combet, R. 2009. A point-based system for local and remote exploration of dense 3d scanned models. In VAST, Citeseer, 25--32. Google ScholarDigital Library
- Bonanni, L., Vargas, G., Chao, N., Pueblo, S., and Ishii, H. 2009. Spime builder: a tangible interface for designing hyperlinked objects. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, ACM, 263--266. Google ScholarDigital Library
- Bruder, G., Steinicke, F., and Hinrichs, K. H. 2009. Archexplore: A natural user interface for immersive architectural walkthroughs. In 3D User Interfaces, 2009. 3DUI 2009. IEEE Symposium on, IEEE, 75--82. Google ScholarDigital Library
- Burigat, S., and Chittaro, L. 2007. Navigation in 3d virtual environments: Effects of user experience and location-pointing navigation aids. Int. J. Hum.-Comput. Stud. 65, 11 (Nov.), 945--958. Google ScholarDigital Library
- Chittaro, L., and Venkataraman, S. 2006. Navigation aids for multi-floor virtual buildings: A comparative evaluation of two approaches. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '06, 227--235. Google ScholarDigital Library
- Computer program to calculate kendall w. http://www.statstodo.com/KendallW_Pgm.php. (Accessed on 07/09/2016).Google Scholar
- Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V., and Hart, J. C. 1992. The cave: audio visual experience automatic virtual environment. Communications of the ACM 35, 6, 64--73. Google ScholarDigital Library
- Darken, R. P., and Sibert, J. L. 1993. A toolset for navigation in virtual environments. In Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '93, 157--165. Google ScholarDigital Library
- Fjeld, M., Bichsel, M., and Rauterberg, M. 1999. Buildit: a brick-based tool for direct interaction. Engineering Psychology and Cognitive Ergonomics (EPCE) 4, 205--212.Google Scholar
- Fowler, R. H., Carrillo, M. D., Huerta, R. A., and Fowler, W. A. 2012. Designing a low cost immersive environment system twenty years after the first cave. In Proceedings of the International Conference on Computer Graphics and Virtual Reality (CGVR), The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 1.Google Scholar
- Indian digital heritage. http://www.nrdms.gov.in/idh.asp. (Accessed on 09/24/2016).Google Scholar
- Igarashi, T., Kadobayashi, R., Mase, K., and Tanaka, H. 1998. Path drawing for 3d walkthrough. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '98, 173--174. Google ScholarDigital Library
- IMU, R. 9 degrees of freedom - razor imu - sen-10736 - sparkfun electronics. https://www.sparkfun.com/products/10736. (Accessed on 07/09/2016).Google Scholar
- Inertial measurement unit - wikipedia, the free encyclopedia. https://en.wikipedia.org/wiki/Inertial_measurement_unit. (Accessed on 07/09/2016).Google Scholar
- Juarez, A., Schonenberg, W., and Bartneck, C. 2010. Implementing a low-cost cave system using the cryengine2. Entertainment Computing 1, 3, 157--164.Google ScholarCross Ref
- Kendall's w - wikipedia, the free encyclopedia. https://en.wikipedia.org/wiki/Kendall%27s_W. (Accessed on 07/09/2016).Google Scholar
- Müller-Tomfelde, C. 2010. Tabletops-Horizontal Interactive Displays. Springer Science & Business Media. Google ScholarDigital Library
- Nielsen, J., and Molich, R. 1990. Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 249--256. Google ScholarDigital Library
- Objet24 desktop 3d printer --- stratasys. http://www.stratasys.com/3d-printers/design-series/objet24. (Accessed on 06/02/2016).Google Scholar
- Oculus, V. 2015. Oculus rift. Available from WWW:¡ http://www.oculusvr.com/rift.Google Scholar
- Photosynth. Photosynth - capture your world in 3d. https://photosynth.net/. (Accessed on 05/16/2016).Google Scholar
- Piazza, T., and Fjeld, M. 2007. Ortholumen: Using light for direct tabletop input. In Horizontal Interactive Human-Computer Systems, 2007. TABLETOP'07. Second Annual IEEE International Workshop on, IEEE, 193--196.Google Scholar
- Piazza, T., Heller, H., and Fjeld, M. 2009. Cermit: Co-located and remote collaborative system for emergency response management. Proc. SIGRAD, 12--20.Google Scholar
- project morpheus, V. Project morpheus - playstation. https://www.playstation.com/en-us/explore/project-morpheus/. (Accessed on 05/16/2016).Google Scholar
- Science express climate action special. http://www.sciencexpress.in/about-science-express.html. (Accessed on 05/16/2016).Google Scholar
- Sjölinder, M., Höök, K., Nilsson, L.-G., and Andersson, G. 2005. Age differences and the acquisition of spatial knowledge in a three-dimensional environment: Evaluating the use of an overview map as a navigation aid. Int. J. Hum.-Comput. Stud. 63, 6 (Dec.), 537--564. Google ScholarDigital Library
- Stoakley, R., Conway, M. J., and Pausch, R. 1995. Virtual reality on a wim: Interactive worlds in miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, CHI '95, 265--272. Google ScholarDigital Library
- Ullmer, B., and Ishii, H. 1997. The metadesk: models and prototypes for tangible user interfaces. In Proceedings of the 10th annual ACM symposium on User interface software and technology, ACM, 223--232. Google ScholarDigital Library
- Underkoffler, J., and Ishii, H. 1999. Urp: a luminous-tangible workbench for urban planning and design. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, ACM, 386--393. Google ScholarDigital Library
- Unity - game engine. http://unity3d.com/. (Accessed on 05/16/2016).Google Scholar
- Vittala temple. http://hampi.in/vittala-temple. (Accessed on 05/16/2016).Google Scholar
Index Terms
- Mixed reality based interaction system for digital heritage
Recommendations
The Effects of VR Environments on the Acceptance, Experience, and Expectations of Cultural Heritage Learning
This article attempts to understand how present Virtual Reality (VR) environments can contribute to enhancing the communication of cultural heritage by providing an experience of the past that is acceptable for the younger generation and how museums and ...
A Review on Augmented Reality for Virtual Heritage System
Edutainment '09: Proceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and DevelopmentAugmented reality is one of the emerging technologies to reconstruct the historical building and monument in the previous era, where the user experiences with the real environment or virtual scene. In education, Virtual Heritage becomes as a platform of ...
Capturing aboriginal heritage in virtual reality
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThe culture of Aboriginal Australians is unique and diverse, but, unfortunately, it is under threat of extinction. This is the culture that does not rely on written records, as knowledge is predominantly being shared in the form of oral tales and ...
Comments