Yunshui Jin
Skip Abstract Section
Abstract
Technologies like Head Mounted Display (HMD)-based Virtual Reality (VR) and Augmented Reality (AR) have made HMD-based immersive museums possible. To investigate the user acceptance, medium, and interaction experience for HMD-based immersive museums, an app entitled The Extended Journey has been designed, developed, and deployed on both VR headsets and AR headsets. Subsequently, a between-subjects design experiment with 62 participants was conducted to measure the user experience and learning outcome in HMD VR and HMD AR conditions. Quantitative results revealed that HMD VR museums had statistically significantly better immersion and empathy compared to HMD AR museums. Qualitative data indicated HMD-based immersive museums were embraced by most young participants while HMD VR had better user acceptance than HMD AR for immersive museums. The interview also demonstrated that the advantage of the HMD-based immersive museum over the traditional online museum is not only the sensory immersion from the medium itself but also the interactive narrative experience that the HMD medium facilitates, especially the natural interaction with the CG characters and the environment in the story.
- [1] . 2017. The development of informal learning and museum pedagogy in museums. Eur. J. Contemp. Edu. 6, 3 (2017), 586–592.Google Scholar
- [2] . 1978. Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge, MA.Google Scholar
- [3] . 1999. Activity theory as a framework for designing constructivist learning environments. Edu. Technol. Res. Dev. 47, 1 (1999), 61–79.Google ScholarCross Ref
- [4] . 2021. Virtual museums as an extended museum experience: Challenges and impacts for museology, digital humanities, museums, and visitors in times of (Coronavirus) crisis. Dig. Human. Quart. 15, 3 (2021).Google Scholar
- [5] . 2018. “Immersive” heritage encounters. Museum Rev. 3, 1 (2018).Google Scholar
- [6] . 2014. Structuring location-aware interactive narratives for mobile augmented reality. In Proceedings of the International Conference on Interactive Digital Storytelling. Springer.Google ScholarCross Ref
- [7] 2004. Building Virtual and Augmented Reality museum exhibitions. In Proceedings of the 9th International Conference on 3D Web Technology. Association for Computing Machinery, 135–144.Google ScholarDigital Library
- [8] 2019. VIRTUE: A virtual reality museum Experience. In Proceedings of the 24th International Conference on Intelligent User Interfaces. Association for Computing Machinery, 119–120.Google Scholar
- [9] . 2018. User-centered design of a virtual reality exhibit for archaeological museums. Int. J. Interact. Design Manufact. 12, 2 (2018), 561–571.Google ScholarCross Ref
- [10] . 2014. An Immersive Virtual Reality Museum via Second Life. Springer International Publishing, Cham.Google ScholarCross Ref
- [11] 2018. Viking VR: Designing a virtual reality experience for a museum. In Proceedings of the Designing Interactive Systems Conference. Association for Computing Machinery, 805–815.Google ScholarDigital Library
- [12] . 2022. Modigliani VR: The Ochre Atelier. Retrieved from https://www.tate.org.uk/whats-on/tate-modern/modigliani/modigliani-vr-ochre-atelierGoogle Scholar
- [13] . 2019. Anne Frank House VR. Retrieved from https://annefrankhousevr.com/Google Scholar
- [14] 2010. From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. J. Cultur. Herit. 11, 1 (2010), 42–49.Google ScholarCross Ref
- [15] . 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cultur. Herit. 11, 4 (2010), 452–458.Google ScholarCross Ref
- [16] . 2011. Museums at Play: Games, Interaction and Learning. Museums Etc.Google Scholar
- [17] 2009. Virtual museums, a survey on methods and tools. J. Cultur. Herit. 10, 4 (2009) 520–528.Google ScholarCross Ref
- [18] . 2001. Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. Johns Hopkins University Press.Google Scholar
- [19] . 2014. Teaching the Holocaust at a distance: Reflections from the field. Ohio Soc. Stud. Rev. 51, 1 (2014), 18–30.Google Scholar
- [20] . 2014. Negotiating the process of historical empathy. Theory Res. Soc. Edu. 42, 1 (2014) 4–34.Google ScholarCross Ref
- [21] . 1984. Interaction of affect and cognition in empathy. In Emotions, Cognition, and Behavior, C. E. Izard, J. Kagan, and R. B. Zajonc (Eds.). Cambridge University Press, 103–131.Google Scholar
- [22] . 1990. The development of emotion regulation: Effects on emotional state and expression. Emotions and Family: For Better or for Worse. Routledge, 53–73.Google Scholar
- [23] 2017. Games for mental and moral development of youth: A review of empirical studies. In Proceedings of the Joint International Conference on Serious Games. Springer.Google ScholarCross Ref
- [24] . 2010. On a scale of state empathy during message processing. West. J. Commun. 74, 5 (2010), 504–524.Google ScholarCross Ref
- [25] . 2001. Defining identification: A theoretical look at the identification of audiences with media characters. Mass Commun. Soc. 4, 3 (2001), 245–264.Google ScholarCross Ref
- [26] . 2014. Narratology: An Introduction. Routledge.Google ScholarCross Ref
- [27] . 2017. The Embodied Mind, Revised Edition: Cognitive Science and Human Experience. MIT Press.Google ScholarCross Ref
- [28] 2018. Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking. PloS One 13, 10 (2018), e0204494.Google ScholarCross Ref
- [29] . 2016. A comparison of head-mounted and hand-held displays for 360 videos with focus on attitude and behavior change. In Proceedings of the 20th International Academic Mindtrek Conference.Google ScholarDigital Library
- [30] . 2017. Facilitating empathy through virtual reality. Motivat. Emot. 41, 6 (2017), 708–712.Google ScholarCross Ref
- [31] 2020. The effects of VR environments on the acceptance, experience, and expectations of cultural heritage learning. J. Comput. Cult. Herit. 13, 1 (2020), 1–21.Google ScholarDigital Library
- [32] . 2018. User experience model for augmented reality applications in urban heritage tourism. J. Herit. Tour. 13, 1 (2018), 46–61.Google ScholarCross Ref
- [33] . 2018. A theoretical model of mobile augmented reality acceptance in urban heritage tourism. Curr. Iss. Tour. 21, 2 (2018), 154–174.Google ScholarCross Ref
- [34] . 2020. A visitors’ experience model for mixed reality in the museum. Curr. Iss. Tour. 23, 9 (2020), 1053–1058.Google ScholarCross Ref
- [35] . 2022. A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality. Multimedia Tools Appl. 81, 4 (2022), 5795–5826.Google ScholarDigital Library
- [36] . 2007. Virtual reality: How much immersion is enough? Computer 40, 7 (2007), 36–43.Google ScholarDigital Library
- [37] . 2003. A note on presence terminology. Presence Connect 3, 3 (2003), 1–5.Google Scholar
- [38] . 2006. Educating students about the Holocaust: A survey of teaching practices. Soc. Edu. 70, 1 (2006), 51–55.Google Scholar
- [39] . 2001. Visualising historical knowledge using virtual reality technology. Dig. Creat. 12, 1 (2001), 15–25.Google ScholarCross Ref
- [40] . 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleop. Virtual Environ. 7, 3 (1998), 225–240.Google ScholarDigital Library
- [41] . 2004. Stages of learning motivation: Development and validation of a measure 1. J. Appl. Soc. Psychol. 34, 7 (2004), 1421–1456.Google ScholarCross Ref
- [42] . 2009. Measuring player immersion in the computer game narrative. Int. J. Hum.-Comput. Interact. 25, 2 (2009), 107–133.Google ScholarCross Ref
- [43] . 2012. Emotional gratification in entertainment experience. Why viewers of movies and television series find it rewarding to experience emotions. Media Psychol. 15, 3 (2012), 267–302.Google ScholarCross Ref
- [44] . 2015. The Coding Manual for Qualitative Researchers. Sage.Google Scholar
- [45] . 2013. What affects social attention? Social presence, eye contact, and autistic traits. PloS One 8, 1 (2013), e53286.Google ScholarCross Ref
- [46] 2010. Eye contact with a virtual character using a vision-based head tracker. In Lecture Notes in Electrical Engineering.Google Scholar
- [47] . 2010. Interactive Narrative for Adaptive Educational Games: Architecture and an Application to Character Education. University of York.Google Scholar
- [48] 2018. Player choices, game endings, and the design of moral dilemmas in games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI-PLAY’18). 2018.Google ScholarDigital Library
- [49] . 2022. Unreal 5 Overview. Retrieved from https://www.unrealengine.com/en-US/unreal-engine-5Google Scholar
- [50] . 2018. A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Edu. Technol. Res. Dev. 66, 5 (2018), 1141–1164.Google ScholarCross Ref
- [51] . 2020. Antecedents of adoption of virtual reality in experiencing destination: A study on the Indian consumers. Tour. Rec. Res. 45, 1 (2020), 42–56.Google Scholar
- [52] News 9. 2022. Mark Zuckerberg reveals Meta's next-gen VR display prototypes—Hollowcake 2 and Mirror Lake. Retrieved from https://www.news9live.com/technology/gadgets/mark-zuckerberg-reveals-hollowcake-2-mirrorlake-metas-next-gen-vr-display-prototypes-177682Google Scholar
- [53] . 2019. Augmented Reality in Holocaust Museums and Memorials. Multimodal Technol. Interact. (2019).Google Scholar
Index Terms
- Comparative Study of HMD-based Virtual and Augmented Realities for Immersive Museums: User Acceptance, Medium, and Learning
Recommendations
A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality
AbstractOver the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) ...
Stepping off a ledge in an HMD-based immersive virtual environment
SAP '13: Proceedings of the ACM Symposium on Applied PerceptionWe explore whether a gender-matched, calibrated self-avatar affects the perception of the affordance of stepping off of a ledge, or visual cliff, in an immersive virtual environment. Visual cliffs form demonstrations in many immersive virtual ...
Augmented Winter Ski with AR HMD
AH '16: Proceedings of the 7th Augmented Human International Conference 2016At time of writing, several affordable Head-Mounted Displays (HMD) are going to be released to the mass market, most of them for Virtual Reality (VR with Oculus Rift, Samsung Gear...) but also for indoor Augmented Reality (AR) with Hololens. We have ...
Comments