Exploring the Impact of Bidirectional Interactions Between VR and SAR on Cultural Exhibition
Article No.: 5, Pages 1 - 8
Abstract
Virtual Reality (VR) technology has transformed cultural exhibitions by enabling immersive experiences. To create a shareable VR experience for cultural exhibitions, some research has integrated VR with other devices. However, existing approaches may suffer from unidirectional interactions, making it difficult for users to modify or influence VR content, which negatively impacts the user experience. To address this issue, a VR collaborative exhibition system based on Spatial Augmented Reality (SAR) is proposed in this study. Using Liangzhu culture as a case, the system allows users to immersively explore cultural heritage through VR while projecting VR content into public spaces via SAR for synchronous viewing from a global perspective. The system supports bidirectional interactions to enhance participation and improve the user experience in VR exhibitions. Furthermore, a comparative study involving 16 participants was conducted to evaluate the impact of the proposed system on collaboration efficiency, cognitive load, and user experience. The results indicated that the proposed system demonstrated significantly higher collaboration efficiency than the screen sharing-based VR exhibition system. Participants reported that it had a lower cognitive load and a better user experience. The interviews further confirmed the user preference for it.
References
[1]
Li, Jingjing, Zheng, Xiaoyang, Watanabe, Ikumu, and Ochiai, Yoichi. 2024. A systematic review of digital transformation technologies in museum exhibition. Computers in Human Behavior, 161 (12/01 2024), 108407. https://doi.org/10.1016/j.chb.2024.108407
[2]
Spadoni, Elena, Marina, Carulli, Ferrise, Francesco and Bordegoni, Monica. 2023. Impact of Multisensory XR Technologies on Museum Exhibition Visits. In Proceedings of the Universal Access in Human-Computer Interaction, 2023, Cham. Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-35897-5_9
[3]
Avlonitou, Charis and Papadaki, Eirini. 2024. Using extended reality technologies in modern museums. Arts & Communication (2024). https://doi.org/10.36922/ac.3428
[4]
Wei, X and Huangfu, R. 2021. Application of Virtual Reality and Augmented Reality in Museum Learning: A Literature Review. In Proceedings of the 15th International Technology, Education and Development Conference, 8-9 March, 2021, Online Conference. https://doi.org/10.21125/inted.2021.1648
[5]
Tao, Y. 2020. A VR/AR-based Display System for Arts and Crafts Museum. In Proceedings of the 2020 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 29-30 October, 2020, Chongqing, China. https://doi.org/10.1109/CyberC49757.2020.00029
[6]
Suroto, Peni Zulandari, Dewantara, Made Handijaya and Wiradarmo, Aulia Ardista. 2020. The Application of Technology in Museums. International Journal of Applied Sciences in Tourism and Events, 4, 2 (Dec. 30 2020), 12. https://doi.org/10.31940/ijaste.v4i2.1853
[7]
Mai, Christian, Bartsch, Sarah Aragon and Rieger, Lea. 2018. Evaluating Shared Surfaces for Co-Located Mixed-Presence Collaboration. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia, 2018, Cairo, Egypt. Association for Computing Machinery. https://doi.org/10.1145/3282894.3282910
[8]
Delgado, Johnny, West, Rachel, Barmpoutis, Angelos, Jang, Seung Hyuk, Stanley, Edward and Kang, Hyo. 2024. Enhancing Museum Experience with VR by Situating 3D Collections in Contex. In Proceedings of the 23rd Annual ACM Interaction Design and Children Conference, 2024, Delft, Netherlands. Association for Computing Machinery. https://doi.org/10.1145/3628516.3659372
[9]
Gumilar, Ihshan, Barde, Amit, Sasikumar, Prasanth, Billinghurst, Mark, Hayati, Ashkan F., Lee, Gun, Munarko, Yuda, Singh, Sanjit and Momin, Abdul. 2022. Inter-brain Synchrony and Eye Gaze Direction During Collaboration in VR. In Proceedings of the Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, 2022, New Orleans, LA, USA. Association for Computing Machinery. https://doi.org/10.1145/3491101.3519746
[10]
Gugenheimer, Jan, Stemasov, Evgeny, Sareen, Harpreet and Rukzio, Enrico. 2018. Facedisplay: Towards asymmetric multi-user interaction for nomadic virtual reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018. https://doi.org/10.1145/3173574.3173628
[11]
Pidel, Catlin and Ackermann, Philipp. 2020. Collaboration in Virtual and Augmented Reality: A Systematic Overview. In Proceedings of the Augmented Reality, Virtual Reality, and Computer Graphics, 2020, Cham. Springer International Publishing. https://doi.org/10.1007/978-3-030-58465-8_10
[12]
Roo, Joan Sol, Gervais, Renaud, Frey, Jeremy and Hachet, Martin. 2017. Inner garden: Connecting inner states to a mixed reality sandbox for mindfulness. In Proceedings of the 2017 CHI conference on human factors in computing systems, 2017. https://doi.org/10.1145/3025453.3025743
[13]
Wang, Peng, Wang, Yue, Billinghurst, Mark, Yang, Huizhen, Xu, Peng and Li, Yanhong. 2023. BeHere: a VR/SAR remote collaboration system based on virtual replicas sharing gesture and avatar in a procedural task. Virtual Reality, 27, 2 (2023/06/01 2023), 1409-1430. https://doi.org/10.1007/s10055-023-00748-5
[14]
Home, MW. 2016. Virtual reality at the British Museum: What is the value of virtual reality environments for learning by children and young people, schools, and families. In Proceedings of the Annual Conference of Museums and the Web, Los Angeles, CA, USA, 2016.
[15]
Carrozzino, Marcello and Bergamasco, Massimo. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. Journal of Cultural Heritage, 11, 4 (10/01 2010), 452-458. https://doi.org/10.1016/j.culher.2010.04.001
[16]
Zhang, Jiali and Bryan-Kinns, Nick. 2022. QiaoLe: Accessing traditional Chinese musical instruments in VR. In Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, IEEE. https://doi.org/10.1109/VRW55335.2022.00080
[17]
Wang, Y., Liu, X., Cheng, B., Arora, C. and Hoang, T. 2022. VR4HcRE: Virtual Reality Platform for Human-centric Requirements Elicitation. In Proceedings of the 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 17-21 Oct., 2022, Singapore, Singapore. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00168
[18]
Jin, Qiao, Liu, Yu, Sun, Ruixuan, Chen, Chen, Zhou, Puqi, Han, Bo, Qian, Feng and Yarosh, Svetlana. 2023. Collaborative Online Learning with VR Video: Roles of Collaborative Tools and Shared Video Control. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023, Hamburg, Germany. Association for Computing Machinery. https://doi.org/10.1145/3544548.3581395
[19]
Fröhlich, Thomas, Alexandrovsky, Dmitry, Stabbert, Timo, Döring, Tanja and Malaka, Rainer. 2018. VRBox: A virtual reality augmented sandbox for immersive playfulness, creativity and exploration. In Proceedings of the 2018 annual symposium on computer-human interaction in play, 2018.
[20]
Ryokai, Kimiko and Li, Yong. 2020. VR SandScape: Working with Multiple Perspectives in a Hybrid VR/SAR Collaborative Play Space. In Proceedings of the Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play, 2020, Virtual Event, Canada. Association for Computing Machinery. https://doi.org/10.1145/3383668.3419892
[21]
Pan, Zhigeng, Gao, Jiali, Wang, Ruonan, Yuan, Qingshu, Fan, Ran and She, Li. 2021. Digital Twin Registration Technique of Spatial Augmented Reality for Tangible Interaction. Journal of Computer-Aided Design & Computer Graphics, 33, 5 (2021), 655-661.
[22]
Gergle, Darren, Kraut, Robert E and Fussell, Susan R. 2013. Using visual information for grounding and awareness in collaborative tasks. Human–Computer Interaction, 28, 1 (2013), 1-39. https://doi.org/10.1080/07370024.2012.678246
[23]
Hart, Sandra G. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, 2006, Sage publications Sage CA: Los Angeles, CA.
[24]
Gergle, Darren, Kraut, Robert E and Fussell, Susan R. 2004. Language efficiency and visual technology: Minimizing collaborative effort with visual information. Journal of language and social psychology, 23, 4 (2004), 491-517.
[25]
Laugwitz, Bettina, Held, Theo and Schrepp, Martin. 2008. Construction and Evaluation of a User Experience Questionnaire. In Proceedings of the HCI and Usability for Education and Work, 2008//, 2008, Berlin, Heidelberg. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-89350-9_6
[26]
Heath, Christian, Lehn, Dirk vom and Osborne, Jonathan. 2005. Interaction and interactives: collaboration and participation with computer-based exhibits. Public Understanding of Science, 14, 1 (2005), 91-101.
[27]
Wu, Yi, Cui, Tingru, Liu, Na, Deng, Yimeng and Guo, Junpeng. 2018. Demystifying continuous participation in game applications at social networking sites: A social playfulness design perspective. Internet Research, 28, 2 (2018), 374-392.
[28]
Likert, Rensis. 1932. A technique for the measurement of attitudes. Archives of Psychology (1932).
[29]
Biocca, Frank and Harms, Chad. 2004. Internal consistency and reliability of the networked minds social presence measure. In Proceedings of the Seventh Annual International Workshop on Presence, 2004.
[30]
Strada, Francesco, Battegazzorre, Edoardo, Ameglio, Enrico, Turello, Simone and Bottino, Andrea. 2022. Assessing Visual Cues for Improving Awareness in Collaborative Augmented Reality. In Proceedings of the Extended Reality, 2022//, 2022, Cham. Springer International Publishing. https://doi.org/10.1007/978-3-031-15546-8_18
[31]
Piumsomboon, Thammathip, Dey, Arindam, Ens, Barrett, Lee, Gun and Billinghurst, Mark. 2019. The effects of sharing awareness cues in collaborative mixed reality. Frontiers in Robotics and AI, 6 (2019), 5. https://doi.org/10.3389/frobt.2019.00005
Index Terms
- Exploring the Impact of Bidirectional Interactions Between VR and SAR on Cultural Exhibition
Recommendations
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsThis demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
BeHere: a VR/SAR remote collaboration system based on virtual replicas sharing gesture and avatar in a procedural task
AbstractIn this paper, we focus on the significance of remote collaboration using virtual replicas, avatar, and gesture on a procedural task in industry; thus, we present a Virtual Reality (VR)/Spatial Augmented Reality (SAR) remote collaboration system, ...
VR SandScape: Working with Multiple Perspectives in a Hybrid VR/SAR Collaborative Play Space
CHI PLAY '20: Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in PlayWe present our informal observations of children and adults playing together with our VR SandScape, a hybrid system with a Spatial Augmented Reality (SAR) sandbox and a Virtual Reality (VR) perspective. We discuss our preliminary findings of how the ...
Comments
Information & Contributors
Information
Published In
December 2024
161 pages
ISBN:9798400713484
DOI:10.1145/3703619
- Editors:
- Ping Li,
- Zhigeng Pan,
- Adrian David Cheok,
- Lei Zhu,
- Zhihua Hu
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 January 2025
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Zhejiang Provincial Experimental Teaching Demonstration Center for the 14th Five Year Plan
- A Project Supported by Scientific Research Fund of Zhejiang Provincial Education Department
- Zhejiang Provincial Natural Science Foundation of China
Conference
VRCAI '24
Sponsor:
VRCAI '24: The 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
December 1 - 2, 2024
Guangdong Province, Nanjing, China
Acceptance Rates
Overall Acceptance Rate 51 of 107 submissions, 48%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 34Total Downloads
- Downloads (Last 12 months)34
- Downloads (Last 6 weeks)34
Reflects downloads up to 27 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format