skip to main content
research-article

A Comparative Evaluation of Techniques for Sharing AR Experiences in Museums

Published: 07 November 2019 Publication History

Abstract

Museums are constantly searching for new ways to increase engagement with their exhibits, from electronic guides to modern digital technologies such as special-purpose tablets, smartphones, and virtual and augmented reality (AR). For AR exhibits in particular, promoting shared experience and group cohesion is not straightforward. In this work, we investigate scenarios in which not everyone is using a head-worn display (HWD), either because there aren't enough available or simply because someone might feel uncomfortable using it. We propose two sharing techniques for AR experiences and evaluate them in a long term in-the-wild study: Over-the-Shoulder AR, which renders a real-time virtual representation of the augmented reality content on a large secondary display; Semantic Linking, which displays contextual information about the virtual content on the same large display. We also introduce a complementary technique: Indicator Rings, which display the locations of the HWD user's objects-of-focus. We observed that participants in the Over-the-Shoulder AR and Semantic Linking conditions stayed together and exhibited more verbal exchanges than participants in a Baseline condition, which could indicate that they were more engaged. Self-reported measures indicated an increase in pair communication and increased comprehension of the virtual content for participants without the HWD. Participants without the HWD also displayed a greater understanding of the location of virtual elements with support from the Indicator Rings, and used them as a tool to guide the HWD user through the virtual content. We discuss design implications for interactive augmented reality exhibits and possible applications outside the cultural heritage scenario.

References

[1]
Jens Alvermann. 2016. Mobile Media in the Museum Space: The Example of the Neanderthal Museum's App "Neanderthal+". Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016), 1509--1512. https://doi.org/10.1145/2968219.2974048
[2]
Paul M Aoki, Rebecca E Grinter, Amy Hurst, Margaret H Szymanski, James D Thornton, and Allison Woodruff. 2002. Sotto Voce: Exploring the interplay of Conversation and Mobile Audio Spaces. SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves 1 (2002), 431--438. https://doi.org/10.1145/503376.503454 arxiv: cs/0205053
[3]
Ernesto Arroyo, Valeria Righi, Roger Tarrago, and Josep Blat. 2011. A Remote Multi-touch Experience to Support Collaboration between Remote Museum Visitors. In Human-Computer Interaction -- INTERACT 2011, Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 462--465.
[4]
Karen Astrid. Hensel. 1987. Families in a Museum: Interactions and Conversations at Displays. (01 1987).
[5]
Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, Vol. 6, 4 (aug 1997), 355--385. https://doi.org/10.1162/pres.1997.6.4.355
[6]
Hrvoje Benko, Edward W. Ishak, and Steven Feiner. 2004. Collaborative mixed reality visualization of an archaeological excavation. In ISMAR 2004: Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality. 132--140. https://doi.org/10.1109/ISMAR.2004.23
[7]
Mark Billinghurst and Hirokazu Kato. 1999. Collaborative Mixed Reality. Proceedings of the First International Symposium on Mixed Reality (1999), 261--284. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.107.682&rep=rep1&type=pdf
[8]
John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry, Vol. 189, 194 (1996), 4--7. https://doi.org/10.1002/hbm.20701
[9]
Matthew Chalmers and Areti Galani. 2004. Seamful interweaving: heterogeneity in the theory and design of interactive systems. Proc. DIS 2004 August (2004), 243--252. https://doi.org/10.1145/1013115.1013149
[10]
A.D. Cheok, Wang Weihua, Xubo Yang, S. Prince, Fong Siew Wan, M. Billinghurst, and H. Kato. [n. d.]. Interactive theatre experience in embodied
[11]
wearable mixed reality space. In Proceedings. International Symposium on Mixed and Augmented Reality. IEEE Comput. Soc, 59--317. https://doi.org/10.1109/ISMAR.2002.1115073
[12]
Keith Cheverst, Nigel Davies, Keith Mitchell, Adrian Friday, and Christos Efstratiou. 2000. Developing a Context-Aware Electronic Tourist Guide: Some Issues and Experiences. SIGCHI conference on Human factors in computing systems, Vol. 2, 1 (2000), 17--24. https://doi.org/10.1145/332040.332047
[13]
Guy Debord. 1955. Introduction to a Critique of Urban Geography. In Critical Geographies: A Collection of Readings. https://doi.org/10.1109/ICUAS.2016.7502677
[14]
Z Doering. 2004. Results of the 2004 Smithsonian-wide Survey of Museum Visitors. Smithsonian Institution, Office of Policy and Analysis, Washington, DC (2004), 4--5.
[15]
M. Fleck, M. Frid, T. Kindberg, E. O'Brien-Strain, R. Rajani, and M. Spasojevic. 2002. From informing to remembering: ubiquitous systems in interactive museums. IEEE Pervasive Computing, Vol. 1, 2 (April 2002), 13--21. https://doi.org/10.1109/MPRV.2002.1012333
[16]
Lesley Fosh, Steve Benford, and Boriana Koleva. 2016. Supporting Group Coherence in a Museum Visit. (2016), 1--12. https://doi.org/10.1145/2818048.2819970
[17]
Areti Galani and Chalmers Matthew. 2010. Vol. Leicester readers in museum studies. Routledge, London, Chapter Chapter 16 - Empowering the Remote Visitor: supporting social museum experiences among local and remote visitors. http://ezproxy.lib.le.ac.uk/login?url=http://www.myilibrary.com?id=427771 991009032749702746.
[18]
Tom Geller. 2006. Interactive Tabletop Exhibits in Museums and Galleries. IEEE Computer Graphics and Applications, Vol. 26, 5 (sep 2006), 6--11. https://doi.org/10.1109/MCG.2006.111
[19]
Jean-Pierre Gerval and Yann Le Ru. 2015. Fusion of Multimedia and Mobile Technology in Audioguides for Museums and Exhibitions. Springer International Publishing, Cham, 173--205. https://doi.org/10.1007/978--3--319--14645--4_8
[20]
Chris Greenhalgh, Stuart Reeves, Peter Tolmie, Steve Benford, and Tom Rodden. 2014. Supporting group interactions in museum visiting. (2014), 1049--1059. https://doi.org/10.1145/2531602.2531619
[21]
Rebecca E Grinter, Paul M Aoki, Margaret H Szymanski, James D Thornton, Allison Woodruff, and Amy Hurst. 2002. Revisiting the visit: understanding how technology can shape the museum visit. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02, Vol. Proceeding. ACM Press, New York, New York, USA, 146. https://doi.org/10.1145/587078.587100
[22]
Iris Herbst, Anne-Kathrin Braun, Rod McCall, and Wolfgang Broll. 2008. TimeWarp. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services - MobileHCI '08. ACM Press, New York, New York, USA, 235. https://doi.org/10.1145/1409240.1409266
[23]
Jon Hindmarsh, Christian Heath, Dirk vom Lehn, and Jason Cleverly. 2002. Creating assemblies: aboard the Ghost Ship. In Proceedings of the 2002 ACM conference on Computer supported cooperative work - CSCW '02. ACM Press, New York, New York, USA, 156. https://doi.org/10.1145/587078.587101
[24]
M Hood. 1983. Staying Away: Why People Choose Not to Visit Museums | Mendeley. Museum News, Vol. 61, 4 (1983), 50--57. https://contentstore.cla.co.uk/secure/link?id=75ddf2cd-d20c-e811--80cd-005056af4099
[25]
Eva Hornecker and Emma Nicol. 2012. What do lab-based user studies tell us about in-the-wild behavior? Designing Interactive Systems Conference (2012), 358--367. https://doi.org/10.1145/2317956.2318010
[26]
Akrivi Katifori, Sara Perry, Maria Vayanou, Laia Pujol, Angeliki Chrysan, Vassilis Kourtis, and Yannis Ioannidis. 2016. Cultivating Mobile-Mediated Social Interaction in the Museum: Towards Group-Based Digital Storytelling Experiences. In Annual Conference of Museums and the Web: MW2016. http://eprints.gla.ac.uk/143241/
[27]
Panayiotis Koutsabasis. 2017. Empirical Evaluations of Interactive Systems in Cultural Heritage. International Journal of Computational Methods in Heritage Science (IJCMHS), Vol. 1, 1 (2017), 100--122. https://doi.org/10.4018/IJCMHS.2017010107
[28]
Mary Elizabeth Luka and Brian Lilley. 2018. The NiS+TS Psychogeographer's Table: Countering the Official Halfiax Explosion Archive. Public, Vol. 57, 1 (2018), 295.
[29]
Jacob B. Madsen and Claus B. Madsen. 2015. Handheld Visual Representation of a Castle Chapel Ruin. Journal on Computing and Cultural Heritage (2015). https://doi.org/10.1145/2822899
[30]
Paulette McManus. 1989. Oh, Yes, They Do: How Museum Visitors Read Labels and Interact with Exhibit Texts. Curator, Vol. 32, 3 (1989), 15. https://doi.org/10.1111/j.2151--6952.1989.tb00718.x
[31]
Paulette M. McManus. 1987. It's the company you keep ...: The social determination of learning-related behaviour in a science museum. International Journal of Museum Management and Curatorship, Vol. 6, 3 (1987), 263--270. https://doi.org/10.1080/09647778709515076 https://doi.org/10.4300/JGME-5--4--18
[32]
Beth Twiss-Garrity and Matthew Fisher. 2007. Remixing Exhibits: Constructing participatory narratives with on-line tools to augment museum experiences. In Proceedings of Museums and the Web 2007. San Francisco, USA. http://www.archimuse.com/mw2007/papers/fisher/fisher.html
[33]
Natalia Vainstein, Tsvi Kuflik, and Joel Lanir. 2016. Towards Using Mobile, Head-Worn Displays in Cultural Heritage. https://doi.org/10.1145/2856767.2856802
[34]
Merel Van Der Vaart and Areti Damala. 2015. Through the Loupe: Visitor engagement with a primarily text-based handheld AR application. 2015 Digital Heritage International Congress, Digital Heritage 2015 (2015), 565--572. https://doi.org/10.1109/DigitalHeritage.2015.7419574
[35]
Klen vC opivc Pucihar and Matjavz Kljun. 2018. ART for Art: Augmented Reality Taxonomy for Art and Cultural Heritage. Augmented Reality Art February (2018), 73--94. https://doi.org/10.1007/978--3--319--69932--5_3
[36]
Vassilios Vlahakis, Nikos Ioannidis, John Karigiannis, Manolis Tsotros, Michael Gounaris, Luis Almeida, Didier Stricker, Tim Gleue, Ioannis T Christou, Renzo Carlucci, and Nikos Ioannidis. 2001. ARCHEOGUIDE: First results of an Augmented Reality, Mobile Computing System in Cultural Heritage Sites. Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage - VAST '01 January (2001), 131. https://doi.org/10.1145/584993.585015
[37]
Alexandra Weilenmann, Thomas Hillman, and Beata Jungselius. 2013. Instagram at the Museum: Communicating the Museum Experience Through Social Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1843--1852. https://doi.org/10.1145/2470654.2466243
[38]
Joost C. F. De Winter, Joost C. F. De Winter, and Dimitra Dodou. 2010. Five-point Likert items: t test versus Mann-Whitney-Wilcoxon. PRACTICAL ASSESSMENT, RESEARCH & EVALUATION (2010), 11. https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.650.3292

Cited By

View all
  • (2025)The Future Museum: Integrating Augmented Reality (AR) and Virtual-text with AI-enhanced Information SystemsJournal of Information Systems Engineering and Management10.55267/iadt.07.1543910:1(25826)Online publication date: 2025
  • (2024)Examining Pair Dynamics in Shared, Co-located Augmented Reality NarrativesProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682091(1-11)Online publication date: 7-Oct-2024
  • (2024)Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing PeopleProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642953(1-14)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 3, Issue CSCW
November 2019
5026 pages
EISSN:2573-0142
DOI:10.1145/3371885
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2019
Published in PACMHCI Volume 3, Issue CSCW

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. gaze detection
  2. in-the-wild study
  3. museum exhibit
  4. text tagging

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)127
  • Downloads (Last 6 weeks)14
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)The Future Museum: Integrating Augmented Reality (AR) and Virtual-text with AI-enhanced Information SystemsJournal of Information Systems Engineering and Management10.55267/iadt.07.1543910:1(25826)Online publication date: 2025
  • (2024)Examining Pair Dynamics in Shared, Co-located Augmented Reality NarrativesProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682091(1-11)Online publication date: 7-Oct-2024
  • (2024)Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing PeopleProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642953(1-14)Online publication date: 11-May-2024
  • (2024)Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642819(1-18)Online publication date: 11-May-2024
  • (2024)Cues to fast‐forward collaboration: A Survey of Workspace Awareness and Visual Cues in XR Collaborative SystemsComputer Graphics Forum10.1111/cgf.1506643:2Online publication date: 30-Apr-2024
  • (2024)Against Isolation in the Museum: Playful Co-presence with Immersive Augmented RealitySerious Games10.1007/978-3-031-74138-8_20(281-297)Online publication date: 31-Oct-2024
  • (2023)The Development of a Model System for the Visualization of Information on Cultural Activities and EventsElectronics10.3390/electronics1223476912:23(4769)Online publication date: 24-Nov-2023
  • (2023)DHH People in Co-located Collaborative Multiplayer AR EnvironmentsCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616039(344-347)Online publication date: 6-Oct-2023
  • (2023)An Information System Project Using Augmented Reality for a Small Local History Museum2023 IEEE 18th International Conference on Computer Science and Information Technologies (CSIT)10.1109/CSIT61576.2023.10324194(1-4)Online publication date: 19-Oct-2023
  • (2022)In-Depth Review of Augmented Reality: Tracking Technologies, Development Tools, AR Displays, Collaborative AR, and Security ConcernsSensors10.3390/s2301014623:1(146)Online publication date: 23-Dec-2022
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media