research-article

Design and User Experience of a Hybrid Mixed Reality Installation that Promotes Tinian Marble Crafts Heritage

Authors:

Vasiliki Nikolakopoulou,

Spyros Vosinakis,

Giorgos Nikopoulos,

Modestos Stavrakis,

Nikolaos Politopoulos,

Labros Fragkedis,

Panayiotis KoutsabasisAuthors Info & Claims

ACM Journal on Computing and Cultural Heritage, Volume 15, Issue 4

Article No.: 60, Pages 1 - 21

https://doi.org/10.1145/3522743

Published: 06 December 2022 Publication History

Abstract

Hybrid physical-digital installations in museums are interactive systems or exhibits that seamlessly combine physical (tangible) artifacts with virtual environments. In the museum, hybrid installations offer direct, hands-on experiences to visitors and thus may enhance their interest and engagement. Moreover, the entanglement of tangible and virtual interfaces may reinforce learning about the respective heritage. This article reports on the design, implementation, and evaluation of an interactive installation that promotes the heritage of Tinian marble crafts that is included in the representative list of intangible heritage by UNESCO and resides in the Museum of Marble Crafts in Tinos, Greece. The installation puts the museum visitor in the role of a crane operator in a virtual reconstruction of a historic quarry and requires them to operate the crane and move marble volumes with safety in cooperation with non-playable characters (NPCs). Our design approach aimed to engage visitors in a playful learning experience, incorporating aspects of the two museum's exhibits (crane, quarry). The empirical evaluation took place at the lab and the museum with promising results on UX and learning. In addition, we identify and discuss several prospects and drawbacks of designing playful tangible interfaces for other practitioners to consider in similar applications.

References

[1]

L. Ciolfi and L. J. Bannon. 2007. Designing hybrid places: Merging interaction design, ubiquitous technologies, and geographies of the museum space. CoDesign 3, 3 (2007), 159–180.

[2]

L. Ciolfi. 2021. Hybrid Interactions in Museums: Why Materiality Still Matters. In Virtual Heritage: A Guide, E. M. Champion (ed.). London: Ubiquity Press. 67–79.

[3]

D. Petrelli and S. O'Brien. 2018. Phone vs. tangible in museums: A comparative study. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York.

Digital Library

[4]

C. Claisse, D. Petrelli, N. Dulake, M. T. Marshall, and L. Ciolfi. 2018. Multisensory interactive storytelling to augment the visit of a historical house museum. In Proceedings of the 2018 3rd Digital Heritage International Congress held jointly with 2018 24th International Conference on Virtual Systems & Multimedia. IEEE. 1–8.

[5]

L. Hirsch, C. Mall, and A. Butz. 2021. Do touch this: Turning a plaster bust into a tangible interface. In Creativity and Cognition Conference Proceedings. 1–8.

[6]

E. Nofal, G. Panagiotidou, R. M. Reffat, H. Hameeuw, V. Boschloos, and A. V. Moere. 2020. Situated tangible gamification of heritage for supporting collaborative learning of young museum visitors. Journal on Computing and Cultural Heritage 13, 1 (2020), 1–24.

Digital Library

[7]

R. Muntean, K. Hennessy, A. Antle, S. Rowley, J. Wilson, and B. Matkin. 2015. ʔeləw̓k̓ʷ–Belongings: Tangible interactions with intangible heritage. Journal of Science and Technology of the Arts 7, 2 (2015), 59–69.

[8]

J. H. Chu, P. Clifton, D. Harley, J. Pavao, and A. Mazalek. 2015. Mapping place: Supporting cultural learning through a lukasa-inspired tangible tabletop museum exhibit. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction. 261–268.

Digital Library

[9]

L. Bannon, S. Benford, J. Bowers, and C. Heath. 2005. Hybrid design creates innovative museum experiences. Communications of the ACM 48, 3 (2005), 62–65.

Digital Library

[10]

F. Liarokapis, P. Petridis, D. Andrews, and S. de Freitas. 2017. Multimodal serious games technologies for cultural heritage. In Mixed Reality and Gamification for Cultural Heritage. Springer, Cham. 371–392.

[11]

S. Arnab, P. Petridis, I. Dunwell, and S. de Freitas. 2011. Enhancing learning in distributed virtual worlds through touch: A browser-based architecture for haptic interaction. In Serious Games and Edutainment Applications, M. Ma, A. Oikonomou, L. C. Jain (ed.). Springer, London, (2011). 149–167

[12]

M. White, N. Mourkoussis, J. Darcy, P. Petridis, F. Liarokapis, P. Lister, and F. Gaspard. 2004. ARCO-an architecture for digitization, management and presentation of virtual exhibitions. In Proceedings of the Computer Graphics International, (2004). IEEE. 622–625.

Digital Library

[13]

A. Damala, E. Hornecker, M. Van der Vaart, D. van Dijk, and I. Ruthven. 2016. The Loupe: tangible augmented reality for learning to look at Ancient Greek art. Mediterranean Archaeology and Archaeometry 16, 5 (2016), 73–85.

[14]

M. T. Marshall, N. Dulake, L. Ciolfi, D. Duranti, H. Kockelkorn, and D. Petrelli. 2016. Using tangible smart replicas as controls for an interactive museum exhibition. In Proceedings of the TEI'’16: 10th International Conference on Tangible, Embedded, and Embodied Interaction. 159–167.

Digital Library

[15]

G. Anagnostakis, M. Antoniou, E. Kardamitsi, T. Sachinidis, P. Koutsabasis, M. Stavrakis, S. Vosinakis, and D. Zissis., 2016. Accessible museum collections for the visually impaired: combining tactile exploration, audio descriptions and mobile gestures. In Proceedings of the 18th International Conference on Human–Computer Interaction with Mobile Devices and Services Adjunct. 1021–1025.

Digital Library

[16]

J. Okerlund, E. Segreto, C. Grote, L. Westendorf, A. Scholze, R. Littrell, and O. Shaer. 2016. Synflo: A tangible museum exhibit for exploring bio-design. In Proceedings of the TEI'’16: 10th International Conference on Tangible, Embedded, and Embodied Interaction. 141–149.

Digital Library

[17]

B. Bontchev. 2015. Serious games for and as cultural heritage. Digital Presentation and Preservation of Cultural and Scientific Heritage 5, (2015), 43–58.

[18]

M. Mortara, C. E. Catalano, F. Bellotti, G. Fiucci, M. Houry-Panchetti, and P. Petridis. 2014. Learning cultural heritage by serious games. Journal of Cultural Heritage 15, 3 (2014), 318–325.

[19]

I. Paliokas and S. Sylaiou. 2016. The use of serious games in museum visits and exhibitions: A systematic mapping study. In Proceedings of the 2016 8th International Conference on Games and Virtual Worlds for Serious Applications. IEEE. 1–8.

[20]

Q. Lu, S. E. Ma, J. Li, H. Mi, and Y. Xu. 2019. Irelics: Designing a tangible interaction platform for the popularization of field archaeology. In Proceedings of the 13th International Conference on Tangible, Embedded, and Embodied Interaction. 45–54.

Digital Library

[21]

A. Dimitropoulos, K. Dimitropoulos, A. Kyriakou, M. Malevitis, S. Syrris, S. Vaka, P. Koutsabasis, S. Vosinakis, and M. Stavrakis. 2018. The loom: interactive weaving through a tangible installation with digital feedback. In Digital Cultural Heritage. Springer, Cham. 199–210.

[22]

L. Clarke, E. Hornecker, and I. Ruthven. 2021. Fighting fires and powering steam locomotives: Distribution of control and its role in social interaction at tangible interactive museum exhibits. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[23]

S. Vosinakis, V. Nikolakopoulou, M. Stavrakis, L. Fragkedis, P. Chatzigrigoriou, and P. Koutsabasis. 2020. Co-Design of a playful mixed reality installation: An interactive crane in the museum of marble crafts. Heritage 3, 4 (2020), 1496–1519.

[24]

M. Schrepp, A. Hinderks, and J. Thomaschewski. 2017. Construction of a benchmark for the user experience questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence 4, 4 (2017), 40–44.

[25]

M. K. Bekele and E. Champion. 2019. A comparison of immersive realities and interaction methods: Cultural learning in virtual heritage. Frontiers in Robotics and AI 6 (2019), 91.

[26]

M. Economou and L. Pujol. 2007. Evaluating the impact of new technologies on cultural heritage visitors. Technology Strategy, Management and Socio-Economic Impact, Heritage Management series 2 (2007), 109–121.

[27]

E. Not, D. Cavada, S. Maule, A. Pisetti, and A. Venturini. 2019. Digital augmentation of historical objects through tangible interaction. Journal on Computing and Cultural Heritage 12, 3 (2019), 1–19.

Digital Library

Cited By

Nikolarakis AKoutsabasis P(2024)Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic ReviewMultimodal Technologies and Interaction10.3390/mti80600528:6(52)Online publication date: 17-Jun-2024
https://doi.org/10.3390/mti8060052
Neamțu CComes RPopovici DBăutu ELiliana MSyrotnik APopovici M(2024)Evaluating User Experience in the Context of Cultural Heritage Dissemination Using Extended Reality: A Case Study of the Dacian Bronze Matrix with Hollow DesignJournal on Computing and Cultural Heritage 10.1145/363993317:2(1-21)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3639933
Nikolakopoulou VVosinakis SStavrakis MKoutsabasis P(2024)Embodied Acts for Testing Mixed Reality Low-Fidelity Prototypes that Convey Intangible Cultural Heritage: Method and Case StudyVirtual Reality and Mixed Reality10.1007/978-3-031-78593-1_3(36-49)Online publication date: 27-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-78593-1_3

Index Terms

Design and User Experience of a Hybrid Mixed Reality Installation that Promotes Tinian Marble Crafts Heritage
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Designing Mixed Reality Experiences that Provide Views to the Past: Reviving the Operation of an Industrial Olive Oil Factory
PCI '21: Proceedings of the 25th Pan-Hellenic Conference on Informatics

Mixed reality (MR) installations in museums can be a promising communication medium for intangible aspects of cultural heritage, such as practices, rituals, craftsmanship, and customs of a previous era. There are various technological approaches for ...
Embodied Acts for Testing Mixed Reality Low-Fidelity Prototypes that Convey Intangible Cultural Heritage: Method and Case Study
Virtual Reality and Mixed Reality
Abstract
In the design of bodily engaging Mixed Reality (MR) installations for intangible cultural heritage (ICH) in museums, a gap remains regarding how to test low-fidelity prototypes to refine the detailed design and ensure successful final ...
Application of Virtual Reality Technology in the Protection of Intangible Cultural Heritage: —Take the “Lion dance” in Shehuo as an example
ICMSSP '22: Proceedings of the 2022 7th International Conference on Multimedia Systems and Signal Processing

China is an ancient civilization with a long history and culture, and has accumulated many precious cultural heritages over thousands of years. Intangible cultural heritage is a very important part of it. Because the intangible cultural heritage is ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 15, Issue 4

December 2022

483 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3572828

Editor:
Franco Niccolucci
VAST-LAB at PIN, University of Florence, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2022

Online AM: 25 July 2022

Accepted: 25 February 2022

Received: 03 September 2021

Published in JOCCH Volume 15, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

European Union and Greek
Operational Program Competitiveness, Entrepreneurship and Innovation
RESEARCH – CREATE – INNOVATE

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
720
Total Downloads

Downloads (Last 12 months)258
Downloads (Last 6 weeks)22

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nikolarakis AKoutsabasis P(2024)Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic ReviewMultimodal Technologies and Interaction10.3390/mti80600528:6(52)Online publication date: 17-Jun-2024
https://doi.org/10.3390/mti8060052
Neamțu CComes RPopovici DBăutu ELiliana MSyrotnik APopovici M(2024)Evaluating User Experience in the Context of Cultural Heritage Dissemination Using Extended Reality: A Case Study of the Dacian Bronze Matrix with Hollow DesignJournal on Computing and Cultural Heritage 10.1145/363993317:2(1-21)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3639933
Nikolakopoulou VVosinakis SStavrakis MKoutsabasis P(2024)Embodied Acts for Testing Mixed Reality Low-Fidelity Prototypes that Convey Intangible Cultural Heritage: Method and Case StudyVirtual Reality and Mixed Reality10.1007/978-3-031-78593-1_3(36-49)Online publication date: 27-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-78593-1_3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents