Abstract
This paper explores museum musical instrument exhibits’ current status and development trends. It highlights the importance of multi-sensory interaction for the museum experience, especially for musical instrument exhibits. Based on existing literatures and case studies, the strengths and weaknesses of current musical instrument exhibit interaction forms are analyzed, and the possibility of applying intelligent replicas to museum musical instrument interaction is proposed. This project produced an interactive prototype in which a physical model of chimes is embedded in a digital component that serves as an interface to control the delivery of virtual instrument sounds and animation effects on screen. The aim is to restore the functionality of the chimes as musical instruments by representing their visual, acoustic, and in some cases, tactile characteristics to visitors through physical interaction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bennett, T.: Civic seeing: museums and the organization of vision. Companion Museum Stud. 263 (2006). https://doi.org/10.1002/9780470996836.ch16
International Council of Museums: Museum Definition. https://icom.museum/en/resources/standards-guidelines/museum-definition/. Accessed 15 June 2022
Graham, H.C.: The ‘co’in co-production: museums, community participation and science and technology studies. Sci. Museum Group J. 5 (2016)
de Visscher, E.: Sound in Museums. https://www.vam.ac.uk/blog/news/sound-in-museums-by-eric-de-visscher-vari-visiting-professor. Accessed 13 Jan 2022
Dal Falco, F., Vassos, S.: Museum experience design: a modern storytelling methodology. Des. J. 20, S3975–S3983 (2017). https://doi.org/10.1080/14606925.2017.1352900
Simon, N.: The Participatory Museum (Museum 2.0). http://www.participatorymuseum.org
Vermeeren, A.P., et al.: Future Museum Experience Design: Crowds, Ecosystems and Novel Technologies. Springer (2018)
Liu, M., Yu, X.: Perception and interaction: enhancement of museum interactive experience. Furniture Interiors 29, 61–65 (2022). https://doi.org/10.16771/j.cn43-1247/ts.2022.03.013
Dierking, L.D., Falk, J.H.: Redefining the museum experience: the interactive experience model. Visitor Studies. 4, 173–176 (1992)
Larsen, S.: Aspects of a psychology of the tourist experience. Scand. J. Hosp. Tour. 7, 7–18 (2007). https://doi.org/10.1080/15022250701226014
Falk, J.H.: Identity and the Museum Visitor Experience. Routledge (2016)
Wang, Q., Lei, Y.: Minds on for the wise: rethinking the contemporary interactive exhibition. Museum Manag. Curatorship. 31, 331–348 (2016). https://doi.org/10.1080/09647775.2016.1173575
Fahy, A.: New technologies for museum communication. In: Museum, Media, Message, pp. 82–96 (1995)
Guo, W., et al.: The rebirth of traditional musical instrument: an interactive installation based on augmented reality and somatosensory technology to empower the exhibition of chimes. Comput. Anim. Virtual Worlds e2171 (2023). https://doi.org/10.1002/cav.2171
O’dell, T.: Tourist experiences and academic junctures. Scand. J. Hospitality Tourism. 7, 34–45 (2007)
Guo, W., Li, S., Zhang, Z., Chen, Z., Chang, KH., Wang, S.: A magic world for children: design and development of a serious game to improve spatial ability. Comput. Anim. Virtual Worlds e2181 (2023). https://doi.org/10.1002/cav.2181
Edwards, E., Gosden, C., Phillips, R.: Sensible Objects: Colonialism, Museums and Material Culture. Berg (2006)
Kannenberg, J.: Towards a more sonically inclusive. Sci. Museum Group J. 8 (2017)
Baumgartner, T., Esslen, M., Jäncke, L.: From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int. J. Psychophysiol. 60, 34–43 (2006). https://doi.org/10.1016/j.ijpsycho.2005.04.007
Jelinčić, D.A., Šveb, M., E. Stewart, A.: Designing sensory museum experiences for visitors’ emotional responses. Museum Manag. Curatorship. 37, 513–530 (2022).https://doi.org/10.1080/09647775.2021.1954985
Pine, B.J., Gilmore, J.H.: Welcome to the Experience Economy. Harvard Business Review Press (1998)
Jelinčić, D.A., Senkić, M.: Creating a heritage tourism experience. the power of the senses. In: Etnološka tribina, pp. 109–126 (2017). https://doi.org/10.15378/1848-9540.2017.40.03
Bubaris, N.: Sound in museums–museums in sound. Museum Manag. Curatorship. 29, 391–402 (2014). https://doi.org/10.1080/09647775.2014.934049
Everrett, T.: A curatorial guide to museum sound design. Curator Museum J. 62, 313–325 (2019). https://doi.org/10.1111/cura.12305
Boon, T., Jamieson, A., Kannenberg, J., Kolkowski, A., Mansell, J.: Organising sound: how a research network might help structure an exhibition (2017)
Mansell, J., De Little, A., Jamieson, A.: Staging listening. Sci. Museum Group J. 17 (2022). https://doi.org/10.15180/221704
Gardo, K., Lukasik, E.: VClav 2.0 – system for playing 3D virtual copy of a historical clavichord. In: Shumaker, R. (ed.) VMR 2011. LNCS, vol. 6774, pp. 141–150. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22024-1_16
Lukasik, E., Materski, M.: Sonification of A Virtual Model of the Old Rare Musical Instrument. Presented at the (2013)
Birley, M., Eichler, H., Myers, A.: Voices for the silenced: Guidelines for interpreting musical instruments in museum collections. Edinburgh: CIMCIM (1998)
de Visscher, E.: Sound in Museums (2): What About Musical Instruments?. https://www.vam.ac.uk/blog/projects/sound-in-museums-2-what-about-musical-instruments. Accessed 13 Jan 2022
Leonard, J., Cadoz, C.: Physical modelling concepts for a collection of multisensory virtual musical instruments. In: New Interfaces for Musical Expression 2015, pp. 150–155 (2015)
Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 437–446 (2006). https://doi.org/10.1145/1124772.1124838
Marshall, M.T., Dulake, N., Ciolfi, L., Duranti, D., Kockelkorn, H., Petrelli, D.: Using tangible smart replicas as controls for an interactive museum exhibition. In: Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, pp. 159–167 (2016). https://doi.org/10.1145/2839462.2839493
Wang, L.: Common Sense of Ancient Chinese Culture, 4th edn. Beijing United Publishing Company, Beijing (2015)
Pi, S., Yu, P.: Observation: New discovery of Chu chimes. http://www.xinhuanet.com/politics/2018-06/19/c_1123000865.htm. Accessed 15 June 2022
Acknowledgements and Funding Information
This research was supported by 2022 Humanities and Social Sciences Youth Fund Program of the Ministry of Education “Research on the innovation of immersive interactive experience mode with the integration of reality and imagination” (No. 22YJC760019).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, Y. et al. (2023). Multi-sensory Interactive Experience Design of Museum Musical Instrument Collections. In: Mori, H., Asahi, Y., Coman, A., Vasilache, S., Rauterberg, M. (eds) HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14056. Springer, Cham. https://doi.org/10.1007/978-3-031-48044-7_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-48044-7_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48043-0
Online ISBN: 978-3-031-48044-7
eBook Packages: Computer ScienceComputer Science (R0)