skip to main content
10.1145/3643834.3660711acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

"Being Eroded, Piece by Piece": Enhancing Engagement and Storytelling in Cultural Heritage Dissemination by Exhibiting GenAI Co-Creation Artifacts

Published: 01 July 2024 Publication History

Abstract

Cultural Heritage is not just about tangible artifacts; it also includes intangible elements such as personal memories, community ties, and envisioned futures. Traditional museums and archives often emphasize physical items like architectural pieces and photos, while overlooking people’s personal and emotional connections to cultural heritage. To illustrate the personal connections people have with cultural heritage sites, we designed an exhibition that displayed images created by participants, which represent their perspectives and future visions of cultural heritage sites. The exhibition’s images, generated through GenAI, helped participants narratively describe cultural heritage locations, allowing them to express their visions of future threats like over-tourism and climate change on these sites. Contrary to constraints, co-creating with Generative AI associates participants with personal memories of cultural heritage, stimulating personal narratives and promoting deep reflection on cultural heritage preservation. The dissemination strategies we designed illustrate the use of GenAI to empower the expression of matters of cultural value beyond the physical.

References

[1]
2022. Inseparable Ties: Cohesion as Told by Hong Kong Historic Buildings" exhibition opens. https://www.info.gov.hk/gia/general/202211/09/P2022110900138.htm. Accessed: 2024-01-20.
[2]
[2] 2023. https://pragmatika.media/en/khramy-mystetstv-istoriia-rozvytku-ukrainskykh-opernykh-teatriv/
[3]
2023. We are Living Heritage - Photo exhibition for the 20th anniversary of the Convention for the Safeguarding of the Intangible Cultural Heritage. https://ich.unesco.org/en/we-are-living-heritage-photo-exhibition-2023-01331. Accessed: 2024-01-20.
[4]
2024. Tell your living heritage story - Interviews with participants at the UNESCO Youth Forum (audio-visual exhibition). https://ich.unesco.org/en/tell-your-living-heritage-story-2018-01002. Accessed: 2024-01-20.
[5]
Dickson Adom. 2016. Inclusion of Local People and Their Cultural Practices in Biodiversity Conservation: Lessons from Successful Nations. American Journal of Environmental Protection 4 (2016), 67–78. https://api.semanticscholar.org/CorpusID:157586522
[6]
Ajay Bandi, Pydi Venkata Satya Ramesh Adapa, and Yudu Eswar Vinay Pratap Kumar Kuchi. 2023. The power of generative ai: A review of requirements, models, input–output formats, evaluation metrics, and challenges. Future Internet 15, 8 (2023), 260.
[7]
Hritik Bansal, Da Yin, Masoud Monajatipoor, and Kai-Wei Chang. 2022. How well can text-to-image generative models understand ethical natural language interventions?arXiv preprint arXiv:2210.15230 (2022).
[8]
Jesse Josua Benjamin, Arne Berger, Nick Merrill, and James Pierce. 2021. Machine learning uncertainty as a design material: a post-phenomenological inquiry. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.
[9]
Ruha Benjamin. 2019. Race after technology: Abolitionist tools for the new Jim code. John Wiley & Sons.
[10]
Charlotte Bird, Eddie Ungless, and Atoosa Kasirzadeh. 2023. Typology of risks of generative text-to-image models. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 396–410.
[11]
Kirsten Boehner, Jennifer Thom-Santelli, Angela Zoss, Geri Gay, Justin S Hall, and Tucker Barrett. 2005. Imprints of place: creative expressions of the museum experience. In CHI’05 extended abstracts on Human factors in computing systems. 1220–1223.
[12]
Lee Bosher, Dowon Kim, Takeyuki Okubo, Ksenia Chmutina, and Rohit Jigyasu. 2020. Dealing with multiple hazards and threats on cultural heritage sites: an assessment of 80 case studies. Disaster Prevention and Management: An International Journal 29, 1 (2020), 109–128.
[13]
Bowwe. 2023. Guide to Mid-Journey Prompts. https://bowwe.com/en/blog/guide-to-midjourney-prompts Accessed: 2023-09-11.
[14]
Vivien Cabannes, Thomas Kerdreux, Louis Thiry, Tina Campana, and Charly Ferrandes. 2019. Dialog on a canvas with a machine. arXiv preprint arXiv:1910.04386 (2019).
[15]
Jiaxun Cao, Qingyang He, Zhuo Wang, RAY LC, and Xin Tong. 2023. DreamVR: curating an interactive exhibition in social VR through an autobiographical design study. In Proceedings of the 2023 CHI conference on human factors in computing systems. 1–18.
[16]
Li-Yuan Chiou, Peng-Kai Hung, Rung-Huei Liang, and Chun-Teng Wang. 2023. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 1941–1954.
[17]
Nuno Correia, Tarquínio Mota, Rui Nóbrega, Luís Silva, and Andreia Almeida. 2010. A multi-touch tabletop for robust multimedia interaction in museums. In ACM International Conference on Interactive Tabletops and Surfaces. 117–120.
[18]
Dan Cosley, Joel Lewenstein, Andrew Herman, Jenna Holloway, Jonathan Baxter, Saeko Nomura, Kirsten Boehner, and Geri Gay. 2008. ArtLinks: fostering social awareness and reflection in museums. In Proceedings of the SIGCHI conference on human factors in computing systems. 403–412.
[19]
Hai Dang, Lukas Mecke, Florian Lehmann, Sven Goller, and Daniel Buschek. 2022. How to prompt? Opportunities and challenges of zero-and few-shot learning for human-AI interaction in creative applications of generative models. arXiv preprint arXiv:2209.01390 (2022).
[20]
Anthony Dunne and Fiona Raby. 2013. Speculative everything: design, fiction, and social dreaming. MIT press.
[21]
Ciarán Dunne. 2011. The place of the literature review in grounded theory research. International journal of social research methodology 14, 2 (2011), 111–124.
[22]
Daniele Duranti, Davide Spallazzo, Raffaella Trocchianesi, 2016. Tangible interaction in museums and temporary exhibitions: embedding and embodying the intangible values of cultural heritage. In SYSTEMS & DESIGN BEYOND PROCESSES AND THINKING 2016. PROCEEDINGS. EDITORIAL UNIVERTITAT POLITÈCNICA DE VALÈNCIA, 160–171.
[23]
Prompt Engineering. 2023. Midjourney vs DALL-E 2: Same Prompt, Different Output. https://www.promptengineering.org/midjourney-vs-dall-e-2-same-prompt-different-output/ Accessed: 2023-09-11.
[24]
Ziv Epstein, Hope Schroeder, and Dava Newman. 2022. When happy accidents spark creativity: Bringing Collaborative Speculation to life with generative AI. arXiv preprint arXiv:2206.00533 (2022).
[25]
Kexue Fu, Yixin Chen, Jiaxun Cao, Xin Tong, and RAY LC. 2023. " I Am a Mirror Dweller": Probing the Unique Strategies Users Take to Communicate in the Context of Mirrors in Social Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–19.
[26]
Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: cultural probes. interactions 6, 1 (1999), 21–29.
[27]
National Geographic. 2019. Many historic icons face the same threats as Notre Dame Cathedral. https://www.nationalgeographic.com/culture/article/many-historic-icons-face-same-threats-notre-dame-cathedral
[28]
Maurice Halbwachs. 1992. On collective memory University of Chicago Press. Chicago IL (1992).
[29]
Kyungsik Han, Patrick C Shih, Mary Beth Rosson, and John M Carroll. 2014. Enhancing community awareness of and participation in local heritage with a mobile application. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 1144–1155.
[30]
Douglas Harper. 1986. Meaning and work: A study in photo elicitation. Current sociology 34, 3 (1986), 24–46.
[31]
Douglas Harper. 2002. Talking about pictures: A case for photo elicitation. Visual studies 17, 1 (2002), 13–26.
[32]
Think Global Heritage. 2017. The Disappearing Chinese Ancient Buildings. https://thinkglobalheritage.wordpress.com/2017/11/25/the-disappearing-chinese-ancient-buildings/
[33]
Matthew K Hong, Shabnam Hakimi, Yan-Ying Chen, Heishiro Toyoda, Charlene Wu, and Matt Klenk. 2023. Generative AI for Product Design: Getting the Right Design and the Design Right. arXiv preprint arXiv:2306.01217 (2023).
[34]
Youngseung Jeon, Seungwan Jin, Patrick C Shih, and Kyungsik Han. 2021. FashionQ: an ai-driven creativity support tool for facilitating ideation in fashion design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.
[35]
Lamia Joreige. 2024. Objects of War No. 4. https://www.tate.org.uk/art/artworks/joreige-objects-of-war-no-4-t13250. Accessed: 2024-01-20.
[36]
Jae-Shin Kang. 2017. Application method of cultural heritage contents exhibition combining augmented reality technology. Journal of the Korea Convergence Society 8, 5 (2017), 137–143.
[37]
Sarah Kenderdine, Leith KY Chan, and Jeffrey Shaw. 2014. Pure land: futures for embodied museography. Journal on Computing and Cultural Heritage (JOCCH) 7, 2 (2014), 1–15.
[38]
G. Khan. 2023. Will AI-generated images create a new crisis for fact-checkers? Experts are not so sure. Reuters Institute. Volume 11.
[39]
Jeongyeon Kim, Sangho Suh, Lydia B Chilton, and Haijun Xia. 2023. Metaphorian: Leveraging Large Language Models to Support Extended Metaphor Creation for Science Writing. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 115–135.
[40]
Hyung-Kwon Ko, Gwanmo Park, Hyeon Jeon, Jaemin Jo, Juho Kim, and Jinwook Seo. 2023. Large-scale text-to-image generation models for visual artists’ creative works. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 919–933.
[41]
RAY LC. 2023. HUMAN ENOUGH: A Space for Reconstructions of AI visions in Speculative Climate Futures. In Proceedings of the 15th Conference on Creativity and Cognition. 217–222.
[42]
RAY LC, Sijia Liu, and Qiaosheng Lyu. 2023. IN/ACTive: A Distance-Technology-Mediated Stage for Performer-Audience Telepresence and Environmental Control. In Proceedings of the 31st ACM International Conference on Multimedia. 6989–6997.
[43]
Yu-Hsu Lee and Chun-Yao Chiu. 2023. The Impact of AI Text-to-Image Generator on Product Styling Design. In International Conference on Human-Computer Interaction. Springer, 502–515.
[44]
Yanheng Li, Lin Luoying, Xinyan Li, Yaxuan Mao, and Ray Lc. 2023. " Nice to meet you!" Expressing Emotions with Movement Gestures and Textual Content in Automatic Handwriting Robots. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. 71–75.
[45]
Lauren Lin and Duri Long. 2023. Generative AI Futures: A Speculative Design Exploration. In Proceedings of the 15th Conference on Creativity and Cognition. 380–383.
[46]
HUGH XUECHEN LIU, YUXUAN HUANG, and JUSSI HOLOPAINEN. 2023. How to use Generative AI as a design material for future human-computer (co-) creation? (2023).
[47]
Hugh Xuechen LIU, Yuxuan HUANG, and Jussi Pekka HOLOPAINEN. 2023. Call for Critical and Speculative Design in Human-Computer Co-creativity: An Overview Study. In 14th International Conference on Computational Creativity (ICCC’23).
[48]
Ying Liu. 2020. Evaluating visitor experience of digital interpretation and presentation technologies at cultural heritage sites: a case study of the old town, Zuoying. Built Heritage 4, 1 (2020), 14.
[49]
Qazi Azizul Mowla. 2004. Memory association in place making: understanding an urban space. Memory 9 (2004), 52–54.
[50]
Michael Muller, Lydia B Chilton, Anna Kantosalo, Charles Patrick Martin, and Greg Walsh. 2022. GenAICHI: generative AI and HCI. In CHI conference on human factors in computing systems extended abstracts. 1–7.
[51]
Ville Paananen, Jonas Oppenlaender, and Aku Visuri. 2023. Using Text-to-Image Generation for Architectural Design Ideation. arXiv preprint arXiv:2304.10182 (2023).
[52]
Niche Pursuits. 2023. Midjourney Review. https://www.nichepursuits.com/midjourney-review/ Accessed: 2023-09-11.
[53]
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, 2021. Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748–8763.
[54]
Janet Rafner, Steven Langsford, Arthur Hjorth, Miroslav Gajdacz, Lotte Philipsen, Sebastian Risi, Joel Simon, and Jacob Sherson. 2021. Utopian or Dystopian?: using a ML-assisted image generation game to empower the general public to envision the future. In Creativity and Cognition. 1–5.
[55]
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 10684–10695.
[56]
Othman Sbai, Mohamed Elhoseiny, Antoine Bordes, Yann LeCun, and Camille Couprie. 2018. Design: Design inspiration from generative networks. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops. 0–0.
[57]
Jae-Eun Shin and Woontack Woo. 2023. How Space is Told: Linking Trajectory, Narrative, and Intent in Augmented Reality Storytelling for Cultural Heritage Sites. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
[58]
Laurajane Smith. 2015. Intangible Heritage: A challenge to the authorised heritage discourse?Revista d’etnologia de Catalunya40 (2015), 133–142.
[59]
Laurajane Smith. 2020. Emotional heritage: Visitor engagement at museums and heritage sites. Routledge.
[60]
Waag Society. 2015. https://www.mesch-project.eu/apm-feint-video/. https://www.mesch-project.eu/apm-feint-video/. Accessed on 23 April 2024.
[61]
Dirk H. R. Spennemann and Kristy Graham. 2007. The importance of heritage preservation in natural disaster situations. International Journal of Risk Assessment and Management 7 (2007), 993–1001. https://api.semanticscholar.org/CorpusID:111082212
[62]
Yuqian Sun, Ying Xu, Chenhang Cheng, Yihua Li, Chang Hee Lee, and Ali Asadipour. 2023. Explore the Future Earth with Wander 2.0: AI Chatbot Driven By Knowledge-base Story Generation and Text-to-image Model. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–5.
[63]
Jřrí Toman. 2017. The Protection of Cultural Property in Time of Armed Conflict and the Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and Transfer of Ownership of Cultural Property (Paris, 14 November 1970). https://api.semanticscholar.org/CorpusID:169892215
[64]
Violeta Tsenova, Gavin Wood, Andrea Dolfini, Annie Tindley, and David Kirk. 2020. Un-authorised view: leveraging volunteer expertise in heritage. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[65]
UNESCO. 2017. UNESCO Director-General condemns destruction of Tetrapylon and severe damage to Theatre in Palmyra. https://en.unesco.org/news/unesco-director-general-condemns-destruction-tetrapylon-and-severe-damage-theatre-palmyra
[66]
Sitong Wang, Samia Menon, Tao Long, Keren Henderson, Dingzeyu Li, Kevin Crowston, Mark Hansen, Jeffrey V Nickerson, and Lydia B Chilton. 2023. ReelFramer: Co-creating News Reels on Social Media with Generative AI. arXiv preprint arXiv:2304.09653 (2023).
[67]
Emma Waterton and Steve Watson. 2010. Culture, heritage and representation: Perspectives on visuality and the past. Ashgate Publishing, Ltd.
[68]
Di Wu, Zhiwang Yu, Nan Ma, Jianan Jiang, Yuetian Wang, Guixiang Zhou, Hanhui Deng, and Yi Li. 2023. StyleMe: Towards Intelligent Fashion Generation with Designer Style. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
[69]
Daijin Yang, Yanpeng Zhou, Zhiyuan Zhang, Toby Jia-Jun Li, and Ray LC. 2022. AI as an Active Writer: Interaction strategies with generated text in human-AI collaborative fiction writing. In Joint Proceedings of the ACM IUI Workshops, Vol. 10. CEUR-WS Team.
[70]
Shichao Zhao. 2022. Creating Futuristic Heritage Experiences: An Exploratory Co-Design Study through Design Fiction. Sustainability 14, 19 (2022), 12027.
[71]
Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, and William Yang Wang. 2022. Visualize Before You Write: Imagination-Guided Open-Ended Text Generation. arXiv preprint arXiv:2210.03765 (2022).

Cited By

View all
  • (2024)THE PRESENT IS IN THE FUTURE: Participatory Generative AI Co-Created Visions as Intangible Cultural HeritageProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687200(1-2)Online publication date: 11-Dec-2024
  • (2024)ArtAI4DS: AI Art and Its Empowering Role in Digital StorytellingEntertainment Computing – ICEC 202410.1007/978-3-031-74353-5_6(78-93)Online publication date: 1-Oct-2024
  • (2024)Ethics of Mixed Reality EntertainmentEntertainment Computing – ICEC 202410.1007/978-3-031-74353-5_23(296-304)Online publication date: 1-Oct-2024

Index Terms

  1. "Being Eroded, Piece by Piece": Enhancing Engagement and Storytelling in Cultural Heritage Dissemination by Exhibiting GenAI Co-Creation Artifacts

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference
    July 2024
    3616 pages
    ISBN:9798400705830
    DOI:10.1145/3643834
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 July 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Cultural Heritage
    2. Dissemination Strategy
    3. Exhibition Design
    4. Generative AI

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Innovation and Technology FundInnovation and Technology CommissionThe Government of the Hong Kong Special Administrative Region
    • University Grants Committee of Hong Kong : Theme-based Research Scheme

    Conference

    DIS '24
    Sponsor:
    DIS '24: Designing Interactive Systems Conference
    July 1 - 5, 2024
    Copenhagen, Denmark

    Acceptance Rates

    Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

    Upcoming Conference

    DIS '25
    Designing Interactive Systems Conference
    July 5 - 9, 2025
    Funchal , Portugal

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)828
    • Downloads (Last 6 weeks)124
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)THE PRESENT IS IN THE FUTURE: Participatory Generative AI Co-Created Visions as Intangible Cultural HeritageProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687200(1-2)Online publication date: 11-Dec-2024
    • (2024)ArtAI4DS: AI Art and Its Empowering Role in Digital StorytellingEntertainment Computing – ICEC 202410.1007/978-3-031-74353-5_6(78-93)Online publication date: 1-Oct-2024
    • (2024)Ethics of Mixed Reality EntertainmentEntertainment Computing – ICEC 202410.1007/978-3-031-74353-5_23(296-304)Online publication date: 1-Oct-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media