I Light U Up: Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences
Authors: 
Zhen Wu, Ruoyu Wen, 
Marcel Zaes Sagesser, Sum Yi Ma, Jiashuo Xian, Wenda Wu, Tristan BraudAuthors Info & Claims
Zhen Wu, Ruoyu Wen, Marcel Zaes Sagesser, Sum Yi Ma, Jiashuo Xian, Wenda Wu, Tristan BraudAuthors Info & ClaimsArticle No.: 22, Pages 1 - 9
Abstract
This paper introduces "I Light U Up", an interactive installation that explores the use of light as input for emergent narrative powered by LLM. Through an installation with light sensors, the audience uses light to communicate with the parallel digital beings, generating a narrative experience that emerges from the interaction. This work serves as a proof-of-concept, supporting a conceptual framework that aims to open new perspectives on the participation of physical data in emergent narrative experiences. It seeks to develop a new dimension in contrast to the text-centric one-way relationship between reader and story by including agency beyond human interactivity.
Supplemental Material
MP4 File
Video Demonstration
- Download
- 81.64 MB
References
[1]
Hume AI. 2024. Hume AI: Building Empathetic AI Systems. https://www.hume.ai/ Accessed: 2024-06-29.
[2]
Ruth Aylett. 1999. Narrative in virtual environments-towards emergent narrative. In Proceedings of the AAAI fall symposium on narrative intelligence. USA, 83–86.
[3]
Purav Bhardwaj and Misha Sra. 2023. Ghost in the Machine: Discourses with AI. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 6, 6 pages.
[4]
Shira Chess. 2014. Augmented regionalism: Ingress as geomediated gaming narrative. Information, Communication & Society 17, 9 (2014), 1105–1117.
[5]
Michele Geronazzo and Stefania Serafin (Eds.). 2023. Sonic Interactions in Virtual Environments. Springer Nature. Accepted: 2022-11-18T14:20:06Z.
[6]
Craig Paul Green. 2020. Finite State Machines and Live Emergent Narrative Theatre. In AI4Narratives@IJCAI. https://api.semanticscholar.org/CorpusID:231886303
[7]
Daniel Harley, Jean Ho Chu, Jamie Kwan, and Ali Mazalek. 2016. Towards a framework for tangible narratives. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. 62–69.
[8]
Hartmut Koenitz, Gabriele Ferri, Mads Haahr, Diğdem Sezen, and Tonguç İbrahim Sezen. 2015. Interactive digital narrative. History, Theory and Practice (2015).
[9]
Ludeon Studios. 2018. RimWorld. Digital game available at Steam Store. https://store.steampowered.com/app/294100/RimWorld/
[10]
Michael Mateas and Andrew Stern. 2005. Façade. (2005).
[11]
Ali Mazalek, Claudia Winegarden, Tristan Al-Haddad, Susan J Robinson, and Chih-Sung Wu. 2009. Architales: physical/digital co-design of an interactive story table. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. 241–248.
[12]
Nick Montfort. 2000. Ad Verbum. https://ifdb.org/viewgame?id=xi4s5ne9m6w821xd.
[13]
Takafumi Morita and Yasuaki Kakehi. 2023. see-saw: A Kinetic Installation that Unfolds in Silence Driven by Liquid Flow. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 10, 6 pages.
[14]
OpenAI. 2024a. ChatGPT. https://chatgpt.com/ Accessed: 2024-06-21.
[15]
OpenAI. 2024b. Hello, GPT-4o. https://openai.com/index/hello-gpt-4o/ Accessed: 2024-06-29.
[16]
panGenerator. 2013. Constellaction. https://pangenerator.com/projects/constellaction/.
[17]
Bojana Petkovic. 2016. Swamp Orchestra. https://sonicfield.org/bojana-petkovic-swamp-orchestra/.
[18]
Uwe Rieger, Yinan Liu, Tharindu Kaluarachchi, Amit Barde, Huidong Bai, Alaeddin Nassani, Suranga Nanayakkara, and Mark Billinghurst. 2023. LightSense - Long Distance. In SIGGRAPH Asia 2023 Art Gallery (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 13, 2 pages.
[19]
Ken Rinaldo. 2000. Autopoiesis. https://www.kenrinaldo.com/portfolio/autopoiesis/.
[20]
James A Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6 (1980), 1161.
[21]
Marie-Laure Ryan. 2009. From Narrative Games to Playable Stories: Toward a Poetics of Interactive Narrative. Storyworlds: A Journal of Narrative Studies 1 (2009), 43–59. http://www.jstor.org/stable/25663007
[22]
Jennifer Seevinck. 2017. Emergence in interactive art. Springer.
[23]
Yang Ting Shen and Ali Mazalek. 2010. PuzzleTale: A Tangible Puzzle Game for Interactive Storytelling. ACM Computers in Entertainment (CIE) 8, 2 (2010), 11.
[24]
Yuqian Sun, Zhouyi Li, Ke Fang, Chang Hee Lee, and Ali Asadipour. 2023a. Language as reality: a co-creative storytelling game experience in 1001 nights using generative AI. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 19. 425–434.
[25]
Yuqian Sun, Yuying Tang, Ze Gao, Zhijun Pan, Chuyan Xu, Yurou Chen, Kejiang Qian, Zhigang Wang, Tristan Braud, Chang Hee Lee, and Ali Asadipour. 2023b. AI Nüshu: An Exploration of Language Emergence in Sisterhood Through the Lens of Computational Linguistics. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 4, 7 pages.
[26]
Dave Szulborski. 2005. This is not a game: A guide to alternate reality gaming. Incunabula.
[27]
Richard Walsh. 2011. Emergent narrative in interactive media. Narrative 19, 1 (2011), 72–85.
[28]
Hao Wang and Chuen-Tsai Sun. 2011. Game reward systems: Gaming experiences and social meanings. In Proceedings of DiGRA 2011 Conference: Think Design Play.
[29]
Daniel White. 2021. “A Magic Beyond All We Do Here”: Musical and Sonic Worldbuilding at Harry Potter Tourist Attractions. InMedia. The French Journal of Media Studies9.1. (Jan. 2021). Number: 9.1. Publisher: Institut du monde anglophone.
[30]
Andrew Yip. 2023. The Garden of Unearthly Delights. In SIGGRAPH Asia 2023 Art Gallery (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 21, 2 pages.
Recommendations
Awash: Prospective Story Sifting Intervention for Emergent Narrative
Interactive StorytellingAbstractEmergent Narrative (EN) affords extensive agency to participants but conflicts with the desire to guarantee compelling narrative. Recent work presents story sifting, an approach that curates simulation output, believing that intervention ...
A Coauthorship-Centric History of Interactive Emergent Narrative
Interactive StorytellingAbstractWe trace the history of emergent narrative as both a term and a concept, with a particular focus on interactive emergent narrative (IEN): the use of emergent narrative as an approach or solution to the problems presented by the combination of ...
Towards a narrative theory of virtual reality
Virtual Reality (VR), by its nature and characteristics, is of specific interest to the AI community, particularly in the domains of Storytelling and Intelligent Characters. We argue that VR must be considered a particular narrative medium alongside ...
Comments
Information & Contributors
Information
Published In
December 2024
194 pages
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 November 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SA '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 178 of 869 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 404Total Downloads
- Downloads (Last 12 months)404
- Downloads (Last 6 weeks)35
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format