Nature: Metaphysics + Metaphor (N:M+M): Exploring Persistence, Feedback, and Visualisation in Mixed Reality Performance Arts.
Authors: 
Tristan Braud, Brian Lau, Dominie Hoi Lam Chan, Chun Ming Wu, Zhen Wu, Vi Jun Sean Yong, Kirill ShatilovAuthors Info & Claims
Tristan Braud, Brian Lau, Dominie Hoi Lam Chan, Chun Ming Wu, Zhen Wu, Vi Jun Sean Yong, Kirill ShatilovAuthors Info & ClaimsArticle No.: 9, Pages 1 - 7
Abstract
Nature: Metaphysics + Metaphor (N:M+M) is an art experience and exhibition that explores the intersection of Nature, Art, Man, and Technology. This immersive experience aims to bridge physical and digital, tangible and intangible, and ephemeral and persistent in mixed reality arts through new interaction and visualization methods. The performance was presented in front of an audience of 50 people, during which the artists constructed a physical-digital artwork that became part of a subsequent exhibition. This paper describes the rationale, creative approach, and technical contribution behind this work while reflecting on audience feedback and future directions.
References
[1]
Adobe. 2018. How Artists Are Shaping the Future of Augmented Reality. https://www.youtube.com/watch?v=F9-PMm6YdUU.
[2]
AΦE Company. 2018. 0AR. https://aoiesteban.com/.
[3]
Vaidehi Bhargava. 2022]. Tech Circus conference: ‘Enter the Metaverse’ @ Broadgate, London. https://www.vaidehiart.net/live-vr-art-performances.
[4]
dezeen. 2015. Bioluminescent Forest glimmers with projection-mapped light. https://www.dezeen.com/2015/01/21/bioluminescent-forest-tarek-mawad-friedrich-van-schoor-projection-mapped-light-trees-mushrooms-glimmer-glow-illuminate/.
[5]
Eyeworks Film. [n. d.]. Visite A Picasso - Full Movie. https://www.youtube.com/watch?v=jyaPbReAumw.
[6]
Max Hattler. 2012. X. https://www.maxhattler.com/x/.
[7]
Tim Ingold. 2010. The textility of making. Cambridge journal of economics 34, 1 (2010), 91–102.
[8]
Valencia James, Thomas Wester, Simon Boas, Holly Newlands, Marin Vesely, Sandrine Malary, and Terri Ayanna Wright. 2021. Suga’: A Live Virtual Dance Performance. In ACM SIGGRAPH 2021 Art Gallery (Virtual Event, USA). New York, USA, Article 12, 5 pages.
[9]
Helen Kennedy and Sarah Atkinson. 2018. Extended reality ecosystems: Innovations in creativity and collaboration in the theatrical arts. Refractory: A Journal of Entertainment Media 30, 10 (2018).
[10]
Rosalind Krauss. 1979. Sculpture in the expanded field. October 8 (1979), 31–44.
[11]
Matthew Kyan, Guoyu Sun, Haiyan Li, Ling Zhong, Paisarn Muneesawang, Nan Dong, Bruce Elder, and Ling Guan. 2015. An Approach to Ballet Dance Training through MS Kinect and Visualization in a CAVE Virtual Reality Environment. ACM Trans. Intell. Syst. Technol. 6, 2, Article 23 (mar 2015), 37 pages.
[12]
Chara Lewis, Kristin Mojsiewicz, and Anneke Pettican. 2022. Erratics on the Road to Wigan Pier: The Creation of TouchAR. Proc. ACM Comput. Graph. Interact. Tech. 5, 4, Article 40 (sep 2022), 10 pages.
[13]
Juhani Pallasmaa. 2012. The eyes of the skin: Architecture and the senses. John Wiley & Sons.
[14]
Giovanni Santini. 2024. A Case Study in XR Live Performance. In International Conference on Extended Reality. Springer, 286–300.
[15]
Kirill Shatilov, Ahmad Alhilal, Tristan Braud, Lik-Hang Lee, Pengyuan Zhou, and Pan Hui. 2023. Players Are Not Ready 101: A Tutorial on Organising Mixed-Mode Events in the Metaverse(MetaSys ’23). New York, USA, 14–20.
[16]
Stevan Silva. 2022. Gorillaz turn the world into a stage with augmented reality. https://blog.google/products/google-ar-vr/gorillaz-maps-music-video/.
[17]
Michael Spitzer. 2021. The Musical Human: A History of Life on Earth–A BBC Radio 4’Book of the Week’. Bloomsbury Publishing.
[18]
Zelia ZZ Tan. 2022. Accelerating Dimension. https://www.westkowloon.hk/en/phygitald_zeliazztan?tab=overview.
[19]
teamLab. 2024. A Forest where Gods Live. https://www.teamlab.art/e/mifuneyamarakuen/.
[20]
Charlotte Triebus, Christian Geiger, and Ivana Družetić-Vogel. 2022. kin_–An AR Dance Performance with Believable Avatars. ISEA International.
[21]
Lao Tzu. 2020. Tao te ching. Courier Dover Publications.
[22]
Anna Zhilyaeva. 2019. Virtual reality painting performance WorldSkills 2019 opening, Kazan. https://youtu.be/iSXG8zVtsa0?feature=shared.
Recommendations
Cinema Meowdiso: Films Co-Created by Human, Large Language Models and a Cat
SA '24: SIGGRAPH Asia 2024 Art PapersCinema Meowdiso is a system that utilizes generative AI to transform daily footage captured by pets into short films across various genres. This project explores the potential of non-human entities as narrative agents and examines how AI can autonomously ...
AI-rays: Exploring Bias in the Gaze of AI Through a Multimodal Interactive Installation
SA '24: SIGGRAPH Asia 2024 Art PapersData surveillance has become more covert and pervasive with AI algorithms, which can result in biased social classifications. Appearance offers intuitive identity signals, but what does it mean to let AI observe and speculate on them? We introduce AI-rays,...
I Light U Up: Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences
SA '24: SIGGRAPH Asia 2024 Art PapersThis paper introduces "I Light U Up", an interactive installation that explores the use of light as input for emergent narrative powered by LLM. Through an installation with light sensors, the audience uses light to communicate with the parallel digital ...
Comments
Information & Contributors
Information
Published In
December 2024
194 pages
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 November 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SA '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 178 of 869 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 197Total Downloads
- Downloads (Last 12 months)197
- Downloads (Last 6 weeks)33
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format