Gerard T. Mulvany
ABSTRACT
Immersive theatre is a highly interactive format that raises the audience's agency over their experience, and, depending on their actions, provides each member with their own understanding of the overarching narrative that developed based on the spatial path they undertook. This theatre format challenges traditional theatre digitisation techniques as current archiving and reproduction methods cannot authentically replicate the affordances (or ‘actions possible’) that audiences have in the original performance. Theatres need to explore new methods of digitisation and archiving, to preserve past experiences and cater to an audience who will access content digitally. This report documents the design decisions and their impact for the interactive prototype digitisation and archival of the 2021 immersive-theatre production “Because the Night” for a digital audience. This interactive digital archive utilises game design and game engine technology to map and transfer the affordances of audiences from the original immersive theatre play to a digital platform, leveraging the game engine's innate affordances, including freedom of movement, spatialised audio, and user intractability. To deliver these research outcomes, the project captured 360-degree video of the performance, music, images of props, and 360-degree photographs of the set, all embedded into a game engine system to authentically preserve the immersive, interactive, and ambient experience of the original production. The resulting system was able to successfully map several of the performances original affordances, including environmental exploration, spatially emergent narratives, object inspection and exploration, and interactive environmental challenges. This document reports on three matters: the design process and decisions to authentically capture the affordances of the theatre production in a digital gameplay experience; the current status of this research project; and the proposed approach to testing the prototype with users.
Supplemental Material
Available for Download
- Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., & Weaver, J. (2010). Google street view: Capturing the world at street level. Computer, 43(6). https://doi.org/10.1109/MC.2010.170Google Scholar
Digital Library
- Apollonio, F. I., Fantini, F., Garagnani, S., & Gaiani, M. (2021). A photogrammetry-based workflow for the accurate 3d construction and visualization of museums assets. Remote Sensing, 13(3). https://doi.org/10.3390/rs13030486Google Scholar
- Biggin, R. (2017). Immersive theatre and audience experience: Space, game and story in the work of punchdrunk. In Immersive Theatre and Audience Experience: Space, Game and Story in the Work of Punchdrunk. https://doi.org/10.1007/978-3-319-62039-8Google Scholar
- Brady, S., Cerniglia, K., Chach, M., Edwards, B., Green, J., Koffler, H., Lehner, S., & Nixon, T. (2021). Preserving Theatrical Legacy An Archiving Manual for Theatre Companies. www.tcg.orgGoogle Scholar
- L. (2006). Practice Based Research: A Guide. CCS Report, 1.Google Scholar
- Cardona-Rivera, R. E., & Young, R. M. (2013). A cognitivist theory of affordances for games. DiGRA 2013 - Proceedings of the 2013 DiGRA International Conference: DeFragging GameStudies.Google Scholar
- Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.). English Language Teaching, 12(5).Google Scholar
- Epic Games Inc. (2021, July 14). Casting in Blueprints. Unreal Engine Documentation. https://docs.unrealengine.com/4.26/en-US/ProgrammingAndScripting/Blueprints/UserGuide/CastNodes/Google Scholar
- Fairfax Media Publications Pty Limited, 2021. (2021, January 20). Be amazed: Malthouse immerses audience. The Age (Melbourne, Australia), 15. https: //ezproxy.deakin.edu.au/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=edsgao&AN=edsgcl.648997995&site=eds-live&scope=siteGoogle Scholar
- J. J. (1979). The ecological approach to visual perception: classic edition. In Journal of Broadcasting (Vol. 28, Issue 1).Google Scholar
- Greuter, S., Kenderdine, S., & Shaw, J. (2018). Pure Land UNWIRED: New approaches to virtual reality for heritage at risk. In Virtual and Augmented Reality: Concepts, Methodologies, Tools, and Applications (Vol. 3). https://doi.org/10.4018/978-1-5225-5469-1.ch079Google ScholarCross Ref
- Grothe, B., Pecka, M., & McAlpine, D. (2010). Mechanisms of sound localization in mammals. In Physiological Reviews (Vol. 90, Issue 3). https://doi.org/10.1152/physrev.00026.2009Google ScholarCross Ref
- Hartmann, T., & Klimmt, C. (2006). Gender and computer games: Exploring females’ dislikes. Journal of Computer-Mediated Communication, 11(4). https://doi.org/10.1111/j.1083-6101.2006.00301.xGoogle Scholar
- insta360.com. (2019). Insta360 Titan – Professional 360 VR 3D Camera | 11K Capture. https://www.insta360.com/product/insta360-titanGoogle Scholar
- , M., & Hoppe, H. (2013). Screened poisson surface reconstruction. ACM Transactions on Graphics, 32(3). https://doi.org/10.1145/2487228.2487237Google ScholarDigital Library
- Koskinen, I., Zimmerman, J., Binder, T., Redstrom, J., & Wensveen, S. (2011). Design Research Through Practice: From the Lab, Field, and Showroom. Elsevier Science. https://books.google.com.au/books?id=oCcIRKi3T20CGoogle ScholarDigital Library
- Lewis, C. H. (1982). Using the “Thinking Aloud” Method In Cognitive Interface Design (Technical report). IBM. RC-9265.Google Scholar
- Norman, D. A. (2013). The Design of Everyday Things, Expanded and Revised Edition. In Human Factors and Ergonomics in Manufacturing.Google Scholar
- Perron, B. (2006). The Heuristic Circle of Gameplay: the Case of Survival Horror. Gaming Realities. A Challenge for Digital Culture.Google Scholar
- Rohr, A., Werth, K., Shen, X., Collins, Z., Fishback, S., Jones, J., Ash, R., & Williams, V. (2018). Rules of Play - Game Design Fundamentals Katie Salen and Eric Zimmerman The. Abdominal Radiology.Google Scholar
- White, G. (2012). On immersive theatre. Theatre Research International, 37(3). https://doi.org/10.1017/S0307883312000880Google Scholar
Index Terms
- Because the Night - Immersive Theatre for Digital Audiences:: Mapping the affordances of immersive theatre to digital interactions using game engines
Recommendations
Analogue and digital immersive experiences: what should digital creators learn from live theatre makers?
EVA '18: Proceedings of the Conference on Electronic Visualisation and the ArtsIn every century, there are different apparatuses that are redefining and refining the notion of immersion. After experiencing panoramas, planetariums or even IMAX movies, we are now longing to see whether VR can really fulfil our expectations. We are ...
Engaging theatre audiences before the play: the design of playful interactive storytelling experiences
Inputs-Outputs '13: Proceedings of the 2013 Inputs-Outputs Conference: An Interdisciplinary Conference on Engagement in HCI and PerformanceIn this paper I present Mobile Stories, a design-led project that explored ways of playfully motivating and engaging theatre audiences in their journey before the premiere of a theatrical play. The project used the art of storytelling and mobile ...
Haptic reassurance in the pitch black for an immersive theatre experience
UbiComp '11: Proceedings of the 13th international conference on Ubiquitous computingAn immersive theatre experience was designed to raise awareness and question perceptions of 'blindness', through enabling both sighted and blind members to experience a similar reality. A multimodal experience was created, comprising ambient sounds and ...
Comments