Asreen Rostami
ABSTRACT
Performing with technology is a complex and challenging task. Artists who use novel technologies, such as Virtual Reality, have to develop strategies of monitoring, maintenance, and recovery from errors with as minimal impact on the ongoing performance as possible. In this paper we draw on two case studies of mixed-reality performances and document strategies of Stage Managing VR Performance, Choreographing for Cables, Consistency & Charging, Improvising Interventions, and Priming Participants. We discuss how these practices expose areas ripe with potential for tool development, and how they can also be used to inform the design of interaction with other technologies, such as the Internet of Things.
Supplemental Material
- Louise Barkhuus and Chiara Rossitto. 2016. Acting with Technology: Rehearsing for Mixed-Media Live Performances. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 864–875. https://doi.org/10.1145/2858036.2858344Google Scholar
Digital Library
- Steve Benford and Gabriella Giannachi. 2011. Performing Mixed Reality. MIT Press.Google ScholarDigital Library
- Steve Benford, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, Gabriella Giannachi, Matt Adams, Nick Tandavanitj, and Ju Row Farr. 2013. Performance-Led Research in the Wild. ACM Trans. Comput.-Hum. Interact. 20, 3 (July 2013), 14:1–14:22. https://doi.org/10.1145/2491500.2491502Google ScholarDigital Library
- Steve Benford, Chris Greenhalgh, Gabriella Giannachi, Brendan Walker, Joe Marshall, and Tom Rodden. 2012. Uncomfortable Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2005–2014.Google Scholar
- Andy Crabtree, Steve Benford, Tom Rodden, Tom Rodden, Chris Greenhalgh, Martin Flintham, Rob Anastasi, Adam Drozd, Matt Adams, Ju Row-Farr, Nick Tandavanitj, Anthony Steed, and Anthony Steed. 2004. Orchestrating a Mixed Reality Game ’on the Ground’. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’04). ACM, New York, NY, USA, 391–398. https://doi.org/10.1145/985692.985742Google ScholarDigital Library
- Emily Dao, Andreea Muresan, Kasper Hornbæk, and Jarrod Knibbe. 2021. Bad Breakdowns, Useful Seams, and Face Slapping: Analysis of VR Fails on YouTube. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3411764.3445435Google ScholarDigital Library
- Nima Dehghani. 2016. Decompensation. http://www.nimadehghani.com/.Google Scholar
- Arnulf Deppermann. 2013. Multimodal Interaction from a Conversation Analytic Perspective. Journal of Pragmatics 46, 1 (Jan. 2013), 1–7. https://doi.org/10.1016/j.pragma.2012.11.014Google ScholarCross Ref
- Paul Dourish and Graham Button. 1998. On ”Technomethodology”: Foundational Relationships Between Ethnomethodology and System Design. Human–Computer Interaction 13, 4 (Dec. 1998), 395–432. https://doi.org/10.1207/s15327051hci1304_2Google ScholarDigital Library
- Paul Duguid. 2012. On Rereading Suchman and Situated Action. Le Libellio d’Aegis 8, 2 (2012), 3–11.Google Scholar
- Mustafa Emirbayer and Douglas W. Maynard. 2011. Pragmatism and Ethnomethodology. Qualitative Sociology; New York 34, 1 (March 2011), 221–261. https://doi.org/10.1007/s11133-010-9183-8Google ScholarCross Ref
- Sheena Erete and Jennifer O. Burrell. 2017. Empowered Participation: How Citizens Use Technology in Local Governance. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2307–2319.Google ScholarDigital Library
- Sara Eriksson, Åsa Unander-Scharin, Vincent Trichon, Carl Unander-Scharin, Hedvig Kjellström, and Kristina Höök. 2019. Dancing With Drones: Crafting Novel Artistic Expressions Through Intercorporeality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, 617:1–617:12. https://doi.org/10.1145/3290605.3300847Google ScholarDigital Library
- Sarah Fdili Alaoui. 2019. Making an Interactive Dance Piece: Tensions in Integrating Technology in Art. In Proceedings of the 2019 on Designing Interactive Systems Conference(DIS ’19). ACM, New York, NY, USA, 1195–1208. https://doi.org/10.1145/3322276.3322289Google ScholarDigital Library
- Blanca Li Company (Film Addict - Calentito). 2020. Blanca Li. Event. Le Bal de Paris de Blanca Li. https://www.blancali.com/en/event/146/Le-Bal-de-Paris.Google Scholar
- Diana Freed, Jackeline Palmer, Diana Minchala, Karen Levy, Thomas Ristenpart, and Nicola Dell. 2018. “A Stalker’s Paradise”: How Intimate Partner Abusers Exploit Technology. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.Google ScholarDigital Library
- Harold Garfinkel. 1991. Studies in Ethnomethodology(1 edition ed.). Polity, Cambridge, UK.Google Scholar
- David Geerts, Evert van Beek, and Fernanda Chocron Miranda. 2019. Viewers’ Visions of the Future. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 59–69. https://doi.org/10.1145/3317697.3323356Google ScholarDigital Library
- Rebecca E. Grinter, W. Keith Edwards, Mark W. Newman, and Nicolas Ducheneaut. 2005. The Work to Make a Home Network Work. In ECSCW 2005, Hans Gellersen, Kjeld Schmidt, Michel Beaudouin-Lafon, and Wendy Mackay (Eds.). Springer Netherlands, Dordrecht, 469–488. https://doi.org/10.1007/1-4020-4023-7_24Google ScholarCross Ref
- Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality Between HMD and Non-HMD Users. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 4021–4033. https://doi.org/10.1145/3025453.3025683Google ScholarDigital Library
- Giulio Iacucci, Carlo Iacucci, and Kari Kuutti. 2002. Imagining and Experiencing in Design, the Role of Performances. In Proceedings of the Second Nordic Conference on Human-Computer Interaction(NordiCHI ’02). ACM, New York, NY, USA, 167–176. https://doi.org/10.1145/572020.572040Google ScholarDigital Library
- Etsuko Ichihara. 2014. 最高の求愛体験をあなたに。SRxSIxMS. http://etsuko-ichihara.com/works/最高の求愛体験をあなたに。srxsixms/.Google Scholar
- Alejandro G. Iñárritu. 2017. Carne y Arena. https://carne-y-arena.com.Google Scholar
- Rachel Jacobs, Steve Benford, and Ewa Luger. 2015. Behind The Scenes at HCI’s Turn to the Arts. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’15). ACM, New York, NY, USA, 567–578. https://doi.org/10.1145/2702613.2732513Google ScholarDigital Library
- Marie Jourdren. 2018. The Horrifically Real Virtuality. https://www.labiennale.org/en/cinema/2018/lineup/venice-virtual-reality/horrifically-real-virtuality.Google Scholar
- Marie Jourdren and Mathias Chelebourg. 2017. Alice, the Virtual Reality Play. https://futureofstorytelling.org/project/alice-the-virtual-reality-play.Google Scholar
- Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: Integrating First-Person View with out-of-Body Vision Generation for Human-Human Augmentation. In Proceedings of the 5th Augmented Human International Conference (Kobe, Japan) (AH ’14). Association for Computing Machinery, New York, NY, USA, Article 46, 8 pages. https://doi.org/10.1145/2582051.2582097Google ScholarDigital Library
- Jarrod Knibbe, Jonas Schjerlund, Mathias Petraeus, and Kasper Hornb\a ek. 2018. The Dream Is Collapsing: The Experience of Exiting VR. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). ACM, New York, NY, USA, 483:1–483:13. https://doi.org/10.1145/3173574.3174057Google ScholarDigital Library
- Boriana Koleva, Ian Taylor, Steve Benford, Mike Fraser, Chris Greenhalgh, Holger Schnädelbach, Dirk vom Lehn, Christian Heath, Ju Row-Farr, and Matt Adams. 2001. Orchestrating a Mixed Reality Performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Seattle, Washington, USA, 38–45.Google ScholarDigital Library
- Veronika Krauß, Alexander Boden, Leif Oppermann, and René Reiners. 2021. Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application Development. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3411764.3445335Google ScholarDigital Library
- Andreas Kunz, Markus Zank, Morten Fjeld, and Thomas Nescher. 2016. Real Walking in Virtual Environments for Factory Planning and Evaluation. Procedia CIRP 44 (Jan. 2016), 257–262. https://doi.org/10.1016/j.procir.2016.02.086Google ScholarCross Ref
- Eric Laurier. 2014. The Graphic Transcript: Poaching Comic Book Grammar for Inscribing the Visual, Spatial and Temporal Aspects of Action. Geography Compass 8, 4 (2014), 235–248. https://doi.org/10.1111/gec3.12123Google ScholarCross Ref
- Corinne Linder. 2018. The Ordinary Circus Girl » Program • Biennale Internationale Des Arts Du Cirque • BIAC. https://www.biennale-cirque.com/en/program/the-ordinary-circus-girl-248.Google Scholar
- Marie-G. Losseau and Yann Deval. 2020. Atlas. https://www.atlas-experience.xyz/.Google Scholar
- Tiffany Marques, Mário Vairinhos, and Pedro Almeida. 2019. How VR 360o Impacts the Immersion of the Viewer of Suspense AV Content. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 239–246. https://doi.org/10.1145/3317697.3325120Google ScholarDigital Library
- Tupac MARTIR. 2019. Cosmos Within Us - Memory Is All We Are. https://www.a-bahn.com/projects/cosmos-within-us.Google Scholar
- Sebastian Marwecki and Patrick Baudisch. 2018. Scenograph: Fitting Real-Walking VR Experiences into Various Tracking Volumes. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(UIST ’18). Association for Computing Machinery, New York, NY, USA, 511–520. https://doi.org/10.1145/3242587.3242648Google ScholarDigital Library
- John McCarthy and Peter Wright. 2004. Technology As Experience. interactions 11, 5 (Sept. 2004), 42–43. https://doi.org/10.1145/1015530.1015549Google ScholarDigital Library
- Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382Google ScholarDigital Library
- Joshua McVeigh-Schultz, Max Kreminski, Keshav Prasad, Perry Hoberman, and Scott S. Fisher. 2018. Immersive Design Fiction: Using VR to Prototype Speculative Interfaces and Interaction Rituals Within a Virtual Storyworld. In Proceedings of the 2018 Designing Interactive Systems Conference(DIS ’18). ACM, New York, NY, USA, 817–829. https://doi.org/10.1145/3196709.3196793Google ScholarDigital Library
- Elisa D. Mekler and Kasper Hornbæk. 2019. A Framework for the Experience of Meaning in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE Trans. Information Systems vol. E77-D, no. 12 (Dec. 1994), 1321–1329.Google Scholar
- Michael Charles Neumann. 2020. The Trip. http://www.michaelcharlesneumann.com/the-trip/.Google Scholar
- Erika Shehan Poole, Marshini Chetty, Rebecca E. Grinter, and W. Keith Edwards. 2008. More than Meets the Eye: Transforming the User Experience of Home Network Management. In Proceedings of the 7th ACM Conference on Designing Interactive Systems(DIS ’08). Association for Computing Machinery, Cape Town, South Africa, 455–464. https://doi.org/10.1145/1394445.1394494Google ScholarDigital Library
- Erika Shehan Poole, Marshini Chetty, Tom Morgan, Rebecca E. Grinter, and W. Keith Edwards. 2009. Computer Help at Home: Methods and Motivations for Informal Technical Support. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). Association for Computing Machinery, Boston, MA, USA, 739–748. https://doi.org/10.1145/1518701.1518816Google ScholarDigital Library
- Asreen Rostami. 2020. Interweaving Technology : Understanding the Design and Experience of Interactive Performances. Ph.D. Dissertation. Department of Computer and Systems Sciences, Stockholm University.Google Scholar
- Asreen Rostami, Emma Bexell, and Stefan Stanisic. 2018. The Shared Individual. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (Stockholm, Sweden) (TEI ’18). Association for Computing Machinery, New York, NY, USA, 511–516. https://doi.org/10.1145/3173225.3173299Google ScholarDigital Library
- Asreen Rostami, Donald McMillan, Elena Márquez Segura, Chiara Rossitto, and Louise Barkhuus. 2017. Bio-Sensed and Embodied Participation in Interactive Performance. In Proceedings of the TEI ’17: Tenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’17). ACM, New York, NY, USA. https://doi.org/10.1145/3024969.3024998Google ScholarDigital Library
- Asreen Rostami, Chiara Rossitto, Louise Barkhuus, Jonathan Hook, Jarmo Laaksolahti, Robyn Taylor, Donald McMillan, Jocelyn Spence, and Julie Williamson. 2017. Design Fiction for Mixed-Reality Performances. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’17). ACM, New York, NY, USA, 498–505. https://doi.org/10.1145/3027063.3027080Google ScholarDigital Library
- Asreen Rostami, Chiara Rossitto, and Annika Waern. 2018. Frictional Realities: Enabling Immersion in Mixed-Reality Performances. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’18). ACM, New York, NY, USA, 15–27. https://doi.org/10.1145/3210825.3210827Google ScholarDigital Library
- Neelima Sailaja, Andy Crabtree, James Colley, Adrian Gradinar, Paul Coulton, Ian Forrester, Lianne Kerlin, and Phil Stenton. 2019. The Living Room of the Future. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 95–107. https://doi.org/10.1145/3317697.3323360Google ScholarDigital Library
- Sara Pérez Seijo. 2017. Immersive Journalism: From Audience to First-Person Experience of News. In Media and Metamedia Management. Springer, Cham, 113–119. https://doi.org/10.1007/978-3-319-46068-0_14Google ScholarCross Ref
- Marco Speicher, Christoph Rosenberg, Donald Degraen, Florian Daiber, and Antonio Krúger. 2019. Exploring Visual Guidance in 360-Degree Videos. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3317697.3323350Google ScholarDigital Library
- Lucy A. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication.Cambridge University Press, New York, NY, US.Google ScholarDigital Library
- Keisuke Suzuki, Sohei Wakisaka, and Naotaka Fujii. 2012. Substitutional Reality System: A Novel Experimental Platform for Experiencing Alternative Reality. Scientific Reports 2, 1 (June 2012), 459. https://doi.org/10.1038/srep00459Google ScholarCross Ref
- Leila Takayama, Caroline Pantofaru, David Robson, Bianca Soto, and Michael Barry. 2012. Making Technology Homey: Finding Sources of Satisfaction and Meaning in Home Automation. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing(UbiComp ’12). Association for Computing Machinery, Pittsburgh, Pennsylvania, 511–520. https://doi.org/10.1145/2370216.2370292Google ScholarDigital Library
- Jordan Tannahill. 2017. Draw Me Close. https://www.nationaltheatre.org.uk/immersive/projects/draw-me-close.Google Scholar
- Robyn Taylor, Guy Schofield, John Shearer, Jayne Wallace, Peter Wright, Pierre Boulanger, and Patrick Olivier. 2011. Designing from Within: Humanaquarium. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). ACM, New York, NY, USA, 1855–1864. https://doi.org/10.1145/1978942.1979211Google ScholarDigital Library
- Robyn Taylor, Jocelyn Spence, Brendan Walker, Bettina Nissen, and Peter Wright. 2017. Performing Research: Four Contributions to HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 4825–4837. https://doi.org/10.1145/3025453.3025751Google ScholarDigital Library
- Jakob Tholander, Chiara Rossitto, Asreen Rostami, Yoshio Ishiguro, Takashi Miyaki, and Jun Rekimoto. 2021. Design in Action: Unpacking the Artists’ Role in Performance-Led Research. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3411764.3445056Google ScholarDigital Library
- Peter Tolmie, Andy Crabtree, Tom Rodden, Chris Greenhalgh, and Steve Benford. 2007. Making the Home Network at Home: Digital Housekeeping. In ECSCW 2007, Liam J. Bannon, Ina Wagner, Carl Gutwin, Richard H. R. Harper, and Kjeld Schmidt (Eds.). Springer, London, 331–350. https://doi.org/10.1007/978-1-84800-031-5_18Google ScholarCross Ref
- Kami Vaniea and Yasmeen Rashidi. 2016. Tales of Software Updates: The Process of Updating Software. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, San Jose, California, USA, 3215–3226. https://doi.org/10.1145/2858036.2858303Google ScholarDigital Library
- Khrystyna Vasylevska and Hannes Kaufmann. 2017. Compressing VR: Fitting Large Virtual Environments within Limited Physical Space. IEEE Computer Graphics and Applications 37, 5 (Jan. 2017), 85–91. https://doi.org/10.1109/MCG.2017.3621226Google ScholarDigital Library
- Mirjam Vosmeer and Ben Schouten. 2017. Project Orpheus A Research Study into 360° Cinematic VR. In Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’17). ACM, New York, NY, USA, 85–90. https://doi.org/10.1145/3077548.3077559Google ScholarDigital Library
- Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300310Google ScholarDigital Library
- Rayoung Yang and Mark W. Newman. 2013. Learning from a Learning Thermostat: Lessons for Intelligent Systems for the Home. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing(UbiComp ’13). Association for Computing Machinery, Zurich, Switzerland, 93–102. https://doi.org/10.1145/2493432.2493489Google ScholarDigital Library
Index Terms
- The Normal Natural Troubles of Virtual Reality in Mixed-Reality Performances
Recommendations
Headset removal for virtual and mixed reality
SIGGRAPH '17: ACM SIGGRAPH 2017 TalksVirtual Reality (VR) has advanced significantly in recent years and allows users to explore novel environments (both real and imaginary), play games, and engage with media in a way that is unprecedentedly immersive. However, compared to physical reality,...
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music ExperiencesThe Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
Speed reading on virtual reality and augmented reality
AbstractMany virtual reality (VR) and augmented reality (AR) applications in education require speed reading. The current study aimed to explore whether the reading performance on VR and AR is different from that on traditional desktop display,...
Highlights- We explored performance of speed reading on virtual and augmented reality.
- ...
Comments