skip to main content
10.1145/3196709.3196793acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Immersive Design Fiction: Using VR to Prototype Speculative Interfaces and Interaction Rituals within a Virtual Storyworld

Published: 08 June 2018 Publication History

Abstract

Immersive design fiction is a novel approach that embeds speculative interactions within a rich virtual reality (VR) storyworld. Immersive design fictions use VR to translate new design opportunities into story-driven, embodied experiences by positioning the participant as a character in a narrative world. This paper presents a case study of an immersive design fiction that depicts a fictionalized reimagining of an industry partner's work practices. This VR experience explores speculative interfaces for creative work and collaboration in the context of a fictional workplace environment. By placing design fictions within rich immersive contexts such as room-scale VR, researchers and practitioners can go beyond prototyping imagined interfaces to also speculate about the interaction rituals and surrounding social context within an experiential storyworld. This approach makes methodological and theoretical contributions to design fiction research by demonstrating a toolkit for exploring and reflecting upon the intersections between speculation, embodiment, and narrative context.

References

[1]
Akers, D. Wizard of Oz for Participatory Design: Inventing a Gestural Interface for 3D Selection of Neural Pathway Estimates. Proceedings of the 2006 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI '06, (2006), 454--459.
[2]
Alger, M. Visual Design Methods for Virtual Reality. September (2015), 98.
[3]
Auger, J. Speculative design: crafting the speculation. Digital Creativity 24, 1 (2013), 11--35.
[4]
Baccus, A., Aguilar y Wedge, C., and Tankal, E. NeuroSpeculative AfroFeminism. Hyphen-Labs, 2016. http://www.hyphen-labs.com/nsaf.html.
[5]
Balsamo, A. Ways of the hand. 2009. http://www.annebalsamo.net/projects/ways-of-thehand/ways-of-the-hand-tinkering-in-digital-age/
[6]
Balsamo, A. Designing Culture: The Technological Imagination at Work. Duke University Press Books, 2011.
[7]
Bardzell, J. and Bardzell, S. What is "critical" about critical design? Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13, (2013), 3297--3306.
[8]
Battarbee, K. Co-experience: user experience as interaction. CoDesign: International Journal of CoCreation in Design and the Arts 1, 1 (2005), 5--18.
[9]
Baumann, K., Stokes, B., Bar, F., and Caldwell, B. Infrastructures of the Imagination. Proceedings of the 8th International Conference on Communities and Technologies - C&T '17, (2017), 266--269.
[10]
Bell, C. Ritual Theory, Ritual Practice. Oxford University Press, USA, New York, NY, 1992.
[11]
Bell, G., Blythe, M., and Sengers, P. Making by making strange : defamiliarization and the design of domestic technologies. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2 (2005), 1--25.
[12]
Bell, G. and Dourish, P. Yesterday's tomorrows: notes on ubiquitous computing's dominant vision. Personal and Ubiquitous Computing 11, 2 (2006), 133--143.
[13]
Benford, S., Bowers, J., Fahlén, L.E., Greenhalgh, C., and Snowdon, D. User Embodiment in Collaborative Virtual Environments. Proceedings of the International Conference on Human Factors in Computing Systems - CHI'95, (1995), 242--249.
[14]
Benford, S., Greenhalgh, C., and Rodden, T. Collaborative virtual environments. Communications of the ACM 44, 7 (2001), 79--85.
[15]
Bleecker, J. Design Fiction: A short essay on design, science, fact and fiction. Near Future Laboratory, 2009.
[16]
Bleecker, J. Design Fiction: From Props to Prototypes. Swiss Design Network: Negotiating Futures-Design Fiction, (2010), 58--67.
[17]
Blythe, M. Research Through Design Fiction: Narrative in Real and Imaginary Abstracts. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '14 (2014), 703--712.
[18]
Blythe, M., Andersen, K., Clarke, R., and Wright, P. AntiSolutionist Strategies. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, (2016), 4968--4978.
[19]
Brandt, E. and Grunnet, C. Evoking the future: Drama and props in user centered design. Proceedings of Participatory Design Conference PDC '00, (2000).
[20]
Briggs, P., Olivier, P., Blythe, M., et al. Invisible design: exploring insights and ideas through ambiguous film scenarios. Designing Interactive Systems, 1933 (2012), 11--15.
[21]
Buchenau, M. and Suri, J.F. Experience prototyping. DIS, ACM Press (2000), 424--433.
[22]
Candy, S. The Futures of Everyday Life: Politics and the Design of Experiential Scenarios. 2010.
[23]
Candy, S. and Dunagan, J. Designing an experiential scenario: The People Who Vanished. Futures, June (2016).
[24]
Candy, S., Dunagan, J.F., Candy, S., and Dunagan, J. The Experiential Turn. Human Futures, December (2016), 26-- 28.
[25]
Chatting, D., Kirk, D.S., Durrant, A.C., Elsden, C., Yurman, P., and Bichard, J.-A. Making Ritual Machines. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, (2017), 435-- 447.
[26]
Coulton, P., Burnett, D., and Gradinar, A. Games as Speculative Design : Allowing Players to Consider Alternate Presents and Plausible Futures. Design Research Society, (2016).
[27]
Coulton, P., Lindley, J., Sturdee, M., and Stead, M. Design Fiction as World Building. Proceedings of the 3nd Biennial Research Through Design Conference, (2017).
[28]
Dalton, N.S., Moreau, R., and Adams, R.K. Resistance is Fertile: Design Fictions in Dystopian Worlds. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, (2016), 365--374.
[29]
DiSalvo, C. Adversarial Design (Design Thinking, Design Theory). MIT Press, Cambridge, MA, 2012.
[30]
Disalvo, C., Jenkins, T., and Lodato, T. Designing Speculative Civics. CHI '16, Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '16 (2016).
[31]
Dourish, P. Where the Action Is: The Foundations of Embodied Interaction (Bradford Books). The MIT Press, 2004.
[32]
Dourish, P. The Stuff of Bits: an Essay on the Materialities of Information. MIT Press, Cambridge, MA, 2017.
[33]
Dourish, P. and Bell, G. Divining a Digital Future: Mess and Mythology in Ubiquitous Computing. The MIT Press, Cambridge, MA, 2011.
[34]
Dourish, P. and Bell, G. "Resistance is futile": reading science fiction alongside ubiquitous computing. Personal and Ubiquitous Computing 18, 4 (2013), 769--778.
[35]
Dourish, P., Finlay, J., Sengers, P., and Wright, P. Reflective HCI : Towards a Critical Technical Practice. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '04, (2004).
[36]
Dunne, A. Hertzian Tales: Electronic Products, Aesthetic Experience, and Critical Design. The MIT Press, 2008.
[37]
Dunne, A. and Raby, F. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press, Cambridge, MA, 2013.
[38]
Elsden, C., Chatting, D., Durrant, A.C., et al. On Speculative Enactments. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '17, (2017).
[39]
Encinas, E. and Blythe, M. The Solution Printer : Magic Realist Design Fiction. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16 (2016), 387--396.
[40]
Faste, H. Intuition in Design : Reflections on the Iterative Aesthetics of Form. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17, (2017).
[41]
Ferri, G., Bardzell, J., Bardzell, S., and Louraine, S. Analyzing critical designs. Proceedings of the 2014 conference on Designing interactive systems - DIS '14, (2014), 355--364.
[42]
Fisher, S. Recent developments in virtual experience design and production. Proc. SPIE 2049, Stereoscopic Displays and Virtual Reality Systems II, (1995), 296--302.
[43]
Gaver, W. What Should We Expect From Research Through Design? Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '12, (2012), 937--946.
[44]
Gilardi, M., Holroyd, P., Brownbridge, C., Watten, P.L., and Obrist, M. Design Fiction Filmmaking. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, January (2016), 1398--1406.
[45]
Goffman, E. Interaction Ritual - Essays on Face-to-Face Behavior. Pantheon, 1967.
[46]
Grimes, R.L. Beginnings in Ritual Studies. University of South Carolina Press, 1995.
[47]
Grimes, R.L. The Craft of Ritual Studies. Oxford University Press, 2014.
[48]
Hales, D. Design fictions an introduction and provisional taxonomy. Digital Creativity 24, 1 (2013), 1--10.
[49]
Höysniemi, J. and Read, J. Wizard of Oz Studies: Why and How. Proceedings of the 1st International Conference on Intelligent User Interfaces, (1993), 193--200.
[50]
Jerald, J. The VR Book: human-centered design for Virtual Reality (ACM Books). 2016.
[51]
Klemmer, S.R., Hartmann, B., and Takayama, L. How Bodies Matter : Five Themes for Interaction Design. Learning, (2006).
[52]
Klemmer, S.R., Hartmann, B., and Takayama, L. How Bodies Matter: Five Themes for Interaction Design. DIS, (2006), 140--149.
[53]
Kurvinen, E., Koskinen, I., and Battarbee, K. Prototyping Social Interaction. Design Issues 24, 3 (2008).
[54]
de la Pena, N., Weil, P., Llobera, J., et al. Immersive Journalism: Immersive Virtual Reality for the First-Person Experience of News. Presence: Teleoperators and Virtual Environments, (2010).
[55]
Lindley, J. and Coulton, P. Pushing the Limits of Design Fiction: The Case for Fictional Research Papers. Proceedings of the 2016 Annual Conference on Human Factors in Computing Systems - CHI '16, (2016), 4032-- 4043.
[56]
Márquez Segura, E., Turmo Vidal, L., Rostami, A., and Waern, A. Embodied Sketching. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 (2016), 6014--6027.
[57]
McVeigh-Schultz, J. Designing Speculative Rituals and other Tangible Imaginaries. (Forthcoming) Unfrozen: The Swiss Design Network.
[58]
McVeigh-Schultz, J. Redesigning the Vox Pop: civic rituals as sites of critical reimagining. In M. Ratto and M. Boler, eds., DIY Citizenship. MIT Press, 2014.
[59]
McVeigh-Schultz, J. Designing Speculative Rituals: Tangible Imaginaries and Fictive Practices from the (Inter)personal to the Political. 2016.
[60]
Mel Slater, Martin Usoh, A.S. Depth of Presence in Virtual Environments. Presence-Teleoperators and Virtual Environments, (1996).
[61]
Murphy, K.M. Collaborative imagining : The interactive use of gestures, talk, and graphic representation in architectural practice. Semiotica 156, 1/4 (2005), 113-- 145.
[62]
Near Future Laboratory. TBD Catalog. Near Future Laboratory LLC, Publishers, 2014.
[63]
Nova, N. Design ethnography? Towards a designerly approach to field research. In Empowering Users through Design: Interdisciplinary Studies and Combined Approaches for Technological Products and Services. Springer, 2015, 119--128.
[64]
Nova, N., Miyake, K., Chiu, W., and Kwon, N. Curious Rituals: Gestural Interaction in the Digital Everyday Life. 2012.
[65]
Oulasvirta, A., Kurvinen, E., and Kankainen, T. Understanding contexts by being there: case studies in bodystorming. Personal and Ubiquitous Computing 7, 2 (2003), 125--134.
[66]
Ozenc, F.K. and Hagan, M. Ritual design: Crafting team rituals for meaningful organizational change. Advances in Intelligent Systems and Computing 585, (2018), 1--12.
[67]
Pierce, J. and Paulos, E. Some variations on a counterfunctional digital camera. Proceedings of the 2014 conference on Designing interactive systems - DIS '14, (2014), 131--140.
[68]
Prado, L. and Oliveira, P. Futuristic Gizmos, Conservative Ideals | Modes of Criticism. Modes of Criticism 1, (2015).
[69]
Raford, N. From Design Fiction to Experiential Futures. In The Future of Futures: Essays by Leading Futurists on the Past, Present, and Future of Future Studies and Practice. Association of Professional Futurists, 2012, 48.
[70]
Reeves, S. Envisioning Ubiquitous Computing. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '12, (2012), 1573-- 1582.
[71]
Schön, D.A. The Reflective Practitioner. Basic Books, 1983.
[72]
Sengers, P., Boehner, K., David, S., and Kaye, J. "Jofish." Reflective design. Proceedings of the 4th decennial conference on Critical computing between sense and sensibility - CC '05, (2005), 49.
[73]
Simsarian, K.T., Francisco, I.S., Annex, P., Embarcadero, T., and Francisco, S. Take it to the Next Stage : The Roles of Role Playing in the Design Process. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '03, (2003), 1012--1013.
[74]
Sirkin, D. and Ju, W. Using Embodied Design Improvisation as a Design Research Tool. International Conference on Human Behavior in Design, October (2014), 1--7.
[75]
Slater, M. and Sanchez-Vives, M. V. Enhancing Our Lives with Immersive Virtual Reality. Frontiers in Robotics and AI 3, December (2016), 1--47.
[76]
Smyth, M. and Helgason, I. Tangible possibilities: envisioning interactions in public space. Digital Creativity 24, 1 (2013), 75--87.
[77]
Sterling, B. Design fiction. Interactions 16, 3 (2009), 20.
[78]
Sterling, B. Closing Keynote address. IxDA Interaction Eleven Conference, (2011).
[79]
Sturdee, M., Coulton, P., Lindley, J.G., Stead, M., Ali, H., and Hudson-Smith, A. Design Fiction: How to Build a Voight-Kampff Machine. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, (2016), 375--386.
[80]
Tambiah, S. A Performative Approach to Ritual. In Culture, Thought, and Social Action. Harvard University Press, Cambridge, MA, 1985.
[81]
Tanenbaum, J. Design fictional interactions. Interactions 21, 5 (2014), 22--23.
[82]
Tanenbaum, J., Tanenbaum, K., and Wakkary, R. Steampunk as Design Fiction. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '12, (2012), 1583--1592.
[83]
Taylor, C.W. Creating Strategic Visions. In C.R. Cothern and N.P. Ross, eds., Environmental Statistics, Assessment, and Forecasting. Lewis Publishers / CRC Press, Boca Raton, FL, 1994, 259--266.
[84]
Tharp, B.M. and Tharp, S.M. Discursive Design: Beyond Purely Commercial Notions of Industrial and Product Design. IDSA National Education Symposium Proceedings, (2008).
[85]
Tonkinwise, C. How We Intend to Future Review of Anthony Dunne. Design Philosophy Papers 12, 2 (2014), 169--188.
[86]
Wakkary, R., Desjardins, A., Hauser, S., and Maestri, L. A sustainable design fiction: Green practices. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 4, Article 23 (2013).
[87]
Weiser, M. The Computer for the 21st Century. Scientific American, (1991).
[88]
Wong, R.Y. and Mulligan, D.K. When a Product Is Still Fictional: Anticipating and Speculating Futures Through Concept Videos. Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16, (2016), 121--133.

Cited By

View all
  • (2024)Designing our Weird Social XR Future: Tactics to support hybrid ways of embodied knowingProceedings of the Halfway to the Future Symposium10.1145/3686169.3686199(1-11)Online publication date: 21-Oct-2024
  • (2024)Enacting Human–Robot Encounters with Theater Professionals on a Mixed Reality StageACM Transactions on Human-Robot Interaction10.1145/367818614:1(1-25)Online publication date: 28-Nov-2024
  • (2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
  • Show More Cited By

Index Terms

  1. Immersive Design Fiction: Using VR to Prototype Speculative Interfaces and Interaction Rituals within a Virtual Storyworld

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DIS '18: Proceedings of the 2018 Designing Interactive Systems Conference
      June 2018
      1418 pages
      ISBN:9781450351980
      DOI:10.1145/3196709
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 June 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. design fiction
      2. embodiment
      3. experience design
      4. immersive design fiction
      5. speculative design
      6. virtual reality

      Qualifiers

      • Research-article

      Conference

      DIS '18
      Sponsor:

      Acceptance Rates

      DIS '18 Paper Acceptance Rate 107 of 487 submissions, 22%;
      Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

      Upcoming Conference

      DIS '25
      Designing Interactive Systems Conference
      July 5 - 9, 2025
      Funchal , Portugal

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)203
      • Downloads (Last 6 weeks)29
      Reflects downloads up to 14 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Designing our Weird Social XR Future: Tactics to support hybrid ways of embodied knowingProceedings of the Halfway to the Future Symposium10.1145/3686169.3686199(1-11)Online publication date: 21-Oct-2024
      • (2024)Enacting Human–Robot Encounters with Theater Professionals on a Mixed Reality StageACM Transactions on Human-Robot Interaction10.1145/367818614:1(1-25)Online publication date: 28-Nov-2024
      • (2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
      • (2024)From Imagination to Innovation: Using Participatory Design Fiction to Envision the Future of Accessible Gaming Wearables for Players with Upper Limb Motor DisabilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36770738:CHI PLAY(1-30)Online publication date: 15-Oct-2024
      • (2024)Acting out in real and virtual environments: comparative analysis for future workstyle designProceedings of the Participatory Design Conference 2024: Exploratory Papers and Workshops - Volume 210.1145/3661455.3669873(73-80)Online publication date: 11-Aug-2024
      • (2024)Embodied Hybrid Bodystorming to Design an XR Suture Training ExperienceProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633362(1-12)Online publication date: 11-Feb-2024
      • (2024)Exploring post-human futures with design fiction among undergraduate students: implications for future-oriented design educationThe Design Journal10.1080/14606925.2024.2433357(1-24)Online publication date: 28-Nov-2024
      • (2024)A systematic review of social classroom climate in online and technology-enhanced learning environments in primary and secondary schoolEducation and Information Technologies10.1007/s10639-023-11705-929:2(2009-2042)Online publication date: 1-Feb-2024
      • (2023)Virtual narratives, physical bodies: Designing diegetic sensory experiences for virtual realityConvergence: The International Journal of Research into New Media Technologies10.1177/13548565231178915(135485652311789)Online publication date: 31-May-2023
      • (2023)“We try to empower them” - Exploring Future Technologies to Support Migrant JobseekersProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3594056(972-983)Online publication date: 12-Jun-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media