Skip to main content

Embodiment in Virtual Reality Performance

  • Conference paper
  • First Online:
Interactivity and Game Creation (ArtsIT 2020)

Abstract

In this publication, we present artistic and technical developments in creating and presenting dance performances in media art, where embodiment is crucial in the artistic process. We study and compare three distinct performances with dancers and one choreographer in the same dance company between 2009 and 2020. The degree of immersion in performance is then compared between the three pieces, created at Balleteatro, in Porto, addressing the transition from the real to the virtual in the performance perspective, with practical cases and direct observations in the way the audience learns different states of body representation through technological means. We initially present the NUVE performance (2010), interpreted by Né Barros, Co:Lateral (2016–2019), a performance that crosses different realities, and, finally, the transition to the UNA work (2020) that takes place in total virtuality. This publication focuses on the developments, the public experience, and the results obtained in more than 20 exhibitions in different locations, either in theater or auditorium and in conference venues.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://balleteatro.pt/.

  2. 2.

    https://jmartinho.net/about/.

  3. 3.

    https://balleteatro.pt/artistas/ne-barros.

  4. 4.

    Cave Automatic Virtual Environment.

  5. 5.

    https://jmartinho.net/nuve/.

  6. 6.

    https://jmartinho.net/colateral/.

  7. 7.

    https://jmartinho.net/una/.

  8. 8.

    https://openframeworks.cc/.

  9. 9.

    https://jmartinho.net/colateral/.

  10. 10.

    https://artsit.eai-conferences.org/2018/program-at-a-glance/.

  11. 11.

    https://isea2019.isea-international.org/.

  12. 12.

    https://www.tempsdimages-portugal.com/2019/show-item/colateral/.

  13. 13.

    https://2019.atdays.sk/.

  14. 14.

    https://www.dgartes.gov.pt/pt/evento/2966.

References

  1. Blades, H., DeLahunta, S.: Digital aptitude - finding the right questions for dance studies. Routledge Int. Handbook Res. Methods Digit. Human. 31–45, (2020). https://doi.org/10.4324/9780429777028-4

  2. Moura, J.M., Marcos, A., Barros, N., Branco, P.: NUVE: resizing the digital gesture. Int. J. Creative Interfaces Comput. Graph. 5, 87–100 (2014). https://doi.org/10.4018/ijcicg.2014070106

    Article  Google Scholar 

  3. Leach, J.: Choreographic objects: contemporary dance, digital creations and prototyping social visibility. J. Cult. Econ. 7, 458–475 (2014). https://doi.org/10.1080/17530350.2013.858058

    Article  Google Scholar 

  4. Kozel, S.: Closer: Performance, Technologies, Phenomenology. MIT Press, Leonardo Book Series (2007)

    Google Scholar 

  5. Cisneros, R.E., Wood, K., Whatley, S., et al.: Virtual reality and choreographic practice: the potential for new creative methods. Body Space Technol. 18, 1–32. https://doi.org/10.16995/bst.305

  6. Brooks, A.L.: Body Electric and Reality Feedback loops: Virtual Interactive Space & Entertainment Potentials. South Korea (2004)

    Google Scholar 

  7. Brooks, A.L.: Virtual Interactive Space (VIS): creating a unique dynamic HCI ludic engaging design (apparatus/method) for human performance and (re)habilitation. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9176, pp. 419–427. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20681-3_39

    Chapter  Google Scholar 

  8. Saltz, D.Z.: The art of interaction: interactivity, performativity, and computers. J. Aesthet. Art Critic. 55, 117–127 (1997). https://doi.org/10.2307/431258

    Article  Google Scholar 

  9. Dixon, S.: Digital Performance: A History of New Media in Theater, Dance, Performance Art, and Installation. MIT Press (2007)

    Book  Google Scholar 

  10. Forest, F., Sugarman, D., Weston, J.: Communication esthetics, interactive participation and artistic systems of communication and expression. Des. Issues 4, 97–115 (1988). https://doi.org/10.2307/1511394

    Article  Google Scholar 

  11. Heilig, M.L.: Sensorama U.S. Patent No. 3,050,870. 870 (1962)

    Google Scholar 

  12. Sutherland, I.E.: The ultimate display. In: Proceedings of the Congress of the Internation Federation of Information Processing (IFIP), pp. 506–508 (1965)

    Google Scholar 

  13. Moura, J.M., Kolen’ko, Y.: Sci-fi Miners: a virtual reality journey to the nanocluster scale. In: Proceedings of the 9th International Conference on Digital and Interactive Arts, pp. 1–10 (2019). https://doi.org/10.1145/3359852.3359912

  14. Fisher, S.S.: The NASA ames VIEWlab Project-A brief history. Presence: Teleoperators Virtual Environ. 25, 339–348 (2016). https://doi.org/10.1162/PRES_a_00277

  15. Lanier, J.: Virtually there. Sci. Am. 284, 66–75 (2001)

    Article  Google Scholar 

  16. Lanier, J.: Dawn of the New Everything : A Journey Through Virtual Reality. Bodley Head (2017)

    Google Scholar 

  17. Steuer, J.: Defining virtual reality: dimensions determining telepresence. J. Commun. 42, 73–93 (1992). https://doi.org/10.1111/j.1460-2466.1992.tb00812.x

    Article  Google Scholar 

  18. Gigante, M.A.: Virtual reality: definitions. History Appl. Virtual Reality Syst. 3–14, (1993). https://doi.org/10.1016/b978-0-12-227748-1.50009-3

  19. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1993, pp. 135–142 (1993). https://doi.org/10.1145/166117.166134

  20. Swanson, K.: Second life: a science library presence in virtual reality. Sci. Technol. Libr. 27, 79–86 (2007). https://doi.org/10.1300/J122v27n03_06

    Article  Google Scholar 

  21. Mazuryk, T., Gervautz, M.: Virtual Reality History. Applications, Technology and Future (1999)

    Google Scholar 

  22. Grau, O.: On the Visual Power of Digital Arts. For a New Archive and Museum Infrastructure in the 21st Century. Ediciones de la Universidad de Castilla-La Mancha (2016)

    Google Scholar 

  23. Shi, J., Honjo, T., Zhang, K., Furuya, K.: Using virtual reality to assess landscape: a comparative study between on-site survey and virtual reality of aesthetic preference and landscape cognition. Sustainability 12, 1–6 (2020). https://doi.org/10.3390/su12072875

    Article  Google Scholar 

  24. Jamieson, H.V.: Adventures in cyberformance - experiments at the interface of theatre and the internet. Queensland University of Technology (2008)

    Google Scholar 

  25. Riva, G., Mantovani, F., Capideville, C.S., et al.: Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol. Behav. 10, 45–56 (2007). https://doi.org/10.1089/cpb.2006.9993

    Article  Google Scholar 

  26. Baños, R.M., Botella, C., Alcañiz, M., et al.: Immersion and emotion: their impact on the sense of presence. Cyberpsychol. Behav. 7, 734–741 (2004). https://doi.org/10.1089/cpb.2004.7.734

    Article  Google Scholar 

  27. Riva, G.: Virtual Reality. The Palgrave Encyclopedia of the Possible 1–10, (2020). https://doi.org/10.1007/978-3-319-98390-5_34-1

  28. Loomis, J.M.: Distal Attribution and Presence. Presence: Teleoperators Virtual Environ. 1, 113–119 (1992). https://doi.org/10.1162/pres.1992.1.1.113

  29. Auvray, M., Hanneton, S., Lenay, C., O’Regan, K.: There is something out there: distal attributtion in sensory substitution, twenty years later. J. Integr. Neurosci. 4, 505–521 (2005). https://doi.org/10.1142/S0219635205001002

    Article  Google Scholar 

  30. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality : a class of displays on the reality - virtuality continuum. Syst. Res. 2351, 1–2 (1994). https://doi.org/10.1117/12.197321

    Article  Google Scholar 

  31. Moura, J.M., Marcos, A.F., Barros, N., Branco, P.: NUVE: in between the analog and virtual body. In: Proceedings of 5th International Conference Tangible Embedded Embodied Interact TEI 2011 (2011). https://doi.org/10.1145/1935701.1935804

  32. Moura, J.M., Barros, N., Ferreira-Lopes, P.: Co: Lateral – realidades e virtualidades incorporadas. In: Vilela, E., Barros, N. (eds.) Performances no Contemporâneo, Coleção Es, pp. 179–198. Faculdade de Letras da Universidade do Porto, Politics and Knowledge Research Group, Instituto de Filosofia, Universidade do Porto, Porto (2018)

    Google Scholar 

  33. Krueger, M.W., Gionfriddo, T., Hinrichsen, K.: VIDEOPLACE - an artificial reality. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 1985, pp. 35–43 (1985). https://doi.org/10.1145/1165385.317463

  34. Buscher, M., Hughes, J., O’Brien, J., Rodden, T.: Presence and Representation in Multimedia Art and Electronic Landscapes. The eSCAPE Project (1998)

    Google Scholar 

  35. Benayoun, M.: World Skin, A Photo Safari In The Land Of War By Maurice Benayoun - ADA | Archive Of Digital Art. https://www.digitalartarchive.at/database/general/work/world-skin.html. Accessed 6 May 2020

  36. Moura, J.M.: A Dança como Performance Digital: O Projeto NUVE. Universidade do Minho (2012)

    Google Scholar 

  37. Moura, J.M., Barros, N., Ferreira-Lopes, P.: From real to virtual embodied performance-a case study between dance and technology. In: Park, J., Nam, J., Park, J.W. (eds.) Proceedings of the 25th International Symposium on Electronic Art (ISEA 2019). ISEA International, Gwangju, pp 370–377 (2019)

    Google Scholar 

  38. Microsoft: Kinect. https://pt.wikipedia.org/wiki/Kinect(2010)

  39. Orbbec: Orbbec – Intelligent computing for everyone everywhere (2018). https://orbbec3d.com/. Accessed 21 Nov 2018

  40. INTEL Intel®’s RealSenseTM. https://www.intelrealsense.com/. Accessed 21 Nov 2019

  41. Lieberman, Z., Castro, A., Community, O.: Openframeworks (2004). https://openframeworks.cc

  42. Fry, B., Reas, C.: Processing.org. In: Processing (2001). https://processing.org/

  43. Bradski, G.: The OpenCV Library. Dr Dobb’s J Softw Tools (2000)

    Google Scholar 

  44. OpenCV Community OpenCV: Background Subtraction. https://docs.opencv.org/3.4/db/d5c/tutorial_py_bg_subtraction.html. Accessed 21 Nov 2018

  45. Bruhn, A., Weickert, J., Schnörr, C.: Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int. J. Comput. Vision 61, 1–21 (2005). https://doi.org/10.1023/B:VISI.0000045324.43199.43

    Article  Google Scholar 

  46. Moura, J.M., Sousa, J., Branco, P., Marcos, A.F.: You move you interact : a full-body dance in-between reality and virtuality. In: Barbosa, Á., Marcos, A. (ed.) ARTECH 2008 : Proceedings of the 4th International Conference on Digital Arts. Universidade Católica Portuguesa, pp. 49–54 (2008)

    Google Scholar 

  47. Albert, J.A., Owolabi, V., Gebel, A., et al.: Evaluation of the pose tracking performance of the azure kinect and kinect v2 for gait analysis in comparison with a gold standard: a pilot study. Sensors (Switzerland) 20, 1–22 (2020). https://doi.org/10.3390/s20185104

    Article  Google Scholar 

  48. Moura, J.M., Ferreira-Lopes, P.: Generative Face from Random Data, on How Computers Imagine Humans. In: Proceedings of the 8th International Conference on Digital Arts – ARTECH 2017, pp. 85–91 (2017). https://doi.org/10.1145/3106548.3106605

  49. Moura, J.M., Barros, N., Ferreira-Lopes, P.: UNA (by Né Barros and João Martinho Moura, 2020) | João Martinho Moura. https://jmartinho.net/una/. Accessed 6 Aug 2020

Download references

Acknowledgments

We are grateful to the entire Balleteatro technical and producing team that has supported the three projects described in this paper over the past ten years. To the research center CITAR (Research Center in Science and Technology of the Arts), School of Arts, Universidade Católica Portuguesa. To Casa Rolão in Braga for the space for some rehearsals. To the UNESCO Braga Media Arts organization, for the support in part of some equipment. To the EAI ArtsIT 2018 conference organization, in Braga. We would also like to thank the University of Minho’s engageLab laboratory for all the NUVE performance support in 2010. We also acknowledge the Openframeworks, OpenCV and Unity communities always very supportive in the on-line forums. Co:Lateral had the support of Direção Geral das Artes (https://www.dgartes.gov.pt/pt/noticia/2758).

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moura, J.M., Barros, N., Ferreira-Lopes, P. (2021). Embodiment in Virtual Reality Performance. In: Brooks, A., Brooks, E.I., Jonathan, D. (eds) Interactivity and Game Creation. ArtsIT 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 367. Springer, Cham. https://doi.org/10.1007/978-3-030-73426-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-73426-8_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-73425-1

  • Online ISBN: 978-3-030-73426-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics