Raul Altosaar
ABSTRACT
A Very Real Looper (AVRL) is an audio-only virtual reality (VR) interface inside of which a performer triggers and controls music through full-body movement. Contrary to how musical interfaces in VR are normally used, a performer using AVRL is not disconnected from their surrounding environment through immersion, nor is their body restrained by a head-mounted display. Rather, AVRL utilizes two VR sensors and the Unity game engine to map virtual musical sounds onto physical objects in the real world. These objects help the performer locate the sounds. Using two handheld VR controllers, these sounds can be triggered, looped, acoustically affected, or repositioned in space. AVRL thus combines the affordances of the physical world and a VR system with the reconfigurability of a game engine. This integration results in an expansive and augmented performance environment that facilitates full-body musical interactions.
- H. Schraffenberger and E. van der Heide. 2016. Multimodal augmented reality: the norm rather than the exception. In Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality (MVAR '16). ACM, New York, NY, USA, Article 1, 6 pages. Google Scholar
Digital Library
- Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 201--210. Google ScholarDigital Library
- Brandon J. Laatsch. 2016. Lighthouse Shenanigans. Video. (27 Feb 2016.). Retrieved November 4, 2018 from https://www.youtube.com/watch?v=9bZkp7q19f0Google Scholar
- Steve Gibson. 2018. Opto-Phono-Kinesia (OPK): Designing Motion-Based Interaction for Expert Performers. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 487--492. Google ScholarDigital Library
- Teemu Mäki-Patola, Juha Laitinen, Aki Kanerva, and Tapio Takala. 2005. Experiments with virtual reality instruments. In Proceedings of the 2005 conference on New interfaces for musical expression (NIME '05). National University of Singapore, Singapore, Singapore, 11--16. Google ScholarDigital Library
- David Wessel and Matthew Wright. 2002. Problems and Prospects for Intimate Musical Control of Computers. Comput. Music J. 26, 3 (September 2002), 11--22. Google ScholarDigital Library
- Bolas, M. & Stone, P. (1992). Virtual mutant theremin. Proceedings International Computer Music Conference, San Jose, California, USA, 360--361. San Fransisco CA, USA: International Computer Music Association.Google Scholar
- Mulder, Axel G.E. (1994). Virtual Musical Instruments: Accessing the sound synthesis universe as a performer. Proceedings of the first Brazilian Symposium on Computer Music, held in Caxambu, Minas Gerais, Brazil, August 2--4 1994, during the XIV annual congress of the Brazilian Computing Society (SBC), pp 243--250. Belo Horizonte, M.G., Brazil: Universidade Federal de Minas Gerais.Google Scholar
Index Terms
- Physically Colliding with Music: Full-body Interactions with an Audio-only Virtual Reality Interface
Recommendations
Touching the audience: musical haptic wearables for augmented and participatory live music performances
AbstractThis paper introduces the musical haptic wearables for audiences (MHWAs), a class of wearable devices for musical applications targeting audiences of live music performances. MHWAs are characterized by embedded intelligence, wireless connectivity ...
Zound: An interactive live electronics
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music ExperiencesAn interactive live electronics, completely controlled real-time by the mouth harp's (Jew's harp, Jaw harp) acoustic signal has been created, using Max (™ Cycling '74). The system interacts according to the various timbre's features of the instrument, ...
MusicFabrik: a playable, portable speaker
NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer InteractionIn this work-in-progress we introduce our prototype, a portable speaker augmented to be used as an electronic music sketchpad which allows musicians to play, record and compose multi-track music on the fly. We developed the MusicFabrik cover for the ...
Comments