Alyson Matheus de Carvalho Souza
ABSTRACT
Multimodal performances aggregate multiple forms of interaction and stimulation to create artistical masterpieces. One of those performances is the Ode to Christus Hypercubus, by Jônatas Manzolli. To enhance the original version of this performance and add new layers of stimulation and interaction, an Augmented Reality (AR) experience was developed. This paper describes the development of this application, all the artistic concepts that were part of the development, and the technologies used to create the final experience. Finally, the paper describes a live performance using this AR interface in a real setting during an exhibition of the Ode to Christus Hypercubus.
- Jack Atherton and Ge Wang. 2020. Doing vs. Being: A philosophy of design for artful VR. Journal of New Music Research 49, 1 (2020), 35–59.Google Scholar
Cross Ref
- Thomas F Banchoff. 2014. Salvador Dalí and the fourth dimension. In Proceedings of bridges 2014: Mathematics, music, art, architecture, culture. 1–10.Google Scholar
- Jonathan Bell and Benedict Carey. 2019. Animated notation, score distribution and ar-vr environments for spectral mimetic transfer in music composition. In TENOR.Google Scholar
- Marcio Cabral, Andre Montes, Gabriel Roque, Olavo Belloc, Mario Nagamura, Regis RA Faria, Fernando Teubl, Celso Kurashima, Roseli Lopes, and Marcelo Zuffo. 2015. Crosscale: A 3D virtual musical instrument interface. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 199–200.Google ScholarCross Ref
- Anıl Çamcı and Rob Hamilton. 2020. Audio-first VR: new perspectives on musical experiences in virtual environments. Journal of New Music Research 49, 1 (2020), 1–7.Google ScholarCross Ref
- Marko Ciciliani. 2020. Virtual 3D environments as composition and performance spaces. Journal of New Music Research 49, 1 (2020), 104–113.Google ScholarCross Ref
- Willams Costa, Luca Ananias, Iago Barbosa, Bruno Barbosa, André De’Carli, Ricardo R Barioni, Lucas Figueiredo, Veronica Teichrieb, and Daniel Filgueira. 2019. Songverse: a music-loop authoring tool based on Virtual Reality. In 2019 21st Symposium on Virtual and Augmented Reality (SVR). IEEE, 216–222.Google ScholarCross Ref
- Rob Hamilton. 2019. ‘Coretet: A 21st century virtual interface for musical expression. In 14th International Symposium on Computer Music Multidisciplinary Research. 1010.Google Scholar
- Jônatas Manzolli. 2015. Multimodal generative installations and the creation of new art form based on interactive narratives. In Proceedings of the 18th Generative Arts Conference. 32–44.Google Scholar
- Jônatas Manzolli. 2016. DESCOBERTAS: creativity as libretto of a multimodal opera. In 19th Generative Arts Conference. 252–266.Google Scholar
- Jônatas Manzolli. 2018. Multimodal architecture of the Ode to Christus Hypercubus. In XXI Generative Art Conference Proceedings, Milan: Domus Argenia Publisher. 171–182.Google Scholar
- Jonatas Manzolli and Marcos Mucheroni. 2018. Transmediatic architecture of the ode to Christus Hypercubus.Google Scholar
- Miller S Puckette 1997. Pure data. In ICMC.Google Scholar
- Antonio Aquilera Ramírez and Ricardo Pérez Aguila. 2002. A method for obtaining the tesseract by unraveling the 4D hypercube. (2002).Google Scholar
- Stefania Serafin, Ali Adjorlu, Lars Andersen, and Nicklas Andersen. 2019. Singing in Virtual Reality with the Danish National children’s choir. In International Symposium on Computer Music Multidisciplinary Research. Springer, 563–574.Google Scholar
- Luca Turchet, Rob Hamilton, and Anil Çamci. 2021. Music in extended realities. IEEE Access 9 (2021), 15810–15832.Google ScholarCross Ref
- Silvin Willemsen, Razvan Paisa, and Stefania Serafin. 2020. Resurrecting the tromba marina: A bowed virtual reality instrument using haptic feedback and accurate physical modelling. In 17th Sound and Music Computing Conference. Axea sas/SMC Network, 300–307.Google Scholar
Index Terms
- Playing the Hypercube – Using Augmented Reality to Enhance a Multimodal Musical Performance
Recommendations
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented RealityAugmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Comments