Steven Jiang
ABSTRACT
Spatial music offers an immersive auditory experience by orchestrating sounds, rhythms, and beats to not only envelop the listener but also dynamically move around, behind, and above them. Despite its promise, existing tools for spatial music remain inefficient, with prior research citing the lack of tailored input devices for spatializing in higher dimensions. To address these challenges, we propose a virtual reality (VR) application designed for intuitive music spatialization in 3D space. Users spatialize music by placing and dragging sound sources in VR to animate their movement. Since animating movement can be imprecise, our application incorporates auto-correction features that adjust the movement of sound objects, ensuring a smoother end result.
- Enda Bates. 2009. The composition and performance of spatial music. Ph. D. Dissertation. Trinity College Dublin.Google Scholar
- Adrià M Cassorla, Gavin Kearney, Andy Hunt, Hashim Riaz, Mirek Stiles, and Damian T Murphy. 2020. Augmented Reality for DAW-Based Spatial Audio Creation Using Smartphones.. In Audio Engineering Society Convention 148. Audio Engineering Society.Google Scholar
- Steven Gelineck and Dan Overholt. 2015. Haptic and Visual Feedback in 3D Audio Mixing Interfaces. In Proceedings of the Audio Mostly 2015 on Interaction With Sound (Thessaloniki, Greece) (AM ’15). Association for Computing Machinery, New York, NY, USA, Article 14, 6 pages. https://doi.org/10.1145/2814895.2814918Google ScholarDigital Library
- Justin Mathew, Stéphane Huot, and Alan Blum. 2014. A morphological analysis of audio objects and their control methods for 3d audio. In NIME 2014-14th International Conference on New Interfaces for Musical Expression. Goldsmiths University of London.Google Scholar
- Justin Dan Mathew, Stéphane Huot, and Brian FG Katz. 2017. Survey and implications for the design of new 3D audio production and authoring tools. Journal on Multimodal User Interfaces 11 (2017), 277–287.Google ScholarCross Ref
- Frank Melchior, Chris Pike, Matthew Brooks, and Stuart Grace. 2013. On the use of a haptic feedback device for sound source control in spatial audio systems. In Audio Engineering Society Convention 134. Audio Engineering Society.Google Scholar
- Nils Peters, Georgios Marentakis, and Stephen McAdams. 2011. Current Technologies and Compositional Practices for Spatialization: A Qualitative and Quantitative Analysis. Computer Music Journal 35, 1 (2011), 10–27. https://doi.org/10.1162/COMJ_a_00037Google ScholarDigital Library
- Anders Riddershom Bargum, Oddur Ingi Kristjánsson, Péter Babó, Rasmus Eske Waage Nielsen, Simon Rostami Mosen, and Stefania Serafin. 2022. Spatial Audio Mixing in Virtual Reality. In Sonic Interactions in Virtual Environments. Springer International Publishing Cham, 269–302.Google Scholar
- James Sheridan, Gaurav Sood, Thomas Jacob, Henry J Gardner, Stephen Barrass, 2004. Soundstudio 4D: A VR Interface for Gestural Composition of Spatial Soundscapes.. In ICAD.Google Scholar
- Gaurav Sood and Stephen Barrass. 2003. Groovy tubes: an interface for designing sound effects in space and time. In New Directions in Interaction: Information environments, media and technology, Conference Proceedings 2003 OZCHI Conference. 246–249.Google Scholar
- Matteo Tomasetti and Luca Turchet. 2023. Playing With Others Using Headphones: Musicians Prefer Binaural Audio With Head Tracking Over Stereo. IEEE Transactions on Human-Machine Systems (2023).Google Scholar
- Xue Yu, Stephen DiVerdi, Akshay Sharma, and Yotam Gingold. 2021. ScaffoldSketch: Accurate Industrial Design Drawing in VR. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 372–384. https://doi.org/10.1145/3472749.3474756Google ScholarDigital Library
Index Terms
- Spatializing Music in Virtual Reality
Recommendations
Spatial Audio in Virtual Reality: A systematic review
SVR '23: Proceedings of the 25th Symposium on Virtual and Augmented RealitySpatial Audio represents sound across a full sphere around the listener’s position and is being widely implemented in Virtual Reality and games. However there’s not an extensive body of work in the full benefits of immersive audio in virtual reality, as ...
Cyberdream: An Interactive Rave Music Visualization in Virtual Reality
SA '21 XR: SIGGRAPH Asia 2021 XRVirtual reality (VR) provides new opportunities for the design of interactive music visualizations. Exploring this area, Cyberdream is a prototype VR application realized through the author's practice-led research, which provides a journey through audio-...
The influence of mood induction by music or a soundscape on presence and emotions in a virtual reality park scenario
AM '20: Proceedings of the 15th International Audio Mostly ConferenceMusic and background sound are often used in virtual realities for creating an emotional atmosphere. The present study investigates how music or an ambient soundscape influence presence, the feeling of "being there", as well as positive and negative ...
Comments