Skip to main content
SpringerLink
Log in

Musical Sonification of Avatar Physiologies, Virtual Flight and Gesture

  • Conference paper
  • First Online:
Sound, Music, and Motion (CMMR 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8905))

Included in the following conference series:

Abstract

Virtual actors moving through interactive game-space environments create rich streams of data that serve as drivers for real-time musical sonification. The paradigms of avian flight, biologically-inspired kinesthetic motion and manually-controlled avatar skeletal mesh components through inverse kinematics are used in the musical performance work ECHO::Canyon to control real-time synthesis-based instruments within a multi-channel sound engine. This paper discusses gestural and control methodologies as well as specific mapping schemata used to link virtual actors with musical characteristics.

All environment and character modeling, custom animations and art direction for ECHO::Canyon were created by artist Chris Platz.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Unreal Development Kit by Epic Software. http://www.udk.com.

References

  1. Aristidou, A., Lasenby, J.: Inverse kinematics: a review of existing techniques and introduction of a new fast iterative solver. Technical Report, Cambridge (2009)

    Google Scholar 

  2. Bencina, R.: Oscpack (2006). http://code.google.com/p/oscpack

  3. Berthaut, F., Hachet, M., Desainte-Catherine, M.: Interacting with the 3D reactive widgets for musical performance. J. New Music Res. 40(3), 253–263 (2011)

    Article  Google Scholar 

  4. Cerqueira, M., Salazar, S., Wang, G.: Soundcraft: transducing starcraft. In: Proceedings of the New Interfaces for Musical Expression Conference, Daiejon, pp. 243–247 (2013)

    Google Scholar 

  5. Choi, H., Wang, G.: LUSH : an organic eco + music system. In: Proceedings of the New Interfaces for Musical Expression Conference, Sydney, pp. 112–115 (2010)

    Google Scholar 

  6. Dahl, S., Bevilacqua, F., Bresin, R., Clayton, M., Leante, L., Poggi, I., Rasamimanana, N.: Gestures in performance. In: Godøy, R., Leman, M. (eds.) Musical Gestures: Sound, Movement, and Meaning, pp. 36–68. Routledge, New York (2010)

    Google Scholar 

  7. Davis, T., Karamanlis, O.: Gestural control of sonic swarms: composing with grouped sound Objects. In: The Proceedings of the 4th Sound and Music Computing Conference, Lefkada, Greece, pp. 192–195 (2007)

    Google Scholar 

  8. Furukawa, K., Fujihata, M., Muench, W.: small_fish (2000). http://hosting.zkm.de/wmuench/small_fish

  9. Hamilton, R.: Q3OSC: or how I learned to stop worrying and love the game. In: Proceedings of the International Computer Music Conference, Copenhagen (2008)

    Google Scholar 

  10. Hamilton, R.: Sonifying game-space choreographies with UDKOSC. In: Proceedings of the New Interfaces for Musical Expression Conference, Daiejon, pp. 446–449 (2013)

    Google Scholar 

  11. Hamilton, R., Caceres, J., Nanou, C., Platz, C.: Multi-modal musical environments for mixed-reality performance. JMUI 4(3–4), 147–156 (2011)

    Google Scholar 

  12. Jensenius, A., Wanderley, M., Godøy, R., Leman, M.: Musical gestures: concepts and methods of research. In: Godøy, R., Leman, M. (eds.) Musical Gestures: Sound, Movement, and Meaning, p. 13. Routledge, New York (2010)

    Google Scholar 

  13. Lehar, S.: Gestalt Isomorphism and the primacy of subjective conscious experience: a gestalt bubble model. Behav. Brain Sci. 26(4), 375–444 (2004). Cambridge University Press

    Google Scholar 

  14. Malham, D., Myatt, A.: 3-D sound spatialization using ambisonic techniques. Comput. Music J. 19(4), 58–70 (1995). Winter

    Article  Google Scholar 

  15. McCarthy, J.: SuperCollider. http://supercollider.sourceforge.net

  16. Oliver, J.: q3apd (2008). http://www.selectparks.net/archive/q3apd.htm

  17. Paul, L.J.: Video game audio prototyping with half life 2. Transdisciplinary Digital Art. Sound, Vision and the New Screen. Communications in Computer and Information Science, vol. 7, pp. 187–198. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  18. Sirikata (2009). http://www.sirikata.com

  19. Verron, C., Drettakis, G.: Procedural audio modeling for particle-based environmental effects. In: Proceedings of the 133rd AES Convention, San Francisco (2012)

    Google Scholar 

  20. Wright, M., Freed, A.: Open sound control: a new protocol for communicating with sound synthesizers. In: Proceedings of the International Computer Music Conference, Thessaloniki (1997)

    Google Scholar 

  21. Zehnder, S., Lipscomb, S.: The role of music In video games. In: Vorderer, P., Bryant, J. (eds.) Playing Video Games: Motives, Responses, and Consequences, pp. 282–303. Lawrence Erlbaum Associates, Routledge, New York (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Computer Research in Music and Acoustics, Stanford University, Stanford, USA

    Robert Hamilton

Authors
  1. Robert Hamilton
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robert Hamilton .

Editor information

Editors and Affiliations

  1. CNRS - LMA, Marseille, France

    Mitsuko Aramaki

  2. Toulon-Var University and CNRS - LMA, Marseille, France

    Olivier Derrien

  3. CNRS - LMA, Marseille, France

    Richard Kronland-Martinet

  4. CNRS - LMA, Marseille, France

    Sølvi Ystad

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Hamilton, R. (2014). Musical Sonification of Avatar Physiologies, Virtual Flight and Gesture. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham. https://doi.org/10.1007/978-3-319-12976-1_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12976-1_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12975-4

  • Online ISBN: 978-3-319-12976-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation