Skip to main content
SpringerLink
Log in

Adaptive Musical Expression from Automatic Realtime Orchestration and Performance

  • Conference paper
  • First Online:
Book cover Interactive Storytelling (ICIDS 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5334))

Included in the following conference series:

Abstract

When scoring an interactive scene or narration music has to follow its events and development organically. Approaches toward musical nonlinearity are needed. Therefore, the means of orchestration and expressive performance provide a big potential that has not been tapped even a little yet. In this paper we will show how to translate them into the interactive context. But to change musical expression it is not feasible to simply switch hard between different instrumentations and performative styles. We introduce and discuss a new style-independent method for organic and musically believable transitions of compositional and performative expression characteristics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wingstedt, J.: Narrative functions of film music in a relational perspective. In: ISME Proceedings—Sound Worlds to Discover, Spain, International Society for Music Education (2004)

    Google Scholar 

  2. Berndt, A., Hartmann, K.: The Functions of Music in Interactive Media. In: Spierling, U., Szilas, N. (eds.) ICIDS 2008. LNCS, vol. 5334, pp. 126–131. Springer, Heidelberg (2008)

    Google Scholar 

  3. Adorno, T., Eisler, H.: Composing for the Films. Oxford University Press, New York (1947)

    Google Scholar 

  4. Lissa, Z.: Ästhetik der Filmmusik. Henschel, Leipzig (1965)

    Google Scholar 

  5. Karlin, F., Wright, R.: On the Track; A Guide to Contemporary Film Scoring, 2nd edn. Taylor & Francis, New York (2004)

    Google Scholar 

  6. Kirnberger, J.P.: Der allezeit fertige Polonaisen und Menuetten Komponist (1757) trans.: The Ever Ready Composer of Polonaises and Minuets

    Google Scholar 

  7. Mozart, W.A.: Musikalisches Würfelspiel: Anleitung so viel Walzer oder Schleifer mit zwei Würfeln zu componieren ohne musikalisch zu seyn noch von der Composition etwas zu verstehen. Köchel Catalog of Mozart’s Work KV1 Appendix 294d or KV6 516f (1787)

    Google Scholar 

  8. Joplin, S.: Melody Dicer. Carousel Publications, Sparrowbush (1974)

    Google Scholar 

  9. Ratai, J.: Der Jazzwürfel—Ein harmonisches Würfelspiel. Fraunhofer Institut Medienkommunikation (2005), http://netzspannung.org/learning/meimus/jazz/

  10. Berndt, A., Hartmann, K., Röber, N., Masuch, M.: Composition and Arrangement Techniques for Music in Interactive Immersive Environments. In: Audio Mostly 2006: A Conf. on Sound in Games, Piteå, Sweden, Interactive Institute, Sonic Studio Piteå, pp. 53–59 (October 2006)

    Google Scholar 

  11. Wingstedt, J.: REMUPP—a tool for investigating musical narrative functions. In: Audio Mostly 2006: A Conf. on Sound in Games, Piteå, Sweden, Interactive Institute, Sonic Studio Piteå, pp. 42–47 (October 2006)

    Google Scholar 

  12. Chapel, R.H.: Realtime Algorithmic Music Systems From Fractals and Chaotic Functions: Towards an Active Musical Instrument. PhD thesis, University Pompeu Fabra, Department of Technology, Barcelona, Spain (September 2003)

    Google Scholar 

  13. Casella, P., Paiva, A.: MAgentA: An Architecture for Real Time Automatic Composition of Background Music. In: de Antonio, A., Aylett, R.S., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, pp. 224–232. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  14. Casella, P., Paiva, A.: Mediating Action and Music with Augmented Grammars. In: 4th International Workshop on Intelligent Agents, pp. 207–211 (2003)

    Google Scholar 

  15. Hörnel, D.: Lernen musikalischer Strukturen und Stile mit neuronalen Netzen. Shaker Verlag, Aachen (2000)

    Google Scholar 

  16. Ebcioglu, K.: An Expert System for Harmonizing Chorales in the Style of J. S. Bach. In: Balaban, M., Ebcioglu, K., Laske, O. (eds.) Understanding Music with AI: Perspectives on Music Cognition, pp. 294–334. AAAI / MIT Press, Cambridge (1992)

    Google Scholar 

  17. Schottstaedt, W.: Automatic Counterpoint. In: Mathews, M., Pierce, J. (eds.) Current Directions in Computer Music Research. MIT Press, Cambridge (1989) (System Developement Foundation Benchmark)

    Google Scholar 

  18. Löthe, M.: Ein wissensbasiertes Verfahren zur Komposition von frühklassischen Menuetten. PhD thesis, University of Stuttgart, Intelligent System Group, Stuttgart, Germany (2003)

    Google Scholar 

  19. Pachet, F., Roy, P.: Musical Harmonization with Constraints: A Survey. Constraints Journal (2001)

    Google Scholar 

  20. Pachet, F.: The Continuator: Musical Interaction with Style. Journal of New Music Research 32(3), 333–341 (2003)

    Article  Google Scholar 

  21. Biles, J.A.: GenJam: Evolutionary Composition Gets a Gig. In: Proceedings of the 2002 Conference for Information Technology Curriculum, Rochester New York, USA (September 2002)

    Google Scholar 

  22. Mathews, M.V., Moore, F.R.: GROOVE—A Program to Compose, Store, and Edit Functions of Time. Communications of the ACM 13(2), 715–721 (1970)

    Article  Google Scholar 

  23. Gartland-Jones, A.: MusicBlox: A Real-Time Algorithm Composition System Incorporating a Distributed Interactive Genetic Algorithm. In: Raidl, G.R., Cagnoni, S., Cardalda, J.J.R., Corne, D.W., Gottlieb, J., Guillot, A., Hart, E., Johnson, C.G., Marchiori, E., Meyer, J.-A., Middendorf, M. (eds.) EvoIASP 2003, EvoWorkshops 2003, EvoSTIM 2003, EvoROB/EvoRobot 2003, EvoCOP 2003, EvoBIO 2003, and EvoMUSART 2003. LNCS, vol. 2611, pp. 490–501. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  24. Wooller, R.W., Brown, A.R.: Investigating morphing algorithms for generative music. In: Third Iteration: Third International Conference on Generative Systems in the Electronic Arts, Melbourne, Australia (December 2005)

    Google Scholar 

  25. Brown, A.R., Wooller, R.W., Kate, T.: The Morphing Table: A collaborative interface for musical interaction. In: Riddel, A., Thorogood, A. (eds.) Proceedings of the Australasian Computer Music Conference, pp. 34–39. Australian National University Canberra, Canberra (2007)

    Google Scholar 

  26. Livingstone, S.R., Muhlberger, R., Brown, A.R.: Playing with Affect: Music Performance with Awareness of Score and Audience. In: Australasian Computer Music Conference, Queensland, Australia (2005)

    Google Scholar 

  27. Livingstone, S.R., Brown, A.R.: Dynamic Response: Real-Time Adaptation for Music Emotion. In: Australasian Conference on Interactive Entertainment, Sydney, Australia (November 2005)

    Google Scholar 

  28. Livingstone, S.R., Muhlberger, R., Brown, A.R., Loch, A.: Controlling Musical Emotionality: An Affective Computational Architecture for Influencing Musical Emotion. Digital Creativity 18(1), 43–53 (2007)

    Article  Google Scholar 

  29. Friberg, A.: pDM: An Expressive Sequencer with Real-Time Control of the KTH Music-Performance Rules. Computer Music Journal 30(1), 37–48 (2006)

    Article  Google Scholar 

  30. Friberg, A., Bresin, R., Sundberg, J.: Overview of the KTH Rule System for Musical Performance. Advances in Cognitive Psychology, Special Issue on Music Performance 2(2–3), 145–161 (2006)

    Google Scholar 

  31. Berndt, A., Hartmann, K.: Strategies for Narrative and Adaptive Game Scoring. In: Audio Mostly 2007: 2nd Conf. on Interaction with Sound, Ilmenau, Germany (September 2007)

    Google Scholar 

  32. Sevsay, E.: Handbuch der Instrumentationspraxis, 1st edn. Bärenreiter, Kassel (2005)

    Google Scholar 

  33. Berlioz, H., Strauss, R.: Grande Traité d’instrumentation et d’orchestration moderne (Treatise on Instrumentation). Kalmus Edition, New York, USA (1844/1904) translated english publication (1948)

    Google Scholar 

  34. Adler, S.: The Study of Orchestration, 3rd edn. Norton & Company, New York (2002)

    Google Scholar 

  35. Widmer, G., Goebel, W.: Computational Models of Expressive Music Performance: The State of the Art. Journal of New Music Research 33(3), 203–216 (2004)

    Article  Google Scholar 

  36. GRAME: MidiShare Developer Documentation. Computer Music Research Lab, France. 1.91 edn. (January 2006)

    Google Scholar 

  37. Hughes, C.W.: Percy Grainger, Cosmopolitan Composer. The Musical Quarterly 23(2), 127–136 (1937)

    Article  Google Scholar 

  38. Grainger, P.: Grainger on Music. In: Gillies, M., Ross, B.C. (eds.). Oxford University Press, Oxford (1999)

    Google Scholar 

  39. Berndt, A.: Liturgie für Bläser, 2nd edn. Musikverlag Bruno Uetz, Halberstadt (2008) (transl.: Liturgy for Brass)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Simulation and Graphics, Otto-von-Guericke University of Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany

    Axel Berndt & Holger Theisel

Authors
  1. Axel Berndt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Holger Theisel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. FH Erfurt, University of Applied Sciences, Altonaerstr. 25, 99085, Erfurt, Germany

    Ulrike Spierling

  2. TECFA, FPSE, University of Geneva, CH 1211, Genève 4, Switzerland

    Nicolas Szilas

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Berndt, A., Theisel, H. (2008). Adaptive Musical Expression from Automatic Realtime Orchestration and Performance. In: Spierling, U., Szilas, N. (eds) Interactive Storytelling. ICIDS 2008. Lecture Notes in Computer Science, vol 5334. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89454-4_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89454-4_20

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89424-7

  • Online ISBN: 978-3-540-89454-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation