Skip to main content
SpringerLink
Log in
Book cover

International Conference on Information Technologies for Performing Arts, Media Access, and Entertainment

ECLAP 2013: Information Technologies for Performing Arts, Media Access, and Entertainment pp 276–287Cite as

Augmented Opera Performance

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7990))

Abstract

Operatic performance has a long and well-established history as a large-scale performance encompassing elements of music, theatre and design. Staging of such productions is an intricate process involving many parties both on the stage and behind the scenes. This paper discusses multimodal and multimedia technologies and techniques that can assist this practice. We look particularly at the conductor, as the controller of temporal progression, leading the various components as a cohesive unit. For this reason, a particular focus is upon the development of methods to communicate cues and information for lighting, visual stimuli and haptic feedback. Previous work that has informed the design of this system is also discussed. The paper concludes with the project’s current status and impact.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Grout, D.J., Williams, H.W.: A short History of Opera, 3rd edn. Columbia University Press, New York (1988)

    Google Scholar 

  2. Siemens, Internet: http://www.siemens.com.br/templates/v2/Contents/timeline-en/timeline.swf (February 6, 2012)

  3. Nakara, T.M.: Inside the conductor’s jacket: Analysis, interpretation and musical synthesis of expressive gesture. Ph.D. dissertation. Dept. Media Arts and Sciences, MIT, Cambridge, MA (2000)

    Google Scholar 

  4. Green, E.: The Modern Conductor. Prentice Hall, Englewood Cliffs (1981)

    Google Scholar 

  5. Boult, A.C.: A Handbook on the Technique of Conducting. Patterson, Lakeland (1976)

    Google Scholar 

  6. Randhofer, R.: By the rivers of babylon: Echoes of the babylonian past in the musical heritage of the Iraqi Jewish diaspora. Ethnomusicology Forum 13, 21–45 (2004)

    Article  Google Scholar 

  7. Haïk-Vantoura, S.: Cheironomy in the ancient world (December 27, 2011), Internet: http://www.rakkav.com/biblemusic/pages/chironomy.htm (January 28, 2012)

  8. Medieval and Renaissance Music (2011), Internet: http://www.essential-humanities.net/western-art/western-music/medieval-and-renaissance-music/ (January 20, 2012)

  9. Gerson-Kiwi, E., Hiley, D.: Cheironomy. Grove Music Online, Internet: http://0-www.oxfordmusiconline.com.wam.leeds.ac.uk/subscriber/article/grove/music/05510?source=omo_gmo&q=cheironomy&article_section=all&search=article&pos=1&_start=1#firsthit (May 11, 2012)

  10. Bent, D.: Notation. Grove Music Online, Internet: http://0-www.oxfordmusiconline.com.wam.leeds.ac.uk/subscriber/article/grove/music/20114pg4 (May 11, 2012)

  11. Jacobson, B.: Conductors on Conducting. Columbia Publishing, Frenchtown (1979)

    Google Scholar 

  12. Bowen, J.A.: The Rise of Conducting. The Cambridge Companion to Conducting. Cambridge University Press, Cambridge (2003)

    Google Scholar 

  13. Serrano, J.G.: Visual perception of simulated conducting motions. A.Mus. D dissertation. University of Arizona (1993)

    Google Scholar 

  14. Neufeld, J., Sinke, C., Dillo, W., Emrich, H.M., Szycik, G.R., Dima, D., Bleich, S., Zedler, M.: The neural correlates of coloured music: A functional MRI investigation of auditory–visual synaesthesia. Neuropsychologia 50, 85–89 (2012)

    Article  Google Scholar 

  15. Paulesu, E., Harrison, J., Baron-Cohen, S., Watson, J.D.G., Goldstein, L., Heather, J., Frackowiak, R.S.J., Frith, C.D.: The physiology of coloured hearing. Brain 118, 661–676 (1995)

    Article  Google Scholar 

  16. Eagleman, D.M., Kagan, A.D., Nelson, S.S., Sagaram, D., Sarma, A.K.: A standardized test battery for the study of synaesthesia. Journal of Neuroscience Methods 159, 139–145 (2007)

    Article  Google Scholar 

  17. Hubbard, T.L.: Synaesthesia-like mappings of light, pitch, and melodic interval. The American Journal of Psychology 109(2), 219–238 (1996)

    Article  Google Scholar 

  18. Marks, L.E.: On associations of light and sound: The mediation of brightness, pitch and loudness. The American Journal of Psychology 87(1/2), 173–188 (1974)

    Article  Google Scholar 

  19. Browne, R.B., Browne, P.: The Guide to United States Popular Culture. Wisconsin Press, Madison (2001)

    Google Scholar 

  20. Scott, K.: Internet: http://www.guardian.co.uk/film/2012/mar/09/4d-vibrating-seats-launched-uk-cinemas (February 7, 2013)

  21. Koslover, R.L., Gleeson, B.T., de Bever, J.T.: Mobile navigation using haptic, audio, and visual direction cues with a handheld test platform. IEEE Transactions on Haptics 5, 33–38 (2012)

    Article  Google Scholar 

  22. Hao, F., Song, A.: Design of a vibrotactile display waistbelt. In: Proc. of the World Congress on Intelligent Control and Automation, WCICA 2010, pp. 5014–5017 (2010)

    Google Scholar 

  23. Nanayakkarai, S.C.: Enhancing Musical Experience for the Hearing-Impaired Using Visual and Haptic Displays. University of Singapore (2009)

    Google Scholar 

  24. Hayes, L., Michalakos, C.: Imposing a networked vibrotactile communication system for improvisational suggestion. Organised Sound 17, 36–44 (2012)

    Article  Google Scholar 

  25. Berdahl, E., Niemeyer, G., Smith, J.O.: Using haptics to assist performers in making gestures to a musical instrument. In: Proc. NIME (2009)

    Google Scholar 

  26. Morita, H., Hashimoto, S., Ohteru, S.: A computer music system that follows a human conductor. Computer 24, 44–53 (1991)

    Article  Google Scholar 

  27. Marrin, T.: Possibilities for the digital baton as a general purpose gestural interface. In: Proc. CHI, pp. 311–312 (1997)

    Google Scholar 

  28. Dannenberg, R.B.: A virtual orchestra for human-computer music performance. In: Proc. ICMC, Huddersfield, pp. 185–188 (2011)

    Google Scholar 

  29. Jones, G., Ong, B., Bruno, I., Ng, K.: Optical Music Imaging: Music document digitisation, recognition, evaluation, and restoration. Interactive Multimedia Music Technologies, 50–79 (2008)

    Google Scholar 

  30. Ng, K.C.: Optical music analysis for printed music score and music handwritten manuscript. In: George, S. (ed.) Visual Perception of Music Notation (2005)

    Google Scholar 

  31. Lighting Control Protocols. Illuminating Engineering Society TM-23-11

    Google Scholar 

  32. Ng, K., Nesi, P.: Interactive Multimedia Music Technologies. Information Science Reference, Hershey (2008)

    Google Scholar 

  33. Puckette, M.: Score following using the sung voice. In: Proc. of the International Computer Music Conference (ICMC), pp. 1–8 (1995)

    Google Scholar 

  34. Armitage, J., Bakanas, P., Balmer, J., Halpin, P., Hudspeth, K., Ng, K.: mConduct: A Multi-Sensor Interface for the Capture and Analysis of Conducting Gesture. In: Proc. of the International Conference of Electronic Visualisation and the Arts (EVA), pp. 229–236 (2012)

    Google Scholar 

  35. Bakanas, P., Armitage, J., Balmer, J., Halpin, P., Hudspeth, K., Ng, K.: mConduct: Gesture Recognition and Reconstruction for Distributed Performance. In: Proc. of the International Conference on Information Technologies for Performing Arts, Media Access and Entertainment (ECLAP), pp. 107–112 (2012)

    Google Scholar 

  36. Armitage, J., Bakanas, P., Balmer, J., Halpin, P., Hudspeth, K., Ng, K.: mConduct: Transcending Domains and Distributed Performance. In: Proc. of the International Computer Music Conference (ICMC) (2012)

    Google Scholar 

  37. Diebel, J.: Representing Attitude: Euler Angles, Unit Quaternions, and Rotation Vectors. Technical Report, Stanford University (2006)

    Google Scholar 

  38. Madgwick, S.: An efficient orientation filter for inertial and inertial/magnetic sensor arrays. Technical Report, Department of Mechanical Engineering, University of Bristol (2010)

    Google Scholar 

  39. Leonard, J., Ng, K.: Music via Motion: A distributed framework for interactive multimedia performance. In: Proceedings of the 17th International Conference on Distributed Multimedia Systems (DMS) (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Music and School of Computing, ICSRiM - University of Leeds, Leeds, LS2 9JT, UK

    Joanne L. Armitage & Kia Ng

Authors
  1. Joanne L. Armitage
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kia Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. DISIT-DSI, Distributed Systems and Internet Technology Lab, Dipartimento di Ingegneria dell’Informazione, DINFO, Università degli Studi di Firenze, Firenze, Italy

    Paolo Nesi

  2. Ex Vetrerie Sciarra, Sapienza, University of Rome, Via dei Volsci, 122, 00185, Rome, Italy

    Raffaella Santucci

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Armitage, J.L., Ng, K. (2013). Augmented Opera Performance. In: Nesi, P., Santucci, R. (eds) Information Technologies for Performing Arts, Media Access, and Entertainment. ECLAP 2013. Lecture Notes in Computer Science, vol 7990. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40050-6_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40050-6_24

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40049-0

  • Online ISBN: 978-3-642-40050-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation