Skip to main content
Springer Nature Link
Log in

Soundscapes/Artabilitation – Evolution of a Hybrid Human Performance Concept, Method & Apparatus Where Digital Interactive Media, The Arts, & Entertainment are Combined

  • Chapter
  • First Online:
Handbook of Multimedia for Digital Entertainment and Arts

Abstract

‘SoundScapes’ is a body of empirical research that for almost two decades has focused upon investigating noninvasive gesture control of multi-sensory stimuli and potential uses in therapy and the arts. In this context noninvasive gesture refers to motion in invisible activity zones of a system input device utilizing technology outside of human vision. Especially targeted are disabled people of all ages, and special focus has been on the profoundly impaired who especially have limited opportunities for creative self-articulation and playful interaction. The concept has been explored in various situations including: - live stage performances; interactive room installations for museums, workshops, and festivals; and in health-care sessions at hospitals, institutes and special schools. Multifaceted aspects continuously cross-inform in a systemic manner, and each situation where the motion-sensitive environment is applied is considered as a hybrid system. Whilst simplistic in concept, i.e. learning by playful and creative doings, inherent are complexities of optimizing the interactive system to user-experience and evaluation of same. This chapter presents the system in context to its conceived-for-target community; it also presents the parallel practice-led investigations in performance art. Reciprocal design and reflective cross-analysis of the activities has resulted such that performance informs design and strategies of intervention and evaluation with impaired users, and vice versa.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.soundbeam.co.uk

  2. 2.

    http://www.ArtAbilitation.net

  3. 3.

    http://www.icdvrat.reading.ac.uk/2008/interpretations.htm

  4. 4.

    http://www.medialogy.eu

References

  1. K. E. Misulis. “Essentials of Clinical Neurophysiology.” Butterworth-Heinemann, 1997.

    Google Scholar 

  2. A. Lucier. “Statement On:luciermisulis Music for Solo Performer.” In: D. Rosenboom (Ed.), Biofeedback and the Arts, Results of Early Experiments. Aesthetic Research Center of Canada Publications, 1976.

    Google Scholar 

  3. D. Warner. “Rock ’n roll Science:warner Playing the Body Electric” [online] Available from http://www.virtualgalen.com/virtualhealing/dr-dave.htm.

  4. A. L. Brooks, A. Camurri, N. Canagarajah and S. Hasselblad. “Interaction with shapes and sounds as a therapy for special needs and rehabilitation.” In:brooks International Conference on Disability, Virtual Reality and Associated Technologies (4th). Veszprém, Hungary, 18–20 September. P. Sharkey, C. S. Lányi, and P. Standen, (Eds.). Reading: University of Reading, pp. 205–212, 2002.

    Google Scholar 

  5. A. L. Brooks. Robotic Synchronized to Human Gesture as a Virtual Coach in (Re)habilitation Therapy. In: 3rd International Workshop on Virtual Rehabilitation (IWVR2004), VRlab, EPFL, Lausanne, Switzerland, pp. 17–16, 2004.

    Google Scholar 

  6. E. Petersson and A. Brooks. Non-formal therapy and learning potentials through human gesture synchronized to robotic gesture. International Journal Universal Access in the Information Society. Springer 6(2), pp. 167–177, 2007.

    Article  Google Scholar 

  7. W. M. Marston. Emotions of Normal People, Routledge, 1928.

    Google Scholar 

  8. A. L. Brooks. SoundScapes: A concept of Virtual Interactive Space (V.I.S.) [unpublished]. World Summit for Social Development/NGO Forum 6–12 March, Holmen, Copenhagen, 1995.

    Google Scholar 

  9. A. L. Brooks. Virtual interactive space (V.I.S.) as a movement capture interface tool giving multimedia feedback for treatment and analysis. In: “Bridging Cultures” – program of The 13th International Congress of the World Confederation for Physical Therapy, Yokohama Japan, May 23–28, Science Links Japan: http://sciencelinks.jp/jeast/article/200110/000020011001A0418015.php, 1999.

  10. A. L. Brooks. Virtual interactive space (V.I.S.). In: ‘Pushing the limits: optimising potential through science and technology’, Congress Program and Abstract Book, 5th Scientific Congress, Sydney 2000 Paralympic Games, Oct. 11–13, Convention Centre, Darling Harbor, Sydney, Australia, 2000.

    Google Scholar 

  11. A. L. Brooks. HUMANICS 1 – a feasibility study to create a home internet based telehealth product to supplement acquired brain injury therapy. In: International Conference on Disability, Virtual Reality and Associated Technologies (5th). Oxford University, UK, 20–22 September 2004. Sharkey, P., McCrindle, R. and Brown, D. (eds.) Reading: University of Reading, pp. 43–50, 2004.

    Google Scholar 

  12. A. L. Brooks and E. Petersson. Recursive reflection and learning in raw data video analysis of interactive ‘play’ environments for special needs health care. In: Proceedings of 7th International Workshop on Enterprise networking and Computing in Healthcare Industry, Korea HEALTHCOM 2005, IEEE Signal Processing Society, USA, pp. 83–87, 2005.

    Google Scholar 

  13. A. L. Brooks and S. Hasselblad. Creating aesthetically resonant environments for the handicapped, elderly and rehabilitation: Sweden. Proceedings of 6th International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT), Esbjerg, Denmark, 18th–20th September, pp. 191–198, 2004.

    Google Scholar 

  14. A. L. Brooks. Enhanced Gesture Capture in Virtual Interactive Space. Computers in Art, Design, and Education (CADE), 29 June–01 July, Copenhagen Business School, Denmark and Malmö University, Sweden, 2004.

    Google Scholar 

  15. A. L. Brooks and E. Petersson. Stillness design attributes in non-formal rehabilitation: CADE2007 - Computers in Art Design and Education. Perth, Curtin University of Technology, pp. 36–44, 2007.

    Google Scholar 

  16. G. Goldkuhl and P. J. Ågerfalk. “Actability: A way to understand information systems pragmatics.” CMTO Research papers No. 2000:13, Linköping University. Presented at the 3rd International Workshop on Organisational Semiotics, 4 July 2000, Stafford, UK, 2000.

    Google Scholar 

  17. P. J. Ågerfalk and S. Cronholm. “Usability versus Actability: A Conceptual Comparative Analysis.” Presented at the HCI International conference New Orleans, USA, Lawrence Erlbaum and Associates, pp. 235–237, 2001.

    Google Scholar 

  18. A. N. Leont’ev. “Activity, consciousness and personality.” NJ: Prentice-Hall, Englewood Cliffs, 1981.

    Google Scholar 

  19. R. Davies. “Commentary on P. J. Standen and D. J. Brown – Virtual Reality in Rehabilitation of People with Intellectual Disabilities: Review.” CyberPsychology and Behavior, 8(3), 2005.

    Google Scholar 

  20. A. L. Brooks and E. Petersson. “Play Therapy Utilizing the Sony EyeToyⓇ.” In: Annual International Workshop on Presence (8th), London, 21–23 September 2005. Slater, M. (ed.) London: University College London, pp. 303–314, 2005.

    Google Scholar 

  21. C. Hummels, T. Djajadiningrapt, and K. Overbeeke. “Knowing, doing and feeling: Communicating with your digital products. Interdisziplinäres Kolleg Kognitions und Neurowissenschaften, Günne am Möhnesee, March 2–9, pp. 289–308, 2001.

    Google Scholar 

  22. B. Buxton. “Sketching User Experiences: getting the design right and the right design,” Elsevier, 2007.

    Google Scholar 

  23. M. Polanyi. “Personal Knowledge: Towards a Post-Critical Philosophy,” Routledge, 2002 [1958].

    Google Scholar 

  24. R. Wollheim. “Art and Its Objects,” 2nd ed., Cambridge University press, 1980.

    Google Scholar 

  25. P. Ellis. “Layered analysis: A video-based qualitative research tool to support the development of a new approach for children with special needs.” The Bulletin for the Council for Research in Music Education. University of Illinois at Urbana-Champaign, USA, 130, pp.65–74, 1996.

    Google Scholar 

  26. P. Ellis. “Caress – ‘an endearing touch’.” In: J. Siraj-Blatchford (ed.) Developing New Technologies for Young Children. London: Trentham Books, pp. 113–137, 2004.

    Google Scholar 

  27. A. Pollini, Experimenting with an Ubiquitous Computing Open Architecture, [PhD Thesis] http://www.ist-palcom.org/publications/files/PhD-Thesis-Pollini.pdf, 2008

  28. E. Petersson and A. L. Brooks. ArtAbilitation{ $Ⓡ$}: An Interactive Installation for the Study of Action and Stillness Cycles in Responsive Environments. Computers in Art, Design, and Education (CADE 2007) http://cedar.humanities.curtin.edu.au/conferences/cade/pdf/CADE2007Conferenc eprogram&abstracts.pdf, 2007.

  29. A. L. Brooks. Towards a platform of alternative and adaptive interactive systems for idiosyncratic special needs, Proc. 7th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies with ArtAbilitation, pp 319–326, Maia, Portugal, 8–11 Sept. 2008.

    Google Scholar 

  30. B. K. Wiederhold. Virtual Healers, International Association for CyberTherapy & Rehabilitation, 2007.

    Google Scholar 

  31. G. Kress and T. van Leeuwen. “Reading Images. The Grammar of Visual Design.” London, Routledge, 1996.

    Google Scholar 

  32. J. S. Bruner. “Nature and Uses of Immaturity.” In: J. S. Bruner, A. Jolly and K. Sylva (eds.), Play – Its Role in Development and Evolution. Basic Books, 1976

    Google Scholar 

  33. F. A. Beach. “Comparison of Copulatory Behavior of Male Rats Raised in Isolation, Cohabitation, and Segregation.” Journal of Genetic Psychology, 60, pp. 121–136, 1942.

    Google Scholar 

  34. Z. Yan and K. Fischer. “Always Under Construction: Dynamic variations in adult cognitive development,” Human Development, 45, pp. 141–160, 2002.

    Article  Google Scholar 

  35. M. Csikszentmihályi. Creativity: Flow and the Psychology of Discovery and Invention. New York: Harper Perennial, 1996.

    Google Scholar 

  36. J. Löwgren and E. Stolterman. Thoughtful Interaction Design, Boston, MIT, 2005.

    Google Scholar 

  37. B. Eaglestone and P. D. Bamidis. “Music composition for the multi-disabled: A systems perspective.” Disability Human Development, 7(1), pp. 19–24, 2008.

    Google Scholar 

  38. A. L. Brooks. Interpretations: inter-sensory stimulation concept targeting inclusive access offering appreciation of classical music for all ages, standing, & disability, Proc. 7th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies with ArtAbilitation, pp 15–22, Maia & Porto, Portugal, 8–11 Sept. 2008.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Medialogy, University Esbjerg, Aalborg, Denmark

    A. L. Brooks

Authors
  1. A. L. Brooks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. L. Brooks .

Editor information

Editors and Affiliations

  1. Dept. Computer Science &, Florida Atlantic University, Glades Road 777, Boca Raton, 33431, U.S.A.

    Borko Furht

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Brooks, A.L. (2009). Soundscapes/Artabilitation – Evolution of a Hybrid Human Performance Concept, Method & Apparatus Where Digital Interactive Media, The Arts, & Entertainment are Combined. In: Furht, B. (eds) Handbook of Multimedia for Digital Entertainment and Arts. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-89024-1_31

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-89024-1_31

  • Published:

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-89023-4

  • Online ISBN: 978-0-387-89024-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics