Skip to main content
SpringerLink
Log in

Exploring the Theoretical Landscape of BehCreative: Artistic and Therapeutic Possibilities of an Extended Digital Musical Instrument

  • Conference paper
  • First Online:
ArtsIT, Interactivity and Game Creation (ArtsIT 2023)

Included in the following conference series:

  • 45 Accesses

Abstract

In the digital age, technology has become ubiquitous in various fields of knowledge, functioning as an extension of the human body – akin to a technological body. Consequently, it acquires ecological validity in our daily lives and offers a path for developing studies rooted in Embodied Cognition. This idea is illustrated by BehCreative, an Extended Digital Musical Instrument (EDMI) introduced and presented in this article. The article delineates the design, mapping and architecture of BehCreative from both musical and cognitive standpoints. Moreover, it explores how these instruments bridge the divide between traditional musical interfaces and immersive technologies, thereby redefining the limits of artistic expression and therapeutic interventions. The article highlights that BehCreative, as a hybrid instrument, holds the potential to facilitate therapeutic recovery and serve as an artistic tool for expressive purposes. Given its hybrid nature, BehCreative presents diverse possibilities for exploring users’ behavioral learning, as evidenced by the results of a mentioned exploratory study. Consequently, it substantiates the hypothesis of being an instrument that warrants examination from an interdisciplinary perspective.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Boeldt, D., et al.: Using virtual reality exposure therapy to enhance treatment of anxiety disorders: identifying areas of clinical adoption and potential obstacles. Front. Psych. 10, 773 (2019). https://doi.org/10.3389/fpsyt.2019.00773

    Article  Google Scholar 

  2. Grenier, S., et al.: Using virtual reality to improve the efficacy of cognitive-behavioral therapy (CBT) in the treatment of late-life anxiety: Preliminary recommendations for future research. Int. Psychogeriatr. 27(7), 1217–1225 (2015). https://doi.org/10.1017/S1041610214002300

    Article  Google Scholar 

  3. Jerdan, S.W., Grindle, M., Van Woerden, H.C., Boulos, M.N.K.: Head-mounted virtual reality and mental health: critical review of current research. JMIR Serious Games 6(3), e9226 (2018)

    Article  Google Scholar 

  4. Partesotti, E., Peñalba, A., Manzolli, J.: Digital instruments and their uses in music therapy. Nord. J. Music. Ther. 27(5), 399–418 (2018)

    Article  Google Scholar 

  5. Frid, E.: Accessible digital musical instruments—a review of musical interfaces in inclusive music practice. Multimodal Technol. Interact. 3(3), 57 (2019)

    Article  Google Scholar 

  6. Miranda, E.R., Wanderley, M.M.: New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. AR Editions Inc., Middelton, US (2006)

    Google Scholar 

  7. Verschure, P.F., Manzolli, J.: Computational modeling of mind and music (2013)

    Google Scholar 

  8. i Badia, S.B., et al.: The effects of explicit and implicit interaction on user experiences in a mixed reality installation: the synthetic oracle. Teleop. Virtual Environ. 18(4), 277–285 (2009). https://doi.org/10.1162/pres.18.4.277

  9. Gibson, J.J.: The Ecological Approach to Visual Perception. Psychology Press, London (1979)

    Google Scholar 

  10. Swingler, T.: “That Was Me!”: applications of the Soundbeam MIDI controller as a key to creative communication, learning, independence and joy (1998)

    Google Scholar 

  11. Ellis, P.: Developing abilities in children with special needs: a new approach. Child. Soc. 9(4), 64–79 (1995)

    Article  Google Scholar 

  12. Brooks, T., Camurri, A., Canagarajah, N., Hasselbad, S.: Interaction with shapes and sounds as a therapy for special needs and rehabilitation. In: Proceedings of the International Conference on Disability, Virtual Reality and Associated Technology, Veszprem, Hungary, ICDVRAT (2002)

    Google Scholar 

  13. Brooks, A.: Soundscapes: the evolution of a concept, apparatus and method where ludic engagement in virtual interactive space is a supplemental tool for therapeutic motivation. Ph.D. thesis (2011). http://vbn.aau.dk. Accessed 9 April 2022

  14. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  15. Wagner, I., et al.: On the role of presence in mixed reality, 18(4), 249–276 (2009)

    Google Scholar 

  16. Dourish, P.: Where the Action Is. MIT Press, London (2004)

    Google Scholar 

  17. Benford, S., Giannachi, G.: Performing Mixed Reality. MIT Press, Cambridge (2011)

    Google Scholar 

  18. Noë, A., O’Regan, J.K.: On the brain-basis of visual consciousness: a sensorimotor account. Vision and mind: selected readings in the philosophy of perception, pp. 567–598 (2002)

    Google Scholar 

  19. Peñalba, A., Valles, M.J., Partesotti, E., Sevillano, M.Á., Castañón, R.: Accessibility and participation in the use of an inclusive musical instrument: the case of MotionComposer. J. Music Technol. Educ. 12(1), 79–94 (2019)

    Article  Google Scholar 

  20. Holden, M.K.: Virtual environments for motor rehabilitation: review. Cyber Psychol. Behav. 8(3), 187–219 (2005)

    Article  Google Scholar 

  21. Rizzo, A.A., Kim, G.J.: A SWOT analysis of the field of virtual reality rehabilitation and therapy. 14(2), 119–146 (2005)

    Google Scholar 

  22. Partesotti, E.: Extended digital music instruments to empower well-being through creativity. In: Brooks, A.L. (ed.) Creating Digitally. Shifting Boundaries: Arts and Technologies - Contemporary Applications and Concepts, vol. 241, pp. 365–401. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-31360-8_13

  23. Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotorcortex. Brain 119, 593–609 (1996)

    Article  Google Scholar 

  24. Partesotti, E., Feitosa, J.A., Manzolli, J., Castellano, G.: Behavioural changes and multimodal interaction within a performative space: an interdisciplinary investigation. J. Epilepsy Clin. Neurophysiol. (2020). ISSN 1676-2649. Proceedings of 6th Brain Congress, Brazilian Institute of Neuroscience and Neurotechnology

    Google Scholar 

  25. Partesotti, E., Tavares, T.F.: Color and emotion caused by auditory stimuli. In: ICMC (2014)

    Google Scholar 

  26. Iazzetta, F.: Meaning in music gesture. In: Battier, M., Wanderley, M. (eds.) Trends in Gestural Control of Music. IRCAM-Centre Pompidou, Paris, France (2000)

    Google Scholar 

  27. Hunt, A., Wanderley M., Kirk., R.: Towards a model for instrumental mapping in expert musical interaction. In: Proceedings of the 2000 International Computer Music Conference, pp. 209–212. International Computer Music Association, San Francisco (2000)

    Google Scholar 

  28. Cameirão, M.S., Badia, S.B., Duarte, E., Frisoli, A., Verschure, P.F.: The combined impact of virtual reality neurorehabilitation and its interfaces on upper extremity functional recovery in patients with chronic stroke. Stroke 43(10), 2720–2728 (2012). https://doi.org/10.1161/STROKEAHA.112.653196. Epub 7 Aug 2012. PMID: 22871683

  29. Betella, A., Verschure, P.F.: The affective slider: a digital self-assessment scale for the measurement of human emotions. PLoS ONE 11(2), e0148037 (2016)

    Article  Google Scholar 

  30. Partesotti, E., et al.: Analysis of affective behavior in the artistic installation moviescape. In: Brooks, A.L. (ed.) ArtsIT 2022. LNCS, vol. 479, pp. 327–345. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-28993-4_23

    Chapter  Google Scholar 

  31. Koelsch, S.: Investigation emotion with music: neuroscientific approaches. Ann. N. Y. Acad. Sci. 1060, 412–418 (2005). https://doi.org/10.1196/annals.1360.034

    Article  Google Scholar 

  32. Manzolli, J.: A auto-organização como agente do processo criativo e laboratório de significação musical. Acta Scientiarum 44(1), e62240 (2022)

    Google Scholar 

  33. Wassermann, K.C., Eng, K., Verschure, P.F.M.J., Manzolli, J.: Live soundscape composition based on synthetic emotions. IEEE Multimedia 10(4), 82–90 (2003). https://doi.org/10.1109/MMUL.2003.1237553

    Article  Google Scholar 

Download references

Acknowledgement

This research was supported by São Paulo Research Foundation – Brazil (FAPESP) – Grants 2016/22619-0 and 2013/07559-3 and Brazilian National Council for Scientific and Technological Development (CNPq) – Grant 308695/2022-4.

Author information

Authors and Affiliations

  1. University of Campinas (UNICAMP), NICS, Campinas, Brazil

    Elena Partesotti & Jônatas Manzolli

  2. University of Campinas (UNICAMP), Gleb Wataghin Institute of Physics, Campinas, Brazil

    Gabriela Castellano

  3. University of Campinas (UNICAMP), Brazilian Institute of Neuroscience and Neurotechnology, Campinas, Brazil

    Gabriela Castellano

Authors
  1. Elena Partesotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gabriela Castellano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jônatas Manzolli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elena Partesotti .

Editor information

Editors and Affiliations

  1. Aalborg University, Aalborg, Denmark

    Anthony L. Brooks

Rights and permissions

Reprints and permissions

Copyright information

© 2024 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Partesotti, E., Castellano, G., Manzolli, J. (2024). Exploring the Theoretical Landscape of BehCreative: Artistic and Therapeutic Possibilities of an Extended Digital Musical Instrument. In: Brooks, A.L. (eds) ArtsIT, Interactivity and Game Creation. ArtsIT 2023. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 564. Springer, Cham. https://doi.org/10.1007/978-3-031-55319-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-55319-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-55318-9

  • Online ISBN: 978-3-031-55319-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation