Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computer-Human Interaction Research and Applications

CHIRA 2020: Computer-Human Interaction Research and Applications pp 54–73Cite as

Learning Tonal Harmony Through Augmented Reality: Bridging the Gap Between Music Embodiment and Digital Experiences

  • Conference paper
  • First Online:

  • 186 Accesses

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1609))

Abstract

This paper aims to highlight how a technologically augmented approach can help developing tonal harmony awareness in young learners. The proposal is rooted in previous experiences conducted by the same research group and dealing, on one side, with the embodiment of music concepts, and, on the other, with a reenactment of the same activities in the digital domain. To the latter goal, a publicly-available web platform containing three types of exercises has been released. In order to bridge the gap between the physical experiences and their digital counterparts, we present a methodological approach based on the adoption of augmented-reality technologies. Such a vision has driven the design and implementation of an app for mobile devices that incorporates image recognition algorithms.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://musiclab.chromeexperiments.com/.

  2. 2.

    https://www.wizefloor.com/.

  3. 3.

    https://www.smallablearning.com/.

  4. 4.

    A triad consists of three distinct notes: the so-called “root note”, an interval of either minor or major third, and an interval of perfect fifth.

  5. 5.

    A harmonic cadence is a progression of chords that concludes a section or a piece of music.

  6. 6.

    Open Sound Control (OSC) is a protocol for networking sound and multimedia devices for purposes such as musical performance or show control. It was originally intended for sharing music performance data, such as gestures, parameters and note sequences, between digital musical instruments.

  7. 7.

    https://cycling74.com/.

  8. 8.

    BYOD stands for Bring Your Own Device.

  9. 9.

    BVI stands for Blind or Visually Impaired.

  10. 10.

    https://developer.apple.com/swift/.

  11. 11.

    https://developer.apple.com/xcode/swiftui/.

  12. 12.

    https://developer.apple.com/documentation/arkit/.

  13. 13.

    https://developer.apple.com/documentation/scenekit/.

  14. 14.

    JSON, standing for JavaScript Object Notation, is a lightweight data-interchange format based on structured plain text.

References

  1. Afreen, R.: Bring your own device (BYOD) in higher education: opportunities and challenges. Int. J. Emerg. Trends Technol. Comput. Sci. 3(1), 233–236 (2014)

    Google Scholar 

  2. Akeju, O., Butakov, S., Aghili, S.: Main factors and good practices for managing BYOD and IoT risks in a K-12 environment. Int. J. Internet Things Cyber-Assur. 1(1), 22–39 (2018)

    Article  Google Scholar 

  3. Avanzini, F., Baratè, A., Cottini, M., Ludovico, L.A., Mandanici, M.: Developing music harmony awareness in young students through an augmented reality approach. In: Constantine, L., Helfert, M., Holzinger, A., Silva, H.P. (eds.) Proceedings of the 4th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2020), pp. 56–63. SCITEPRESS - Science and Technology Publications, Lda (2020). https://doi.org/10.5220/0010144700560063

  4. Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: A computer-based approach to teach tonal harmony to young students. In: Lane, H., Uhomoibhi, J., Zvacek, S. (eds.) Proceedings of the 11th International Conference on Computer Supported Education (CSEDU 2019), vol. 1, pp. 271–279. SCITEPRESS - Science and Technology Publications, Lda (2019)

    Google Scholar 

  5. Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: Metrics for the automatic assessment of music harmony awareness in children. In: Barbancho, A.M., Barbancho, I., Peinado, A., Tardón, L.J. (eds.) Proceedings of the 16th Sound & Music Computing Conference (SMC 2019), pp. 372–379. SMC (2019)

    Google Scholar 

  6. Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: Songs in music education: design and early experimentation of a web tool for the recognition of harmonic changes. In: Csapó, B., Uhomoibhi, J. (eds.) Proceedings of the 13th International Conference on Computer Supported Education (CSEDU 2021), vol. 1, pp. 709–720. SCITEPRESS - Science and Technology Publications, Lda (2021)

    Google Scholar 

  7. Avanzini, F., Baratè, A., Ludovico, L.A., Mandanici, M.: A web platform to foster and assess tonal harmony awareness. In: Lane, H.C., Zvacek, S., Uhomoibhi, J. (eds.) CSEDU 2019. CCIS, vol. 1220, pp. 398–417. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58459-7_19

    Chapter  Google Scholar 

  8. Azuma, R.T.: A survey of augmented reality. Presence Teleoper. Virtual Environ. 6(4), 355–385 (1997)

    Article  Google Scholar 

  9. Bigand, E.: The influence of implicit harmony, rhythm and musical training on the abstraction of “tension-relaxation schemas’’ in tonal musical phrases. Contemp. Music Rev. 9(1–2), 123–137 (1993)

    Article  Google Scholar 

  10. Bruder, P.: Gadgets go to school: the benefits and risks of BYOD (bring your own device). Educ. Digest 80(3), 15 (2014)

    Google Scholar 

  11. Cabiria, J.: Augmenting engagement: augmented reality in education. In: Increasing Student Engagement and Retention Using Immersive Interfaces: Virtual Worlds, Gaming, and Simulation. Emerald Group Publishing Limited (2012)

    Google Scholar 

  12. Cardoza, Y., Tunks, J.: The bring your own technology initiative: an examination of teachers’ adoption. Comput. Sch. 31(4), 293–315 (2014)

    Article  Google Scholar 

  13. Chang, A., Paz, F., Arenas, J.J., Díaz, J.: Augmented reality and usability best practices: a systematic literature mapping for educational videogames. In: 2018 IEEE Sciences and Humanities International Research Conference (SHIRCON), pp. 1–5. IEEE (2018)

    Google Scholar 

  14. Cheng, G., Guan, Y., Chau, J.: An empirical study towards understanding user acceptance of bring your own device (BYOD) in higher education. Australas. J. Educ. Technol. 32(4) (2016)

    Google Scholar 

  15. Douglas, D.B., Wilke, C.A., Gibson, J.D., Boone, J.M., Wintermark, M.: Augmented reality: advances in diagnostic imaging. Multimodal Technol. Interact. 1(4), 29 (2017)

    Article  Google Scholar 

  16. Euler, L.: Tentamen novae theoriae musicae ex certissismis harmoniae principiis dilucide expositae. Saint Petersburg Academy (1739)

    Google Scholar 

  17. Goodkin, D.: Orff-Schulwerk in the new millennium. Music. Educ. J. 88(3), 17–23 (2001)

    Article  Google Scholar 

  18. He, W., Zhao, L.: Exploring undergraduates’ learning engagement via BYOD in the blended learning classroom. Int. J. Inf. Educ. Technol. 10(2), 159–164 (2020)

    Google Scholar 

  19. Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: NMC Horizon Report: 2014 K-12 Edition. The New Media Consortium (2014)

    Google Scholar 

  20. Kaufmann, H., Dünser, A.: Summary of usability evaluations of an educational augmented reality application. In: Shumaker, R. (ed.) ICVR 2007. LNCS, vol. 4563, pp. 660–669. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73335-5_71

    Chapter  Google Scholar 

  21. Ko, S.M., Chang, W.S., Ji, Y.G.: Usability principles for augmented reality applications in a smartphone environment. Int. J. Hum.-Comput. Interact. 29(8), 501–515 (2013)

    Article  Google Scholar 

  22. Lai, K.W., Khaddage, F., Knezek, G.: Blending student technology experiences in formal and informal learning. J. Comput. Assist. Learn. 29(5), 414–425 (2013)

    Article  Google Scholar 

  23. Lemos, B., Correa, A., Nascimento, M., Lopes, R.: Augmented reality musical app to support children’s musical education. J. Comput. Sci. Inf. Technol. 5(4), 121–127 (2017)

    Google Scholar 

  24. Li, W., Nee, A., Ong, S.: A state-of-the-art review of augmented reality in engineering analysis and simulation. Multimodal Technol. Interact. 1(3), 17 (2017)

    Article  Google Scholar 

  25. Liao, C.C.Y., Cheng, H.N.H., Chang, W.-C., Chan, T.-W.: Supporting parental engagement in a BYOD (bring your own device) school. J. Comput. Educ. 4(2), 107–125 (2017). https://doi.org/10.1007/s40692-017-0085-6

    Article  Google Scholar 

  26. Mandanici, M., Rodà, A., Canazza, S.: The Harmonic Walk: an interactive physical environment to learn tonal melody accompaniment. Adv. Multimed. 2016 (2016)

    Google Scholar 

  27. McLean, K.J.: The implementation of bring your own device (BYOD) in primary [elementary] schools. Front. Psychol. 7, 1739 (2016)

    Article  Google Scholar 

  28. Nelson, D.: BYOD: an opportunity schools cannot afford to miss. Internet@schools 19(5), 12–15 (2012)

    Google Scholar 

  29. Ng, W.: Mobile learning: BYOD and personalised learning. In: Ng, W. (ed.) New Digital Technology in Education, pp. 171–189. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-05822-1_8

    Chapter  Google Scholar 

  30. Riemann, H.: Harmony Simplified: Or the Theory of the Tonal Functions of Chords. Augener & Company (1895)

    Google Scholar 

  31. Rusiñol, M., Chazalon, J., Diaz-Chito, K.: Augmented songbook: an augmented reality educational application for raising music awareness. Multimed. Tools Appl. 77(11), 13773–13798 (2018)

    Article  Google Scholar 

  32. Saa, P., Moscoso-Zea, O., Lujan-Mora, S.: Bring your own device (BYOD): students perception - privacy issues: a new trend in education? In: 2017 16th International Conference on Information Technology Based Higher Education and Training (ITHET), pp. 1–5. IEEE (2017)

    Google Scholar 

  33. Safar, A.H.: BYOD in higher education: a case study of Kuwait university. J. Educators Online 15(2), n2 (2018)

    Article  Google Scholar 

  34. Seitz, J.A.: Dalcroze, the body, movement and musicality. Psychol. Music 33(4), 419–435 (2005)

    Article  Google Scholar 

  35. Sweeny, J.: BYOD in Education. A Report for Australia and New Zealand: Nine Conversations for Successful BYOD Decision Making. Microsoft (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratorio di Informatica Musicale, Dipartimento di Informatica “Giovanni Degli Antoni”, Università degli Studi di Milano, Via G. Celoria 18, Milano, Italy

    Federico Avanzini, Adriano Baratè, Mauro Cottini & Luca Andrea Ludovico

  2. Dipartimento di Didattica della Musica, Conservatorio di Musica “Luca Marenzio”, Piazza A. Benedetti Michelangeli 1, Brescia, Italy

    Marcella Mandanici

Authors
  1. Federico Avanzini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adriano Baratè
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mauro Cottini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luca Andrea Ludovico
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marcella Mandanici
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luca Andrea Ludovico .

Editor information

Editors and Affiliations

  1. Medical University of Graz, Graz, Austria

    Andreas Holzinger

  2. IT - Institute of Telecommunications, Lisboa, Portugal

    Hugo Plácido Silva

  3. Dublin City University, Dublin, Ireland

    Markus Helfert

  4. Madeira Interactive Technologies Institute, Funchal-Madeira, Portugal

    Larry Constantine

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Avanzini, F., Baratè, A., Cottini, M., Ludovico, L.A., Mandanici, M. (2022). Learning Tonal Harmony Through Augmented Reality: Bridging the Gap Between Music Embodiment and Digital Experiences. In: Holzinger, A., Silva, H.P., Helfert, M., Constantine, L. (eds) Computer-Human Interaction Research and Applications. CHIRA 2020. Communications in Computer and Information Science, vol 1609. Springer, Cham. https://doi.org/10.1007/978-3-031-22015-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22015-9_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22014-2

  • Online ISBN: 978-3-031-22015-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation