Skip to main content
SpringerLink
Log in
Book cover

International Conference on Immersive Learning

iLRN 2018: Immersive Learning Research Network pp 198–210Cite as

Listen and Play: Auditory-Motor Interaction in a Bard’s Tale Video Game

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 840))

Abstract

Serious video games represent an immersive way of learning, providing an interaction between learning and game-play. Serious games have shown to be motivational and train the player to acquire certain skills. However, designers should find a balance between pedagogical goals and game-mechanics. Recent investigations show the learning benefits that players obtain by playing music-video games and how these games can support players to improve their musical skills due to embodied music cognition. In the current study, we develop a music-video game to improve the pitch recognition of players. We use the LM-GM model to assess the design of the video game. Moreover, a pilot case study was conducted where the participants performed the video game and answered a Game Experience Questionnaire. Thus, we analyzed the player experience and preliminary results display a relation between learning and game-play. Nevertheless, more studies are needed for appraising the learning effects.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Game and Learning Alliance-European Network of Excellence on Serious Games http://www.galanoe.eu.

References

  1. Juul, J.: A Casual Revolution: Reinventing Video Games and Their Players. The MIT Press, Cambridge (2012)

    Google Scholar 

  2. Egenfeldt-Nielsen, S.: What makes a good learning game?: Going beyond edutainment. eLearn Mag. 2, Article No. 2 (2011). https://doi.org/10.1145/1943208.1943210

  3. Prensky, M.: Digital Game-Based Learning. McGraw-Hill, New York (2001)

    Google Scholar 

  4. Arnab, S., Lim, T., Carvalho, M. B., Bellotti, F., de Freitas, S., Louchart, S., Suttie, N., Berta, R., De Gloria, A.: Mapping learning and game mechanics for serious games analysis. Br. J. Educ. Technol. 46, 391–411 (2015). https://doi.org/10.1111/bjet.12113

    Article  Google Scholar 

  5. Malaka, R.: How computer games can improve your health and fitness. In: Göbel, S., Wiemeyer, J. (eds.) GameDays 2014. LNCS, vol. 8395, pp. 1–7. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-05972-3_1

    Chapter  Google Scholar 

  6. de Castell, S., Jenson, J., Thumlert, K.: From simulation to imitation: controllers, corporeality, and mimetic play. Simul. Gaming 45(3), 332–355 (2014). https://doi.org/10.1177/1046878114542316

    Article  Google Scholar 

  7. Juul, J.: The game, the player, the world: looking for a heart of gameness. In: Proceedings of the 2003 DiGRA International Conference: Level Up, pp. 30–45. Utrecht University (2003)

    Google Scholar 

  8. Gajadhar, B.J., de Kort, Y.A.W., IJsselsteijn, W.A.: Shared fun is doubled fun: player enjoyment as a function of social setting. In: Markopoulos, P., de Ruyter, B., IJsselsteijn, W., Rowland, D. (eds.) Fun and Games 2008. LNCS, vol. 5294, pp. 106–117. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88322-7_11

    Chapter  Google Scholar 

  9. Csikszentmihalyi, M.: Flow: The Psychology of Optimal Experience. Harper Perennial, New York (2008)

    Google Scholar 

  10. Hamari, J., Shernoff, D.J., Rowe, E., Coller, B., Asbell-Clarke, J., Edwards, T.: Challenging games help students learn: an empirical study on engagement, flow and immersion in game-based learning. Comput. Hum. Behav. 54(C), 170–179 (2016). https://doi.org/10.1016/j.chb.2015.07.045

    Article  Google Scholar 

  11. Nijs, L., Coussement, P., Moens, B., Amelick, D., Lesaffre, M., Leman, M.: Interacting with the music paint machine: relating the constructs of flow, experience and presence. Interact. Comput. 24(4), 237–250 (2012). https://doi.org/10.1016/j.intcom.2012.05.002

    Article  Google Scholar 

  12. Alexandrovsky, D., Alvarez, K., Walther-Franks, B., Wollersheim, J., Malaka, R.: Jump‘n’rhythm: a video game for training timing skills. In: Weyers, B., Dittmar, A. (eds.) Mensch und Computer 2016 Workshopband. Gesellschaft für Informatik e.V. Achen, Germany (2016). https://doi.org/10.18420/muc2016-ws10-0005

  13. Leman, M.: Embodied Music Cognition and Mediation Technology. MIT Press, Cambridge (2007)

    Google Scholar 

  14. Peppler, K., Downton, M., Lindsay, E., Hay, K.: The Nirvana effect: tapping video games to mediate music learning and interest. Int. J. Learn. Media 3(1), 41–59 (2011). https://doi.org/10.1162/ijlm_a_00062

    Article  Google Scholar 

  15. Lilla, D., Herrlich, M., Malaka, R., Krannich, D.: The influence of music on player performance in exergames for Parkinson’s Patients. In: Herrlich, M., Malaka, R., Masuch, M. (eds.) ICEC 2012. LNCS, vol. 7522, pp. 433–436. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33542-6_46

    Google Scholar 

  16. Lahav, A., Saltzman, E., Schlaug, G.: Action representation of sound: audiomotor recognition network while listening to newly acquired actions. J. Neurosci. 27(2), 308–314 (2007). https://doi.org/10.1523/JNEUROSCI.4822-06.2007

    Article  Google Scholar 

  17. Bangert, M., Haeusler, U., Altenmüller, E.: On practice: how the brain connects piano keys and piano sounds. Ann. N. Y. Acad. Sci. 930, 425–428 (2001). https://doi.org/10.1111/j.1749-6632.2001.tb05760.x

    Article  Google Scholar 

  18. Lahav, A., Boulanger, A., Schlaug, G., Saltzman, E.: The power of listening: auditory-motor interactions in musical training. Ann. N. Y. Acad. Sci. 1060(1), 189–194 (2005). https://doi.org/10.1196/annals.1360.042

    Article  Google Scholar 

  19. Prieto, R., Medina-Medina, N., Paderewski-Rodriguez, P., Gutierrez-Vela, F.L.: Design methodology for educational games based on interactive screenplays. In: Proceedings 2st Congreso de la Sociedad Española para las Ciencias del Videojuego CoSECiVi 2015. CEUR-WS (1394), Barcelona (2015)

    Google Scholar 

  20. Carey, R.: Game design canvas. In: Serious Play Conference, Pittsburgh, PA (2015)

    Google Scholar 

  21. IJsselsteijn, W., Poels, K., de Kort, Y.A.W.: The game experience questionnaire: development of a self-report measure to assess player experiences of digital games (n.d.)

    Google Scholar 

  22. Poels, K., de Kort, Y., Ijsselsteijn, W.: “It is always a lot of fun!”: exploring dimensions of digital game experience using focus group methodology. In: Proceedings of the 2007 Conference on Future Play, pp. 83–184. ACM, Toronto (2007). https://doi.org/10.1145/1328202.1328218

  23. Schiefele, U.: The role of interest in motivation and learning. In: Collins, J.M., Messick, S. (eds.) Intelligence and Personality: Bridging the Gap in Theory and Measurement, pp. 163–194. Lawrence Erlbaum Associates, Mahwah, N.J. (2001)

    Google Scholar 

  24. Cheng, M., She, H., Annetta, L.: Game immersion experience: its hierarchical structure and impact on game-based science learning. J. Comput. Assist. Learn. 31, 232–253 (2015). https://doi.org/10.1111/jcal.12066

    Article  Google Scholar 

  25. Fullagar, C.J., Knight, P.A., Sovern, H.S.: Challenge/skill balance, flow, and performance anxiety. Appl. Psychol.: Int. Rev. 62, 236–259 (2013). https://doi.org/10.1111/j.1464-0597.2012.00494.x

    Article  Google Scholar 

  26. Nacke, L., Lindley, C.: Affective ludology, flow and immersion in a first- person shooter: measurement of player experience. Loading... J. Can. Game Stud. Assoc. 1(5), 1–21 (2009)

    Google Scholar 

  27. Baker, R.S.J.D., D’Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to be frustrated than bored: the incidence, persistence, and impact of learners cognitive affective states during interactions with three different computer-based learning environments. Int. J. Hum.-Comput. Stud. 68(4), 223–241 (2010). https://doi.org/10.1016/j.ijhcs.2009.12.003

    Article  Google Scholar 

  28. Smeddinck, J.D., Herrlich, M., Malaka, R.: Exergames for physiotherapy and rehabilitation: a medium-term situated study of motivational aspects and impact on functional reach. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 4143–4146. ACM, New York (2015). https://doi.org/10.1145/2702123.2702598

  29. Jäncke, L.: From cognition to action. In: Altenmüler, E., Wiesendanger, M., Kesselring, J. (eds.) Motor, Control and the Brain. Oxford University Press (2006). https://doi.org/10.1093/acprof:oso/9780199298723.003.0002

    Chapter  Google Scholar 

  30. Ramos-Mejia, C.M.: La dinmica del violinista. Ricordi Americana (1947)

    Google Scholar 

  31. Suzuki, S.: Suzuki Violin School. Violin Part, vol. 1. Summy-Birchard Inc. (Warner), Los Angeles (1978)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Prof. Eva Verena Schmid, professor of music-pedagogy, for her ideas to improve the game design. First author thanks DAAD for funding her doctoral project. Finally, we also would like to thank Grupo Escolar Simón Bolivar from Xalapa, Mexico for providing the participants of the pilot case study.

Author information

Authors and Affiliations

  1. Digital Media Lab, TZI, University of Bremen, Bremen, Germany

    Katya A. Alvarez-Molina, Aaron Jöllenbeck & Rainer Malaka

Authors
  1. Katya A. Alvarez-Molina
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aaron Jöllenbeck
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rainer Malaka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katya A. Alvarez-Molina .

Editor information

Editors and Affiliations

  1. University of Arkansas, Fayetteville, Arkansas, USA

    Dennis Beck

  2. University of St Andrews, St Andrews, United Kingdom

    Colin Allison

  3. Universidade Aberta, Coimbra, Portugal

    Leonel Morgado

  4. Institute for Information System and Computer System, Graz University of Technology, Graz, Austria

    Johanna Pirker

  5. School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom

    Anasol Peña-Rios

  6. Virginia Tech, Blacksburg, Virginia, USA

    Todd Ogle

  7. Salish Kootenai College, Pablo, Montana, USA

    Jonathon Richter

  8. Institute for Information System and Computer System, Graz University of Technology, Graz, Austria

    Christian Gütl

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alvarez-Molina, K.A., Jöllenbeck, A., Malaka, R. (2018). Listen and Play: Auditory-Motor Interaction in a Bard’s Tale Video Game. In: Beck, D., et al. Immersive Learning Research Network. iLRN 2018. Communications in Computer and Information Science, vol 840. Springer, Cham. https://doi.org/10.1007/978-3-319-93596-6_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93596-6_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93595-9

  • Online ISBN: 978-3-319-93596-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation