Skip to main content
SpringerLink
Log in

EEG-Based Brain-Computer Interface for Emotional Involvement in Games Through Music

  • Chapter
  • First Online:
Book cover Digital Da Vinci

Abstract

The reliability of commercial non-invasive BCI (Brain Computer Interface) devices and the lower cost of these EEG-based systems, determined the increasing interest in their application in different research fields, also thanks to the portability of the equipment. The latter feature makes BCI devices particularly suited for entertainment applications especially due to the possibility to detect the mental state of the users. The relationship between emotions and entertainment is obvious, as the influence of music in human emotional states. While BCI devices represent a challenge in gaming motion control, they have been successfully applied in music production (Dan et al., PloS ONE, 2009) and composition (Hamadicharef et al., CW2010 282–286, 2010). In our previous work (Folgieri et al., Proceedings of the 4th International Conference on Applied Human Factors and Ergonomics, San Francisco, USA) we focused on conscious production of music notes with the aim of developing a prototype for applications in entertainment. In this work we trace the state-of-the art of our research and present our opinion on possible applications of the preliminary obtained results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://csea.phhp.ufl.edu/media/iadsmessage.html.

  2. 2.

    http://www.processsing.org.

  3. 3.

    http://cycling74.com/products/max/.

References

  • Allison BZ, Wolpaw EW, Wolpaw JR (2007) Brain-computer interface systems: progress and prospects. Expert Rev Med Devices 4(4):463–474

    Article  Google Scholar 

  • Ansari-Asl K, Chanel G, Pun T (2007) A channel selection method for EEG classification in emotion assessment based on synchronization likelihood. In: Eusipco 2007, 15th European signal processing conference, Poznan, Poland, 2007

    Google Scholar 

  • bin Yunus J et al (2012) The effect of noise removing on emotional classification. In: IEEE Computer & Information Science (ICCIS), 2012 International Conference on, vol 1, pp 485–489

    Google Scholar 

  • Brown JC (1991) Calculation of a constant q spectral transform. J Acoust Soc Am 89:425

    Article  Google Scholar 

  • Call of Duty. Retrieved 23rd February, 2014, from http://www.callofduty.com

  • Choi S, Cichocki A, Park HM, Lee SY (2005). Blind source separation and independent component analysis: A review. Neural Information Processing-Letters and Reviews, 6(1), 1–57.

    Google Scholar 

  • Comon P (1994) Independent component analysis, a new concept? Signal Process 36(3):287–314

    Google Scholar 

  • Dan W, Chao-Yi L, De-Zhong Y (2009) Scale-free music of the brain. PloS ONE

    Google Scholar 

  • Davidson RJ, Schwartz GE, Saron C, Bennett J, Goleman DJ (1979) Frontal versus parietal EEG asymmetry during positive and negative affect [Abstract]. Psychophysiology 16:202–203

    Google Scholar 

  • Szibbo D, Luo A, Sullivan TJ (2012) Removal of blink artifacts in single channel EEG. In Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE:3511-3514. IEEE.

    Google Scholar 

  • Eckmann J-P, Olifson Kamphorst S, Ruelle D (1987) Recurrence plots of dynamical systems. Europhys Lett 4(9):973–977

    Article  Google Scholar 

  • Emotive System Inc. Retrieved 23rd February, 2014, from http://www.emotiv.com

  • Folgieri, R, Zichella M (2012) Conscious and unconscious music from the brain: design and development of a tool translating brainwaves into music using a BCI device. In: Proceedings of the 4th International conference on applied human factors and Ergonomics, San Francisco, USA, CRC press.

    Google Scholar 

  • Gaetano Valenza AL, Scilingo EP (2012) The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans Affect Comput 3(2):237–249

    Article  Google Scholar 

  • Garcés Correa A, Laciar E, Patiño HD, Valentinuzzi ME (2007) Artifact removal from EEG signals using adaptive filters in cascade. J Phys: Conf Ser 90:012081 (IOP Publishing)

    Google Scholar 

  • Hamadicharef B et al (2010) Brain-Computer Interface (BCI) based musical composition. In: CW2010, pp 282–286

    Google Scholar 

  • Hamilton JD (1994) Time series analysis, vol. 2. Princeton University Press, Princeton

    Google Scholar 

  • Huang D, Zhang H, Ang K, Guan C, Pan Y, Wang C, Yu J (2012, March). Fast emotion detection from EEG using asymmetric spatial filtering. In Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, IEEE, pp. 589–592

    Google Scholar 

  • Hyvärinen A, Oja E (2000) Independent component analysis: algorithms and applications. Neural networks 13(4):411–430

    Google Scholar 

  • Jackson DC, Mueller MJ, Dolski I, Dalton KM, Nitschke JB, Urry HL, Rosenkranz MA, Ryff CD, Singer BH, Davidson RJ (2003) Now you feel it, now you don’t: frontal brain electrical asymmetry and individual differences in emotion regulation. Psychol Sci 14:612–617

    Article  Google Scholar 

  • Keil A, Müller M, Gruber T, Wienbruch C, Stolarova M, Elbert T (2001) Effects of emotional arousal in the cerebral hemispheres: a study of oscillatory brain activity and event-related potentials. Clin Neurophysiol 112(11):2057–2068

    Article  Google Scholar 

  • Kirmizialsan E, Bayraktaroglu Z, Gurvit H, Keskin Y, Emre M, Demiralp T (2006) Comparative analysis of event-related potentials during Go/NoGo and CPT: decomposition of electrophysiological markers of response inhibition and sustained attention. Brain Res 1104(1):114–128. doi:10.1016/j.brainres.2006.03.010

    Article  Google Scholar 

  • Ko M, Bae K, Oh G, Ryu T (2009) A study on new gameplay based on brain-computer interface. In: Barry A, Helen K, Tanya K (eds.) Breaking new ground: innovation in games, play, practice and theory. Proceedings of the 2009 digital games research association conference, Brunel University

    Google Scholar 

  • Lalor EC, Kelly SP, Finucane C, Burke R, Smith R, Reilly RB, McDarby G (2005) Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment. EURASIP journal on applied signal processing, 2005, 3156–3164

    Google Scholar 

  • Laurier C, Sordo M, Serra J, Herrera P (2009) Music mood representations from social tags. In: Proceedings of international society for music information retrieval conference (ISMIR), Kobe, Japan

    Google Scholar 

  • Lee TW (1998). Independent component analysis (pp. 27–66). Springer US.

    Google Scholar 

  • Lu D, Liu L, Zhang H (January 2006) Automatic mood detection and tracking of music audio signals. In IEEE transactions on audio, speech and language processing, vol 14, no 1, pp 5–18

    Google Scholar 

  • Metal Gear Solid. Retrieved 23rd February, 2014, from http://www.konami.jp/kojima_pro/english/index.html

  • Morris JD (1995) SAM: the self-assessment Manikin, an efficient cross-cultural measurement of emotional response. J Advertising Res

    Google Scholar 

  • Mühl C, Gürkök H, Plass-Oude Bos D, Thurlings ME, Scherffig L, Duvinage M, Elbakyan AA, Kang S, Poel M, Heylen DKJ (2010) Bacteria hunt: a multimodal, multiparadigm BCI game. In: Proceedings of the international summer workshop on multimodal interfaces, Genua

    Google Scholar 

  • Müller M, Keil A, Gruber T, Elbert T (1999) Processing of affective pictures modulates right-hemispheric gamma band EEG activity. Clin Neurophysiol 110(11):1913–1920

    Article  Google Scholar 

  • Murugappan M, Nagarajan R, Yaacob S (2009) Appraising human emotions using time frequency analysis based EEG alpha band features. pp 70–75

    Google Scholar 

  • NeuroSky Inc. Retrieved 23rd February, 2014, from http://neurosky.biz

  • Petrantonakis PC, Hadjileontiadis LJ (2012) Adaptive emotional information retrieval from EEG signals in the time-frequency domain. IEEE Trans Signal Process 60(5):2604–2616

    Article  MathSciNet  Google Scholar 

  • Pineda JA, Silverman DS, Vankov A, Hestenes J (2003) Learning to control brain rhythms: making a brain-computer interface possible. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 11(2), 181–184

    Google Scholar 

  • Plass-Oude Bos D, Reuderink B, Laar B, Gürkök H, Mühl C, Poel M, Nijholt A, Heylen D (2010) Brain-computer interfacing and games. In: Tan DS, Nijholt A (eds) Brain-computer interfaces, series human-computer interaction series

    Google Scholar 

  • Resident Evil. Retrieved 23rd February, 2014, from http://www.capcom.co.jp/bio5/

  • Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161–1178

    Article  Google Scholar 

  • Ryu CS, Song Y, Kim SH, Yi I, Kim JE, Sohn JH (1998). A time-frequency analysis of the EEG evoked by negative and positive visual stimuli. In Engineering in Medicine and Biology Society, 1998. Proceedings of the 20th Annual International Conference of the IEEE, IEEE, Vol. 4, pp. 2012–2015

    Google Scholar 

  • Schmidt LA, Fox NA (1999) Conceptual, biological, and behavioral distinctions among different types of shy children. In: Schmidt LA, Schulkin J (eds) Extreme fear, shyness and social phobia: origins, biological mechanisms, and clinical outcomes. Oxford University Press, New York, pp 47–66

    Google Scholar 

  • Schmidt LA, Trainor LJ (2001) Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions. Cognition Emotion 15:487–500

    Article  Google Scholar 

  • Scott M, Anthony JB, Tzyy-Ping J, Terrence JS et al (1996) Independent component analysis of electroencephalographic data. Adv Neur Inform Process Syst :145–151

    Google Scholar 

  • Silent Hill. Retrieved 23rd February, 2014, from http://www.konami.com/games/shh/

  • Sniper Elite. Retrieved 23rd February, 2014, from http://www.microids.com/en/catalogue/28/sniper-elite-berlin-1945.html

  • Stone JV (2005) Independent Component Analysis. Encyclopedia of Statistics in Behavioral Science. Wiley Online Library

    Google Scholar 

  • Tomarken AJ, Davidson RJ, Wheeler RE, Doss RC (1992) Individual differences in anterior brain asymmetry and fundamental dimensions of emotions. J Pers Soc Psychol 62:676–678

    Article  Google Scholar 

  • Tseng KC, Wang YT, Lin BS, Hsieh PH (2012, July). Brain Computer Interface-based Multimedia Controller. In Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2012 Eighth International Conference on, IEEE, pp. 277–280

    Google Scholar 

  • Zhou W, Gotman J (2009) Automatic removal of eye movement artifacts from the eeg using ica and the dipole model. Prog Nat Sci 19(9):1165–1170

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DEMM, Dipartimento di Economia, Management e Metodi quantitativi, Università degli Studi di Milano, Milano, Italy

    Raffaella Folgieri

  2. Dipartimento di Informatica, Università degli Studi di Milano, Milano, Italy

    Mattia G. Bergomi

  3. Ircam, Université Pierre et Marie Curie, Paris, France

    Mattia G. Bergomi

  4. CdL Informatica per la Comunicazione, Università degli Studi di Milano, Milano, Italy

    Simone Castellani

Authors
  1. Raffaella Folgieri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mattia G. Bergomi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Simone Castellani
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Newton Lee Laboratories, LLC, Tujunga, California, USA

    Newton Lee

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Folgieri, R., Bergomi, M., Castellani, S. (2014). EEG-Based Brain-Computer Interface for Emotional Involvement in Games Through Music. In: Lee, N. (eds) Digital Da Vinci. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-0536-2_9

Download citation

  • DOI: https://doi.org/10.1007/978-1-4939-0536-2_9

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4939-0535-5

  • Online ISBN: 978-1-4939-0536-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation