Skip to main content
Springer Nature Link
Log in

Competing and Collaborating Brains: Multi-brain Computer Interfacing

  • Chapter
  • First Online:
Brain-Computer Interfaces

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 74))

Abstract

In this chapter we survey the possibilities of brain-computer interface applications that assume two or more users, where at least one of the users’ brain activity is used as input to the application. Such ‘applications’ were already explored by artists who introduced artistic EEG applications in the early ‘seventies’ of the previous century. These early explorations were not yet supported by advanced signal process methods, simply because there was no computing support possible, and interest in artistic applications faded until it reappeared in more recent years. Research in neuroscience, signal processing, machine learning and applications in medical, assistive BCIs prevailed. It was supported by computer science that provided real-time and off-line processing to analyze and store large amounts of streaming or collected data. With the possibility to access cheap shared and distributed storage and processing power, as it became available in the last decade of the previous century and the first decade of this century, different kinds of BCI applications, following a general interest in digital games, interactive entertainment and social media, became visible. These are domains where experience, fun and emotions are more important than efficiency, robustness and control. BCI provides user and application with a new modality that can be manipulated and interpreted, in addition to other input modalities. This has been explored, but mostly from the point of view of a single user interacting with an application. In this chapter we look at BCI applications where more than one user is involved. Games are among the possible applications and there are already simple games where gamers compete or collaborate using brain signal information from one or more players. We consider extensions of current applications by looking at different types of multi-user games, including massively multi-player online role-playing games. We mention research—distinguishing between active and passive BCI—on multi-participant BCI in non-game contexts that provides us with information about the possibilities of collaborative and competitive multi-brain games and that allows us to develop a vision on such games. The results of the literature study are collected in a table where we distinguish between the various forms of interaction between players (participants) in collaborative and competitive games and team activities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Allison, B.Z., Dunne, S., Leeb, R., del Millan, J.R., Nijholt, A.: Future BNCI: a roadmap for future directions in brain/neuronal computer interaction research. In: DG Information Society and Media (Directorate “ICT Addressing Societal Challenges”, Unit “ICT for Inclusion”) Under the Seventh Framework Programme [FP7/2007-2013] of the European Union. http://bnci-horizon-2020.eu/images/bncih2020/FBNCI_Roadmap.pdf. Accessed 5 June 2014

  2. Azar, A.T., Balas, V.E., Olariu, T.: Classification of EEG-based brain-computer interfaces. In: Iantovics, B., Kountchev, R. (eds) Advanced Intelligent Computational Technologies and Decision Support Systems, Studies in Computational Intelligence, vol. 486, pp. 97–106. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-00467-9_9

  3. Bonnet, L., Lotte, F., Lécuyer, A.: Two brains, one game: design and evaluation of a multi-user BCI video game based on motor imagery. IEEE Trans. Comput. Intell. AI Games 5(2), 185–198 (2013)

    Article  Google Scholar 

  4. Brunner, C., Blankertz, B., Cincotti, F., Kübler, A., Mattia, D., Miralles, F., Nijholt, A., Otal, B., Salomon, P., Müller-Putz, G.R.: BNCI Horizon 2020—Towards a Roadmap for Brain/Neural Computer Interaction. In: Stephanidis, C., Antona, M. (eds.) Universal Access in Human-Computer Interaction (UAHCI 2014), 8th International Conference, Heraklion, Crete, Greece, June 2014. Lecture notes in computer science, vol. 8513, pp. 475–486. Springer, Heidelberg (2014)

    Google Scholar 

  5. Dikker, S.: Neuroscience experiment I: measuring the magic of mutual gaze. (Real-time interactive neuroimaging art installation). In: Collaboration with Marina Abramovic, Matthias Oostrik, and Representatives of the Art and Science: Insights into Consciousness Workshops, The Watermill Center, New York. http://www.youtube.com/watch?v=Ut9oPo8sLJw. Accessed 5 June 2014

  6. Eaton, J., Miranda, E.R.: Real-time notation using brainwave control. In: Bresin, R. (ed.) Proceedings of the 2013 Sound and Music Computing Conference, pp. 130–135. Stockholm, Sweden (2013)

    Google Scholar 

  7. Eckstein, M.P., Das, K., Pham, B.T., Peterson, M.F., Abbey, C.K., Sy, J.L., Giesbrecht, B.: Neural decoding of collective wisdom with multi-brain computing. NeuroImage 59(1), 94–108 (2011)

    Article  Google Scholar 

  8. Fan, Y.-Y., Myles Sciotto, F.: BioSync: an informed participatory interface for audience dynamics and audiovisual content co-creation using mobile PPG and EEG. In: Proceedings 13th International Conference on New Interfaces for Musical Expression (NIME), pp 248–251. KAIST, Daejeon, Korea, May 2013

    Google Scholar 

  9. Gates, C., Subramanian, S., Gutwin, C.: Djs’ perspectives on interaction and awareness in nightclubs. In: Carroll, J.M., Coughlin, J. (eds.) Proceedings of the 6th Conference on Designing Interactive Systems, ACM, pp. 70–79, June 2006

    Google Scholar 

  10. Gürkök, H., Nijholt, A.: Brain-computer interfaces for multimodal interaction: a survey and principles. Human Comput. Interact. 28(5), 292–307 (2012)

    Article  Google Scholar 

  11. Gürkök, H., Nijholt, A., Poel, M.: Brain-computer interface games: towards a framework. In: Herrlich, M., Malaka, R., Masuch, M. (eds.) Proceedings 11th International Conference on Entertainment Computing (ICEC 2012), Lecture Notes in Computer Science, vol. 7522, pp. 144–157. Springer, Heidelberg (2012)

    Google Scholar 

  12. Gürkök, H., Nijholt, A., Poel, M., Obbink, M.: Evaluating a multi-player brain-computer interface game: challenge versus co-experience. Entertainment Comput. 4(3), 195–203 (2013)

    Article  Google Scholar 

  13. Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., Heeger, D.J.: Neurocinematics: the neuroscience of film. Projections 2(1), 1–26 (2008)

    Article  Google Scholar 

  14. Hjelm, S.I., Browall, C.: Brainball: using brain activity for cool competition. In: Proceedings of the First Nordic Conference on Computer-Human Interaction (NordiCHI 2000), Stockholm, Sweden (2000)

    Google Scholar 

  15. Kamiya, J.: Conscious control of brain waves. Psychol. Today 1(11), 56–60 (1968)

    Google Scholar 

  16. Krepki, R., Blankertz, B., Curio, G., Müller, K.R.: The Berlin brain-computer interface (BBCI)—towards a new communication channel for online control in gaming applications. Multimed Tools Appl. 33(1), 73–90 (2007)

    Article  Google Scholar 

  17. van de Laar, B., Gürkök, H., Plass-Oude Bos, D., Nijboer, F., Nijholt, A.: User experience evaluation of brain-computer interfaces. In: Allison, B.Z., et al. (eds.) Towards Practical Brain-Computer Interfaces: Bridging the Gap from Research to Real-World Applications, pp. 223–237. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  18. Le Groux, S., Manzolli, J., Verschure, P.F.M.J., Sanchez, M., Luvizotto, A., Mura, A., Valjamae, A., Guger, C., Prueckl, R., Bernardet, U.: Disembodied and collaborative musical interaction in the multimodal brain orchestra. In: Conference on New Interfaces for Musical Expression (NIME 2010), pp. 309–314 (2010)

    Google Scholar 

  19. Leslie, G., Mullen, T.: MoodMixer: EEG-based collaborative sonification. In: Jensenius A.R., Tveit, A., Godøy, R.I., Overholt, D. (eds.) In: Proceedings 11th International Conference on New Interfaces for Musical Expression (NIME), pp. 296–299. Oslo, Norway (2011)

    Google Scholar 

  20. Maby, E., Perrin, M., Bertrand, O., Sanchez, G., Mattout, J.: BCI could make old two-player games even more fun: a proof of concept with “Connect Four”. Adv. Human Comput. Interact. 2012(124728), 8 (2012)

    Google Scholar 

  21. Makeig, S., Leslie, G., Mullen, T., Sarma, D., Bigdely-Shamlo, N., Kothe, C.: First demonstration of a musical emotion BCI. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) Proceedings of the 4th international conference on Affective computing and intelligent interaction (ACII’11), Part II. Lecture notes in computer science, vol. 6975, pp. 487–496. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  22. Mann, S., Fung, J., Garten, A.: DECONcert: making waves with water, EEG, and music. In: Kronland-Martinet, R., Ystad, S., Jensen, K. (eds.) Computer Music Modeling and Retrieval, 4th International Symposium, CMMR 2007. Lecture notes in computer science, vol. 4969, pp. 487–505. Springer, Heidelberg (2008)

    Google Scholar 

  23. Mealla, S., Väljamäe, A., Bosi, M., Jordà, S.: Let me listen to your brain: physiology-based interaction in collaborative music composition. In: CHI 2011 Workshop paper, pp 1–4 (2011)

    Google Scholar 

  24. Mühl, C., Chanel, G., Allison, B., Nijholt, A.: A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges. Brain Comput. Interfaces 1(2), 66–84 (2014)

    Article  Google Scholar 

  25. Müller, J.V.: Lindenberger U (2012) Intra- and interbrain synchronization and network properties when playing guitar in duets. Front Hum Neurosci. 6(3), 12 (2012)

    Google Scholar 

  26. Nijholt, A., Oude Bos, D., Reuderink, B.: Turning shortcomings into challenges: brain-computer interfaces for games. Entertainment Comput. 1(2), 85–94 (2009)

    Article  Google Scholar 

  27. Nijholt, A., Allison, B.Z., Jacob, R.K.: Brain-computer interaction: can multimodality help? In: 13th International Conference on Multimodal Interaction, Alicante, Spain, pp. 35–39. ACM, NY, USA, Nov 2011

    Google Scholar 

  28. Nijholt, A., Gürkök, H.: Multi-brain games: cooperation and competition. In: Stephanidis, C., Antona, M. (eds.) Proceedings Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for Inclusion. Lecture notes in computer science, vol. 8009, pp. 652–661. Springer, Heidelberg (2013)

    Google Scholar 

  29. O’Hara, K., Sellen, A., Harper, R.: Embodiment in brain-computer interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11), pp. 353–362. ACM, NY, USA

    Google Scholar 

  30. Plass-Oude Bos, D., Reuderink, B., van de Laar, B., Gürkök, H., Mühl, C., Poel, M., Nijholt, A., Heylen, D.: Brain-computer interfacing and games. In: Tan, D., Nijholt, A. (eds.) Brain-Computer Interfaces: Applying Our Minds to Human-Computer Interaction, pp. 149–178. Springer, London (2010)

    Chapter  Google Scholar 

  31. Poli, R., Cinel, C., Matran-Fernandez, A., Sepulveda, F., Stoica, A.: Towards cooperative brain-computer interfaces for space navigation. In: Proceedings of the 2013 International Conference On Intelligent User Interfaces (IUI ‘13), pp. 149–159. ACM, New York, NY, USA (2013)

    Google Scholar 

  32. Pope, A.T., Stevens, C.L.: Interpersonal biocybernetics: connecting through social psychophysiology. Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI ’12), pp. 561–566. Santa Monica, CA, USA, ACM, NY, USA (2012)

    Google Scholar 

  33. Rao, R.P.N., Stocco, A.: Direct brain-to-brain communication in humans: A pilot study. http://homes.cs.washington.edu/~rao/brain2brain/experiment.html. Accessed 5 June 2014

  34. Reuderink, B., Poel, M., Nijholt, A.: The impact of loss of control on movement BCIs. IEEE Trans. Neural Syst. Rehabil. Eng. 19(6), 628–637 (2011)

    Article  Google Scholar 

  35. Rosenboom, R. (ed.): Biofeedback and the arts: results of early experiments. Aesthetic Research Centre of Canada, Vancouver (1976)

    Google Scholar 

  36. Sobell, N.: Streaming the brain. IEEE Multimedia 9(3), 4–8 (2002)

    Google Scholar 

  37. Stephens, G.J., Silbert, L.J., Hasson, U.: Speaker–listener neural coupling underlies successful communication. Proc. Natl. Acad. Sci. U.S.A. 107(32), 14425–14430 (2010)

    Article  Google Scholar 

  38. Stevens, R., Galloway, T., Berka, C., Behneman, A.: A neurophysiologic approach for studying team cognition. In: Proceedings Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), pp 1–8 (2010)

    Google Scholar 

  39. Stoica, A,: MultiMind: multibrain signal fusion to exceed the power of a single brain. In: Proceedings 2012 Third International Conference on Emerging Security Technologies, PP. 94–98. IEEE Computer Society, Lisbon, Portugal (2012)

    Google Scholar 

  40. Szafir, D., Mutlu, B.: Pay attention! Designing adaptive agents that monitor and improve user engagement. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12), Austin, TX, USA, May 2012, pp. 11–20. ACM, New York, USA (2012)

    Chapter  Google Scholar 

  41. Vidal, J.J.: Toward direct brain-computer communication. Ann. Rev. Biophys. Bioeng. 2, 157–180 (1973). doi:10.1146/annurev.bb.02.060173.001105

    Article  Google Scholar 

  42. Wang, Y., Jung, T.P.: A collaborative brain-computer interface for improving human performance. PLoS ONE. www.plosone.org 6(5), e20422:1–11 (2011)

  43. Yuan, P., Wang, Y., Gao, X., Jung, T.-P., Gao, S.: A collaborative brain-computer interface for accelerating human decision making. In: Stephanidis, C., Antona, M. (eds.) Proceedings Universal Access in Human-Computer Interaction: Design Methods, Tools, and Interaction Techniques for eInclusion. Lecture notes in computer science, vol 8009, PP. 672–681. Springer, Heidelberg (2012)

    Google Scholar 

  44. Yuan, P., Wang, Y., Gao, X., Jung, T.-P., Gao, S.: A collaborative brain-computer interface for accelerating human decision making. In: Stephanidis, C., Antona, M. (eds.) Proceedings Universal Access in Human-Computer Interaction: Design Methods, Tools, and Interaction Techniques for eInclusion. Lecture notes in computer science, vol. 8009, PP. 672–681. Springer, Heidelberg (2013)

    Google Scholar 

  45. Yuill, N., Rogers, Y. Mechanisms for collaboration: a design and evaluation framework. ACM Trans. Comput. Human Interact. 19(1), Article 1 (2012)

    Google Scholar 

Download references

Acknowledgements

A preliminary version of this chapter appeared in the LNCS proceedings of the 2013 HCII conference [28]. I’m grateful to Nelson Nijholt for providing information about multi-player games and taking care of some illustrations. This research has been supported by the European Community’s 7th Framework Programme (FP7/2007–2013) under grant agreement Nr. 609593: The Future of Brain/Neuronal Computer Interaction: Horizon 2020 (BNCI Horizon 2020).

Author information

Authors and Affiliations

  1. Human Media Interaction, University of Twente, PO Box 217, 7500 AE, Enschede, The Netherlands

    Anton Nijholt

Authors
  1. Anton Nijholt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anton Nijholt .

Editor information

Editors and Affiliations

  1. Department of Information Technology, Cairo University, Giza, Egypt

    Aboul Ella Hassanien

  2. Faculty of Computers and Information, Benha University, Benha, Egypt

    Ahmad Taher Azar

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Nijholt, A. (2015). Competing and Collaborating Brains: Multi-brain Computer Interfacing. In: Hassanien, A., Azar, A. (eds) Brain-Computer Interfaces. Intelligent Systems Reference Library, vol 74. Springer, Cham. https://doi.org/10.1007/978-3-319-10978-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-10978-7_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10977-0

  • Online ISBN: 978-3-319-10978-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics