Laurens R. Krol
ABSTRACT
This paper introduces a completely hands-free version of Tetris that uses eye tracking and passive brain-computer interfacing (a real-time measurement and interpretation of brain activity) to replace existing game elements, as well as introduce novel ones. In Meyendtris, dwell time-based eye tracking replaces the game's direct control elements, i.e. the movement of the tetromino. In addition to that, two mental states of the player influence the game in real time by means of passive brain-computer interfacing. First, a measure of the player's relaxation is used to modulate the speed of the game (and the corresponding music). Second, when upon landing of a tetromino a state of error perception is detected in the player's brain, this last landed tetromino is destroyed. Together, this results in a multimodal, hands-free version of the classic Tetris game that is no longer hindered by manual input bottlenecks, while engaging novel mental abilities of the player.
- Kai Keng Ang, Zheng Yang Chin, Haihong Zhang, and Cuntai Guan. 2008. Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface. In IEEE International Joint Conference on Neural Networks (IJCNN), 2008. 2390–2397.Google Scholar
- Benjamin Blankertz, Steven Lemm, Matthias S Treder, Stefan Haufe, and Klaus-Robert Müller. 2011. Single-trial analysis and classification of ERP components – A tutorial. NeuroImage 56, 2 (2011), 814–825.Google ScholarCross Ref
- D.H. Cymek, A.C. Venjakob, S. Ruff, O.H.M Lutz, S. Hofman, and M. Roetting. 2014. Entering PIN codes by smooth pursuit eye movements. Journal of Eye Movement Research 7(4) (2014), 1.Google Scholar
- Arnaud Delorme, Tim Mullen, Christian Kothe, Zeynep Akalin Acar, Nima Bigdely-Shamlo, Andrey Vankov, and Scott Makeig. 2011. EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing. Computational Intelligence and Neuroscience 2011, Article 10 (2011), 1 pages. Google ScholarDigital Library
- Kate C Ewing, Stephen H Fairclough, and Kiel Gilleade. 2016. Evaluation of an Adaptive Game that Uses EEG Measures Validated during the Design Process as Inputs to a Biocybernetic Loop. Frontiers in Human Neuroscience 10 (2016), 223.Google ScholarCross Ref
- L. A. Farwell and E. Donchin. 1988. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology 70, 6 (1988), 510–523.Google ScholarCross Ref
- William J Gehring, Yanni Liu, Joseph M Orr, and Joshua Carp. 2012. The errorrelated negativity (ERN/Ne). In Oxford handbook of event-related potential components, Steven J. Luck and Emily S. Kappenman (Eds.). Oxford University Press, New York, NY, 231–291. 0120Google Scholar
- Kiel M Gilleade and Alan Dix. 2004. Using Frustration in the Design of Adaptive Videogames. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE ’04). ACM, New York, NY, USA, 228–232. Google ScholarDigital Library
- Mike Goslin and Mark R Mine. 2004. The Panda3D graphics engine. Computer 37, 10 (2004), 112–114. Google ScholarDigital Library
- K. Holmqvist. 2011. Eye Tracking. A comprehensive guide to methods and measures. Oxford University Press.Google Scholar
- R.J.K. Jakob. 1995. Virtual environments and advanced interface design. In Eye Tracking and Advanced Interface Design, W. Barfield and T.A. III. Furness (Eds.). Oxford University Press, New York, NY, 258–288. Google ScholarDigital Library
- O.H.M. Lutz, A.C. Venjakob, and S. Ruff. 2015. SMOOVS: Towards calibration-free text entry by gaze using smooth pursuit movements. Journal of Eye Movement Research 8(1):2 (2015), 1–11.Google ScholarCross Ref
- David Marshall, Damien Coyle, Shane Wilson, and Michael Callaghan. 2013. Games, Gameplay, and BCI: The State of the Art. IEEE Transactions on Computational Intelligence and AI in Games 5, 2 (2013), 82–99. TCIAIG.2013.2263555Google ScholarCross Ref
- Tim R Mullen, Christian A E Kothe, Yu M Chi, Alejandro Ojeda, Trevor Kerth, Scott Makeig, Tzyy-Ping Jung, and Gert Cauwenberghs. 2015. Real-time neuroimaging and cognitive monitoring using wearable dry EEG. IEEE Transactions on Biomedical Engineering 62, 11 (2015), 2553–2567. TBME.2015.2481482Google ScholarCross Ref
- Janna Protzak, Klas Ihme, and Thorsten O Zander. 2013. A Passive Brain-Computer Interface for Supporting Gaze-Based Human-Machine Interaction. In Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion, Constantine Stephanidis and Margherita Antona (Eds.). Lecture Notes in Computer Science, Vol. 8009. Springer, Berlin Heidelberg, Germany, 662–671. Google ScholarDigital Library
- Sergei L. Shishkin, Yuri O. Nuzhdin, Evgeny P. Svirin, Alexander G. Trofimov, Anastasia A. Fedorova, Bogdan L. Kozyrskiy, and Boris M. Velichkovsky. 2016.Google Scholar
- EEG Negativity in Fixations Used for Gaze-Based Control: Toward Converting Intentions into Actions with an Eye-Brain-Computer Interface. Frontiers in Neuroscience 10 (2016), 528.Google Scholar
- B. van de Laar, H. Gürkök, D. Plass-Oude Bos, M. Poel, and A. Nijholt. 2013. Experiencing BCI Control in a Popular Computer Game. IEEE Transactions on Computational Intelligence and AI in Games 5, 2 (2013), 176–184.Google ScholarCross Ref
- Jacques J. Vidal. 1973. Toward direct brain-computer communication. Annual Review of Biophysics and Bioengineering 2, 1 (1973), 157–180.Google ScholarCross Ref
- Jonathan R. Wolpaw and Dennis J. McFarland. 2008. Brain-Computer Interface Operation of Robotic and Prosthetic Devices. Computer 41 (2008), 52–56. Google ScholarDigital Library
- Jonathan R Wolpaw and Elizabeth W Wolpaw. 2012. Brain-computer interfaces: something new under the sun. In Brain-Computer Interfaces: Principles and practice, Jonathan R Wolpaw and Elizabeth W Wolpaw (Eds.). Oxford University Press, Oxford, UK, 3–12.Google Scholar
- Thorsten O. Zander, Lena M. Andreessen, Angela Berg, Maurice Bleuel, Juliane Pawlitzki, Lars Zawallich, Laurens R. Krol, and Klaus Gramann. 2017. Evaluation of a Dry EEG System for Application of Passive Brain-Computer Interfaces in Autonomous Driving. Frontiers in Human Neuroscience 11 (2017), 78.Google ScholarCross Ref
- Thorsten O. Zander, Jonas Brönstrup, Romy Lorenz, and Laurens R. Krol. 2014. Towards BCI-based Implicit Control in Human-Computer Interaction. In Advances in Physiological Computing, Stephen H. Fairclough and Kiel Gilleade (Eds.). Springer, Berlin, Germany, 67–90.Google Scholar
- Thorsten O. Zander, Matti Gärtner, Christian Andreas Kothe, and Roman Vilimek. 2010. Combining Eye Gaze Input With a Brain-Computer Interface for Touchless Human-Computer Interaction. International Journal of Human-Computer Interaction 27, 1 (2010), 38–51.Google ScholarCross Ref
- Thorsten O. Zander and Sabine Jatzev. 2012. Context-aware brain-computer interfaces: exploring the information space of user, technical system and environment. Journal of Neural Engineering 9, 1 (2012), 016003.Google ScholarCross Ref
- Thorsten O. Zander and Christian Andreas Kothe. 2011. Towards passive braincomputer interfaces: applying brain-computer interface technology to humanmachine systems in general. Journal of Neural Engineering 8, 2 (2011), 025005.Google ScholarCross Ref
Index Terms
- Meyendtris: a hands-free, multimodal tetris clone using eye tracking and passive BCI for intuitive neuroadaptive gaming
Recommendations
Evaluating User Experience of Actual and Imagined Movement in BCI Gaming
Most research on Brain-Computer Interfaces BCI focuses on developing ways of expression for disabled people who are not able to communicate through other means. Recently it has been shown that BCI can also be used in games to give users a richer ...
Playstyles in Tetris: Beyond Player Skill, Score, and Competition
Entertainment Computing – ICEC 2022AbstractIn this study, we looked at playstyles in Tetris in order to explore how players construct meaning in abstract video games. To do this, we looked at playstyles that go beyond metrics related to player skill, score and competition. Indeed, non-...
The Berlin Brain-Computer Interface (BBCI) --- towards a new communication channel for online control in gaming applications
The investigation of innovative Human-Computer Interfaces (HCI) provides a challenge for future multimedia research and development. Brain-Computer Interfaces (BCI) exploit the ability of human communication and control bypassing the classical ...
Comments