Skip to main content
SpringerLink
Log in

A Hat-Integrated HCI System for Serious Games–Proof-of-Concept Applications in Focus Detection and Game Controlling

  • Conference paper
  • First Online:
Games and Learning Alliance (GALA 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14475))

Included in the following conference series:

  • 379 Accesses

Abstract

This paper presents the first prototype and proof-of-concept applications of an everyday hat-integrated human-computer interaction (HCI) system for serious games. Copper textile-based electrodes are integrated into a basic hat, and an HCI system is built around OpenBCI Ganglion device. As proof-of-concept applications, focus detection based on electroencephalography (EEG) and mobile game controlling based on electrooculogram (EOG) are presented. The functionality of these applications is tested by four participants. Based on the achieved results, this hat-integrated HCI system with copper-based textile electrodes can be an effective HCI medium for versatile serious games applications. Calibration of the system must be done for each participant, which will be the focus of our next study in this field. The results of this study are steps towards more user-friendly human-technology interfaces and game controllers, which can be integrated into our daily clothing for versatile serious games applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abdulin, E.R., Komogortsev, O.V.: Person verification via eye movement-driven text reading model. In: 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS), pp. 1–8. IEEE, Arlington, VA, USA (2015). https://doi.org/10.1109/BTAS.2015.7358786

  2. Stiefelhagen, R., Yang, J., Waibel, A.: Estimating focus of attention based on gaze and sound. In: Proceedings of the 2001 workshop on Perceptive User Interfaces, pp. 1–9. ACM, Orlando Florida USA (2001). https://doi.org/10.1145/971478.971505

  3. Bulling, A., Roggen, D., Tröster, G.: It’s in your eyes: towards context-awareness and mobile HCI using wearable EOG goggles. In: Proceedings of the 10th international conference on Ubiquitous Computing, pp. 84–93. ACM, Seoul Korea (2008). https://doi.org/10.1145/1409635.1409647

  4. Li, J., Ngai, G., Va Leong, H., Chan, S.: Multimodal human attention detection for reading. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, pp. 187–192. ACM, Pisa Italy (2016). https://doi.org/10.1145/2851613.2851681

  5. Lin, C.-T., Wu, S.-L., Jiang, W.-L., Jyun-Wei Liang, Chen, S.-A.: A wireless Electrooculography-based human-computer interface for baseball game. In: 2013 9th International Conference on Information, Communications & Signal Processing, pp. 1–4. IEEE, Tainan, Taiwan (2013). https://doi.org/10.1109/ICICS.2013.6782884

  6. Kumar, D., Sharma, A.: Electrooculogram-based virtual reality game control using blink detection and gaze calibration. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 2358–2362. IEEE, Jaipur, India (2016). https://doi.org/10.1109/ICACCI.2016.7732407

  7. Wang, P., Yang, Y., Li, J.: Development of parkour game system using EEG control. In: 2018 International Symposium on Computer, Consumer and Control (IS3C), pp. 258–261. IEEE, Taichung, Taiwan (2018). https://doi.org/10.1109/IS3C.2018.00072

  8. Webster, J.G., Clark, J.W. (eds.): Medical instrumentation: application and design. John Wiley & Sons, Hoboken, NJ (2010)

    Google Scholar 

  9. Heo, J., Yoon, H., Park, K.S.: A novel wearable forehead EOG measurement system for human computer interfaces. Sensors 17(7), 1485 (2007). https://doi.org/10.3390/s17071485

    Article  Google Scholar 

  10. Sawangjai, P., Hompoonsup, S., Leelaarporn, P., Kongwudhikunakorn, S., Wilaiprasitporn, T.: Consumer grade EEG measuring sensors as research tools: a review. IEEE Sensors J. 20, 3996–4024 (2020). https://doi.org/10.1109/JSEN.2019.2962874

    Article  Google Scholar 

  11. Wei, C.-C., Ma, M.-Y.: Influences of visual attention and reading time on children and adults. Read. Writ. Q. 33, 97–108 (2017). https://doi.org/10.1080/10573569.2015.1092100

    Article  Google Scholar 

  12. Vourvopoulos, A., Liarokapis, F.: Evaluation of commercial brain–computer interfaces in real and virtual world environment: a pilot study. Comput. Electr. Eng.. Electr. Eng. 40, 714–729 (2014). https://doi.org/10.1016/j.compeleceng.2013.10.009

  13. Patsis, G., Sahli, H., Verhelst, W., De Troyer, O.: Evaluation of attention levels in a tetris game using a brain computer interface. In: Carberry, S., Weibelzahl, S., Micarelli, A.,  Semeraro, G. (eds.) User Modeling, Adaptation, and Personalization, pp. 127–138. Springer, Berlin  (2013). https://doi.org/10.1007/978-3-642-38844-6_11

  14. Crowley, K., Sliney, A., Pitt, I., Murphy, D.: Evaluating a brain-computer interface to categorise human emotional response. In: 2010 10th IEEE International Conference on Advanced Learning Technologies, pp. 276–278. IEEE, Sousse, Tunisia (2010). https://doi.org/10.1109/ICALT.2010.81

  15. Baskan, A., Goncu-Berk, G.: User experience of wearable technologies: a comparative analysis of textile-based and accessory-based wearable products. Appl. Sci. 12, 11154 (2022). https://doi.org/10.3390/app122111154

    Article  Google Scholar 

  16. Rahman, S.M.M., Mattila, H., Janka, M., Virkki, J.: Impedance evaluation of textile electrodes for EEG measurements. Text. Res. J. 93, 1878–1888 (2023). https://doi.org/10.1177/00405175221135131

    Article  Google Scholar 

  17. Less EMF: Pure Copper Polyester Taffeta. https://lessemf.com/product/pure-copper-polyester-taffeta/

  18. Marcuse, L.V., Fields, M.C., Yoo, J., Rowan, A.J.: Rowan’s primer of EEG. Elsevier, Edinburgh (2016)

    Google Scholar 

  19. Florida Research Instruments Inc: FRI-2147-OpenBCI. http://www.floridaresearchinstruments.com/manuals/saline-openBCI-1-1-printing-version.pdf

  20. OpenBCI Documentation: GUI Widget Guide. https://docs.openbci.com/Software/OpenBCISoftware/GUIWidgets/

  21. Moran, A.: Concentration: attention and performance. In: Murphy, S.M. (ed.) The Oxford Handbook of Sport and Performance Psychology, pp. 117–130. Oxford University Press (2012). https://doi.org/10.1093/oxfordhb/9780199731763.013.0006

  22. Näsi, M., Koivusilta, L.: Internet and everyday life: the perceived implications of internet use on memory and ability to concentrate. Cyberpsychol. Behav. Soc. Netw.. Behav. Soc. Netw. 16, 88–93 (2013). https://doi.org/10.1089/cyber.2012.0058

    Article  Google Scholar 

  23. Chayer, C., Freedman, M.: Frontal lobe functions. Curr. Neurol. Neurosci. Rep.. Neurol. Neurosci. Rep. 1, 547–552 (2001). https://doi.org/10.1007/s11910-001-0060-4

    Article  Google Scholar 

  24. Robertson, I.H., Manly, T., Andrade, J., Baddeley, B.T., Yiend, J.: `Oops!’: performance correlates of everyday attentional failures in traumatic brain injured and normal subjects. Neuropsychologia 35, 747–758 (1997). https://doi.org/10.1016/S0028-3932(97)00015-8

    Article  Google Scholar 

  25. Heilman, K.M., Valenstein, E., Heilman, K.M. (eds.): Clinical neuropsychology. Oxford Univ. Press, New York (2012)

    Google Scholar 

  26. McGough, O.H., Mayhorn, C.B..: In Response to warnings: exploring individual differences in sustained attention performance. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 66, 231–235 (2022). https://doi.org/10.1177/1071181322661095

  27. Rooth, M.: A theory of focus interpretation. Nat. Lang. Seman. 1, 75–116 (1992). https://doi.org/10.1007/BF02342617

    Article  Google Scholar 

  28. Barea, R., Boquete, L., Mazo, M., Lopez, E.: System for assisted mobility using eye movements based on electrooculography. IEEE Trans. Neural Syst. Rehabil. Eng. 10, 209–218 (2002). https://doi.org/10.1109/TNSRE.2002.806829

    Article  Google Scholar 

  29. Golrou, A., Rafiei, N., Sabouri, M.: Wheelchair controlling by eye movements using eog based human machine interface and artificial neural network. IJCA 184, 12–18 (2022). https://doi.org/10.5120/ijca2022922465

    Article  Google Scholar 

  30. Hosni, S.M., Shedeed, H.A., Mabrouk, M.S., Tolba, M.F.: EEG-EOG based virtual keyboard: toward hybrid brain computer interface. Neuroinform 17, 323–341 (2019). https://doi.org/10.1007/s12021-018-9402-0

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tampere University, 33100, Tampere, Finland

    S. M. Musfequr Rahman, Asif Shaikh, Henna Mattila, Tarmo Lipping, Pasi Raumonen & Johanna Virkki

  2. Satakunta University of Applied Sciences, 28130, Pori, Finland

    Merilampi Sari

Authors
  1. S. M. Musfequr Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Asif Shaikh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henna Mattila
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tarmo Lipping
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Merilampi Sari
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Pasi Raumonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Johanna Virkki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. M. Musfequr Rahman .

Editor information

Editors and Affiliations

  1. Technological University Dublin, Dublin, Ireland

    Pierpaolo Dondio

  2. Technological University Dublin, Dublin, Ireland

    Mariana Rocha

  3. University of Galway, Galway, Ireland

    Attracta Brennan

  4. Berlin School of Economics and Law, Berlin, Germany

    Avo Schönbohm

  5. CAPTRS, Austin, TX, USA

    Francesca de Rosa

  6. Tampere University, Tampere, Finland

    Antti Koskinen

  7. University of Genova, Genoa, Italy

    Francesco Bellotti

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rahman, S.M.M. et al. (2024). A Hat-Integrated HCI System for Serious Games–Proof-of-Concept Applications in Focus Detection and Game Controlling. In: Dondio, P., et al. Games and Learning Alliance. GALA 2023. Lecture Notes in Computer Science, vol 14475. Springer, Cham. https://doi.org/10.1007/978-3-031-49065-1_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49065-1_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49064-4

  • Online ISBN: 978-3-031-49065-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation