Abstract
This paper describes “Neurochat”, a novel artistic Brain Computer Interface (aBCI) application that allows users to explore the combination of art and brain activity in a live online chat experience. This new interaction method enables users to video-chat online while expressing themselves using artistic facial filters that represent their real-time affective state, generated from electroencephalogram (EEG) brain activity from a mobile EEG headset. This paper discusses motivations for creating such an application by giving an overview of the current state of the art in aBCI. It also discusses the architecture of the created system, including the associated application components, application flow, design of facial filters with the descriptions of their associated affective state, and classification method that was used. Additionally, a preliminary user study was conducted to investigate the effect of the application combined with an existing online video-chatting method, Google Hangouts, to gain insight on user perspective towards the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andujar, M., Crawford, C.S., Nijholt, A., Jackson, F., Gilbert, J.E.: Artistic brain-computer interfaces: the expression and stimulation of the user’s affective state. Brain-Comput. Interfaces 2–3, 60–69 (2015)
Brooke, J.: Sus: A “quick and dirty” usability. Usability Evaluation in Industry (1996)
Lieblein, R., Hunter, C., Garcia, S., Andujar, M., Crawford, C.S., Gilbert, J.E.: NeuroSnap: expressing the user’s affective state with facial filters. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2017. LNCS (LNAI), vol. 10285, pp. 345–353. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58625-0_25
Magazine, M.: Directshow: core media technology in windows XP empowers you to create custom audio/video processing components (2002)
McClinton, W., Caprio, D., Laesker, D., Pinto, B., Garcia, S., Andujar, M.: P300-based 3D brain painting in virtual reality. In: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–6 (2019)
McClinton, W., Garcia, S., Andujar, M.: An immersive brain painting: the effects of brain painting in a virtual reality environment. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) HCII 2019. LNCS (LNAI), vol. 11580, pp. 436–445. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22419-6_31
Prpa, M., Pasquier, P.: Brain-computer interfaces in contemporary art: a state of the art and taxonomy. In: Nijholt, A. (ed.) Brain Art, pp. 65–115. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14323-7_3
Reuderink, B., Mühl, C., Poel, M.: Valence, arousal and dominance in the EEG during game play. Int. J. Auton. Adaptive Commun. Syst. 1, 45–62 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Garcia, S., Andujar, M. (2021). Neurochat: Artistic Affective State Facial Filters in Online Video Communication. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science(), vol 12776. Springer, Cham. https://doi.org/10.1007/978-3-030-78114-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-78114-9_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78113-2
Online ISBN: 978-3-030-78114-9
eBook Packages: Computer ScienceComputer Science (R0)