Abstract
Stroke rehabilitation suffers from low levels of patient engagement, impeding recovery. Virtual rehabilitation (VR) approaches can improve patient outcomes; however, there is limited understanding of the participant’s user experience and the field lacks a validated, objective measure of VR engagement. A neurophysiological measure of engagement in healthy adults was therefore examined, to inform future clinical studies. Twenty-four participants (Mage 26.7 years, range 18–47) interacted with a tabletop VR system (Elements DNA, or EDNA), after which they rated their experience on the presence questionnaire (PQ). Separately, participants completed tasks eliciting low (resting eyes-open and -closed) and high (EDNA VR and roller coaster simulation) levels of engagement while continuous electroencephalogram (EEG) was recorded from a single, left pre-frontal electrode. EEG differences between the resting and simulation conditions included an increase in theta power (p < 0.01) and a decrease in alpha power (p < 0.01). Importantly, theta power in simulation conditions correlated with PQ scores expressing the hands-on EDNA VR experience (rs = 0.38–0.48). In conclusion, the current results provide proof of concept that increased frontal theta power in healthy adults provides a valid measure of user engagement in VR simulation and participation. As the practical potential of VR is increasingly realised in stroke rehabilitation, objective EEG-based measures of engagement may provide a convenient and sensitive technique to assist in evaluating these interventions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aminov A, Rogers JM, Middleton S, Caeyenberghs K, Wilson PH (2018) What do randomized controlled trials say about virtual rehabilitation in stroke? A systematic literature review and meta-analysis of upper-limb and cognitive outcomes. J Neuroeng Rehabil 15:29. https://doi.org/10.1186/s12984-018-0370-2
Badcock NA, Mousikou P, Mahajan Y, de Lissa P, Thie J, McArthur G (2013) Validation of the Emotiv EPOC EEG gaming system for measuring research quality auditory ERPs. PeerJ e38
Barello S, Graffigna G, Vegni E (2012) Patient engagement as an emerging challenge for healthcare services: mapping the literature. Nurs Res Pract 2012:905934. https://doi.org/10.1155/2012/905934
Barry RJ, Clarke AR, Johnstone SJ, Magee CA, Rushby JA (2007) EEG differences between eyes-closed and eyes-open resting conditions. Clin Neurophysiol 118:2765–2773. https://doi.org/10.1016/j.clinph.2007.07.028
Barry RJ, De Blasio FM, Cave AE (2014) Eyes-closed vs. eyes-open EEG in young and older adults. Int J Psychophysiol 94:236
Bartur G, Joubran K, Peleg-Shani S, Vatine JJ, Shahaf G (2017) An EEG tool for monitoring patient engagement during stroke rehabilitation: a feasibility study. Biomed Res Int 2017:9071568. https://doi.org/10.1155/2017/9071568
Baumgartner T, Valko L, Esslen M, Jancke L (2006) Neural correlate of spatial presence in an arousing and noninteractive virtual reality: an EEG and psychophysiology study. Cyberpsychol Behav 9:30–45. https://doi.org/10.1089/cpb.2006.9.30
Baumgartner T, Willi M, Jancke L (2007) Modulation of corticospinal activity by strong emotions evoked by pictures and classical music: a transcranial magnetic stimulation study. NeuroReport 18:261–265. https://doi.org/10.1097/WNR.0b013e328012272e
Baumgartner T, Speck D, Wettstein D, Masnari O, Beeli G, Jancke L (2008) Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children. Front Hum Neurosci 2:8. https://doi.org/10.3389/neuro.09.008.2008
Beardsely M (1982) The aesthetic point of view. Cornell University Press, Ithaca, NY
Berka C et al (2007) EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviat Space Environ Med 78:B231–244
Borghini G, Isabella R, Vecchiato G, Toppi J, Astolfi L, Caltagirone C, Babiloni F (2011) Brainshield HREEG study of perceived pilot mental workload. Ital J Aerosp Med 5:34–47
Brackney DE, Priode K (2017) Back to reality: the use of the Presence Questionnaire for measurement of fidelity in simulation. J Nurs Meas 25:66–73. https://doi.org/10.1891/1061-3749.25.2.E66
Brett CE, Sykes C, Pires-Yfantouda R (2017) Interventions to increase engagement with rehabilitation in adults with acquired brain injury: a systematic review. Neuropsychol Rehabil 27:959–982. https://doi.org/10.1080/09602011.2015.1090459
Bright FA, Kayes NM, Worrall L, McPherson KM (2015) A conceptual review of engagement in healthcare and rehabilitation. Disabil Rehabil 37:643–654. https://doi.org/10.3109/09638288.2014.933899
Burke JW, McNeill MDJ, Charles DK, Morrow PJ, Crosbie JH, McDonough SM (2009) Optimising engagement for stroke rehabilitation using serious games. Vis Comput 25:1085. https://doi.org/10.1007/s00371-009-0387-4
Calabro RS et al (2017) The role of virtual reality in improving motor performance as revealed by EEG: a randomized clinical trial. J Neuroeng Rehabil 14:53. https://doi.org/10.1186/s12984-017-0268-4
Cavanagh JF, Frank MJ (2014) Frontal theta as a mechanism for cognitive control. Trends Cogn Sci 18:414–421. https://doi.org/10.1016/j.tics.2014.04.012
Csikszentmihalyi M (1990) Flow: The psychology of optimal experience. Harper & Row, New York
Deutsch JE, Myslinski MJ, Kafri M, Ranky R, Sivak M, Mavroidis C, Lewis JA (2013) Feasibility of virtual reality augmented cycling for health promotion of people poststroke. J Neurol Phys Ther 37:118–124. https://doi.org/10.1097/NPT.0b013e3182a0a078
Doppelmayr M, Finkenzeller T, Sauseng P (2008) Frontal midline theta in the pre-shot phase of rifle shooting: differences between experts and novices. Neuropsychologia 46:1463–1467. https://doi.org/10.1016/j.neuropsychologia.2007.12.026
Duckworth J et al. (2015) Resonance: an interactive tabletop artwork for co-located group rehabilitation and play. In: International conference on universal access in human-computer interaction, Springer, pp 420-431
Dussault C, Jouanin JC, Philippe M, Guezennec CY (2005) EEG and ECG changes during simulator operation reflect mental workload and vigilance. Aviat Space Environ Med 76:344–351
Ekandem JI, Davis TA, Alvarez I, James MT, Gilbert JE (2012) Evaluating the ergonomics of BCI devices for research and experimentation. Ergonomics 55:592–598
Ewing KC, Fairclough SH, Gilleade K (2016) Evaluation of an adaptive game that uses EEG measures validated during the design process as inputs to a biocybernetic loop. Front Hum Neurosci 10:223. https://doi.org/10.3389/fnhum.2016.00223
Fairclough SH, Venables L (2006) Prediction of subjective states from psychophysiology: a multivariate approach. Biol Psychol 71:100–110. https://doi.org/10.1016/j.biopsycho.2005.03.007
Fairclough SH, Venables L, Tattersall A (2005) The influence of task demand and learning on the psychophysiological response. Int J Psychophysiol 56:171–184. https://doi.org/10.1016/j.ijpsycho.2004.11.003
Feigin VL, Norrving B, Mensah GA (2017) Global Burden of Stroke. Circ Res 120:439–448. https://doi.org/10.1161/circresaha.116.308413
Finnigan S, Wong A, Read S (2016) Defining abnormal slow EEG activity in acute ischaemic stroke: delta/alpha ratio as an optimal QEEG index. Clin Neurophysiol 127:1452–1459. https://doi.org/10.1016/j.clinph.2015.07.014
Freeman J, Avons SE, Pearson DE, IJsselsteijn WA (1999) Effects of sensory information and prior experience on direct subjective ratings of presence. Presence-Teleop Virt 8:1–13
Gamito P et al (2010) Training presence: the importance of virtual reality experience on the “sense of being there”. Stud Health Technol Inform 154:128–133
Green D, Wilson PH (2012) Use of virtual reality in rehabilitation of movement in children with hemiplegia − A multiple case study evaluation. Disabil Rehabil 34:593–604
Green D, Wilson P (2014) Applications of VR technologies for childhood disability. Virtual Reality for Physical and Motor Rehabilitation. Springer, New York, pp 203–216
Gundel A, Wilson GF (1992) Topographical changes in the ongoing EEG related to the difficulty of mental tasks. Brain Topogr 5:17–25. https://doi.org/10.1007/bf01129966
Howard MC (2017) A meta-analysis and systematic literature review of virtual reality rehabilitation programs. Comput Hum Behav 70:317–327. https://doi.org/10.1016/j.chb.2017.01.013
Hsieh LT, Ranganath C (2014) Frontal midline theta oscillations during working memory maintenance and episodic encoding and retrieval. NeuroImage 85(Pt 2):721–729. https://doi.org/10.1016/j.neuroimage.2013.08.003
Imam B, Jarus T (2014) Virtual reality rehabilitation from social cognitive and motor learning theoretical perspectives in stroke population. Rehabil Res Pract 2014:594540. https://doi.org/10.1155/2014/594540
Imms C, Granlund M, Wilson PH, Steenbergen B, Rosenbaum PL, Gordon AM (2017) Participation, both a means and an end: a conceptual analysis of processes and outcomes in childhood disability. Dev Med Child Neurol 59:16–25. https://doi.org/10.1111/dmcn.13237
Jäncke L, Cheetham M, Baumgartner T (2009) Virtual reality and the role of the prefrontal cortex in adults and children. Front Neurosci. https://doi.org/10.3389/neuro.01.006.2009
Johnstone SJ, Blackman R, Bruggemann JM (2012) EEG from a single-channel dry-sensor recording device. Clin EEG Neurosci 43:112–120
Kao SC, Huang CJ, Hung TM (2013) Frontal midline theta is a specific indicator of optimal attentional engagement during skilled putting performance. J Sport Exerc Psychol 35:470–478
Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Brain Res Rev 29:169–195
Kober SE, Kurzmann J, Neuper C (2012) Cortical correlate of spatial presence in 2D and 3D interactive virtual reality: an EEG study. Int J Psychophysiol 83:365–374. https://doi.org/10.1016/j.ijpsycho.2011.12.003
Lalmas M, O’Brien H, Yom-Tov E (2014) Measuring user engagement. Synth Lect Inf Concepts Retr Serv 6:1–132
Langhorne P, Bernhardt J, Kwakkel G (2011) Stroke rehabilitation. Lancet 377:1693–1702. https://doi.org/10.1016/S0140-6736(11)60325-5
Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M (2017) Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev
Lee SH, Kim YM, Lee BH (2015) Effects of virtual reality-based bilateral upper-extremity training on brain activity in post-stroke patients. J Phys Ther Sci 27:2285–2287. https://doi.org/10.1589/jpts.27.2285
Leiker AM, Miller M, Brewer L, Nelson M, Siow M, Lohse K (2016) The relationship between engagement and neurophysiological measures of attention in motion-controlled video games: a randomized controlled trial. JMIR Serious Games 4:e4. https://doi.org/10.2196/games.5460
Lenze EJ, Munin MC, Quear T, Dew MA, Rogers JC, Begley AE, Reynolds CF (2004) Significance of poor patient participation in physical and occupational therapy for functional outcome and length of stay. Arch Phys Med Rehabil 85:1599–1601
Lequerica AH, Kortte K (2010) Therapeutic engagement: a proposed model of engagement in medical rehabilitation. Am J Phys Med Rehabil 89:415–422. https://doi.org/10.1097/PHM.0b013e3181d8ceb2
Lequerica AH, Donnell CS, Tate DG (2009) Patient engagement in rehabilitation therapy: physical and occupational therapist impressions. Disabil Rehabil 31:753–760. https://doi.org/10.1080/09638280802309095
Levin MF (2011) Can virtual reality offer enriched environments for rehabilitation? Expert Rev Neurother 11:153–155. https://doi.org/10.1586/ern.10.201
Lewis GN, Rosie JA (2012) Virtual reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users? Disabil Rehabil 34:1880–1886. https://doi.org/10.3109/09638288.2012.670036
Li C, Rusak Z, Horvath I, Ji L (2014) Influence of complementing a robotic upper limb rehabilitation system with video games on the engagement of the participants: a study focusing on muscle activities. Int J Rehabil Res 37:334–342. https://doi.org/10.1097/mrr.0000000000000076
Li C, Rusák Z, Horváth I, Ji L (2016) Development of engagement evaluation method and learning mechanism in an engagement enhancing rehabilitation system. Eng Appl Artif Intell 51:182–190. https://doi.org/10.1016/j.engappai.2016.01.021
Lohse KR, Hilderman CG, Cheung KL, Tatla S, Van der Loos HF (2014) Virtual reality therapy for adults post-stroke: a systematic review and meta-analysis exploring virtual environments and commercial games in therapy. PLoS ONE 9:e93318
Maclean N, Pound P, Wolfe C, Rudd A (2000) Qualitative analysis of stroke patients’ motivation for rehabilitation. BMJ 321:1051–1054
Maier M, Rubio Ballester B, Duff A, Duarte Oller E, Verschure P (2019) Effect of Specific Over Nonspecific VR-Based Rehabilitation on Poststroke Motor Recovery: a Systematic Meta-analysis. Neurorehabil Neural Repair 33:112–129. https://doi.org/10.1177/1545968318820169
McMahan T, Parberry I, Parsons TD (2015) Evaluating player task engagement and arousal using electroencephalography. Procedia Manuf 3:2303–2310. https://doi.org/10.1016/j.promfg.2015.07.376
Miller BW (2015) Using reading times and eye-movements to measure cognitive engagement. Educ Psychol 50:31–42. https://doi.org/10.1080/00461520.2015.1004068
Mumford N, Duckworth J, Thomas PR, Shum D, Williams G, Wilson PH (2010) Upper limb virtual rehabilitation for traumatic brain injury: initial evaluation of the Elements system. Brain Inj 24:780–791. https://doi.org/10.3109/02699051003652807
Mumford N, Duckworth J, Thomas PR, Shum D, Williams G, Wilson PH (2012) Upper-limb virtual rehabilitation for traumatic brain injury: a preliminary within-group evaluation of the Elements system. Brain Inj 26:166–176
Nagendra H, Kumar V, Mukherjee S (2017) Evaluation of cognitive behavior among deaf subjects with video game as intervention. Cogn Syst Res 42:42–57. https://doi.org/10.1016/j.cogsys.2016.11.007
O’Brien HL, Toms EG (2008) What is user engagement? A conceptual framework for defining user engagement with technology. J Assoc Inf Sci Technol 59:938–955. https://doi.org/10.1002/asi.20801
Oliveira SMS et al (2018) Electroencephalographic changes using virtual reality program: technical note. Neurol Res 40:160–165. https://doi.org/10.1080/01616412.2017.1420584
Ostir GV, Berges I, Ottenbacher ME, Clow A, Ottenbacher KJ (2008) Associations between positive emotion and recovery of functional status following stroke. Psychosom Med 70:404–409. https://doi.org/10.1097/PSY.0b013e31816fd7d0
Palma GC et al (2017) Effects of virtual reality for stroke individuals based on the International Classification of Functioning and Health: a systematic review. Top Stroke Rehabil 24:269–278. https://doi.org/10.1080/10749357.2016.1250373
Perez MA, Lungholt BK, Nyborg K, Nielsen JB (2004) Motor skill training induces changes in the excitability of the leg cortical area in healthy humans. Exp Brain Res 159:197–205
Pope AT, Bogart EH, Bartolome DS (1995) Biocybernetic system evaluates indices of operator engagement in automated task. Biol Psychol 40:187–195
Ratti E, Waninger S, Berka C, Ruffini G, Verma A (2017) Comparison of Medical and Consumer Wireless EEG Systems for Use in Clinical Trials. Front Hum Neurosci 11:398–398. https://doi.org/10.3389/fnhum.2017.00398
Reinecke K, Cordes M, Lerch C, Koutsandreou F, Schubert M, Weiss M, Baumeister J (2011) From lab to field conditions: a pilot study on EEG methodology in applied sports sciences. Appl Psychophysiol Biofeedback 36:265–271. https://doi.org/10.1007/s10484-011-9166-x
Rogers JM, Johnstone SJ, Aminov A, Donnelly J, Wilson PH (2016) Test-retest reliability of a single-channel, wireless EEG system. Int J Psychophysiol 106:87–96
Rogers JM, Duckworth J, Middleton S, Steenbergen B, Wilson PH (2019) Elements virtual rehabilitation improves motor, cognitive, and functional outcomes in adult stroke: evidence from a randomized controlled pilot study. J Neuroeng Rehabil 16:56. https://doi.org/10.1186/s12984-019-0531-y
Ruffino C, Papaxanthis C, Lebon F (2017) Neural plasticity during motor learning with motor imagery practice: review and perspectives. Neuroscience 341:61–78. https://doi.org/10.1016/j.neuroscience.2016.11.023
Salminen M, Ravaja N (2008) Increased oscillatory theta activation evoked by violent digital game events. Neurosci Lett 435:69–72. https://doi.org/10.1016/j.neulet.2008.02.009
Schleiger E, Sheikh N, Rowland T, Wong A, Read S, Finnigan S (2014) Frontal EEG delta/alpha ratio and screening for post-stroke cognitive deficits: the power of four electrodes. Int J Psychophysiol 94:19–24
Schultheis MT, Rizzo AA (2001) The application of virtual reality technology in rehabilitation. J Clin Psychiatry 62:617–622
Seale GS, Berges I, Ottenbacher KJ, Ostir GV (2010) Change in positive emotion and recovery of functional status following stroke. Rehabil Psychol 55:33–39. https://doi.org/10.1037/a0018744
Slobounov SM, Fukada K, Simon R, Rearick M, Ray W (2000) Neurophysiological and behavioral indices of time pressure effects on visuomotor task performance. Brain Res Cogn Brain Res 9:287–298
Slobounov SM, Ray W, Johnson B, Slobounov E, Newell KM (2015) Modulation of cortical activity in 2D versus 3D virtual reality environments: an EEG study. Int J Psychophysiol 95:254–260. https://doi.org/10.1016/j.ijpsycho.2014.11.003
Smith ME, Gevins A, Brown H, Karnik A, Du R (2001) Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Hum Factors 43:366–380. https://doi.org/10.1518/001872001775898287
Stephenson W (1967) Play theory. The Play Theory of Mass Communication. University of Chicago Press, Chicago, pp 45–65
Toms EG (2002) Information interaction: providing a framework for information architecture. J Assoc Inf Sci Technol 53:855–862. https://doi.org/10.1002/asi.10094
Triberti S, Riva G (2015) Being present in action: a theoretical model about the “Interlocking” between intentions and environmental affordances. Front Psychol 6:2052. https://doi.org/10.3389/fpsyg.2015.02052
Valderrama JT, de la Torre A, Van Dun B (2018) An automatic algorithm for blink-artifact suppression based on iterative template matching: application to single channel recording of cortical auditory evoked potentials. J Neural Eng 15:016008. https://doi.org/10.1088/1741-2552/aa8d95
Witmer BG, Singer MJ (1998) Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators Virtual Environ 7:225–240
Witmer BG, Jerome CJ, Singer MJ (2005) The factor structure of the presence questionnaire. Presence Teleoperators Virtual Environ 14:298-312
Wright RA (2008) Refining the prediction of effort: Brehm’s distinction between potential motivation and motivation intensity. Soc Personal Psychol Compass 2:682–701
Yamada F (1998) Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game: useful tools for psychophysiology in ergonomics. Ergonomics 41:678–688. https://doi.org/10.1080/001401398186847
Zappasodi F, Marzetti L, Olejarczyk E, Tecchio F, Pizzella V (2015) Age-Related Changes in Electroencephalographic Signal Complexity. PLoS ONE 10:e0141995–e0141995. https://doi.org/10.1371/journal.pone.0141995
Zimmerli L, Jacky M, Lunenburger L, Riener R, Bolliger M (2013) Increasing patient engagement during virtual reality-based motor rehabilitation. Arch Phys Med Rehabil 94:1737–1746. https://doi.org/10.1016/j.apmr.2013.01.029
Acknowledgements
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to report.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rogers, J.M., Jensen, J., Valderrama, J.T. et al. Single-channel EEG measurement of engagement in virtual rehabilitation: a validation study. Virtual Reality 25, 357–366 (2021). https://doi.org/10.1007/s10055-020-00460-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-020-00460-8