skip to main content
research-article

Toward Understanding the Impact of Visualized Focus Levels in Virtual Reality on User Presence and Experience

Published: 24 September 2024 Publication History

Abstract

Neurofeedback refers to the process of feeding a sensory representation of brain activity back to users in real time to improve a particular brain function, e.g., their focus and/or attention on a particular task. This study addressed the notable lack of research on methods used to visualize EEG data and their effects on the immersive quality of VR. We developed an algorithm to quantify focus, yielding a focus score. A pre-study with twenty participants confirmed its effectiveness in distinguishing between focused and relaxed mental states. Subsequently, we used this focus score to prototype a VR experience system visualizing the focus score in preconfigured manners, which was utilized in an exploratory study to assess the impact of different neurofeedback visualization methods on user engagement and focus in VR. Among all the visualization methods evaluated, the environmental scheme stood out due to its superior usability during task execution, its ability to evoke positive emotions through the visualization of objects or scenes, and its minimal deviation from user expectations. Additionally, we explored design guidelines based on collected results for future research to further refine the visualization scheme, ensuring effective integration of the focus score within the VR environment. These enhancements are crucial for designing neurofeedback visualization schemes that aim to boost participant focus in VR settings, offering significant insights into the optimization of such technologies.

References

[1]
Judith Amores, Xavier Benavides, and Pattie Maes. 2016. PsychicVR: Increasing Mindfulness by Using Virtual Reality and Brain Computer Interfaces. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 2. https://doi.org/10.1145/2851581.2889442
[2]
Alissa N. Antle, Leslie Chesick, and Elgin-Skye Mclaren. 2018. Opening up the Design Space of Neurofeedback Brain--Computer Interfaces for Children. ACM Trans. Comput.-Hum. Interact. 24, 6, Article 38 (jan 2018), 33 pages. https://doi.org/10.1145/3131607
[3]
Alissa N. Antle, Elgin-Skye McLaren, Holly Fiedler, and Naomi Johnson. 2019. Evaluating the Impact of a Mobile Neurofeedback App for Young Children at School and Home. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300266
[4]
Michela Balconi, Davide Crivelli, and Laura Angioletti. 2019. Efficacy of a neurofeedback training on attention and driving performance: physiological and behavioral measures. Frontiers in neuroscience 13 (2019), 996.
[5]
S. Bell. 2019. Elements of Visual Design in the Landscape. Taylor & Francis. https://books.google.com.tw/books?id= xKbP0AEACAAJ
[6]
Anna M. Berger and Eddy J. Davelaar. 2018. Frontal Alpha Oscillations and Attentional Control: A Virtual Reality Neurofeedback Study. Neuroscience 378 (2018), 189--197. https://doi.org/10.1016/j.neuroscience.2017.06.007 Neurofeedback and Functional Enhancement: Mechanisms, Methodology, Behavioral and Clinical Applications.
[7]
Frank Biocca and Ben Delaney. 1995. Immersive virtual reality technology. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US. 57--124 pages.
[8]
Doug A. Bowman and Ryan P. McMahan. 2007. Virtual Reality: How Much Immersion Is Enough? Computer 40, 7 (2007), 36--43. https://doi.org/10.1109/MC.2007.257
[9]
Virginia Braun, Victoria Clarke, Nikki Hayfield, and Gareth Terry. 2019. Thematic Analysis. In Handbook of Research Methods in Health Social Sciences, Pranee Liamputtong (Ed.). Springer Singapore, 843--860.
[10]
Grigore Burdea, Paul Richard, and Philippe Coiffet. 1996. Multimodal virtual reality: Input-output devices, system integration, and human factors. International Journal of Human-Computer Interaction 8 (1996), 5--24. https://doi.org/10.1080/10447319609526138
[11]
Mark Colley, Max Rädler, Jonas Glimmann, and Enrico Rukzio. 2022. Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 49 (jul 2022), 21 pages. https://doi.org/10.1145/ 3534609
[12]
Conover. 2006. Practical Nonparametric Statistics 3Rd Ed. Wiley India Pvt. Limited. https://books.google.com.tw/ books?id=UBV2VwCxrMcC
[13]
Jean Costa, François Guimbretière, Malte F. Jung, and Tanzeem Choudhury. 2019. BoostMeUp: Improving Cognitive Performance in the Moment by Unobtrusively Regulating Emotions with a Smartwatch. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 2, Article 40 (jun 2019), 23 pages. https://doi.org/10.1145/3328911
[14]
Ylli Dalladaku, Jacob Kelley, Brycen Lacey, James Mitchiner, Braden Welsh, and Matthew Beigh. 2020. Assessing the Effectiveness of Virtual Reality in the Training of Army Aviators. In Proceedings of the 2020 Annual General Donald R. Keith Memorial Capstone Conference, New York, NY. 40.
[15]
Alex Dan and Miriam Reiner. 2017. Real Time EEG Based Measurements of Cognitive Load Indicates Mental States During Learning. Journal of Educational Data Mining 9, 2 (Dec. 2017), 31--44. https://doi.org/10.5281/zenodo.3554719
[16]
Tamer Demiralp and Erol Basar. 1992. Theta rhythmicities following expected visual and auditory targets. International Journal of Psychophysiology 13, 2 (1992), 147--160. https://doi.org/10.1016/0167--8760(92)90054-F
[17]
John Desnoyers-Stewart, Ekaterina R. Stepanova, Philippe Pasquier, and Bernhard E. Riecke. 2019. JeL: Connecting Through Breath in Virtual Reality. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA '19). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3290607.3312845
[18]
Arindam Dey, Alex Chatburn, and Mark Billinghurst. 2019. Exploration of an EEG-Based Cognitively Adaptive Training System in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 220--226. https://doi.org/10.1109/VR.2019.8797840
[19]
Patrick Dickinson, Kathrin Gerling, Kieran Hicks, John Murray, John Shearer, and Jacob Greenwood. 2019. Virtual reality crowd simulation: effects of agent density on user experience and behaviour. Virtual Reality 23, 1 (01 Mar 2019), 19--32. https://doi.org/10.1007/s10055-018-0365-0
[20]
Industry Dive. 2016. Report: VR delivers big on engagement, emotional response. https://www.marketingdive.com/ news/report-vr-delivers-big-on-engagement-emotional-response/430113/.
[21]
Mohamed El Beheiry, Sébastien Doutreligne, Clément Caporal, Cécilia Ostertag, Maxime Dahan, and Jean-Baptiste Masson. 2019. Virtual Reality: Beyond Visualization. Journal of Molecular Biology 431, 7 (2019), 1315--1321. https: //doi.org/10.1016/j.jmb.2019.01.033
[22]
Passant Elagroudy, Xiyue Wang, Evgeny Stemasov, Teresa Hirzle, Svetlana Shishkovets, Siddharth Mehrotra, and Albrecht Schmidt. 2020. SpotlessMind: A Design Probe for Eliciting Attitudes towards Sharing Neurofeedback. In Proceedings of the Augmented Humans International Conference (Kaiserslautern, Germany) (AHs'20). Association for Computing Machinery, New York, NY, USA, Article 24, 8 pages. https://doi.org/10.1145/3384657.3384800
[23]
EMOTIV. 2024. Emotiv EPOC X. https://www.emotiv.com/epoc-x/.
[24]
Stefanie Enriquez-Geppert, René J. Huster, and Christoph S. Herrmann. 2017. EEG-Neurofeedback as a Tool to Modulate Cognition and Behavior: A Review Tutorial. Frontiers in Human Neuroscience 11 (2017). https://doi.org/10. 3389/fnhum.2017.00051
[25]
J.R. Evans, T.H. Budzynski, H.K. Budzynski, and A. Abarbanel. 2009. Introduction to Quantitative EEG and Neurofeedback: Advanced Theory and Applications. Elsevier Science. https://books.google.com.tw/books?id=PigKJuOSvbMC
[26]
Stephanie Evergreen and Chris Metzner. 2013. Design principles for data visualization in evaluation. New directions for evaluation 2013, 140 (2013), 5--20.
[27]
Felix Filipi, Febrian Nugroho, and Sidharta. 2023. Measuring the percentage of brain concentration levels using Bi-LSTM algorithm. Procedia Computer Science 216 (2023), 655--663. https://doi.org/10.1016/j.procs.2022.12.181 7th International Conference on Computer Science and Computational Intelligence 2022.
[28]
Doron Friedman, Robert Leeb, Christoph Guger, Anthony Steed, Gert Pfurtscheller, and Mel Slater. 2007. Navigating Virtual Reality by Thought: What is It Like? Presence: Teleoper. Virtual Environ. 16, 1 (feb 2007), 100--110. https: //doi.org/10.1162/pres.16.1.100
[29]
Michael Friendly. 2008. A Brief History of Data Visualization. Springer Berlin Heidelberg, Berlin, Heidelberg, 15--56. https://doi.org/10.1007/978--3--540--33037-0_2
[30]
A. W. K. Gaillard and C. J. E. Wientjes. 1994. Mental load and work stress as two types of energy mobilization. Work & Stress 8, 2 (1994), 141--152. https://doi.org/10.1080/02678379408259986 arXiv:https://doi.org/10.1080/02678379408259986
[31]
N.; McGuigan J.; Crothers I.; Browning J. Gallagher, A. G.; McClure. 1999. Virtual Reality Training in Laparoscopic Surgery: A Preliminary Assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR). Endoscopy 31, 04 (31 Dec 1999), 310--313. https://doi.org/10.1055/s-1999--15
[32]
PsyCat Games. 2021. Brain Games For Adults. https://psycatgames.com/magazine/gaming/brain-games-for-adults/.
[33]
Anmin Gong, Feng Gu,Wenya Nan, Yi Qu, Changhao Jiang, and Yunfa Fu. 2021. A Review of Neurofeedback Training for Improving Sport Performance From the Perspective of User Experience. Frontiers in Neuroscience 15 (2021). https://doi.org/10.3389/fnins.2021.638369
[34]
Stefan Gradl, Markus Wirth, Tobias Zillig, and Bjoern M Eskofier. 2018. Visualization of heart activity in virtual reality: A biofeedback application using wearable sensors. In 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN). 152--155. https://doi.org/10.1109/BSN.2018.8329681
[35]
John Gruzelier, Tobias Egner, and David Vernon. 2006. Validating the efficacy of neurofeedback for optimising performance. Progress in brain research 159 (2006), 421--431.
[36]
Simon Hanslmayr, Wolfgang Klimesch, Paul Sauseng, Walter Gruber, Michael Doppelmayr, Roman Freunberger, and Thomas Pecherstorfer. 2005. Visual discrimination performance is related to decreased alpha amplitude but increased phase locking. Neuroscience Letters 375, 1 (2005), 64--68. https://doi.org/10.1016/j.neulet.2004.10.092
[37]
M.C. Hao, Umeshwar Dayal, D.A. Keim, and T. Schreck. 2005. Importance-driven visualization layouts for large time series data. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005. 203--210. https://doi.org/10.1109/ INFVIS.2005.1532148
[38]
Steve Haroz, Robert Kosara, and Steven L Franconeri. 2015. Isotype visualization: Working memory, performance, and engagement with pictographs. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 1191--1200.
[39]
Mariam Hassib, Stefan Schneegass, Philipp Eiglsperger, Niels Henze, Albrecht Schmidt, and Florian Alt. 2017. EngageMeter: A System for Implicit Audience Engagement Sensing Using Electroencephalography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 5114--5119. https://doi.org/10.1145/3025453.3025669
[40]
Anu Holm, Kristian Lukander, Jussi Korpela, Mikael Sallinen, and Kiti M. I. Müller. 2009. Estimating Brain Load from the EEG. The Scientific World Journal 9 (June 2009), 973791. https://doi.org/10.1100/tsw.2009.83
[41]
Kenneth Holmqvist, Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van de Weijer. 2011. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, United States.
[42]
Noura Howell, John Chuang, Abigail De Kosnik, Greg Niemeyer, and Kimiko Ryokai. 2018. Emotional Biosensing: Exploring Critical Alternatives. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 69 (nov 2018), 25 pages. https: //doi.org/10.1145/3274338
[43]
Li Hu and Zhiguo Zhang. 2019. EEG Signal Processing and Feature Extraction. Springer Nature Singapore. https: //books.google.com.tw/books?id=1dW1DwAAQBAJ
[44]
Ocean Hurd, Sri Kurniawan, and Mircea Teodorescu. 2019. Virtual reality video game paired with physical monocular blurring as accessible therapy for amblyopia. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 492--499.
[45]
Talib S Hussain, Bruce Roberts, Ellen S Menaker, Susan L Coleman, VA Centreville, Kelly Pounds, Clint Bowers, Janis A Cannon-Bowers, Alan Koenig, Richard Wainess, et al. 2009. Designing and developing effective training games for the US Navy. In The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC), Vol. 1. Citeseer, 39.
[46]
Shinobu Ishihara. 1998. Ishihara?s Tests for Colour Blindness: 24 Plate Edition. Taylor & Francis. https://books.google. com.tw/books?id=DOcEHQAACAAJ
[47]
International School ISMA. 2016. Why mental arithmetic is the best exercise for a brain? https://isma.bz/en/articles/ why-mental-arithmetic-is-the-best-exercise-for-a-brain/.
[48]
H. Jay. 2014. The Power of Concentration: Targeting the Human Mind. CreateSpace Independent Publishing Platform. https://books.google.com.tw/books?id=zKiozwEACAAJ
[49]
Crescent Jicol, Chun Hin Wan, Benjamin Doling, Caitlin H Illingworth, Jinha Yoon, Charlotte Headey, Christof Lutteroth, Michael J Proulx, Karin Petrini, and Eamonn O?Neill. 2021. Effects of Emotion and Agency on Presence in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI'21). Association for Computing Machinery, New York, NY, USA, Article 529, 13 pages. https://doi.org/10.1145/ 3411764.3445588
[50]
Rachel Jug, Xiaoyin 'Sara' Jiang, and Sarah M. Bean. 2018. Giving and Receiving Effective Feedback: A Review Article and How-To Guide. Archives of Pathology & Laboratory Medicine 143, 2 (08 2018), 244--250. https://doi.org/10.5858/ arpa.2018-0058-RA arXiv:https://meridian.allenpress.com/aplm/article-pdf/143/2/244/1448982/arpa_2018-0058-ra.pdf
[51]
Joseph Kamiya. 1969. Operant control of the EEG alpha rhythm and some of its reported effects on consciousness. Altered states of consciousness (1969), 519--529.
[52]
Stephen Kaplan. 1995. The restorative benefits of nature: Toward an integrative framework. Journal of environmental psychology 15, 3 (1995), 169--182.
[53]
David Kirsh. 2005. Metacognition, distributed cognition and visual design. Cognition, education, and communication technology (2005), 147--180.
[54]
Wolfgang Klimesch. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Research Reviews 29, 2 (1999), 169--195. https://doi.org/10.1016/S0165-0173(98)00056--3
[55]
Silvia Erika Kober, Johanna Louise Reichert, Daniela Schweiger, Christa Neuper, and Guilherme Wood. 2017. Does feedback design matter? A neurofeedback study comparing immersive virtual reality and traditional training screens in elderly. International Journal of Serious Games 4, 3 (2017).
[56]
Martin Kocur, Florian Habler, Valentin Schwind, Pawel W. Wozniak, Christian Wolff, and Niels Henze. 2021. Physiological and Perceptual Responses to Athletic Avatars While Cycling in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI'21). Association for Computing Machinery, New York, NY, USA, Article 519, 18 pages. https://doi.org/10.1145/3411764.3445160
[57]
Ilkka Kosunen, Mikko Salminen, Simo Järvelä, Antti Ruonala, Niklas Ravaja, and Giulio Jacucci. 2016. RelaWorld: Neuroadaptive and Immersive Virtual Reality Meditation System. In Proceedings of the 21st International Conference on Intelligent User Interfaces (Sonoma, California, USA) (IUI '16). Association for Computing Machinery, New York, NY, USA, 208--217. https://doi.org/10.1145/2856767.2856796
[58]
Sueyoon Lee, Abdallah El Ali, Maarten Wijntjes, and Pablo Cesar. 2022. Understanding and Designing Avatar Biosignal Visualizations for Social Virtual Reality Entertainment. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI'22). Association for Computing Machinery, New York, NY, USA, Article 425, 15 pages. https://doi.org/10.1145/3491102.3517451
[59]
Lika Haizhou Liu, Xi Lu, Richard Martinez, Dennis Wang, Fannie Liu, Andrés Monroy-Hernández, and Daniel A. Epstein. 2022. Mindful Garden: Supporting Reflection on Biosignals in a Co-Located Augmented Reality Mindfulness Experience. In Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing (Virtual Event, Taiwan) (CSCW'22 Companion). Association for Computing Machinery, New York, NY, USA, 201--204. https://doi.org/10.1145/3500868.3559708
[60]
Joan Llobera, Bernhard Spanlang, Giulio Ruffini, and Mel Slater. 2010. Proxemics with Multiple Dynamic Characters in an Immersive Virtual Environment. ACM Trans. Appl. Percept. 8, 1, Article 3 (nov 2010), 12 pages. https: //doi.org/10.1145/1857893.1857896
[61]
Fabien Lotte and Marco Congedo. 2016. EEG feature extraction. Brain--Computer Interfaces 1: Foundations and Methods (2016), 127--143.
[62]
Martin Lotze and Ulrike Halsband. 2006. Motor imagery. Journal of Physiology-paris 99, 4--6 (2006), 386--395.
[63]
Christian Mai, Niklas Thiem, and Heinrich Hussmann. 2020. DrawingPresence: A Method for Assessing Temporal Fluctuations of Presence Status in a VR Experience. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 4, Article 146 (sep 2020), 21 pages. https://doi.org/10.1145/3369827
[64]
Guido Makransky, Thomas S Terkildsen, and Richard E Mayer. 2019. Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and instruction 60 (2019), 225--236.
[65]
Hengameh Marzbani, Hamid Reza Marateb, and Marjan Mansourian. 2016. Neurofeedback: A Comprehensive Review on System Design, Methodology and Clinical Applications. Basic and Clinical Neuroscience 7 (2016), 143 -- 158.
[66]
Michael Meehan, Brent Insko, Mary Whitton, and Frederick P. Brooks. 2002. Physiological Measures of Presence in Stressful Virtual Environments. ACM Trans. Graph. 21, 3 (jul 2002), 645--652. https://doi.org/10.1145/566654.566630
[67]
Marijn H. C. Meijers, Paola Remmelswaal, and Anke Wonneberger. 2019. Using Visual Impact Metaphors to Stimulate Environmentally Friendly Behavior: The Roles of Response Efficacy and Evaluative Persuasion Knowledge. Environmental Communication 13, 8 (2019), 995--1008. https://doi.org/10.1080/17524032.2018.1544160 arXiv:https://doi.org/10.1080/17524032.2018.1544160
[68]
Umberto Melia, Francesc Clariá, Montserrat Vallverdú, and Pere Caminal. 2014. Filtering and thresholding the analytic signal envelope in order to improve peak and spike noise reduction in EEG signals. Medical Engineering & Physics 36, 4 (2014), 547--553. https://doi.org/10.1016/j.medengphy.2013.11.014
[69]
MentalUP. 2021. Concentration Game: Play and Improve Your Focus. https://www.mentalup.co/blog/concentrationcard-game.
[70]
Jonathan Mercier-Ganady, Fabien Lotte, Emilie Loup-Escande, Maud Marchal, and Anatole Lécuyer. 2014. The Mind-Mirror: See your brain in action in your head using EEG and augmented reality. In 2014 IEEE Virtual Reality (VR). IEEE, 33--38.
[71]
Byoung-Kyong Min and Hae-Jeong Park. 2010. Task-related modulation of anterior theta and posterior alpha EEG reflects top-down preparation. BMC Neuroscience 11, 1 (28 Jun 2010), 79. https://doi.org/10.1186/1471--2202--11--79
[72]
Joschka Mütterlein. 2018. The Three Pillars of Virtual Reality? Investigating the Roles of Immersion, Presence, and Interactivity. In Hawaii International Conference on System Sciences.
[73]
Asma Naz, Regis Kopper, Ryan P McMahan, and Mihai Nadin. 2017. Emotional qualities of VR space. In 2017 IEEE virtual reality (VR). IEEE, 3--11.
[74]
NeuroSky. 2015. EEG Games Top 5 List: Playing with Your Brainwaves. http://neurosky.com/2015/09/eeg-games-top-5-list-playing-with-your-brainwaves/.
[75]
MaryAnn P. Noonan, Ben M. Crittenden, Ole Jensen, and Mark G. Stokes. 2018. Selective inhibition of distracting input. Behavioural Brain Research 355 (2018), 36--47. https://doi.org/10.1016/j.bbr.2017.10.010 SI: MCC 2016.
[76]
Guardian News & Media Limited or its affiliated companies. 2022. Mind games: a mental workout to help keep your brain sharp. https://www.theguardian.com/lifeandstyle/2018/oct/13/mental-exercises-to-keep-your-brain-sharp.
[77]
Veronica S Pantelidis. 2010. Reasons to use virtual reality in education and training courses and a model to determine when to use virtual reality. Themes in Science and Technology Education 2, 1--2 (2010), 59--70.
[78]
René Peinl and Tobias Wirth. 2022. Presence in VR Experiences?An Empirical Cost--Benefit Analysis. In Proceedings of Sixth International Congress on Information and Communication Technology, Xin-She Yang, Simon Sherratt, Nilanjan Dey, and Amit Joshi (Eds.). Springer Singapore, Singapore, 461--471.
[79]
Alex Poole and Linden J Ball. 2006. Eye tracking in HCI and usability research. In Encyclopedia of human computer interaction. IGI global, 211--219.
[80]
Joseph Psotka. 1995. Immersive training systems: Virtual reality and education and training. Instructional science 23, 5 (1995), 405--431.
[81]
Jaziar Radianti, Tim A. Majchrzak, Jennifer Fromm, and IsabellWohlgenannt. 2020. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education 147 (2020), 103778. https://doi.org/10.1016/j.compedu.2019.103778
[82]
Robert Richer, Nan Zhao, Judith Amores, Bjoern M. Eskofier, and Joseph A. Paradiso. 2018. Real-time Mental State Recognition using a Wearable EEG. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 5495--5498. https://doi.org/10.1109/EMBC.2018.8513653
[83]
R Ron-Angevin, A Diaz-Estrella, and A Reyes-Lecuona. 2005. Development of a brain-computer interface based on virtual reality to improve training techniques. In Cyberpsychology & behavior, Vol. 8. MARY ANN LIEBERT, INC 140 HUGUENOT STREET, 3RD FL, NEW ROCHELLE, NY 10801 USA, 353--354.
[84]
K. Martin Sagayam, P. Malin Bruntha, M. Sridevi, M. Renith Sam, Utku Kose, and Omer Deperlioglu. 2021. Chapter 7 - A cognitive perception on content-based image retrieval using an advanced soft computing paradigm. In Advanced Machine Vision Paradigms for Medical Image Analysis, Tapan Gandhi, Siddhartha Bhattacharyya, Sourav De, Debanjan Konar, and Sandip Dey (Eds.). Academic Press, 189--211. https://doi.org/10.1016/B978-0--12--819295--5.00007-X
[85]
Majed Samad, Albert Jin Chung, and Ladan Shams. 2015. Perception of Body Ownership Is Driven by Bayesian Sensory Inference. PLOS ONE 10, 2 (02 2015), 1--23. https://doi.org/10.1371/journal.pone.0117178
[86]
P. Sauseng, W. Klimesch, W. Stadler, M. Schabus, M. Doppelmayr, S. Hanslmayr, W. R. Gruber, and N. Birbaumer. 2005. A shift of visual spatial attention is selectively associated with human EEG alpha activity. European Journal of Neuroscience 22, 11 (2005), 2917--2926. https://doi.org/10.1111/j.1460--9568.2005.04482.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1460--9568.2005.04482.x
[87]
Valentin Schwind, Pascal Knierim, Lewis Chuang, and Niels Henze. 2017. "Where's Pinky?": The Effects of a Reduced Number of Fingers in Virtual Reality. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Amsterdam, The Netherlands) (CHI PLAY '17). Association for Computing Machinery, New York, NY, USA, 507--515. https://doi.org/10.1145/3116595.3116596
[88]
Nathan Semertzidis, Michaela Scary, Josh Andres, Yutika Kulwe, Brahmi Dwivedi, Fabio Zambetta, and Florian Floyd Mueller. 2020. Neo-Noumena. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA'20). Association for Computing Machinery, New York, NY, USA, 1--4. https: //doi.org/10.1145/3334480.3383163
[89]
Nathan Arthur Semertzidis, Betty Sargeant, Justin Dwyer, Florian Floyd Mueller, and Fabio Zambetta. 2019. Towards Understanding the Design of Positive Pre-Sleep Through a Neurofeedback Artistic Experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300804
[90]
Farhana Shahid,Wasifur Rahman, Anika Binte Islam, Nipi Paul, Nabila Khan, Mohammad Saifur Rahman, Md Munirul Haque, and A. B. M. Alim Al Islam. 2019. Two Tell-Tale Perspectives of PTSD: Neurobiological Abnormalities and Bayesian Regulatory Network of the Underlying Disorder in a Refugee Context. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 101 (sep 2019), 45 pages. https://doi.org/10.1145/3351259
[91]
Amardeep Singh, Ali Abdul Hussain, Sunil Lal, and Hans W Guesgen. 2021. A comprehensive review on critical issues and possible solutions of motor imagery based electroencephalography brain-computer interface. Sensors 21, 6 (2021), 2173.
[92]
SketchBubble.com. 2024. Target Board Icons PowerPoint Template. https://www.sketchbubble.com/en/presentationtarget-board-icons.html.
[93]
Mel Slater. 2003. A Note on Presence Terminology. Presence Connect 3 (01 2003).
[94]
Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364 (2009), 3549 -- 3557.
[95]
M. Slater and M. V. Sanchez-Vives. 2014. Transcending the Self in Immersive Virtual Reality. Computer 47, 07 (jul 2014), 24--30. https://doi.org/10.1109/MC.2014.198
[96]
Mel Slater and Anthony Steed. 2000. A Virtual Presence Counter. Presence: Teleoper. Virtual Environ. 9, 5 (oct 2000), 413--434. https://doi.org/10.1162/105474600566925
[97]
Mel Slater and Sylvia Wilbur. 1997. A Framework for Immersive Virtual Environments Five: Speculations on the Role of Presence in Virtual Environments. Presence: Teleoper. Virtual Environ. 6, 6 (dec 1997), 603--616. https: //doi.org/10.1162/pres.1997.6.6.603
[98]
David Slayback, Syed Abdali, Justin Brooks, W David Hairston, and Paul Groves. 2018. Novel Methods for EEG Visualization and Virtualization. In 2018 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 1--5.
[99]
Andrzej Smiech. 2022. Six Ways To Improve Your Focus And Attention Span. https://www.forbes.com/sites/ forbescoachescouncil/2022/02/25/six-ways-to-improve-your-focus-and-attention-span/'sh=52cdf8901ce2.
[100]
Erin T. Solovey and Felix Putze. 2021. Improving HCI with Brain Input: Review, Trends, and Outlook. Foundations and Trends® in Human--Computer Interaction 13, 4 (2021), 298--379. https://doi.org/10.1561/1100000078
[101]
Olga Sourina, QiangWang, Yisi Liu, and Minh Khoa Nguyen. 2011. A Real-time Fractal-based Brain State Recognition from EEG and its Applications. BIOSIGNALS 2011 - Proceedings of the International Conference on Bio-Inspired Systems and Signal Processing, 82--90.
[102]
Statology. 2021. Z-Score Normalization: Definition & Examples. https://www.statology.org/z-score-normalization/.
[103]
M.B Sterman and L Friar. 1972. Suppression of seizures in an epileptic following sensorimotor EEG feedback training. Electroencephalography and Clinical Neurophysiology 33, 1 (1972), 89--95. https://doi.org/10.1016/0013--4694(72)90028--4
[104]
Jonathan Stevens and J. Kincaid. 2015. The Relationship between Presence and Performance in Virtual Simulation Training. Open Journal of Modelling and Simulation 03 (01 2015), 41--48. https://doi.org/10.4236/ojmsi.2015.32005
[105]
Unity Technologies. 2016. Nature Starter Kit 2. https://assetstore.unity.com/packages/3d/environments/naturestarter-kit-2--52977.
[106]
Unity Technologies. 2019. Fantasy Forest Environment - Free Demo. https://assetstore.unity.com/packages/3d/ environments/fantasy/fantasy-forest-environment-free-demo-35361.
[107]
Unity Technologies. 2024. Oculus Integration. https://assetstore.unity.com/packages/tools/integration/oculusintegration-82022.
[108]
Unity Technologies. 2024. Unity Asset Store. https://assetstore.unity.com/.
[109]
Janet P. Trammell, Priscilla G. MacRae, Greta Davis, Dylan Bergstedt, and Ariana E. Anderson. 2017. The Relationship of Cognitive Performance and the Theta-Alpha Power Ratio Is Age-Dependent: An EEG Study of Short Term Memory and Reasoning during Task and Resting-State in Healthy Young and Old Adults. Frontiers in Aging Neuroscience 9 (2017). https://doi.org/10.3389/fnagi.2017.00364
[110]
Chai M. Tyng, Hafeez U. Amin, Mohamad N. M. Saad, and Aamir S. Malik. 2017. The Influences of Emotion on Learning and Memory. Frontiers in psychology 8 (24 Aug 2017), 1454--1454. https://doi.org/10.3389/fpsyg.2017.01454
[111]
Roger S. Ulrich. 1981. Natural Versus Urban Scenes: Some Psychophysiological Effects. Environment and Behavior 13, 5 (1981), 523--556. https://doi.org/10.1177/0013916581135001 arXiv:https://doi.org/10.1177/0013916581135001
[112]
Roger S Ulrich, Robert F Simons, Barbara D Losito, Evelyn Fiorito, Mark A Miles, and Michael Zelson. 1991. Stress recovery during exposure to natural and urban environments. Journal of environmental psychology 11, 3 (1991), 201--230.
[113]
Martin Usoh, Ernest Catena, Sima Arman, and Mel Slater. 2000. Using Presence Questionnaires in Reality. Presence: Teleoper. Virtual Environ. 9, 5 (oct 2000), 497--503. https://doi.org/10.1162/105474600566989
[114]
Jennifer J. Vogel, Adams Greenwood-Ericksen, Jan Cannon-Bowers, and Clint A. Bowers. 2006. Using Virtual Reality with and without Gaming Attributes for Academic Achievement. Journal of Research on Technology in Education 39, 1 (2006), 105--118. https://doi.org/10.1080/15391523.2006.10782475 arXiv:https://doi.org/10.1080/15391523.2006.10782475
[115]
Athanasios Vourvopoulos, Evangelos Niforatos, and Michail Giannakos. 2019. EEGlass: An EEG-Eyeware Prototype for Ubiquitous Brain-Computer Interaction. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (London, United Kingdom) (UbiComp/ISWC '19 Adjunct). Association for Computing Machinery, New York, NY, USA, 647--652. https://doi.org/10.1145/3341162.3348383
[116]
Jinn-Rong Wang and Shulan Hsieh. 2013. Neurofeedback training improves attention and working memory performance. Clinical Neurophysiology 124, 12 (2013), 2406--2420.
[117]
Laurie M. Wilcox, Robert S. Allison, Samuel Elfassy, and Cynthia Grelik. 2006. Personal Space in Virtual Reality. ACM Trans. Appl. Percept. 3, 4 (oct 2006), 412--428. https://doi.org/10.1145/1190036.1190041
[118]
Michael Wilkinson, Sean Brantley, and Jing Feng. 2021. A Mini Review of Presence and Immersion in Virtual Reality. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 65, 1 (2021), 1099--1103. https://doi.org/10.1177/1071181321651148 arXiv:https://doi.org/10.1177/1071181321651148
[119]
Ying Zhu, Xiaochen Yin, and Xiaoyong Shu. 2009. Study on the application of metaphor in modern furniture design. In 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design. 29--32. https://doi.org/10.1109/CAIDCD.2009.5374909

Index Terms

  1. Toward Understanding the Impact of Visualized Focus Levels in Virtual Reality on User Presence and Experience

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue MHCI
    MHCI
    September 2024
    1136 pages
    EISSN:2573-0142
    DOI:10.1145/3697825
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 September 2024
    Published in PACMHCI Volume 8, Issue MHCI

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. focus score
    2. neurofeedback
    3. virtual reality
    4. visualization

    Qualifiers

    • Research-article

    Funding Sources

    • National Science and Technology Council of Taiwan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 94
      Total Downloads
    • Downloads (Last 12 months)94
    • Downloads (Last 6 weeks)12
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media