Skip to main content
Springer Nature Link
Log in

Adaptive Virtual Neuroarchitecture

  • Chapter
  • First Online:
Everyday Virtual and Augmented Reality

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user has received limited attention. Based on the influence of space design on a user and combining that with the dynamic affordances of virtual spaces, we present the idea of adaptive virtual neuroarchitecture (AVN), where virtual environments respond to the user and the user’s real-world context while simultaneously influencing them both in real time. To show how AVN has been explored in current research, we present a sampling of recent work that demonstrates reciprocal relationships using physical affordances (space, objects), the user’s state (physiological, cognitive, emotional), and the virtual world used in the design of novel virtual reality experiences. We believe AVN has the potential to help us learn how to design spaces and environments that can enhance the wellbeing of their inhabitants.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://en.wikipedia.org/wiki/Programmable_matter.

  2. 2.

    https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html.

  3. 3.

    https://galea.co/.

  4. 4.

    https://www.strivr.com/blog/customer-experience-training-virtual-reality/

References

  • Ahir K, Govani K, Gajera R, Shah M (2020) Application on virtual reality for enhanced education learning, military training and sports. Augmented Human Res 5(1):1–9

    Google Scholar 

  • Allen JG, MacNaughton P, Satish U, Santanam S, Vallarino J, Spengler JD (2016) Associations of cognitive function scores with carbon dioxide, ventilation, and volatile organic compound exposures in office workers: a controlled exposure study of green and conventional office environments. Environ Health Perspect 124(6):805–812

    Google Scholar 

  • Amores J, Fuste A, Richer R (2019) Deep reality: towards increasing relaxation in VR by subtly changing light, sound and movement based on HR, EDA, and EEG. In: Extended abstracts of the 2019 CHI conference on human factors in computing systems, pp 1–2

    Google Scholar 

  • Amores J, Maes P (2017) Essence: Olfactory interfaces for unconscious influence of mood and cognitive performance. In: Proceedings of the 2017 CHI conference on human factors in computing systems, pp 28–34

    Google Scholar 

  • Barton J, Pretty J (2010) What is the best dose of nature and green exercise for improving mental health? A multi-study analysis. Environ Sci Technol 44(10):3947–3955

    Google Scholar 

  • Bernal G, Yang T, Jain A, Maes P (2018) Physiohmd: a conformable, modular toolkit for collecting physiological data from head-mounted displays. In: Proceedings of the 2018 ACM international symposium on wearable computers, pp 160–167

    Google Scholar 

  • Blesser B, Salter L-R (2007) Spaces speak, are you listening. The Cambridge, MA

    Google Scholar 

  • Bower M, Gallagher S (2013) Bodily affects as prenoetic elements in enactive perception. Phenomenol Mind 4(1):78–93

    Google Scholar 

  • Bowler DE, Buyung-Ali LM, Knight TM, Pullin AS (2010) A systematic review of evidence for the added benefits to health of exposure to natural environments. BMC Public Health 10(1):1–10

    Google Scholar 

  • Bozgeyikli E, Raij A, Katkoori S, Dubey R (2016) Point & teleport locomotion technique for virtual reality. In: Proceedings of the 2016 annual symposium on computer-human interaction in play, pp 205–216

    Google Scholar 

  • Brooks J, Nagels S, Lopes P (2020) Trigeminal-based temperature illusions. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–12

    Google Scholar 

  • Checa D, Bustillo A (2020) A review of immersive virtual reality serious games to enhance learning and training. Multimedia Tools Appl 79(9):5501–5527

    Google Scholar 

  • Cheng L-P, Ofek E, Holz C, Wilson AD (2019) Vroamer: generating on-the-fly VR experiences while walking inside large, unknown real-world building environments. In: 2019 IEEE conference on Virtual Reality and 3D user interfaces (VR). IEEE, pp 359–366

    Google Scholar 

  • Cristiano C, Elisa F, Giulia B, Stefano F, Francesco T, Bogdan M, Thomas Z, Sandra B (2017) Virtual reality for neuroarchitecture: cue reactivity in built spaces. Front Psychol 8:185

    Google Scholar 

  • Cho B-H, Ku J, Jang DP, Kim S, Lee YH, Kim IY, Lee JH, Kim SI (2002) The effect of virtual reality cognitive training for attention enhancement. CyberPsychology Behav 5(2):129–137

    Google Scholar 

  • Choi H-H, Van Merriënboer JJG, Paas F (2014) Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load. Educ Psychol Rev 26(2):225–244

    Google Scholar 

  • Choi I, Culbertson H, Miller MR, Olwal A, Follmer S (2017) Grabity: a wearable haptic interface for simulating weight and grasping in virtual reality. In: Proceedings of the 30th annual ACM symposium on user interface software and technology, pp 119–130

    Google Scholar 

  • Choi KY, Ishii H (2020) ambienbeat: wrist-worn mobile tactile biofeedback for heart rate rhythmic regulation. In: Proceedings of the fourteenth international conference on tangible, embedded, and embodied interaction, pp 17–30

    Google Scholar 

  • Costa J, Adams AT, Jung MF, Guimbretière F, Choudhury T (2016) Emotioncheck: leveraging bodily signals and false feedback to regulate our emotions. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing, pp 758–769

    Google Scholar 

  • Costa J, Guimbretière F, Jung MF, Choudhury T (2019) Boostmeup: improving cognitive performance in the moment by unobtrusively regulating emotions with a smartwatch. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, vol 3, issue 2, pp 1–23

    Google Scholar 

  • Davies C, Harrison J (1996) Osmose: towards broadening the aesthetics of virtual reality. ACM SIGGRAPH Comput Graph 30(4):25–28

    Google Scholar 

  • Depledge MH, Stone RJ, Bird WJ (2011) Can natural and virtual environments be used to promote improved human health and wellbeing? Environ Sci Technol 45(11):4660–4665

    Google Scholar 

  • Ellard C (2015) Places of the heart: the psychogeography of everyday life. Bellevue Literary Press

    Google Scholar 

  • Fernandez JA, Fusté A, Richer R, Maes P (2019) Deep reality: an underwater VR experience to promote relaxation by unconscious HR, EDA, and brain activity biofeedback. In: ACM SIGGRAPH 2019 Virtual, Augmented, and Mixed Reality, pp 1–1 (2019)

    Google Scholar 

  • Fisk WJ (2000) Health and productivity gains from better indoor environments and their relationship with building energy efficiency. Ann Rev Energy Environ 25(1):537–566

    Google Scholar 

  • Franz G (2005) An empirical approach to the experience of architectural space. PhD thesis, Bauhaus-Universität Weimar, Germany

    Google Scholar 

  • Friedenberg J, Silverman G (2006) Cognitive science?: an introduction to the study of mind. Sage, Thousand Oaks

    Google Scholar 

  • Goldberg P (2021) 12 embodiment, dissociation, and the rhythm of life. In: Body as psychoanalytic object: clinical applications from Winnicott to Bion and beyond, p 12

    Google Scholar 

  • Hartmann J, Holz C, Ofek E, Wilson AD (2019) Realitycheck: Blending virtual environments with situated physical reality. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–12

    Google Scholar 

  • Higuera-Trujillo JL, Llinares C, Macagno E (2021) The cognitive-emotional design and study of architectural space: a scoping review of neuroarchitecture and its precursor approaches. Sensors 21(6):2193

    Google Scholar 

  • Higuera-Trujillo JL, Maldonado JL-T, Millán CL (2017) Psychological and physiological human responses to simulated and real environments: a comparison between photographs, 360 panoramas, and virtual reality. Appl Ergon 65:398–409

    Google Scholar 

  • Insko BE (2001) Passive haptics significantly enhances virtual environments. The University of North Carolina at Chapel Hill

    Google Scholar 

  • Jain A, Horowitz AH, Schoeller F, Leigh S, Maes P, Sra M (2020) Designing interactions beyond conscious control: a new model for wearable interfaces. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, vol 4, issue 3, Sept 2020

    Google Scholar 

  • Je S, Lim H, Moon K, Teng S-Y, Brooks J, Lopes P, Bianchi A (2021) Elevate: A walkable pin-array for large shape-changing terrains. In: Proceedings of the 2021 CHI conference on human factors in computing systems, pp 1–11

    Google Scholar 

  • Langer EJ (2009) Counterclockwise: mindful health and the power of possibility. Ballantine Books

    Google Scholar 

  • Larrea-Tamayo H (2015) ARkits: architectural robotics kits. PhD thesis, Massachusetts Institute of Technology

    Google Scholar 

  • Leder D (1990) The absent body. University of Chicago Press

    Google Scholar 

  • Li G (2019) The dynamics of architectural form: Space, emotion and memory. Art Des Rev 7(4):187–205

    Google Scholar 

  • Lindsay PH, Norman DA (2013) Human information processing: an introduction to psychology. Academic Press

    Google Scholar 

  • Llinares C, Higuera-Trujillo JL, Serra J (2021) Cold and warm coloured classrooms. Effects on students’ attention and memory measured through psychological and neurophysiological responses. Buildi Environ 196:107726

    Google Scholar 

  • Lopes P, Ion A, Baudisch P (2015) Impacto: simulating physical impact by combining tactile stimulation with electrical muscle stimulation. In: Proceedings of the 28th annual ACM symposium on user interface software & technology, pp 11–19

    Google Scholar 

  • Lopes P, Young S, Cheng L, Marwecki P, Baudisch P. Providing haptics to walls and other heavy objects in virtual reality by means of electrical muscle stimulation. In: Proceedings of conference on human factors in computing systems

    Google Scholar 

  • MacNaughton P, Satish U, Laurent JGC, Flanigan S, Vallarino J, Coull B, Spengler JD, Allen JG (2017) The impact of working in a green certified building on cognitive function and health. Build Environ 114:178–186

    Google Scholar 

  • Marín-Morales J, Higuera-Trujillo JL, Greco A, Guixeres J, Llinares C, Scilingo EP, Alcañiz M, Valenza G (2018) Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Sci Rep 8(1):1–15

    Google Scholar 

  • McCoy JM, Evans GW (2002) The potential role of the physical environment in fostering creativity. Creativity Res J 14(3–4):409–426

    Google Scholar 

  • Mcsweeney J, Rainham D, Johnson SA, Sherry SB, Singleton J (2014) Indoor nature exposure (ine): a health-promotion framework. Health Promotion Int 30(1):126–139

    Article  Google Scholar 

  • Mehta R, Zhu R, Cheema A (2012) Is noise always bad? Exploring the effects of ambient noise on creative cognition. J Consumer Res 39(4):784–799

    Google Scholar 

  • Merleau-Ponty M (1996) Phenomenology of perception. Motilal Banarsidass Publishe

    Google Scholar 

  • Metzger C. Neuroarchitecture. Jovis Verlag GmbH

    Google Scholar 

  • Milovanovic J, Moreau G, Siret D, Miguet F (2017) Virtual and augmented reality in architectural design and education. In: 17th international conference, CAAD Futures 2017

    Google Scholar 

  • Montessori M (1959) The absorbent mind. Lulu.com

    Google Scholar 

  • Mott MS, Robinson DH, Walden A, Burnette J, Rutherford AS (2012) Illuminating the effects of dynamic lighting on student learning. Sage Open 2(2):2158244012445585

    Google Scholar 

  • Murray C (1999) Towards a phenomenology of the body in virtual reality. Res Philos Technol 19:149–173

    Google Scholar 

  • Naz A, Kopper R, McMahan RP, Nadin M (2017) Emotional qualities of VR space. In: 2017 IEEE Virtual Reality (VR). IEEE, pp 3–11

    Google Scholar 

  • Plante TG, Aldridge A, Bogden R, Hanelin C (2003) Might virtual reality promote the mood benefits of exercise? Comput Human Behav 19(4):495–509

    Google Scholar 

  • Portman ME, Natapov A, Fisher-Gewirtzman D (2015) To go where no man has gone before: virtual reality in architecture, landscape architecture and environmental planning. Comput Environ Urban Syst 54:376–384

    Google Scholar 

  • Poupyrev I, Billinghurst M, Weghorst S, Ichikawa T (1996) The go-go interaction technique: non-linear mapping for direct manipulation in VR. In: Proceedings of the 9th annual ACM symposium on user interface software and technology, pp 79–80

    Google Scholar 

  • Presti P, Ruzzon D, Avanzini P, Caruana F, Rizzolatti G, Vecchiato G (2022) Measuring arousal and valence generated by the dynamic experience of architectural forms in virtual environments. Sci Rep 12(1):1–12

    Google Scholar 

  • Roessler KK (2012) Healthy architecture! Can environments evoke emotional responses? Global J Health Sci 4(4):83

    Google Scholar 

  • Rosello O, Exposito M, Maes P (2016) Nevermind: using augmented reality for memorization. In: Proceedings of the 29th annual symposium on user interface software and technology, pp 215–216

    Google Scholar 

  • Ruthenbeck GS, Reynolds KJ (2015) Virtual reality for medical training: the state-of-the-art. J Simul 9(1):16–26

    Google Scholar 

  • Sacks R, Perlman A, Barak R (2013) Construction safety training using immersive virtual reality. Constr Manage Econ 31(9):1005–1017

    Google Scholar 

  • Schooler JW, Mrazek MD, Baird B, Winkielman P (2015) Minding the mind: the value of distinguishing among unconscious, conscious, and metaconscious processes

    Google Scholar 

  • Shapira L, Freedman D (2016) Reality skins: creating immersive and tactile virtual environments. In: 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, pp 115–124

    Google Scholar 

  • Shapiro L (2011) Embodied cognition. Routledge

    Google Scholar 

  • Simeone AL, Velloso E, Gellersen H (2015) Substitutional reality: using the physical environment to design virtual reality experiences. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, pp 3307–3316

    Google Scholar 

  • Salvador S-F, Angelica R, Charles S (2004) Tactile selective attention and body posture: assessing the multisensory contributions of vision and proprioception. Percept Psychophys 66(7):1077–1094

    Google Scholar 

  • Spence C (2020) Senses of place: architectural design for the multisensory mind. Cogn Res: Principles Implications 5(1):1–26

    Google Scholar 

  • Sra M, Garrido-Jurado S, Maes P (2017) Oasis: procedurally generated social virtual spaces from 3d scanned real spaces. IEEE Trans Visualization Comput Graph 24(12):3174–3187

    Google Scholar 

  • Sra M, Garrido-Jurado S, Schmandt C, Maes P (2016) Procedurally generated virtual reality from 3d reconstructed physical space. In: Proceedings of the 22nd ACM conference on virtual reality software and technology, pp 191–200

    Google Scholar 

  • Sra M, Jain A, Maes P (2019) Adding proprioceptive feedback to virtual reality experiences using galvanic vestibular stimulation. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–14

    Google Scholar 

  • Sra M, Jain D, Caetano AP, Calvo A, Hilton E, Schmandt C (2016) Resolving spatial variation and allowing spectator participation in multiplayer VR In: Proceedings of the 29th annual symposium on user interface software and technology, pp 221–222

    Google Scholar 

  • Sra M, Maes P, Vijayaraghavan P, Roy D (2017) Auris: creating affective virtual spaces from music. In: Proceedings of the 23rd ACM symposium on virtual reality software and technology, pp 1–11

    Google Scholar 

  • Sra M, Xu X, Maes P (2018) Breathvr: leveraging breathing as a directly controlled interface for virtual reality games. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–12

    Google Scholar 

  • Sullivan JV (2018) Learning and embodied cognition: a review and proposal. Psychol Learn Teach 17(2):128–143

    Google Scholar 

  • Suzuki R, Hedayati H, Zheng C, Bohn JL, Szafir D, Yi-Luen Do E, Gross MD, Leithinger D (2020) Roomshift: room-scale dynamic haptics for VR with furniture-moving swarm robots. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–11

    Google Scholar 

  • Ulrich RS (1981) Natural versus urban scenes: some psychophysiological effects. Environ Behav 13(5):523–556

    Google Scholar 

  • Ulrich RS (1991) Effects of interior design on wellness: theory and recent scientific research. In: Journal of health care interior design: proceedings from the... symposium on health care interior design, vol 3, pp 97–109

    Google Scholar 

  • Ulrich RS, Simons RF, Losito BD, Evelyn F, Miles MA, Michael Z (1991) Stress recovery during exposure to natural and urban environments. J Environ Psychol 11(3):201–230

    Google Scholar 

  • Ulrich RS (1984) View through a window may influence recovery from surgery. Science 224(4647):420–421

    Article  Google Scholar 

  • van Rooij M, Lobel A, Harris O, Smit N, Granic I (2016) Deep: a biofeedback virtual reality game for children at-risk for anxiety. In: Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems, CHI EA ’16, New York, NY, USA. Association for Computing Machinery, pp 1989–1997

    Google Scholar 

  • Vorländer M, Schröder D, Pelzer S, Wefers F (2015) Virtual reality for architectural acoustics. J Build Performance Simul 8(1):15–25

    Google Scholar 

  • Wilson M (2002) Six views of embodied cognition. Psychonomic Bull Rev 9(4):625–636

    Google Scholar 

  • Wyon DP (2004) The effects of indoor air quality on performance and productivity. Indoor Air 14:92–101

    Google Scholar 

  • Yang (Junrui) J, Holz C, Ofek E, Wilson AD (2019) Dreamwalker: substituting real-world walking experiences with a virtual reality. In: Proceedings of the 32nd annual ACM symposium on user interface software and technology, pp 1093–1107

    Google Scholar 

  • Yixian Y, Takashima K, Tang A, Tanno T, Fujita K, Kitamura Y (2020) Zoomwalls: dynamic walls that simulate haptic infrastructure for room-scale VR world. In: Proceedings of the 33rd annual ACM symposium on user interface software and technology, pp 223–235

    Google Scholar 

  • Zhao N, Azaria A, Paradiso JA (2017) Mediated atmospheres: a multimodal mediated work environment. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, vol 1, issue 2, pp 1–23

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. MIT Media Lab, Cambridge, USA

    Abhinandan Jain & Pattie Maes

  2. UCSB, Santa Barbara, USA

    Misha Sra

Authors
  1. Abhinandan Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pattie Maes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Misha Sra
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abhinandan Jain .

Editor information

Editors and Affiliations

  1. KU Leuven, Leuven, Belgium

    Adalberto Simeone

  2. Human-Computer Interaction Group, University of Trier, Trier, Germany

    Benjamin Weyers

  3. Liverpool Business School, Liverpool John Moores University, Liverpool, UK

    Svetlana Bialkova

  4. HIT Lab NZ, University of Canterbury, Christchurch, New Zealand

    Robert W. Lindeman

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Jain, A., Maes, P., Sra, M. (2023). Adaptive Virtual Neuroarchitecture. In: Simeone, A., Weyers, B., Bialkova, S., Lindeman, R.W. (eds) Everyday Virtual and Augmented Reality. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-031-05804-2_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05804-2_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05803-5

  • Online ISBN: 978-3-031-05804-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics