research-article

Mediated Atmospheres: A Multimodal Mediated Work Environment

Authors:

Joseph A. ParadisoAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 2

Article No.: 31, Pages 1 - 23

https://doi.org/10.1145/3090096

Published: 30 June 2017 Publication History

Abstract

Atmosphere - the sensorial qualities of a space, shaped by the composition of light, sound, objects, people, etc. - has remarkable influence on our experiences and behavior. Manipulating it has been shown to be powerful, affecting cognitive performance, mood and even physiology, our work envisions and implements a smart office prototype, capable of digitally transforming its atmosphere - creating what we call Mediated Atmospheres (MA) - using computationally controlled lighting, video projection and sound. Additionally, we equipped this space with a modular real-time data collection infrastructure, integrating a set of biosignal sensors. Through a user study (N=29) we demonstrate MA's effects on occupants’ ability to focus and to recover from a stressful situation. Our evaluation is based on subjective measurements of perception, as well as objective measurements, extracted from recordings of heart rate variability and facial features. We compare multiple signal processing approaches for quantifying changes in occupant physiological state. Our findings show that MA significantly (p<0.05) affect occupants’ perception as well as physiological response, which encouragingly correlate with occupants’ perception. Our findings is a first step towards personalized control of the ambient atmosphere to support wellbeing and productivity.

References

[1]

Matthew Aldrich, Nan Zhao, and Joseph Paradiso. 2010. Energy efficient control of polychromatic solid state lighting using a sensor network. Tenth International Conference on Solid State Lighting 7784 (2010), 778408--778408--15.

[2]

Matthew Matthew Henry Aldrich. 2014. Experiential lighting: development and validation of perception-based lighting controls. (2014).

[3]

Judith Amores Fernandez. 2016. Essence: olfactory interfaces for unconscious influence of mood and cognitive performance. (2016).

[4]

A A Bak and D E Grobbee. 1990. A randomized study on coffee and blood pressure. Journal of human hypertension 4, 3 (1990), 259--264.

[5]

Louise Barkhuus and Anind Dey. 2003. Is context-aware computing taking control away from the user? Three levels of interactivity examined. In International Conference on Ubiquitous Computing. Springer, 149--156.

[6]

Robert A Baron. 1994. The physical environment of work settings: Effects on task performance, interpersonal relations, and job satisfaction. Research in organizational behavior 16 (1994), 1.

[7]

Hrvoje Benko, Andrew D. Wilson, and Federico Zannier. 2014. Dyadic Projected Spatial Augmented Reality. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST). 645--655.

Digital Library

[8]

Gary G Berntson. 1997. and interpretive caveats. Psychophysiology 34 (1997), 623--648.

[9]

P. R. Boyce, Jennifer A. Veitch, G. R. Newsham, C. C. Jones, J. Heerwagen, M. Myer, and C. M. Hunter. 2006. Lighting quality and office work: Two field simulation experiments. Lighting Research and Technology 38, 3 (2006), 191--223.

[10]

Nancy H Chen, Jason Nawyn, Maria Thompson, Julie Gibbs, and Kent Larson. 2013. Context-aware tunable office lighting application and user response. In SPIE Optical Engineering+ Applications, Vol. 8835. International Society for Optics and Photonics, 883507.

[11]

Luca Chittaro and Riccardo Sioni. 2014. Affective computing vs. Affective placebo: Study of a biofeedback- controlled game for relaxation training. International Journal of Human Computer Studies 72, 8-9 (2014), 663--673.

Digital Library

[12]

Hwan-Hee Choi, Jeroen J. G. van Merriënboer, and Fred Paas. 2014. Effects of the Physical Environment on Cognitive Load and Learning: Towards a New Model of Cognitive Load. Educational Psychology Review 26, 2 (2014), 225--244.

[13]

B Cimprich. 1990. Attentional fatigue and restoration in individuals with cancer. Ph.D. Dissertation. Michigan: University of Michigan.

[14]

Bernadine Cimprich. 1993. Development of an intervention to restore attention in cancer patients. Cancer nursing 16, 2 (1993), 83--92.

[15]

Geo Clausen and David P Wyon. 2008. The combined effects of many different indoor environmental factors on acceptability and office work performance. HVAC8R Research 14, 1 (2008), 103--113.

[16]

Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, and Narayanan C. Krishnan. 2013. CASAS: A smart home in a box. Computer 46, 7 (2013), 62--69. arXiv:NIHMS150003.

Digital Library

[17]

Fernando De la Torre, Wen-Sheng Chu, Xuehan Xiong, Francisco Vicente, Xiaoyu Ding, and Jeffrey Cohn. 2015. Intraface. In Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on, Vol. 1. IEEE, 1--8.

[18]

ETS. 2016. The GRE Tests. (2016). http://www.ets.org/gre/

[19]

Mark Feldmeier and Joseph A. Paradiso. 2010. Personalized HVAC control system. In Internet of Things (IOT), 2010. IEEE, 1--8.

[20]

Abe Fettig. 2005. Twisted network programming essentials. O’Reilly Media, Inc.

Digital Library

[21]

Mariana G Figueiro, G. C. Brainard, and R. White Lockley, S. W., V. L. Revell. 2008. Light and human health: An overview of the impact of optical Radiation on visual, circadian, neuroendocrine, and neurobehavioral responses. Technical Report. arXiv:arXiv:1011.1669v3

[22]

Mariana G. Figueiro, Brittany Wood, Barbara Plitnick, and Mark S. Rea. 2011. The impact of light from computer monitors on melatonin levels in college students. Neuroendocrinology Letters 32, 2 (2011), 158--163.

[23]

Monika Frontczak and Pawel Wargocki. 2011. Literature survey on how different factors influence human comfort in indoor environments. Building and Environment 46, 4 (2011), 922--937.

[24]

Gensler. 2013. 2013 U.S. Workplace Survey Key Findings. Technical Report.

[25]

V F Gladwell, D K Brown, Joanna L Barton, M P Tarvainen, P Kuoppa, J Pretty, J M Suddaby, and G R H Sandercock. 2012. The effects of views of nature on autonomic control. European journal of applied physiology 112, 9 (2012), 3379--3386.

[26]

Joshua J. Gooley, Kyle Chamberlain, Kurt A. Smith, Sat Bir S Khalsa, Shantha M W Rajaratnam, Eliza Van Reen, Jamie M. Zeitzer, Charles A. Czeisler, and Steven W. Lockley. 2011. Exposure to room light before bedtime suppresses melatonin onset and shortens melatonin duration in humans. Journal of Clinical Endocrinology and Metabolism 96, 3 (2011).

[27]

D Gromala. 2001. Meditation Chamber. SIGGRAPH 2001 Conf. Abstracts and Applications, ACM Press (2001), 127.

[28]

Sharaf Hameed, Jyri Pakarinen, Kari Valde, and Ville Pulkki. 2004. Psychoacoustic cues in room size perception. In Audio Engineering Society Convention 116. Audio Engineering Society, 1--7.

[29]

Terry Hartig and Henk Staats. 2003. Guest Editors’ introduction: Restorative environments. Journal of Environmental Psychology 23, 2 (2003), 103--107.

[30]

Gerald Häubl and Kyle B Murray. 2003. Preference construction and persistence in digital marketplaces: The role of electronic recommendation agents. Journal of Consumer Psychology 13, 1-2 (2003), 75--91.

[31]

Thomas R Herzog, P Maguire, and Mary B Nebel. 2003. Assessing the restorative components of environments. Journal of Environmental Psychology 23, 2 (2003), 159--170.

[32]

W.A. Wijnand IJsselsteijn, Willem Oosting, I.M. Ingrid Vogels, Yvonne Y.A.W. de Kort, Evert van Loenen, De Kort, Van Loenen, W.A. Wijnand IJsselsteijn, Willem Oosting, I.M. Ingrid Vogels, Yvonne Y.A.W. de Kort, and Evert van Loenen. 2006. Looking At or Looking Out : Exploring Monocular Cues to Create a See-Through Experience with a Virtual Window. Proc. of PRESENCE (2006), 87--95.

[33]

Hiroshi Ishii, Craig Wisneski, Scott Brave, Andrew Dahley, Matt Gorbet, Brygg Ullmer, and Paul Yarin. 1998. ambientROOM: Integrating Ambient Media with Architectural Space. In Proceedings of the Conference on Human Factors in Computing Systems: Making the Impossible Possible (CHI’98). 173--174.

Digital Library

[34]

H 1 Ising and B Kruppa. 2004. Health effects caused by noise: evidence in the literature from the past 25 years. Noise and Health 6, 22 (2004), 5.

[35]

Sang-joong Jung, Heung-sub Shin, and Wan-young Chung. 2014. Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel. IET Intelligent Transport Systems 8, 1 (2014), 43--50.

[36]

Peter H Kahn, Batya Friedman, Brian Gill, Jennifer Hagman, Rachel L Severson, Nathan G Freier, Erika N Feldman, and Sybil Carre. 2008. A plasma display window ? The shifting baseline problem in a technologically mediated natural world. Journal of Environmental Psychology 28 (2008), 192--199.

[37]

Stephen Kaplan. 1995. The restorative effects of nature: Toward an integrative framework. Journal of Environmental Psychology 16, 1995 (1995), 169--182.

[38]

Wolfgang Klimesch. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Research Reviews 29, 2-3 (1999), 169--195.

[39]

Igor Knez. 1995. Effects of indoor lighting on mood and cognition. Journal of Environmental Psychology 15, 1 (1995), 39--51.

[40]

Enrique Leon, Graham Clarke, Victor Callaghan, Faiyaz Doctor, Enrique Leon, Graham Clarke, Victor Callaghan, and Faiyaz Doctor. 2010. Affect-aware behaviour modelling and control inside an Intelligent Environment. Pervasive and Mobile Computing Journal 6, 4 (2010), 1--44.

Digital Library

[41]

Remco Magielse and Philip R. Ross. 2011. A design approach to socially adaptive lighting environments. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction Facing Complexity - CHItaly. ACM Press, New York, New York, USA, 171.

Digital Library

[42]

Nicola Mammarella, Beth Fairfield, and Cesare Cornoldi. 2007. Does music enhance cognitive performance in healthy older adults ? The Vivaldi effect. Aging clinical and experimental research 19, 5 (2007), 394--399.

[43]

Janetta Mitchell McCoy and Gary W Evans. 2002. The potential role of the physical environment in fostering creativity. Creativity Research Journal 14, 3-4 (2002), 409--426.

[44]

Ravi Mehta, Rui Juliet Zhu, and Amar Cheema. 2012. Is noise always bad? Exploring the effects of ambient noise on creative cognition. Journal of Consumer Research 39, 4 (2012), 784--799.

[45]

Martina T Mitterschiffthaler, Cynthia H Y Fu, Jeffrey A Dalton, Christopher M Andrew, and Steven C R Williams. 2007. Functional MRI study of happy and sad âĂŞ affective states induced by classical music. Human brain mapping 28, 11 (2007), 1150--1162.

[46]

M. S. Mott, D. H. Robinson, A. Walden, J. Burnette, and A. S. Rutherford. 2012. Illuminating the Effects of Dynamic Lighting on Student Learning. SAGE Open 2, 2 (2012), 2158244012445585--.

[47]

Michael Mozer, Robert Dodier, Debra Miller, Marc Anderson, J Anderson, D Bertini, M Bronder, M Colagrosso, R Cruickshank, and B Daugherty. 2005. The adaptive house. In IEE Seminar Digests, Vol. 11059. IET, v1--39.

[48]

Jifei Ou, Gershon Dublon, Chin-Yi Cheng, Felix Heibeck, Karl Willis, and Hiroshi Ishii. 2016. Cilllia: 3D Printed Micro-Pillar Structures for Surface Texture, Actuation and Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5753--5764.

Digital Library

[49]

Margherita Pasini, Rita Berto, Margherita Brondino, Rob Hall, and Catherine Ortner. 2014. How to measure the restorative quality of environments: The PRS-11. Procedia-Social and Behavioral Sciences 159 (2014), 293--297.

[50]

Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2014. Context aware computing for the internet of things: A survey. IEEE Communications Surveys and Tutorials 16 (2014), 414--454.

[51]

R Raskar, G Welch, M Cutts, and A Lake. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. Proceedings of the 25th … (1998), 1--10.

Digital Library

[52]

D Schmidt, Michael Stal, Hans Rohnert, and F Bushmann. 2000. Patterns for Concurrent and Networked Objects, volume 2 of Pattern-Oriented Software Architecture. (2000).

Digital Library

[53]

Holger Schnädelbach, Kevin Glover, and Ainojie Alexander Irune. 2010. ExoBuilding : Breathing Life into Architecture. In proceedings of the 6th Nordic Conference on Human-Computer Interaction. 442--451.

Digital Library

[54]

Vipul Singhvi, Andreas Krause, Carlos Guestrin, James H Garrett Jr, and H Scott Matthews. 2005. Intelligent Light Control using Sensor Networks. In Proceedings of the 3rd international conference on Embedded networked sensor systems. 218--229.

Digital Library

[55]

Anne-mie Sponselee, Yvonne De Kort, and Anneloes Meijnders. 2004. Healing Media : The moderating role of presence in restoring from stress in a mediated environment. Presence January (2004), 197--203.

[56]

Steelcase Global Report. 2016. Engagement and the Global Workplace. Technical Report.

[57]

Mika P Tarvainen, Juha-Pekka Niskanen, Jukka A Lipponen, Perttu O Ranta-Aho, and Pasi A Karjalainen. 2014. Kubios HRVâĂŞheart rate variability analysis software. Computer methods and programs in biomedicine 113, 1 (2014), 210--220.

Digital Library

[58]

Carolyn M. Tennessen and Bernadine Cimprich. 1995. Views to nature: Effects on attention. Journal of Environmental Psychology 15, 1 (1995), 77--85.

[59]

Martin Tomitsch, Thomas Grechenig, Andrew Vande Moere, and Sheldon Renan. 2008. Information sky: Exploring the visualization of information on architectural ceilings. In Proceedings of the International Conference on Information Visualisation. 100--105.

Digital Library

[60]

Mikko P Tulppo, Timo H Mäkikallio, Tapio Seppänen, Raija T Laukkanen, and Heikki V Huikuri. 1998. Vagal modulation of heart rate during exercise: effects of age and physical fitness. American Journal of Physiology-Heart and Circulatory Physiology 274, 2 (1998), H424--H429.

[61]

Jay Vidyarthi, Bernhard E Riecke, and Diane Gromala. 2012. Sonic Cradle : Designing for an Immersive Experience of Meditation by Connecting Respiration to Music. In Proc. DIS 2012. 408--417.

Digital Library

[62]

Glenn F Wilson and Christopher A Russell. 2003. Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Human Factors: The Journal of the Human Factors and Ergonomics Society 45, 4 (2003), 635--644.

[63]

Hy Y Wu. 2012. An empirical study of UK living labs. Proceedings of International Association for Management of Technology IAMOT (2012), 1--21. http://cswww.essex.ac.uk/staff/vic/papers/misc/2012

[64]

Zephyr. 2016. Bioharness 3. (2016).

[65]

Nan Zhao, Matthew Aldrich, Christoph F Reinhart, and Joseph A Paradiso. 2015. A Multidimensional Continuous Contextual Lighting Control System Using Google Glass. In Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments. ACM, 235--244.

Digital Library

Cited By

Huang YMorris ABrunet C(2024)Designing a Multi-modal Wearable Mixed Reality System for Body Awareness in Workspaces2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555836(1-6)Online publication date: 15-May-2024
https://doi.org/10.1109/ICHMS59971.2024.10555836
Singh NBernal GSavchenko DGlassman E(2023)Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine IntelligenceACM Transactions on Computer-Human Interaction10.1145/351159930:5(1-57)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3511599
Ekblaw ACherston JLiu FWicaksono IHaddad DSumini VParadiso J(2023)From UbiComp to Universe—Moving Pervasive Computing Research Into Space ApplicationsIEEE Pervasive Computing10.1109/MPRV.2023.324266722:2(27-42)Online publication date: 1-Apr-2023
https://doi.org/10.1109/MPRV.2023.3242667
Show More Cited By

Index Terms

Mediated Atmospheres: A Multimodal Mediated Work Environment
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Ubiquitous emotion-aware computing

Emotions are a crucial element for personal and ubiquitous computing. What to sense and how to sense it, however, remain a challenge. This study explores the rare combination of speech, electrocardiogram, and a revised Self-Assessment Mannequin to ...
Stressful first impressions in job interviews
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Stress can impact many aspects of our lives, such as the way we interact and work with others, or the first impressions that we make. In the past, stress has been most commonly assessed through self-reported questionnaires; however, advancements in ...
The Perceived Emotion of Isolated Synthetic Audio: The EmoSynth Dataset and Results
AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion

The ability of sound to enhance human wellbeing has been known since ancient civilisations, and methods can be found today across domains of health and within a variety of cultures. There are an abundance of sound-based methods which show benefits for ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 2

June 2017

665 pages

EISSN:2474-9567

DOI:10.1145/3120957

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 June 2017

Accepted: 01 May 2017

Revised: 01 April 2017

Received: 01 February 2017

Published in IMWUT Volume 1, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
855
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)9

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang YMorris ABrunet C(2024)Designing a Multi-modal Wearable Mixed Reality System for Body Awareness in Workspaces2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555836(1-6)Online publication date: 15-May-2024
https://doi.org/10.1109/ICHMS59971.2024.10555836
Singh NBernal GSavchenko DGlassman E(2023)Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine IntelligenceACM Transactions on Computer-Human Interaction10.1145/351159930:5(1-57)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3511599
Ekblaw ACherston JLiu FWicaksono IHaddad DSumini VParadiso J(2023)From UbiComp to Universe—Moving Pervasive Computing Research Into Space ApplicationsIEEE Pervasive Computing10.1109/MPRV.2023.324266722:2(27-42)Online publication date: 1-Apr-2023
https://doi.org/10.1109/MPRV.2023.3242667
Fujita KTakashima KItoh YKitamura Y(2023)Human-Workspace Interaction: prior research efforts and future challenges for supporting knowledge workersQuality and User Experience10.1007/s41233-023-00060-98:1Online publication date: 18-Aug-2023
https://doi.org/10.1007/s41233-023-00060-9
Jain AMaes PSra M(2023)Adaptive Virtual NeuroarchitectureEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_9(227-249)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_9
Lopes LRodrigues ACabral DCampos P(2022)From Monitoring to Assisting: A Systematic Review towards Healthier WorkplacesInternational Journal of Environmental Research and Public Health10.3390/ijerph19231619719:23(16197)Online publication date: 3-Dec-2022
https://doi.org/10.3390/ijerph192316197
Zhao NKodama EParadiso J(2022)Mediated Atmosphere Table (MAT): Adaptive Multimodal Media System for Stress RestorationIEEE Internet of Things Journal10.1109/JIOT.2022.31909299:23(23614-23625)Online publication date: 1-Dec-2022
https://doi.org/10.1109/JIOT.2022.3190929
Margariti EAli RBenthem de Grave RVerweij DSmeddinck JKirk D(2021)Understanding the Experiences of Remote Workers: Opportunities for Ambient Workspaces at HomeFrontiers in Computer Science10.3389/fcomp.2021.6735853Online publication date: 3-Sep-2021
https://doi.org/10.3389/fcomp.2021.673585
Nkurunziza JBusa MGummeson JRisinger E(2021)Psycho-physiological impedance matching through holistic closed-loop cyber-physical systemsProceedings of the 2021 Workshop on Future of Digital Biomarkers10.1145/3469266.3471166(51-54)Online publication date: 25-Jun-2021
https://dl.acm.org/doi/10.1145/3469266.3471166
Fujita KSuzuki ATakashima KIkematsu KKitamura YKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)TiltChair: Manipulative Posture Guidance by Actively Inclining the Seat of an Office ChairProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445151(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445151
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents