Augmented Breathing via Thermal Feedback in the Nose
Article No.: 26, Pages 1 - 11
Abstract
We propose, engineer, and study a novel method to augment the feeling of breathing—enabling interactive applications to let users feel like they are inhaling more/less air (perceived nasal airflow). We achieve this effect by cooling or heating the nose in sync with the user’s inhalation. Our illusion builds on the physiology of breathing: we perceive our breath predominantly through the cooling of our nasal cavities during inhalation. This is why breathing in a “fresh” cold environment feels easier than in a “stuffy” hot environment, even when the inhaled volume is the same. Our psychophysical study confirmed that our in-nose temperature stimulation significantly influenced breathing perception in both directions: making it feel harder & easier to breathe. Further, we found that <Formula format="inline"><TexMath><?TeX $\sim 90 \,\%$?></TexMath><AltText>Math 1</AltText><File name="uist24-115-inline1" type="svg"/></Formula> of the trials were described as a change in perceived airflow/breathing, while only <Formula format="inline"><TexMath><?TeX $\sim 8 \,\%$?></TexMath><AltText>Math 2</AltText><File name="uist24-115-inline2" type="svg"/></Formula> as temperature. Following, we engineered a compact device worn across the septum that uses Peltier elements. We illustrate the potential of this augmented breathing in interactive contexts, such as for virtual reality (e.g., rendering ease of breathing crisp air or difficulty breathing with a deteriorated gas mask) and everyday interactions (e.g., in combination with a relaxation application or to alleviate the perceived breathing resistance when wearing a mask).
Supplemental Material
M4V File
UIST8023
- Download
- 56.89 MB
References
[1]
Sufyan Ashhad, Kaiwen Kam, Christopher A. Del Negro, and Jack L. Feldman. 2022. Breathing Rhythm and Pattern and Their Influence on Emotion. Annual Review of Neuroscience 45, 1 (July 2022), 223–247. https://doi.org/10.1146/annurev-neuro-090121-014424
[2]
Ilhan Aslan, Hadrian Burkhardt, Julian Kraus, and Elisabeth André. 2016. Hold my Heart and Breathe with Me: Tangible Somaesthetic Designs. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, Gothenburg Sweden, 1–6. https://doi.org/10.1145/2971485.2996727
[3]
Ryan S. Bailey, Kevin P. Casey, Sachin S. Pawar, and Guilherme J. M. Garcia. 2017. Correlation of Nasal Mucosal Temperature With Subjective Nasal Patency in Healthy Individuals. JAMA Facial Plastic Surgery 19, 1 (Jan. 2017), 46–52. https://doi.org/10.1001/jamafacial.2016.1445
[4]
Richard P. Brown and Patricia L. Gerbarg. 2005. Sudarshan Kriya Yogic Breathing in the Treatment of Stress, Anxiety, and Depression: Part II—Clinical Applications and Guidelines. The Journal of Alternative and Complementary Medicine 11, 4 (Aug. 2005), 711–717. https://doi.org/10.1089/acm.2005.11.711
[5]
Antoinette Bumatay and Jinsil Hwaryoung Seo. 2017. Investigating the Role of Biofeedback and Haptic Stimulation in Mobile Paced Breathing Tools. In Augmented Cognition. Neurocognition and Machine Learning, Dylan D. Schmorrow and Cali M. Fidopiastis (Eds.). Vol. 10284. Springer International Publishing, Cham, 287–303. https://doi.org/10.1007/978-3-319-58628-1_23 Series Title: Lecture Notes in Computer Science.
[6]
Lisa Anneke Burr, Julius Šula, Julia Mayrhauser, and Alexander Meschtscherjakov. 2023. BREATHTURES: A First Step Towards Breathing Gestures as Distinct Input Modality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–6. https://doi.org/10.1145/3544549.3585787
[7]
Yuxuan Chen, Yi Jin, Zhaoning Zeng, Shiyu Chen, Yang Zhou, Xinchi Xu, Jie Liu, and Guihuan Feng. 2023. VisaudiBlow: Fine-grained Blowing Interaction Based on Visual and Auditory Detection. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–6. https://doi.org/10.1145/3544549.3585829
[8]
George Dallam and Bethany Kies. 2020. The Effect of Nasal Breathing Versus Oral and Oronasal Breathing During Exercise: A Review. Journal of Sports Research 7, 1 (2020), 1–10. https://doi.org/10.18488/journal.90.2020.71.1.10
[9]
Char Davies and John Harrison. 1996. Osmose: towards broadening the aesthetics of virtual reality. ACM SIGGRAPH Computer Graphics 30, 4 (Nov. 1996), 25–28. https://doi.org/10.1145/240806.240808
[10]
Christopher A. Del Negro, Gregory D. Funk, and Jack L. Feldman. 2018. Breathing matters. Nature Reviews Neuroscience 19, 6 (June 2018), 351–367. https://doi.org/10.1038/s41583-018-0003-6
[11]
Esko Dijk and Alina Weffers. 2010. Breathe with the Ocean: a System for Relaxation using Audio, Haptic and Visual Stimuli. In Proceedings of Haptic and Visual Stimuli (Special Symposium at EuroHaptics 2010)(CTIT Workshop Proceedings Series, Vol. 1). University of Twente Centre for Telematics and Information Technology, Amsterdam, The Netherlands, 47–60.
[12]
Abdallah El Ali, Ekaterina R. Stepanova, Shalvi Palande, Angelika Mader, Pablo Cesar, and Kaspar Jansen. 2023. BreatheWithMe: Exploring Visual and Vibrotactile Displays for Social Breath Awareness during Colocated, Collaborative Tasks. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–8. https://doi.org/10.1145/3544549.3585589
[13]
Alexz Farrall, Jordan Taylor, Ben Ainsworth, and Jason Alexander. 2023. Manifesting Breath: Empirical Evidence for the Integration of Shape-changing Biofeedback-based Artefacts within Digital Mental Health Interventions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–14. https://doi.org/10.1145/3544548.3581188
[14]
Esther Foo, Justin Baker, Crystal Compton, and Brad Holschuh. 2020. Soft Robotic Compression Garment to Assist Novice Meditators. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–8. https://doi.org/10.1145/3334480.3382919
[15]
Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R. Cauchard. 2018. Breeze: Sharing Biofeedback through Wearable Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–12. https://doi.org/10.1145/3173574.3174219
[16]
Ikuo Homma and Yuri Masaoka. 2008. Breathing rhythms and emotions. Experimental Physiology 93, 9 (Sept. 2008), 1011–1021. https://doi.org/10.1113/expphysiol.2008.042424
[17]
Ravinder Jerath, John W. Edry, Vernon A. Barnes, and Vandna Jerath. 2006. Physiology of long pranayamic breathing: Neural respiratory elements may provide a mechanism that explains how slow deep breathing shifts the autonomic nervous system. Medical Hypotheses 67, 3 (Jan. 2006), 566–571. https://doi.org/10.1016/j.mehy.2006.02.042
[18]
Tao Jiang, Junwen Zhong, Jiaming Liang, Yichuan Wu, Zehui Li, Xiaohao Wang, Liwei Lin, and Xiang Qian. 2019. Wearable Airflow Sensor for Nasal Symmetric Evaluation and Respiration Monitoring. In 2019 IEEE SENSORS. IEEE, Montreal, QC, Canada, 1–4. https://doi.org/10.1109/SENSORS43011.2019.8956504
[19]
A. S. Jones, D. J. Willatt, and L. M. Durham. 1989. Nasal airflow: resistance and sensation. The Journal of Laryngology & Otology 103, 10 (Oct. 1989), 909–911. https://doi.org/10.1017/S0022215100110485
[20]
Annkatrin Jung, Miquel Alfaras, Pavel Karpashevich, William Primett, and Kristina Höök. 2021. Exploring Awareness of Breathing through Deep Touch Pressure. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–15. https://doi.org/10.1145/3411764.3445533
[21]
Mahin Kamalifard, Mahnaz Shahnazi, Manizheh Sayyah Melli, Shirin Allahverdizadeh, Shiva Toraby, and Atefeh Ghahvechi. 2012. The Efficacy of Massage Therapy and Breathing Techniques on Pain Intensity and Physiological Responses to Labor Pain. Journal of Caring Sciences 1, 2 (2012), 73–8. https://doi.org/10.5681/JCS.2012.011 Medium: text/html Publisher: Tabriz University of Medical Sciences.
[22]
Pavel Karpashevich, Pedro Sanches, Rachael Garrett, Yoav Luft, Kelsey Cotton, Vasiliki Tsaknaki, and Kristina Höök. 2022. Touching Our Breathing through Shape-Change: Monster, Organic Other, or Twisted Mirror. ACM Transactions on Computer-Human Interaction 29, 3 (June 2022), 1–40. https://doi.org/10.1145/3490498
[23]
Jina Kim, Young-Woo Park, and Tek-Jin Nam. 2015. BreathingFrame: An Inflatable Frame for Remote Breath Signal Sharing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Stanford California USA, 109–112. https://doi.org/10.1145/2677199.2680606
[24]
Esther Koh, Mythri Ambatipudi, DaLoria L. Boone, Julia B. W. Luehr, Alena Blaise, Jose Gonzalez, Nishant Sule, David J. Mooney, and Emily M. He. 2022. Quantifying face mask comfort. Journal of Occupational and Environmental Hygiene 19, 1 (Jan. 2022), 23–34. https://doi.org/10.1080/15459624.2021.2002342
[25]
Jinwoo Lee, Heayoun Sul, Wonha Lee, Kyung Rok Pyun, Inho Ha, Dongkwan Kim, Hyojoon Park, Hyeonjin Eom, Yeosang Yoon, Jinwook Jung, Dongjun Lee, and Seung Hwan Ko. 2020. Stretchable Skin‐Like Cooling/Heating Device for Reconstruction of Artificial Thermal Sensation in Virtual Reality. Advanced Functional Materials 30, 29 (July 2020), 1909171. https://doi.org/10.1002/adfm.201909171
[26]
J. Lindemann, R. Leiacker, G. Rettinger, and T. Keck. 2002. Nasal mucosal temperature during respiration. Clinical Otolaryngology and Allied Sciences 27, 3 (June 2002), 135–139. https://doi.org/10.1046/j.1365-2273.2002.00544.x
[27]
Sunniva Liu, Jianzhe Gu, Dinesh K Patel, and Lining Yao. 2024. breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft Interfaces. In Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Cork Ireland, 1–11. https://doi.org/10.1145/3623509.3633372
[28]
Xin Liu. 2017. Masque: A Misheard Self. In Inward to Outward. Massachusetts Institute of Technology, Cambridge, Massachusetts, USA, 48–63. http://hdl.handle.net/1721.1/114069
[29]
Lars Malm. 1997. Measurement of nasal patency. Allergy 52 (Dec. 1997), 19–23. https://doi.org/10.1111/j.1398-9995.1997.tb04879.x
[30]
Joe Marshall, Duncan Rowland, Stefan Rennick Egglestone, Steve Benford, Brendan Walker, and Derek McAuley. 2011. Breath control of amusement rides. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11. ACM Press, Vancouver, BC, Canada, 73. https://doi.org/10.1145/1978942.1978955
[31]
Jelena Mladenović, Jérémy Frey, and Jessica R. Cauchard. 2018. Dišimo: Anchoring Our Breath. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–4. https://doi.org/10.1145/3170427.3186517
[32]
Neema Moraveji, Ben Olson, Truc Nguyen, Mahmoud Saadat, Yaser Khalighi, Roy Pea, and Jeffrey Heer. 2011. Peripheral paced respiration: influencing user physiology during information work. In Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST ’11. ACM Press, Santa Barbara, California, USA, 423. https://doi.org/10.1145/2047196.2047250
[33]
Caitlin Morris, Pinyao Liu, Bernhard E. Riecke, and Pattie Maes. 2023. InExChange: Fostering Genuine Social Connection through Embodied Breath Sharing in Mixed Reality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–5. https://doi.org/10.1145/3544549.3583917
[34]
Pablo Paredes and Matthew Chan. 2011. CalmMeNow: exploratory research and design of stress mitigating mobile interventions. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems. ACM, Vancouver BC Canada, 1699–1704. https://doi.org/10.1145/1979742.1979831
[35]
Sungmee Park and Sundaresan Jayaraman. 2021. From containment to harm reduction from SARS-CoV-2: a fabric mask for enhanced effectiveness, comfort, and compliance. The Journal of The Textile Institute 112, 7 (July 2021), 1144–1158. https://doi.org/10.1080/00405000.2020.1805971
[36]
Pierre Philippot, Gaëtane Chapelle, and Sylvie Blairy. 2002. Respiratory feedback in the generation of emotion. Cognition & Emotion 16, 5 (Aug. 2002), 605–627. https://doi.org/10.1080/02699930143000392
[37]
Jasper Shen, Kevin Hur, Kai Zhao, Donald Leopold, and Bozena Wrobel. 2017. Determinants and Evaluation of Nasal Airflow Perception. Facial Plastic Surgery 33, 04 (Aug. 2017), 372–377. https://doi.org/10.1055/s-0037-1603788
[38]
Jeffrey C. Smith, Ana P.L. Abdala, Anke Borgmann, Ilya A. Rybak, and Julian F.R. Paton. 2013. Brainstem respiratory networks: building blocks and microcircuits. Trends in Neurosciences 36, 3 (March 2013), 152–162. https://doi.org/10.1016/j.tins.2012.11.004
[39]
Jeffrey C. Smith, Ana P. L. Abdala, Ilya A. Rybak, and Julian F. R. Paton. 2009. Structural and functional architecture of respiratory networks in the mammalian brainstem. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1529 (Sept. 2009), 2577–2587. https://doi.org/10.1098/rstb.2009.0081
[40]
Tobias Sonne and Mads Møller Jensen. 2016. ChillFish: A Respiration Game for Children with ADHD. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’16. ACM Press, Eindhoven, Netherlands, 271–278. https://doi.org/10.1145/2839462.2839480
[41]
Florian Soyka, Markus Leyrer, Joe Smallwood, Chris Ferguson, Bernhard E. Riecke, and Betty J. Mohler. 2016. Enhancing stress management techniques using virtual reality. In Proceedings of the ACM Symposium on Applied Perception. ACM, Anaheim California, 85–88. https://doi.org/10.1145/2931002.2931017
[42]
Misha Sra, Xuhai Xu, and Pattie Maes. 2018. BreathVR: Leveraging Breathing as a Directly Controlled Interface for Virtual Reality Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–12. https://doi.org/10.1145/3173574.3173914
[43]
Michael G. Stewart, David L. Witsell, Timothy L. Smith, Edward M. Weaver, Bevan Yueh, and Maureen T. Hannley. 2004. Development and Validation of the Nasal Obstruction Symptom Evaluation (NOSE) Scale. Otolaryngology–Head and Neck Surgery 130, 2 (Feb. 2004), 157–163. https://doi.org/10.1016/j.otohns.2003.09.016
[44]
Rujia Sun, Xiaohe Zhou, Benjamin Steeper, Ruidong Zhang, Sicheng Yin, Ke Li, Shengzhang Wu, Sam Tilsen, Francois Guimbretiere, and Cheng Zhang. 2023. EchoNose: Sensing Mouth, Breathing and Tongue Gestures inside Oral Cavity using a Non-contact Nose Interface. In Proceedings of the 2023 International Symposium on Wearable Computers. ACM, Cancun, Quintana Roo Mexico, 22–26. https://doi.org/10.1145/3594738.3611358
[45]
Xiaotian Sun and Kiyoshi Tomimatsu. 2017. Breath Is to Be Perceived - Breathing Signal Sharing Involved in Remote Emotional Communication. In Distributed, Ambient and Pervasive Interactions, Norbert Streitz and Panos Markopoulos (Eds.). Vol. 10291. Springer International Publishing, Cham, 472–481. https://doi.org/10.1007/978-3-319-58697-7_35 Series Title: Lecture Notes in Computer Science.
[46]
Markus Tatzgern, Michael Domhardt, Martin Wolf, Michael Cenger, Gerlinde Emsenhuber, Radomir Dinic, Nathalie Gerner, and Arnulf Hartl. 2022. AirRes Mask: A Precise and Robust Virtual Reality Breathing Interface Utilizing Breathing Resistance as Output Modality. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1–14. https://doi.org/10.1145/3491102.3502090
[47]
Paul Tennent, Duncan Rowland, Joe Marshall, Stefan Rennick Egglestone, Alexander Harrison, Zachary Jaime, Brendan Walker, and Steve Benford. 2011. Breathalising games: understanding the potential of breath control in game interfaces. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology - ACE ’11. ACM Press, Lisbon, Portugal, 1. https://doi.org/10.1145/2071423.2071496
[48]
Linlin Tu, Chongguang Bi, Tian Hao, and Guoliang Xing. 2018. BreathCoach: A Smart In-home Breathing Training System with Bio-Feedback via VR Game. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers - UbiComp ’18. ACM Press, Singapore, Singapore, 468–471. https://doi.org/10.1145/3267305.3267582
[49]
Shun-Yu Wang, Chia-Yu Cheng, Shu-Meng Huang, Weng Io Chan, Yu-Hsuan Huang, and Jhih-Wei Lin. 2023. Breathero: Not Another Slow Breathing Game — Exploring Faster-Paced VR Breathing Exercise Games. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–7. https://doi.org/10.1145/3544549.3583829
[50]
D. J. Willatt and A. S. Jones. 1996. The role of the temperature of the nasal lining in the sensation of nasal patency. Clinical Otolaryngology 21, 6 (Dec. 1996), 519–523. https://doi.org/10.1111/j.1365-2273.1996.tb01102.x
[51]
Xiaoguang Yan, Susanne Menzel, Kai Zhao, Kanghyun Kim, and Thomas Hummel. 2023. Intranasal trigeminal sensitivity to mechanical stimuli is associated with the perception of nasal patency. European Archives of Oto-Rhino-Laryngology 280, 12 (Dec. 2023), 5391–5399. https://doi.org/10.1007/s00405-023-08126-2
[52]
I. Yoshiya, T. Nakajima, I. Nagai, and S. Jitsukawa. 1975. A bidirectional respiratory flowmeter using the hot-wire principle. Journal of Applied Physiology 38, 2 (Feb. 1975), 360–365. https://doi.org/10.1152/jappl.1975.38.2.360
[53]
Kai Zhao, Kara Blacker, Yuehao Luo, Bruce Bryant, and Jianbo Jiang. 2011. Perceiving Nasal Patency through Mucosal Cooling Rather than Air Temperature or Nasal Resistance. PLoS ONE 6, 10 (Oct. 2011), e24618. https://doi.org/10.1371/journal.pone.0024618
[54]
Daniel Zielasko, Sebastian Freitag, Dominik Rausch, Yuen C. Law, Benjamin Weyers, and Torsten W. Kuhlen. 2015. BlowClick: A Non-Verbal Vocal Input Metaphor for Clicking. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction - SUI ’15. ACM Press, Los Angeles, California, USA, 20–23. https://doi.org/10.1145/2788940.2788953
Index Terms
- Augmented Breathing via Thermal Feedback in the Nose
Recommendations
Demonstrating Augmented Breathing via Thermal Feedback in the Nose
UIST Adjunct '24: Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and TechnologyWe demonstrate a novel method to augment the feeling of breathing—enabling interactive applications to let users feel like they are inhaling more/less air (perceived nasal airflow). We achieve this effect by cooling or heating the nose in sync with the ...
Real-time Thermal Medium-based Breathing Analysis with Python
PyHPC'17: Proceedings of the 7th Workshop on Python for High-Performance and Scientific ComputingRespiration monitoring is an important physiological measurement taken to determine the health of an individual. In clinical sleep studies, respiration activity is monitored to detect sleep disorders such as sleep apnea and respiratory conditions such ...
Comments
Information & Contributors
Information
Published In
October 2024
2334 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
UIST '24
UIST '24: The 37th Annual ACM Symposium on User Interface Software and Technology
October 13 - 16, 2024
PA, Pittsburgh, USA
Acceptance Rates
Overall Acceptance Rate 561 of 2,567 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 420Total Downloads
- Downloads (Last 12 months)420
- Downloads (Last 6 weeks)166
Reflects downloads up to 25 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in