Lisa Anneke Burr
Alexander Meschtscherjakov
ABSTRACT
The use of breath as interaction modality has sparked some interest recently in HCI. Research in this field actively explored breathing interaction (e.g., guidance and feedback) in different contexts. So far, very little systems can be found that systematically use defined breathing gestures as distinct input modality. In this work, we describe the design, development and implementation of five distinct breathing gestures (BREATHTURES), that can be applied as defined input modality to interact with an application. We present a qualitative user study (n=7) focusing on usability and user experience of the developed BREATHTURES when applied in a game-like application. Results indicate an overall positive rating in terms of fun and usability. Some BREATHTURES were perceived harder to perform and to detect than others. Further iterations of our work will require refined BREATHTURE detection. Overall, our work demonstrates the design, implementation and application of pre-defined breathing gestures as distinct input modality.
Footnotes
1 For this research ethical approval was granted by the Ethics Committee of Salzburg University, reference number: GZ 12/2022
Footnote
Supplemental Material
- Fadel Adib, Zachary Kabelac, Hongzi Mao, Dina Katabi, and Robert C. Miller. 2014. Demo: Real-Time Breath Monitoring Using Wireless Signals. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (Maui, Hawaii, USA) (MobiCom ’14). Association for Computing Machinery, New York, NY, USA, 261–262. https://doi.org/10.1145/2639108.2641756Google Scholar
Digital Library
- Vasundhara Agrawal, Varnika Naik, Mayuri Duggirala, and Sandeep Athavale. 2020. Calm a mobile based deep breathing game with biofeedback. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play. 153–157.Google ScholarDigital Library
- Ahmet Baydur, Rodney H Adkins, and Joseph Milic-Emili. 2001. Lung mechanics in individuals with spinal cord injury: effects of injury level and posture. Journal of Applied Physiology 90, 2 (2001), 405–411.Google ScholarCross Ref
- Gila Benchetrit. 2000. Breathing pattern in humans: diversity and individuality. Respiration physiology 122, 2-3 (2000), 123–129.Google Scholar
- Lisa Burr, Nick Betzlbacher, Alexander Meschtscherjakov, and Manfred Tscheligi. 2022. Breathing Training on the Run: Exploring Users Perception on a Gamified Breathing Training Application During Treadmill Running. In Persuasive Technology: 17th International Conference, PERSUASIVE 2022, Virtual Event, March 29–31, 2022, Proceedings (Doha, Qatar). Springer-Verlag, Berlin, Heidelberg, 58–74. https://doi.org/10.1007/978-3-030-98438-0_5Google ScholarDigital Library
- Wei-Hung Chen. 2015. Blowatch: Blowable and hands-free interaction for smartwatches. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on human factors in computing systems. 103–108.Google ScholarDigital Library
- Yeqing Chen, Yulong Bian, Wei Gai, and Chenglei Yang. 2020. Adaptive Blowing Interaction Method Based on a Siamese Network. IEEE Access 8 (2020), 115486–115500.Google ScholarCross Ref
- Youngjun Cho, Nadia Bianchi-Berthouze, and Simon J Julier. 2017. DeepBreath: Deep learning of breathing patterns for automatic stress recognition using low-cost thermal imaging in unconstrained settings. In 2017 seventh international conference on affective computing and intelligent interaction (acii). IEEE, 456–463.Google Scholar
- Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R Cauchard. 2018. Breeze: Sharing biofeedback through wearable technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- N Garcia-Hernandez, I Muñoz-Pepi, F Villafranca-Martinez, and V Parra-Vega. 2022. Usability and Effectiveness Evaluation of a Game-Based Biofeedback System to Strengthen Respiratory Muscles. International Journal of Human–Computer Interaction (2022), 1–12.Google ScholarCross Ref
- Eric Harbour, Michael Lasshofer, Matteo Genitrini, and Hermann Schwameder. 2021. Enhanced breathing pattern detection during running using wearable sensors. Sensors 21, 16 (2021), 5606.Google ScholarCross Ref
- Eric Harbour, Thomas Stöggl, Hermann Schwameder, and Thomas Finkenzeller. 2022. Breath Tools: A Synthesis of Evidence-Based Breathing Strategies to Enhance Human Running. Frontiers in Physiology (2022), 233.Google Scholar
- Oo Jin Heng and Quek Albert. 2020. Bubble Tower: Breathing Based Virtual Reality Action Game. In Proceedings of the 2020 the 4th International Conference on Big Data and Internet of Things. 33–37.Google ScholarDigital Library
- Rohan Hundia and Aaron Quigley. 2019. BreathIn: A breath pattern sensing approach for user computer interaction. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction. 581–584.Google ScholarDigital Library
- Annkatrin Jung, Miquel Alfaras, Pavel Karpashevich, William Primett, and Kristina Höök. 2021. Exploring Awareness of Breathing through Deep Touch Pressure. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 263, 15 pages. https://doi.org/10.1145/3411764.3445533Google ScholarDigital Library
- Jong-Hyun Kim and Jung Lee. 2020. Controlling your contents with the breath: Interactive breath interface for VR, games, and animations. Plos one 15, 10 (2020), e0241498.Google ScholarCross Ref
- Takahiro Kusabuka and Takuya Indo. 2020. IBUKI: Gesture Input Method Based on Breathing. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology. 102–104.Google ScholarDigital Library
- James R Lewis. 2006. Usability testing. Handbook of human factors and ergonomics 12 (2006), e30.Google Scholar
- Ryoma Ogawa, Kyosuke Futami, and Kazuya Murao. 2021. NasalBreathInput: A Hands-Free Input Method by Nasal Breath Gestures using a Glasses Type Device. In The 23rd International Conference on Information Integration and Web Intelligence. 620–624.Google ScholarDigital Library
- Ryoya Onishi, Tao Morisaki, Shun Suzuki, Saya Mizutani, Takaaki Kamigaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2021. DualBreath: Input Method Using Nasal and Mouth Breathing. In Augmented Humans Conference 2021. 283–285.Google Scholar
- Pablo E Paredes, Yijun Zhou, Nur Al-Huda Hamdan, Stephanie Balters, Elizabeth Murnane, Wendy Ju, and James A Landay. 2018. Just breathe: In-car interventions for guided slow breathing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1–23.Google ScholarDigital Library
- Shwetak N Patel and Gregory D Abowd. 2007. Blui: low-cost localized blowable user interfaces. In Proceedings of the 20th annual ACM symposium on User interface software and technology. 217–220.Google ScholarDigital Library
- Rakesh Patibanda, Florian’Floyd’ Mueller, Matevz Leskovsek, and Jonathan Duckworth. 2017. Life tree: understanding the design of breathing exercise games. In Proceedings of the annual symposium on computer-human interaction in play. 19–31.Google ScholarDigital Library
- Michael Brent Phillips, Jason Beach, Michael Cathey, Jake Lockert, and William Satterfield. 2017. Reliability and validity of the Hexoskin wearable body metrics telemetry shirt. Journal of Sport and Human Performance 5, 2 (2017).Google Scholar
- Mirjana Prpa, Ekaterina R. Stepanova, Thecla Schiphorst, Bernhard E. Riecke, and Philippe Pasquier. 2020. Inhaling and Exhaling: How Technologies Can Perceptually Extend Our Breath Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376183Google ScholarDigital Library
- Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, Pratik Shah, Jason Wu, Aman Parnami, Bailey Bercik, Thad Starner, Gregory D Abowd, and W Keith Edwards. 2016. Whoosh: non-voice acoustics for low-cost, hands-free, and rapid input on smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 120–127.Google ScholarDigital Library
- Daniela Roditi and Michael E Robinson. 2011. The role of psychological interventions in the management of patients with chronic pain. Psychology research and behavior management 4 (2011), 41.Google Scholar
- Jeff Sauro. 2012. things to know about the Single Ease Question (SEQ). Measuring U 2012 (2012).Google Scholar
- Misha Sra, Xuhai Xu, and Pattie Maes. 2018. Breathvr: Leveraging breathing as a directly controlled interface for virtual reality games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Markus Tatzgern, Michael Domhardt, Martin Wolf, Michael Cenger, Gerlinde Emsenhuber, Radomir Dinic, Nathalie Gerner, and Arnulf Hartl. 2022. AirRes Mask: A Precise and Robust Virtual Reality Breathing Interface Utilizing Breathing Resistance as Output Modality. In CHI Conference on Human Factors in Computing Systems. 1–14.Google ScholarDigital Library
- Paul Tennent, Duncan Rowland, Joe Marshall, Stefan Rennick Egglestone, Alexander Harrison, Zachary Jaime, Brendan Walker, and Steve Benford. 2011. Breathalising games: understanding the potential of breath control in game interfaces. In Proceedings of the 8th international conference on advances in computer entertainment technology. 1–8.Google ScholarDigital Library
- Robby van Delden, Danny Plass-Oude Bos, Antje Jacoba Vivian de With, Koen Vogel, Randy Klaassen, Nynke Zwart, Joyce Faber, Boony Thio, and Mattienne van der Kamp. 2020. SpiroPlay, a Suite of Breathing Games for Spirometry by Kids & Experts. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 400–413.Google ScholarDigital Library
- Vincent Van Rheden, Eric Harbour, Thomas Finkenzeller, Lisa Anneke Burr, Alexander Meschtscherjakov, and Manfred Tscheligi. 2021. Run, Beep, Breathe: Exploring the Effects on Adherence and User Experience of 5 Breathing Instruction Sounds while Running. In Proceedings of the 16th International Audio Mostly Conference, AM 2021(ACM International Conference Proceeding Series). Association for Computing Machinery, 16–23. https://doi.org/10.1145/3478384.3478412 Publisher Copyright: © 2021 ACM.; 16th International Audio Mostly Conference, AM 2021 ; Conference date: 01-09-2021 Through 03-09-2021.Google ScholarDigital Library
- X Rosalind Wang, Joseph T Lizier, Amalia Z Berna, Florence G Bravo, and Stephen C Trowell. 2015. Human breath-print identification by E-nose, using information-theoretic feature selection prior to classification. Sensors and Actuators B: Chemical 217 (2015), 165–174.Google ScholarCross Ref
- Motoji Yamamoto, Takeshi Ikeda, and Yoshinobu Sasaki. 2008. Real-time analog input device using breath pressure for the operation of powered wheelchair. In 2008 IEEE International Conference on Robotics and Automation. IEEE, 3914–3919.Google ScholarCross Ref
- Andrea Zaccaro, Andrea Piarulli, Marco Laurino, Erika Garbella, Danilo Menicucci, Bruno Neri, and Angelo Gemignani. 2018. How Breath-Control Can Change Your Life: A Systematic Review on Psycho-Physiological Correlates of Slow Breathing. Frontiers in human neuroscience 12 (2018), 353. https://doi.org/10.3389/fnhum.2018.00353Google ScholarCross Ref
Index Terms
- BREATHTURES: A First Step Towards Breathing Gestures as Distinct Input Modality
Recommendations
Breathero: Not Another Slow Breathing Game — Exploring Faster-Paced VR Breathing Exercise Games
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsBreatHero is a faster-paced Virtual Reality (VR) action game that explores the potential of combining breathing techniques learning with the combat elements of action games. BreatHero uses breathing techniques as various skills for attacking and ...
HRV Assessment Using Finger-tip Photoplethysmography (PulseRate) as Compared to ECG on Healthy Subjects During Different Postures and Fixed Breathing Pattern
AbstractHeart Rate Variability (HRV) is a well-known method to assess the human Autonomic Nervous System (ANS) functions. Currently, in the health care information system, HRV properties are very useful to provide medical and other vital signs of the ...
Breathing patterns recognition: A functional data analysis approach
Highlights- Assessing subject's respiratory function and his/her breathing pattern is fundamental.
Abstract Background and ObjectiveThe ongoing pandemic proved fundamental is to assess a subject's respiratory functionality and breathing pattern measurement during quiet breathing is feasible in almost all patients, even those ...
Comments