skip to main content
research-article

RF Vital Sign Sensing under Free Body Movement

Published: 14 September 2021 Publication History

Abstract

Radio frequency (RF) sensors such as radar are instrumental for continuous, contactless sensing of vital signs, especially heart rate (HR) and respiration rate (RR). However, decades of related research mainly focused on static subjects, because the motion artifacts from other body parts may easily overwhelm the weak reflections from vital signs. This paper marks a first step in enabling RF vital sign sensing under ambulant daily living conditions. Our solution is inspired by existing physiological research that revealed the correlation between vital signs and body movement. Specifically, we propose to combine direct RF sensing for static instances and indirect vital sign prediction based on movement power estimation. We design customized machine learning models to capture the sophisticated correlation between RF signal pattern, movement power, and vital signs. We further design an instant calibration and adaptive training scheme to enable cross-subjects generalization, without any explicit data labeling from unknown subjects. We prototype and evaluate the framework using a commodity radar sensor. Under a variety of moving conditions, our solution demonstrates an average estimation error of 5.57 bpm for HR and 3.32 bpm for RR across multiple subjects, which largely outperforms state-of-the-art systems.

References

[1]
Shyam A, Vignesh Ravichandran, Preejith S. P, Jayaraj Joseph, and Mohanasankar Sivaprakasam. 2019. PPGnet: Deep Network for Device Independent Heart Rate Estimation from Photoplethysmogram. CoRR abs/1903.08912 (2019).
[2]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 837--846.
[3]
D. Biswas, L. Everson, M. Liu, M. Panwar, B. Verhoef, S. Patki, C. H. Kim, A. Acharyya, C. Van Hoof, M. Konijnenburg, and N. Van Helleputte. 2019. CorNET: Deep Learning Framework for PPG-Based Heart Rate Estimation and Biometric Identification in Ambulant Environment. IEEE Transactions on Biomedical Circuits and Systems 13, 2 (2019).
[4]
Mark Brink, Christopher H Müller, and Christoph Schierz. 2006. Contact-free measurement of heart rate, respiration rate, and body movements during sleep. Behavior research methods 38, 3 (2006), 511--521.
[5]
N. Burba, M. Bolas, D. M. Krum, and E. A. Suma. 2012. Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect. In IEEE Virtual Reality Workshops (VRW).
[6]
Giovanni Diraco, Alessandro Leone, and Pietro Siciliano. 2017. A radar-based smart sensor for unobtrusive elderly monitoring in ambient assisted living applications. Biosensors 7, 4 (2017), 55.
[7]
Biyi Fang, Nicholas D Lane, Mi Zhang, Aidan Boran, and Fahim Kawsar. 2016. BodyScan: Enabling radio-based sensing on wearable devices for contactless activity and vital sign monitoring. In Proceedings of the 14th annual international conference on mobile systems, applications, and services. 97--110.
[8]
Maria Faurholt-Jepsen, Søren Brage, Maj Vinberg, and Lars Vedel Kessing. 2016. State-related differences in the level of psychomotor activity in patients with bipolar disorder-Continuous heart rate and movement monitoring. Psychiatry research 237 (2016), 166--174.
[9]
Denise Felber Dietrich, Ursula Ackermann-Liebrich, Christian Schindler, Jean-Claude Barthélémy, Otto Brändli, Diane R Gold, Bruno Knöpfli, Nicole M Probst-Hensch, Fr d ric Roche, Jean-Marie Tschopp, et al. 2008. Effect of physical activity on heart rate variability in normal weight, overweight and obese subjects: results from the SAPALDIA study. European journal of applied physiology 104, 3 (2008), 557--565.
[10]
Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning. 1050--1059.
[11]
Felix A Gers, Jürgen Schmidhuber, and Fred Cummins. 1999. Learning to forget: Continual prediction with LSTM. (1999).
[12]
Changzhan Gu, Guochao Wang, Yiran Li, Takao Inoue, and Changzhi Li. 2013. A hybrid radar-camera sensing system with phase compensation for random body movement cancellation in Doppler vital sign detection. IEEE transactions on microwave theory and techniques 61, 12 (2013), 4678--4688.
[13]
Te-Yu J Kao, Yan Yan, Tze-Min Shen, Austin Ying-Kuang Chen, and Jenshan Lin. 2013. Design and analysis of a 60-GHz CMOS Doppler micro-radar system-in-package for vital-sign and vibration detection. IEEE Transactions on Microwave Theory and Techniques 61, 4 (2013), 1649--1659.
[14]
John B Kostis, AE Moreyra, MT Amendo, JOANNE Di Pietro, NORA Cosgrove, and PT Kuo. 1982. The effect of age on heart rate in subjects free of heart disease. Studies by ambulatory electrocardiography and maximal exercise stress test. Circulation 65, 1 (1982), 141--145.
[15]
Arnaldo G Leal-Junior, Camilo R Díaz, Cátia Leitão, Maria José Pontes, Carlos Marques, and Anselmo Frizera. 2019. Polymer optical fiber-based sensor for simultaneous measurement of breath and heart rate under dynamic movements. Optics & Laser Technology 109 (2019), 429--436.
[16]
Changzhi Li, Jun Ling, Jian Li, and Jenshan Lin. 2009. Accurate Doppler radar noncontact vital sign detection using the RELAX algorithm. IEEE Transactions on Instrumentation and Measurement 59, 3 (2009), 687--695.
[17]
J. C. Lin. 1975. Noninvasive microwave measurement of respiration. Proc. IEEE 63, 10 (1975).
[18]
Lanbo Liu and Sixin Liu. 2014. Remote detection of human vital sign with stepped-frequency continuous wave radar. IEEE journal of selected topics in applied earth observations and remote sensing 7, 3 (2014), 775--782.
[19]
Mohamed Faisal Lutfi and Mohamed Yosif Sukkar. 2011. The effect of gender on heart rate variability in asthmatic and normal healthy adults. International journal of health sciences 5, 2 (2011), 146.
[20]
FS Martinelli, MPT Chacon-Mikahil, LEB Martins, EC Lima-Filho, R Golfetti, MA Paschoal, and L Gallo-Junior. 2005. Heart rate variability in athletes and nonathletes at rest and during head-up tilt. Brazilian journal of medical and biological research 38, 4 (2005), 639--647.
[21]
Dionne Matthew and Anne Delextrat. 2009. Heart rate, blood lactate concentration, and time-motion analysis of female basketball players during competition. Journal of sports sciences 27, 8 (2009), 813--821.
[22]
Isar Mostafanezhad, Ehsan Yavari, Olga Boric-Lubecke, Victor M Lubecke, and Danilo P Mandic. 2013. Cancellation of unwanted Doppler radar sensor motion using empirical mode decomposition. IEEE Sensors Journal 13, 5 (2013), 1897--1904.
[23]
Mehrdad Nosrati, Shahram Shahsavari, Sanghoon Lee, Hua Wang, and Negar Tavassolian. 2019. A Concurrent Dual-Beam Phased-Array Doppler Radar Using MIMO Beamforming Techniques for Short-Range Vital-Signs Monitoring. IEEE Transactions on Antennas and Propagation 67, 4 (2019), 2390--2404.
[24]
Selena R Pasadyn, Mohamad Soudan, Marc Gillinov, Penny Houghtaling, Dermot Phelan, Nicole Gillinov, Barbara Bittel, and Milind Y Desai. 2019. Accuracy of commercially available heart rate monitors in athletes: a prospective study. Cardiovascular diagnosis and therapy 9, 4 (2019), 379.
[25]
Raffaella Pellegrini and Maria Rita Ciceri. 2012. Listening to and mimicking respiration: Understanding and synchronizing joint actions. Review of psychology 19, 1 (2012), 17--27.
[26]
Polar. 2019. Polar H10 heart rate sensor. https://www.polar.com/us-en/products/accessories/
[27]
Pytorch. 2020. Pytorch website. https://pytorch.org/
[28]
Kun Qian, Chenshu Wu, Zheng Yang, Yunhao Liu, and Kyle Jamieson. 2017. Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi. In Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc).
[29]
Tauhidur Rahman, Alexander T Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak N Patel, Julie A Kientz, and Tanzeem Choudhury. 2015. Dopplesleep: A contactless unobtrusive sleep sensing system using short-range doppler radar. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 39--50.
[30]
B Rassler and J Kohl. 2000. Coordination-related changes in the rhythms of breathing and walking in humans. European journal of applied physiology 82, 4 (2000), 280--288.
[31]
JD Schipke, G Arnold, and M Pelzer. 1999. Effect of respiration rate on short-term heart rate variability. Journal of Clinical and Basic Cardiology 2, 1 (1999), 92--95.
[32]
José J Segura-Juárez, David Cuesta-Frau, Luis Samblas-Pena, and Mateo Aboy. 2004. A microcontroller-based portable electrocardiograph recorder. IEEE Transactions on Biomedical Engineering 51, 9 (2004), 1686--1690.
[33]
Azadeh Sharafi, Mehran Baboli, Mohammad Eshghi, and Alireza Ahmadian. 2012. Respiration-rate estimation of a moving target using impulse-based ultra wideband radars. Australasian physical & engineering sciences in medicine 35, 1 (2012), 31--39.
[34]
Kunsoo Shin, HARUYUKI Minamitani, SHOHEI Onishi, HAJIME Yamazaki, and MYOUNGHO Lee. 1997. Autonomic differences between athletes and nonathletes: spectral analysis approach. Medicine and Science in Sports and Exercise 29, 11 (1997), 1482--1490.
[35]
Steven W Su, Weidong Chen, Dongdong Liu, Yi Fang, Weijun Kuang, Xiaoxiang Yu, Tian Guo, Branko G Celler, and Hung T Nguyen. 2010. Dynamic modelling of heart rate response under different exercise intensity. The open medical informatics journal 4 (2010), 81.
[36]
TI. 2019. AWR1243Boost. http://www.ti.com/tool/AWR1243BOOST
[37]
TI. 2019. FMCW principle. http://www.ti.com/lit/wp/spyy007/spyy007.pdf
[38]
TI. 2019. The fundamentals of millimeter wave sensors. http://www.ti.com/lit/wp/spyy005/spyy005.pdf
[39]
Jianxuan Tu, Taesong Hwang, and Jenshan Lin. 2016. Respiration rate measurement under 1-D body motion using single continuous-wave Doppler radar vital sign detection system. IEEE Transactions on Microwave Theory and Techniques 64, 6 (2016), 1937--1946.
[40]
Kim van Loon, Linda M Peelen, Emmy C van de Vlasakker, Cor J Kalkman, Leo van Wolfswinkel, and Bas van Zaane. 2018. Accuracy of remote continuous respiratory rate monitoring technologies intended for low care clinical settings: a prospective observational study. Canadian Journal of Anesthesia/Journal canadien d'anesthésie 65, 12 (2018), 1324--1332.
[41]
Vernier. 2019. Respiration Monitor Belt. https://www.vernier.com/product/go-direct-respiration-belt/
[42]
Fu-Kang Wang, Tzyy-Sheng Horng, Kang-Chun Peng, Je-Kuan Jau, Jian-Yu Li, and Cheng-Chung Chen. 2011. Single-antenna Doppler radars using self and mutual injection locking for vital sign detection with random body movement cancellation. IEEE Transactions on Microwave Theory and Techniques 59, 12 (2011), 3577--3587.
[43]
Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 25--36.
[44]
S. Wiesner and Z. Yaniv. 2007. Monitoring Patient Respiration using a Single Optical Camera. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
[45]
Zhicheng Yang, Parth H Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2016. Monitoring vital signs using millimeter wave. In Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 211--220.
[46]
Zhicheng Yang, Parth H Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2017. Vital sign and sleep monitoring using millimeter wave. ACM Transactions on Sensor Networks (TOSN) 13, 2 (2017), 1--32.
[47]
Saeid Yazdanirad, Habibollah Dehghan, Yaser Rahimi, Mohammad Zeinodini, and Mahnaz Shakeriyan. 2015. The relationship between overweight and heart rate in hot and very hot weather under controlled conditions. Health Scope 4, 4 (2015).
[48]
Wenfeng Yin, Xiuzhu Yang, Lei Li, Lin Zhang, Nattapong Kitsuwan, and Eiji Oki. 2018. Hear: Approach for Heartbeat Monitoring with Body Movement Compensation by IR-UWB Radar. Sensors 18, 9 (2018), 3077.
[49]
Shichao Yue, Hao He, Hao Wang, Hariharan Rahul, and Dina Katabi. 2018. Extracting multi-person respiration from entangled RF signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--22.

Cited By

View all
  • (2025)VitalHide: Enabling Privacy-Aware Wireless Sensing of Vital SignsProceedings of the 26th International Workshop on Mobile Computing Systems and Applications10.1145/3708468.3711880(37-42)Online publication date: 26-Feb-2025
  • (2025)mm-MuRe: mmWave-Based Multi-Subject Respiration Monitoring via End-to-End Deep LearningIEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology10.1109/JERM.2024.34437829:1(49-61)Online publication date: Mar-2025
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 5, Issue 3
Sept 2021
1443 pages
EISSN:2474-9567
DOI:10.1145/3486621
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2021
Published in IMWUT Volume 5, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deep learning
  2. heart rate
  3. millimeter wave radar
  4. respiration rate

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)328
  • Downloads (Last 6 weeks)27
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)VitalHide: Enabling Privacy-Aware Wireless Sensing of Vital SignsProceedings of the 26th International Workshop on Mobile Computing Systems and Applications10.1145/3708468.3711880(37-42)Online publication date: 26-Feb-2025
  • (2025)mm-MuRe: mmWave-Based Multi-Subject Respiration Monitoring via End-to-End Deep LearningIEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology10.1109/JERM.2024.34437829:1(49-61)Online publication date: Mar-2025
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • (2024)Vital Sign Sensing in Motion based on Millimeter Wave RadarProceedings of the 2024 4th International Joint Conference on Robotics and Artificial Intelligence10.1145/3696474.3696489(64-67)Online publication date: 13-Sep-2024
  • (2024)RF-GymCare: Introducing Respiratory Prior for RF Sensing in Gym EnvironmentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785688:3(1-28)Online publication date: 9-Sep-2024
  • (2024)BSENSE: In-vehicle Child Detection and Vital Sign Monitoring with a Single mmWave Radar and Synthetic ReflectorsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699352(478-492)Online publication date: 4-Nov-2024
  • (2024)Enhancing mmWave Radar Sensing Using a Phased-MIMO ArchitectureProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661865(56-69)Online publication date: 3-Jun-2024
  • (2024)MetaBioLiq: A Wearable Passive Metasurface Aided mmWave Sensing Platform for BioFluidsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690687(1192-1206)Online publication date: 4-Dec-2024
  • (2024)MSense: Boosting Wireless Sensing Capability Under Motion InterferenceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649350(108-123)Online publication date: 29-May-2024
  • (2024)Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity RecognitionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314157:4(1-25)Online publication date: 12-Jan-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media