Abstract
Recent advances in computer vision and signal processing are enabling researchers to realize mechanisms for the remote monitoring of vital signs. The remote measurement of vital signs, including heart rate (HR), Heart Rate Variability (HRV), and respiratory rate, presents important advantages for patients. For instance, continuous remote monitoring alleviates the discomfort due to skin irritation and/or mobility limitation associated with contact-based measurement techniques. Recently, several studies presented methods to measure HR and HRV by detecting the Blood Volume Pulse (BVP) from the human skin. They use a single camera to capture a visible segment of the skin such as face, hand, or foot to monitor the BVP. We propose a remote HR measurement algorithm that uses multiple cameras to capture the facial video recordings of still and moving subjects. Using Independent Component Analysis (ICA) as a Blind Source Separation (BSS) method, we isolate the physiological signals from noise in the RGB facial video recordings. With respect to the ECG measurement ground truth, the proposed method decreases the RMSE by 18% compared to the state-of-the-art in the subject movement condition. The proposed method achieves an RMSE of 1.43 bpm and 0.96 bpm in the stationary and movement conditions respectively.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
“Zephyr TM Performance Systems | Performance Monitoring Technology.” [Online]. Available: https://www.zephyranywhere.com/. [Accessed: 17-Apr-2018].
Refrences
Kranjec, J., Begus, S., Drnovsek, J., Gersak, G.: Novel methods for noncontact heart rate measurement: a feasibility study. IEEE Trans. Instrum. Meas. 63, 838–847 (2014). https://doi.org/10.1109/TIM.2013.2287118
Kim, H.-G., Cheon, E.-J., Bai, D.-S., Lee, Y.H., Koo, B.-H.: Stress and heart rate variability: a meta-analysis and review of the literature. Psychiatry Investig. 15, 235–245 (2018). https://doi.org/10.30773/pi.2017.08.17
Al Osman, H., Dong, H., El Saddik, A.: Ubiquitous biofeedback serious game for stress management. IEEE Access (2016). https://doi.org/10.1109/ACCESS.2016.2548980
Villarroel, M., et al.: Continuous non-contact vital sign monitoring in neonatal intensive care unit. Healthc. Technol. Lett. 1, 87–91 (2014). https://doi.org/10.1049/htl.2014.0077
Poh, M.-Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18, 10762 (2010). https://doi.org/10.1364/OE.18.010762
Poh, M.Z., McDuff, D.J., Picard, R.W.: Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans. Biomed. Eng. (2011). https://doi.org/10.1109/TBME.2010.2086456
van Gastel, M., Stuijk, S., de Haan, G.: Robust respiration detection from remote photoplethysmography. Biomed. Opt. Express 7, 4941 (2016). https://doi.org/10.1364/BOE.7.004941
Comon, P.: Independent component analysis, a new concept?*. Signal Process. 36, 28–314 (1994). Comon/Signal Process.
Ghanadian, H., Ghodratigohar, M., Al Osman, H.: A machine learning method to improve non-contact heart rate monitoring using an RGB camera. IEEE Access (2018). https://doi.org/10.1109/ACCESS.2018.2872756
Sajjacholapunt, P., Ball, L.J.: The influence of banner advertisements on attention and memory: human faces with averted gaze can enhance advertising effectiveness. Front. Psychol. 5, 166 (2014). https://doi.org/10.3389/fpsyg.2014.00166
Stiefelhagen, R.: Tracking focus of attention in meetings. In: 4th IEEE International Conference on Multimodal Interfaces. IEEE Computer Society (2002)
Sun, N., Garbey, M., Merla, A., Pavlidis, I.: Imaging the cardiovascular pulse. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), pp. 416–421. IEEE (2005). https://doi.org/10.1109/CVPR.2005.184
Pereira, C.B., Yu, X., Czaplik, M., Rossaint, R., Blazek, V., Leonhardt, S.: Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 6, 4378–4394 (2015). https://doi.org/10.1364/BOE.6.004378
Takano, C., Ohta, Y.: Heart rate measurement based on a time-lapse image. Med. Eng. Phys. 29, 853–857 (2007). https://doi.org/10.1016/j.medengphy.2006.09.006
McDuff, D., Gontarek, S., Picard, R.W.: Improvements in remote cardiopulmonary measurement using a five band digital camera. IEEE Trans. Biomed. Eng. (2014). https://doi.org/10.1109/TBME.2014.2323695
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, p. I-511–I-518. IEEE Computer Society (2001). https://doi.org/10.1109/CVPR.2001.990517
Mcduff, D.: Fusing partial camera signals for noncontact pulse rate variability measurement. IEEE Trans. Biomed. Eng. 65, 1725–1739 (2018). https://doi.org/10.1109/TBME.2017.2771518
Estepp, J.R., Blackford, E.B., Meier, C.M.: Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography. In: 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1462–1469. IEEE (2014). https://doi.org/10.1109/SMC.2014.6974121
Gupta, O., McDuff, D., Raskar, R.: Real-time physiological measurement and visualization using a synchronized multi-camera system. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). pp. 312–319. IEEE (2016). https://doi.org/10.1109/CVPRW.2016.46
Baltrušaitis, T., Robinson, P., Morency, L.-P.: OpenFace: an open source facial behavior analysis toolkit. In: IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ghanadian, H., Al Osman, H. (2019). Non-contact Heart Rate Monitoring Using Multiple RGB Cameras. In: Vento, M., Percannella, G. (eds) Computer Analysis of Images and Patterns. CAIP 2019. Lecture Notes in Computer Science(), vol 11679. Springer, Cham. https://doi.org/10.1007/978-3-030-29891-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-29891-3_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29890-6
Online ISBN: 978-3-030-29891-3
eBook Packages: Computer ScienceComputer Science (R0)