Abstract
The detection of vital parameters is one of the first and foremost task to be performed on a patient to evaluate her/his health status. Among the vital signs, a great importance is assumed by the heart rate, which is defined as the number of heartbeats measured in a minute. Heart rate is generally measured using an electrocardiograph, which allows an accurate recording of the cardiac activity, but requires the placement of some electrodes in specific points of the body. Such an approach involves a direct contact between the device and the patient’s skin, which is often uncomfortable and impractical. In this paper we propose a contactless approach based on RGB video for heart rate extraction, avoiding any type of direct interaction. For this purpose, we exploit videos of the subjects’ faces recorded via smartphone and we then apply the EVM method to estimate the heart rate obtained in a comfortable and non-invasive way. The results obtained with two different methodologies, based on Fast Fourier Transform (FFT) and on the MUltiple SIgnal Classification (MUSIC) algorithm, have been compared to three devices with clinical validity, i.e., a pulse oximeter, a Polar heart rate strap and a blood pressure monitor, which guarantee accuracy at a reduced cost and are easily commercially available. The high accuracy of the developed system is proved by the small difference achieved between the values measured with the developed contactless technique and those obtained with the wearable devices, which results in an error between 1.07\(\%\) and 4.67\(\%\), regardless of the ambient light conditions under which the videos were captured.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu, H.-Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31, 65:1-65:8 (2012)
Fletcher, R.R., Chamberlain, D., Paggi, N., Deng, X.: Implementation of smart phone video plethysmography and dependence on lighting parameters. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3747–3750 (2015)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
Gambi, E., et al.: Heart rate detection using microsoft kinect: validation and comparison to wearable devices. Sensors 17(8), 1776 (2017)
Secerbegovic, A., Bergsland, J., Halvorsen, P.S., Suljanovic, N., Mujcic, A., Balasingham, I.: Blood pressure estimation using video plethysmography. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), pp. 461–464, April 2016
Poh, M.Z., McDuff, D.J., Picard, R.W.: Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans. Biomed. Eng. 58, 7–11 (2011)
Alghoul, K., Alharthi, S., Osman, H.A., Saddik, A.E.: Heart rate variability extraction from videos signals: ICA vs. EVM comparison. IEEE Access 5, 4711–4719 (2017)
Bennett, S.L., Goubran, R., Knoefel, F.: Adaptive eulerian video magnification methods to extract heart rate from thermal video. In: 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp. 1–5. IEEE (2016)
Miljković, N., Trifunović, D.: Pulse rate assessment: eulerian video magnification vs. electrocardiography recordings. In: 12th Symposium on Neural Network Applications in Electrical Engineering (NEUREL), pp. 17–20. IEEE (2014)
Shahadi, H.I., Al-allaq, Z.J., Albattat, H.J.: Efficient denoising approach based eulerian video magnification for colour and motion variations. Int. J. Electr. Comput. Eng. (2088–8708) 10 (2020)
Wu, X., Yang, X., Jin, J., Yang, Z.: PCA-based magnification method for revealing small signals in video. SIViP 12(7), 1293–1299 (2018)
Madhav, K.V., Ram, M.R., Krishna, E.H., Reddy, K.N., Reddy, K.A.: Estimation of respiratory rate from principal components of photoplethysmographic signals. In: 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), pp. 311–314 (2010)
Ciattaglia, G., Senigagliesi, L., De Santis, A., Ricciuti, M.: Contactless measurement of physiological parameters. In: 2019 IEEE 9th International Conference on Consumer Electronics (ICCE-Berlin), pp. 22–26 (2019)
Ricciuti, M., Ciattaglia, G., De Santis, A., Gambi, E., Senigagliesi, L.: Contactless heart rate measurements using RGB-camera and radar. In: ICT4AWE, pp. 121–129 (2020)
Chen, Q., Jiang, X., Liu, X., Lu, C., Wang, L., Chen, W.: Non-contact heart rate monitoring in neonatal intensive care unit using RGB camera. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5822–5825. IEEE (2020)
Hui, M.L., Nisar, H., Ho, Y.K., Chiong, T.P.: A video based heart rate monitoring system for drivers using photoplethysmography signal. In: 2018 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), pp. 1–6. IEEE (2018)
Dosso, Y.S., Bekele, A., Green, J.R.: Eulerian magnification of multi-modal RGB-D video for heart rate estimation. In: 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp. 1–6. IEEE (2018)
Aubakir, B., Nurimbetov, B., Tursynbek, I., Varol, H.A.: Vital sign monitoring utilizing eulerian video magnification and thermography. In: 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3527–3530. IEEE (2016)
Li, T., Tang, Y.: Frequency estimation based on modulation FFT and music algorithm. In: 2010 First International Conference on Pervasive Computing, Signal Processing and Applications, pp. 525–528. IEEE (2010)
Wei, Z., Xiaolong, L., Jin, Z., Xueyun, W., Hongxing, L.: Foetal heart rate estimation by empirical mode decomposition and music spectrum. Biomed. Signal Process. Control 42, 287–296 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ricciuti, M., Senigagliesi, L., Gambi, E. (2022). Heart Rate Estimation Using the EVM Method, the FFT and MUSIC Algorithms Under Different Conditions. In: Bettelli, A., Monteriù, A., Gamberini, L. (eds) Ambient Assisted Living. ForItAAL 2020. Lecture Notes in Electrical Engineering, vol 884. Springer, Cham. https://doi.org/10.1007/978-3-031-08838-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-031-08838-4_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08837-7
Online ISBN: 978-3-031-08838-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)