Abstract
Heartrate monitoring can be very decisive in terms of detecting heart-related diseases in early stages. Given that smartphones are used almost ubiquitously by humans on a daily basis and that they are equipped with several sensors and a powerful CPU, they are the ideal tools to accomplish daily heartrate monitoring. Many studies have shown the possibility of monitoring the heartrate in a very accurate way by using smartphone camera and the photo-plethysmography technique. However, in real cases, when using a smartphone camera as the input sensor, the pulse signal usually contains noise caused by fingertip movements, pressure changes between the smartphone camera and the fingertip, or changes in ambient light intensity. Hence, many techniques have been proposed to filter and detect real peaks in the pulse signal and avoid noise peaks. Most of those state-of-the-art techniques rely on the assumption that real peaks are those having the maximum values in their respective cycles. In some cases, the assumption is not correct, which decreases the accuracy of peak detection. Hence, this paper proposes a novel method to detect a pulse signal’s real peaks. The proposed method first smoothens a pulse signal by using a second-order Butterworth band-pass filter over a wide frequency range. Then, it considers the local minima of the signal as peaks and builds an optimization tree based on statistical properties, such as uniformity of peak time locations, peak count within a period, and variance in times elapsed between adjacent peaks, to detect combinations of peaks that optimize the heartrate computation. Results from experiments conducted using synthetic and real signals show that the proposed method can detect a pulse signal’s real peaks with higher precision as compared to conventional methods, and is very robust to signal noises. The proposed method has a significant heartrate estimation accuracy in various real scenarios and across smartphone models; its error rate is as low as 0.8588±0.0653 beats per minute, even in cases of signals with extensive noise.
Similar content being viewed by others
References
Baek H, Chung G, Kim K, Park KA (2012) Smart health monitoring chair for nonintrusive measurement of biological signals. IEEE Trans Inf Technol Biomed 16(1):150–158
Balakrishnan G, Durand F, Guttag J (2013) Detecting pulse from head motions in video. Proceedings of IEEE Conference on Computer Vision Pattern Recognition, Portland, OR, US, 25–27 June; pp. 3430–3437
Banitsas K, Pelegris P, Orbach T, Cavouras D, Sidiropoulos K, Kostopoulos S (2009) A simple algorithm to monitor HR real time treatment applications. Proceedings of 9th International Conference on Information Technology and Applications in Biomedicine, Larnaca, Cyprus, 5–7 November; pp. 1–5
Grimaldi D, Kurylyak Y, Lamonaca F, Nastro A (2011) Photo-plethysmography detection by smartphone’s video camera. Proceedings of the 6th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems, Prague, Czech Republic, 15–17 September; pp. 488–491
Guede-Fernandez F, Ferrer-Mileo V, Ramos-Castro J, Fernandez-Chimeno M, Garcia-Gonzalez A (2015) Real time heart rate variability assessment from Android smartphone camera photoplethysmography: postural and device influences. Proceedings of 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Milan, Italy, 25–29 August; pp. 7332–7335
Home health monitoring may significantly improve blood pressure control. Available online: http://xnet.kp.org/newscenter/pressreleases/co/2010/052110telehealthstudy.html Accessed 7 Aug 2017
Instant heart rate, https://play.google.com/store/apps/details?id=si.modula.android.instantheartrate. Accessed 7 Aug 2017
Jonathan E, Leahy M (2010) Investigating a smartphone imaging unit for photoplethysmography. Physiol Meas 31:N79–N83
Lagido RB, Lobo J, Leite S, Sousa C, Ferreira L, Silva-Cardoso J (2014) Using the smartphone camera to monitor heart rate and rhythm in heart failure patients. Proceedings of 2014 IEEE-EMBS international conference on biomedical and health informatics, hotel las Areanas Balneario resort, Spain, 1–4 June; pp. 556–559
Lanata A, Scilingo EP, De Rossi DA (2010) Multimodal transducer for cardiopulmonary activity monitoring in emergency. IEEE Trans Inf Technol Biomed 14(3):817–825
Laure D, Paramonov I (2013) Improved algorithm for heart rate measurement using mobile phone camera. Proceedings of the 13th conference of open innovations association Fruct, Petrozavodsk, Russia, 22–26 April; pp. 85–93
Leonard P, Grubb N, Addison P, Clifton D, Watson J (2004) An algorithm for the detection of individual breaths from the pulse oximeter waveform. J Clin Monit Comput 18:309–312
Lomaliza J-P, Park H (2016) A highly efficient and reliable heart rate monitoring system using smartphone cameras. Multime Tools Appl 17(20):21051–21071
Maeda Y, Sekine M, Tamura T (2009) The advantages of wearable green reflected photoplethysmography. J Med Syst 35:829–834
Michachelles F, Wicki R, Schiele B (2004) Less contact: heart-rate detection without even touching the user. Proceedings of Eighth International Symposium on Wearable Computers, Arlington, VA, US, 31, pp. 4–7
Muaremi A, Armich B, Troster G (2013) Towards measuring stress with smartphones and wearable devices during workday and sleep. BioNanoScience 3(2):172–183
Pelegris P, Banitsas K, Orbach T, Marias K (2010) A novel method to detect heart beat rate using a mobile phone. Proceedings of 32nd Annual International Conference of the IEEE Engineering in Medicine Biology Society, Buenos Aires, Argentina, 1–4 September; pp. 5488–5491
Po L-M, Xu X, Feng L, Li Y, Cheung K-W, Cheung C-H (2015) Frame adaptive ROI for photoplethysmography signal extraction from fingertip video captured by smartphone. Proceedings of IEEE International Symposium on Circuits and Systems, Lisbon, Portugal, 24–27 May; pp. 1634–1637
Poh M-Z, McDuff DJ, Picard RW (2010) Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt Express 18(10):10762–10774
Poh M-Z, McDuff DJ, Picard RW (2011) A medical mirror for non-contact health monitoring. Proceedings of ACM SIGGRAPH 2011 Emerging Technologies., Vancouver, BC, Canada, 7–11 August, pp. 1–1
Runtastic heart rate, https://play.google.com/store/apps/details?id=com.runtastic.android.heartrate.lite. Accessed 7 Aug 2017
Scully CG, Lee JS, Meyer J, Gorbach AM, GranquistFraser D, Mendelson Y, Chon KH (2012) Physiological parameter monitoring from optical recordings with a mobile phone. IEEE Trans Biomed Eng 59:303–306
Valdez AC, Ziefle M, Verbert K, Felfernig A, Holzinger A (2016) Recommender Systems for Health Informatics: state-of-the-art and future perspectives, in machine learning for health informatics, lecture notes in artificial intelligence LNAI 9605. Springer, Heidelberg, pp 391–414
Walter M, Eilebrecht B, Wartzek T, Leonhardt S (2011) The smart car seat: personalized monitoring of vital signs in automotive applications. Pers Ubiquit Comput 15(7):707–715
Wu K-F, Chan C-H, Zhang Y-T (2006) Contactless and cuffless monitoring of blood pressure on a chair using e-textile materials. Proceedings of 3rd IEEE/EMBS International Summer School on Medical Devices and Biosensors, Cambridge, MA, US, 4–6 September; pp. 98–100
Zheng Y-L, Ding X-R, Poon CCY, Lo BPL, Zhang H, Zhou X-L, Yang G-Z, Zhao N, Zhang Y-T (2014) Unobtrusive sensing and wearable devices for health informatics. IEEE Trans Biomed Eng 61(5):1538–1554
Acknowledgements
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2014R1A1A2059579).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lomaliza, JP., Park, H. Improved peak detection technique for robust PPG-based heartrate monitoring system on smartphones. Multimed Tools Appl 77, 17131–17155 (2018). https://doi.org/10.1007/s11042-017-5282-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5282-9