Abstract
Respiratory rate is a key vital sign that needs daily monitoring for hospital patients in general and those with respiratory conditions in particular. Moreover, it is a predictor of major heart conditions. Yet, studies have shown that it is widely neglected in hospital care due partially to the discomfort caused by the required equipment. In this paper, we propose a smartphone-based method for accurate measurement of the respiratory rate using the video of the skin surface as recorded by the smartphone built-in camera in the presence of the flash light. From this input, we use frame averaging to extract a photoplethysmographic signal of the red, green, and blue channels. Next, we apply discrete wavelet transform on the best representative photoplethysmographic signal for respiratory signal extraction and estimate the rate. Fifteen subjects participated in the testing and evaluation. The maximum absolute error was 0.67 breaths/min, whereas the root mean square error was 0.366 breaths/min. The average percentage error and average percentage accuracy using our approach were 2.2%, 97.8% respectively. A comparison with other works in the literature reveal a superior performance in terms of accuracy, ease of use, and cost.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alafeef M (2017) Smartphone-based photoplethysmographic imaging for heart rate monitoring. J Med Eng Technol 41(5):1–9. https://doi.org/10.1080/03091902.2017.1299233
Almond NE, Jones DP, Cooke ED (1988) Noninvasive measurement of the human peripheral circulation: relationship between laser doppler flowmeter and photoplethysmograph signals from the finger. Angiology 39(9):819–29
Bailon R, Sornmo L, Laguna P (2006) A robust method for ecg-based estimation of the respiratory frequency during stress testing. IEEE Trans Biomed Eng 53(7):1273–85. https://doi.org/10.1109/tbme.2006.871888
Barrett KE, Barman SM, Scott Boitano HLB (2019) Ganong’s review of medical physiology, 26th edn. McGraw-Hill, New York
Bland JM, Altman D (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 327(8476):307–310. https://doi.org/10.1016/S0140-6736(86)90837-8, http://www.sciencedirect.com/science/article/pii/S0140673686908378, originally published as Volume 1, Issue 8476
Charlton PH, Birrenkott DA, Bonnici T, Pimentel MAF, Johnson AEW, Alastruey J, Tarassenko L, Watkinson PJ, Beale R, Clifton DA (2018) Breathing rate estimation from the electrocardiogram and photoplethysmogram: a review. IEEE Rev Biomed Eng 11:2–20. https://doi.org/10.1109/RBME.2017.2763681
Chen T, Chiu MC (2018) Smart technologies for assisting the life quality of persons in a mobile environment: a review. J Ambient Intell Humaniz Comput 9(2):319–327. https://doi.org/10.1007/s12652-016-0396-x
Cretikos MA, Bellomo R, Hillman K, Chen J, Finfer S, Flabouris A (2008) Respiratory rate: the neglected vital sign. Med J Aust 188(11):657–9
Daubechies I (1990) The wavelet transform, time-frequency localization and signal analysis. IEEE Trans Inf Theory 36(5):961–1005. https://doi.org/10.1109/18.57199
Giurgiutiu V (2014) Chapter 14-signal processing and pattern recognition for structural health monitoring with pwas transducers. In: Giurgiutiu V (ed) Structural Health Monitoring with Piezoelectric Wafer Active Sensors (2nd Edn), second edition edn, Academic Press, Oxford, pp 807 – 862, https://doi.org/10.1016/B978-0-12-418691-0.00014-9, http://www.sciencedirect.com/science/article/pii/B9780124186910000149
Gravelyn TR, Weg JG (1980) Respiratory rate as an indicator of acute respiratory dysfunction. JAMA 244(10):1123–5
Hassan M, Malik A, Fofi D, Saad N, Karasfi B, Ali Y, Meriaudeau F (2017) Heart rate estimation using facial video: a review. Biomed Signal Process Control 38:346–360. https://doi.org/10.1016/j.bspc.2017.07.004, http://www.sciencedirect.com/science/article/pii/S1746809417301362
iWorkx (2018a) The iworx 214 and labscribe v2.0 tutorial. http://www.iworx.com/wp-content/uploads/2013/02/Tutorial-LS2.pdf. Accessed 26 May 2018
iWorkx (2018b) Labscribe. https://www.iworx.com/research/software/labscribe/. Accessed 26 May 2018
Jamil U, Sajid A, Hussain M, Aldabbas O, Alam A, Shafiq MU (2019) Melanoma segmentation using bio-medical image analysis for smarter mobile healthcare. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-019-01218-0
Kao Y, Chao PC, Wey C (2019) Design and validation of a new ppg module to acquire high-quality physiological signals for high-accuracy biomedical sensing. IEEE J Sel Top Quantum Electron 25(1):1–10. https://doi.org/10.1109/JSTQE.2018.2871604
Karlen W, Garde A, Myers D, Scheffer C, Ansermino JM, Dumont GA (2015) Estimation of respiratory rate from photoplethysmographic imaging videos compared to pulse oximetry. IEEE J Biomed Health Inform 19(4):1331–8. https://doi.org/10.1109/jbhi.2015.2429746
Leonard PA, Clifton D, Addison PS, Watson JN, Beattie T (2006) An automated algorithm for determining respiratory rate by photoplethysmogram in children. Acta Paediatr 95(9):1124–8. https://doi.org/10.1080/08035250600612280
Li X (2016) Using mobile phone sensors to detect rapid respiratory rate in the diagnosis of pneumonia. Int J Eng Technol 8(4):293–296. https://doi.org/10.7763/ijet.2016.v8.900
Lin YD, Ho HY, Tsai CC, Wang SF, Lin KP, Chang HH (2013) Simultaneous heartbeat and respiration monitoring using ppg and riiv on a smartphone device. Biomed Eng Appl Basis Commun 25: https://doi.org/10.4015/S1016237213500415, https://www.worldscientific.com/doi/abs/10.4015/S1016237213500415
Lin YD, Chien YH, Chen YS (2017) Wavelet-based embedded algorithm for respiratory rate estimation from ppg signal. Biomed Signal Process Control 36:138–145. https://doi.org/10.1016/j.bspc.2017.03.009, http://www.sciencedirect.com/science/article/pii/S1746809417300599
Malasinghe LP, Ramzan N, Dahal K (2019) Remote patient monitoring: a comprehensive study. J Ambient Intell Humaniz Comput 10(1):57–76. https://doi.org/10.1007/s12652-017-0598-x
MathWorks (2018) Matlab. https://www.mathworks.com/products/matlab.html. Accessed 26 May 2018
Meredith DJ, Clifton D, Charlton P, Brooks J, Pugh CW, Tarassenko L (2012) Photoplethysmographic derivation of respiratory rate: a review of relevant physiology. J Med Eng Technol 36(1):1–7. https://doi.org/10.3109/03091902.2011.638965, http://www.ncbi.nlm.nih.gov/pubmed/22185462
Mitali R, Prabhu S (2015) A novel algorithm to obtain respiratory rate from the ppg signal. Int J Comput Appl 126(15):9–12. https://doi.org/10.5120/ijca2015906263
Moraes JL, Rocha MX, Vasconcelos GG, Vasconcelos Filho JE, De Albuquerque VHC, Alexandria AR (2018) Advances in photopletysmography signal analysis for biomedical applications. Sensors 18(6), https://doi.org/10.3390/s18061894, http://www.mdpi.com/1424-8220/18/6/1894
Murthy VS, Ramamoorthy S, Srinivasan N, Rajagopal S, Rao MM (2001) Analysis of photoplethysmographic signals of cardiovascular patients. In: Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol 3, pp 2204–2207, https://doi.org/10.1109/IEMBS.2001.1017209
Nie R, He M, Cao J, Zhou D, Liang Z (2018) Pulse coupled neural network based mri image enhancement using classical visual receptive field for smarter mobile healthcare. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-018-1098-3
Pirhonen M, Peltokangas M, Vehkaoja A (2018) Acquiring respiration rate from photoplethysmographic signal by recursive bayesian tracking of intrinsic modes in time-frequency spectra. Sensors (Basel) 18(6):1693. https://doi.org/10.3390/s18061693
Ps KB, Jatti A (2015) Respiration and heart rate monitoring from photoplethysmograph signal. Adv Sig Process 3(1):8–16. https://doi.org/10.13189/asp.2015.030102
Sanyal S, Nundy KK (2018) Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face. IEEE J Transl Eng Health Med 6:1–11. https://doi.org/10.1109/JTEHM.2018.2818687
Schroeder CA, Smith LJ (2011) Respiratory rates and arterial blood-gas tensions in healthy rabbits given buprenorphine, butorphanol, midazolam, or their combinations. Journal of the American Association for Laboratory Animal Science : JAALAS 50(2):205–211, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3061421/
Singh M (2014) Introduction to Biomedical Instrumentation, 2nd edn. PHI Learning
Soltani S (2002) On the use of the wavelet decomposition for time series prediction. Neurocomputing 48(1):267–277. https://doi.org/10.1016/S0925-2312(01)00648-8, http://www.sciencedirect.com/science/article/pii/S0925231201006488
Tabei F, Kumar R, Phan TN, McManus DD, Chong JW (2018) A novel personalized motion and noise artifact (mna) detection method for smartphone photoplethysmograph (ppg) signals. IEEE Access 6:60498–60512. https://doi.org/10.1109/ACCESS.2018.2875873
Tambe SB, Gajre SS (2018) Cluster-based real-time analysis of mobile healthcare application for prediction of physiological data. J Ambient Intell Humaniz Comput 9(2):429–445. https://doi.org/10.1007/s12652-017-0562-9
Ubeyli ED, Guler I (2005) Feature extraction from doppler ultrasound signals for automated diagnostic systems. Comput Biol Med 35(9):735–64. https://doi.org/10.1016/j.compbiomed.2004.06.006
Unser M, Aldroubi A (1996) A review of wavelets in biomedical applications. Proc IEEE 84(4):626–638. https://doi.org/10.1109/5.488704
Webster JG (1997) Design of pulse oximeters, 1st edn. Institute of Physics Publishing, http://www.crcnetbase.com/isbn/9780750304672
Funding
This research was supported by Jordan University of Science and Technology, Deanship of Research award number 20180356.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alafeef, M., Fraiwan, M. Smartphone-based respiratory rate estimation using photoplethysmographic imaging and discrete wavelet transform. J Ambient Intell Human Comput 11, 693–703 (2020). https://doi.org/10.1007/s12652-019-01339-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-019-01339-6