Skip to main content
Springer Nature Link
Log in

Real-time heart activity monitoring with optical illusion using a smartphone

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this study, we obtained a pulsatile photoplethysmogram (PPG) signal from a fingertip using the built-in camera of an iPhone 6 s and displayed a real-time heart activity images with holographic projection on a smartphone screen. Our proposed heart activity hologram is simple and can be easily realized with only a smartphone and overhead projector (OHP) film. A square pyramid-shaped OHP film was positioned on a smartphone screen. The actual cardiac cycle on the smartphone screen was projected onto the film while measuring the pulsatile signal from a fingertip placed on the smartphone’s camera. The heart’s beat-to-beat time interval was then recorded. This approach enables observation of one’s own virtual heart activity in real time, rather than seeing a pulsatile signal graphically on a smartphone. To investigate the feasibility of this heart activity monitoring based on holographic projection, we tested it under different conditions in terms of environmental light, smartphone screen light intensity, and film color, and quantified the contrast-to-noise ratio for comparison.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Aboy M, McNames J, Thong T, Tsunami D, Ellenby MS, Goldstein B (2005) An automatic beat detection algorithm for pressure signals. IEEE Trans Biomed Eng 52(10):1662–1670

    Article  Google Scholar 

  2. Allen J (2007) Photoplethysmography and its application in clinical physiological measurement. Physiol Meas 28(3):R1

    Article  Google Scholar 

  3. Alqassim S, Ganesh M, Khoja S, Zaidi M, Aloul F, Sagahyroon A (2012) Sleep apnea monitoring using mobile phones. In: e-Health Networking, Applications and Services (Healthcom), 2012 I.E. 14th International Conference on, IEEE, pp 443–446

  4. Banitsas K, Pelegris P, Orbach T, Cavouras D, Sidiropoulos K, Kostopoulos S (2009) A simple algorithm to monitor hr for real time treatment applications. In: 2009 9th International Conference on Information Technology and Applications in Biomedicine, IEEE, pp 1–5

  5. Boulos MNK, Wheeler S, Tavares C, Jones R (2011) How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX. Biomed Eng Online 10(1):1

    Article  Google Scholar 

  6. Bourdillon P (1980) Holography in medicine and biology. J Mod Opt 27(6):731–731

    Google Scholar 

  7. Burgner J, Simpson A, Fitzpatrick J, Lathrop R, Herrell S, Miga M, Webster R (2013) A study on the theoretical and practical accuracy of conoscopic holography-based surface measurements: toward image registration in minimally invasive surgery. Intern J Med Robot Comp Assist Sur 9(2):190–203

    Article  Google Scholar 

  8. Che UK, Lao CK, Pun SH, Mak PU, Wan F, Vai MI (2012) Portable heart rate detector based on photoplethysmography with android programmable devices. In: Telecommunications and Signal Processing (TSP), 2012 35th International Conference on, IEEE, pp 605–609

  9. Gregoski MJ, Mueller M, Vertegel A, Shaporev A, Jackson BB, Frenzel RM, Sprehn SM, Treiber FA (2012) Development and validation of a smartphone heart rate acquisition application for health promotion and wellness telehealth applications. Intern J Telemedd Appl 2012:1. doi:10.1155/2012/696324

    Google Scholar 

  10. Hackett M (2013) Medical holography for basic anatomy training. DTIC Document

    Google Scholar 

  11. Han M, Giese G, Zickler L, Sun H, Bille J (2004) Mini-invasive corneal surgery and imaging with femtosecond lasers. Opt Express 12(18):4275–4281

    Article  Google Scholar 

  12. Jimenez LF, Parnandi A, Gutierrez-Osuna R (2013) Extracting heart rate and respiration rate using a cell phone camera

  13. Karlen W, Ansermino JM, Dumont GA, Scheffer C (2013) Detection of the optimal region of interest for camera oximetry. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, pp 2263–2266

  14. Kyriacou E, Pattichis C, Pattichis M (2009) An overview of recent health care support systems for eEmergency and mHealth applications. In: 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, pp 1246–1249

  15. Lee J, Reyes BA, McManus DD, Mathias O, Chon KH (2012) Atrial fibrillation detection using a smart phone. In: 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, pp 1177–1180

  16. Lee J, Matsumura K, Yamakoshi K-i, Rolfe P, Tanaka S, Yamakoshi T (2013a) Comparison between red, green and blue light reflection photoplethysmography for heart rate monitoring during motion. In: 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), IEEE, pp 1724–1727

  17. Lee J, Reyes BA, McManus DD, Maitas O, Chon KH (2013b) Atrial fibrillation detection using an iPhone 4S. IEEE Trans Biomed Eng 60(1):203–206

    Article  Google Scholar 

  18. Lenskiy AA, Aitzhan Y (2013) Extracting heart rate variability from a smartphone camera. J Inform Comm Converg Eng 11(3):216–222

    Google Scholar 

  19. Li H, Zhao H (2013) Systolic blood pressure estimation using Android smart phones. In: 2013 6th International Conference on Biomedical Engineering and Informatics, IEEE, pp 260–264

  20. Luxton DD, McCann RA, Bush NE, Mishkind MC, Reger GM (2011) mHealth for mental health: integrating smartphone technology in behavioral healthcare. Prof Psychol: Res Prac 42(6):505

    Article  Google Scholar 

  21. Marieb EN, Hoehn K (2007) Human anatomy & physiology. Pearson Education

    Google Scholar 

  22. Matsumura K, Rolfe P, Lee J, Yamakoshi T (2014) iPhone 4s photoplethysmography: which light color yields the most accurate heart rate and normalized pulse volume using the iPhysioMeter application in the presence of motion artifact? PLoS One 9(3):e91205

    Article  Google Scholar 

  23. McManus DD, Lee J, Maitas O, Esa N, Pidikiti R, Carlucci A, Harrington J, Mick E, Chon KH (2013) A novel application for the detection of an irregular pulse using an iPhone 4S in patients with atrial fibrillation. Heart Rhythm 10(3):315–319

    Article  Google Scholar 

  24. Nam Y, Lee J, Chon KH (2014) Respiratory rate estimation from the built-in cameras of smartphones and tablets. Ann Biomed Eng 42(4):885–898

    Article  Google Scholar 

  25. Ozdalga E, Ozdalga A, Ahuja N (2012) The smartphone in medicine: a review of current and potential use among physicians and students. J Med Internet Res 14(5):e128

    Article  Google Scholar 

  26. Pechprasarn T, Pongnumkul S (2013) Estimation of respiratory rate from smartphone's acceleration data. In: Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 2013 10th International Conference on, IEEE, pp 1–5

  27. Pelegris P, Banitsas K, Orbach T, Marias K (2010) A novel method to detect heart beat rate using a mobile phone. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, IEEE, pp 5488–5491

  28. Pepper's ghost could bring videoconferences to life (2009). New Scientist 204 (2735):23. doi:10.1016/S0262–4079(09)63056-6

  29. Santangelo PJ, Sojka PE (1993) Holographic particle diagnostics. Prog Energy Combust Sci 19(6):587–603

    Article  Google Scholar 

  30. Schäfer A, Vagedes J (2013) How accurate is pulse rate variability as an estimate of heart rate variability?: a review on studies comparing photoplethysmographic technology with an electrocardiogram. Int J Cardiol 166(1):15–29

    Article  Google Scholar 

  31. Scully CG, Lee J, Meyer J, Gorbach AM, Granquist-Fraser D, Mendelson Y, Chon KH (2012) Physiological parameter monitoring from optical recordings with a mobile phone. IEEE Trans Biomed Eng 59(2):303–306

    Article  Google Scholar 

  32. Siddiqui SA, Zhang Y, Feng Z, Kos A (2016) A pulse rate estimation algorithm using PPG and smartphone camera. J Med Syst 40(5):1–6

    Article  Google Scholar 

  33. Tamura T, Maeda Y, Sekine M, Yoshida M (2014) Wearable photoplethysmographic sensors—past and present. Electronics 3(2):282–302

    Article  Google Scholar 

  34. Ventola CL (2014) Mobile devices and apps for health care professionals: uses and benefits. Pharm Therap 39(5):356

    Google Scholar 

  35. Vizbara V (2013) Comparison of green, blue and infrared light in wrist and forehead photoplethysmography. Biomed Eng 2015(1):17

    Google Scholar 

  36. Wac K (2013) Smartphone as a personal, pervasive health informatics services platform: literature review. arXiv preprint arXiv:13107965

Download references

Acknowledgements

This study was partially supported by a grant from the Korean Health Technology R&D Project, Ministry of Health and Welfare, Republic of Korea (HI12C0110), and partially supported by a Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning: NRF-2013R1A1A1005775 and NRF-2015M3A9D7067215.

Author information

Authors and Affiliations

  1. Biomedical Engineering, Wonkwang University School of Medicine, Iksan, South Korea

    Tharoeun Thap, Heewon Chung & Jinseok Lee

  2. Imaging Science based Lung and Bone Disease Research Center, Wonkwang University, Iksan, South Korea

    Changwon Jeong & Jonghyun Ryu

  3. Computer Science and Engineering, Soonchunhyang University, Asan, South Korea

    Yunyoung Nam

  4. Radiology, Wonkwang University School of Medicine, Iksan, South Korea

    Kwon-Ha Yoon

Authors
  1. Tharoeun Thap
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Heewon Chung
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Changwon Jeong
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jonghyun Ryu
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Yunyoung Nam
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Kwon-Ha Yoon
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Jinseok Lee
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Jinseok Lee.

Electronic supplementary material

Video 1

Heart activity images on a smartphone screen with artificial simple heart image sequence (video file is uploaded on Figshare website: https://dx.doi.org/10.6084/m9.figshare.3490253) (MP4 14,528 kb)

Video 2

Heart activity images on a smartphone screen with heart’s depolarization and repolarization sequence (video file is uploaded on Figshare website: https://dx.doi.org/10.6084/m9.figshare.3490253) (MP4 15,647 kb)

Video 3

Heart activity images on a smartphone screen with 3D reconstructed heart image sequence (video file is uploaded on Figshare website: https://dx.doi.org/10.6084/m9.figshare.3490253) (MP4 19,102 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thap, T., Chung, H., Jeong, C. et al. Real-time heart activity monitoring with optical illusion using a smartphone. Multimed Tools Appl 77, 6209–6224 (2018). https://doi.org/10.1007/s11042-017-4530-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4530-3

Keywords