ABSTRACT
The extraction of human physiological based on face video has become a hot research direction, but few researchers pay attention to the process of signal extraction from an optical perspective. This paper establishes an optical model for human skin, and analyzes the principle of extracting human physiological signals from face video by imaging. Based on this model, the effects of melanin and hemoglobin on BVP (blood volume pulse) signal extraction were analyzed. In addition, this paper introduces the model of camera imaging, and discusses the cause of noise generation, analysis of the impact of two kinds of noise on video quality. Finally, this paper uses the MAHNOB database to carry out the heart rate extraction experiment from video, the experiment concluded that: (1) The face with lighter skin color is more conducive to human heart rate extraction; (2) Reducing the signal-noise ratio through compressing the video quality, the impact on the heart rate estimation error reaches minimum as the signal-noise ratio is 30dB; (3) By compressing the original video resolution, color information in the video is reduced, which has a impact on BVP signals extraction, the information recovery can be performed by the method of super-resolution reconstruction.
- Frédéric Bousefsaf, Choubeila Maaoui, and Alain Pruski, 2013. Continuous wavelet filtering on webcam photoplethysmographic signals to remotely assess the instantaneous heart rate. Biomedical Signal Processing & Control 8, 6, 568--574.Google ScholarCross Ref
- L Tarassenko, M Villarroel, A Guazzi, J Jorge, D A Clifton, D.A., and C Pugh, 2014. Non-contact video-based vital sign monitoring using ambient light and auto-regressive models. Physiological Measurement 35, 5, 807--831.Google ScholarCross Ref
- Enock Jonathan and Martin J. Leahy, 2011. Cellular phone-based photoplethysmographic imaging. Journal of Biophotonics 4, 5, 293--296.Google ScholarCross Ref
- Lei Li, Zhaoqiang Xia, Abdenour Hadid, Xiaoyue Jiang, Haixi Zhang, and Xiaoyi Feng, 2019. Replayed Video Attack Detection Based on Motion Blur Analysis. IEEE Transactions on Information Forensics and Security.Google ScholarCross Ref
- Weijia C, Lee E. Ostrander, Bok Y, 1990. In vivo reflectance of blood and tissue as a function of light wavelength. Biomedical Engineering IEEE Transactions on biomedical engineering, 37, 6, 632--639.Google Scholar
- Wim Verkruysse, Lars O Svaasand, and J Stuart Nelson, 2008. Remote plethysmographic imaging using ambient light. Optics Express 16, 26, 21434--21445.Google ScholarCross Ref
- Ming-Zher Poh, Daniel J. McDuff, and Rosalind W. Picard, 2010. Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Transactions on Biomedical Engineering, 58, 1, 7--11.Google ScholarCross Ref
- Sungjun Kwon, Hyunseok Kim, and Kwang Suk Park, 2012. Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone. Annual International Conference of the IEEE Engineering in Medicine and Biology Society.Google ScholarCross Ref
- Wen Jun Jiang, Shi Chao Gao, Peter Wittek, and Li Zhao, 2015. Real-time quantifying heart beat rate from facial video recording on a smart phone using Kalman filters. In IEEE International Conference on E-health Networking.Google Scholar
- Tom Lister, Philip A. Wright, and Paul H. Chappell, 2012. Optical properties of human skin. Journal of Biomedical Optics 17, 9, 90901--90901.Google ScholarCross Ref
- I. Botev, 1979. A new conception of Bouguer-Lambert-Beer's law. Fresenius Zeitschrift Für Analytische Chemie 297, 5, 419--419.Google ScholarCross Ref
- L.O. Svaasand, L.T. Norvang, E.J. Fiskerstrand, E.K.S. Stopps, M.W. Berns, and J.S. Nelson, 1995. Tissue parameters determining the visual appearance of normal skin and port-wine stains. Lasers in Medical Science 10, 1, 55--65.Google ScholarCross Ref
- Xiaobai Li, Jie Chen, Guoying Zhao, Matti Pietikainen, 2014. Remote Heart Rate Measurement from Face Videos under Realistic Situations. IEEE Computer Vision & Pattern Recognition. Google ScholarDigital Library
- SHI, J., LIU, X., ZONG, Y., QI, C., and ZHAO, G., 2018. Hallucinating Face Image by Regularization Models in High-Resolution Feature Space. IEEE Transactions on Image Processing PP, 99, 1--1.Google Scholar
Index Terms
- Analysis of Factors on BVP Signal Extraction Based on Imaging Principle
Recommendations
BVP Feature Signal Analysis for Intelligent User Interface
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing SystemsThe Blood Volume Pulse (BVP) sensor has been becoming increasingly common in devices such as smart phones and smart watches. These devices often use BVP to monitor the heart rate of an individual. There has been a large amount of research linking the ...
Imaging Photoplethysmography: Signal Waveform Analysis
2019 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS)Imaging photoplethysmography (iPPG) is used to remotely measure the blood volume pulse using a camera. Traditionally, it has been employed to estimate heart and respiratory rates, and recently blood pressure and oxygen saturation. Biomedical engineering ...
Skin Color Segmentation Based on Improved 2D Otsu and YCgCr
ICECE '10: Proceedings of the 2010 International Conference on Electrical and Control EngineeringA new algorithm for skin color segmentation is proposed in this paper. Firstly, the skin color sample images are light-compensated and transferred from RGB to YCgCr color space. Secondly, the Gaussian skin color model is established from 179221 skin ...
Comments