Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter (O) October 28, 2020

Model-based sensor fusion of multimodal cardiorespiratory signals using an unscented Kalman filter

Modellbasierte Sensorfusion von multimodalen kardiorespiratorischen Signalen mittels eines unscented Kalman-Filters
  • Onno Linschmann

    Onno Linschmann was born in Herzberg am Harz, Germany, in 1995. In 2016 he received the B. Sc. degree in electrical engineering with a major in Information and Communications Engineering and in 2019 the M. Sc. degree in electrical engineering with a major in System Engineering and Automation at RWTH Aachen University, Aachen. He is currently a Ph. D. candidate at the Medical Information Technology, Helmholtz-Institute for Biomedical Engineering, RWTH Aachen University, Aachen, Germany. His research interests include the field of sensor fusion, nonlinear estimation and scenario detection for medical applications.

    EMAIL logo
    , Steffen Leonhardt

    Steffen Leonhardt (SM’06) was born in Frankfurt, Germany, in 1961. He received the M. S. degree in computer engineering from the State University of New York at Buffalo, Buffalo, NY, USA, the Dr.-Ing. degree (Ph. D.) in electrical engineering from the Technical University of Darmstadt, Darmstadt, Germany, and the M. D. degree in medicine from J. W. Goethe University, Frankfurt, Germany. He has almost five years of R&D management experience working for Dräger Medical AG & Company, KGaA., Lübeck, Germany, and was appointed Full Professor and Head of the Philips endowed Chair of Medical Information Technology at RWTH Aachen University, Aachen, Germany, in 2003. Among others, Dr. Leonhardt serves as an associate Editor of the IEEE Journal of Biomedical and Health Informatics and IEEE Transactions on Biomedical Circuits and Systems. In 2014, he became a fellow of the NRW Academy of Sciences, Humanities and the Arts in Düsseldorf, Germany. In 2015, he was appointed a distinguished lecturer by the IEEE EMBS. He holds a honorary degree from CTU Prague (Dr. h. c., 2018) and has been appointed distinguished professor at IIT Madras, India, in 2018.

    and Christoph Hoog Antink

    Christoph Hoog Antink (M’14) was born in Lohne (Oldenburg), Germany in 1985. He obtained a M. S. degree in mechanical engineering from the University at Buffalo, Buffalo, New York in 2011. He also holds a Dipl.-Ing. (2012) and a Dr.-Ing. (Ph. D., 2018) degree in electrical engineering from the RWTH Aachen University, Aachen, Germany. He is currently heading the Medical Signal Processing Group at RWTH Aachen University’s Medical Information Technology. His research interests include unobtrusive sensing of vitals signs, sensor fusion, and machine learning in medicine.

Abstract

Based on a model of three coupled oscillators describing the influence of respiration, namely respiratory sinus arrhythmia (RSA), and so-called Mayer waves on the heart rate, an unscented Kalman filter (UKF) is designed to perform sensor fusion of multimodal cardiorespiratory sensor signals. The aim is to implicitly use redundancy between the sensor signals to improve the estimated heart rate while utilising model knowledge. The effectiveness of the approach is shown by estimations of the heart rate on synthesised data as well as patient data from the Fantasia dataset and a Sleep laboratory which provide two, three or six sensor channels for resting individuals. It could be shown that the approach is able to fuse multimodal sensor signals on signal level to achieve more accurate estimations. For real data, errors in mean heart rate as small as 1.56 % were achieved.

Zusammenfassung

Basierend auf einem Modell, das den Einfluss von Atmung, d. h. respiratorische Sinusarrhythmie, und den sogenannten Mayer-Wellen auf die Herzfrequenz beschreibt, wird ein Unscented Kalman-Filter (UKF) zur Fusion von multimodalen kardiorespiratorischen Sensorsignalen entworfen. Das Ziel ist es, implizit Redundanz zwischen den Sensorsignalen auszunutzen, um die Schätzung der Herzfrequenz durch das Ausnutzen von Modellwissen zu verbessern. Die Effektivität dieses Ansatzes wird anhand der Schätzung der Herzfrequenz aus synthetisierten und echten Daten aus dem Fantasiadatensatz und einem Schlaflabor mit zwei, drei bzw. sechs Sensorenkanälen gezeigt. Es konnte gezeigt werden, dass der Ansatz tatsächlich dafür genutzt werden kann, multimodale Sensorsignale auf der Signalebene zu fusionieren und dadurch genauere Schätzungen zu erzielen. Für Echtdaten konnten Fehler bezüglich der mittleren Herzfrequenz von nur 1.56 % erreicht werden

Award Identifier / Grant number: LE 817/26-1

Funding statement: The authors gratefully acknowledge the financial support provided by the German Research Foundation [Deutsche Forschungsgemeinschaft (DFG), LE 817/26-1].

About the authors

Onno Linschmann

Onno Linschmann was born in Herzberg am Harz, Germany, in 1995. In 2016 he received the B. Sc. degree in electrical engineering with a major in Information and Communications Engineering and in 2019 the M. Sc. degree in electrical engineering with a major in System Engineering and Automation at RWTH Aachen University, Aachen. He is currently a Ph. D. candidate at the Medical Information Technology, Helmholtz-Institute for Biomedical Engineering, RWTH Aachen University, Aachen, Germany. His research interests include the field of sensor fusion, nonlinear estimation and scenario detection for medical applications.

Steffen Leonhardt

Steffen Leonhardt (SM’06) was born in Frankfurt, Germany, in 1961. He received the M. S. degree in computer engineering from the State University of New York at Buffalo, Buffalo, NY, USA, the Dr.-Ing. degree (Ph. D.) in electrical engineering from the Technical University of Darmstadt, Darmstadt, Germany, and the M. D. degree in medicine from J. W. Goethe University, Frankfurt, Germany. He has almost five years of R&D management experience working for Dräger Medical AG & Company, KGaA., Lübeck, Germany, and was appointed Full Professor and Head of the Philips endowed Chair of Medical Information Technology at RWTH Aachen University, Aachen, Germany, in 2003. Among others, Dr. Leonhardt serves as an associate Editor of the IEEE Journal of Biomedical and Health Informatics and IEEE Transactions on Biomedical Circuits and Systems. In 2014, he became a fellow of the NRW Academy of Sciences, Humanities and the Arts in Düsseldorf, Germany. In 2015, he was appointed a distinguished lecturer by the IEEE EMBS. He holds a honorary degree from CTU Prague (Dr. h. c., 2018) and has been appointed distinguished professor at IIT Madras, India, in 2018.

Christoph Hoog Antink

Christoph Hoog Antink (M’14) was born in Lohne (Oldenburg), Germany in 1985. He obtained a M. S. degree in mechanical engineering from the University at Buffalo, Buffalo, New York in 2011. He also holds a Dipl.-Ing. (2012) and a Dr.-Ing. (Ph. D., 2018) degree in electrical engineering from the RWTH Aachen University, Aachen, Germany. He is currently heading the Medical Signal Processing Group at RWTH Aachen University’s Medical Information Technology. His research interests include unobtrusive sensing of vitals signs, sensor fusion, and machine learning in medicine.

Acknowledgment

The authors thank Tarun Singh for helping with the CUT implementation.

References

1. N. Adurthi, P. Singla and T. Singh. Conjugate unscented transformation: applications to estimation and control. Journal of Dynamic Systems, Measurement, and Control, 140(3), Nov. 2017.10.1115/1.4037783Search in Google Scholar

2. C. Brüser, S. Winter and S. Leonhardt. Robust inter-beat interval estimation in cardiac vibration signals. Physiological Measurement, 34(2):123–138, Jan. 2013.10.1088/0967-3334/34/2/123Search in Google Scholar PubMed

3. E. Buccelletti, G. Emanuele, E. Scaini, L. Galiuto, R. Persiani, A. Biondi, F. Basile and N. Silveri. Heart rate variability and myocardial infarction: systematic literature review and metanalysis. European Review for Medical and Pharmacological Sciences, 13:299–307, Nov. 2008.Search in Google Scholar

4. P. Hamilton. Open source ECG analysis. In Computers in Cardiology, pages 101–104, Sept. 2002.10.1109/CIC.2002.1166717Search in Google Scholar

5. C. Hoog Antink, S. Leonhardt and M. Walter. A synthesizer framework for multimodal cardiorespiratory signals. Biomedical Physics & Engineering Express, 3(3):035028, Jun. 2017.10.1088/2057-1976/aa76eeSearch in Google Scholar

6. N. Iyengar, C. K. Peng, R. Morin, A. L. Goldberger and L. A. Lipsitz. Age-related alterations in the fractal scaling of cardiac interbeat interval dynamics. American Journal of Physiology – Regulatory, Integrative and Comparative Physiology, 271(4):R1078–R1084, 1996. PMID: 8898003.10.1152/ajpregu.1996.271.4.R1078Search in Google Scholar PubMed

7. S. Julier and J. K. Uhlmann. A general method for approximating nonlinear transformations of probability distributions. Technical report, 1996.Search in Google Scholar

8. S. J. Julier, J. K. Uhlmann and H. F. Durrant-Whyte. A new approach for filtering nonlinear systems. In Proceedings of 1995 American Control Conference – ACC’95, volume 3, pages 1628–1632, Jun. 1995.10.1109/ACC.1995.529783Search in Google Scholar

9. R. E. Kalman. A new approach to linear filtering and prediction problems. Transactions of the ASME – Journal of Basic Engineering, 82(Series D):35–45, 1960.10.1115/1.3662552Search in Google Scholar

10. S. Leonhardt, L. Leicht and D. Teichmann. Unobtrusive vital sign monitoring in automotive environments – a review. Sensors (Basel, Switzerland), 18(9), 2018.10.3390/s18093080Search in Google Scholar PubMed PubMed Central

11. M. Lüken, B. Penzlin, S. Leonhardt and B. J. E. Misgeld. Quantification of respiratory sinus arrhythmia using the IPANEMA body sensor network. In 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pages 83–88, Jun. 2016.10.1109/BSN.2016.7516237Search in Google Scholar

12. MATLAB. 9.7.0.1319299 (R2019b). The MathWorks Inc., Natick, Massachusetts, 2018.Search in Google Scholar

13. P. E. McSharry, G. D. Clifford, L. Tarassenko and L. A. Smith. A dynamical model for generating synthetic electrocardiogram signals. IEEE Transactions on Biomedical Engineering, 50(3):289–294, 2003.10.1109/TBME.2003.808805Search in Google Scholar PubMed

14. O. Postolache, P. S. Girão, E. Pinheiro and G. Postolache. Unobtrusive and Non-invasive Sensing Solutions for On-Line Physiological Parameters Monitoring, pages 277–314. Springer Berlin Heidelberg, Berlin, Heidelberg, 2010.10.1007/978-3-642-15687-8_15Search in Google Scholar

15. G. A. Reyes del Paso, W. Langewitz, L. J. M. Mulder, A. van Roon and S. Duschek. The utility of low frequency heart rate variability as an index of sympathetic cardiac tone: A review with emphasis on a reanalysis of previous studies. Psychophysiology, 50(5):477–487, 2013.10.1111/psyp.12027Search in Google Scholar PubMed

16. F. Shaffer, R. McCraty and C. L. Zerr. A healthy heart is not a metronome: an integrative review of the heart’s anatomy and heart rate variability. Frontiers in Psychology, 5, Sept. 2014.10.3389/fpsyg.2014.01040Search in Google Scholar PubMed PubMed Central

17. D. Simon. Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches. Wiley-Interscience, New York, NY, USA, 2006.10.1002/0470045345Search in Google Scholar

18. W. von Rosenberg, T. Chanwimalueang, T. Adjei, U. Jaffer, V. Goverdovsky and D. P. Mandic. Resolving ambiguities in the LF/HF ratio: LF-HF scatter plots for the categorization of mental and physical stress from HRV. Frontiers in Physiology, 8:360, 2017.10.3389/fphys.2017.00360Search in Google Scholar PubMed PubMed Central

19. Y. Zheng, X. Ding, C. C. Y. Poon, B. P. L. Lo, H. Zhang, X. Zhou, G. Yang, N. Zhao and Y. Zhang. Unobtrusive sensing and wearable devices for health informatics. IEEE Transactions on Biomedical Engineering, 61(5):1538–1554, May 2014.10.1109/TBME.2014.2309951Search in Google Scholar PubMed PubMed Central

Received: 2020-05-02
Accepted: 2020-09-29
Published Online: 2020-10-28
Published in Print: 2020-11-26

© 2020 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 30.4.2024 from https://www.degruyter.com/document/doi/10.1515/auto-2020-0075/html
Scroll to top button