Abstract
Heartbeat classification plays an important role in identifying cardiac arrhythmias. Although automated heartbeat classification approaches have been broadly reported, they still suffer from some disadvantages, such as the inescapable domain knowledge and human ingenuity for hand-crafted heartbeat feature engineering, and the slow learning speed for iterative deep learning heartbeat classification approach. To address the above issues, for the first time, this paper proposes a novel multilayer extreme learning machine (ML-ELM) heartbeat classification approach for feature representation and classification of the heartbeat signals. Different from the iterative optimization scheme in traditional neural networks, ELM autoencoder (ELM-AE) is employed in ML-ELM for random mapping of the input weights and non-iterative learning is implemented for output weights. To realize unsupervised self-encoding heartbeat feature mapping, the output of ELM-AE is consistent with the incoming heartbeat signal, and the optimization objective is to minimize the reconstruction error. Heartbeat feature extraction is efficiently performed by layer-by-layer ELM-AE stacking. In the stage of heartbeat classification, to solve the unstable performance caused by random parameter initialization in ELM hidden nodes, bagging-based ensemble learning is employed to combine several ELM classifiers and thus develops a well-performed heartbeat classification approach. The proposed approach is applied to two-lead ECG signals, which is obtained from the MIT-BIH arrhythmia public dataset. The experimental results show that the ELM-AE based feature extraction can effectively characterize the characteristics of the heartbeat signal with high efficiency compared with other state-of-the-art approaches. Applying the ensemble decision fusion to two leads, the final classification accuracy reaches 99.41%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Afkhami RG, Azarnia G, Tinati MA (2016) Cardiac arrhythmia classification using statistical and mixture modeling features of ECG signals. Pattern Recogn Lett 70(2):45–51. https://doi.org/10.1016/j.patrec.2015.11.018
Al-Fahoum AS, Howitt I (1999) Combined wavelet transformation and radial basis neural networks for classifying life-threatening cardiac arrhythmias. Med Biol Eng Comput 37:566–573. https://doi.org/10.1007/BF02513350
Awodeyi AE, Alty SR, Ghavami M (2014) Median based method for baseline wander removal in photoplethysmogram signals. Paper presented at 2014 IEEE international conference on bioinformatics and bioengineering, Boca Raton, 10–12 November 2014. https://doi.org/10.1109/BIBE.2014.77
Cano o, Andrés A, Alonso P, et al (2017) Essential ECG clues in patients with congenital heart disease and arrhythmias. J Electrocardiol 50(2):243–250. https://doi.org/10.1016/j.jelectrocard.2016.08.005
Chen CLP, Zhang C, Chen L et al (2015) Fuzzy restricted boltzmann machine for the enhancement of deep learning. IEEE Trans Fuzzy Syst 23(6):2163–2173. https://doi.org/10.1109/TFUZZ.2015.2406889
Chen S, Hua W, Li Z et al (2017) Heartbeat classification using projected and dynamic features of ECG signal. Biomed Signal Process Control 31:165–173. https://doi.org/10.1016/j.bspc.2016.07.010
De Chazal P, Reilly RB (2006) A patient-adapting heartbeat classifier using ECG morphology and heartbeat interval features. IEEE Trans Biomed Eng 53(12):2535–2543. https://doi.org/10.1109/TBME.2006.883802
De Chazal P, O’Dwyer M, Reilly RB (2004) Automatic classification of heartbeats using ECG morphology and heartbeat interval features. IEEE Trans Biomed Eng 51(7):1196–1206. https://doi.org/10.1109/TBME.2004.827359
Ding C, Tao D (2018) Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE Trans Pattern Anal Mach Intell 40(4):1002–1014. https://doi.org/10.1109/TPAMI.2017.2700390
Galar M, Fernandez A, Barrenechea E et al (2012) A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. IEEE Trans Syst Man Cybern C Appl Rev 42(4):463–484. https://doi.org/10.1109/TSMCC.2011.2161285
Ghista DN, Subbhuraam VS, Swapna G, et al. (2016) ECG waveform and heart rate variability signal analysis to detect cardiac arrhythmias. In: Ghista DN (ed) Cardiology Science and Technology. CRC Press, Boca Raton, p 219–252. https://doi.org/10.1201/b18,553
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507. https://doi.org/10.1126/science.1127647
Hinton GE, Osindero S, Teh Y (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554. https://doi.org/10.1162/neco.2006.18.7.1527
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. Paper presented at 2004 IEEE international joint conference on neural networks, Budapest, 25–29 July 2004. https://doi.org/10.1109/IJCNN.2004.1380068
Huang GB, Chen L, Siew CK (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892. https://doi.org/10.1109/TNN.2006.875977
Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: Theory and applications. Neurocomputing 70(1–3):489–501. https://doi.org/10.1016/j.neucom.2005.12.126
Huang GB, Zhou H, Ding X et al (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern 42(2):513–529. https://doi.org/10.1109/TSMCB.2011.2168604
Inan OT, Giovangrandi L, Kovacs GTA (2006) Robust neural-network-based classification of premature ventricular contractions using wavelet transform and timing interval features. IEEE Trans Biomed Eng 53(12):2507–2515. https://doi.org/10.1109/TBME.2006.880879
Kasun LLC, Zhou H, Huang G et al (2013) Representational learning with extreme learning machine for big data. IEEE Intell Syst 28(6):31–34. https://doi.org/10.1109/MIS.2013.140
Khunti K (2014) Accurate interpretation of the 12-lead ECG electrode placement: A systematic review. Health Educ J 73(5):610–623. https://doi.org/10.1177/0017896912472328
Kiranyaz S, Ince T, Gabbouj M (2016) Real-time patient-specific ECG classification by 1-d convolutional neural networks. IEEE Trans Biomed Eng 63(3):664–675. https://doi.org/10.1109/TBME.2015.2468589
Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386
Lecun Y, Boser B, Denker JS et al (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551. https://doi.org/10.1162/neco.1989.1.4.541
Li D, Zhang H, M. Z, (2017) Wavelet de-noising and genetic algorithm-based least squares twin SVM for classification of arrhythmias. Circuits, Syst, Signal Process 36:2828–2846. https://doi.org/10.1007/s00034-016-0439-8
Mar T, Zaunseder S, Martínez JP et al (2011) Optimization of ECG classification by means of feature selection. IEEE Trans Biomed Eng 58(8):2168–2177. https://doi.org/10.1109/TBME.2011.2113395
Martinez JP, Almeida R, Olmos S et al (2004) A wavelet-based ECG delineator: evaluation on standard databases. IEEE Trans Biomed Eng 51(4):570–581. https://doi.org/10.1109/TBME.2003.821031
Mondéjar-Guerra V, Novo J, Rouco J et al (2019) Heartbeat classification fusing temporal and morphological information of ECGs via ensemble of classifiers. Biomed Signal Process Control 47:41–48. https://doi.org/10.1016/j.bspc.2018.08.007
Moody G, Mark R (2005) MIT-BIH arrhythmia database, v1.0.0. Figshare https://doi.org/10.13026/C2F305
Osowski S, Linh TH (2001) ECG beat recognition using fuzzy hybrid neural network. IEEE Trans Biomed Eng 48(11):1265–1271. https://doi.org/10.1109/10.959322
Polikar R (2006) Ensemble based systems in decision making. IEEE Circ Syst Mag 6(3):21–45. https://doi.org/10.1109/MCAS.2006.1688199
Sagi O, Rokach L (2018) Ensemble learning: A survey. WIREs Data Mining Knowl Discov 8(4):e1249. https://doi.org/10.1002/widm.1249
Shi H, Wang H, Huang Y et al (2019) A hierarchical method based on weighted extreme gradient boosting in ECG heartbeat classification. Comput Methods Program Biomed 171:1–10. https://doi.org/10.1016/j.cmpb.2019.02.005
Shyu LY, Wu YH, Hu W (2004) Using wavelet transform and fuzzy neural network for ECG detection from the holter ECG. IEEE Trans Biomed Eng 51(7):1269–1273. https://doi.org/10.1109/tbme.2004.824131
Tajbakhsh N, Shin JY, Gurudu SR et al (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imag 35(5):1299–1312. https://doi.org/10.1109/TMI.2016.2535302
Tang J, Deng C, Huang GB (2016) Extreme learning machine for multilayer perceptron. IEEE Trans Neural Netw Learn Syst 27(4):809–821. https://doi.org/10.1109/TNNLS.2015.2424995
Thakor NV, Webster JG, Tompkins WJ (1984) Estimation of QRS complex power spectra for design of a QRS filter. IEEE Trans Biomed Eng BME-31(11):702–706. https://doi.org/10.1109/TBME.1984.325393
Thaler MS (2012) The Only EKG Book You’ll Ever Need, 7th edn. Lippincott Williams & Wilkins, Philadelphia, PA
Tuncer T, Dogan S, Plawiak P et al (2019) Automated arrhythmia detection using novel hexadecimal local pattern and multilevel wavelet transform with ECG signals. Knowl-Based Syst 186(104):923. https://doi.org/10.1016/j.knosys.2019.104923
Vincent P, Larochelle H, Lajoie I, et al. (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371—3408. http://jmlr.org/papers/v11/vincent10a.html
Wang T, Lu C, Ju W et al (2022) Imbalanced heartbeat classification using easyensemble technique and global heartbeat information. Biomed Signal Process Control 71(103):105. https://doi.org/10.1016/j.bspc.2021.103105
World Health Organization (2021) Cardiovascular diseases. https://www.who.int/en/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds), accessed 2 September 2022
Xu Y, Zhang S, Cao Z et al (2021) Extreme learning machine for heartbeat classification with hybrid time-domain and wavelet time-frequency features. J Healthc Eng 31(6674):695. https://doi.org/10.1155/2021/6674695
Yang P, Wang D, Zhao WB et al (2021) Ensemble of kernel extreme learning machine based random forest classifiers for automatic heartbeat classification. Biomed Signal Process Control 63(102):138. https://doi.org/10.1016/j.bspc.2020.102138
Ye C, Vijaya Kumar BVK, Coimbra MT (2012) Heartbeat classification using morphological and dynamic features of ECG signals. IEEE Trans Biomed Eng 59(10):2930–2941. https://doi.org/10.1109/TBME.2012.2213253
Yildirim O, Plawiak P, Tan RS et al (2018) Arrhythmia detection using deep convolutional neural network with long duration ECG signals. Comput Biol Med 102(1):411–420. https://doi.org/10.1016/j.compbiomed.2018.09.009
Yildirim O, Baloglu UB, Tan RS et al (2019) A new approach for arrhythmia classification using deep coded features and LSTM networks. Comput Methods Programs Biomed 176:121–133. https://doi.org/10.1016/j.cmpb.2019.05.004
Zhang J, Xiao W, Li Y et al (2019) Multilayer probability extreme learning machine for device-free localization. Neurocomputing 396(5):383–393. https://doi.org/10.1016/j.neucom.2018.11.106
Zhang J, Li Y, Xiao W et al (2020) Non-iterative and fast deep learning: Multilayer extreme learning machines. J Franklin Inst 357(30):8925–8955. https://doi.org/10.1016/j.jfranklin.2020.04.033
Zheng S, Jayasumana S, Romera-Paredes B, et al. (2015) Conditional random fields as recurrent neural networks. Paper presented at 2015 IEEE international conference on computer vision, Santiago, 07–13 December 2015. https://doi.org/10.1109/ICCV.2015.179
Acknowledgements
The authors would like to thank the anonymous reviewers for their insightful comments and suggestions.
Funding
This work was supported in part by the National Natural Science Foundations of China (NSFC) under Grant 62173032, the Foshan Science and Technology Innovation Special Project under Grant BK20AF005 and Grant BK22BF005, and the Regional Joint Fund of the Guangdong Basic and Applied Basic Research Fund under Grant 2022A1515140109.
Author information
Authors and Affiliations
Contributions
Yuefan Xu: Conceptualiztion, Methodology, Software, Formal Analysis, Writing—original draft; Luyao Liu: Investigation; Sen Zhang: Supervision, Resources; Wendong Xiao: Conceptualization, Funding acquisition, Writing—review & editing.
Corresponding author
Ethics declarations
Conflicts of interest
All authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xu, Y., Liu, L., Zhang, S. et al. Multilayer extreme learning machine-based unsupervised deep feature representation for heartbeat classification. Soft Comput 27, 12353–12366 (2023). https://doi.org/10.1007/s00500-023-07861-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-023-07861-2