Skip to main content
SpringerLink
Log in

Enhancing cardiac diagnostics through semantic-driven image synthesis: a hybrid GAN approach

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Cardiac image synthesis and analysis are pivotal in modern healthcare for accurate diagnosis and treatment of cardiovascular conditions. This study introduces a pioneering approach—hybrid GAN with semantic resonance—for the generation and analysis of synthetic cardiac images. Drawing from a diverse dataset encompassing local and global views, acquired through various modalities like MRI, CT, and echocardiography, the critical need for both accuracy and clinical relevance in cardiac image synthesis is addressed. In the architectural setup, a hybrid GAN is defined, comprising both local and global components. The local generator excels in capturing intricate details, while the global generator contextualizes the overall cardiac structure. A fundamental innovation lies in the incorporation of pre-trained CNN classifiers specialized in recognizing cardiac pathologies, anatomical structures, and clinical features. These classifiers provide conditional guidance to the generators, ensuring that the synthesized images align semantically with clinical expectations. The training phase employs a pioneering approach, integrating real-time feedback from the classifiers to steer the image synthesis process. The generators, discriminators, and classifiers are optimized, with a dual emphasis on adversarial loss for authenticity and classification loss for diagnostic significance. The accuracy obtained by the proposed approach is 98.96%. Further, the SSIM and PSNR values attained by the proposed approach are 0.955 and 45.23, which is higher than the existing approaches like GAN, CNN, VAE, DenseNet, VGG19, DeepCardiac, Pix2Pix GAN and Cycle-GAN, respectively. Validation on an independent test dataset underscores the generalization capabilities of the proposed hybrid GAN. Furthermore, post-processing techniques refine the generated images, elevating their clinical relevance. Results visualization presents the prowess of the proposed approach, providing a holistic view of local and global perspectives within synthetic images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Availability of data and material

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Kwon JM, Kim KH, Jeon KH, Lee SY, Park J, Oh BH (2020) Artificial intelligence algorithm for predicting cardiac arrest using electrocardiography. Scand J Trauma, Resuscitation Emerg Med 28:1–10

    Article  Google Scholar 

  2. Grogan M, Lopez-Jimenez F, Cohen-Shelly M, Dispenzieri A, Attia ZI, Abou Ezzedine OF, Lin G, Kapa S, Borgeson DD, Friedman PA, Murphree DH Jr (2021) Artificial intelligence–enhanced electrocardiogram for the early detection of cardiac amyloidosis. Mayo Clin Proc 96(11):2768–2778

    Article  Google Scholar 

  3. Rath A, Mishra D, Panda G (2021) LSTM-based cardiovascular disease detection using ECG signal. Cognitive informatics and soft computing: proceeding of CISC 2020. Springer, Singapore, pp 133–142

    Chapter  Google Scholar 

  4. Colin GC, Pouleur AC, Gerber BL, Poncelet PA, De Meester C, D’Hondt AM, Vlassenbroek A, Houard L, Gevenois PA, Ghaye B (2020) Pulmonary hypertension detection by computed tomography pulmonary transit time in heart failure with reduced ejection fraction. Eur Heart J Cardiovasc Imaging 21(11):1291–1298

    Article  Google Scholar 

  5. Mishra S, Kass DA (2021) Cellular and molecular pathobiology of heart failure with preserved ejection fraction. Nat Rev Cardiol 18(6):400–423

    Article  Google Scholar 

  6. Mansour A, Fuhrman JD, Ammar FE, Loggini A, Davis J, Lazaridis C, Kramer C, Goldenberg FD, Giger ML (2022) Machine learning for early detection of hypoxic-ischemic brain injury after cardiac arrest. Neurocrit Care 36:974–982

    Article  Google Scholar 

  7. Elming MB, Hammer-Hansen S, Voges I, Nyktari E, Raja AA, Svendsen JH, Pehrson S, Signorovitch J, Køber L, Prasad SK, Thune JJ (2020) Myocardial fibrosis and the effect of primary prophylactic defibrillator implantation in patients with non-ischemic systolic heart failure—DANISH-MRI. Am Heart J 221:165–176

    Article  Google Scholar 

  8. Olsen CR, Mentz RJ, Anstrom KJ, Page D, Patel PA (2020) Clinical applications of machine learning in the diagnosis, classification, and prediction of heart failure. Am Heart J 229:1–17

    Article  Google Scholar 

  9. Chae M, Gil HW, Cho NJ, Lee H (2022) Machine learning-based cardiac arrest prediction for early warning system. Mathematics 10(12):2049

    Article  Google Scholar 

  10. Kumar Y, Koul A, Sisodia PS, Shafi J, Kavita V, Gheisari M, Davoodi MB (2021) Heart failure detection using quantum-enhanced machine learning and traditional machine learning techniques for internet of artificially intelligent medical things. Wirel Commun Mobile Comput 17(2021):1–6

    Google Scholar 

  11. Al Khalil Y, Amirrajab S, Lorenz C, Weese J, Pluim J, Breeuwer M (2023) Reducing segmentation failures in cardiac MRI via late feature fusion and GAN-based augmentation. Comput Biol Med 161:106973

    Article  Google Scholar 

  12. Pandya S, Gadekallu TR, Reddy PK, Wang W, Alazab M (2022) InfusedHeart: a novel knowledge-infused learning framework for diagnosis of cardiovascular events. IEEE Trans Comput Soc Syst 1–10

  13. Acs B, Rantalainen M, Hartman J (2020) Artificial intelligence as the next step towards precision pathology. J Intern Med 288(1):62–81

    Article  Google Scholar 

  14. Baral S, Alsadoon A, Prasad PWC, Al Aloussi S, Alsadoon OH (2021) A novel solution of using deep learning for early prediction cardiac arrest in Sepsis patient: enhanced bidirectional long short-term memory (LSTM). Multimed Tools Appl 80:32639–32664

    Article  Google Scholar 

  15. Savorgnan F, Crouthamel DI, Heroy A, Santerre J, Acosta S (2022) Quantification of electrocardiogram instability prior to cardiac arrest in patients with single-ventricle physiology. J Electrocardiol 73:29–33

    Article  Google Scholar 

  16. Tani H, Tohyama S (2022) Human engineered heart tissue models for disease modeling and drug discovery. Front Cell Dev Biol 10:855763

    Article  Google Scholar 

  17. Kuznetsov VV, Moskalenko VA, Zolotykh NY (2020) Electrocardiogram generation and feature extraction using a variational autoencoder. arXiv preprint arXiv:2002.00254

  18. Rustam F, Ishaq A, Munir K, Almutairi M, Aslam N, Ashraf I (2022) Incorporating CNN features for optimizing performance of ensemble classifier for cardiovascular disease prediction. Diagnostics 12(6):1474

    Article  Google Scholar 

  19. Jahmunah V, Ng EYK, San TR, Acharya UR (2021) Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using GaborCNN model with ECG signals. Comput Biol Med 134:104457

    Article  Google Scholar 

  20. Ishaq A, Sadiq S, Umer M, Ullah S, Mirjalili S, Rupapara V, Nappi M (2021) Improving the prediction of heart failure patients’ survival using SMOTE and effective data mining techniques. IEEE access 9:39707–39716

    Article  Google Scholar 

  21. Le MT, Vo MT, Pham NT, Dao SV (2021) Predicting heart failure using a wrapper-based feature selection. Indones J Electr Eng Comput Sci 21(3):1530–1539

    Google Scholar 

  22. Abdellatif A, Abdellatef H, Kanesan J, Chow CO, Chuah JH, Gheni HM (2022) An effective heart disease detection and severity level classification model using machine learning and hyperparameter optimization methods. IEEE Access 10:79974–79985

    Article  Google Scholar 

  23. Krishnan VG, Saradhi DM, Kumar DS, Dhanalakshmi G, Pushpa P, Vijayaraja DV (2023) Hybrid optimization based feature selection with densenet model for heart disease prediction. Int J Electric Electron Res 11(2):253–261

    Article  Google Scholar 

  24. Apostolopoulos ID, Papathanasiou ND, Papandrianos N, Papageorgiou E, Apostolopoulos DJ (2023) Innovative attention-based explainable feature-fusion VGG19 network for characterising myocardial perfusion imaging SPECT polar maps in patients with suspected coronary artery disease. Appl Sci 13(15):8839

    Article  Google Scholar 

  25. Jimenez-Perez G, Acosta J, Alcaine A, Camara O (2021) Generalizing electrocardiogram delineation--Training convolutional neural networks with synthetic data augmentation. arXiv preprint arXiv:2111.12996

  26. Kaspal R, Alsadoon A, Prasad PWC, Al-Saiyd NA, Nguyen TQV, Pham DTH (2021) A novel approach for early prediction of sudden cardiac death (SCD) using hybrid deep learning. Multimedia Tools Appl 80:8063–8090

    Article  Google Scholar 

  27. https://www.cardiacatlas.org/sunnybrook-cardiac-data/

  28. https://www.creatis.insa-lyon.fr/Challenge/acdc/databases.html

  29. https://www.cardiacatlas.org/amrg-cardiac-atlas/

  30. Ahmad A, Hussain HK, Tanveer H, Kiruthiga T, Gupta K (2023) The intelligent heart rate monitoring model for survivability prediction of cardiac arrest patients using deep cardiac learning model. In: International conference on intelligent systems for communication, IoT and security (ICISCoIS). IEEE, 376–381

  31. Aljohani A, Alharbe N (2022) Generating synthetic images for healthcare with novel deep pix2pix gan. Electronics 11(21):3470

    Article  Google Scholar 

  32. Zhang H, Li H, Dillman JR, Parikh NA, He L (2022) Multi-contrast MRI image synthesis using switchable cycle-consistent generative adversarial networks. Diagnostics 12(4):816

    Article  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Sri Sairam Engineering College, West Tambaram, Chennai, 600 044, India

    S. Gurusubramani & B. Latha

Authors
  1. S. Gurusubramani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. B. Latha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Gurusubramani.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Human and animal rights

This article does not contain any studies with human or animal subjects performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gurusubramani, S., Latha, B. Enhancing cardiac diagnostics through semantic-driven image synthesis: a hybrid GAN approach. Neural Comput & Applic 36, 8181–8197 (2024). https://doi.org/10.1007/s00521-024-09452-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-024-09452-0

Keywords

Search

Navigation