Abstract
As the core of deep learning methodologies, convolutional neural network (CNN) has received wide attention in the area of image recognition. In particular, it requires very precise, accurate and fine recognition power for medical imaging processing. Numerous promising prospects of CNN applications with medical prognosis and diagnosis have been reported in the related works, and the common goal among the literature is mainly to analyze the insights from the finest details of medical images and build a more suitable model with maximum accuracy and minimum error. Thus, a novel CNN model is proposed with the characteristics of multi-view feature preprocessing and swarm-based parameter optimization. Additional information of extra features from multi-view is discovered potentially for training, and simultaneously, the most optimal set of CNN parameters are provided by our proposed leader and long-tail-based particle swarm optimization. The purpose of such a hybrid method is to achieve the highest possibility of target recognition in medical images. Preliminary experiments over cardiovascular and mammogram datasets related to heart disease prediction and breast cancer classification, respectively, are designed and conducted, and the results indicate encouraging performance compared to other existing CNN model optimization methods.
Similar content being viewed by others
References
World Health Organization (2018) World health statistics 2018: monitoring health for the SDGs, sustainable development goals
Hendrick RE, Baker JA, Helvie MA (2019) Breast cancer deaths averted over 3 decades. Cancer 125(9):1482–1488
Aribal E, Mora P, Chaturvedi AK, Hertl K, Davidović J, Salama DH, Gershan V, Kadivec M, Odio C, Popli M (2019) Improvement of early detection of breast cancer through collaborative multi-country efforts: observational clinical study. Eur J Radiol 115:31–38
Wang X, Guo Y, Wang Y, Yu J (2019) Automatic breast tumor detection in ABVS images based on convolutional neural network and superpixel patterns. Neural Comput Appl 31(4):1069–1081
Bajaj V, Pawar M, Meena VK, Kumar M, Sengur A, Guo Y (2017) Computer-aided diagnosis of breast cancer using bi-dimensional empirical mode decomposition. Neural Comput Appl 31:3307–3315
LeCun Y, Bengio Y (1995) Convolutional networks for images, speech, and time series. Handb Brain Theory Neural Netw 3361(10):1995
Lan K, Wang D-t, Fong S, Liu L-s, Wong KK, Dey N (2018) A survey of data mining and deep learning in bioinformatics. J Med Syst 42(8):139
Kennedy J, Eberhart R (1995) Particle swarm optimization (PSO). In: Proceedings of IEEE international conference on neural networks, Perth, Australia, pp 1942–1948
Lan K, Fong S, Liu L-S, Wong RK, Dey N, Millham RC, Wong KK (2019) A clustering based variable sub-window approach using particle swarm optimisation for biomedical sensor data monitoring. Enterp Inf Syst. https://doi.org/10.1080/17517575.2019.1597388
Yang X-S (2010) Nature-inspired metaheuristic algorithms. Luniver Press, Bristol
Yang X-S (2010) Firefly algorithm, Levy flights and global optimization. In: Bramer M, Ellis R, Petridis M (eds) Research and development in intelligent systems XXVI. Springer, London, pp 209–218
Sahiner B, Chan H-P, Petrick N, Wei D, Helvie MA, Adler DD, Goodsitt MM (1996) Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images. IEEE Trans Med Imaging 15(5):598–610
Kooi T, Litjens G, Van Ginneken B, Gubern-Mérida A, Sánchez CI, Mann R, den Heeten A, Karssemeijer N (2017) Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal 35:303–312
Arevalo J, González FA, Ramos-Pollán R, Oliveira JL, Lopez MAG (2015) Convolutional neural networks for mammography mass lesion classification. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 797–800
Mordang J-J, Janssen T, Bria A, Kooi T, Gubern-Mérida A, Karssemeijer N (2016) Automatic microcalcification detection in multi-vendor mammography using convolutional neural networks. In: International workshop on breast imaging. Springer, pp 35–42
Ruder S (2016) An overview of gradient descent optimization algorithms. arXiv preprint, arXiv:160904747
Dheeba J, Singh NA, Selvi ST (2014) Computer-aided detection of breast cancer on mammograms: a swarm intelligence optimized wavelet neural network approach. J Biomed Inform 49:45–52
Zhu W, Lou Q, Vang YS, Xie X (2017) Deep multi-instance networks with sparse label assignment for whole mammogram classification. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 603–611
Carneiro G, Nascimento J, Bradley AP (2015) Unregistered multiview mammogram analysis with pre-trained deep learning models. In: international conference on medical image computing and computer-assisted intervention. Springer, pp 652–660
Chung H, Shin K-S (2019) Genetic algorithm-optimized multi-channel convolutional neural network for stock market prediction. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04236-3
Luo G, Dong S, Wang K, Zuo W, Cao S, Zhang H (2017) Multi-views fusion CNN for left ventricular volumes estimation on cardiac MR images. IEEE Trans Biomed Eng 65(9):1924–1934
Appia V, Yezzi A (2011) Active geodesics: Region-based active contour segmentation with a global edge-based constraint. In: 2011 international conference on computer vision. IEEE, pp 1975–1980
Lee H-Y, Codella NC, Cham MD, Weinsaft JW, Wang Y (2009) Automatic left ventricle segmentation using iterative thresholding and an active contour model with adaptation on short-axis cardiac MRI. IEEE Trans Biomed Eng 57(4):905–913
Lee HY, Codella N, Cham M, Prince M, Weinsaft J, Wang Y (2008) Left ventricle segmentation using graph searching on intensity and gradient and a priori knowledge (lvGIGA) for short-axis cardiac magnetic resonance imaging. J Magn Reson Imaging 28(6):1393–1401
Tran PV (2016) A fully convolutional neural network for cardiac segmentation in short-axis MRI. arXiv preprint, arXiv:160400494
Pednekar A, Kurkure U, Muthupillai R, Flamm S, Kakadiaris IA (2006) Automated left ventricular segmentation in cardiac MRI. IEEE Trans Biomed Eng 53(7):1425–1428
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241
Liu H, Hu H, Xu X, Song E (2012) Automatic left ventricle segmentation in cardiac MRI using topological stable-state thresholding and region restricted dynamic programming. Acad Radiol 19(6):723–731
Hu H, Liu H, Gao Z, Huang L (2013) Hybrid segmentation of left ventricle in cardiac MRI using gaussian-mixture model and region restricted dynamic programming. Magn Reson Imaging 31(4):575–584
Curiale AH, Colavecchia FD, Kaluza P, Isoardi RA, Mato G (2017) Automatic myocardial segmentation by using a deep learning network in cardiac MRI. In: 2017 XLIII Latin American computer conference (CLEI). IEEE, pp 1–6
Snoek J, Rippel O, Swersky K, Kiros R, Satish N, Sundaram N, Patwary M, Prabhat M, Adams R (2015) Scalable bayesian optimization using deep neural networks. In: International conference on machine learning, pp 2171–2180
Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P, Nasrin MS, Hasan M, Van Essen BC, Awwal AA, Asari VK (2019) A state-of-the-art survey on deep learning theory and architectures. Electronics 8(3):292
Becherer N, Pecarina J, Nykl S, Hopkinson K (2019) Improving optimization of convolutional neural networks through parameter fine-tuning. Neural Comput Appl 31:3469. https://doi.org/10.1007/s00521-017-3285-0
Sun Y, Xue B, Zhang M, Yen GG (2018) A particle swarm optimization-based flexible convolutional autoencoder for image classification. IEEE Trans Neural Netw Learn Syst 30:2295–2309
Loussaief S, Abdelkrim A (2018) Convolutional neural network hyper-parameters optimization based on genetic algorithms. Int J Adv Comput Sci Appl 9(10):252–266
Guo B, Hu J, Wu W, Peng Q, Wu F (2019) The Tabu_genetic algorithm: a novel method for hyper-parameter optimization of learning algorithms. Electronics 8(5):579
Tian Z, Fong S (2016) Survey of meta-heuristic algorithms for deep learning training. In: Baskan O (ed) Optimization algorithms—methods and applications. Intech, Rijeka
Zhining Y, Yunming P (2015) The genetic convolutional neural network model based on random sample. Int J u-and e-Serv Sci Technol 8(11):317–326
Rosa G, Papa J, Marana A, Scheirer W, Cox D (2015) Fine-tuning convolutional neural networks using harmony search. In: Pardo A, Kittler J (eds) Progress in pattern recognition, image analysis, computer vision, and applications. Springer, Cham, pp 683–690
Rere LR, Wardijono BA, Chandra YI (2019) A comparison study of three single-solution based metaheuristic optimisation for stacked auto encoder. J Phys: Conf Ser 1:012066
Fong S, Deb S, Yang X (2018) How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics. In: Sa P, Sahoo M, Murugappan M, Wu Y, Majhi B (eds) Progress in intelligent computing techniques: theory, practice, and applications. Springer, Berlin, pp 3–25
Shrestha A, Mahmood A (2019) Review of deep learning algorithms and architectures. IEEE Access 7:53040–53065
Yang X-S, Deb S (2009) Cuckoo search via Lévy flights. In: 2009 world congress on nature & biologically inspired computing (NaBIC). IEEE, pp 210–214
Mantegna RN (1994) Fast, accurate algorithm for numerical simulation of Levy stable stochastic processes. Phys Rev E 49(5):4677
Fong S, Deb S, Yang X-S, Li J (2014) Feature selection in life science classification: metaheuristic swarm search. IT Prof 16(4):24–29
Wang S-H, Muhammad K, Hong J, Sangaiah AK, Zhang Y-D (2020) Alcoholism identification via convolutional neural network based on parametric ReLU, dropout, and batch normalization. Neural Comput Appl 32:665. https://doi.org/10.1007/s00521-018-3924-0
Acknowledgements
The authors are thankful to the financial support from the research grants, MYRG2016-00069, offered by the Multi-Year Research Grant (MYRG) of University of Macau, and FDCT/126/2014/A3, offered by the Science and Technology Development Fund (FDCT) of Macau SAR government.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lan, K., Liu, L., Li, T. et al. Multi-view convolutional neural network with leader and long-tail particle swarm optimizer for enhancing heart disease and breast cancer detection. Neural Comput & Applic 32, 15469–15488 (2020). https://doi.org/10.1007/s00521-020-04769-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-04769-y