Abstract
Chest X-Ray images are among the most used tools in medical diagnosis of various hearts and lung abnormalities and infections that could cause pneumonia, severe acute respiratory syndrome, septic shock, failure of multiple organs, and even death. Although such kind of images could be obtained at low cost, the lacking of qualified radiologists limits the exploitation of the X-Ray imaging technology. For these reasons, researchers have proposed the use of deep learning techniques to develop computer-assisted diagnosis systems. Among the most used techniques that have shown great performance in image classification, we find the Convolutional Neural Network (CNN). According to the literature, a good number of CNN architectures already exist. Unfortunately, there are no guidelines to design a specific architecture for a particular task; therefore, such design is still very subjective and mainly depends on the expertise and knowledge of data scientists. Motivated by these observations, we propose in this paper an automated method of CNN design for X-Ray image classification. We demonstrate that the CNN design can be seen as an optimization problem and we propose an Evolutionary algorithm (EA) that evolves a population of CNN architectures, with the aim to output an optimized one. Thanks to the ability of the EA to vary the graphs topologies of convolution blocks, the architecture search space is intelligently sampled approximating the optimal possible CNN architecture. Our proposed evolutionary method is validated by means of a set of comparative experiments with respect to relevant state-of-art architectures coming from three-generation approaches, namely: manual crafting, reinforcement learning-based design, and evolutionary optimization. The obtained results show the merits of our proposal based on the detection of the thoracic anomalies in the X-Ray images.
Supported by the Deanship of Scientific Research at Prince Sattam bin Abdulaziz University through the research project No. 2020/01/13222.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Becker, A.S., et al.: Detection of tuberculosis patterns in digital photographs of chest X-ray images using Deep Learning: feasibility study. Int. J. Tuberc. Lung Dis. 22(3), 328–335 (2018)
Louati, A., Louati, H., Li, Z.: Deep learning and case-based reasoning for predictive and adaptive traffic emergency management. J. Supercomput. 77(5), 4389–4418 (2020). https://doi.org/10.1007/s11227-020-03435-3
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25, 1097–1105 (2012)
Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely 750 connected convolutional networks. In: The IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR arXiv:1409.1556 (2014)
Szegedy, C. et al.: Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition, p. 19 (2015)
Xie, S., Girshick, R., Dollar, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: IEEE conference on Computer Vision and Pattern Recognition, pp. 1492–1500 (2017)
Louati, H., Bechikh, S., Louati, A., Hung, C.C., Ben Said, L.: Deep convolutional neural network architecture design as a bi-level optimization problem. Neurocomputing 439, 44–62 (2021). https://doi.org/10.1016/j.neucom.2021.01.094
Zoph, B., Le, Q.V.: Neural architecture search with reinforcement learning. In: 2017 International Conference on Learning Representations, Toulon, France. arXiv:1611.01578 (2016)
Zhong, Z., Yan, J., Wu, W., Shao, J., Liu, C.-L.: Practical block-wise neural network architecture generation. In: IEEE conference on Computer Vision and Pattern Recognition, pp. 2423–2432 (2018)
Baker, B., Gupta, O., Naik, N., Raskar, R.: Designing neural network architectures using reinforcement learning. MedRxiv (2016) https://doi.org/10.1101/2020.02.14.20023028
Shinozaki, T., Watanabe, S.: Structure discovery of deep neural network based on evolutionary algorithms. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4979–4983 (2015)
Sun, Y., Xue, B., Zhang, M., Yen, G.G.: Completely automated CNN architecture design based on blocks. IEEE Trans. Neural Netw. Learn. Syst. 33(2), 1242–1254 (2019)
Lu, Z., et al.: NSGA-Net: neural architecture search using multi-objective genetic algorithm. In: Genetic and Evolutionary Computation Conference, pp. 419–427 (2019)
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M.: ChestX-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3462–3471 (2017)
Islam, M.T., Aowal, M.A., Minhaz, A.T., Ashraf, K.: Abnormality detection and localization in chest X-rays using deep convolutional neural networks. CoRR arXiv:1705.09850 (2017)
Rajpurkar, P., et al.: Deep learning for chest radiograph diagnosis: a retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med. 15(11), 1–17 (2018)
Yao, L., Poblenz, E., Dagunts, D., Covington, B., Bernard, D., Lyman, K.: Learning to diagnose from scratch by exploiting dependencies among labels. CoRR arXiv:1710.1050 (2017)
Irvin, J., et al.: CheXpert: a large chest radiograph dataset with uncertainty labels and expert comparison. In: Thirty-Third AAAI Conference on Artificial Intelligence, pp. 590–597 (2019)
Sethy, P.K., Behera, S.K.: Detection of coronavirus disease (COVID-19) based on deep features. Int. J. Math. Eng. Manag. Sci. 5(4), 643–651 (2020)
Said, R., Bechikh, S., Louati, A., Aldaej, A., Ben Said, L.: Solving combinatorial multi-objective bi-level optimization problems using multiple populations and migration schemes. IEEE Access 8, 141674–141695 (2020). https://doi.org/10.1109/ACCESS.2020.3013568
Blog, G.R.: AutoML for large scale image classification and object detection. Google Research (2017) https://research.googleblog.com/2017/11/automl-for-large-scaleimage.html
Liang, J., Meyerson, E., Hodjat, B., Fink, D., Mutch, K., Miikkulainen, R.: Evolutionary neural autoML for deep learning (2019). https://doi.org/10.1145/3321707.3321721
Lu, Z., et al.: Multi-criterion evolutionary design of deep convolutional neural networks. arXiv arXiv:1912.01369 (2019)
Louati, A., Louati, H., Nusir, M., hardjono, B.: Multi-agent deep neural networks coupled with LQF-MWM algorithm for traffic control and emergency vehicles guidance. J. Ambient Intell. Hum. Comput. 11(11), 5611–5627 (2020). https://doi.org/10.1007/s12652-020-01921-3
Acknowledgements
This project was supported by the Deanship of Scientific Research at Prince Sattam bin Abdulaziz University through the research project No. 2020/01/13222.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Louati, H., Bechikh, S., Louati, A., Aldaej, A., Said, L.B. (2021). Evolutionary Optimization of Convolutional Neural Network Architecture Design for Thoracic X-Ray Image Classification. In: Fujita, H., Selamat, A., Lin, J.CW., Ali, M. (eds) Advances and Trends in Artificial Intelligence. Artificial Intelligence Practices. IEA/AIE 2021. Lecture Notes in Computer Science(), vol 12798. Springer, Cham. https://doi.org/10.1007/978-3-030-79457-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-79457-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79456-9
Online ISBN: 978-3-030-79457-6
eBook Packages: Computer ScienceComputer Science (R0)