Abstract
Deep metric learning-based image retrieval systems have recently been used in medical applications because they provide clinically relevant information-based similar images based on prior knowledge. Although train examiners and deep learning models successfully analyze leukocyte cells, there are still numerous difficult challenges due to biological variation, time constraints, and a variety of image-related aspects. In this study, we propose a deep metric learning model-based image retrieval and classification system for acute myeloid leukemia blood cells to address these issues and assist physicians. The proposed model utilizes the pre-trained ResNet-34 model as the backbone network, embedding loss with multi similarity miner, and M-Per-Class sampling strategy to learn an embedding function. The five embedding losses were also applied to compare the four performances in order to determine the best loss-based model. Based on the best loss-based model, the class-wise precision and sensitivity using a neighborhood size are also presented. The results show that the contrastive loss-based deep metric learning model achieved the highest precision of 94.90%, sensitivity of 94.85%, specificity of 99.64%, and accuracy of 99.32% in model comparison. Except for a few failures in small classes, the class-wise precision and sensitivity scores looked to be impressive in all classes. Therefore, this proposed system can highly be effective in screening and diagnosing of AML-related white blood cell stages that cause serious cancer.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Data Availability
The detailed analysis of the five loss-based models, the comparison results between previous work and contrastive loss-based DML model, and some test images are available at Figshare: https://doi.org/10.6084/m9.figshare.23544915.v1.
References
Ahmed, N., Yigit, A., Isik, Z., Alpkocak, A.: Identification of leukemia subtypes from microscopic images using convolutional neural network. Diagnostics (Basel) 9, 104 (2019)
Patel, N., Mishra, A.: Automated leukaemia detection using microscopic images. Procedia Comput. Sci. 58, 635–642 (2015)
Riley, L.K., Rupert, J.: Evaluation of patients with leukocytosis. Am. Fam. Phys. 92, 1004–1011 (2015)
McKinnon, K.M.: Flow cytometry: an overview. Curr. Protoc. Immunol. 120, 5.1.1–5.1.11 (2018)
Cao, H., Liu, H., Song, E.: A novel algorithm for segmentation of leukocytes in peripheral blood. Biomed. Signal Process. Control 45, 10–21 (2018)
Matek, C., Schwarz, S., Spiekermann, K., Marr, C.: Human-level recognition of blast cells in acute myeloid leukaemia with convolutional neural networks. Nat. Mach. Intell. 1, 538–544 (2019)
Jung, C., Abuhamad, M., Mohaisen, D., Han, K., Nyang, D.: WBC image classification and generative models based on convolutional neural network. BMC Med. Imaging 22, 94 (2022)
Wang, Q., Bi, S., Sun, M., Wang, Y., Wang, D., Yang, S.: Deep learning approach to peripheral leukocyte recognition. PLoS ONE 14, e0218808 (2019)
Kutlu, H., Avci, E., Özyurt, F.: White blood cells detection and classification based on regional convolutional neural networks. Med. Hypotheses 135, 109472 (2020)
Yi, D., Lei, Z., Liao, S., Li, S.Z.: Deep metric learning for person re-identification. In: 2014 22nd International Conference on Pattern Recognition, pp. 34–39 (2014)
Lu, J., Hu, J., Zhou, J.: Deep metric learning for visual understanding: an overview of recent advances. IEEE Signal Process. Mag. 34, 76–84 (2017)
Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)
Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737 (2017)
Sundgaard, J.V., et al.: Deep metric learning for otitis media classification. Med. Image Anal. 71, 102034 (2021)
Zhong, A., Li, X., Wu, D., Ren, H., Kim, K., Kim, Y., et al.: Deep metric learning-based image retrieval system for chest radiograph and its clinical applications in COVID-19. Med. Image Anal. 70, 101993 (2021)
Matek, C., Schwarz, S., Spiekermann, K., Marr, C.: A single-cell morphological dataset of leukocytes from AML patients and non-malignant controls. The cancer imaging archive (2019)
Musgrave, K., Belongie, S., Lim, S.-N.: A metric learning reality check. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12370, pp. 681–699. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58595-2_41
Hadsell, R., Chopra, S., LeCun, Y.: Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), pp. 1735–1742 (2006)
Weinberger, K.Q., Blitzer, J., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. In: Proceedings of the 18th International Conference on Neural Information Processing Systems, pp. 1473–1480. MIT Press, Vancouver, British Columbia, Canada (2005)
Sun, Y., et al.: Circle loss: a unified perspective of pair similarity optimization. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6397–6406 (2020)
Movshovitz-Attias, Y., Toshev, A., Leung, T.K., Ioffe, S., Singh, S.: No fuss distance metric learning using proxies. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 360–368 (2017)
Wang, X., Han, X., Huang, W., Dong, D., Scott, M.R.: Multi-similarity loss with general pair weighting for deep metric learning. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5017–5025 (2019)
Musgrave, K., Belongie, S., Lim, S.-N.: Pytorch metric learning. arXiv preprint arXiv:2008.09164 (2020)
Maslej-Krešňáková, V., Sarnovský, M., Butka, P., Machová, K.: Comparison of deep learning models and various text pre-processing techniques for the toxic comments classification. Appl. Sci. (Basel) 10, 8631 (2020)
McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)
Acknowledgements
This work was supported by Thailand Science Research and Innovation Fund and King Mongkut’s Institute of Technology Ladkrabang (KMITL), Thailand. We acknowledge with thanks to The Cancer Imaging Archive (TCIA) for their publicly available dataset.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Naing, K.M., Kittichai, V., Tongloy, T., Chuwongin, S., Boonsang, S. (2023). Images Retrieval and Classification for Acute Myeloid Leukemia Blood Cell Using Deep Metric Learning. In: Nguyen, N.T., et al. Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2023. Communications in Computer and Information Science, vol 1863. Springer, Cham. https://doi.org/10.1007/978-3-031-42430-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-42430-4_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42429-8
Online ISBN: 978-3-031-42430-4
eBook Packages: Computer ScienceComputer Science (R0)