Skip to main content
SpringerLink
Log in

Improved DeepMitosisNet framework for detection of mitosis in histopathology images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Mitosis detection in the histopathology images is one of the important prognostic factors that is helpful for cancer grading. Mitosis counting from whole slide images is challenging due to shape variations and stain variations. The key to solving the issue is to find more discriminative features corresponding to object boundaries and other similar objects like lymphocytes, cells with dense nuclei, and various soft tissues with the same grey level. However, small mitotic cells are difficult to detect using traditional machine learning methods. In this paper, we present an improved deep learning combined teaching learning-based optimizer (TLBO) model called DeepMitosisNet for accurate detection of mitotic figures. The proposed model helps reduce misclassification rates and computational costs. Comprehensive experiments are performed on the MITOS-ATYPIA 14 dataset for both Aperio and Hamamatsu scanners. The proposed model achieved an F-score of 96%, precision of 93.7% and recall of 98%, showing that the proposed deep framework with TLBO shows substantial improvements over other state-of-the-art mitosis detection techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Algorithm 2
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The datasets generated during and/or analyzed during the current study are available in the https://mitos-atypia-14.grand-challenge.org/Donwload/ repository.

References

  1. Albayrak A, Bilgin G (2016) Mitosis detection using convolutional neural network based features. In: 2016 IEEE 17th international symposium on computational intelligence and informatics (CINTI). https://doi.org/10.1109/cinti.2016.7846429

  2. Babatunde O, Armstrong L, Leng J et al (2014) A genetic algorithm-based feature selection. Int J Electr Commun Comput Eng 5:889–905

    Google Scholar 

  3. Barlow PW (1977) Changes in chromatin structure during the mitotic cycle. Protoplasma 91(2):207–211. https://doi.org/10.1007/bf01276735

    Article  Google Scholar 

  4. Beevi KS, Nair MS, Bindu GR (2017) A multi-classifier system for automatic mitosis detection in breast histopathology images using deep belief networks. IEEE J Transl Eng Health Med 5:1–11. https://doi.org/10.1109/jtehm.2017.2694004

    Article  Google Scholar 

  5. Beevi KS, Nair MS, Bindu G (2019) Automatic mitosis detection in breast histopathology images using convolutional neural network based deep transfer learning. Biocybern Biomed Eng 39(1):214–223. https://doi.org/10.1016/j.bbe.2018.10.007

    Article  Google Scholar 

  6. Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828. https://doi.org/10.1109/tpami.2013.50

    Article  Google Scholar 

  7. Boyle P, Levin B et al (2008) World cancer report 2008. IARC Press, International Agency for Research on Cancer

    Google Scholar 

  8. Ciresan D, Giusti A, Gambardella L et al (2012) Deep neural networks segment neuronal membranes in electron microscopy images. In: Pereira F, Burges C, Bottou L et al (eds) Advances in neural information processing systems, vol 25. Curran Associates, Inc., p 2843–2851. https://proceedings.neurips.cc/paper_files/paper/2012/file/459a4ddcb586f24efd9395aa7662bc7c-Paper.pdf

  9. Ciresan DC, Meier U, Masci J et al (2011) Flexible, high performance convolutional neural networks for image classification. In: Walsh T (ed) IJCAI 2011, Proceedings of the 22nd international joint conference on artificial intelligence, Barcelona, Catalonia, Spain, July 16-22, 2011. IJCAI/AAAI, pp 1237–1242. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-210

  10. Cruz-Roa AA, Ovalle JEA, Madabhushi A et al (2013) A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection. In: Advanced Information systems engineering. Springer, Berlin Heidelberg, pp 403–410. https://doi.org/10.1007/978-3-642-40763-5_50

  11. Das DK, Dutta PK (2019) Efficient automated detection of mitotic cells from breast histological images using deep convolution neutral network with wavelet decomposed patches. Comput Biol Med 104:29–42. https://doi.org/10.1016/j.compbiomed.2018.11.001

    Article  Google Scholar 

  12. Elston C, Ellis I (1991) Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19(5):403–410. https://doi.org/10.1111/j.1365-2559.1991.tb00229.x

  13. Gandomkar Z, Brennan PC, Mello-Thoms C (2017) Determining image processing features describing the appearance of challenging mitotic figures and miscounted nonmitotic objects. J Pathol Inform 8(1):34. https://doi.org/10.4103/jpi.jpi_22_17

    Article  Google Scholar 

  14. Gonzalez RC (2009) Digital image processing. Pearson Education India

  15. He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/cvpr.2016.90

  16. Irshad H, Jalali S, Roux L et al (2013) Automated mitosis detection using texture, SIFT features and HMAX biologically inspired approach. J Pathol Inform 4(2):12. https://doi.org/10.4103/2153-3539.109870

    Article  Google Scholar 

  17. Irshad H, Gouaillard A, Roux L et al (2014) Spectral band selection for mitosis detection in histopathology. In: 2014 IEEE 11th international symposium on biomedical imaging (ISBI). https://doi.org/10.1109/isbi.2014.6868110

  18. Kaushal C, Bhat S, Koundal D et al (2019) Recent trends in computer assisted diagnosis (CAD) system for breast cancer diagnosis using histopathological images. IRBM 40(4):211–227. https://doi.org/10.1016/j.irbm.2019.06.001

    Article  Google Scholar 

  19. Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  Google Scholar 

  20. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444. https://doi.org/10.1038/nature14539

    Article  Google Scholar 

  21. Li C, Wang X, Liu W et al (2018) DeepMitosis: Mitosis detection via deep detection, verification and segmentation networks. Med Image Anal 45:121–133. https://doi.org/10.1016/j.media.2017.12.002

    Article  Google Scholar 

  22. Loukas C, Kostopoulos S, Tanoglidi A et al (2013) Breast cancer characterization based on image classification of tissue sections visualized under low magnification. Computat Math Methods Med 2013:1–7. https://doi.org/10.1155/2013/829461

    Article  MathSciNet  Google Scholar 

  23. Mahmood T, Arsalan M, Owais M et al (2020) Artificial intelligence-based mitosis detection in breast cancer histopathology images using faster R-CNN and deep CNNs. J Clin Med 9(3):749. https://doi.org/10.3390/jcm9030749

    Article  Google Scholar 

  24. Maroof N, Khan A, Qureshi SA et al (2020) Mitosis detection in breast cancer histopathology images using hybrid feature space. Photodiagnosis Photodyn Ther 31:101885. https://doi.org/10.1016/j.pdpdt.2020.101885

    Article  Google Scholar 

  25. Mathew T, Kini JR, Rajan J (2021) Computational methods for automated mitosis detection in histopathology images: a review. Biocybern Biomed Eng 41(1):64–82. https://doi.org/10.1016/j.bbe.2020.11.005

    Article  Google Scholar 

  26. Grand Challenge MITOSATYPIA14 (2014) Mitos-atypia-14.grand-challenge.org. https://mitos-atypia-14.grand-challenge.org/Donwload/. Accessed 25 Jun 2023

  27. Moradi P, Gholampour M (2016) A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. Appl Soft Comput 43:117–130. https://doi.org/10.1016/j.asoc.2016.01.044

    Article  Google Scholar 

  28. Nassif AB, Talib MA, Nasir Q et al (2022) Breast cancer detection using artificial intelligence techniques: A systematic literature review. Artif Intell Med 127:102276. https://doi.org/10.1016/j.artmed.2022.102276

    Article  Google Scholar 

  29. Nateghi R, Danyali H, Helfroush MS et al (2014a) Intelligent CAD system for automatic detection of mitotic cells from breast cancer histology slide images based on teaching-learning-based optimization. Computat Biol J 2014:1–9. https://doi.org/10.1155/2014/970898

    Article  Google Scholar 

  30. Nateghi R, Danyali H, SadeghHelfroush M et al (2014b) Automatic detection of mitosis cell in breast cancer histopathology images using genetic algorithm. In: 2014 21th Iranian conference on biomedical engineering (ICBME). https://doi.org/10.1109/icbme.2014.7043883

  31. Nateghi R, Danyali H, Helfroush MS (2021) A deep learning approach for mitosis detection: Application in tumor proliferation prediction from whole slide images. Artif Intell Med 114:102048. https://doi.org/10.1016/j.artmed.2021.102048

    Article  Google Scholar 

  32. Pan X, Lu Y, Lan R et al (2021) Mitosis detection techniques in \(h\) &\(e\) stained breast cancer pathological images: a comprehensive review. Comput Electr Eng 91:107038. https://doi.org/10.1016/j.compeleceng.2021.107038

    Article  Google Scholar 

  33. Paul A, Mukherjee DP (2015) Mitosis detection for invasive breast cancer grading in histopathological images. IEEE Trans Image Process 24(11):4041–4054. https://doi.org/10.1109/tip.2015.2460455

    Article  MathSciNet  Google Scholar 

  34. Rao R, Savsani V, Vakharia D (2011) Teaching-learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput-Aided Des 43(3):303–315. https://doi.org/10.1016/j.cad.2010.12.015

    Article  Google Scholar 

  35. Rao RV, Patel V (2012) An elitist teaching-learning-based optimization algorithm for solving complex constrained optimization problems. Int J Ind Eng Computat 3(4):535–560. https://doi.org/10.5267/j.ijiec.2012.03.007

    Article  Google Scholar 

  36. Rao S (2018) Mitos-RCNN: A novel approach to mitotic figure detection in breast cancer histopathology images using region based convolutional neural networks. arXiv:1807.01788

  37. Rehman MU, Akhtar S, Zakwan M et al (2022) Novel architecture with selected feature vector for effective classification of mitotic and non-mitotic cells in breast cancer histology images. Biomed Signal Process Control 71:103212. https://doi.org/10.1016/j.bspc.2021.103212

    Article  Google Scholar 

  38. Ren S, He K, Girshick R et al (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149. https://doi.org/10.1109/tpami.2016.2577031

    Article  Google Scholar 

  39. Saha M, Chakraborty C, Racoceanu D (2018) Efficient deep learning model for mitosis detection using breast histopathology images. Comput Med Imaging Graph 64:29–40. https://doi.org/10.1016/j.compmedimag.2017.12.001

    Article  Google Scholar 

  40. Smith RD, Mallath MK (2019) History of the growing burden of cancer in india: From antiquity to the 21st century. J Glob Oncol 5:1–15. https://doi.org/10.1200/jgo.19.00048

    Article  Google Scholar 

  41. Sohail A, Khan A, Wahab N et al (2021) A multi-phase deep CNN based mitosis detection framework for breast cancer histopathological images. Sci Rep 11(1). https://doi.org/10.1038/s41598-021-85652-1

  42. Szegedy C, Ioffe S, Vanhoucke V et al (2017) Inception-v4, inception-ResNet and the impact of residual connections on learning. Proc AAAI Conf Artif Intell 31(1). https://doi.org/10.1609/aaai.v31i1.11231

  43. Tashk A, Helfroush MS, Danyali H et al (2013) An automatic mitosis detection method for breast cancer histopathology slide images based on objective and pixel-wise textural features classification. In: The 5th conference on information and knowledge technology. https://doi.org/10.1109/ikt.2013.6620101

  44. Tashk A, Helfroush M, Danyali H et al (2014) A novel CAD system for mitosis detection using histopathology slide images. J Med Signals Sensors 4(2):139. https://doi.org/10.4103/2228-7477.130493

    Article  Google Scholar 

  45. Tashk A, Helfroush MS, Danyali H et al (2015) Automatic detection of breast cancer mitotic cells based on the combination of textural, statistical and innovative mathematical features. Appl Math Modell 39(20):6165–6182. https://doi.org/10.1016/j.apm.2015.01.051

    Article  MathSciNet  Google Scholar 

  46. Ustuner M, Bilgin G (2015) Mitosis detection on histopathological images using statistical detection algorithms. In: 2015 23nd signal processing and communications applications conference (SIU). https://doi.org/10.1109/siu.2015.7129880

  47. Vo DM, Nguyen NQ, Lee SW (2019) Classification of breast cancer histology images using incremental boosting convolution networks. Inf Sci 482:123–138. https://doi.org/10.1016/j.ins.2018.12.089

    Article  Google Scholar 

  48. Wahab N, Khan A, Lee YS (2017) Two-phase deep convolutional neural network for reducing class skewness in histopathological images based breast cancer detection. Comput Biol Med 85:86–97. https://doi.org/10.1016/j.compbiomed.2017.04.012

    Article  Google Scholar 

  49. Wahab N, Khan A, Lee YS (2019) Transfer learning based deep CNN for segmentation and detection of mitoses in breast cancer histopathological images. Microscopy 68(3):216–233. https://doi.org/10.1093/jmicro/dfz002

    Article  Google Scholar 

  50. Wan T, Zhang W, Zhu M et al (2017) Automated mitosis detection in histopathology based on non-Gaussian modeling of complex wavelet coefficients. Neurocomputing 237:291–303. https://doi.org/10.1016/j.neucom.2017.01.008

    Article  Google Scholar 

  51. Wang H, Cruz-Roa A, Basavanhally A et al (2014a) Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection. In: Gurcan MN, Madabhushi A (eds) SPIE proceedings, SPIE. https://doi.org/10.1117/12.2043902

  52. Wang H, Cruz-Roa A, Basavanhally A et al (2014b) Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features. J Med Imag 1(3):034003. https://doi.org/10.1117/1.jmi.1.3.034003

    Article  Google Scholar 

  53. Wang M, Wu C, Wang L et al (2019) A feature selection approach for hyperspectral image based on modified ant lion optimizer. Knowl-Based Syst 168:39–48. https://doi.org/10.1016/j.knosys.2018.12.031

    Article  Google Scholar 

  54. Yosinski J, Clune J, Bengio Y et al (2014) How transferable are features in deep neural networks? In: Proceedings of the 27th international conference on neural information processing systems - volume 2. MIT Press, Cambridge, MA, USA, NIPS’14, pp 3320–3328

  55. Yu Y, Lin H, Yu Q et al (2015) Modality classification for medical images using multiple deep convolutional neural networks. J Computat Inform Syst 11:5403–5413

    Google Scholar 

Download references

Author information

Author notes

  1. Anand S, Vivek Raja P.S, and Selvakumar B contributed equally to this work.

Authors and Affiliations

  1. Department of Computer Science and Engineering, Mepco Schlenk Engineering College, Sivakasi, 626005, Tamilnadu, India

    Lakshmanan B & Selvakumar B

  2. Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, 626005, Tamilnadu, India

    Anand S

  3. Nexstem, Wilmington, DE, USA

    Vivek Raja P.S

Authors
  1. Lakshmanan B
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anand S
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vivek Raja P.S
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Selvakumar B
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lakshmanan B.

Ethics declarations

Ethical Statement

The authors assure that this work is the outcome of the research work and it has not been published elsewhere and that it has not been submitted simultaneously for publication elsewhere.

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

B, L., S, A., P.S, V.R. et al. Improved DeepMitosisNet framework for detection of mitosis in histopathology images. Multimed Tools Appl 83, 43303–43324 (2024). https://doi.org/10.1007/s11042-023-16830-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16830-8

Keywords

Search

Navigation