Skip to main content
SpringerLink
Log in

Modern convolutional object detectors for nuclei detection on pleural effusion cytology images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nuclei detection is a crucial step in the cell-based analysis of a wide range of pathological images. It is also the basis of many automated methods such as cell counting, segmentation, and tracking. Nevertheless, it is seen as a challenging task because the nuclei display variability of size, shape, orientation and intensity and number of nuclei. In recent years, a variety of Convolutional Neural Network (CNN) based object detectors have been proposed. Although these methods have demonstrated superior success in different object detection problems, they have not yet been used for nuclei detection on pathology images. The main contributions of this work are: 1) We propose the first implementation of the faster region-based convolutional neural network (Faster R-CNN), the region-based fully convolutional network (R-FCN), and the single shot multibox detector (SSD) methods for nuclei detection on pathology images. These methods are viewed as ‘modern convolutional object detectors’. 2) We present a novel database of pleural effusion cytology images. We used proposed object detectors with different ‘feature extractors’ such as Residual Network (ResNet), Inception v2, and MobileNet for performance comparison. Experiments show that all these object detectors using different feature extractors achieve remarkable detection speed and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, et al. (2016) Tensorflow: large-scale machine learning on heterogeneous distributed systems. arXiv:160304467

  2. Albarqouni S, Baur C, Achilles F, Belagiannis V, Demirci S, Navab N (2016) Aggnet: deep learning from crowds for mitosis detection in breast cancer histology images. IEEE Trans Med Imaging 35(5):1313–1321

    Article  Google Scholar 

  3. Baykal E, Doğan H, Ekinci M, Ercin ME, Ersöz Ş (2017) Automated nuclei detection in serous effusion cytology based on machine learning. In: Signal processing and communications applications conference (SIU), 2017 25th. IEEE, pp 1–4

  4. Baykal E, Doğan H, Ercin ME, Ersöz Ş, Ekinci M (2018) Automated nuclei detection in serous effusion cytology with stacked sparse autoencoders. In: Signal processing and communications applications conference (SIU), 2018 26th. IEEE, pp 1–4

  5. Cakir E, Demirag F, Aydin M, Unsal E (2009) Cytopathologic differential diagnosis of malignant mesothelioma, adenocarcinoma and reactive mesothelial cells: a logistic regression analysis. Diagn Cytopathol 37(1):4–10

    Article  Google Scholar 

  6. Cireşan DC, Giusti A, Gambardella LM, Schmidhuber J (2013) Mitosis detection in breast cancer histology images with deep neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 411–418

  7. Dai KJ, R-fcn YL (2016) Object detection via region-based fully convolutional networks. NIPS

  8. Davidson B, Firat P, Michael CW (2011) Serous effusions: etiology. Prognosis and Therapy. Springer Science & Business Media, Diagnosis

    Google Scholar 

  9. DeBiasi EM, Pisani MA, Murphy TE, Araujo K, Kookoolis A, Argento AC, Puchalski J (2015) Mortality among patients with pleural effusion undergoing thoracentesis. Eur Respir J 46(2):495–502

    Article  Google Scholar 

  10. Everingham M, Van Gool L, Williams C, Winn J, Zisserman A (2012) The pascal visual object classes challenge 2012 results. See http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html, vol 5

  11. Girshick R (2015) Fast r-cnn. arXiv:150408083

  12. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587

  13. Greenspan H, Van Ginneken B, Summers RM (2016) Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique. IEEE Trans Med Imaging 35(5):1153–1159

    Article  Google Scholar 

  14. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  15. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv:170404861

  16. Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S, et al. (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In: IEEE CVPR

  17. Irshad H (2013) Automated mitosis detection in histopathology using morphological and multi-channel statistics features. Journal of Pathology Informatics: 4

  18. Kashif MN, Raza SEA, Sirinukunwattana K, Arif M, Rajpoot N (2016) Handcrafted features with convolutional neural networks for detection of tumor cells in histology images. In: 2016 IEEE 13th international symposium on biomedical imaging (ISBI). IEEE, pp 1029–1032

  19. Lezoray O, Elmoataz A, Cardot H (2003) A color object recognition scheme: application to cellular sorting. Mach Vis Appl 14(3):166–171

    Article  Google Scholar 

  20. Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, pp 740–755

  21. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: single shot multibox detector. In: European conference on computer vision. Springer, pp 21–37

  22. Malekmehr D (2018) California pleural effusion. http://www.treatpleuraleffusion.com/pleural-effusion-water-in-the-lungs-los-angeles-ca/, Accessed 12-August-2018

  23. Marel M, Zrutova M, Stasny B, Light RW (1993) The incidence of pleural effusion in a well-defined region: epidemiologic study in central Bohemia. Chest 104 (5):1486–1489

    Article  Google Scholar 

  24. Mufidah R, Wasito I, Hanifah N, Faturrahman M, Ghaisani FD (2017) Automatic nucleus detection of pap smear images using stacked sparse autoencoder (ssae). In: Proceedings of the international conference on algorithms, computing and systems. ACM, pp 9–13

  25. Normalization B (2015) Accelerating deep network training by reducing internal covariate shift

  26. Paliy I, Lamonaca F, Turchenko V, Grimaldi D, Sachenko A (2010) Micro nucleus detection in human lymphocytes using convolutional neural network. In: International conference on artificial neural networks. Springer, pp 521–530

  27. Papanicolaou GN (1942) A new procedure for staining vaginal smears. Science 95(2469):438–439

    Article  Google Scholar 

  28. Rathod V, Neal W (2017) Tensorflow detection model zoo. https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo.md, Accessed 12-April-2018

  29. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788

  30. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99

  31. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  32. Schneider TE, Bell AA, Meyer-Ebrecht D, Böcking A, Aach T (2007) Computer-aided cytological cancer diagnosis: cell type classification as a step towards fully automatic cancer diagnostics on cytopathological specimens of serous effusions. In: Medical Imaging 2007: Computer-Aided Diagnosis, International Society for Optics and Photonics, vol 6514, p 65140G

  33. Sheaff MT, Singh N (2012) Cytopathology: an introduction. Springer, Berlin

    Google Scholar 

  34. Sheppard C, Wilson T (1978) Depth of field in the scanning microscope. Optics Lett 3(3):115–117

    Article  Google Scholar 

  35. Shidham VB, Atkinson BF (2007) Cytopathologic diagnosis of serous fluids e-book. Elsevier Health Sciences

  36. Shotton DM (1989) Confocal scanning optical microscopy and its applications for biological specimens. J Cell Sci 94(2):175–206

    Google Scholar 

  37. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:14091556

  38. Sirinukunwattana K, Raza SEA, Tsang YW, Snead DR, Cree IA, Rajpoot NM (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 35(5):1196–1206

    Article  Google Scholar 

  39. Song TH, Sanchez V, EIDaly H, Rajpoot NM (2017) Hybrid deep autoencoder with curvature gaussian for detection of various types of cells in bone marrow trephine biopsy images. In: 2017 IEEE 14th international symposium on biomedical imaging (ISBI 2017). IEEE, pp 1040–1043

  40. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  41. Von Ahn L, Dabbish L (2008) Designing games with a purpose. Commun ACM 51(8):58–67

    Article  Google Scholar 

  42. Xie Y, Xing F, Shi X, Kong X, Su H, Yang L (2018) Efficient and robust cell detection: a structured regression approach. Med Image Anal 44:245–254

    Article  Google Scholar 

  43. Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A (2016) Stacked sparse autoencoder (ssae) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging 35(1):119–130

    Article  Google Scholar 

Download references

Acknowledgements

This work has fully been supported by the TUBITAK Research Project 117E961.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Karadeniz Technical University, Trabzon, 61080, Turkey

    Elif Baykal, Hulya Dogan & Murat Ekinci

  2. Department of Pathology and Faculty of Medicine, Karadeniz Technical University, Trabzon, 61080, Turkey

    Mustafa Emre Ercin & Safak Ersoz

Authors
  1. Elif Baykal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hulya Dogan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mustafa Emre Ercin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Safak Ersoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Murat Ekinci
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elif Baykal.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Baykal, E., Dogan, H., Ercin, M.E. et al. Modern convolutional object detectors for nuclei detection on pleural effusion cytology images. Multimed Tools Appl 79, 15417–15436 (2020). https://doi.org/10.1007/s11042-019-7461-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7461-3

Keywords

Search

Navigation