Skip to main content
SpringerLink
Log in

Semi-supervised learning with deep convolutional generative adversarial networks for canine red blood cells morphology classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Information of Red Blood Cell (RBC) morphology, obtained by analysing RBC images, is regularly requested by veterinarians to diagnose anaemic dogs. Machine learning techniques have been exploited to speed up the image classification. Recently, many researchers used deep learning techniques for classification; however, a large quantity of labelled data is necessary to extract performance with them. A lack of annotated data, due to time and costs for pathologist and their limited numbers, has become a difficulty. This limits the amount of annotated data and leads to a large number of unannotated data, preventing traditional deep learning algorithms from being effective. We show that a semi-supervised learning method, using the Generative Adversarial Networks (GANs) for canine RBC morphology classification, can solve the lack of labelled data, when we want to train a deep learning classifier. Our semi-supervised GAN can use both labelled and unlabelled data and showed that they can achieve the same level of performance as a traditional convolutional neural network, with a smaller number of labelled images. Furthermore, we showed that augmenting the limited numbers of a labelled images enhanced the overall performance. A key benefit of our method is reduced pathologist cost and time to annotate cell images for developing a deep learning classifier.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bikhet SF, Darwish AM, Tolba HA, Shaheen SI (2000) Segmentation and classification of white blood cells. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing. (ICASSP 2000), 5-9 June 2000, Istanbul, Turkey, pp 2259–2261

  2. Brock A, Donahue J, Simonyan K (2018) Large scale GAN training for high fidelity natural image synthesis. arXiv:1809.11096

  3. Chapelle O, Scholkopf B, Zien A (2006) Semisupervised learning. Massachusetts Institute of Technology

  4. Cho J, Lee K, Shin E, Choy G, S Do (2015) How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? arXiv:1511.06348

  5. Chongxuan L, Xu T, Zhu J, Zhang B (2017) Triple generative adversarial nets. In: Proceedings of the advances in neural information processing systems (NIPS 2017), 4-9 December 2017, Long Beach, CA, USA, pp 4088–4098

  6. Cseke I (1992) A fast segmentation scheme for white blood cell images. In: Proceedings of the 11th international conference on pattern recognition (ICPR 1992), 30 August-1 September 1992, The Hague, Netherlands, pp 530–533

  7. Dai Z, Yang Z, Yang F, Cohen WW, Salakhutdinov RR (2017) Good semi-supervised learning that requires a bad GAN. In: Proceeding of the advances in neural information processing systems (NIPS 2017), 4-9 December 2017, Long Beach, CA, USA, pp 6510–6520

  8. Dong Y, Jiang Z, Shen H, Pan WD, Williams LA, Reddy VVB, Benjamin WH, Bryan AW (2017) Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells. In: Proceedings of the 2017 international conference on biomedical & health informatics (BHI 2017), 16-19 February 2017, Orlando, Florida, pp 101–104

  9. Dorini LB, Minetto R, Leite NJ (2007) White blood cell segmentation using morphological operators and scale-space analysis. In: Proceedings of the XX Brazilian symposium on computer graphics and image processing (SIBGRAPI 2007), 7-10 October 2007, Minas Gerais, Brazil, pp 294–304

  10. Ford J (2013) Red blood cell morphology. Int J Lab Hematol 35(3):351–357

    Article  Google Scholar 

  11. Goodfellow I, P-Abadie J, Mirza M, Xu B, Farley WD, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Proceedings of the advances in neural information processing systems (NIPS 2014), 8-13 December 2014, Montréal, Canada, pp 2672–2680

  12. Gregory TR (2000) Nucleotypic effects without nuclei: genome size and erythrocyte size in mammals. Genome 43:11

    Article  Google Scholar 

  13. Habibzadeh M, Jannesari M, Rezaei Z, Baharvand H, Totonchi M (2018) Automatic white blood cell classification using pre-trained deep learning models ResNet and inception. In: Proceedings of the 10th International Conference on Machine Vision (ICMV 2017), 13-15 November 2017, Vienna, Austria, vol 10696, p 1069612

  14. Hiremath PS, Bannigidad P, Geeta S (2010) Automated identification and classification of white blood cells (leukocytes) in digital microscopic images. IJCA Special Issue on Recent Trends in Image Processing and Pattern Recognition, 59–63

  15. Hou Q, Cheng M-M, Liu J, HS P, Webseg T (2018) Learning semantic segmentation from web searches. arXiv:1803.09859

  16. Jambhekar ND (2011) Red blood cells classification using image processing. Sci Res Reporter 1(3):151–154

    Google Scholar 

  17. Jin B, Ortiz Segovia MV, Susstrunk S (2017) Webly supervised semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2017), 21-26 July 2017, Honolulu, HI, USA, pp 3626–3635

  18. Kim KS, Kim PK, Song JJ, Park YC (2000) Analyzing blood cell image to distinguish its abnormalities. In: Proceedings of the 8th ACM international conference on multimedia (MM 2000), 30 October-3 November 2000, Los Angeles, CA, USA, pp 395–397

  19. Kingma DP, Welling M (2013) Auto-encoding variational Bayes. arXiv:1312.6114

  20. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2017), 21-26 July 2017, Honolulu, HI, USA, pp 4681–4690

  21. Li W, Wang Z, Li J, Polson J, Speier W, Arnold C (2019) Semi-supervised learning based on generative adversarial network: a comparison between good GAN and bad GAN approach. arXiv:1905.06484

  22. Li W, Wang Z, Yue Y, Li J, Speier W, Zhou M, Arnold CW (2019) Semi-supervised learning using adversarial training with good and bad samples. arXiv:1910.08540

  23. Maaløe L, Sønderby CK, Sønderby SK, Winther O (2016) Auxiliary deep generative models. arXiv:1602.05473

  24. Macawile MJ, Quiñones VV, Ballado A, Dela Cruz J, Caya MV (2018) White blood cell classification and counting using convolutional neural network. In: Proceedings of the 3rd international conference on control and robotics engineering (ICCRE 2018), 20-23 April 2018, Nagoya, Japan, pp 259–263

  25. Madani A, Moradi M, Karargyris A, Syeda-Mahmood T (2018) Semi-supervised learning with generative adversarial networks for chest x-ray classification with ability of data domain adaptation. In: Proceedings of the 15th international symposium on biomedical imaging (ISBI 2018), 4-7 April 2018, Washington, DC, USA, pp 1038–1042

  26. Malihi L, Ansari-Asl K, Behbahani A (2013) Malaria parasite detection in giemsa-stained blood cell images. In: Proceedings of the 8th Iranian conference on machine vision and image processing (MVIP 2013), 10-12 September 2013, Zanjan, Iran, pp 360–365

  27. Markiewicz T, Osowski S, Marianska B, Moszczynski L (2005) Automatic recognition of the blood cells of myelogenous leukemia using SVM. In: Proceedings of the IEEE international joint conference on neural networks (IJCNN 2005), 31 July-4 August 2005, Montreal, Canada, vol 4, pp 2496–2501

  28. Miyato T, Maeda S-i, Koyama M, Ishii S (2018) Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 41(8):1979–1993

    Article  Google Scholar 

  29. Odena A (2016) Semi-supervised learning with generative adversarial networks. arXiv:1606.01583

  30. Olmschenk G, Zhu Z, Tang H (2019) Generalizing semi-supervised generative adversarial networks to regression using feature contrasting. Comput Vis Image Underst 186:1–12

    Article  Google Scholar 

  31. Osowski S, Siroic R, Markiewicz T, Siwek K (2008) Application of support vector machine and genetic algorithm for improved blood cell recognition. IEEE Trans Instrum Meas 58(7):2159–2168

    Article  Google Scholar 

  32. Papandreou G, Chen L-C, Murphy KP, Yuille AL (2015) Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: Proceedings of the IEEE international conference on computer vision (ICCV 2015), 7-13 December 2015, Santiago, Chile, pp 1742–1750

  33. Pasupa K, Sunhem W (2016) A comparison between shallow and deep architecture classifiers on small dataset. In: Proceeding of the 8th international conference on information technology and electrical engineering (ICITEE 2016), 5-6 October 2016, Yogyakarta, Indonesia, pp 390–395

  34. Pasupa K, Vatathanavaro S, Tungjitnob S (2020) Convolutional neural networks based focal loss for class imbalance problem: a case study of canine red blood cells morphology classification. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-01773-x

  35. Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv:1712.04621

  36. Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv:1511.06434

  37. Rasmus A, Berglund M, Honkala M, Valpola H, Raiko T (2015) Semi-supervised learning with ladder networks. In: Proceedings of the advances in neural information processing systems (NIPS 2015), 7-12 December 2015, Montréal, Canada, pp 3546–3554

  38. Razzak MI, Naz S (2017) Microscopic blood smear segmentation and classification using deep contour aware CNN and extreme machine learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops (CVPR Workshop 2017), 21-26 July 2017, Honolulu, HI, USA, pp 801–807

  39. Razzak MI, Naz S, Zaib A (2018) Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps, volume 26 of lecture notes in computational vision and biomechanics, pp 323–350

  40. Salimans T, Goodfellow I, Zaremba W, Cheung V, Radford A, Chen X (2016) Improved techniques for training GANs. In: Proceeding of the advances in neural information processing systems (NIPS 2016), 5-10 December 2016, Barcelona, Spain, pp 2234–2242

  41. Shafique S, Tehsin S (2018) Acute lymphoblastic leukemia detection and classification of its subtypes using pretrained deep convolutional neural networks. Technol Cancer Res Treatment 17:1533033818802789

    Article  Google Scholar 

  42. Shahin AI, Guo Y, Amin KM, Sharawi AA (2017) White blood cells identification system based on convolutional deep neural learning networks. Comput Methods Programs Biomed 168:69–80

    Article  Google Scholar 

  43. Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):60

    Article  Google Scholar 

  44. Souly N, Spampinato C, Shah M (2017) Semi and weakly supervised semantic segmentation using generative adversarial network. arXiv:1703.09695

  45. Souly N, Spampinato C, Shah M (2017) Semi supervised semantic segmentation using generative adversarial network. In: Proceedings of the IEEE international conference on computer vision (ICCV 2017), 22-29 October 2017, Venice, Italy, pp 5688–5696

  46. Sricharan K, Bala R, Shreve M, Ding H, Saketh K, Sun J (2017) Semi-supervised conditional GANs. arXiv:1708.05789

  47. Taherisadr M, Nasirzonouzi M, Baradaran B, Mehdizade A (2013) New approch to red blood cell classification using morphological image processing. Shiraz E-Med J 14(1):44–53

    Google Scholar 

  48. Tai W-L, Hu R-M, Hsiao HCW, Chen R-M, Tsai JJP (2011) Blood cell image classification based on hierarchical SVM. In: Proceedings of the IEEE international symposium on multimedia (ISM 2011), 5-7 December 2011, Dana Point CA, USA, pp 129–136

  49. Tiwari P, Qian J, Li Q, Wang B, Gupta D, Khanna A, Rodrigues JJPC, de Albuquerque VHC (2018) Detection of subtype blood cells using deep learning. Cogn Syst Res 52:1036–1044

    Article  Google Scholar 

  50. Tomari R, Zakaria WNW, Jamil MMA, Nor FM, Fuad NFN (2014) Computer aided system for red blood cell classification in blood smear image. Procedia Comput Sci 42:206–213

    Article  Google Scholar 

  51. Tu Y, Lin Y, Wang J, Kim J-U (2018) Semi-supervised learning with generative adversarial networks on digital signal modulation classification. Comput Mater Continua 55(2):243–254

    Google Scholar 

  52. Ushizima DM, Lorena AC, De Carvalho ACPLF (2005) Support vector machines applied to white blood cell recognition. In: Proceedings of the international conference on hybrid intelligent systems (HIS 2005), 6-9 November 2005, Rio de Janeiro, Brazil, pp 1–6

  53. Walsh J, O’ Mahony N, Campbell S, Carvalho A, Krpalkova L, Velasco-Hernandez G, Harapanahalli S, Riordan D (2019) Deep learning vs. traditional computer vision. In: Proceedings of the computer vision conference (CVC 2019), 25-26 April 2019, Las Vegas, Nevada, United States, pp 128–144

  54. Weiss DJ, Wardrop KJ (2011) Schalm’s veterinary hematology. Wiley

  55. Weston J, Ratle F, Mobahi H, Collobert R (2012) Deep learning via semi-supervised embedding. In: Neural networks: tricks of the trade, volume 7700 of lecture note in computer science, pp 639–655

  56. Xu M, Papageorgiou DP, Abidi SZ, Dao M, Zhao H, Karniadakis GE (2017) A deep convolutional neural network for classification of red blood cells in sickle cell anemia PLoS. Comput Biol 13(10):e1005746

    Google Scholar 

  57. Yang Z, Cohen WW, Salakhutdinov R (2016) Revisiting semi-supervised learning with graph embeddings. arXiv:1603.08861

  58. Zhang H, Xu T, Li H, Zhang S, Wang X, Huang X, Metaxas DN (2017) StackGAN: text to photo-realistic image synthesis with stacked generative adversarial networks. In: Proceedings of the IEEE international conference on computer vision (ICCV 2017), 22-29 October 2017, Venice, Italy, pp 5907–5915

  59. Zhang H, Goodfellow I, Metaxas D, Odena A (2018) Self-attention generative adversarial networks. arXiv:1805.08318

  60. Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision (ICCV 2017), 22-29 October 2017, Venice, Italy, pp 2223–2232

Download references

Acknowledgements

We thank the Veterinary Teaching Hospital, Kasetsart University, Hua Hin, Thailand, for providing stained glass slides of peripheral blood smears and labelling the dataset. This research was supported by the Faculty of Information Technology, King Mongkut’s Institute of Technology Ladkrabang.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, King Mongkut’s Institute of Technology Ladkrabang, 10520, Bangkok, Thailand

    Kitsuchart Pasupa, Suchat Tungjitnob & Supawit Vatathanavaro

Authors
  1. Kitsuchart Pasupa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Suchat Tungjitnob
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Supawit Vatathanavaro
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kitsuchart Pasupa.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pasupa, K., Tungjitnob, S. & Vatathanavaro, S. Semi-supervised learning with deep convolutional generative adversarial networks for canine red blood cells morphology classification. Multimed Tools Appl 79, 34209–34226 (2020). https://doi.org/10.1007/s11042-020-08767-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08767-z

Keywords

Search

Navigation