Skip to main content

Realistic Evaluation of FixMatch on Imbalanced Medical Image Classification Tasks

  • Conference paper
  • First Online:
Bildverarbeitung für die Medizin 2022

Part of the book series: Informatik aktuell ((INFORMAT))

  • 1503 Accesses

Zusammenfassung

Semi-supervised learning offers great potential for medical image analysis, as it reduces the annotation burden for clinicians. In this work, we apply the state-of-the-art method FixMatch to chest X-ray and retinal image datasets. Our comparison with the supervised-only method is based on a fair hyperparameter tuning budget and includes label imbalance in the labeled set, thus simulating a practical evaluation setup. We find that unlabeled data can be used effectively for the retinal images, especially when using additional methods to counteract label imbalance in the unsupervised loss. In experiments with CheXpert, however, FixMatch does not provide substantial gains.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Literatur

  1. Sohn K, Berthelot D, Li CL, Zhang Z, Carlini N, Cubuk ED et al. Fixmatch: simplifying semi-supervised learning with consistency and confidence. ArXiv. 2020.

    Google Scholar 

  2. Liu Q, Yu L, Luo L, Dou Q, Heng PA. Semi-supervised medical image classification with relation-driven self-ensembling model. IEEE Trans Med Imaging. 2020;39(11):3429–40.

    Google Scholar 

  3. Gyawali PK, Ghimire S, Bajracharya P, Li Z, Wang L. Semi-supervised medical image classification with global latent mixing. Med Image Comput Comput Assist Interv. Springer. 2020:604–13.

    Google Scholar 

  4. Irvin J, Rajpurkar P, Ko M, Yu Y, Ciurea-Ilcus S, Chute C et al. Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. Proc Conf AAAI Artif Intell. Vol. 33. (01). 2019:590–7.

    Google Scholar 

  5. Kaggle. Diabetic retinopathy detection [online]. 2015.

    Google Scholar 

  6. Voets M, Møllersen K, Bongo LA. Reproduction study using public data of: development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. PloS one. 2019;14(6):e0217541.

    Google Scholar 

  7. Johnson JM, Khoshgoftaar TM. Survey on deep learning with class imbalance. J Big Data. 2019;6(1):27.

    Google Scholar 

  8. Berthelot D, Carlini N, Cubuk ED, Kurakin A, Sohn K, Zhang H et al. Remixmatch: semisupervised learning with distribution alignment and augmentation anchoring. ArXiv. 2019.

    Google Scholar 

  9. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2016.

    Google Scholar 

  10. Kingma DP, Ba J. Adam: a method for stochastic optimization. ArXiv. 2014.

    Google Scholar 

  11. Cubuk ED, Zoph B, Shlens J, Le QV. RandAugment: practical automated data augmentation with a reduced search space. ArXiv. 2019.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maximilian Zenk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zenk, M., Zimmerer, D., Isensee, F., Jäger, P.F., Wasserthal, J., Maier-Hein, K. (2022). Realistic Evaluation of FixMatch on Imbalanced Medical Image Classification Tasks. In: Maier-Hein, K., Deserno, T.M., Handels, H., Maier, A., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2022. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-36932-3_61

Download citation

Publish with us

Policies and ethics