Skip to main content

MorphSet: Improving Renal Histopathology Case Assessment Through Learned Prognostic Vectors

  • Conference paper
  • First Online:
  • 8780 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12908))

Abstract

Computer Aided Diagnosis (CAD) systems for renal histopathology applications aim to understand and replicate nephropathologists’ assessments of individual morphological compartments (e.g. glomeruli) to render case-level histological diagnoses. Deep neural networks (DNNs) hold great promise in addressing the poor intra- and interobserver agreement between pathologists. This being said, the generalization ability of DNNs heavily depends on the quality and quantity of training labels. Current “consensus” labeling strategies require multiple pathologists to evaluate every compartment unit over thousands of crops, resulting in enormous annotative costs. Additionally, these techniques fail to address the underlying reproducibility issues we observe across various diagnostic feature assessment tasks. To address both of these limitations, we introduce MorphSet, an end-to-end architecture inspired by Set Transformers which maps the combined encoded representations of Monte Carlo (MC) sampled glomerular compartment crops to produce Whole Slide Image (WSI) predictions on a case basis without the need for expensive fine-grained morphological feature labels. To evaluate performance, we use a kidney transplant Antibody Mediated Rejection (AMR) dataset, and show that we are able to achieve 98.9% case level accuracy, outperforming the consensus label baseline. Finally, we generate a visualization of prediction confidence derived from our MC evaluation experiments, which provides physicians with valuable feedback.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Labelbox, labelbox, online (2020). https://labelbox.com

  2. Bankhead, P., et al.: QuPath: open source software for digital pathology image analysis. bioRxiv (2017). https://doi.org/10.1101/099796, https://www.biorxiv.org/content/early/2017/03/06/099796

  3. Barisoni, L., et al.: Digital pathology imaging as a novel platform for standardization and globalization of quantitative nephropathology. Clin. Kidney J. 10(2), 176–187 (2017). https://doi.org/10.1093/ckj/sfw129

    Article  Google Scholar 

  4. Cicalese, P.A., Mobiny, A., Shahmoradi, Z., Yi, X., Mohan, C., Van Nguyen, H.: Kidney level lupus nephritis classification using uncertainty guided Bayesian convolutional neural networks. IEEE J. Biomed. Health Inform. 25(2), 315–324 (2021). https://doi.org/10.1109/JBHI.2020.3039162

    Article  Google Scholar 

  5. Haas, M., et al.: Consensus definitions for glomerular lesions by light and electron microscopy: recommendations from a working group of the Renal Pathology Society. Kidney Int. 98(5), 1120–1134 (2020). https://doi.org/10.1016/j.kint.2020.08.006

    Article  Google Scholar 

  6. Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., Saltz, J.H.: Patch-based convolutional neural network for whole slide tissue image classification (2016)

    Google Scholar 

  7. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  8. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR arXiv:1502.03167 (2015)

  9. Lee, J., Lee, Y., Kim, J., Kosiorek, A., Choi, S., Teh, Y.W.: Set transformer: a framework for attention-based permutation-invariant neural networks. In: International Conference on Machine Learning, pp. 3744–3753. PMLR (2019)

    Google Scholar 

  10. Liapis, G., Singh, H.K., Derebail, V.K., Gasim, A.M.H., Kozlowski, T., Nickeleit, V.: Diagnostic significance of peritubular capillary basement membrane multilaminations in kidney allografts: old concepts revisited. Transplantation 94(6), 620–629 (2012)

    Article  Google Scholar 

  11. Roufosse, C., et al.: A 2018 reference guide to the Banff classification of renal allograft pathology. Transplantation 102(11), 1795–1814 (2018)

    Article  Google Scholar 

  12. Smith, B., et al.: A method to reduce variability in scoring antibody-mediated rejection in renal allografts: implications for clinical trials - a retrospective study. Transpl. Int. 32(2), 173–183 (2019). https://doi.org/10.1111/tri.13340

    Article  Google Scholar 

  13. Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: Chaudhuri, K., Salakhutdinov, R. (eds.) Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 97, pp. 6105–6114. PMLR, June 2019. http://proceedings.mlr.press/v97/tan19a.html

  14. Uchino, E., et al.: Classification of glomerular pathological findings using deep learning and nephrologist-AI collective intelligence approach. Int. J. Med. Inform. 141, 104231 (2020)

    Article  Google Scholar 

  15. Vaswani, A., et al.: Attention is all you need (2017)

    Google Scholar 

  16. Xu, Y., Mo, T., Feng, Q., Zhong, P., Lai, M., Chang, E.I.: Deep learning of feature representation with multiple instance learning for medical image analysis. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1626–1630 (2014). https://doi.org/10.1109/ICASSP.2014.6853873

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pietro Antonio Cicalese .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cicalese, P.A. et al. (2021). MorphSet: Improving Renal Histopathology Case Assessment Through Learned Prognostic Vectors. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12908. Springer, Cham. https://doi.org/10.1007/978-3-030-87237-3_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87237-3_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87236-6

  • Online ISBN: 978-3-030-87237-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics