Abstract
Annotated images for rare disease diagnosis are extremely hard to collect. Therefore, identifying rare diseases based on scarce amount of data is of far-reaching significance. Existing methods target only at rare diseases diagnosis, while neglect to preserve the performance of common disease diagnosis. To address this issue, we first disentangle the features of common diseases into a disease-shared part and a disease-specific part, and then employ the disease-shared features alone to enrich rare-disease features, without interfering the discriminability of common diseases. In this paper, we propose a new setting, i.e., generalized rare disease diagnosis to simultaneously diagnose common and rare diseases. A novel selective treasure sharing (STS) framework is devised under this setting, which consists of a gradient-induced disentanglement (GID) module and a distribution-targeted calibration (DTC) module. The GID module disentangles the common-disease features into disease-shared channels and disease-specific channels based on the gradient agreement across different diseases. Then, the DTC module employs only disease-shared channels to enrich rare-disease features via distribution calibration. Hence, abundant rare-disease features are generated to alleviate model overfitting and ensure a more accurate decision boundary. Extensive experiments conducted on two medical image classification datasets demonstrate the superior performance of the proposed STS framework.
Y. Chen—This work was done when Yuanyuan Chen was a visiting student at the Department of Electrical Engineering, City University of Hong Kong.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Afrasiyabi, A., Lalonde, J.-F., Gagné, C.: Associative alignment for few-shot image classification. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12350, pp. 18–35. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58558-7_2
Ali, S., Bhattarai, B., Kim, T.-K., Rittscher, J.: Additive angular margin for few shot learning to classify clinical endoscopy images. In: Liu, M., Yan, P., Lian, C., Cao, X. (eds.) MLMI 2020. LNCS, vol. 12436, pp. 494–503. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59861-7_50
Cai, J., et al.: Deep lesion tracker: monitoring lesions in 4D longitudinal imaging studies. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 15159–15169 (2021)
Chen, Y., Xia, Y.: Iterative sparse and deep learning for accurate diagnosis of Alzheimer’s disease. Pattern Recogn. 116, 107944 (2021)
Gao, H., Shou, Z., Zareian, A., Zhang, H., Chang, S.F.: Low-shot learning via covariance-preserving adversarial augmentation networks. In: In Advances in Neural Information Processing Systems (NeurlPS), pp. 981–991 (2018)
Guo, X., Yang, C., Liu, Y., Yuan, Y.: Learn to threshold: thresholdnet with confidence-guided manifold mixup for polyp segmentation. IEEE Trans. Med. Imaging 40(4), 1134–1146 (2021)
Li, K., Zhang, Y., Li, K., Fu, Y.: Adversarial feature hallucination networks for few-shot learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13470–13479 (2020)
Li, X., Zhong, Z., Wu, J., Yang, Y., Lin, Z., Liu, H.: Expectation-maximization attention networks for semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9167–9176 (2019)
Li, X., Yu, L., Jin, Y., Fu, C.-W., Xing, L., Heng, P.-A.: Difficulty-aware meta-learning for rare disease diagnosis. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12261, pp. 357–366. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59710-8_35
Mai, S., Li, Q., Zhao, Q., Gao, M.: Few-shot transfer learning for hereditary retinal diseases recognition. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12908, pp. 97–107. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87237-3_10
Mangla, P., Kumari, N., Sinha, A., Singh, M., Krishnamurthy, B., Balasubramanian, V.N.: Charting the right manifold: manifold mixup for few-shot learning. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 2218–2227 (2020)
Mansilla, L., Echeveste, R., Milone, D.H., Ferrante, E.: Domain generalization via gradient surgery. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6630–6638 (2021)
Marrakchi, Y., Makansi, O., Brox, T.: Fighting class imbalance with contrastive learning. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12903, pp. 466–476. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87199-4_44
Pan, Y., Liu, M., Xia, Y., Shen, D.: Disease-image-specific learning for diagnosis-oriented neuroimage synthesis with incomplete multi-modality data. IEEE Trans. Pattern Anal. Mach. Intell. (2021). https://doi.org/10.1109/TPAMI.2021.3091214
Paul, A., Tang, Y., Shen, T.C., Summers, R.M.: Discriminative ensemble learning for few-shot chest x-ray diagnosis. Med. Image Anal. 68, 101911 (2021)
Pogorelov, K., et al: A multi-class image dataset for computer aided gastrointestinal disease detection. In: Proceedings of the 8th ACM on Multimedia Systems Conference, pp. 164–169 (2017)
Schwartz, E., et al.: \(\delta \)-encoder: an effective sample synthesis method for few-shot object recognition. In: International Conference on Neural Information Processing Systems (NIPS), pp. 2850–2860 (2018)
Sun, J., Wei, D., Ma, K., Wang, L., Zheng, Y.: Unsupervised representation learning meets pseudo-label supervised self-distillation: a new approach to rare disease classification. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12905, pp. 519–529. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87240-3_50
Wang, Y., Zhang, R., Zhang, S., Li, M., Xia, Y., Zhang, X., Liu, S.: Domain-specific suppression for adaptive object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9603–9612 (2021)
Xing, X., Hou, Y., Li, H., Yuan, Y., Li, H., Meng, M.Q.-H.: Categorical relation-preserving contrastive knowledge distillation for medical image classification. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12905, pp. 163–173. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87240-3_16
Yang, S., Liu, L., Xu, M.: Free lunch for few-shot learning: distribution calibration. In: International Conference on Learning Representations (ICLR) (2021)
Zagoruyko, S., Komodakis, N.: Wide residual networks. arXiv preprint arXiv:1605.07146 (2016)
Zhang, C., Cai, Y., Lin, G., Shen, C.: Deepemd: few-shot image classification with differentiable earth mover’s distance and structured classifiers. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 12203–12213 (2020)
Zhang, J., Xie, Y., Xia, Y., Shen, C.: Dodnet: learning to segment multi-organ and tumors from multiple partially labeled datasets. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1195–1204 (2021)
Zhu, W., Li, W., Liao, H., Luo, J.: Temperature network for few-shot learning with distribution-aware large-margin metric. Pattern Recogn. 112, 107797 (2021)
Acknowledgement
This work was supported in part by the National Natural Science Foundation of China under Grants 62171377, in part by the Key Research and Development Program of Shaanxi Province under Grant 2022GY-084, in part by Hong Kong Research Grants Council (RGC) Early Career Scheme grant 21207420 (CityU 9048179), and in part by Hong Kong RGC Collaborative Research Fund grant C4063-18G (CityU 8739029).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, Y., Guo, X., Xia, Y., Yuan, Y. (2022). Disentangle Then Calibrate: Selective Treasure Sharing for Generalized Rare Disease Diagnosis. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13433. Springer, Cham. https://doi.org/10.1007/978-3-031-16437-8_49
Download citation
DOI: https://doi.org/10.1007/978-3-031-16437-8_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16436-1
Online ISBN: 978-3-031-16437-8
eBook Packages: Computer ScienceComputer Science (R0)
