Abstract
Deep learning-based megapixel image classifiers have exceptional prediction performance in a number of domains, including clinical pathology. However, extracting reliable, human-interpretable model explanations has remained challenging. Because real-world megapixel images often contain latent image features highly correlated with image labels, it is difficult to distinguish correct explanations from incorrect ones. Furthering this issue are the flawed assumptions and designs of today’s classifiers. To investigate classification and explanation performance, we introduce a framework to (a) generate synthetic control images that reflect common properties of megapixel images and (b) evaluate average test-set correctness. By benchmarking two commonplace Convolutional Neural Networks (CNNs), we demonstrate how this interpretability evaluation framework can inform architecture selection beyond classification performance—in particular, we show that a simple Attention-based architecture identifies salient objects in all seven scenarios, while a standard CNN fails to do so in six scenarios. This work carries widespread applicability to any megapixel imaging domain .
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Achanta, R., Estrada, F., Wils, P., Süsstrunk, S.: Salient region detection and segmentation. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 66–75. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-79547-6_7
Adadi, A., Berrada, M.: Peeking inside the Black-Box: a survey on explainable artificial intelligence (XAI). IEEE Access 6, 52138–52160 (2018)
Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., Kim, B.: Sanity checks for saliency maps (2020)
Amann, J., Blasimme, A., Vayena, E., Frey, D., Madai, V.I.: Precise4Q consortium: explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med. Inform. Decis. Mak. 20(1), 310 (2020)
Amores, J.: Multiple instance classification: review, taxonomy and comparative study. Artif. Intell. 201, 81–105 (2013)
Anonymous: Patches are all you need? In: Submitted to The Tenth International Conference on Learning Representations (2022). https://openreview.net/forum?id=TVHS5Y4dNvM. under review
Arazo, E., Ortego, D., Albert, P., O’Connor, N.E., McGuinness, K.: Pseudo-labeling and confirmation bias in deep semi-supervised learning. arXiv:1908.02983 [cs], June 2020. arXiv: 1908.02983
Arun, N., et al.: Assessing the (un)trustworthiness of saliency maps for localizing abnormalities in medical imaging. bioRxiv, July 2020
Bartol, K., Bojanić, D., Pribanić, T., Petković, T., Donoso, Y.D., Mas, J.S.: On the comparison of classic and deep keypoint detector and descriptor methods. arXiv, July 2020
Berry, S., et al.: Analysis of multispectral imaging with the AstroPath platform informs efficacy of PD-1 blockade. Science 372(6547) (2021)
Black, S., et al.: CODEX multiplexed tissue imaging with DNA-conjugated antibodies. Nat. Protoc. 16, 3802–3835 (2021)
Bommasani, R., et al.: On the opportunities and risks of foundation models. arXiv, August 2021
Borji, A., Cheng, M.-M., Hou, Q., Jiang, H., Li, J.: Salient object detection: a survey. Comput. Vis. Media 5(2), 117–150 (2019). https://doi.org/10.1007/s41095-019-0149-9
Brunner, G., Liu, Y., Pascual, D., Richter, O., Ciaramita, M., Wattenhofer, R.: On identifiability in transformers. arXiv, August 2019
Burges, C.J.C.: MNIST handwritten digit database, Yann LeCun, Corinna Cortes and Chris Burges. https://yann.lecun.com/exdb/mnist/. Accessed 20 July 2022
Bándi, P., et al.: From detection of individual metastases to classification of lymph node status at the patient level: the CAMELYON17 challenge. IEEE Trans. Med. Imaging 38(2), 550–560 (2019). https://doi.org/10.1109/TMI.2018.2867350
Campanella, G., et al.: Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat. Med. 25(8), 1301 (2019)
Carbonneau, M.A., Cheplygina, V., Granger, E., Gagnon, G.: Multiple instance learning: a survey of problem characteristics and applications. arXiv, December 2016
Caron, M., et al.: Emerging properties in self-supervised vision transformers. arXiv, April 2021
Chan, L., Hosseini, M., Rowsell, C., Plataniotis, K., Damaskinos, S.: HistoSegNet: semantic segmentation of histological tissue type in whole slide images. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, October 2019
Chefer, H., Gur, S., Wolf, L.: Transformer interpretability beyond attention visualization. arXiv, December 2020
Chevrier, S., et al.: An immune atlas of clear cell renal cell carcinoma. Cell 169(4), 736-749.e18 (2017). https://doi.org/10.1016/j.cell.2017.04.016
Choe, J., Oh, S.J., Lee, S., Chun, S., Akata, Z., Shim, H.: Evaluating weakly supervised object localization methods right. arXiv, January 2020
Coffey, V.C.: Multispectral imaging moves into the mainstream. Opt. Photonics News 23(4), 18 (2012)
Cohen, T.S., Welling, M.: Group equivariant convolutional networks. arXiv, February 2016
Cruz-Roa, A., Arévalo, J., Judkins, A., Madabhushi, A., González, F.: A method for medulloblastoma tumor differentiation based on convolutional neural networks and transfer learning. In: 11th International Symposium on Medical Information Processing and Analysis, vol. 9681, p. 968103. International Society for Optics and Photonics, December 2015. https://doi.org/10.1117/12.2208825. https://www.spiedigitallibrary.org/conference-proceedings-of-spie/9681/968103/A-method-for-medulloblastoma-tumor-differentiation-based-on-convolutional-neural/10.1117/12.2208825.short
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893 (2005). https://doi.org/10.1109/CVPR.2005.177
Das, A., Rad, P.: Opportunities and challenges in explainable artificial intelligence (XAI). A survey. arXiv, June 2020
Du, M., Liu, N., Hu, X.: Techniques for interpretable machine learning. arXiv, July 2018
Echle, A., Rindtorff, N.T., Brinker, T.J., Luedde, T., Pearson, A.T., Kather, J.N.: Deep learning in cancer pathology: a new generation of clinical biomarkers. Br. J. Cancer 124(4), 686–696 (2020)
Fan, D.P., Cheng, M.M., Liu, Y., Li, T., Borji, A.: Structure-measure: a new way to evaluate foreground maps. arXiv, August 2017
Fan, D.P., Gong, C., Cao, Y., Ren, B., Cheng, M.M., Borji, A.: Enhanced-alignment measure for binary foreground map evaluation. arXiv, May 2018
Frintrop, S., García, G.M., Cremers, A.B.: A cognitive approach for object discovery. In: 2014 22nd International Conference on Pattern Recognition, pp. 2329–2334, August 2014
Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F.A., Brendel, W.: ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness. arXiv, November 2018
Ghafoorian, M., et al.: Location sensitive deep convolutional neural networks for segmentation of white matter hyperintensities. Sci. Rep. 7(1), 5110 (2017)
Giesen, C., et al.: Highly multiplexed imaging of tumor tissues with subcellular resolution by mass cytometry. Nat. Methods 11(4), 417–422 (2014). https://doi.org/10.1038/nmeth.2869
Goltsev, Y., et al.: Deep profiling of mouse splenic architecture with CODEX multiplexed imaging. Cell 174(4), 968–981.e15 (2018)
Gupta, A.K., Seal, A., Prasad, M., Khanna, P.: Salient object detection techniques in computer vision-a survey. Entropy 22(10) (2020)
Gurcan, M.N., Boucheron, L., Can, A., Madabhushi, A., Rajpoot, N., Yener, B.: Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2, 147–171 (2009). https://doi.org/10.1109/RBME.2009.2034865. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2910932/
Halicek, M., et al.: Head and neck cancer detection in digitized Whole-Slide histology using convolutional neural networks. Sci. Rep. 9(1), 14043 (2019)
Harris, C.R., et al.: Quantifying and correcting slide-to-slide variation in multiplexed immunofluorescence images, July 2021
Hickey, J.W., et al.: Spatial mapping of protein composition and tissue organization: a primer for multiplexed antibody-based imaging. arXiv, July 2021
Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., Saltz, J.H.: Patch-based convolutional neural network for whole slide tissue image classification. arXiv:1504.07947 [cs], March 2016. arXiv: 1504.07947
Huang, H., Chen, Z., Rudin, C.: SegDiscover: visual concept discovery via unsupervised semantic segmentation. arXiv, April 2022
Huttenlocher, D., Klanderman, G., Rucklidge, W.: Comparing images using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15(9), 850–863 (1993). https://doi.org/10.1109/34.232073
Ilse, M., Tomczak, J.M., Welling, M.: Attention-based deep multiple instance learning. arXiv, February 2018
Jacovi, A., Goldberg, Y.: Towards faithfully interpretable NLP systems: how should we define and evaluate faithfulness? arXiv, April 2020
Jaderberg, M., Simonyan, K., Zisserman, A., Kavukcuoglu, K.: Spatial transformer networks. arXiv:1506.02025 [cs], February 2016. arXiv: 1506.02025
Jean, N., Burke, M., Xie, M., Davis, W.M., Lobell, D.B., Ermon, S.: Combining satellite imagery and machine learning to predict poverty. Science 353(6301), 790–794 (2016)
Jean, N., Wang, S., Samar, A., Azzari, G., Lobell, D., Ermon, S.: Tile2Vec: unsupervised representation learning for spatially distributed data. arXiv, May 2018
Jetley, S., Lord, N.A., Lee, N., Torr, P.H.S.: Learn to pay attention. arXiv, April 2018
Jiang, Y., Yang, M., Wang, S., Li, X., Sun, Y.: Emerging role of deep learning-based artificial intelligence in tumor pathology. Cancer Commun. 40(4), 154–166 (2020)
Kandemir, M., Hamprecht, F.A.: Computer-aided diagnosis from weak supervision: a benchmarking study. Comput. Med. Imaging Graph. 42, 44–50 (2015)
Kao, P.Y., et al.: Improving patch-based convolutional neural networks for MRI brain tumor segmentation by leveraging location information. Front. Neurosci. 13, 1449 (2019)
Kawamura, Y., et al.: Histological and immunohistochemical evaluation of stroma variations and their correlation with the KI-67 index and expressions of glucose transporter 1 and monocarboxylate transporter 1 in canine thyroid C-cell carcinomas. J. Vet. Med. Sci. 78(4), 607–612 (2016)
Kim, B., Reif, E., Wattenberg, M., Bengio, S., Mozer, M.C.: Neural networks trained on natural scenes exhibit gestalt closure. arXiv, March 2019
Kim, B., Seo, J., Jeon, S., Koo, J., Choe, J., Jeon, T.: Why are saliency maps noisy? Cause of and solution to noisy saliency maps. arXiv, February 2019
Kitaev, N., Kaiser, L., Levskaya, A.: Reformer: the efficient transformer. arXiv:2001.04451 [cs, stat], February 2020. arXiv: 2001.04451
Klevesath, M.B., Bobrow, L.G., Pinder, S.E., Purushotham, A.D.: The value of immunohistochemistry in sentinel lymph node histopathology in breast cancer. Br. J. Cancer 92(12), 2201–2205 (2005)
van der Laak, J., Ciompi, F., Litjens, G.: No pixel-level annotations needed. Nat. Biomed. Eng. 3(11), 855–856 (2019)
Lähnemann, D., et al.: Eleven grand challenges in single-cell data science. Genome Biol. 21(1), 31 (2020)
LeCun, Y., Bottou, L., Bengio, Y., Ha, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 46 (1998)
Lerousseau, M., Vakalopoulou, M., Deutsch, E., Paragios, N.: SparseconvMIL: sparse convolutional context-aware multiple instance learning for whole slide image classification. In: COMPAY 2021: The Third MICCAI Workshop on Computational Pathology (2021). https://openreview.net/forum?id=3byhkJb8FUj
Lewis, S.M., et al.: Spatial omics and multiplexed imaging to explore cancer biology. Nat. Methods 18, 997–1012 ((2021)
Li, X.H., et al.: Quantitative evaluations on saliency methods: an experimental study. arXiv, December 2020
Liebel, L., Körner, M.: Auxiliary tasks in multi-task learning. arXiv, May 2018
Linardatos, P., Papastefanopoulos, V., Kotsiantis, S.: Explainable AI: a review of machine learning interpretability methods. Entropy 23(1) (2020)
Lipton, Z.C.: The mythos of model interpretability. arXiv, June 2016
Litjens, G., et al.: 1399 H &E-stained sentinel lymph node sections of breast cancer patients: the CAMELYON dataset. Gigascience 7(6) (2018)
Liu, Y., Zhuang, B., Shen, C., Chen, H., Yin, W.: Auxiliary learning for deep multi-task learning. arXiv, September 2019
Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. arXiv, March 2021
Lu, M.Y., Williamson, D.F.K., Chen, T.Y., Chen, R.J., Barbieri, M., Mahmood, F.: Data-efficient and weakly supervised computational pathology on whole-slide images. Nat. Biomed. Eng. 55, 555–570 (2021)
Marcos, D., Volpi, M., Tuia, D.: Learning rotation invariant convolutional filters for texture classification. arXiv, April 2016
Matos, L.L.D., Trufelli, D.C., de Matos, M.G.L., da Silva Pinhal, M.A.: Immunohistochemistry as an important tool in biomarkers detection and clinical practice. Biomark. Insights 5, 9–20 (2010)
Molnar, C., Casalicchio, G., Bischl, B.: Interpretable machine learning - a brief history, State-of-the-Art and challenges. arXiv, October 2020
Nathanson, S.D.: Insights into the mechanisms of lymph node metastasis. Cancer 98(2), 413–423 (2003). https://doi.org/10.1002/cncr.11464
Nazeri, K., Aminpour, A., Ebrahimi, M.: Two-stage convolutional neural network for breast cancer histology image classification. arXiv:1803.04054 [cs] 10882, pp. 717–726 (2018). https://doi.org/10.1007/978-3-319-93000-881. arXiv: 1803.04054
Nguyen, A., Yosinski, J., Clune, J.: Deep neural networks are easily fooled: high confidence predictions for unrecognizable images. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 427–436. IEEE, Boston, June 2015. https://doi.org/10.1109/CVPR.2015.7298640. https://ieeexplore.ieee.org/document/7298640/
Pesenson, M.Z., Pesenson, I.Z., McCollum, B.: The data big bang and the expanding digital universe: high-dimensional, complex and massive data sets in an inflationary epoch. Adv. Astron. 2010, 1–16 (2010). https://doi.org/10.1155/2010/350891. arXiv: 1003.0879
Raghu, M., Unterthiner, T., Kornblith, S., Zhang, C., Dosovitskiy, A.: Do vision transformers see like convolutional neural networks? arXiv, August 2021
Rahwan, I., et al.: Machine behaviour. Nature 568(7753), 477–486 (2019)
Ras, G., Xie, N., van Gerven, M., Doran, D.: Explainable deep learning: a field guide for the uninitiated. arXiv, April 2020
Ratner, A., De Sa, C., Wu, S., Selsam, D., Ré, C.: Data programming: creating large training sets, quickly. Adv. Neural. Inf. Process. Syst. 29, 3567–3575 (2016)
Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?”: explaining the predictions of any classifier. arXiv, February 2016
Robinson, J., Jegelka, S., Sra, S.: Strength from weakness: fast learning using weak supervision. arXiv, February 2020
Rost, S., Giltnane, J., Bordeaux, J.M., Hitzman, C., Koeppen, H., Liu, S.D.: Multiplexed ion beam imaging analysis for quantitation of protein expression in cancer tissue sections. Lab. Invest. 97(8), 992–1003 (2017)
Sakamoto, T., et al.: A narrative review of digital pathology and artificial intelligence: focusing on lung cancer. Transl. Lung Cancer Res. 9(5), 2255–2276 (2020)
Salvi, M., Acharya, U.R., Molinari, F., Meiburger, K.M.: The impact of pre- and post-image processing techniques on deep learning frameworks: a comprehensive review for digital pathology image analysis. Comput. Biol. Med. 128, 104129 (2021)
Schaumberg, A.J., et al.: Interpretable multimodal deep learning for real-time pan-tissue pan-disease pathology search on social media. Mod. Pathol. 33(11), 2169–2185 (2020)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. arXiv, October 2016
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. Int. J. Comput. Vis. 128(2), 336–359 (2020). https://doi.org/10.1007/s11263-019-01228-7. arXiv:1610.02391
Shaban, M., et al.: Context-aware convolutional neural network for grading of colorectal cancer histology images. IEEE Trans. Med. Imaging 39(7), 2395–2405 (2020)
Shamir, R.R., Duchin, Y., Kim, J., Sapiro, G., Harel, N.: Continuous dice coefficient: a method for evaluating probabilistic segmentations. arXiv, June 2019
Sharma, S., Kiros, R., Salakhutdinov, R.: Action recognition using visual attention. arXiv:1511.04119 [cs], February 2016. arXiv: 1511.04119
Simonyan, K., Vedaldi, A., Zisserman, A.: Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv:1312.6034 [cs], April 2014. arXiv: 1312.6034
Simonyan, K., Zisserman, A.: Very deep convolutional networks for Large-Scale image recognition. arXiv, September 2014
Sooriakumaran, P., Lovell, D.P., Henderson, A., Denham, P., Langley, S.E.M., Laing, R.W.: Gleason scoring varies among pathologists and this affects clinical risk in patients with prostate cancer. Clin. Oncol. 17(8), 655–658 (2005)
Palatnik de Sousa, I., Maria Bernardes Rebuzzi Vellasco, M., Costa da Silva, E.: Local interpretable model-agnostic explanations for classification of lymph node metastases. Sensors (Basel, Switzerland) 19(13) (2019). https://doi.org/10.3390/s19132969. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6651753/
Stamey, T.A., McNeal, J.E., Yemoto, C.M., Sigal, B.M., Johnstone, I.M.: Biological determinants of cancer progression in men with prostate cancer. JAMA 281(15), 1395–1400 (1999). https://doi.org/10.1001/jama.281.15.1395. http://jamanetwork.com/journals/jama/fullarticle/189523Association 7
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. arXiv:1512.00567 [cs], December 2015. arXiv: 1512.00567
Thompson, G.Z., Maitra, R.: CatSIM: a categorical image similarity metric. arXiv, April 2020
Tourniaire, P., Ilie, M., Hofman, P., Ayache, N., Delingette, H.: Attention-based multiple instance learning with mixed supervision on the camelyon16 dataset. In: COMPAY 2021: the third MICCAI Workshop on Computational Pathology (2021). https://openreview.net/forum?id=Z_L9j0HW3QM
Vaswani, A., et al.: Attention is all you need. arXiv, June 2017
Veeling, B.S., Linmans, J., Winkens, J., Cohen, T., Welling, M.: Rotation equivariant CNNs for digital pathology. arXiv:1806.03962 [cs, stat], June 2018. arXiv: 1806.03962
Vinuesa, R., Sirmacek, B.: Interpretable deep-learning models to help achieve the sustainable development goals. Nat. Mach. Intell. 3(11), 926–926 (2021)
Wagner, J., et al.: A single-cell atlas of the tumor and immune ecosystem of human breast cancer. Cell 177(5), 1330-1345.e18 (2019). https://doi.org/10.1016/j.cell.2019.03.005
Wang, D., Khosla, A., Gargeya, R., Irshad, H., Beck, A.H.: Deep learning for identifying metastatic breast cancer. arXiv:1606.05718 [cs, q-bio], June 2016. arXiv: 1606.05718
Wang, L., et al.: Learning to detect salient objects with image-level supervision. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, July 2017
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., Yang, R.: Salient object detection in the deep learning era: an in-depth survey. IEEE Trans. Pattern Anal. Mach. Intell. 44, 3239–3259 (2021)
Wang, Z., Bovik, A., Sheikh, H., Simoncelli, E.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004). https://doi.org/10.1109/TIP.2003.819861
Wen, S., et al.: Comparison of different classifiers with active learning to support quality control in nucleus segmentation in pathology images. AMIA Jt Summits Transl. Sci. Proc. 2017, 227–236 (2018)
Wilkinson, L., Anand, A., Grossman, R.: Graph-theoretic scagnostics. In: IEEE Symposium on Information Visualization 2005, INFOVIS 2005, pp. 157–164, October 2005
Xie, J., Xu, K., Li, Z., Bi, Q., Qin, K.: Building scene recognition based on deep multiple instance learning convolutional neural network using high resolution remote sensing image. In: Proceedings of the 2019 International Conference on Video, Signal and Image Processing, VSIP 2019, pp. 60–63. Association for Computing Machinery, New York, October 2019
Xu, H., Jiang, C., Liang, X., Li, Z.: Spatial-aware graph relation network for large-scale object detection. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2019
Yeh, C., et al.: Using publicly available satellite imagery and deep learning to understand economic well-being in Africa. Nat. Commun. 11(1), 2583 (2020)
Yildirim, G., Sen, D., Kankanhalli, M., Süsstrunk, S.: Evaluating salient object detection in natural images with multiple objects having multi-level saliency. arXiv, March 2020
Yurtsever, E., Lambert, J., Carballo, A., Takeda, K.: A survey of autonomous driving: common practices and emerging technologies. IEEE Access 8, 58443–58469 (2020)
Zhang, J.M., Harman, M., Ma, L., Liu, Y.: Machine learning testing: survey, landscapes and horizons. arXiv, June 2019
Zhang, J., Yu, X., Li, A., Song, P., Liu, B., Dai, Y.: Weakly-Supervised salient object detection via scribble annotations. arXiv, March 2020
Zhang, M., Sohoni, N.S., Zhang, H.R., Finn, C., Ré, C.: Correct-N-contrast: a contrastive approach for improving robustness to spurious correlations (2021)
Zhao, W., Du, S.: Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J. Photogramm. Remote. Sens. 113, 155–165 (2016)
Zhou, Z.H.: Multi-instance learning: a survey (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Machiraju, G., Plevritis, S., Mallick, P. (2022). A Dataset Generation Framework for Evaluating Megapixel Image Classifiers and Their Explanations. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T. (eds) Computer Vision – ECCV 2022. ECCV 2022. Lecture Notes in Computer Science, vol 13672. Springer, Cham. https://doi.org/10.1007/978-3-031-19775-8_25
Download citation
DOI: https://doi.org/10.1007/978-3-031-19775-8_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-19774-1
Online ISBN: 978-3-031-19775-8
eBook Packages: Computer ScienceComputer Science (R0)