Abstract
The use of modern approaches based on convolutional neural networks (CNNs) for segmentation of whole slide images (WSIs) helps pathologists obtain more stable and quantitative analysis results and improve diagnosis objectivity. But working with WSIs is extremely difficult due to their resolution, size and the presence of a large number of incompatible image storage formats from equipment manufacturers. In addition, the use of modern CNN-based image analysis methods is complicated by the need to use a set of tools with a low level of internal integration.
In order to facilitate the interaction of histologists with whole slide images and modern image analysis methods we implemented PathScribe – a new universal cross-platform cloud-based tool for comfortable viewing and manipulating large collections of WSIs on almost any device, including tablets and smartphones.
We also consider the important problem of automatic tissue type recognition on WSIs and propose a new CNN-based method of automatic tissue type recognition on WSIs with a 2 subsets of PATH-DT-MSU dataset which contain high-quality whole slide images of digestive tract tumors with tissue type area annotations.
The proposed method achieved 0.929 accuracy on CRC-VAL-HE-7K dataset (9 classes) and 0.97 accuracy on PATH-DT-MSU-WSS1, WSS2 datasets (5 classes). The developed method allows to classify the areas corresponding to the gastric own mucous glands in the lamina propria and distinguish the tubular structures of a highly differentiated gastric adenocarcinoma with normal glands.
Supported by RSCF and Non-commercial Foundation for the Advancement of Science and Education INTELLECT.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pathscribe - a new cross-platform software tool for viewing, annotation and automatic analysis of whole slide histological images (2022). https://pathscribe.ru
Ali, L., et al.: Digital assessment of depth of invasion in melanoma using different immunohistochemical stains. Archives of the Balkan Medical Union 55(2), 290–297 (2020)
Borovec, J., et al.: Anhir: automatic non-rigid histological image registration challenge. IEEE Trans. Med. Imaging 39(10), 3042–3052 (2020)
Chen, Y., et al.: The immune subtypes and landscape of gastric cancer and to predict based on the whole-slide images using deep learning. Front. immunol. 12 (2021)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Kather, J.N., Halama, N., Marx, A.: 100,000 histological images of human colorectal cancer and healthy tissue (v0.1) (2018). https://doi.org/10.5281/zenodo.1214456
Kather, J.N., et al.: Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study. PLoS Med. 16(1), e1002730 (2019)
Khvostikov, A., Krylov, A.S., Mikhailov, I., Malkov, P.: CNN assisted hybrid algorithm for medical images segmentation. In: Proceedings of the 2020 5th International Conference on Biomedical Signal and Image Processing, pp. 14–19 (2020)
Khvostikov, A., Krylov, A.S., Mikhailov, I., Malkov, P.: Visualization of whole slide histological images with automatic tissue type recognition. Pattern Recognit Image Anal. 32(3), 483–488 (2022)
Kumar, N., Gupta, R., Gupta, S.: Whole slide imaging (wsi) in pathology: current perspectives and future directions. J. Digit. Imaging 33(4), 1034–1040 (2020)
Mikhailov, I., Khvostikov, A., Krylov, A., Malkov, P., Danilova, N., Oleynikova, N.: Development of cnn-based algorithm for automatic recognition of the layers of the wall of the stomach and colon. In: Virchows Archiv, vol. 479, pp. S36–S37. Springer One New York Plaza, Suite 4600, New York, Ny, United States (2021)
Patel, A.: Contemporary whole slide imaging devices and their applications within the modern pathology department: A selected hardware review. J. Pathology Inform. 12(1), 50 (2021)
Salvi, M., Acharya, U.R., Molinari, F., Meiburger, K.M.: The impact of pre-and post-image processing techniques on deep learning frameworks: A comprehensive review for digital pathology image analysis. Comput. Biol. Med. 128, 104129 (2021)
Song, J.H., Hong, Y., Kim, E.R., Kim, S.H., Sohn, I.: Utility of artificial intelligence with deep learning of hematoxylin and eosin-stained whole slide images to predict lymph node metastasis in t1 colorectal cancer using endoscopically resected specimens; prediction of lymph node metastasis in t1 colorectal cancer. J. Gastroenterol., 1–13 (2022)
Wang, X., et al.: Predicting gastric cancer outcome from resected lymph node histopathology images using deep learning. Nat. Commun. 12(1), 1–13 (2021)
Acknowledgements
The scientific part of the work was supported by Russian Science Foundation grant 22-41-02002, the PathScribe development as the educational tool is funded by Non-commercial Foundation for the Advancement of Science and Education INTELLECT.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this paper
Cite this paper
Khvostikov, A., Krylov, A., Mikhailov, I., Malkov, P. (2023). Visualization and Analysis of Whole Slide Histological Images. In: Rousseau, JJ., Kapralos, B. (eds) Pattern Recognition, Computer Vision, and Image Processing. ICPR 2022 International Workshops and Challenges. ICPR 2022. Lecture Notes in Computer Science, vol 13644. Springer, Cham. https://doi.org/10.1007/978-3-031-37742-6_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-37742-6_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-37741-9
Online ISBN: 978-3-031-37742-6
eBook Packages: Computer ScienceComputer Science (R0)
