Abstract
The unification of electronic health records promises interoperability of medical data. Divergent data storage options, inconsistent naming schemes, varied annotation procedures, and disparities in label quality, among other factors, pose significant challenges to the integration of expansive datasets especially across instiutions. This is particularly evident in the emerging multi-modal learning paradigms where dataset harmonization is of paramount importance. Leveraging the DICOMstandard,we designed a data integration and filter tool that streamlines the creation of multi-modal datasets. This ensures that datasets from various locations consistently maintain a uniform structure. We enable the concurrent filtering of DICOMdata (i.e. images andwaveforms) and corresponding annotations (i.e. segmentations and structured reports) in a graphical user interface. The graphical interface as well as example structured report templates is openly available at https://github.com/Cardio-AI/fl-multi-modal-dataset-creation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Noumeir R. Benefits of the DICOM structured report. J Digit Imaging. 2006;16(4):295–306.
Rieke N, Hancox J, Li W, Milletarì F, Roth HR, Albarqouni S et al. The future of digital health with federated learning. NPJ Digit Med. 2020;3(119):2398–6352.
Bridge C, Gorman C, Pieper S, Doyle S, Lennerz J, Kalpathy-Cramer J et al. Highdicom: a python library for standardized encoding of image annotations and machine learning model outputs in pathology and radiology. J Digit Imaging. 2022;35(6):1719–37.
Scherer J, Nolden M, Kleesiek J, Metzger J, Kades K, Schneider V et al. Joint imaging platform for federated clinical data analytics. JCO Clin Cancer Inform. 2020;4:1027–38.
Moor M, Banerjee O, Hossein Abad ZS, Krumholz HM, Leskovec J, Topol EJ et al. Foundation models for generalist medical artificial intelligence. Nature. 2023;616(7956):259–65.
Seidler T, Tölle M, André F, Bannas P, Frey N, Friedrich S et al. Federated learning of TAVI outcomes (FLOTO): A collaborative multi-center deep learning initiative. Clin Res Cardiol. 2022.
Nobel M, Geel K van, Robben S. Structured reporting in radiology: a systematic review to explore its potential. Eur Radiol. 2022;32:2837–54.
Clunie DA. DICOM structured reporting. Bangor: PixelMed, 2000.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Tölle, M., Burger, L., Kelm, H., Engelhardt, S. (2024). Towards Unified Multi-modal Dataset Creation for Deep Learning Utilizing Structured Reports. In: Maier, A., Deserno, T.M., Handels, H., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2024. BVM 2024. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-44037-4_39
Download citation
DOI: https://doi.org/10.1007/978-3-658-44037-4_39
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-44036-7
Online ISBN: 978-3-658-44037-4
eBook Packages: Computer Science and Engineering (German Language)