Yijia Zeng
ABSTRACT
White matter (WM) tract segmentation is beneficial to brain research, which provides a valuable tool for analyzing brain development and disease. The introduction of convolutional neural networks (CNNs) has greatly improved the accuracy of WM tract segmentation. However, the training of CNNs usually requires extensive manual annotations of WM tracts, which are often difficult to obtain in practical applications. Therefore, in this study, we explore two methods to realize CNN-based WM tract segmentation when there are no manual annotations of WM tracts for the target dataset and improve the segmentation accuracy. The first method generates registration-based pseudo labels for the target dataset to train the WM tract segmentation network. Specifically, we register images of the publicly available annotated dataset to images of the unlabeled target dataset and improve the binarization strategy by taking advantage of the characteristics of registration and WM tracts to generate the soft labels of WM tracts for target dataset. Moreover, we propose the other method to construct loss weighted matrix for network training using the registration information, which reduces the impact of registration error and further improves the segmentation performance. We evaluated the proposed methods with two dMRI datasets. The results show that the proposed methods are effective in improving the segmentation performance of WM tracts when the manual annotations are unavailable.
- Michel Thiebaut De Schotten, Alberto Bizzi, Flavio Dell’Acqua, Matthew Allin, Muriel Walshe, Robin Murray, Steven C Williams, Declan GM Murphy, Marco Catani, 2011. Atlasing location, asymmetry and inter-subject variability of white matter tracts in the human brain with MR diffusion tractography. NeuroImage 54, 1 (2011), 49–59.Google Scholar
Cross Ref
- Eleftherios Garyfallidis, Marc-Alexandre Côté, Francois Rheault, Jasmeen Sidhu, Janice Hau, Laurent Petit, David Fortin, Stephen Cunanne, and Maxime Descoteaux. 2018. Recognition of white matter bundles using local and global streamline-based registration and clustering. NeuroImage 170(2018), 283–295.Google ScholarCross Ref
- James C Gee, Hui Zhang, Abraham Dubb, Brian B Avants, Paul A Yushkevich, and Jeffrey T Duda. 2006. Anatomy-based visualizations of diffusion tensor images of brain white matter. In Visualization and Processing of Tensor Fields. Springer, 155–163.Google Scholar
- Miguel Guevara, Claudio Román, Josselin Houenou, Delphine Duclap, Cyril Poupon, Jean François Mangin, and Pamela Guevara. 2017. Reproducibility of superficial white matter tracts using diffusion-weighted imaging tractography. NeuroImage 147(2017), 703–725.Google ScholarCross Ref
- Gordon J Harris, Patrick E Barta, Luon W Peng, Seong Lee, Paul D Brettschneider, Amish Shah, Jeffery D Henderer, Thomas E Schlaepfer, and Godfrey D Pearlson. 1994. MR volume segmentation of gray matter and white matter using manual thresholding: dependence on image brightness.American Journal of Neuroradiology 15, 2 (1994), 225–230.Google Scholar
- Fraser Henderson, Kalil G Abdullah, Ragini Verma, and Steven Brem. 2020. Tractography and the connectome in neurosurgical treatment of gliomas: the premise, the progress, and the potential. Neurosurgical Focus 48, 2 (2020), E6.Google ScholarCross Ref
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).Google Scholar
- Bo Li, Marius De Groot, Rebecca ME Steketee, Rozanna Meijboom, Marion Smits, Meike W Vernooij, M Arfan Ikram, Jiren Liu, Wiro J Niessen, and Esther E Bron. 2020. Neuro4Neuro: A neural network approach for neural tract segmentation using large-scale population-based diffusion imaging. NeuroImage 218(2020), 116993.Google ScholarCross Ref
- Lauren J O’Donnell and Ofer Pasternak. 2015. Does diffusion MRI tell us anything about the white matter? An overview of methods and pitfalls. Schizophrenia Research 161, 1 (2015), 133–141.Google ScholarCross Ref
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019).Google Scholar
- Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 234–241.Google ScholarCross Ref
- David C Van Essen, Stephen M Smith, Deanna M Barch, Timothy EJ Behrens, Essa Yacoub, Kamil Ugurbil, Wu-Minn HCP Consortium, 2013. The WU-Minn human connectome project: an overview. NeuroImage 80(2013), 62–79.Google ScholarCross Ref
- Jakob Wasserthal, Peter Neher, and Klaus H Maier-Hein. 2018. TractSeg-Fast and accurate white matter tract segmentation. NeuroImage 183(2018), 239–253.Google ScholarCross Ref
- Jakob Wasserthal, Peter F Neher, Dusan Hirjak, and Klaus H Maier-Hein. 2019. Combined tract segmentation and orientation mapping for bundle-specific tractography. Medical Image Analysis 58 (2019), 101559.Google ScholarCross Ref
- Ye Wu, Yoonmi Hong, Sahar Ahmad, Weili Lin, Dinggang Shen, Pew-Thian Yap, UNC/UMN Baby Connectome Project Consortium, 2020. Tract dictionary learning for fast and robust recognition of fiber bundles. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 251–259.Google ScholarDigital Library
- Chuyang Ye, Zhen Yang, Sarah H Ying, and Jerry L Prince. 2015. Segmentation of the cerebellar peduncles using a random forest classifier and a multi-object geometric deformable model: application to spinocerebellar ataxia type 6. Neuroinformatics 13, 3 (2015), 367–381.Google ScholarCross Ref
- Jason D Yeatman, Robert F Dougherty, Elena Rykhlevskaia, Anthony J Sherbondy, Gayle K Deutsch, Brian A Wandell, and Michal Ben-Shachar. 2011. Anatomical properties of the arcuate fasciculus predict phonological and reading skills in children. Journal of Cognitive Neuroscience 23, 11 (2011), 3304–3317.Google ScholarDigital Library
- Fan Zhang, Suheyla Cetin Karayumak, Nico Hoffmann, Yogesh Rathi, Alexandra J Golby, and Lauren J O’Donnell. 2020. Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation. Medical Image Analysis 65 (2020), 101761.Google ScholarCross Ref
Index Terms
- Improved White Matter Tract Segmentation for Unannotated Dataset
Recommendations
Multimodality white matter tract segmentation using CNN
ACM TURC '19: Proceedings of the ACM Turing Celebration Conference - ChinaDiffusion-weighted MRI tractography combining with fiber clustering is a typical approaches of white matter tract segmentation. However, due to the anatomical accuracy of the diffusion-weighted images (DWI) and complicated processing procedure, this ...
White Matter Tract Segmentation with Self-supervised Learning
Medical Image Computing and Computer Assisted Intervention – MICCAI 2020AbstractWhite matter tract segmentation based on diffusion magnetic resonance imaging (dMRI) plays an important role in brain analysis. Deep learning based methods of white matter tract segmentation have been proposed to improve the segmentation accuracy. ...
One-Shot Segmentation of Novel White Matter Tracts via Extensive Data Augmentation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2022AbstractDeep learning based methods have achieved state-of-the-art performance for automated white matter (WM) tract segmentation. In these methods, the segmentation model needs to be trained with a large number of manually annotated scans, which can be ...
Comments