ABSTRACT
Brain image parcellation is an important data processing step in neuroscience. Since multi-atlas based parcellation (MAP) uses prior information from brain atlases (i.e., manually labeled brain regions), it can provide accurate brain parcellation and has been widely adopted. Recently, some deep learning based brain image parcellation (DLP) methods using fully convolutional network (FCN) have been proposed. Compared with MAP, DLP has high computational efficiency, making it more applicable in practice. However, existing DLP methods either neglect or partially utilize brain atlases, making it difficult to get comparable parcellation accuracy as MAP. In this paper, we propose a new DLP method which is able to use brain atlases in an effective way. The network is based on FCN and non-local block based channel attention module (NL module). The input of our network is the target brain image to be parcellated as well as available brain atlases, and the parcellation result is produced through the FCN guided by the features of brain atlases selected by NL modules at different scales. In the experiments using two public MR brain image datasets (LPBA40 and NIREP-NA0), our method outperforms MAP and the state-of-the-art DLP methods due to the effective usage of brain atlases.
- Rolf A. Heckemann, Joseph V. Hajnal, Paul Aljabar, Daniel Rueckert, and Alexander Hammersc. 2006. Automatic anatomical brain mri segmentation combining label propagation and decision fusion. In Neuroimage. 115–126.Google Scholar
- Juan Eugenio Iglesias and Mert Rory Sabuncu. 2015. Multi-Atlas Segmentation of Biomedical Images: A Survey. arXiv preprint arXiv:1412.3421 (2015).Google Scholar
- Long, Jonathan, E. Shelhamer, and T. Darrell. 2014. Fully Convolutional Networks for Semantic Segmentation. arXiv preprint arXiv:1411.4038 (2014)Google Scholar
- Dong Nie, Li Wang, Yaozong Gao, and Dinggang Shen. 2016. Fully convolutional networks for multimodality isointense infant brain image segmentation. In International Symposium on Biomedical Imaging (ISBI). 1342–1345.Google Scholar
- Mohammad Havaei, Axel Davy, David Warde-Farley, Antoine Biard, Aaron Courville, Yoshua Bengio, Chris Pal, Pierre-Marc Jodoin, Hugo Larochelle. 2017. Brain tumor segmentation with deep neural networks. In Medical Image Analysis. 18–31.Google Scholar
- Olaf Ronneberger, Philipp Fischer, Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv preprint arXiv:1505.04597 (2015).Google Scholar
- Sandra González-Villà, Yuankai Huo, Arnau Oliver, Xavier Lladó, Bennett A. Landman. 2018. Multi-atlas Parcellation in the Presence of Lesions: Application to Multiple Sclerosis. In Computer Science,104–113.Google Scholar
- Jason H. Su, Francis T. Thomas, Willard S. Kasoff, Thomas Tourdias, Eun Young Choi, Brian K. Rutt, Manojkumar Saranathan. 2019. Fast fully automated segmentation of thalamic nuclei from structural MRI. In NeuroImage. 272-282.Google ScholarCross Ref
- Longwei Fang, Lichi Zhang, Dong Nie, Xiaohuan Cao, Islem Rekik, Seong-Whan Lee, Huiguang He, Dinggang Shen. 2018. Automatic brain labeling via multi-atlas guided fully convolutional network. In Medical Image Analysis. 157–168.Google Scholar
- Xiaolong Wang, Ross Girshick, Abhinav Gupta, Kaiming He. 2018. Non-local neural networks. arXiv preprint arXiv:1711.07971 (2018)Google Scholar
- Jun Fu, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, Hanqing Lu. 2019. Dual attention network for scene segmentation. arXiv preprint arXiv:1809.02983 (2019).Google Scholar
- D. W. Shattuck, M. Mirza, V. Adisetiyo, C. Hojatkashani, G. Salamon, K. L. Narr, R. A. Poldrack, R. M. Bilder, and A. W. Toga. 2008. Construction of a 3d probabilistic atlas of human cortical structures. in Neuroimage. 1064–1080.Google Scholar
- G. E. Christensen, X. Geng, J. G. Kuhl, J. Bruss, T. J. Grabowski, I. A. Pirwani, M. W. Vannier, J. S. Allen, and H. Damasio. 2006. Introduction to the non-rigid image registration evaluation project (nirep). In IEEE transactions on magnetics. 2972–2975.Google Scholar
- L. R. Dice. 1945. Measures of the amount of ecologic association between species. In Ecology, vol. 26, no. 3, pp. 297–302.Google ScholarCross Ref
- R. Woolson. 2007. Wilcoxon signed-rank test. In Wiley encyclopedia of clinicaltrials. pp. 1–3.Google Scholar
Recommendations
Functional Parcellation of Attentional Control Regions of the Brain
Recently, a number of investigators have examined the neural loci of psychological processes enabling the control of visual spatial attention using cued-attention paradigms in combination with event-related functional magnetic resonance imaging. ...
Brain network dynamics underlying visuospatial judgment: An fmri connectivity study
Previous functional imaging research has consistently indicated involvement of bilateral fronto-parietal networks during the execution of visuospatial tasks. Studies with TMS have suggested that the right hemispheric network, but not the left, is ...
Brain Lacunae Segmentation from Fair Sequence Based On Fully Convolutional Neural Network
ACAI '18: Proceedings of the 2018 International Conference on Algorithms, Computing and Artificial IntelligenceNeuroimaging in the context of brain disease is becoming more and more important. Brain detection and segmentation are two fundamental steps in neuroimage analysis. Because the cost of manual segmentation of the brain is too much, more and more ...
Comments