Abstract
Traditional brain network methods usually focus on either functional connectivity (FC) or structural connectivity (SC) for describing node interactions and only consider the interaction between paired network nodes. Therefore, the underlying relationship between FC and SC, as well as the complicated interactions among network nodes, has not been sufficiently studied and fully utilized to discover disease-related biomarkers. To tackle these problems, we propose a Diffusion-Convolution-Bilinear Neural Network (DCB-NN) framework for brain network analysis, which couples FC and SC seamlessly and considers wider interactions among network nodes. Specifically, a brain network model (graph) is first defined, whose edges are determined by neural fiber physical connections extracted from DTI and node features are governed by brain activities extracted from fMRI. Then, based on this model, we build two DCB modules to extract multi-scale features from this brain network. Each DCB module consists of diffusion, convolution and bilinear pooling. Through diffusion guided by physical connections, the network node features not only reflect the activities in their corresponding brain regions, but also are influenced by the activities from other brain regions. These enhanced node features are nonlinearly weighed through 1-D convolution, and their second-order statistics are further extracted by bilinear pooling for disease prediction. In order to capture node interactions at multi-scale, we include two DCB modules, corresponding to one-step and two-step diffusions, respectively. The whole model is trained in an end-to-end way. Experiments on a real epilepsy dataset demonstrate the effectiveness and advantages of our proposed method.
This study was supported by the National Key Research and Development Program of China (No. 2018YFC2001602) and the National Natural Science Foundation of China (Nos. 61876082, 61861130366, 61703301), the Royal Society-Academy of Medical Sciences Newton Advanced Fellowship (No. NAF\(\backslash \)R180371), the Fundamental Research Funds for the Central Universities (No. NP2018104).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Fornito, A., Zalesky, A., Breakspear, M.: The connectomics of brain disorders. Nat. Rev. Neurosci. 16(3), 159 (2015)
Dyrba, M., Grothe, M., Kirste, T., et al.: Multimodal analysis of functional and structural disconnection in Alzheimer’s disease using multiple kernel SVM. Hum. Brain Mapp. 36(6), 2118–2131 (2015)
Rudie, J.D., Brown, J.A., Beck-Pancer, D., et al.: Altered functional and structural brain network organization in autism. NeuroImage Clin. 2, 79–94 (2013)
Oechslin, M.S., Gschwind, M., James, C.E.: Tracking training-related plasticity by combining fMRI and DTI: the right hemisphere ventral stream mediates musical syntax processing. Cereb. Cortex 28(4), 1209–1218 (2017)
Kim, D.J., Schnakenberg Martin, A.M., Shin, Y.W., et al.: Aberrant structural-functional coupling in adult cannabis users. Hum. Brain Mapp. 40(1), 252–261 (2019)
Atwood, J., Towsley, D.: Diffusion-convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1993–2001 (2016)
Zhu, Q., Huang, J., Xu, X.: Non-negative discriminative brain functional connectivity for identifying schizophrenia on resting-state fMRI. Biomed. Eng. Online 17(1), 32 (2018)
Mao, B., Huang, J., Zhang, D.: Node based row-filter convolutional neural network for brain network classification. In: Geng, X., Kang, B.-H. (eds.) PRICAI 2018. LNCS (LNAI), vol. 11012, pp. 1069–1080. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-97304-3_82
Ktena, S.I., et al.: Distance metric learning using graph convolutional networks: application to functional brain networks. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10433, pp. 469–477. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66182-7_54
Kang, U., Tong, H., Sun, J.: Fast random walk graph kernel. In: Proceedings of the 2012 SIAM International Conference on Data Mining, pp. 828–838. Society for Industrial and Applied Mathematics (2012)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, J., Zhou, L., Wang, L., Zhang, D. (2019). Integrating Functional and Structural Connectivities via Diffusion-Convolution-Bilinear Neural Network. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_77
Download citation
DOI: https://doi.org/10.1007/978-3-030-32248-9_77
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32247-2
Online ISBN: 978-3-030-32248-9
eBook Packages: Computer ScienceComputer Science (R0)