Abstract
Understanding the relationship between brain functional connectivity and structural connectivity is important in the field of brain imaging, and it can help us better comprehend the working mechanisms of the brain. Much effort has been made on this issue, but it is still far from satisfactory. The brain transmits information through a network architecture, which means that the regions and connections of the brain are significant. The main difficulties with this issue are currently at least two aspects. On the one hand, the importance of different brain regions in structural and functional integration has not been fully addressed; on the other hand, the connectome skeleton of the brain, plays the role in common and key connections in the brain network, has not been clearly studied. To alleviate the above problems, this paper proposes a transformer-based self-supervised graph reconstruction framework (TSGR). The framework uses the graph neural network (GNN) to fuse functional and structural information of the brain, reconstructs the brain graph through a self-supervised model and identifies the regions that are important to the reconstruction task. These regions are considered as key connectome regions which play an essential role in the communication connectivity of the brain network. Based on key brain regions, the connectome skeleton can be obtained. Experimental results demonstrate the effectiveness of the proposed method, which obtains key regions and connectome skeleton in the brain network. This provides a new angle of view to explore the relationship between brain function and structure. Our code is available at https://github.com/kang105/TSGR.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sporns, O., Tononi, G., Kötter, R.: The human connectome: a structural description of the human brain. PLoS Comput. Biol. 1, e42 (2005)
Biswal, B., Zerrin Yetkin, F., Haughton, V.M., Hyde, J.S.: Functional connectivity in the motor cortex of resting human brain using echo-planar mri. Magn. Reson. Med. 34, 537–541 (1995)
Zamora-López, G., Zhou, C., Kurths, J.: Cortical hubs form a module for multisensory integration on top of the hierarchy of cortical networks. Front. Neuroinform. 4, 1 (2010)
Gordon, E.M., et al.: Precision functional mapping of individual human brains. Neuron 95, 791-807.e7 (2017)
Greicius, M.D., Supekar, K., Menon, V., Dougherty, R.F.: Resting-state functional connectivity reflects structural connectivity in the default mode network. Cereb. Cortex 19, 72–78 (2009)
Mišić, B., et al.: Network-level structure-function relationships in human neocortex. Cereb. Cortex 26, 3285–3296 (2016)
Sarwar, T., Tian, Y., Yeo, B.T.T., Ramamohanarao, K., Zalesky, A.: Structure-function coupling in the human connectome: a machine learning approach. Neuroimage 226, 117609 (2021)
Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Trans. Neural Netw. 20, 61–80 (2009)
Dosovitskiy, A., et al.: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv preprint http://arxiv.org/abs/2010.11929 (2021)
Kipf, T.N., Welling, M.: Semi-Supervised Classification with Graph Convolutional Networks. arXiv preprint http://arxiv.org/abs/1609.02907 (2017)
Van Essen, D.C., et al.: The human connectome project: a data acquisition perspective. Neuroimage 62, 2222–2231 (2012)
Fischl, B., et al.: Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33, 341–355 (2002)
Glasser, M.F., et al.: The minimal preprocessing pipelines for the human connectome project. Neuroimage 80, 105–124 (2013)
van den Heuvel, M.P., Kahn, R.S., Goñi, J., Sporns, O.: High-cost, high-capacity backbone for global brain communication. Proc. Natl. Acad. Sci. 109, 11372–11377 (2012)
Jenkinson, M., Bannister, P., Brady, M., Smith, S.: Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17, 825–841 (2002)
Jenkinson, M., Beckmann, C.F., Behrens, T.E.J., Woolrich, M.W., Smith, S.M.: FSL. NeuroImage 62, 782–790 (2012)
Nguyen, D.Q., Nguyen, T.D., Phung, D.: Universal Graph Transformer Self-Attention Networks. arXiv preprint http://arxiv.org/abs/1909.11855 (2022)
Gao, H., Ji, S.: Graph U-Nets. In: Proceedings of the 36th International Conference on Machine Learning, pp. 2083–2092. PMLR (2019)
Mallat, S.G., Zhang, Z.: Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process. 41, 3397–3415 (1993)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)
van den Heuvel, M.P., Sporns, O.: Network hubs in the human brain. Trends Cogn. Sci. 17, 683–696 (2013)
Deng, F., et al.: A functional model of cortical gyri and sulci. Brain Struct. Funct. 219, 1473–1491 (2014)
Nie, J., et al.: Axonal fiber terminations concentrate on gyri. Cereb Cortex. 22, 2831–2839 (2012)
Acknowledgement
This work was supported by the National Natural Science Foundation of China (62006194).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kang, Y., Wang, R., Shi, E., Wu, J., Yu, S., Zhang, S. (2023). Exploring Brain Function-Structure Connectome Skeleton via Self-supervised Graph-Transformer Approach. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14227. Springer, Cham. https://doi.org/10.1007/978-3-031-43993-3_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-43993-3_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43992-6
Online ISBN: 978-3-031-43993-3
eBook Packages: Computer ScienceComputer Science (R0)
