Skip to main content

Clustering-Based Deep Brain MultiGraph Integrator Network for Learning Connectional Brain Templates

  • Conference paper
  • First Online:
Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis (UNSURE 2020, GRAIL 2020)

Abstract

Recently, the use of connectional brain templates (CBTs) has revolutionized the field of neurological disorder diagnosis through providing integral representation maps of a population-driven brain connectivity and effective identification of atypical changes in brain connectivity. Ideally, a reliable CBT should satisfy the following criteria: (1) centeredness as it occupies the center of the brain network population, and (2) discriminativeness as it allows to identify differences in brain connectivity between populations with different brain states (e.g., healthy and disordered). Existing state-of-the-art methods for connectional brain template (CBT) estimation from a population of multi-view brain networks (also called brain multigraphs) learn the integration process in a dichotomized manner, where different learning steps are pieced in together independently. Hence, such frameworks are inherently agnostic to the cumulative estimation error from step to step. This is a key limitation that we addressed by capitalizing on the power of deep learning frameworks residing in learning an end-to-end deep mapping using a single objective function to optimize to transform input data into target output data. In this paper, we propose to learn a many-to-one deep learning mapping by designing a clustering-based multi-graph integrator network (MGINet). Our MGINet inputs population of brain multigraphs (many) and outputs a single CBT graph (one). We first propose to tease apart brain multigraph data heterogeneity by first clustering similar samples together using multi-kernel manifold learning. In this way, we are optimally learning to disentangle the heterogeneity of our population and facilitating the integration task for our MGINet. Next, for each cluster, we first integrate the multigraph of each subject into a single graph, then merge the generated graphs into a cluster-specific CBT. Finally, we simply average the cluster-specific CBTs into a final CBT. Our experimental results show that our MGINet largely outperforms state-of-the-art methods in terms of centeredness and representativeness of the estimated CBT using both autistic and healthy brain multigraph datasets. Our clustering-based MGINet (cMGINet) source code is available at https://github.com/basiralab/cMGINet in Python.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://fcon_1000.projects.nitrc.org/indi/abide/.

References

  1. Xue, Z., et al.: Simulating deformations of mr brain images for validation of atlas-based segmentation and registration algorithms. NeuroImage 33, 855–866 (2006)

    Article  Google Scholar 

  2. Rohlfing, T., et al.: The INIA19 template and neuromaps atlas for primate brain image parcellation and spatial normalization. Front. Neuroinf. 6, 27 (2012)

    Article  Google Scholar 

  3. Reuter, M., Schmansky, N.J., Rosas, H.D., Fischl, B.: Within-subject template estimation for unbiased longitudinal image analysis. Neuroimage 61, 1402–1418 (2012)

    Article  Google Scholar 

  4. Shi, F., et al.: Infant brain atlases from neonates to 1-and 2-year-olds. PloS One 6, e18746 (2011)

    Article  Google Scholar 

  5. Wu, G., et al.: Hierarchical multi-atlas label fusion with multi-scale feature representation and label-specific patch partition. NeuroImage 106, 34–46 (2015)

    Article  Google Scholar 

  6. Rekik, I., Li, G., Lin, W., Shen, D.: Estimation of Brain Network Atlases Using Diffusive-Shrinking Graphs: Application to Developing Brains. In: Niethammer, M., Styner, M., Aylward, S., Zhu, H., Oguz, I., Yap, P.-T., Shen, D. (eds.) IPMI 2017. LNCS, vol. 10265, pp. 385–397. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59050-9_31

    Chapter  Google Scholar 

  7. Bassett, D.S., Sporns, O.: Network neuroscience. Nat. Neurosci. 20, 353–364 (2017)

    Article  Google Scholar 

  8. Pescosolido, B.A., et al.: Linking genes-to-global cultures in public health using network science. In: Handbook of Applied System Science, pp. 25–48 (2016)

    Google Scholar 

  9. Holmes, A.J., et al.: Brain genomics superstruct project initial data release with structural, functional, and behavioral measures. Sci. Data 2, 1–16 (2015)

    Article  Google Scholar 

  10. Yuan, L., et al.: Multi-source feature learning for joint analysis of incomplete multiple heterogeneous neuroimaging data. NeuroImage 61, 622–632 (2012)

    Article  Google Scholar 

  11. Dhifallah, S., et al.: Estimation of connectional brain templates using selective multi-view network normalization. Med. Image Anal. 59, 101567 (2020)

    Article  Google Scholar 

  12. Rekik, I., Li, G., Lin, W., Shen, D.: Estimation of shape and growth brain network atlases for connectomic brain mapping in developing infants. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 985–989 (2018)

    Google Scholar 

  13. Dhifallah, S., et al.: Clustering-based multi-view network fusion for estimating brain network atlases of healthy and disordered populations. J. Neurosci. Methods 311, 426–435 (2019)

    Article  Google Scholar 

  14. Biswas, M., et al.: State-of-the-art review on deep learning in medical imaging. Front. Biosci. (Landmark Ed.) 24, 392–426 (2019)

    Article  Google Scholar 

  15. Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Trans. Neural Netw. 20, 61–80 (2008)

    Article  Google Scholar 

  16. Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203 (2013)

  17. Henaff, M., Bruna, J., LeCun, Y.: Deep convolutional networks on graph-structured data. arXiv preprint arXiv:1506.05163 (2015)

  18. Wang, B., et al.: SIMLR: a tool for large-scale genomic analyses by multi-kernel learning. Proteomics 18, 1700232 (2018)

    Article  Google Scholar 

  19. Yun, S., Jeong, M., Kim, R., Kang, J., Kim, H.J.: Graph transformer networks. In: Advances in Neural Information Processing Systems, pp. 11983–11993(2019)

    Google Scholar 

  20. Wang, B., et al.: Similarity network fusion for aggregating data types on a genomic scale. Nat. Methods 11, 333 (2014)

    Article  Google Scholar 

  21. Mahjoub, I., Mahjoub, M.A., Rekik, I.: Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states. Sci. Rep. 8, 1–14 (2018)

    Article  Google Scholar 

  22. Soussia, M., Rekik, I.: Unsupervised manifold learning using high-order morphological brain networks derived from T1-w MRI for autism diagnosis. Front. Neuroinform. 12, 70 (2018)

    Article  Google Scholar 

Download references

Acknowledgments

I. Rekik is supported by the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie Individual Fellowship grant agreement No 101003403 (http://basira-lab.com/normnets/).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Islem Rekik .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Demir, U., Gharsallaoui, M.A., Rekik, I. (2020). Clustering-Based Deep Brain MultiGraph Integrator Network for Learning Connectional Brain Templates. In: Sudre, C.H., et al. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis. UNSURE GRAIL 2020 2020. Lecture Notes in Computer Science(), vol 12443. Springer, Cham. https://doi.org/10.1007/978-3-030-60365-6_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60365-6_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60364-9

  • Online ISBN: 978-3-030-60365-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics