skip to main content
10.1145/3573381.3597222acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
demonstration

DatAR: Comparing Relationships between Brain Regions and Diseases: An Immersive AR Tool for Neuroscientists

Published: 29 August 2023 Publication History

Abstract

Different brain diseases are associated with distinct patterns of affected brain regions. Neuroscientists aim to understand the variability of these patterns across different brain diseases. We used a user-centered design approach to develop support for neuroscientists in exploring and comparing which regions are affected by which diseases based on neuroscience literature. Our study involved six neuroscientists and nine visualization experts who evaluated the usability and explainability of our visualization tool for comparing disease patterns in brain regions. Our results show that our tool can help neuroscientists explore and visualize relationships between brain regions and diseases, and compare patterns of affected regions in an immersive AR environment.

Supplementary Material

MP4 File (imx23e-sub1006-i6.mp4)
Demo presentation of the DatAR tool

References

[1]
Xia an Bi, Xi Hu, Yiming Xie, and Hao Wu. 2021. A novel CERNNE approach for predicting Parkinson’s Disease-associated genes and brain regions based on multimodal imaging genetics data. Medical Image Analysis 67 (2021), 101830. https://doi.org/10.1016/j.media.2020.101830
[2]
Urs Braun, Axel Schaefer, Richard F. Betzel, Heike Tost, Andreas Meyer-Lindenberg, and Danielle S. Bassett. 2018. From Maps to Multi-dimensional Network Mechanisms of Mental Disorders. Neuron 97, 1 (2018), 14–31. https://doi.org/10.1016/j.neuron.2017.11.007
[3]
Madeleine Goodkind, Simon B. Eickhoff, Desmond J. Oathes, Ying Jiang, Andrew Chang, Laura B. Jones-Hagata, Brissa N. Ortega, Yevgeniya V. Zaiko, Erika L. Roach, Mayuresh S. Korgaonkar, Stuart M. Grieve, Isaac Galatzer-Levy, Peter T. Fox, and Amit Etkin. 2015. Identification of a Common Neurobiological Substrate for Mental Illness. JAMA Psychiatry 72, 4 (04 2015), 305–315. https://doi.org/10.1001/jamapsychiatry.2014.2206 arXiv:https://jamanetwork.com/journals/jamapsychiatry/articlepdf/2108651/yoi140096.pdf
[4]
Marc Janeras, Joan Roca, Josep A. Gili, Oriol Pedraza, Gerald Magnusson, M. Amparo Núñez-Andrés, and Kathryn Franklin. 2022. Using Mixed Reality for the Visualization and Dissemination of Complex 3D Models in Geosciences—Application to the Montserrat Massif (Spain). Geosciences 12, 10 (Oct 2022), 370. https://doi.org/10.3390/geosciences12100370
[5]
Taeho Jo, Kwangsik Nho, and Andrew J. Saykin. 2019. Deep Learning in Alzheimer’s Disease: Diagnostic Classification and Prognostic Prediction Using Neuroimaging Data. Frontiers in Aging Neuroscience 11 (2019). https://doi.org/10.3389/fnagi.2019.00220
[6]
Johnson J. G. Keiriz, Liang Zhan, Olusola Ajilore, Alex D. Leow, and Angus G. Forbes. 2018. NeuroCave: A web-based immersive visualization platform for exploring connectome datasets. Network Neuroscience 2, 3 (Aug. 2018), 344–361. https://doi.org/10.1162/netn_a_00044
[7]
Daniel Paes, Eduardo Arantes, and Javier Irizarry. 2017. Immersive environment for improving the understanding of architectural 3D models: Comparing user spatial perception between immersive and traditional virtual reality systems. Automation in Construction 84 (2017), 292–303. https://doi.org/10.1016/j.autcon.2017.09.016
[8]
RA Poldrack, JA Mumford, T Schonberg, D Kalar, B Barman, and T Yarkoni. 2012. Discovering Relations Between Mind, Brain, and Mental Disorders Using Topic Mapping. PLoS Comput Biol 10, 8 (2012). https://doi.org/10.1371/journal.pcbi.1002707
[9]
Ruggiero Seccia, Silvia Romano, Marco Salvetti, Andrea Crisanti, Laura Palagi, and Francesca Grassi. 2021. Machine Learning Use for Prognostic Purposes in Multiple Sclerosis. Life 11, 2 (2021). https://doi.org/10.3390/life11020122
[10]
Austin R. Ward and Rob Capra. 2020. Immersive Search: Using Virtual Reality to Examine How a Third Dimension Impacts the Searching Process. Association for Computing Machinery, New York, NY, USA, 1621–1624. https://doi.org/10.1145/3397271.3401303

Index Terms

  1. DatAR: Comparing Relationships between Brain Regions and Diseases: An Immersive AR Tool for Neuroscientists

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences
    June 2023
    465 pages
    ISBN:9798400700286
    DOI:10.1145/3573381
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 August 2023

    Check for updates

    Author Tags

    1. augmented reality
    2. exploratory search
    3. information visualization and visual analytics
    4. measures of user experience and performance
    5. neuroscience literature search
    6. virtual reality

    Qualifiers

    • Demonstration
    • Research
    • Refereed limited

    Conference

    IMX '23

    Acceptance Rates

    Overall Acceptance Rate 69 of 245 submissions, 28%

    Upcoming Conference

    IMX '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 57
      Total Downloads
    • Downloads (Last 12 months)20
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media