skip to main content
10.1145/3095140.3095153acmotherconferencesArticle/Chapter ViewAbstractPublication PagescgiConference Proceedingsconference-collections
short-paper

Temporaltracks: visual analytics for exploration of 4D fMRI time-series coactivation

Published: 27 June 2017 Publication History

Abstract

Functional magnetic resonance imaging (fMRI) is a 4D medical imaging modality that depicts a proxy of neuronal activity in a series of temporal scans. Statistical processing of the modality shows promise in uncovering insights about the functioning of the brain, such as the default mode network, and characteristics of mental disorders. Current statistical processing generally summarises the temporal signals between brain regions into a single data point to represent the 'coactivation' of the regions. That is, how similar are their temporal patterns over the scans. However, the potential of such processing is limited by issues of possible data misrepresentation due to uncertainties, e.g. noise in the data. Moreover, it has been shown that brain signals are characterised by brief traces of coactivation, which are lost in the single value representations. To alleviate the issues, alternate statistical processes have been used, however creating effective techniques has proven difficult due to problems, e.g. issues with noise, which often require user input to uncover. Visual analytics, therefore, through its ability to interactively exploit human expertise, presents itself as an interesting approach of benefit to the domain. In this work, we present the conceptual design behind TemporalTracks, our visual analytics system for exploration of 4D fMRI time-series coactivation data, utilising a visual metaphor to effectively present coactivation data for easier understanding. We describe our design with a case study visually analysing Human Connectome Project data, demonstrating that TemporalTracks can uncover temporal events that would otherwise be hidden in standard analysis.

References

[1]
G. Sun, Y. Wu, R. Liang, and S. Liu, "A Survey of Visual Analytics Techniques and Applications: State-of-the-Art Research and Future Challenges," Journal of Computer Science and Technology, vol. 28, pp. 852--867, 2013.
[2]
O. Sporns, Networks of the Brain: MIT Press, 2010.
[3]
O. Sporns, "Contributions and challenges for network models in cognitive neuroscience," Nature Neuroschience, vol. 17, pp. 652--660, 2014.
[4]
A. Eklund, M. Andersson, C. Josephson, M. Johannesson, and H. Knutsson, "Does parametric fMRI analysis with SPM yield valid results? An empirical study of 1484 rest datasets," Neuroimage, vol. 61, pp. 565--78, Jul 2 2012.
[5]
A. Eklund, T. Nichols, and H. Knutsson, "Can parametric statistical methods be trusted for fMRI based group studies?," PNAS, vol. 113, pp. 7900--7905, 2016.
[6]
M. A. Lindquist, "The statistical analysis of fMRI data," Statistical Science, vol. 28, pp. 439--464, 2008.
[7]
Y. Zang, T. Jiang, Y. Lu, Y. He, and L. Tian, "Regional homogeneity approach to fMRI data analysis," Neuroimage, vol. 22, pp. 394--400, 2004.
[8]
M. Rubinov and O. Sporns, "Complex network measures of brain connectivity: uses and interpretations.," NeuroImage, vol. 52, pp. 1059--69, 2010.
[9]
R. Yuste and A. Fairhall, "Temporal dynamics in fMRI resting-state activity," Proc Natl Acad Sci U S A, vol. 112, pp. 5263--5264, 2015.
[10]
X. Liu and J. H. Duyn, "Time-varying functional network information extracted from brief instances of spontaneous brain activity," PNAS, vol. 110, pp. 4392--4397, 2013.
[11]
J. Carp, "On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments," Frontiers in Neuroscience, vol. 6, p. 149, 2012.
[12]
D. S. Margulies, J. Böttger, A. Watanabe, and K. J. Gorgolewski, "Visualizing the human connectome.," NeuroImage, vol. 80, pp. 445--61, 2013.
[13]
S. Smith, C. Beckmann, J. Andersson, E. Auerbach, J. Bijsterbosch, G. Douaud, et al., "Resting-state fMRI in the Human Connectome Project," NeuroImage, vol. 80, pp. 144--168, 2013.
[14]
C. Chia and Z. Syed, "Using Adaptive Downsampling to Compare Time Series with Warping," ICDMW, pp. 1304--1311, 2010.
[15]
J. Walker, M. Jones, R. Laramee, O. Bidder, H. Williams, R. Scott, et al., "TimeClassifier: a visual analytic system for the classification of multi-dimensional time series data," The Visual Computer, vol. 31, pp. 1067--1078, 2015.
[16]
S. Haroz, R. Kosara, and S. Franconeri, "The connected scatterplot for presenting paired time series," IEEE Transactions on Visualization and Computer Graphics, vol. 22, pp. 2174--2186, 2016.
[17]
D. Gotz and H. Stavropoulos, "Decisionflow: Visual analytics for high-dimensional temporal event sequence data," IEEE Transactions on Visualization and Computer Graphics, vol. 20, pp. 1783--1792, 2014.
[18]
B. Bach, C. Shi, N. Heulot, T. Madhyastha, T. Grabowski, and P. Dragicevic, "Time curves: Folding time to visualize patterns of temporal evolution in data," IEEE Transactions on Visualization and Computer Graphics, vol. 22, pp. 559--568, 2016.
[19]
C. Bryan, K. Ma, and J. Woodring, "Temporal Summary Images: An Approach to Narrative Visualization via Interactive Annotation Generation and Placement," IEEE Transactions on Visualization and Computer Graphics, vol. 23, pp. 511--520, 2017.
[20]
E. Keogh, L. Wei, X. Xi, S. Lonardi, J. Shieh, and S. Sirowy, "Intelligent icons: Integrating lite-weight data mining and visualization into GUI operating systems," ICDM, pp. 912--916, 2006.
[21]
J. Lin, E. Keogh, S. Lonardi, and B. Chiu, "A symbolic representation of time series, with implications for streaming algorithm," ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, pp. 2--11, 2003.
[22]
J. Pang, B. Sharif, Z. Fan, X. Bi, R. Arsanjani, D. Berman, et al., "ECG and navigator-free four-dimensional whole-heart coronary MRA for simultaneous visualization of cardiac anatomy and function," Magnetic Resonance in Medicine, vol. 72, pp. 1208--1217, 2014.
[23]
A. K. Al-Awami, J. Beyer, H. Strobelt, N. Kasthuri, J. W. Lichtman, H. Pfister, et al., "NeuroLines: A Subway Map Metaphor for Visualizing Nanoscale Neuronal Connectivity," IEEE Transactions on Visualization and Computer Graphics, vol. 20, pp. 2369--2378, 2014.
[24]
B. Bach, N. Henry-Riche, T. Dwyer, T. Madhyastha, J. D. Fekete, and T. Grabowski, "Small MultiPiles: Piling time to explore temporal patterns in dynamic networks," Computer Graphics Forum, vol. 34, pp. 31--40, 2015.
[25]
I. Boyandin, E. Bertini, P. Bak, and D. Lalanne, "Flowstrates: An Approach for Visual Exploration of Temporal Origin-Destination Data," Computer Graphics Forum, vol. 30, pp. 971--980, 2011.
[26]
S. van den Elzen, D. Holten, J. Blaas, and J. van Wijk, "Reducing Snapshots to Points: A Visual Analytics Approach to Dynamic Network Exploration," IEEE Transactions on Visualization and Computer Graphics, vol. 22, pp. 1--10, 2016.
[27]
S. Liu, Y. Wu, E. Wei, M. Liu, and Y. Liu, "StoryFlow: Tracking the Evolution of Stories," IEEE Transactions on Visualization and Computer Graphics, vol. 19, pp. 2436--2445, 2013.
[28]
Research Imaging Institute University of Texas Health Science Center. (2017). Papaya. Available: http://ric.uthscsa.edu/mango/papaya.html
[29]
R. Buckner, J. Andrews-Hanna, and D. Schacter, "The brain's default network," Annals of the New York Academy of Sciences, vol. 1124, pp. 1--38, 2008.
[30]
M. D. Greicius, G. Srivastava, A. L. Reiss, and V. Menon, "Default-mode network activity distinguishes Alzheimer's disease from healthy aging: evidence from functional MRI," Proc Natl Acad Sci U S A, vol. 101, pp. 4637--42, Mar 30 2004.
[31]
C. Destrieux, B. Fischl, A. Dale, and E. Halgren, "Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature," Neuroimage, vol. 53, pp. 1--15, Oct 15 2010.

Cited By

View all
  • (2024)FAVis: Visual Analytics of Factor Analysis for Psychological Research2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00018(51-55)Online publication date: 13-Oct-2024
  • (2019)Optimizing the use of biologgers for movement ecology researchJournal of Animal Ecology10.1111/1365-2656.1309489:1(186-206)Online publication date: Oct-2019
  • (2019)TempoCave: Visualizing Dynamic Connectome Datasets to Support Cognitive Behavioral Therapy2019 IEEE Visualization Conference (VIS)10.1109/VISUAL.2019.8933544(186-190)Online publication date: Oct-2019
  • Show More Cited By

Index Terms

  1. Temporaltracks: visual analytics for exploration of 4D fMRI time-series coactivation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      CGI '17: Proceedings of the Computer Graphics International Conference
      June 2017
      260 pages
      ISBN:9781450352284
      DOI:10.1145/3095140
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 27 June 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. coactivation analysis
      2. functional magnetic resonance imaging
      3. temporal data visualization

      Qualifiers

      • Short-paper

      Conference

      CGI '17
      CGI '17: Computer Graphics International 2017
      June 27 - 30, 2017
      Yokohama, Japan

      Acceptance Rates

      Overall Acceptance Rate 35 of 159 submissions, 22%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)17
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 25 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)FAVis: Visual Analytics of Factor Analysis for Psychological Research2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00018(51-55)Online publication date: 13-Oct-2024
      • (2019)Optimizing the use of biologgers for movement ecology researchJournal of Animal Ecology10.1111/1365-2656.1309489:1(186-206)Online publication date: Oct-2019
      • (2019)TempoCave: Visualizing Dynamic Connectome Datasets to Support Cognitive Behavioral Therapy2019 IEEE Visualization Conference (VIS)10.1109/VISUAL.2019.8933544(186-190)Online publication date: Oct-2019
      • (2019)Challenges for Brain Data Analysis in VR Environments2019 IEEE Pacific Visualization Symposium (PacificVis)10.1109/PacificVis.2019.00013(42-46)Online publication date: Apr-2019
      • (2018)A review and outlook on visual analytics for uncertainties in functional magnetic resonance imagingBrain Informatics10.1186/s40708-018-0083-05:2Online publication date: 3-Jul-2018
      • (2018)Adapted K-Core Decomposition and Visualization for Functional Magnetic Resonance Imaging Connectivity Networks2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)10.1109/EMBC.2018.8513275(4134-4137)Online publication date: Jul-2018

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media