Abstract
Functional magnetic resonance imaging (fMRI) has significantly contributed to understanding both normal and diseased human brains. Variability often exists in the magnitude, spatial distribution, and statistical significance of the resulting fMRI maps due to differences in equipment and other site-specific differences. In addition, because of costly imaging, demanding tasks, and analytical burden, understanding the effect of these differences may help develop an efficient pooling and comparison mechanism.
Prospective multi-institutional repeated fMRI data were acquired recently in the first phase of the extensive Functional Imaging Research of Schizophrenia Testbed study, sponsored by the Biomedical Informatics Research Network (BIRN) in the US. Five “human phantoms,” who were right-handed healthy males, were included in the study. These subjects repeatedly performed the same sensory-motor task over 10 of the 11 study sites on 2 separate visits per site.
The effects of factors such as subject, study site, field strength, vendor, K-space, visit, and repeated run on the fMRI reproducibility were evaluated. Over 4 repeated runs per visit at each site, at a given binarizing activation threshold, we first calculated a three-dimensional (3D) brain activation map via an intial expectation and maximization (EM) algorithm. Site-to-site differences were then assessed based on a second-level hiearchical EM. Against the estimated gold standard of the 3D activation map, activation percentage, sensitivity, specificity, and receiver operating characteristic curves were then estimated using voxel counts. A statistical regression model was used to assess the significance of accuracy predictors with p-values generated in order to explain those factors contributing towards the variability in repeated brain activation maps.
Chapter PDF
Similar content being viewed by others
Keywords
- Activation Percentage
- Receiver Operating Char
- Biomedical Informatics Research Network
- Diseased Human Brain
- Human Phantom
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Brannen, J.H., Badie, B., Moritz, C.H., Quigley, M., Meyerand, M.E., Haughton, V.M.: Reliability of functional MR imaging with word-generation tasks for mapping Broca’s area. American Journal of Neuroradiology 22, 1711–1718 (2001)
Machielsen, W.C.M., Rombouts, S.A.R.B., Barkhof, F., Scheltens, P., Witter, M.P.: FMRI of visual encoding: reproducibility of activation. Human Brain Mapping 9, 156–164 (2000)
Le, T.H., Hu, X.: Methods for assessing accuracy and reliability in functional MRI. NMR in Biomedicine 10, 160–164 (1997)
Genovese, C.R., Noll, D.C., Eddy, W.F.: Estimating test-retest reliability in fMRI I: statistical methodology. Magnetic Resonance in Medicine 38, 497–507 (1997)
Maitra, R., Roys, S.R., Gullapalli, R.P.: Test-retest reliability estimation of functional MRI Data. Magnetic Resonance in Medicine 48, 62–70 (2002)
Casey, B.J., Cohen, J.D., O’Craven, K., Davidson, R.J., Irwin, W., Nelson, C.A., Noll, D.C., Hu, X., Lowe, M.J., Rosen, B.R., Truwitt, C.L., Turski, P.A.: Reproducibility of fMRI results across four institutions using a spatial working memory task. NeuroImage 8, 249–261 (1998)
Wei, X.C., Yoo, S.-S., Dickey, C.C., Zou, K.H., Guttmann, C.R.G., Panych, L.P.: Functional MRI of auditory verbal working memory: long-term reproducibility analysis. NeuroImage 21, 1000–1008 (2004)
Warfield, S.K., Zou, K.H., Wells III, W.M.: Validation of image segmentation and expert quality with an expectation-maximization algorithm. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002. LNCS, vol. 2488, p. 298. Springer, Heidelberg (2002)
Warfield, S.K., Zou, K.H., Wells III, W.M.: Simultaneous Truth and Performance Level Estimation (STAPLE): An Algorithm for the Validation of Image Segmentation. IEEE Transactions on Medical Imaging (2004) (in press)
Gering, D.T., Nabavi, A., Kikinis, R., Hata, N., O’Donnell, L.J., Grimson, W.E., Jolesz, F.A., Black, P.M., Wells III, M.W.: An integrated visualization system for surgical planning and guidance using image fusion and an open MR. Journal of Magnetic Resonance Imaging 13, 967–975 (2001)
Metz, C.E., Merman, B.A., Shen, J.H.: Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. Statistics in Medicine 17, 1033–1053 (1998)
Zou, K.H., Warfield, S.K., Bharatha, A., Tempany, C.M.C., Kaus, M., Haker, S., Wells III, W.M., Jolesz, F.A., Kikinis, R.: Statistical validation of imagage segmentation quality based on a spatial overlap index. Academic Radiology 11, 178–189 (2004)
Zou, K.H., Warfield, S.K., Fielding, J.R., Tempany, C.M., Wells III, M.W., Kaus, M.R., Jolesz, F.A., Kikinis, R.: Statistical validation based on parametric receiver operating characteristic analysis of continuous classification data. Academic Radiology 10, 1359–1368 (2003)
Zou, K.H., Wells, W.M., Kaus, M.R., Kikinis, R., Jolesz, F.A., Warfield, S.K.: Statistical validation of automated probabilistic segmentation against composite latent expert ground truth in MR imaging of brain tumors. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002. LNCS, vol. 2488, pp. 315–322. Springer, Heidelberg (2002)
Zou, K.H.,Wells, M.W. III, Kikinis, R.,Warfield.: Three validation metrics for automated probabilistic image segmentation of brain tumors. Statistics in Medicine (2004) (in press)
Zou, K.H., Hall, W.J., Shapiro, D.E.: Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests. Statistics in Medicine 16, 2143–2156 (1997)
Genovese, C.R., Lazar, N.A., Nichols, T.: Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage 15, 870–878 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zou, K.H. et al. (2004). A Prospective Multi-institutional Study of the Reproducibility of fMRI: A Preliminary Report from the Biomedical Informatics Research Network. In: Barillot, C., Haynor, D.R., Hellier, P. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2004. MICCAI 2004. Lecture Notes in Computer Science, vol 3217. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30136-3_94
Download citation
DOI: https://doi.org/10.1007/978-3-540-30136-3_94
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22977-3
Online ISBN: 978-3-540-30136-3
eBook Packages: Springer Book Archive