Abstract
Determining the links between cognitive processes and neuroelectrical brain activity (i.e., event-related potentials, ERPs) depends strongly on our understanding of how this activity fluctuates in response to stimuli; however, the way in which changes in ERP amplitudes can accelerate and decelerate over time has received only scant attention. The present study demonstrates that moment-to-moment changes (i.e., derivatives) of ERP responses convey information that is not readily accessible from the amplitude of response. Subjects exposed to visual and auditory stimuli either alone (unimodal) or combined (crossmodal) yielded different responses according to particular derivatives of ERP activation. In particular, an effect of cross-modality integration (stronger activation for crossmodal compared to unimodal stimuli) was detected in the higher derivatives of activation of a number of electrode sites spanning a fronto-centro-parietal distribution; in most sites, no such effect was detected in the amplitude of waveforms itself. These results suggest that information may be carried by the higher derivatives of ERP responses, and that distinct topographic distributions are associated with different derivatives of response. These different derivatives of response may in turn relate to different strategies for sensory processing in the brain, and in particular reflect a fundamental mode of information processing by time derivatives previously reported in cortex.
Similar content being viewed by others
References
Angelaki, D. E., Shaikh, A. G., Green, A. M., & Dickman, J. D. (2004). Neurons compute internal models of the physical laws of motion. Nature, 430(6999), 560–564.
Basar, E., Demiralp, T., Schurmann, M., Basar-Eroglu, C., & Ademoglu, A. (1999). Oscillatory brain dynamics, wavelet analysis, and cognition. Brain and Language, 66(1), 146–183.
Boersma, P., & Weenink, D. (2006). Praat: doing phonetics by computer (Version 4.5.04): http://www.praat.org.
Demiralp, T., Ademoglu, A., Istefanopulos, Y., Basar-Eroglu, C., & Basar, E. (2001). Wavelet analysis of oddball P300. International Journal of Psychophysiology, 39(2–3), 221–227.
Fort, A., Delpuech, C., Pernier, J., & Giard, M. H. (2002). Early auditory-visual interactions in human cortex during nonredundant target identification. Cognitive Brain Research, 14(1), 20–30.
Freeman, W. J., Holmes, M. D., West, G. A., & Vanhatalo, S. (2006). Fine spatiotemporal structure of phase in human intracranial EEG. Clinical Neurophysiology, 117(6), 1228–1243.
Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 360(1456), 815–836.
Friston, K., Henson, R., Phillips, C., & Mattout, J. (2006). Bayesian estimation of evoked and induced responses. Human Brain Mapping, 27(9), 722–735.
Giard, M. H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11(5), 473–490.
Gibbons, H., & Stahl, J. (2007). Response-time corrected averaging of event-related potentials. Clinical Neurophysiology, 118(1), 197–208.
Green, P. J., & Silverman, B. W. (1994). Nonparametric regression and generalized linear models: a roughness penalty approach. London: Chapman and Hall.
Holstein, G. R., Rabbitt, R. D., Martinelli, G. P., Friedrich, V. L., Jr., Boyle, R. D., & Highstein, S. M. (2004). Convergence of excitatory and inhibitory hair cell transmitters shapes vestibular afferent responses. Proceedings of the National Academy of Sciences of the United States of America, 101(44), 15766–15771.
Iidaka, T., Matsumoto, A., Nogawa, J., Yamamoto, Y., & Sadato, N. (2006). Frontoparietal network involved in successful retrieval from episodic memory. Spatial and temporal analyses using fMRI and ERP. Cerebral Cortex, 16(9), 1349–1360.
Lopes da Silva, F. (1999). Event-related potentials: methodology and quantification. In E. Neidermeyer & F. Lopes da Silva (Eds.), Electroencephalography(4th ed.). Philadelphia: Lippincott Williams & Wilkins.
Lu, T., & Wang, X. (2004). Information content of auditory cortical responses to time-varying acoustic stimuli. Journal of Neurophysiology, 91(1), 301–313.
Molholm, S., Ritter, W., Javitt, D. C., & Foxe, J. J. (2004). Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cerebral Cortex, 14(4), 452–465.
Noppeney, U., Josephs, O., Hocking, J., Price, C. J., & Friston, K. J. (2007). The Effect of Prior Visual Information on Recognition of Speech and Sounds. Cerebral Cortex (in press).
Picton, T. (1988). Handbook of electroencephalography and clinical neurophysiology. Amsterdam: Elsevier.
Puccini, G. D., Sanchez-Vives, M. V., & Compte, A. (2007). Integrated mechanisms of anticipation and rate-of-change computations in cortical circuits. PLoS Computational Biology, 3(5), e82.
Ramsay, J., & Silverman, B. W. (2005). Functional data analysis, Second edition. New York: Springer.
Renart, A., Song, P., & Wang, X. J. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38(3), 473–485.
Shaikh, A. G., Green, A. M., Ghasia, F. F., Newlands, S. D., Dickman, J. D., & Angelaki, D. E. (2005). Sensory convergence solves a motion ambiguity problem. Current Biology, 15(18), 1657–1662.
Teder-Salejarvi, W. A., Di Russo, F., McDonald, J. J., & Hillyard, S. A. (2005). Effects of spatial congruity on audio-visual multimodal integration. Journal of Cognitive Neuroscience, 17(9), 1396–1409.
Thivierge, J. (2007). Functional data analysis of cognitive events in EEG. Paper presented at the IEEE International Conference on Systems, Man, and Cybernetics, Montreal, Canada.
Acknowledgements
This work was supported by a Postdoctoral Fellowship from the Fonds Québéçois de Recherche sur les Natures et Technologies (FQRNT). This work benefited from discussions with Jim Ramsay, Thomas Shultz and Frédéric Dandurand (McGill University), as well as data from Natalie Phillips and Axel Winneke (Concordia University).
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary Material
(DOC 4002 kb)
Rights and permissions
About this article
Cite this article
Thivierge, JP. Higher Derivatives of ERP Responses to Cross-Modality Processing. Neuroinform 6, 35–46 (2008). https://doi.org/10.1007/s12021-007-9007-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12021-007-9007-5