Abstract
Two measures from information theory, transmitted information and channel capacity, can quantify the ability of neurons to convey stimulus-dependent information. These measures are calculated using probability functions estimated from stimulus-response data. However, these estimates are biased by response quantization, noise, and small sample sizes. Improved estimators are developed in this paper that depend on both an estimate of the sample-size bias and the noise in the data.
Similar content being viewed by others
References
Abramson N (1963) Information theory and coding. McGraw-Hill, New York
Bevington PR (1969) Data reduction and error analysis for the physical sciences. McGraw-Hill, New York
Blahut RE (1972) Computation of channel capacity and rate-distortion functions. IEEE Trans Inf Theory IT-18:460–473
Blahut RE (1987) Principles and practice of information theory. Addison-Wesley, Reading, Mass
Carlton AG (1969) On the bias of information estimates. Psychol Bull 71:108–109
Cattaneo A, Maffei L, Morrone C (1981) Patterns in the discharge of simple and complex visual cortical cells. Proc R Soc London B 212:279–297
Crowe A, de Ruiter T, Blaauw M, Oosthoek B (1988) Information transmission in non-visual fingertip matching along a horizontal track in the median plane. Biol Cybern 58:141–148
Eckhorn R, Grüsser O-J, Kröller J, Pellnitz K, Pöpel B (1976) Efficiency of different neural codes: information transfer calculations for three different neuronal systems. Biol Cybern 22:49–60
Eckhorn R, Pöpel B (1974) Rigorous and extended application of information theory to the afferent visual system of the cat. I. basic concepts. Kybernetik 16:191–200
Efron B (1982) The jackknife, the bootstrap and other resampling plans. SIAM Monograph. vol 38. CBMS-NSF. SIAM Philadelphia
Fagen RM (1978) Information measures: statistical confidence limits and inference. J Theor Biol 73:61–79
Fukunaga K (1972) Introduction to statistical pattern recognition. Academic Press, New York
Fuller MS, Looft SJ (1984) Information-theoretic analysis of cutaneous receptor responses. IEEE Trans Biomed Eng BME-31:377–383
Guttman I, Wilks SS, Hunter JS (1971) Introductory engineering statistics. Wiley, New York
Macrae AW (1971) On calculating unbiased information measures. Psychol Bull 75:270–277
Miller GA (1955) Note on the bias of information estimates. Inf Theory Psychol Probl Methods II-B:95–100
Optican LM, Richmond BJ (1987) Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. J Neurophysiol 57:162–178
Richmond BJ, Optican LM (1987) Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex: II. Quantification of response waveform. J Neurophysiol 57:147–161
Richmond BJ, Optican LM (1990) Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. II. Information transmission. J Neurophysiol 64:370–380
Richmond BJ, Optican LM, Spitzer H (1990) Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. I. Stimulus-response relations. J Neurophysiol 64:351–369
Sakitt B (1980) Visual-motor efficiency (VME) and the information transmitted in visual-motor tasks. Bull Psychonom Soc 16:329–332
Sakitt B, Francis L, Zeffiro TA (1983) The information transmitted at final position in visually triggered forearm movements. Biol Cybern 46:111–118
Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423
Silverman BW (1986) Density estimation for statistics and data analysis. Chapman and Hall, London
Author information
Authors and Affiliations
Additional information
This work was supported in part by Air Force Office of Scientific Research Grant AFOSR-ISSA-88-0073
Rights and permissions
About this article
Cite this article
Optican, L.M., Gawne, T.J., Richmond, B.J. et al. Unbiased measures of transmitted information and channel capacity from multivariate neuronal data. Biol. Cybern. 65, 305–310 (1991). https://doi.org/10.1007/BF00216963
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00216963