Skip to main content

Predictive Coding

  • Living reference work entry
  • First Online:
Encyclopedia of Computational Neuroscience

Definition

Predictive coding is both a technique for efficient information encoding and a method for performing perceptual inference. It is commonly used to model information processing in the cerebral cortex.

Detailed Description

Predictive coding models of cortical function are typically implemented as hierarchical neural networks. Such networks contain alternating populations of “error-detecting” neurons and “prediction” neurons. Figure 1 shows the connectivity between a single pair of adjacent populations in such a hierarchy, for a very simplified case where there are only two neurons in each population. The inputs come from the thalamus or are the outputs of prediction neurons at preceding stages in the hierarchy. The activity of the prediction neurons encodes hypotheses about the causes underlying the inputs to the preceding population of error-detecting neurons. The activity of the error-detecting neurons encodes the discrepancy (or residual error) between the expected inputs...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Arel I, Rose DC, Karnowski TP (2010) Deep machine learning: a new frontier in artificial intelligence research. IEEE Comput Intel Mag 5(4):13–18

    Article  Google Scholar 

  • Barlow H (2001) Redundancy reduction revisited. Netw Comput Neural Syst 12:241–253

    Article  CAS  Google Scholar 

  • Friston KJ (2005) A theory of cortical responses. Philos Trans R Soc B Biol Sci 360(1456):815–836

    Article  Google Scholar 

  • Lochmann T, Deneve S (2011) Neural processing as causal inference. Curr Opin Neurobiol 21(5):774–781

    Article  CAS  PubMed  Google Scholar 

  • Olshausen BA, Field DJ (1996) Emergence of simple-cell receptive properties by learning sparse code for natural images. Nature 381:607–609

    Article  CAS  PubMed  Google Scholar 

  • Rao RPN, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2(1):79–87

    Article  CAS  PubMed  Google Scholar 

  • Spratling MW (2008) Predictive coding as a model of biased competition in visual attention. Vision Res 48(12):1391–1408

    Article  CAS  PubMed  Google Scholar 

  • Spratling MW (2010) Predictive coding as a model of response properties in cortical area V1. J Neurosci 30(9):3531–3543

    Article  CAS  PubMed  Google Scholar 

  • Spratling MW (2011) A single functional model accounts for the distinct properties of suppression in cortical area V1. Vision Res 51(6):563–576

    Article  CAS  PubMed  Google Scholar 

  • Srinivasan MV, Laughlin SB, Dubs A (1982) Predictive coding: a fresh view of inhibition in the retina. Proc R Soc Lond B Biol Sci 216(1205):427–459

    Article  CAS  PubMed  Google Scholar 

Further Reading

  • Clark A (2013) Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav Brain Sci. doi:10.1017/S0140525X12000477

    Google Scholar 

  • Egner T, Monti JM, Summerfield C (2010) Expectation and surprise determine neural population responses in the ventral visual stream. J Neurosci 30(49):16601–16608. doi:10.1523/JNEUROSCI.2770-10.2010

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Huang Y, Rao RPN (2011) Predictive coding. WIREs Cogn Sci 2:580–593. doi:10.1002/wcs.142

    Article  Google Scholar 

  • Kveraga K, Ghuman AS, Bar M (2007) Top-down predictions in the cognitive brain. Brain Cogn 65:145–168

    Article  PubMed Central  PubMed  Google Scholar 

  • Spratling MW (2012) Unsupervised learning of generative and discriminative weights encoding elementary image components in a predictive coding model of cortical function. Neural Comput 24(1):60–103

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Spratling .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this entry

Cite this entry

Spratling, M. (2014). Predictive Coding. In: Jaeger, D., Jung, R. (eds) Encyclopedia of Computational Neuroscience. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7320-6_509-6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7320-6_509-6

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, New York, NY

  • Online ISBN: 978-1-4614-7320-6

  • eBook Packages: Springer Reference Biomedicine and Life SciencesReference Module Biomedical and Life Sciences

Publish with us

Policies and ethics