Skip to main content

Advertisement

SpringerLink
Log in

Habit learning and brain–machine interfaces (BMI): a tribute to Valentino Braitenberg’s “Vehicles”

  • Review
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

Brain–Machine Interfaces (BMI) allow manipulation of external devices and computers directly with brain activity without involvement of overt motor actions. The neurophysiological principles of such robotic brain devices and BMIs follow Hebbian learning rules as described and realized by Valentino Braitenberg in his book “Vehicles,” in the concept of a “thought pump” residing in subcortical basal ganglia structures. We describe here the application of BMIs for brain communication in totally locked-in patients and argue that the thought pump may extinguish—at least partially—in those people because of extinction of instrumentally learned cognitive responses and brain responses. We show that Pavlovian semantic conditioning may allow brain communication even in the completely paralyzed who does not show response-effect contingencies. Principles of skill learning and habit acquisition as formulated by Braitenberg are the building blocks of BMIs and neuroprostheses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Abbreviations

ALS:

Amyotrophic lateral sclerosis

ADHD:

Attention deficit and hyperactivity disorder

BOLD:

Blood-Oxygenation-Level-Dependent

BMI:

Brain–Machine Interfaces

CNS:

Central nervous system

CLIS:

Completely locked-in-state

CR:

Conditioned response

E:

Effect

ECoG:

Electrocorticograms

EEG:

Electroencephalogram

ERPs:

Event-related brain potentials

LFPs:

Extracellular local field potentials

LIS:

Locked-in-state

NIRS:

Near-Infrared Spectroscopy Signals

rt-fMRI:

Real-time-functional magnetic resonance imaging

R:

Response

SCPs:

Slow cortical potentials

S:

Stimulation

References

  • Ayala GG, Furdea A, Ruf CA, Flor H, Birbaumer N (2014). Brain communication with a completely locked-in patient using bedside near-infrared spectroscopy. Ann Neurol

  • Barlow TB (1972) Single units and sensation: a neuron doctrine for perceptual psychology? Perception 1(4):371–394

    Article  CAS  PubMed  Google Scholar 

  • Birbaumer N (ed) (1979) Biofeedback and self-regulation. Lawrence Erlbaum Ass, Hillsdale

  • Birbaumer N, Elbert T, Canavan A, Rockstroh B (1990) Slow potentials of the cerebral cortex and behavior. Phys Rev 70:1–41

    CAS  Google Scholar 

  • Birbaumer N (2006a) Brain-computer-interface research: coming of age. Clin Neurophysiol 117:479–483

    Article  PubMed  Google Scholar 

  • Birbaumer N (2006b) Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. Psychophysiology 43:517–532

    Article  PubMed  Google Scholar 

  • Birbaumer N, Cohen L (2007) Brain-computer-interfaces (BCI): communication and restoration of movement in paralysis. J Physiol 579(3):621–636

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Birbaumer N, Ramos Murguialday A (2008) Brain-computer- interface (BCI) in paralysis. Curr Opin Neurol 21:634–638

    Article  PubMed  Google Scholar 

  • Birbaumer N, Piccione F, Silvoni S, Wildgruber M (2012) Ideomotor silence: the case of complete paralysis and brain-computer interfaces (BCI). Psychol Res 76:183–191

    Article  PubMed  Google Scholar 

  • Birbaumer N, Ruiz S, Sitaram R (2013) Learned regulation of brain metabolism. Trends Cogn Sci 17:295–302

    Article  PubMed  Google Scholar 

  • Braitenberg V (1978) Cell assemblies in the cerebral cortex. In: Heim R, Palm G (eds) Theoretical approaches to complex systems. Springer, Berlin, pp 171–188

    Chapter  Google Scholar 

  • Braitenberg V (1984) Vehicles: experiments in synthetic psychology. MIT Press, Cambridge

    Google Scholar 

  • Braitenberg V, Schüz A (1991) Anatomy of the cortex, statistics and geometry. Springer, Berlin, Revised 2nd edn (1998) Cortex: statistics and geometry of neuronal connceticity. Springer, Berlin

  • Caria A, Veit R, Sitaram R, Lotze M, Weiskopf N, Grodd W et al (2007) Regulation of anterior insular cortex activity using real-time fMRI. NeuroImage 35:1238–1246

    Article  PubMed  Google Scholar 

  • Daly JJ, Wolpaw JR (2008) Brain-computer interfaces in neurological rehabilitation. Lancet Neurol 7:1032–1043

    Article  PubMed  Google Scholar 

  • De Massari D, Ruf CA, Furdea A, Matuz T, van der Heiden L, Halder S, Silvoni S, Birbaumer N (2013) Brain communication in the locked-in state. Brain 136:1989–2000

    Google Scholar 

  • Dworkin BR, Miller NE (1986) Failure to replicate visceral learning in the acute curarized rat preparation. Behav Neurosci 100:299– 314

    Google Scholar 

  • Dworkin BR (1993) Learning and physiological regulation. University of Chicago Press, Chicago

    Google Scholar 

  • Elbert T, Rockstroh B, Lutzenberger W, Birbaumer N (eds) (1984) Self-regulation of the brain and behavior. Springer, New York

  • Felton EA, Wilson JA, Williams JC, Garell PC (2007) Electrocortico-graphically controlled brain-computer interfaces using motor and sensory imagery in patients with temporary subdural electrode implants. J Neurosurg 106:495–500

    Article  PubMed  Google Scholar 

  • Fetz EE (1969) Operant conditioning of cortical unit activity. Science 163:955–958

    Article  CAS  PubMed  Google Scholar 

  • Fuchs T, Birbaumer N, Lutzenberger W, Gruzelier JH, Kaiser J (2003) Neurofeed-back training for attention-deficit/hyperactivity disorder in children: a comparison with methylphenidate. Appl Psychophys Biofeedback 28(1):1–12

    Google Scholar 

  • Georgopoulos AP, Kalaska JF, Caminiti R, Massey JT (2007) On the relations between the direction of two dimensional arm movements and cell discharge in primate motor cortex. J Neurophysiol 2:1527–1537

    Google Scholar 

  • Graybiel AM (2000), The basal ganglia. Curr Biol 10(14):R509–11

    Google Scholar 

  • Haggard P, Clark S, Kalogeras J (2002) Voluntary action and conscious awareness. Nat Neurosci 5:382–385

    Article  CAS  PubMed  Google Scholar 

  • Hinterberger T, Veit R, Wilhelm B, Weiskopf N, Vatine J-J, Birbaumer N (2005) Neuronal mechanisms underlying control of a brain-computer-interface. Eur J Neurosci 21:3169–3181

    Google Scholar 

  • Holland J, Skinner BF (1961) The analysis of behavior. MacGraw-Hill, New York

    Google Scholar 

  • Howe MW, Tierney PL, Sandberg SG, Phillips PE, Graybiel AM (2013) Prolonged dopamine signaling in striatum signals proximity and value of distant rewards. Nature 500(7464):575–579. doi:10.1038/nature12475. Epub 2013 Aug 4

    Google Scholar 

  • Jeannerod M (2001) Neural simulation of action: a unifying mechanism for motor cognition. Neuro Image 14:103–109

    Google Scholar 

  • Kamiya J, Callaway E, Yeager CL (1969) Visual evoked responses in subjects trained to control alpha rhythms. Psychophysiology 5(6):683–695

    Article  CAS  PubMed  Google Scholar 

  • Koralek AC, Jin X, Long JD II, Costa RM, Carmena JM (2012) Cortico-striatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 10(5):331–335

    Article  Google Scholar 

  • Kotchoubey B, Strehl U, Uhlmann C, Holzapfel S, König M, Fröscher W et al (2001) Modification of slow cortical potentials in patients with refractory epilepsy: a controlled outcome study. Epilepsia 42(3):406–416

    Article  CAS  PubMed  Google Scholar 

  • Kotchoubey B, Lang S, Winter S, Birbaumer N (2003) Cognitive processing in completely paralyzed patients with amyotrophic lateral sclerosis. Eur J Neurol 10(5):551–558

    Article  CAS  PubMed  Google Scholar 

  • Kübler A, Birbaumer N (2008) Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clin Neurophysiol 119:2658–2666

    Article  PubMed Central  PubMed  Google Scholar 

  • Lebedev MA, Nicolelis MA (2006) Brain machine interfaces: past, present and future. Trends Neurosci 29:536–546

    Article  CAS  PubMed  Google Scholar 

  • Miller NE (1969) Learning of visceral and glandular responses. Science 163:434–445

    Article  CAS  PubMed  Google Scholar 

  • Miller KJ, Schalk G, Fetz EE, den Nijs M, Ojemann JG, Rao RP (2010) Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc Natl Acad Sci USA 107:4430–4435

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Nagai Y, Goldstein LH, Fenwick PBC, Trimble MR (2004) Clinical efficacy of galvanic skin response biofeedback training in reducing seizures in adult epilepsy: a preliminary randomized controlled study. Epilepsy Behav 5:216–223

    Article  PubMed  Google Scholar 

  • Nijboer F, Sellers EW, Mellinger J, Jordan MA, Matuz T, Halder S et al (2008) A P300-based brain-computer interfacefor people with amyotrophic lateral sclerosis. Clin Neurophysiol 119(8):1909–1916

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • O’Doherty JE, Lebedev MA, Hanson TL, Fitzsimmons NA, Nicolelis MA (2009) A brain-machine interface instructed by direct intracortical microstimulation. Front Integr Neurosci 3:20. doi:10.3389/neuro.07.020.2009

    PubMed Central  PubMed  Google Scholar 

  • O’Doherty JE, Lebedev MA, Ifft PJ, Zhuang KZ, Shokur S, Bleuler H, Nicolelis MA (2011) Active tactile exploration using a brain-machine-brain interface. Nature 479(7372):228–231. doi:10.1038/nature10489

    Article  PubMed Central  PubMed  Google Scholar 

  • Ramos Murguialday A, Hill J, Bensch M, Martens S, Halder S, Nijboer F, Schoelkopf B, Birbaumer N, Gharabaghi A (2011) Transition from the Locked in to the completely locked-in state: a physiological analysis. Clin Neurophysiol 122:925–933

    Article  PubMed  Google Scholar 

  • Razran G (1961) The observable unconscious and the inferable conscious in current Soviet psychophysiology: interoceptive conditioning, semantic conditioning, and the orienting reflex. Psychol Rev 68:1–147

    Article  CAS  PubMed  Google Scholar 

  • Riehle A, Vaadia E (eds) (2005) Motor cortex in voluntary movements: a distributed system for distributed functions. CRC Press, Boca Raton

  • Rockstroh B, Elbert T, Birbaumer N, Wolf P, Düchting-Röth A, Reker M et al (1993) Cortical self-regulation in patients with epilepsies. Epilepsy Res 14:63–72

    Article  CAS  PubMed  Google Scholar 

  • Schultz W (2013) Updating dopamine reward signals. Curr Opin Neurobiol 23(2):229–238. doi:10.1016/j.conb.2012.11.012. Epub 2012 Dec 22

    Google Scholar 

  • Schultz W, Tremblay L, Hollerman JR (2003) Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 26(6):321–328

    Article  CAS  PubMed  Google Scholar 

  • Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87–115

    Article  PubMed  Google Scholar 

  • Sitaram R, Zhang H, Guan C, Thulasidas M, Hoshi Y, Ishikawa A et al (2007b) Temporal classification of multi-channel near infrared spectroscopy signals of motor imagery for developing a brain-computer interface. Neuro Image 34:1416–1427

    PubMed  Google Scholar 

  • Sitaram R, Caria A, Veit R, Gaber T, Rota G, Kübler A et al (2007a) FMRI brain-computer interface: a tool for neuroscientific research and treatment. Comput Intell Neurosci Article ID 25487. doi:10.1155/2007/25487

  • Skinner F (1953) Science and human behavior. Macmillan, New York

    Google Scholar 

  • Sterman MB, Clemente CD (1962) Forebrain inhibitory mechanisms: cortical synchronization induced by basal forebrain stimulation. Exp Neurol 6:91–102

    Article  CAS  PubMed  Google Scholar 

  • Strehl U, Leins U, Goth G, Klinger C, Hinterberger T, Birbaumer N (2006) Self-regulation of slow cortical potentials—a new treatment for children with attention-deficit/hyperactivity disorder. Pediatrics 118(5):1530–1540

    Article  Google Scholar 

  • Velliste M, Perel S, Spalding MC et al (2008) Cortical control of a prothetic arm for self-feeding. Nature 453:1098–1101

    Article  CAS  PubMed  Google Scholar 

  • Walker JE, Kozlowski G (2005) Neurofeedback treatment of epilepsy. Child Adolesc Psychiatr Clin N Am 14:163–176

    Google Scholar 

  • Weiskopf N, Scharnowski F, Veit R, Goebel R, Birbaumer N, Mathiak K (2005) Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI). J Physiol-Paris 98:357–373

    Article  Google Scholar 

  • Wilhelm B, Jordan M, Birbaumer N (2006) Communication in locked-in syndrome: effects of imagery on salivary pH. Neurology 67:534–535

    Article  CAS  PubMed  Google Scholar 

  • Wittgenstein L (2001) Philosophische untersuchungen. In: Schulte J (ed) Wissenschaftliche Buchgesellschaft, Frankfurt

  • Ziessler M, Nattkemper D, Frensch PA (2004) The role of anticipation and intention in the learning of effects of selfperformed actions. Psychol Res 68:163–175

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

The authors are supported by the Deutsche Forschungsgemeinschaft (DFG), Koselleck–Award, Bundesministerium für Bildung und Forschung (BMBF 01GQ0831), European Research Council (ERC), Motorika, Israel; Baden–Württemberg–Stiftung, Kultusministerium Baden-Württemberg, Volkswagen-Stiftung (VW-Stiftung), EU Project WAY Grant Nr. 288551 Wearable interfaces for hAnd function recoverY (WAY); DGIST Joint Research Program funded by the Ministry of Education, Science and Technology of Republic of Korea.

Conflict of interest

We declare that we have no conflicts of interest.

Author information

Authors and Affiliations

  1. Institute of Medical Psychology and Behavioral Neurobiology, University of Tuebingen, Silcherstr. 5, 72076 , Tübingen, Germany

    Niels Birbaumer

  2. IRCCS - Ospedale San Camillo, Istituto di Ricovero e Cura a Carattere Scientifico, Via Alberoni 70, 30126 , Venezia Lido, Italy

    Niels Birbaumer

  3. Brain Imaging and Neuro stimulation (BINS) Laboratory, Department of Neurology, Universitätsklinikum Hamburg-Eppendorf, Martinistr. 52, 20246 , Hamburg, Germany

    Friedhelm C. Hummel

Authors
  1. Niels Birbaumer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Friedhelm C. Hummel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Niels Birbaumer.

Additional information

This article forms part of a special issue of Biological Cybernetics entitled “Structural Aspects of Biological Cybernetics: Valentino Braitenberg, Neuroanatomy, and Brain Function”.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Birbaumer, N., Hummel, F.C. Habit learning and brain–machine interfaces (BMI): a tribute to Valentino Braitenberg’s “Vehicles”. Biol Cybern 108, 595–601 (2014). https://doi.org/10.1007/s00422-014-0595-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-014-0595-5

Keywords

Search

Navigation