Abstract
This contribution introduces the psychological learning framework of anticipatory behavioral control (ABC). Departing from the premise that almost all behavior of humans and higher animals is goal oriented, the framework proposes that (1) a voluntary action is preceded by a representation of the to-be-attained effect(s), (2) learning of such effect representations is triggered by the comparison of predicted and actual effects resulting in the primary learning of action-effect relations, (3) situational context is integrated secondarily, (4) action-effect representations are activated by the need or desire of an effect-related goal, and (5) conditionalized action-effect relations can also be activated by contingent stimuli. The framework is supported by a variety of experimental studies and an extensive literature survey.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ach, N.: Über den Willensakt und das Temperament: Eine experimentelle Untersuchung. Verlag von Quelle & Meyer, Leipzig (1910)
Allan, L.G.: A note on measurements of contingency between two binary variables in judgment tasks. Bulletin of the Psychonomic Society 15, 147–149 (1980)
Allan, L.G., Jenkins, H.M.: The judgment of contingency and the nature of the response alternatives. Canadian Journal of Psychology 34, 1–11 (1980)
Aschersleben, G., Prinz, W.: Synchronizing actions with events: The role of sensory information. Perception and Psychophysics 57, 305–317 (1995)
Aschersleben, G., Prinz, W.: Delayed auditory feedback in synchronization. Journal of Motor Behavior 29, 35–46 (1997)
Butz, M.V., Hoffmann, J.: Anticipations control behavior: Animal behavior in an anticipatory learning classifier system. Adaptive Behavior (2003) (in press)
Cleeremans, A.: Mechanisms of implicit learning. MIT Press, Cambridge (1993)
Cohen, A., Ivry, R., Keele, S.W.: Attention and structure in sequence learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 16, 17–30 (1990)
Colwill, R.M., Rescorla, R.A.: Postconditioning devaluation of a reinforcer affects instrumental learning. Journal of Experimental Psychology: Animal Behavior Processes 11, 120–132 (1985)
Colwill, R.M., Rescorla, R.A.: Evidence for the hierarchical structure of instrumental learning. Animal Learning & Behavior 18, 71–82 (1990)
Desmurget, M., Grafton, S.: Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Scienc 4, 423–431 (2000)
Dickinson, A.: Instrumental conditioning. In: Mackintosh, N. (ed.) Animal learning and cognition, pp. 45–79. Academic Press, San Diego (1994)
Dickinson, A., Shanks, D.R., Evenden, J.: Judgment of act-outcome contingency: The role of selective attribution. Quarterly Journal of Experimental Psychology 36A, 29–50 (1984)
Elsner, B., Hommel, B.: Effect anticipation and action control. Journal of Experimental Psychology: Human Perception and Performance 27, 229–240 (2001)
Gibson, J.J.: The ecological approach to visual perception. Houghton, Boston (1979)
Gomez, R.L., Schvaneveldt, R.W.: What is learned from artificial grammars? Transfer tests of simple associations. Journal of Experimental Psychology: Learning, Memory, and Cognition 20, 396–410 (1994)
Greenwald, A.G.: Sensory feedback mechanisms in performance control: With special reference to the ideo-motor mechanism. Psychological Review 77, 73–99 (1970)
Harle, E.: Der Apparat des Willens. Zeitschrift für hilosophie und philosophische Kritik 38, 50–73 (1861)
Hazeltine, E.: The representational nature of sequence learning: Evidence for goalbased codes. In: Prinz, W., Hommel, B. (eds.) Common mechanisms in perception and action. Attention and Performance, vol. XIX, pp. 673–689. Oxford University Press, Oxford (2002)
Heckhausen, H., Beckmann, J.: Intentional action and action slips. Psychological Review 97, 36–48 (1990)
Herbart, J.: Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. August Wilhem Unzer, Königsberg, Germany (1825)
Hoffmann, J.: Vorhersage und Erkenntnis: Die Funktion von Antizipationen in der menschlichen Verhaltenssteuerung und Wahrnehmung. [Anticipation and cognition: The function of anticipations in human behavioral control and perception.], Hogrefe, Göttingen, Germany (1993)
Hoffmann, J., Sebald, A.: Lernmechanismen zum Erwerb verhaltenssteuernden Wissens [Learning mechanisms for the acquisation of knowledge for behavioral control]. Psychologische Rundschau 51, 1–9 (2000)
Hoffmann, J., Sebald, A., Stöcker, C.: Irrelevant response effects improve serial learning in serial reaction time tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition 27, 470–482 (2001)
Hommel, B.: The cognitive representation of action: Automatic integration of perceived action effects. Psychological Research 59, 176–186 (1996)
Hommel, B.: Perceiving one’s own action — and what it leads to. In: Jordan, J.S. (ed.) Systems theory and apriori aspects of perception, Systems theory and apriori aspects of perception, pp. 143–179. Elesevier Science B.V, Amsterdam (1998)
James, W.: The Principles of Psychology, vol. 1. Harvard University Press, Cambridge (1981) (orig.1890)
James, W.: The Principles of Psychology, vol. 2. Harvard University Press, Cambridge (1981) (orig.1890)
Koch, I., Hoffmann, J.: Patterns, chunks, and hierarchies in serial reaction time tasks. Psychological Research 63, 22–35 (2000)
Koch, I., Kunde, W.: Verbal response-effect compatibility. Memory and Cognition (2003) (in press)
Kornblum, S., Hasbroucq, T., Osman, A.: Dimensional overlap: Cognitive basis for stimulus response compatibility: A model and taxonomy. Psychological Review 97, 253–270 (1990)
Kunde, W.: Temporal response-effect compatibility. Psychological Research (2003) (in press)
Kunde, W., Hoffmann, J., Zellmann, P.: The impact of anticipated action effects on action planning. Acta Psychologica 109, 137–155 (2002)
Kunde, W., Koch, I., Hoffmann, J.: Anticipated action effects affect the selection, initiation and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology (2003) (in press)
Kunde, W.: Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance 27, 387–394 (2001)
Lewin, K.: Wille, Vorsatz und Bedürfnis. Psychologische Forschung 7, 330–385 (1928)
Lotze, H.: Medizinische Psychologie oder Physiologie der Seele. Weidmann’sche Buchhandlung, Leipzig (1852)
Mandler, G.: Cognitive Psychology. In: An essay in cognitive science, Erlbaum, Hillsdale, NJ (1985)
Münsterberg, H.: Beiträge zur Experimentalpsychologie. Heft 1. J.C.B. Mohr, Freiburg i.B (1889)
Neisser, U.: Cognitive psychology. Appleton, New York (1967)
Nissen, M.J., Bullemer, P.: Attentional requirements of learning: Evidence from performance measures. Cognitive Psychology 19, 1–32 (1987)
Pearce, J.M.: Animal learning and cognition, 2nd edn. Psychology Press, Hove (1997)
Prinz, W.: Ideomotor action. In: Heuer, H., Sanders, A.F. (eds.) Perspectives on perception and action, Erlbaum, Hillsdale, NJ, pp. 47–76 (1987)
Prinz, W.: Perception and action planning. European Journal of Cognitive Psychology 9, 129–154 (1997)
Reber, A.S.: Implicit learning of artificial grammars. Journal of Verbal Learning and Verbal Behavior 6, 855–863 (1967)
Reber, A.S.: Implicit learning and tacit knowledge. Journal of Experimental Psychology: General 118, 219–235 (1989)
Rescorla, R.A.: Evidence for an association between the discriminative stimulus and the response-outcome association in instrumental learning. Journal of Experimental Psychology: Adaptive Behavior Processes 16, 326–334 (1990)
Rescorla, R.A.: Associative relations in instrumental learning: The eighteenth Bartlett memorial lecture. Quarterly Journal of Experimental Psychology 43, 1–23 (1991)
Rescorla, R.A.: Full preservation of a response-outcome association through training with a second outcome. Quarterly Journal of Experimental Psychology 48, 252–261 (1995)
Seger, C.A.: Implicit learning. Psychological Bulletin 115, 163–196 (1994)
Shanks, D.R.: Continuous monitoring of human contingency judgment across trials. Memory and Cognition 13, 158–167 (1985)
Shanks, D.R., Dickinson, A.: Associative accounts of causality judgment. In: Bower, G.H. (ed.) The psychology of learning and motivation, vol. 21, pp. 229–261. Academic Press, San Diego (1987)
Simon, J.R., Rudel, A.P.: Auditory S-R compatibility: The effect of an irrelevant cue on information processing. Journal of Applied Psychology 51, 300–304 (1967)
Stadler, M.A., Frensch, P.A.: Handbook of implicit learning. Sage Publications, Thousand Oaks (1998)
Stock, A., Hoffmann, J.: Intentional fixation of behavioral learning or how R-E learning blocks S-R learning. European Journal of Cognitive Psychology 14, 127–153 (2002)
Stöcker, C., Sebald, A., Hoffmann, J.: The influence of response effect compatibility in a serial reaction time task. Quarterly Journal of Experimental Psychology (2003) (in press)
Stolzmann, W.: Antizipative Classifier Systems [Anticipatory classifier systems]. Shaker Verlag, Aachen (1997)
Stolzmann, W.: An introduction to anticipatory classifier systems. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) Learning Classifier Systems: From Foundations to Applications, pp. 175–194. Springer, Heidelberg (2000)
Sutton, R.S., Barto, A.G.: Reinforcement learning: An introduction. MIT Press, Cambridge (1998)
Thorndike, E.L.: Animal intelligence: Experimental studies. Macmillan, New York (1911)
Tolman, E.C.: Purposive Behavior in animals and men. Appleton, New York (1932)
Tolman, E.C.: There is more than one kind of learning. Psychological Review 5b, 144–155 (1949)
Tolman, E.C., Honzik, C.: Introduction and removal of reward, and maze performance in rats. University of California, Publications in Psychology 4, 257–275 (1930)
Wasserman, E.A., Chatlosh, D.L., Neunaber, D.J.: Perception of causal relations in humans: Factors affecting judgments of interevent contingencies under freeoperant procedures. Learning and Motivation 14, 406–432 (1993)
Wasserman, E.A., Elek, S.M., Chatlosh, D.L., Baker, A.G.: Rating causal relations: Role of probability in judgments of response-outcome contingency. Journal of Experimental Psychology: Learning, Memory, and Cognition 19, 174–188 (1993)
Watson, J.B.: Psychology from the standpoint of a behaviorist, Lippincott, Philadelphia, vol. 2 (1924)
Watson, J.: Psychology as a behaviorist views it. Psychological Review 20, 158–177 (1913)
Ziessler, M.: Response-effect learning as a major component of implicit serial learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 24, 962–978 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Hoffmann, J. (2003). Anticipatory Behavioral Control. In: Butz, M.V., Sigaud, O., Gérard, P. (eds) Anticipatory Behavior in Adaptive Learning Systems. Lecture Notes in Computer Science(), vol 2684. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45002-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-540-45002-3_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40429-3
Online ISBN: 978-3-540-45002-3
eBook Packages: Springer Book Archive