Skip to main content
Springer Nature Link
Log in

Axioms for a Class of Algorithms of Sequential Decision Making

  • Conference paper
Algorithmic Decision Theory (ADT 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5783))

Included in the following conference series:

  • 1088 Accesses

Abstract

We axiomatically characterise a class of algorithms for making sequential decisions in situations of complete ignorance. These algorithms assume that a decision maker (DM) (human or or a software agent) has exogenously defined utilities for prizes and she uses the empirical distribution of prizes to calculate the “expected utility” of each action maximising this expected utility at each stage of the decision making process. We show that this class of algorithms is defined by three simple axioms that highlight the independence of the given actions, the bounded rationality of the agent, and the principle of insufficient reason at margin.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Anscombe, F., Aumann, R.: A definition of subjective probabiliy. Annals of Mathematical Statistics 34, 199–205 (1963)

    Article  MathSciNet  Google Scholar 

  2. Börgers, T., Morales, A.J., Sarin, R.: Expedient and monotone learning rules. Econometrica 72(2), 383–405 (2004)

    Article  MathSciNet  Google Scholar 

  3. Brown, G.W.: Iterative solutions of games by fictitious play. In: Koopmans, T.C. (ed.) Activity Analysis of Production and Allocation, pp. 374–376. Wiley, New York (1951)

    Google Scholar 

  4. Easley, D., Rustichini, A.: Choice without beliefs. Econometrica 67(5), 1157–1184 (1999)

    Article  MathSciNet  Google Scholar 

  5. Fudenberg, D., Levine, D.K.: The Theory of Learning in Games. MIT Press, Cambridge (1998)

    MATH  Google Scholar 

  6. Gale, D.: The Theory of Linear Economic Models. McGraw-Hill, New-York (1960)

    MATH  Google Scholar 

  7. Gigerenzer, G., Selten, R.: Bounded Rationality: The Adaptive Toolbox. MIT Press, Cambridge (2002)

    Book  Google Scholar 

  8. Gilboa, I., Schmeidler, D.: A theory of case-based decisions. Cambridge University Press, Cambridge (2001)

    Book  Google Scholar 

  9. Gilboa, I., Schmeidler, D.: Inductive Inference: An Axiomatic Approach. Econometrica 71(1), 1–26 (2003)

    Article  MathSciNet  Google Scholar 

  10. Lettau, M., Uhlig, H.: Rules of thumb and dynamic programming. Tilburg University Discussion Paper (1995)

    Google Scholar 

  11. Milnor, J.H.: Games against nature. In: Davis, C.H., Coombs, R.M., Thrall, R.L. (eds.) Decision Processes, pp. 49–60. John Wiley & Sons, Inc., Chichester (1954)

    Google Scholar 

  12. Savage, L.J.: The Foundations of Statistics. Harvard University Press, Cambridge (1954)

    MATH  Google Scholar 

  13. Schlag, K.H.: Why imitate, and if so, how? A boundedly rational approach to multi-armed bandits. Journal of Economic Theory 78(1), 130–156 (1998)

    Article  MathSciNet  Google Scholar 

  14. Sertel, M.R., Slinko, A.: Ranking Committees, Words or Multisets. Economic Theory 30(2), 265–287 (2007)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Economics Discipline, University of Sydney, NSW, 2006, Australia

    Murali Agastya

  2. Department of Mathematics, The University of Auckland, Private Bag, 92019, Auckland, New Zealand

    Arkadii Slinko

Authors
  1. Murali Agastya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arkadii Slinko
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Pure and Applied Mathematics, University of Padova, Via Trieste 63, 35121, Padova, Italy

    Francesca Rossi

  2. LAMSADE-CNRS, University of Paris Dauphine, Place du Maréchal De Lattre de Tassigny, 75775, Paris Cedex 16, France

    Alexis Tsoukias

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Agastya, M., Slinko, A. (2009). Axioms for a Class of Algorithms of Sequential Decision Making. In: Rossi, F., Tsoukias, A. (eds) Algorithmic Decision Theory. ADT 2009. Lecture Notes in Computer Science(), vol 5783. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04428-1_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04428-1_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04427-4

  • Online ISBN: 978-3-642-04428-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics