Skip to main content

Interactive Learning Neural Networks for Predicting Game Behavior

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5551))

Abstract

Game theory is an interdisciplinary approach to the study of human behavior. Games describe a widely accepted framework for representing interactive decision-making. Artificial Neural Networks (ANNs) are universal approximators and have the ability of learning. Combining ANNs with game representation, we introduced a new architecture by which the learning abilities of ANNs are utilized to predict game behavior. Based on previous work, we investigated further the potential value of neural networks for modeling and predicting human interactive learning in repeated games. We conducted simulation studies based on the new model using experiments data which are provided by authors other than this paper. Through computer simulations and comparing with other models, we demonstrated that our model is superior in many respects to other models on ten experiments.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hu, X., Wang, J.: A Recurrent Neural Network for Solving a Class of General Variational Inequalities. IEEE Transactions on Systems, Man and Cybernetics 37(3), 528–539 (2007)

    Article  Google Scholar 

  2. Liu, Q., Wang, J.: A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming. IEEE Transactions on Neural Networks 19(3), 558–570 (2008)

    Google Scholar 

  3. Cohen, M.D.: Learning with Regret. Science 319, 1052–1053 (2008)

    Article  Google Scholar 

  4. Erev, I., Roth, A.: Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed-strategy Equilibria. Am. Econ. Rev. 88, 848–881 (1998)

    Google Scholar 

  5. Erev, I., Roth, A., Slonim, L., Barron, G.: Learning and Equilibrium as Useful Approximations: Accuracy of Prediction on Randomly Selected Constant Sum Games. Econ. Theory 33, 29–51 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  6. Camerer, C., Ho, T.H.: Experience-weighted Attraction Learning in Formal Games. Econometrica 67, 827–874 (1999)

    Article  MATH  Google Scholar 

  7. Ho, T.-H., Camerer, C., Chong, J.-K.: Self-tuning Experience-weighted Attraction Learning in Games. J. of Econ. Theory 133, 177–198 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  8. Ert, E., Erev, I.: Replicated Alternatives and the Role of Confusion, Chasing and Regret in Decisions from Experience. J. Behav. Decision Making 20, 305–322 (2007)

    Article  Google Scholar 

  9. Marchiori, D., Warglien, M.: Predicting Human Interactive Learing by Regret-Driven Neural Networks. Science 319, 1111–1113 (2008)

    Article  Google Scholar 

  10. Camerer, C.F.: Behavioral Game Theory: Experiments on Strategic Interaction Princeton. Princeton University Press, NJ (2003)

    MATH  Google Scholar 

  11. Nash, J.F.: Equilibrium Points in N-Person Games. Mathematics 36, 48–49 (1950)

    MathSciNet  MATH  Google Scholar 

  12. Hertz, J., Krogh, A., Palmer, R.G.: Introduction to the Theory of Neural Computation. Addison-Wesley, Redwood City (1991)

    Google Scholar 

  13. Hopfield, J.J.: Learning Algorithms and Probability Distributions in Feed-forward and Feed-back Networks. Proc. Natl. Acad. Sci. U.S.A. 84, 8429–8433 (1987)

    Article  MathSciNet  Google Scholar 

  14. Selten, R., Stöcker, R.: End behavior in Sequences of Finite Prisoner’s Dilemma Supergames a learning Theory Approach. J. Econ. Behav. Organ. 7, 47–70 (1986)

    Article  Google Scholar 

  15. Camille, N., et al.: The Involvement of the Orbitofrontal Cortex in the Experience of Regret. Science 304, 1167–1170 (2004)

    Article  Google Scholar 

  16. Coricelli, G., et al.: Regret and Its Avoidance: a Neuroimaging Study of Choice Behavior. Nat. Neurosci. 8, 1255–1262 (2005)

    Article  Google Scholar 

  17. Lee, D.: Neuroeconomics Best to Go with What You Know. Nature 441, 822–823 (2006)

    Article  Google Scholar 

  18. Selten, R.: Axiomatic Characterization of the Quadratic Scoring Rule. Exp. Econ. 1, 43–61 (1998)

    Article  MATH  Google Scholar 

  19. Erev, I., Roth, A., Slonim, L., Barron, G.: Predictive Value and the Usefulness of Game Theoretic Models. Int. J. of Forecasting 18, 359–368 (2002)

    Article  Google Scholar 

  20. Lieberman, B., Malcom, D.: The Behavior of Responsive Individuals Playing a two- person, Zero Sum Game Requiring the Use of Mixed Strategies. Psychonomic Science 12, 373–374 (1965)

    Google Scholar 

  21. O’Neill, B.: Nunmetric Test of the Minimax Theory of Two Person Zerosum Games. Proc. Natl. Acad. Sciences U.S.A. 84, 2106–2109 (1987)

    Article  MATH  Google Scholar 

  22. Avrahami, J., Guth, W., Kareev, Y.: Games of Competition in a Stochastic Environment. Theory and Decision 59, 255–294 (2005)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sun, Q., Ren, G., Qi, X. (2009). Interactive Learning Neural Networks for Predicting Game Behavior. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01507-6_87

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01507-6_87

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01506-9

  • Online ISBN: 978-3-642-01507-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics