Skip to main content

Validation and Verification of Agent-Based Models in the Social Sciences

  • Conference paper
Epistemological Aspects of Computer Simulation in the Social Sciences (EPOS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5466))

  • 1789 Accesses

Abstract

This paper considers some of the difficulties in establishing verificaction and validation of agent based models. The fact that most ABMs are solved by simulation rather than analytically blurs the distinction between validation and verification. We suggest that a clear description of the phenomena to be explained by the model and testing for the simplest possible realistic agent rules of behaviour are key to the successful validation of ABMs and will provide the strongest base for enabling model comparison and acceptance. In particular, the empirical evidence that in general agents act intuitively rather than rationally is now strong. This implies that models which assign high levels of cognition to their agents require particularly strong justification if they are to be considered valid.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Atkinson, A.B.: The Timescale of Economic Models: How Long is the Long Run? Review of Economic Studies 36, 137–152 (1969)

    Article  Google Scholar 

  2. Axelrod, R.: Advancing the Art of Simulation in the Social Sciences. In: Conte, R., Hegelsmann, R., Terna, P. (eds.) Simulating Social Phenomena, Berlin, pp. 21–40. Springer, Heidelberg (1997)

    Chapter  Google Scholar 

  3. Dosi, G., Fagiolo, G., Roventini, A.: An Evolutionary Model of Endogenous Business Cycles. Computational Economics 27(1), 3–34 (2006)

    Article  MATH  Google Scholar 

  4. Kahenman, D.: Maps of Bounded Rationality: A Perspective on Intuitive Judgement and Choice. American Economic Review 93, 1449–1475 (2003)

    Article  Google Scholar 

  5. McNamara, L., Trucano, T., Backus, G.: Verification and Validation as Applied Epistemology. In: Proceedings of the UCLA Conference on Human Complex Systems (April 2007), http://hcs.ucla.edu/arrowhead.htm

  6. Ormerod, P.: The US business cycle: power law scaling for interacting units with complex internal structure. Physica A 314, 774–785 (2002)

    Article  MATH  Google Scholar 

  7. Ormerod, P.: Information cascades and the distribution of economic recessions in capitalist economies. Physica A 341, 556–568 (2004)

    Article  MathSciNet  Google Scholar 

  8. Ormerod, P., Rosewell, B.: What can firms know?, plenary talk. In: Proc. NAACSOS conference, Pittsburgh (2003)

    Google Scholar 

  9. Ormerod, P., Rosewell, B.: On the Methodology of Assessing Agent Based Models in the Social Sciences. In: Metcalfe, J.S., Foster, J. (eds.) Evolution and Economic Complexity, Edward Elgar, Cheltenham (2004)

    Google Scholar 

  10. Pilch, M., Trucano, T., Moya, J., Groehlich, G., Hodges, A., Peercy, D.: Guidelines for Sandia ASCI Verification and Validation Plans – Content and Format: Version 2.0., Albuquerque, NM: Sandia National Laboratories, SAND 2000–3101 (2000)

    Google Scholar 

  11. Rand, W., Wilensky, U.: Verification and Validation through Replication: A Case Study Using Axelrod and Hammond’s Ethnocentrism Model. In: Proc. NAACSOS (2006)

    Google Scholar 

  12. Rosewell, B., Horton, A.: Neighbours are not enough. In: European Conference on Complex Systems, Oxford (2006)

    Google Scholar 

  13. Smith, V.L.: Constructivist and Ecological Rationality in Economics. American Economic Review 93, 465–508 (2003)

    Article  Google Scholar 

  14. Stewart, I.: From Here to Infinity. Oxford University Press, Oxford (1996)

    MATH  Google Scholar 

  15. Windrum, P., Fagiolo, G., Moneta, A.: Empirical Validation of Agent-Based Models: Alternatives and Prospects. Journal of Artificial Societies and Social Simulation 10, 2 (2007)

    Google Scholar 

  16. Wright, I.: The social architecture of capitalism. Physica A 346, 589–620 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ormerod, P., Rosewell, B. (2009). Validation and Verification of Agent-Based Models in the Social Sciences. In: Squazzoni, F. (eds) Epistemological Aspects of Computer Simulation in the Social Sciences. EPOS 2006. Lecture Notes in Computer Science(), vol 5466. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01109-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01109-2_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01108-5

  • Online ISBN: 978-3-642-01109-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics