Abstract
Simulation models in general and system dynamics type simulation models in particular have become increasingly popular in the analysis of important policy issues in business organizations. The usefulness of these models is predicated on their ability to link patterns of behavior of a system to the underlying structures of the system. Despite their capabilities, the acceptance of system dynamics simulation models by the broader community of modelers and decision makers is limited. We argue that reluctance by the system dynamics modelers to expose their models to formal validity procedures is the main problem. This leads to an exploration of formal validity procedures available but less explored in system dynamics modeling ‘repertoire’. An illustration of the application of tests for both the structural and behavior validity of a system dynamics simulation model follows. Finally, some conclusions on the increased appeal for simulation models for the wider community of model builders and users are drawn.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barlas, Y. (1989). Multiple tests for validations of system dynamics type of simulation models. European Journal of Operational Research, 42(1), 59–87.
Barlas, Y., & Carpenter, S. (1990). Philosophical roots of model validation: Two paradigms. System Dynamics Review, 6(2), 148–166.
Bunn, D., & Larsen, E. (1992). Sensitivity reserve margin to factors influencing investment behavior in the electricity market of England and Wales. Energy Policy, 29, 420–429.
Bunn, D., Larsen, E., & Vlahos, K. (1997). Complementary modeling approaches for analyzing several effects of privatization. In D. Bunn & E. R. Larsen (Eds.), Systems modeling for energy policy (pp. 303–325). Chichester: Wiley.
Coyle, G., & Exelby, D. (2000). The validation of commercial system dynamics models. System Dynamics Review, 16(1), 27–41.
Curry, G. L., Deuermeyer, B. L., & Feldman, R. M. (1989). Discrete simulation. Oakland: Holden-Day.
Dyner, I., Smith, R., & Pena, G. (1995). System dynamics modeling for energy efficiency analysis and management. The Journal of the Operational Research Society, 46(10), 1163–1173.
Finlay, P., & Wilson, J. (1987). The paucity of model validation in operational research projects. The Journal of the Operational Research Society, 38, 303–308.
Ford, A. (1983). Using simulation for policy evaluation in the electric utility industry. Simulation, 40(3), 85–92.
Ford, A. (1985). Short lead time technologies as a defense against demand uncertainty. In J. Plummer, E. Oatman, & P. Gupta (Eds.), Strategic management and planning for electric utilities. Englewood Cliffs: Prentice Hall.
Forrester, J. W. (1961). The model versus modeling process. System Dynamics Review, 1(2), 133–134.
Forrester, J. W., & Senge, P. M. (1980). Tests for building confidence in system dynamics models. TIME Studies in the Management Science, 14, 209–228.
Gass, S. I. (1983). Decision-aiding models: validation, assessment, and related issues for policy analysis. Operations Research, 31(4), 603–631.
Goodall, D. W. (1972). Building and testing ecosystem models. In J. N. J. Jeffers (Ed.), Mathematical models in ecology (pp. 173–194). Oxford: Blackwell.
Kleindorfer, G. B., O’Neill, L., & Ganeshan, R. (1998). Validation in simulations: Various positions in the philosophy of science. Management Science, 44(8), 1087–1099.
Lane, D. C. (1995). The folding star: a comparative reframing and extension of validity concepts in system dynamics. In T. Shimada & K. Saeed (Eds.), Proceedings of the 1995 international system dynamics conference (pp. 111–130). Tokyo: Gakushuin University.
Law, A. M., & Kelton, W. D. (2000). Simulation modeling and analysis (3rd ed., p. 265). Fairfield: McGraw-Hill.
Moxnes, E. (1990). Inter-fuel substitution in OECD—European electricity production. System Dynamics Review, 6(1), 44–65.
Naill, R. (1992). A system dynamics model for national energy policy planning. System Dynamics Review, 8(1), 1–19.
Oliva, R. (2003). Model calibration as a testing strategy for system dynamics models. European Journal of Operational Research, 151, 552–568.
Pidd, M. (2010). Why modeling and model use matter. The Journal of the Operational Research Society, 1, 14–24.
PEY (2006). Pakistan Energy Yearbook 2005. Ministry of Petroleum and Natural Resources, Govt. of Pakistan, Islamabad (pp. 111–130).
Qudrat-Ullah, H. (2005). MDESRAP: a model for understanding the dynamics of electricity supply, resources, and pollution. International Journal of Global Energy Issue, 23(1), 1–14.
Qudrat-Ullah, H. (2008). Behavior validity of a simulation model for sustainable development. International Journal of Management and Decision Making, 9(2), 129–139.
Qudrat-Ullah, H., & BaekSeo, S. (2010). How to do structural validity of a system dynamics type simulation model: The case of an energy policy model. Energy Policy. doi:10.1016/j.enpol.2009.12.009.
Sterman, J. D. (1984). Appropriate summary statistics for evaluating the historical fit of system dynamics models. Dynamica, 10 (Winter), 51–66.
Sterman, J. D. (2000). Business dynamics: systems thinking and modeling for a complex world. New York: McGraw-Hill.
Zebda, A. (2002). Using cost-benefit analysis for evaluating decision models in operational research. Journal of American Academy of Business, September, 106–114.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Qudrat-Ullah, H. On the validation of system dynamics type simulation models. Telecommun Syst 51, 159–166 (2012). https://doi.org/10.1007/s11235-011-9425-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11235-011-9425-4