Skip to main content
SpringerLink
Log in

Filling gaps in simulation of complex systems: the background and motivation for CoSMoS

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

Modelling and simulation of complex systems can create scientific research tools that allow the inaccessible dynamic aspects of systems to be explored in ways that are not possible in live systems. In some scientific contexts, there is a need to be able to create and use such simulations to explore and generate hypotheses alongside conventional laboratory research. The principled complex systems modelling and simulation (CoSMoS) approach was created to support these activities, as a response to a perceived gap in the software engineering development process for simulation. The article presents some of the software engineering motivation for CoSMoS, by exploring this perceived gap. Following from this analysis, the article considers the validation of complex systems simulators, especially where these are to be used in ongoing research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • ACE (2014) http://www.econ.iastate.edu/tesfatsi/ace.htm. Cited 26 February 2014

  • Albergante L, Timmis J, Beattie L, Kaye PM (2013) A Petri net model of granulomatous inflammation: implications for IL-10 mediated control of Leishmania donovani infection. PLoS Comput Biol 9(11):e1003334

    Article  Google Scholar 

  • Alden K (2012) Simulation and statistical techniques to explore lymphoid tissue organogenesis. PhD thesis, University of York, 2012. http://etheses.whiterose.ac.uk/3220/

  • Alden K, Read M, Timmis J, Andrews P, Veiga-Frenandes H, Coles M (2013) Spartan: a comprehensive tool for understanding uncertainty in simulations of biological systems. PLoS Comput Biol 9(2):e1002916

  • Alden K, Timmis J, Andrews PS, Veiga-Fernandes H, Coles MC (2012) Pairing experimentation and computational modeling to understand the role of tissue inducer cells in the development of lymphoid organs. Front Immunol 3:172. doi:10.3389/fimmu.2012.00172

  • Alexander R (2007) Using simulation for systems of systems hazard analysis. PhD thesis, Department of Computer Science, University of York

  • Alexander R, Alexander-Bown R, Kelly T (2008) Engineering safety-critical complex systems. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 33–63

  • Andrews PS, Polack F, Sampson AT, Timmis J, Scott L, Coles M (2008) Simulating biology: towards understanding what the simulation shows. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 93–123

  • Andrews PS, Polack FAC, Sampson AT, Stepney S, Timmis J (2010) The CoSMoS process, version 0.1. Technical report YCS-2010-450, Dept of Computer Science, Univ. of York. www.cs.york.ac.uk/ftpdir/reports/2010/YCS/453/YCS-2010-453.pdf

  • Andrews PS, Stepney S, Hoverd T, Polack FAC, Sampson AdamT, Timmis J (2011) Cosmos process, models and metamodels. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 1–14

  • Bersini H (2006) Immune systems modeling: the OO way. In: ICARIS, volume 4163 of LNCS. Springer, Berlin, pp 151–163

  • Bersini H (2012) UML for ABM. J Artif Soc Soc Simul 15(1):9

  • Bryden J, Noble J (2006) Computational modelling, explicit mathematical treatments, and scientific explanation. In: Artificial life X. MIT Press, Cambridge, pp 520–526

  • CCTA (1990) SSADM Version 4 reference manual. NCC Blackwell, Oxford

  • Coakley S, Gheorghe M, Holcombe M, Chin S, Worth D, Greenough C (2012) Exploitation of high performance computing in the FLAME agent-based simulation framework. In: High performance computing and communications, IEEE 9th international conference on embedded software and systems (HPCC-ICESS), New York, pp 538–545

  • Coakley S, Smallwood R, Holcombe M (2006) From molecules to insect communities—how formal agent based computational modelling is uncovering new biological facts. Sci Math Jpn 64(2):185–198

  • Di Paolo E, Noble J, Bullock S (2000) Simulation models as opaque thought experiments. In Artificial Life VII. MIT Press, Cambridge, MA, pp 497–506

  • Droop A, Garnett P, Polack FAC, Stepney S (2011) Multiple model simulation: modelling cell division and differentiation in the prostate. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 79–112

  • Epstein JM (1999) Agent-based computational models and generative social science. Complexity 4(5):41–60

    Article  MathSciNet  Google Scholar 

  • Flame. http://www.flame.ac.uk/docs/overview.html. Cited 26 February 2014

  • Forrester JM, Greaves RB, Polack FAC (2012) CoSMoS in the context of social ecological research. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 47–76

  • Garnett P, Steinacher A, Stepney S, Clayton R, Leyser O (2010a) Computer simulation: the imaginary friend of auxin transport biology. BioEssays News Rev Mol Cell Dev Biol 32(9):828–835

    Article  Google Scholar 

  • Garnett P, Stepney S, Day F, Leyser O (2010b) Using the CoSMoS process to enhance an executable model of auxin transport canalisation. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 9–32

  • Garnett P, Stepney S, Leyser O (2008) Towards an executable model of auxin transport canalisation. In Workshop on complex systems modelling and simulation. Luniver Press, pp 63–92

  • Ghetiu T, Alexander RD, Andrews PS, Polack FAC, Bown J (2009) Equivalence arguments for complex systems simulations - a case-study. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 101–140

  • Ghetiu T, Polack FAC, Bown J (2010) Argument-driven validation of computer simulations - a necessity rather than an option. In VALID, IEEE Press, New York, pp 1–4

  • Greaves RB, Read M, Timmis J, Andrews PS, Butler JA, Gerckens B, Kumar V (2013) In silico investigation of novel biological pathways: the role of CD200 in regulation of T cell priming in experimental autoimmune encephalomyelitis. Biosystems. doi:10.1016/j.biosystems.2013.03.007

    MATH  Google Scholar 

  • Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, Goss-Custard J, Grand T, Heinz SK, Huse G (2006) A standard protocol for describing individual-based and agent-based models. Ecol Model 198(1–2):115–126

    Article  Google Scholar 

  • Grimm V, Berger U, DeAngelis DL, Polhill JG, Railsback SF (2010) The ODD protocol: a review and first update. Ecol Model 221(23):2760–2768

    Article  Google Scholar 

  • HSE (2014) http://www.hse.gov.uk/risk/index.htm. Cited 26 February 2014

  • Karr JR, Sanghvi JC, Macklin DN, Gutschow MV, Jacobs JM, Bolival B, Assad-Garcia N, Glass JI, Covert MW (2012) A whole-cell computational model predicts phenotype from genotype. Cell 150(2):389–401

    Article  Google Scholar 

  • Kelly TP (1999) Arguing safety - a systematic approach to managing safety cases. PhD thesis, Department of Computer Science, University of York, 1999. YCST 99/05

  • MASON (2014) http://cs.gmu.edu/eclab/projects/mason/. Cited 26 February 2014

  • McEwan CH, Klatzmann D, Thomas-Vaslin V, Six A (2011) Refitting Harel statecharts for systemic mathematical models in computational immunology. In ICARIS, volume 6825 of LNCS. Springer, Berlin

  • Miller GF (1995) Artificial life as theoretical biology: How to do real science with computer simulation. Technical report cognitive science research paper 378. School of Cognitive and Computing Sciences, University of Sussex

  • Moore J, Moyo D, Beattie L, Andrews P, Timmis J, Kaye P (2013) Functional complexity of the Leishmania granuloma and the potential of in silico modelling. Front Immun 4(35). doi:10.3389/fimmu.2013.00035

  • Nance RE, Sargent RG (2002) Perspectives on the evolution of simulation. Oper Res 50(1):161–172

    Article  MATH  MathSciNet  Google Scholar 

  • Naylor TH, Finger JM (1967) Verification of computer simulation models. Manag Sci 14(2):B-92–B-101

    Article  Google Scholar 

  • Odell J (2002) Objects and agents compared. J Object Technol 1:41–53

    Article  Google Scholar 

  • OpenABM (2014) http://www.openabm.org/. Cited 26 February 2014

  • OpenWorm (2014) http://www.artificialbrains.com/openworm. Cited 26 February 2014

  • Origin Consulting (York) (2011) GSN community standard version 1. Technical report, Department of Computer Science, University of York. http://www.goalstructuringnotation.info

  • Padgham L, Winikoff M (2003) Prometheus: A methodology for developing intelligent agents. In AOSE, volume 2585 of LNCS, Springer, Berlin, pp 174–185

  • Polack FAC (2010) Arguing validation of simulations in science. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 51–74

  • Polack FAC (2012) Choosing and adapting design notations in the principled development of complex systems simulations for research. In: Modelling the physical world at models. ACM Digitial Library

  • Polack FAC, Andrews PS, Ghetiu T, Read M, Stepney S, Timmis J, Sampson AT (2010) Reflections on the simulation of complex systems for science. In ICECCS, IEEE Press, New York, pp 276–285

  • Polack FAC, Droop A (2014) Principled simulation of cell proliferation dynamics using the CoSMoS approach. (Submitted)

  • Polack FAC, Droop A, Garnett P, Ghetiu T, Stepney S (2011) Simulation validation: exploring the suitability of a simulation of cell division and differentiation in the prostate. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 113–133

  • Read M, Andrews PS, Timmis J, Kumar V (2009a) A domain model of Experimental Autoimmune Encephalomyelitis. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 9–44

  • Read M, Andrews PS, Timmis J, Kumar V (2009b) Using UML to model EAE and its regulatory network. In: ICARIS, volume 5666 of LNCS. Springer, Berlin

  • Read M, Andrews PS, Timmis J, Kumar V (2012) Techniques for grounding agent-based simulations in the real domain: a case study in experimental autoimmune encephalomyelitis. Math Comput Model Dyn Syst 18(1):67–86

    Article  MATH  Google Scholar 

  • Read MN (2011) Statistical and modelling techniques to build confidence in the investigation of immunology through agent-based simulation. PhD thesis, University of York

  • Rumbaugh J, Blaha M, Premerlani W, Eddy F, Lorensen W (1991) Object-oriented modelling and design. Prentice Hall, Englewood Cliffs, NJ

    Google Scholar 

  • Sargent RG (1985) An exposition on verification and validation of simulation models. In: 17th winter simulation conference, ACM, pp 15–22

  • Sargent RG (1986) The use of graphical models in model validation. In: 18th winter simulation conference. ACM, pp 237–241

  • Sargent RG (2005) Verification and validation of simulation models. In: 37th winter simulation conference. ACM, pp 130–143

  • Schmolke A, Thorbek P, DeAngelis DL, Grimm V (2010) Ecological models supporting environmental decision making: a strategy for the future. Trends Ecol Evolut 25(8):479–486

    Article  Google Scholar 

  • Shoham Y (1993) Agent-oriented programming. Artif Intell 60:51–92

    Article  MathSciNet  Google Scholar 

  • Stepney S (2012) A pattern language for scientific simulations. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 77–103

  • Stepney S (2013) CoSMoS simulation experiment reproducibility and the ODD protocol. In: Workshop on complex systems modelling and simulation. Luniver Press, pp 93–107

  • Stevens P, Pooley R (2006) Using UML, 2nd ed. Pearson Education Ltd, UK

  • Sudeikat J, Braubach L, Pokahr A, Lamersdorf W (2004) Evaluation of agent-oriented software methodologies - examination of the gap between modeling and platform. In AOSE, volume 3382 of LNCS. Springer, Berlin, pp 126–141

  • Tesfatsion L (2006) Agent-based computational economics: A constructive approach to economic theory, 2005. Subsequently published In: Tesfatsion L, Judd KL (eds) Handbook of computational economics, vol 2, Elsevier, Amsterdam. http://www2.econ.iastate.edu/tesfatsi/hbintlt.pdf

  • Vargha A, Delaney HD (2000) A critique and improvement of the CL common language effect size statistics of McGraw and Wong. J Educ Behav Stat 25(2):101–132

    Google Scholar 

  • Wheeler M, Bullock S, Di Paolo E, Noble J, Bedau M, Husbands P, Kirby S, Seth A (2002) The view from elsewhere: perspectives on ALife modelling. Artif Life 8(1):87–100

    Article  Google Scholar 

  • WholeCell (2014) https://simtk.org/home/wholecell. Cited 26 February 2014

  • Williams RA, Greaves R, Read M, Timmis Jon, Andrews PS, Kumar V (2013) In silico investigation into dendritic cell regulation of CD8Treg mediated killing of Th1 cells in murine experimental autoimmune encephalomyelitis. BMC Bioinform 14(Suppl 6):S9

    Google Scholar 

  • Wilson S, McDermid J, Fenelon P, Kirkham P (1995) No more spineless safety cases: A structured method and comprehensive tool support for the production of safety cases. In: 2nd international conference on control and instrumentation in nuclear installations (INEC’95)

  • Wilson SP, McDermid JA (1995) Integrated analysis of complex safety critical systems. Comput J 38(10):765–776

  • YCIL. Artoo argumentation tool. http://www-users.cs.york.ac.uk/psa/arg-tool/argumentation.html. Cited 26 February 2014

  • Zeigler BP (1999) A theory-based conceptual terminology for M&S VV&A. Technical report 99S-SIW-064, Arizona Center for Integrative Modeling and Simulation. www.acims.arizona.edu/PUBLICATIONS/publications.shtml

Download references

Acknowledgments

Much of the work reported in this paper was undertaken as part of the EPSRC CoSMoS project, Grants EP/E053505/1 and EP/E049419/1. Thanks are due to the anonymous reviewers, and to Adam Sampson, for detailed comments and reminders of bits of CoSMoS motivation that I had overlooked.

Author information

Authors and Affiliations

  1. Department of Computer Science, YCCSA, University of York, York, YO10 5DD, UK

    Fiona Polack

Authors
  1. Fiona Polack
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fiona Polack.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Polack, F. Filling gaps in simulation of complex systems: the background and motivation for CoSMoS. Nat Comput 14, 49–62 (2015). https://doi.org/10.1007/s11047-014-9462-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11047-014-9462-5

Keywords

Search

Navigation