Skip to main content
SpringerLink
Log in

From Testing to Theorem Proving

  • Chapter
Multiagent Engineering

Part of the book series: International Handbooks on Information Systems ((INFOSYS))

Abstract

Verification and validation of software systems are essential aspects in the software development life-cycle. However, verifying AI software is difficult as it suffers from non-determinism. In multiagent systems, this problem is increased by the known problems of verifying concurrent, distributed or object-oriented systems. On the basis of challenges for verification of multiagent systems, approaches for testing, runtime monitoring, static analysis, model checking, and theorem proving are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barringer, H.; Goldberg, A.; Havelund, K.; Sen, K.: Rule-based runtime verfication. In: Fifth International Conference on Verfication, Model Checking and Abstract Interpretation (VMCAI 2004). Venice, Italy, 2004.

    Google Scholar 

  2. Beck, K.: Test Driven Development by Example. Addison-Wesley Professional, 2002.

    Google Scholar 

  3. Beck, K.; Andres, C.: Extreme Programming Explained. Addison-Wesley Professional, 2004.

    Google Scholar 

  4. Booch, G.: Objektorientierte Analyse und Design. Addison-Wesley, Bonn, Paris, 1994.

    MATH  Google Scholar 

  5. Brat, G.; Giannakopoulou, D.; Goldberg, A.; Havelund, K.; Lowry, M.; Pasareanu, C.; Venet, A.; Visser, W.: Experimental evaluation of verfication and validation tools on martian rover software. In: CMU/SEI Software Model Checking. Pittsburg, USA, 2003. Extended version to appear in Formal Methods in System Design.

    Google Scholar 

  6. Braubach, L.; Pokahr, A.; Lamersdorf, W.; Moldt, D.: Goal Representation for BDI Agent Systems. In: Bordini, R. H.; Dastani, M.; Dix, J.; Fallah-Seghrouchni, A. E. (Eds.): Proceedings of the Second International Workshop on Programming Multiagent Systems: Languages and Tools. New York, pp. 9–20.

    Google Scholar 

  7. Cabac, L.; Moldt, D.: Formal Semantics for AUML Agent Interaction Protocols Diagrams. In: Odell, J.; Giorgini, P.; Müller, J. P. (Eds.): Agent-Oriented Software Engineering V. 5th International Workshop (AOSE 2004). Springer, Berlin, Heidelberg, New York, pp. 47–61.

    Google Scholar 

  8. Clarke, E.; Grumberg, O.; Peled, D.: Model Checking. MIT Press, 2000.

    Google Scholar 

  9. Clarke, E.; Emerson, E. M.: Synthesis of Synchronization Skeletons for Branching Time Temporal Logic. In: Logics of Programs, Workshop. Lecture Notes in Computer Science 131. Springer Verlag, New York, 1981.

    Google Scholar 

  10. DeLoach, S. A.; Wood, M. F.; Sparkman, C. H.: Multiagent systems engineering. In: International Journal of Software Engineering and Knowledge Engineering 11(2001)3, pp. 231–258.

    Article  Google Scholar 

  11. Dijkstra, E. W.: The Programming Task Considered as an Intellectual Challenge. Transcription from Dijkstras EW 1969. Transcripted by McCarthy, D. C. Eindhoven, 1969.

    Google Scholar 

  12. Drusinky, D.: The Temporal Rover and the ATG Rover. In: SPIN Model Checking and Software Verification. Lecture Notes in Computer Science 1885. Springer, Berlin, Heidelberg, New York, 2000, pp. 323–330.

    Google Scholar 

  13. Edmonds, B.; Bryson, J. J.: The Insufficiency of Formal Design Methods — the necessity of an experimental approach for the understanding and control of complex MAS. In: Proceedings of Autonomous Agents and Multi-Agent Systems (AAMAS 04). The Association for Computing Machinery, Inc., New York, USA, 2004, pp. 936–943.

    Google Scholar 

  14. Fernandes, J.; Bello, O.: Modeling of Multi-agent System Activities through Colored Petri Nets: an Industrial Production System Case Study. In: Proceedings of the 16 International Conference on Applied Informatics. Anaheim, CA, 1998, pp. 17–20.

    Google Scholar 

  15. Fisher, M.; Wooldridge, M.: On the formal specification and verification of Multi-Agent Systems. In: International Journal of Cooperative Information Systems 6(1997)1, pp. 37–65.

    Article  Google Scholar 

  16. Gerth, R.; Peled, D.; Vardi, M. Y.; Wolper, P.: Simple on-the-fly automatic verification of linear temporal logic. In: Protocol Specification, Testing, and Verification: Chapman, 1995, pp. 3–18.

    Google Scholar 

  17. Gómez-Sanz, J. J.; Geravis, M.-P.; Weiss, G.: A Survey on Agent-Oriented Software Engineering Research. In: Bergenti, F.; Gleizes, M.-P.; Zambonelli, F. (Eds.): Methodologies and Software Engineering for Agent Systems. Kluwer Academic Publishers, Boston, Dordrecht, London, 2004, pp. 33–64.

    Chapter  Google Scholar 

  18. Halladay, S.; Wiebel, M.: Object-oriented Software Engineering-Object Verfication. R&D Publications, Lawrence, 1994.

    Google Scholar 

  19. Hatton, L.: Does OO Sync with How We Think? In: IEEE Software 15(1998)3, pp. 46–54.

    Article  Google Scholar 

  20. Hausen, H. L.; Müllerburg, M.; Schmidt, M: Über das Prüfen, Messen und Bewerten von Software (On the Examination, Measurement, and Assessment of Software). In: Informatik Spektrum 10(1987)3, pp. 123–144.

    Google Scholar 

  21. Hanachi, C.; Hameurlain, N.; Sibertin-Blanc, C.: Mobile Agents Behaviours: From Declarative Specifications to Implementation. In: Proceedings of the 3rd Int. Workshop of Cooperative Information Agents (CIA’ 99), Uppsala, Sweden. Springer-Verlag, Berlin, 1999, pp. 196–207.

    Google Scholar 

  22. Havelund, K.; Rosu, G.: Monitoring Java programs with Java PathExplorer. In: First Workshop on Runtime Verfication (RV 2001). Electronic Notes in Theoretical Computer Science 55 (2001).

    Google Scholar 

  23. Henzinger, T. A.; Kupferman, O.; Qadeer, S.: From Pre-historic to Post-modern symbolic model checking. In: Proceedings of the 10th International Conference on Computer Aided Verification. Springer-Verlag, Berlin, 1998.

    Google Scholar 

  24. Herzog, O.: Zur Analyse der Kontrollstruktur von parallelen Programmen mit Hilfe von Petri-Netzen. Inform. Dissertation, Universität Dortmund, 1976.

    Google Scholar 

  25. Holvoet, T.: Agents and Petri Nets. In: Petri Net Newsletter 49 (1995), pp. 3–8.

    Google Scholar 

  26. Holzmann, G.: The Model Checker Spin. In: IEEE Transactions on Software Engineering 23(1995)5, pp. 279–295.

    Article  Google Scholar 

  27. Hoppe, T.; Mesegeur, P.: VVT Terminology: A Proposal. In: IEEE Expert 8(1993)3, pp. 48–55.

    Article  Google Scholar 

  28. Hormann, A.: Testbasierte Spezifikation von Agenteninteraktionsverhalten. Diploma Thesis, University of Bremen, 2006.

    Google Scholar 

  29. Huget, M. P.; Demazeau, Y.: Evaluating Multiagent Systems: A Record/Replay Approach. In: Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT04). IEEE Press, 2004.

    Google Scholar 

  30. Jabbar, S.; Abbas, K. Z.: A generalized methodology and framework for the Validation and Verification of Multi-Agent Systems. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. IEEE, Tucson, 2001.

    Google Scholar 

  31. Kacprzak, M.; Lomuscio, A.; Penczek, W.: Verification of multiagent systems via unbounded model checking. In: Proceedings of the 3rd International Joint Conference on Autonomous Agents and Multiagentsystems (AAMAS 2004). IEEE Computer Society, New York, 2004.

    Google Scholar 

  32. Köhler, M.; Moldt, D.; Rölke, D.: Modelling the Structure and Behaviour of Petri Net Agents. In: Proceedings of the 22nd International Conference on Application and Theory of Petri Nets. Springer-Verlag, London, UK, 2001, pp. 224–241.

    Google Scholar 

  33. Kruchten, P.: The Rational Unified Process — Eine Einführung. 2nd ed., Addison Wesley, 2001.

    Google Scholar 

  34. McMillan, K. L.: Applying SAT methods in unbounded symbolic model checking. In: Proceedings of the 14th International Conference on Computer Aided Verification (CAV’02). Lecture Notes in Computer Science 2404. Springer-Verlag, 2002, pp. 250–264.

    Google Scholar 

  35. Menzies, T.; Pecheur, C.: Verification and Validation and Artificial Intelligence. In: Advances of Computers 65. Elsevier, 2005.

    Google Scholar 

  36. Moldt, D.; Rölke, H.: Pattern Based Workflow Design Using Reference Nets. In: van der Aalst, W.; Arthur ter Hofstede, A.; Weske, M. (Eds.): Proceedings of International Conference on Business Process Management, Eindhoven, NL. Lecture Notes in Computer Science 2678. Springer-Verlag, Berlin, 2003, pp. 246–260.

    Google Scholar 

  37. Moldt, D.; Valk, R.: Object Oriented Petri Nets in Business Process Modelling. In: Business Process Management, Models, Techniques, and Empirical Studies. Springer-Verlag, London, UK, 2000, pp. 254–273.

    Google Scholar 

  38. Moldt, D.; Wienberg, F.: Multi-Agent-Systems Based on Coloured Petri Nets. In: ICATPN’ 97: Proceedings of the 18th International Conference on Application and Theory of Petri Nets. Springer-Verlag, London, UK, 1997, pp. 82–101.

    Google Scholar 

  39. Moura, L.; Owre, S.; Ruess, H.; Rushby, J.; Shankar, N.; Sorea, M.; Tiwari, A.: SAL 2. In: Alur, R.; Peled, D. (Eds.): Computer-Aided Verification. Lecture Notes in Computer Science 3114. Springer Verlag, Boston, 2004, pp. 496–500.

    Google Scholar 

  40. Mylopoulos, J.; Kolp, M.; Castro, J.: UML for Agent-Oriented Software Development: The Tropos Proposal. In: Gogolla, M.; Kobryn, C. (Eds.): Proceedings of the 4th International Conference on the Unified Modeling Language, Modeling Languages, Concepts, and Tools. Lecture Notes in Computer Sciences 2185. Springer-Verlag, Berlin, 2001, pp. 422–441.

    Google Scholar 

  41. Nielson, F.; Nielson, H. R.; Hankin, C.: Principles of Program Analysis. Springer, Berlin, Heidelberg, New York, 1999.

    MATH  Google Scholar 

  42. Owre, S.; Rushby, J.; Shankar, N.: Analyzing tabular and statetransition requirements specifications in PVS. NASA Contractor Report 201729. SRI International, 1997.

    Google Scholar 

  43. Padgham, L.; Winikoff, M.: Developing intelligent agent systems: A practical guide. Wiley, 2004.

    Google Scholar 

  44. Pasareanu, C. S.; Visser, W.: Verification of Java Programs Using Symbolic Execution and Invariant Generation. In: Graf, S.; Mounier, L. (Eds.): Model Checking Software. Lecture Notes in Computer Science 2989. Springer Verlag, Berlin, 2004.

    Google Scholar 

  45. Peled, D.: Combining partial order reductions with on-the-fly model-checking. In: CAV 94: Computer Aided Verification Lecture Notes in Computer Science 818. Springer, 1994, pp. 377–390.

    Google Scholar 

  46. Queille, J. P. M.; Sifakis, J.: Specification and verification of concurrent systems in Cesar. In Proceedings of the 5th International Symposium on Programming. Lecture Notes in Computer Science 137. Springer, 1981, pp. 337–351.

    Google Scholar 

  47. Rainsberger, J. B.; Stirling, S.: JUnit Recipies — Practical Methods for Programmer Testing. Manning Publications Co., 2005.

    Google Scholar 

  48. Riedemann, E. H.: Testmethoden für sequentielle und nebenläufige Software-Systeme. B.G. Teubner, Stuttgart, 1997.

    MATH  Google Scholar 

  49. Royce, W. W.: Managing the Development of Large Software systems. In: Proceedings of the IEEE Wescon, August 1970. TRW, pp. 1–9.

    Google Scholar 

  50. Rumbaugh, J.; Blaha, M.; Premerlani, W.; Eddy, F.; Lorensen, W.: Object-Oriented Modelling and Design. Prentice Hall, Englewood Cliffs, New Jersey, 1991.

    Google Scholar 

  51. Rushby, J.: Theorem proving for verification. In: Cassez, F. (Ed.): Modelling and Verification of Parallel Processes: MoVEP 2k, Nantes, France, June 2000. Tutorial presented at MoVEP. Lecture Notes in Artificial Intelligence 2067. Springer, 2000.

    Google Scholar 

  52. Scholz, T.; Timm, I. J.; Spittel, R.: An Agent Architecture for Ensuring Quality by Dynamic Capability Certification. In: Proceedings of the third conference on Multiagent System Technology (MATES 2005). Lecture Notes in Artificial Intelligence (LNAI) 3550. Springer Verlag, Berlin, 2005, pp. 130–140.

    Google Scholar 

  53. Scholz, T.; Timm, I. J.; Woelk, P.-O.: Emerging Capabilities in Intelligent Agents for Flexible Production Control. In: Ueda, K.; Monostri, L.; Markus, A. (Eds.): Proceedings of the 5th International Workshop on Emergent Synthesis (IWES 2004). Budapest, 2004, pp. 99–105.

    Google Scholar 

  54. Sibertin-Blanc, C.: Cooperative Nets. In: Proceedings of the 15th International Conference on Application and Theory of Petri Nets, Zaragoza, Spain. Springer-Verlag, Berlin, 1994, pp. 471–490.

    Google Scholar 

  55. Smith, M.; Robson, D.: Object-Oriented Programming — The Problems of Validation. In: Proceedings of the International Conference on Software Maintenance. IEEE Computer Society Press, San Diego, 1990.

    Google Scholar 

  56. Sneed, H. M.; Winter, M.: Testen objektorientierter Software. Hanser, München, Wien, 2002.

    Google Scholar 

  57. Thaller, G. E.: Software-Test — Verifikation und Validation 2. Verlag Heinz Heise GmbH & Co KG, Hannover, 2002.

    Google Scholar 

  58. Timm, I. J: Dynamisches Konfliktmanagement als Verhaltenssteuerung Intelligenter Agenten. DISKI 283. infix, Köln, 2004.

    Google Scholar 

  59. Timm, I. J: Selbstlernprozesse in der Agentenkommunikation. In: Florian, M.; Hillebrandt, F. (Eds.): Adaption und Lernen in und von Organisationen. VS Verlag für Sozialwissenschaften, Wiesbaden, pp. 103–127, to appear.

    Google Scholar 

  60. Timm, I. J.; Tönshoff, H. K.; Herzog, O.; Woelk, P. O.: Synthesis and Adaption of Multiagent Communication Protocols in the Production Engineering Domain. In: Butala, P.; Ueda, K. (Eds.): Proceedings of the 3rd International Workshop on Emergent Synthesis (IWES’ 01). Bled, Slovenia, March 12–13, 2001, pp. 73–82.

    Google Scholar 

  61. Turner, C.; Robson, D.: State-Based Testing of object-oriented Programs. In: Proceedings of the International Conference on Software Maintenance. IEEE Computer Society Press, Montreal, 1993.

    Google Scholar 

  62. Wei&sB, G.; Jakob, R.: Agentenorientierte Softwareentwicklung. Springer, Berlin, Heidelberg, New York, 2005.

    MATH  Google Scholar 

  63. Wooldridge, M. J.: Agents and Software Engineering. In: Journal AI*IA Notizie 11(1998)3, pp. 31–37.

    Google Scholar 

  64. Wooldridge, M. J.; Ciancarini, P.: Agent-Oriented Software Engineering: The State of the Art. In: Ciancarini, P.; Wooldridge, M. (Eds.): Agent-Oriented Software Engineering (AOSE 2000). Lecture Notes in Computer Science 1957. Springer-Verlag, Berlin, 2000.

    Google Scholar 

  65. Wooldridge, M.; Fisher, M.; Huget, M. P.; Parsons, S.: Model checking multiagent systems with mable. In: Proceedings of the First International Conference on Autonomous Agents and Multiagent Systems (AAMAS-02). Bologna, Italy, 2002.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Technologie-Zentrum Informatik, Universität Bremen, Bremen

    Ingo J. Timm & Thorsten Scholz

  2. Wirtschaftsinformatik II, Universität Hohenheim, Germany

    Hendrik Fürstenau

Authors
  1. Ingo J. Timm
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thorsten Scholz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hendrik Fürstenau
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Wirtschaftsinformatik II (510 O), Universität Hohenheim, Schwerzstraße 35, 70599, Stuttgart, Germany

    Stefan Kirn

  2. Technologie-Zentrum Informatik, Universität Bremen, Am Fallturm 1, 28359, Bremen, Germany

    Otthein Herzog

  3. Institut für Programmstrukturen und Datenorganisation (IPD), Universität Karlsruhe (TH), Am Fasanengarten 5, 76131, Karlsruhe, Germany

    Peter Lockemann

  4. Lehrstuhl für Informatik 4, RWTH Aachen, Ahornstraße 55, 52074, Aachen, Germany

    Otto Spaniol

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer Berlin · Heidelberg

About this chapter

Cite this chapter

Timm, I.J., Scholz, T., Fürstenau, H. (2006). From Testing to Theorem Proving. In: Kirn, S., Herzog, O., Lockemann, P., Spaniol, O. (eds) Multiagent Engineering. International Handbooks on Information Systems. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32062-8_25

Download citation

  • DOI: https://doi.org/10.1007/3-540-32062-8_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-31406-6

  • Online ISBN: 978-3-540-32062-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation