Abstract
Multiagent systems (MAS) have found their way into industrial applications in recent years and appear to be one of the most promising technologies that originated in AI research in recent years. However, evaluation standards as they are common e.g. in the scheduling or database systems communities are largely amiss. In this paper, we propose communication-based performance measurement (CBPM) as a new method that is particularly suitable for open, communication-intensive MAS, and argue that it can be used as to design indicators for self-diagnosis by the MAS itself. The ability of such self-diagnosis is a prerequisite for MAS with self-repairing and self-optimising properties required by the autonomic computing view. CBPM is based on the idea that important aspects of the external behaviour of a MAS can be measured in terms of the communication processes within them. We present different levels of communication-based performance measurement: frequency analysis of performatives and analysis of complex message patterns. Several examples of analyses of inter-agent communication based on FIPA-ACL and the contract-net protocol in implemented, complex, market-oriented MAS demonstrate the usefulness of our approach. We conclude that these performance measures provide useful information about MAS and pave the way for devising autonomic self-improvement methods for these systems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
AgentCities (2003), http://www.agentcities.org
Brauer, W., Nickles,M., Rovatsos, M., Weiß, G., Lorentzenet, K.F.: Expectation-Oriented Analysis and Design. In: Wooldridge, M.J., Weiß, G., Ciancarini, P. (eds.) AOSE 2001. LNCS(LNAI), vol. 2222, p. 226. Springer, Heidelberg (2002)
Cao, J., Kerbyson, D.J., Nudd, G.R.: Performance evaluation of an agent-based resource management infrastructure for grid computing. In: Proceedings of the 1st IEEE/ACM International Symposium on Cluster Computing and the Grid, Brisbane, Australia, pp. 311–318 (2001)
Dikaiakos, M., Kyriakou, M., Samaras, G.: Performance evaluation of mobile-agent middleware: A hierarchical approach. In: Picco, G.P. (ed.) MA 2001. LNCS, vol. 2240, pp. 244–259. Springer, Heidelberg (2001)
Dumke, R., Rautenstrauch, C., Schmietendorf, A., Scholz, A. (eds.): WOSP 2000 and GWPESD 2000. LNCS, vol. 2047, p. 68. Springer, Heidelberg (2001)
FIPA. FIPA (Foundation for Intelligent Agents) (2003), http://www.fipa.org
Jennings, N.R.: On agent-based software engineering. Artificial Intelligence 117, 277–296 (2000)
Labrou, Y., Finin, T.: A Proposal for a new KQML Specification. Technical Report TR CS- 97-03, Computer Science and Electrical Engineering Department, University of Maryland Baltimore County, Baltimore, MD (February 1997)
Parunak, V.: Industrial and practical applications of DAI. In: Weiss, G. (ed.) Multiagent Systems, pp. 377–421. The MIT Press, Cambridge (1999)
IBM Research. Autonomic computing (2003), http://www.research.ibm.com/autonomic/
Schillo, M., Kray, C., Fischer, K.: The Eager Bidder Problem: A Fundamental Problem of DAI and Selected Solutions. In: Proceedings of the 1st International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2002), pp. 599–607 (2002)
Smith, R.G., Davis, R.: Frameworks for cooperation in distributed problem solving. IEEE Transactions on Systems, Man, and Cybernetics SMC-11(1), 61–70 (1981)
Wooldridge, M.J.: Agent-based software engineering. IEE Proceedings on Software Engineering 144(1), 26–37 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rovatsos, M., Schillo, M., Fischer, K., Weiß, G. (2003). Indicators for Self-Diagnosis: Communication-Based Performance Measures. In: Schillo, M., Klusch, M., Müller, J., Tianfield, H. (eds) Multiagent System Technologies. MATES 2003. Lecture Notes in Computer Science(), vol 2831. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39869-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-39869-1_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20124-3
Online ISBN: 978-3-540-39869-1
eBook Packages: Springer Book Archive