Abstract
The growing employment of Multi-Agent Systems (MASs) in several domains of everyday life has provided the impetus for much research into new tools and methodologies for their design and implementation. But up to now, few works have focused on evaluation of these MASs, and none of these considered characteristics such as the rationality, the autonomy, the reactivity and the environment adaptability of the agents in the MAS. We believe these characteristics affect the whole performance of these systems and are connected to the complexity of the environment where the agents act. In this paper we propose an evaluation method for static multi-agent systems. The method, based on the Goal-Question-Metric approach, allows evaluation of these same MAS characteristics and combines two analysis perspectives of these systems: intra-agent and inter-agent. We also report the use of the defined approach to evaluate the GeCo_Automotive system’s MAS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jang, K.S., Nam, T.E., Wadhwa, B.: On measurement of Objects and Agents., http://www.comp.nus.edu.sg/~bimlesh/ametrics/index.htm
Klügl, F.: Measuring Complexity of Multi-agent Simulations – An Attempt Using Metrics. In: Dastani, M., El Fallah Seghrouchni, A., Leite, J., Torroni, P. (eds.) LADS 2007. LNCS (LNAI), vol. 5118, pp. 123–138. Springer, Heidelberg (2008)
Król, D., Zelmozer, M.: Structural Performance Evaluation of Multi-Agent Systems. J. of Universal Computer Science 14, 1154–1178 (2008)
Hmida, F.B., Chaari, W.L., Tagina, M.: Performance Evaluation of Multiagent Systems: Communication Criterion. In: Carbonell, J.G., Siekmann, J. (eds.) KES-AMSTA 2008. LNCS (LNAI), vol. 4953, pp. 773–782. Springer, Heidelberg (2008)
Gutiérez, C., GarcÃa-Magariño, I., Gómez-Sanz, J.J.: Evaluation of Multi-Agent System Communication in INGENIAS. In: Cabestany, J., Sandoval, F., Prieto, A., Corchado, J.M. (eds.) IWANN 2009. LNCS, vol. 5517, pp. 619–626. Springer, Heidelberg (2009)
Lee, S.K., Hwang, C.S.: Architecture modeling and evaluation for design of agent-based system. J. of Systems and Software 72, 195–208 (2004)
Lass, R.N., Sultanik, E.A., Regli, W.C.: Metrics for Multiagent Systems. In: Madhavan, R., Tunstel, E., Messina, E. (eds.) Performance Evaluation and Benchmarking of Intelligent Systems. LNCS, pp. 1–19. Springer, US (2009)
Basili, V., Caldiera, G., Rombach, H.: The Goal Question Metric Approach. In: Marciniak, J.J. (ed.) Encyclopedia of Soft. Eng., vol. 2, pp. 528–532. John Wiley & Sons, Inc., Chichester (1994)
Russell, S., Norvig, P.: Artificial intelligence: A modern approach. Prentice-Hall, Englewood Cliffs (1995)
Wooldridge, M., Jennings, N.R.: Intelligent agents: Theory and practice. The Knowledge Engineering Review 10, 115–152 (1995)
Nwana, H.S.: Software Agents: An Overview. The Knowledge Engineering Review 11, 205–244 (1996)
Di Bitonto, P., Plantamura, V.L., Roselli, T., Rossano, V.: A taxonomy for cataloging LOs using IEEE educational metadata. In: 7th IEEE International Conference on Advanced Learning Technologies, pp. 139–141. IEEE Press, Los Alamitos (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Di Bitonto, P., Laterza, M., Roselli, T., Rossano, V. (2010). An Evaluation Method for Multi-Agent Systems. In: Jędrzejowicz, P., Nguyen, N.T., Howlet, R.J., Jain, L.C. (eds) Agent and Multi-Agent Systems: Technologies and Applications. KES-AMSTA 2010. Lecture Notes in Computer Science(), vol 6070. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13480-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-13480-7_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13479-1
Online ISBN: 978-3-642-13480-7
eBook Packages: Computer ScienceComputer Science (R0)