Abstract
Software agents are a promising technology for today’s complex, distributed systems. Methodologies and techniques that address testing and reliability of multi agent systems are increasingly demanded, in particular to support automated test case generation and execution.
A novel approach, based on agent interaction ontology, has been recently proposed and integrated into a testing framework, called eCAT, which can generate and evolve test cases automatically, and run them continuously.
In this paper, we focus on the experimental evaluation of an ontology-based test generation approach. We use two BDI agent applications as case studies to investigate the performance of the framework as well as its capability to reveal faults.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bergenti, F., Gleizes, M.-P., Zambonelli, F.: Methodologies and Software Engineering for Agent Systems: The Agent-Oriented Software Engineering Handbook. Springer, Heidelberg (2004)
Bordini, R.H., Fisher, M., Visser, W., Wooldridge, M.: Verifying multi-agent programs by model checking. Autonomous Agents and Multi-Agent Systems 12(2), 239–256 (2006)
Botía, J.A., Gómez-Sanz, J.J., Pavón, J.: Intelligent data analysis for the verification of multi-agent systems interactions. In: Corchado, E., Yin, H., Botti, V., Fyfe, C. (eds.) IDEAL 2006. LNCS, vol. 4224, pp. 1207–1214. Springer, Heidelberg (2006)
Botía, J.A., López-Acosta, A., Gómez-Skarmeta, A.F.: ACLAnalyser: A tool for debugging multi-agent systems. In: ECAI, pp. 967–968 (2004)
Bratman, M.E.: Intentions, Plans and Practical Reason. Harvard University Press, Cambridge (1987)
Coelho, R., Cirilo, E., Kulesza, U., von Staa, A., Rashid, A., Lucena, C.: Jat: A test automation framework for multi-agent systems. In: 23rd IEEE International Conference on Software Maintenance (2007)
Dikenelli, O., Erdur, R.C., Gumus, O.: Seagent: a platform for developing semantic web based multi agent systems. In: AAMAS 2005: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems, pp. 1271–1272. ACM Press, New York (2005)
Euzenat, J., Bach, T.L., Barrasa, J., Bouquet, P., Bo, J.D., Dieng, R., Ehrig, M., Hauswirth, M., Jarrar, M., Lara, R., Maynard, D., Napoli, A., Stamou, G., Stuckenschmidt, H., Shvaiko, P., Tessaris, S., Acker, S.V., Zaihrayeu, I.: State of the art on ontology alignment. Knowledge Web Deliverable 2.2.3 (August 2004)
FIPA. Interaction protocols specifications (2000-2002), http://www.fipa.org/repository/ips.php3
Kalfoglou, Y., Schorlemmer, M.: Ontology mapping: the state of the art. The Knowledge Engineering Review 18(1), 1–31 (2003)
Lam, D.N., Barber, K.S.: Debugging Agent Behavior in an Implemented Agent System. In: Bordini, R.H., Dastani, M., Dix, J., El Fallah Seghrouchni, A. (eds.) PROMAS 2004. LNCS, vol. 3346, pp. 104–125. Springer, Heidelberg (2005)
Nguyen, C.D., Perini, A., Tonella, P.: Automated continuous testing of multi-agent systems. In: The fifth European Workshop on Multi-Agent Systems (December 2007)
Nguyen, C.D., Perini, A., Tonella, P.: Ontology-based Test Generation for Multi Agent Systems. In: Proc. of the International Conference on Autonomous Agents and Multiagent Systems (2008)
Padgham, L., Winikoff, M.: Prometheus: A pragmatic methodology for engineering intelligent agents. In: Proc. Workshop on Agent Oriented Methodologies, OOPSLA 2002 (2002)
Pokahr, A., Braubach, L., Lamersdorf, W.: Multi-Agent Programming. In: Jadex: A BDI Reasoning Engine. Kluwer Book, Dordrecht (2005)
Rouff, C.: A test agent for testing agents and their communities. In: Aerospace Conference Proceedings, vol. 5 (2002)
TILAB. Java agent development framework, http://jade.tilab.com/
Tiryaki, A.M., Öztuna, S., Dikenelli, O., Erdur, R.C.: Sunit: A unit testing framework for test driven development of multi-agent systems. In: Padgham, L., Zambonelli, F. (eds.) AOSE VII / AOSE 2006. LNCS, vol. 4405, pp. 156–173. Springer, Heidelberg (2007)
Zhang, Z., Thangarajah, J., Padgham, L.: Automated unit testing for agent systems. In: 2nd International Working Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2007), Barcelona, Spain (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, C.D., Perini, A., Tonella, P. (2009). Experimental Evaluation of Ontology-Based Test Generation for Multi-agent Systems. In: Luck, M., Gomez-Sanz, J.J. (eds) Agent-Oriented Software Engineering IX. AOSE 2008. Lecture Notes in Computer Science, vol 5386. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01338-6_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-01338-6_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01337-9
Online ISBN: 978-3-642-01338-6
eBook Packages: Computer ScienceComputer Science (R0)