Abstract
We propose a methodology that can be used to compare and evaluate Artificial Intelligence architectures and is motivated by fundamental properties required by general intelligent systems. We examine an initial application of this method used to compare Soar and CLIPS in two simple domains. Results gathered from our tests indicate both qualitative and quantitative differences in these architectures and are used to explore how aspects of the architectures may affect the agent design process and the performance of agents implemented within each architecture.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
CLIPS Reference Manual: Version 6.05
Doorenbos, R.B.: Production Matching for Large Learning Systems. PhD thesis, Carnegie Mellon University (1995)
Forgy, C.L.: On the Efficient Implementation of Production Systems. PhD thesis, Carnegie Mellon University (1979)
Gat, E.: Integrating planning and reacting in a heterogeneous asynchronous architecture for mobile robots. In: Proceedings Tenth National Conference on Artificial Intelligence, pp. 809–815. AAAI Press, Menlo Park (1992)
Gevarter, W.B.: The nature and evaluation of commercial expert system building tools. Computer 20(5), 24–41 (1987)
Ingrand, F.F., Georgeff, M.P., Rao, A.S.: An architecture for real-time reasoning and system control. IEEE Expert 7(6), 34–44 (1992)
Laird, J.E., Newell, A., Rosenbloom, P.S.: Soar: An architecture for general intelligence. Artificial Intelligence (1987)
Lee, J., Yoo, S.I.: Reactive-system approaches to agent architectures. In: Jennings, N.R. (ed.) ATAL 1999. LNCS (LNAI), vol. 1757, Springer, Heidelberg (2000)
Mettrey, W.A.: A comparative evaluation of expert system tools. Computer 24(2), 19–31 (1991)
Newell, A.: Unified Theories of Cognition. Harvard University Press, Cambridge (1990)
Plant, R.T., Salinas, J.P.: Expert system shell benchmarks: The missing comparison factor. Information & Management 27, 89–101 (1994)
Pollack, M.E., Ringuette, M.: Introducing the tileworld: Experimentally evaluating agent architectures. In: Proceedings of the Eighth National Conference on Artificial Intelligence, vol. 1, pp. 183–189. MIT Press, Cambridge (1990)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, pp. 31–52. Prentice-Hall, Upper Saddle River (1995)
Schreiber, A.T., Birmingham, W.P.: Editorial: the sisyphus-vt initiative. International Journal of Human-Computer Studies 44(3), 275–280 (1996)
Stylianou, A.C., Smith, R.D., Madey, G.R.: An empirical model for the evaluation and selection of expert system shells. Expert Systems With Applications 8(1), 143–155 (1995)
Tate, A., Drabble, B., Kirby, R.: O–plan2: An architecture for command, planning and control. In: Fox, M., Zweben, M. (eds.) Intelligent Scheduling. Morgan Kaufmann, San Francisco (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wallace, S.A., Laird, J.E. (2000). Toward a Methodology for AI Architecture Evaluation: Comparing Soar and CLIPS. In: Jennings, N.R., Lespérance, Y. (eds) Intelligent Agents VI. Agent Theories, Architectures, and Languages. ATAL 1999. Lecture Notes in Computer Science(), vol 1757. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10719619_9
Download citation
DOI: https://doi.org/10.1007/10719619_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67200-5
Online ISBN: 978-3-540-46467-9
eBook Packages: Springer Book Archive