Abstract
Evaluation of systems, synthetic environments and human performance are generally complicated and time-consuming tasks. Existing evaluation systems are domain dependent and don’t provide explanation on how the system reaches the evaluation results. Expertise is needed for evaluation process. Defining a model or a methodology, which simplifies and models the evaluation knowledge and speeds up the evaluation process, can obviously save cost, time and provide reusability. In this study, a knowledge representation of evaluation, which can also be used in distributed environments, was developed to handle the heuristic knowledge of experts from different domains and information from different sources for evaluation purposes. The evaluation knowledge was represented as reference model of evaluation objectives, production rules, evaluation measures, methods and parameters. Using of multiagents is proposed for evaluation in distributed environments. Different types of multi-agent organizations can be designed and developed. Multi-agents can simplify the evaluation process and reduce network traffic in distributed environments and decrease security problems among the network.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Trochin, W.M.K.: Introduction to Evaluation (2002), http://trochim.human.cornell.edu/kb/intreval.htm
Öztemel, E., Öztürk, V.: Intelligent Evaluation Definition of Training Systems in Synthetic Environments. In: ITEC 2003 Conference, UK (2003)
Shub, Y., Kushnir, A., Frenkel, J.: Pilot Evaluation System Aerospace and Electronics. In: IEEE Proceedings of the NAECON 1994, pp. 734–741 (1994)
Hartley, R., Varley, G.: The Design And Evaluation For Development Of Complex Decision Making Skills. In: IEEE International Conference on Advanced Learning Technologies (2001)
Gregory, W.H.: Evaluating Simulation Based Training Scenarios. In: 1998 Spring SIW (Simulation Interoperability Workshop) (1998)
Oliveira, J.C., Shirmohammad, S., Georganas, N.D.: Collaborative Virtual Environment standards: a performance evaluation Proceedings. In: 3rd IEEE International Workshop on Distributed Interactive Simulation and Real-Time Applications, October 22-23, pp. 14–21 (1999)
Macannuco, D., Hung, J., Civinskas, W.: A Test Suite to Evaluate Run-Time Infrastructure (RTI) Implementations for High Performance, Human-In-The-Loop (HITL) Simulators. In: 1998 Spring SIW (Simulation Interoperability Workshop) (1998)
Öztürk, V., Sönmez, C.: An Expert-Fuzzy Approach for Evaluation. In: International Manufacturing Symposium (IMS) 2004, Sakarya, Turkiye (2004)
Rigg, G., Morley, R., Hepplewhite, R.: Themis: The Objective Assessment of CGF Performance. In: 9th Conference on Computer Generated Forces & Behevioral Representation (CGF-BR), SISO (2000)
Bass, E.J.: Architecture for an intelligent instructor pilot decision support system. In: IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, pp. 891–896 (1998)
Gregory, W.H.: Evaluating Simulation Based Training Scenarios. In: 1998 Spring SIW (Simulation Interoperability Workshop) (1998), http://www.sisostds.org/doclib/doclib.cfm?SISO_FID_897
Hemel, P., Kisg, W.J.: Simulation Techniques In Operator And Maintenance Training, Performance Assessment, And Personnel Selection. Comput. & Indus. Eng. 2, 105–112 (1981)
Drewer, P.M.: RTP 11.13 Project Technical report, RTP11.13-CAE-WE6.1–WD1_MzD- 2.0b (2001)
Rollesbroich, B., Meyer zu Drewer, P., Greiwe, K., Jokipii, M., Hartikainen, T.: Common Evaluation Framework & Evaluation Knowledge Editor, RTP 11.13 Project Technical report, RTP11.13-CAE-WE6.1-TR-1.0 (2003)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice-Hall, Englewood Cliffs (1995)
Weiss, G.: Multiagent Systems A Modern Approach to Distributed Modern Approach to Artificial Intelligence. The MIT Press Cambridge, Massachusetts London (1999)
Gokturk, E., Polat, F.: Implementing Agent Communication for a Multiagent Simulation Infrastructure on HLA. In: Yazıcı, A., Şener, C. (eds.) ISCIS 2003. LNCS, vol. 2869, pp. 619–626. Springer, Heidelberg (2003)
Alhajj, R., Polat, F.: Multiple-Agents to Identify and Separate Touching Digits in Unconstrained Handwritten Hindi Numerals. International Journal of Experimental and Theoretical Artificial Intelligence 15(4), 461–471 (2003)
Ulusar, U.D., Akin, H.L.: Design and Implementation of a Real Time Planner for Autonomous Robots. In: Proceedings, TAINN 2004, Turkish Symposium On Artificial Intelligence and Neural Networks, Izmir, Turkey, pp. 263–270 (2004)
Sycara, K.P.: Multiagent Systems. AI Magazine, American Association for Artificial Intelligence (1998)
Turban, E.: Expert Systems and Applied Artificial Intelligence. Macmillan Publishing Company, USA (1995)
Öztemel, E., Öztürk, V.: Intelligent Evaluation Definition of Training Systems in Synthetic Environments. In: ITEC 2003 Conference, UK (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Öztürk, V., Sönmez, C., Öztemel, E. (2005). Distributed Evaluation Using Multi-agents. In: Yolum, p., Güngör, T., Gürgen, F., Özturan, C. (eds) Computer and Information Sciences - ISCIS 2005. ISCIS 2005. Lecture Notes in Computer Science, vol 3733. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11569596_34
Download citation
DOI: https://doi.org/10.1007/11569596_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29414-6
Online ISBN: 978-3-540-32085-2
eBook Packages: Computer ScienceComputer Science (R0)