Abstract
Knowledge elicitation is accepted as being one of the most problematic areas in the creation of a knowledge-based system.
A large amount of research has already concentrated on finding more efficient and effective techniques for eliciting knowledge from an individual expert. However, little attention has been given to the involvement of more than one source of expertise in knowledge-based system development.
This paper is based on the authors' practical experience gained when developing a knowledge-based system for the conceptual design of bridges. It shows that the use of more than one expert throughout the knowledge elicitation process can improve both the efficiency of the approach and the quality of the knowledge acquired.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Barstow, D. R. (1979) Knowledge Based Program Construction. Elsevier Science Publishing Co. Inc., New York.
Bennett, J. S. (1981) On the Structure of the Acquisition Process for Rule Based Systems. In Machine Intelligence: Infotech State of the Art Report, Series 9, No. 3. Pergamon Infotech Ltd, Maidenhead, Berks, pp. 189–204.
Boose, J. H. (1986) Rapid acquisition and Combination of Knowledge from Multiple Experts in the Same Domain. Future Computing Systems, 1, 191–216.
Brachman, R. J., Amarel, S., Engelman, C., Engelmore, R. S., Feigenbaum, E. A. & Wilkins, D. E. (1983) What are Expert Systems? In. Building Expert Systems (F. Hayes-Roth, D. A. Waterman & D. B. Lenat), Addison Wesley, Reading, Mass.
Buchanan, B. G., Sutherland, G. L. and Feigenbaum, E. A. (1969) Rediscovering Some Problems of Artificial Intelligence in the Context of Organic Chemistry. In: Machine Intelligence 5, (eds B. Meltzer & D. Mitchie), Edinburgh University Press, Edinburgh, pp. 253–280.
Clancey, W. J. (1981) Methodology for Building an Intelligent Tutoring System, Computer Science Dept. Report No. STAN-CS-81–894. Stanford University, Palo Alto, California.
Chung, P. W. H. & Kumar, B. (1987) Knowledge Elicitation Methods: A Case Study in Structural Design. In The Application of Artificial Intelligence Techniques to Civil and Structural Engineering, 1987 (Conf.). Civil-Comp Press, pp. 21–26.
Dixon, J. R. & Simmons, M. K. (1983) Computers that Design: Expert Systems for Mechanical Engineers. Computers in Mechanical Engineering. pp. 10–18.
Ericsson, K. & Simon, H. A. (1980) Verbal Reports as Data. Psychological Review, 87, 215–251.
Fox, J., Myers, C. D., Greaves, M. F. & Pegram, S. (1987) A Systematic Study of Knowledge Based Refinement in the Diagnosis of Leukemia. In Knowledge Acquisition for Expert Systems—A Practical Handbook. (A. L. Kidd), Plenum Press, New York, pp. 73–90.
Fox, M. S. et al. (1983) Techniques for Sensor Based Diagnosis. Proc. of the 8th International Conference on AI. pp. 158–163.
Gammack, J. G. (1987) Different Techniques and Different Aspects on Declarative Knowledge. In Knowledge Acquisition for Expert Systems—A Practical Handbook (ed. A. L. Kidd). Plenum Press, New York, pp. 137–162.
Greenwell, M. (1988) Knowledge Engineering for Expert Systems. Ellis Horwood Ltd.
Grover, M. D. (1983) A Pragmatic Knowledge Acquisition Methodology. Proceedings of the 8th International Conference on AI, pp. 436–438.
Hartley, R. T. (1982) A Conceptual Basis for Expert Systems Methodology. Proc. of the 2nd British Computer Society Conf. on Expert Systems. Brunel University, Surrey. pp. 47–51.
Hayes-Roth, F., Waterman, D. & Lenat, D. (eds) (1983) Building Systems, Reading, Mass., Addison-Wesley.
Inder, R., Chung, P. W. H. & Fraser, J. (1987) Towards a Methodology for Incremental System Development. In Proceedings of an SERC Workshop on Knowledge Acquisition for Engineering Applications, (eds C. J. Pavelin & M. D. Wilson) 1987. pp. 44–255.
Kidd, A. L. (1987) Knowledge Acquisition: An Introductory Framework. In Knowledge Acquisition for Expert Systems—A Practical Handbook (ed A. L. Kidd). Plenum Press, New York, pp. 1–16.
McDermott, J. (1980) R1's Formative Years. AI Magazine, 2, 21–29.
McGraw, K. L. & Seale, M. R. (1988) Knowledge Elicitation with Multiple Experts, AI Review, 2, 31–44.
Miles, J. C. & Moore, C. J. (1989) An Expert System for the Conceptual Design of Bridges. Proc. Civil-Comp 89: International Conference on the Application of AI Techniques to Civil and Structural Engineering. London, UK, pp. 171–176.
Mittal, S. & Dym, C. L. (1985) Knowledge Acquisition from Multiple Experts. AI Magazine, Summer 1985, 32–36.
Moore, C. J. (1991) An Expert System for the Conceptual Design of Bridges. Ph.D. Thesis presented to the University of Wales. College of Cardiff, February 1991.
Moore, C. J. & Miles, J. C. (1991) The Importance of Detailed KBS Evaluation Intended for Implementation in the Engineering Industry. Computing Systems in Engineering, in press.
Shaw, M. L. G. (1988) Problems of Validation in a Knowledge Acquisition System Using Multiple Experts. In European Knowledge Acquisition Workshop. Bonn, pp. 5-2–5-15.
Shaw, M. L. G. & Gaines, B. R. (1988) A Methodology for Recognising Concensus, Correspondence, Conflict and Contrast in a Knowledge Acquisition System. 3rd AAAI Sponsored Knowledge Acquisition for Knowledge Based Systems Workshop. Banff. Canada. November, pp. 30-1–30-19.
Shortliffe, E. H. (1976) Computer Based Medical Consultations: MYCIN. Elsevier, New York.
Slater, P. (1981) Construct Systems in Conflict. In: Recent Advances in Personal Construct Technology (ed. M. L. G. Shaw). Academic Press, London.
Smith, R. G. & Baker, J. D. (1983) The Dipmeter Advisory System: A Case Study in Commercial Expert System Development. Proceedings of the 8th International Conference on AI, pp. 158–163.
Stephanou, H. E. & Lu, S. Y. (1984) Measuring Concensus Effectiveness by a Generalised Entropy Griterion. Proceedings of 1st Conference on AI Applications. Denver.
Trimble, G. & Cooper, C. (1987) Experience of Knowledge Acquisition for Expert Systems in Constructions. In Proceedings of an SERC Workshop on Knowledge Acquisition for Engineering Applications, 1987. Rutherford Appleton Laboratory, Oxford, pp. 7–13.
Waterman, D. A. & Jenkins, B. (1979) Heuristic Modelling Using Rule Based Computer Systems. In Terrorism: Threat, Reality. Response (eds R. Kupperman and D. Trent). Hoover Institution Press, Stanford University, California. pp. 285–330.
Welbank, M. (1983) A Review of Knowledge Acquisition Techniques for Expert Systems. Pub: Martlesham Consultancy Services, British Telecom Research Laboratories.
Welbank, M. (1987) Perspectives on Knowledge Acquisition. In: Proceedings of an SERC Workshop on Knowledge Acquisition for Engineering Applications, 1987. Rutherfora Appleton Laboratory, Oxford, pp. 21–26.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Moore, C.J., Miles, J.C. Knowledge elicitation using more than one expert to cover the same domain. Artif Intell Rev 5, 255–271 (1991). https://doi.org/10.1007/BF00141757
Issue Date:
DOI: https://doi.org/10.1007/BF00141757