Skip to main content

A Methodology for Evaluation of Knowledge-Based Systems

  • Conference paper
Medical Informatics Europe 1991

Abstract

Knowledge based systems (KBS) are of great potential use in medicine. However, the progress in development and actual day to day use of KBSs in medicine has been disappointing. Shortliffe (1989) believes that this is because medical decision aids are not user friendly, they do not explain their reasoning adequately, they are too time consuming to use in the actual work environment, and particularly because of physician fears of e.g. legal liability and intrusion of the systems into their practice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Barber, B., Jensen, O.A., Lamberts, H., Roger, F.H., De Schouwer, P., Zollner, H. “The Six Safety First Principles Of Health Information Systems, Computer Perspectives In Health Care - Cp90, Uk National Conference Of Medical Informatics 2–4 April (1990), Brighton, Pub. British Journal Of Health Care Computing.

    Google Scholar 

  • De Dombal, F.T. “Towards a more objective evaluation of computer aided decision support systems”. In MEDINFO ’83. Ed, Van Bemmel J., Ball M.J., Wigertz O. 436–439 (1983).

    Google Scholar 

  • Miller, P.L. “Evaluation of artificial intelligence systems in medicine.” Comp. Prog. Method Biomed, 22 5–11 (1986 a).

    Google Scholar 

  • Nolan, J., McNair, P., Brender, J. “Factors Influencing the Transferability of Medical Decision Support Systems”. Int J Biomed Comput, 27, 7–26. (1990).

    Article  Google Scholar 

  • O’Moore R., Clarke K., Smeets R., Brender J., Nykanen P., McNair P., Grimson J., Barber B. “Items of Relevance for the Evaluation of Knowledge Based/Expert Systems and Influence from Domain Characteristics”. KAVAS (A1021) Report EM 1.1. EEC AIM Office, 62 Rue de Treves, Brussels. (1990 a).

    Google Scholar 

  • O’Moore, R., Clarke, K., Brender. J., McNair. P., Nykanen. P., Smeets, R., Talmon, J., Grimson, J., Barber, B. “Methodology for Evaluation of Knowledge Based Systems”. Technical report EM 1.2, KAVAS (A 1021) Project, CEC AIM Programme, (1990 b).

    Google Scholar 

  • Rossi-Mori, A., Ricci, F.L. “Comprehensive criteria for evaluation and design of knowledge based systems in Medicine.” In System Engineering in Medicine. Ed. Talmon, J. & Fox, J. Springer Verlag (1989).

    Google Scholar 

  • Schioler, T., Nolan, J., McNair, P. “Transferability of Knowledge Based Systems, Information Technology Factors”, MIE ‘91.

    Google Scholar 

  • Shortliffe, E.H. “Testing reality - the introduction of decision support technologies for physicians. Meth. Inform. Med., 28, 1–5 (1989).

    Google Scholar 

  • Smeets, R.P.A.M., Talmon, J.L., O’Moore, R. “General Methodology and Problems in Assessment of Decision Support Systems”. In Lecture Notes in Medical Informatics, MIE490, Vol 40, 225–230. (1990).

    Google Scholar 

  • Wyatt, J, “The evaluation of clinical decision support systems: a discussion of the methodology used iti the ACORN project. AIME ’87. Ed. Fox, J., Fieschi, M., Engelbrecht, R. Lecture notes in medical informatics 33, Springer Verlag, 229–238 (1987).

    Google Scholar 

  • Wyatt, J., Spiegelhalter, D. “Evaluating medical decision aids: What to test, and how.” In System In Medicine Eds. Talmon, J. and Fox, J. Springer Verlag 1–13 (1990).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Clarke, K. et al. (1991). A Methodology for Evaluation of Knowledge-Based Systems. In: Adlassnig, KP., Grabner, G., Bengtsson, S., Hansen, R. (eds) Medical Informatics Europe 1991. Lecture Notes in Medical Informatics, vol 45. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-93503-9_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-93503-9_64

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-54392-3

  • Online ISBN: 978-3-642-93503-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics