Abstract
Improvement of the quality in health care and the assessment of health outcomes of medical technologies have attracted an increasing attention in the implementation phases. In this paper 12 recent evaluation studies are reviewed to investigate to what extend they reflect the structure, process, outcome conceptual framework. It is found that all the evaluation studies focus on structure measures. But if computer programs to support medical decision making are to be considered in the planning process of the health care system, the evaluation studies must strive to evaluate process and outcomes measures as well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
List of references
Adlassnig K.P., Scheithauer W.:“Performance evaluation of medical expert systems using ROC curves” Computers and biomedical research: 1989 22 (4) P. 297–313.
Bankowitz R.A., McNeil A.M., Challinor S.M., Parker R.C., Kapoor W.N., Milter R.A.: “A Computer-Assisted Medical Diagnostic Consultation Service. Implementation and Prospective Evaluation of A Prototype”. Annals of Internal Medicine: 1989 110 P. 824–32.
Barnett G.O., Cimino J.J., Hupp J.A., Hoffer E.P.: “DXplain: Experience with Knowledge Acquisition and Program Evaluation”. Proceedings 11th Symposium on Comp. Appl. in Med. Care: 1987 P. 150–4.
Brook R.H., Lohr K.N.: “Efficacy, Effectiveness, Variations and Quality. Boundary Crossing Research”. Medical Care: 1985, 23 (5), P. 710–22.
Buchanan B.G., Shortliffe E.H. (Eds.):“Rule-Based Expert Systems. The MYCIN Experiments of the Stanford Heuristic Programming Project”. Addison-Wesley Publishing Company: 1984.
Donabedian A: “Explorations in Quality Assessing and Monitoring. Vol. 1. The Definition of Quality and Approaches to its Assessment”. Health Administration Press. Ann Arbor, Ml: 1980.
Donabedian A.:“Quality Assessment and Assurance: Unity of Purpose, Diversity of Means”. Inquiry (Blue Cross and Blue Shield Association): 1988 25(spring) P. 173–192.
Epstein A.M.: “The Outcomes Movement - Will It Get Us Where We Want to Go”. The New England Journal of Medicine: 1990 323 (4) P. 266–70.
Kingsland L.C. III: “Evaluation of Medical Expert Systems: Experience with the AI/RHEUM Knowledge-Based Consultant System in Rheumatology”. US Government work:.
Lundsgaarde H.P.: “Evaluating Medical Expert System”. Social Science and Medicine: 1987, 24, P. 805–19.
Miller P.L.: “The Evaluation of Artificial Intelligence Systems in Medicine”. Computer methods and programs in biomedicine: 1986 22 P 5–11..
Miller P.L., Sittig D.F.: “The Evaluation of Clinical Decision Support Systems: What is Necessary versus what is interesting”. Medical Informatics: 1990, 15 (3), P. 185–90.
Nelson S.J., Blois M.S., Tuttle M.S., Erlbaum M., Harrison P., Kim H., Winkelmann B., Yamashita D.: “Evaluating Reconsider. A Computer Program for Diagnostic Prompting”. Journal of Medical Systems: 1985 9 (5/6) P. 379–88.
Office of Technology Assessment: “The Quality of Medical Care. Information for Consumers”. OTA-H-386 Washington D.C. U.S. Government Printing Office: 1988.
Plügge L.A., Verhey F.R.J., Jolles J.: “A Desktop Expert System for the Differential Diagnosis of Dementia. An Evaluation Study”. International Journal of Technology Assessment in Health Care: 1990 6 (1) P. 147–56.
Reggia J.A.: “Evaluation of Medical Expert Systems: Case Study in Performance Assessment”. Proceedings of the 9th Annual Symposium on Computer Applications in Medical Care: 1985 P. 287–91.
Relman A.S.: “Assessment and Accountability. The Third Revolution in Medical Care”. The New England Journal of Medicine: 1988 319 (18) P. 1220–1222.
Rossi-Mori A., Pisanelli D.M., Ricci F.L.: “Evaluation Stages and Design Steps for Knowledge-Based Systems in Medicine”. Medical Informatics: 1990, 15 (3), P. 191–204.
Shamsolmaali A., Collinson P.O., Gray T.G., Carson E.R., Cramp D.G.: “Implementation and Evaluation of a Knowledge-Based System for the Interpretation of Laboratory Data”. Hunter J. et al. (Eds.): AIME 89. Springer Verlag: 1989 P. 167–76.
Waxman H.S., Worley W.E.: “Computer-Assisted Adult Medical Diagnosis: Subject Review and Evaluation of a New Microcomputer-Based System”. Medicine: 1990 69 (3) P. 125–36.
Whitbeck C., Brooks R.: “Criteria for Evaluating a Computer Aid to Clinical Reasoning”. The Journal of Medicine and Philosophy: 1983 8. P. 51–65.
Wyatt J.:“The Evaluation of Clinical Decision Support Systems: A Discussion of the Methodology Used in the ACORN Project”. Fox J. et al. (Eds.): AIME 87. Springer Verlag: 1987 P. 15–24.
Wyatt J., Spiegelhalter D.: “Evaluating Medical Expert Systems: What to Test and How?”. Medical Informatics: 1990, 15 (3), P. 205–17.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1991 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nøhr, C. (1991). Outcomes Assessment, Quality Assurance and Evaluation of Expert Diagnostic Systems. In: Adlassnig, KP., Grabner, G., Bengtsson, S., Hansen, R. (eds) Medical Informatics Europe 1991. Lecture Notes in Medical Informatics, vol 45. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-93503-9_65
Download citation
DOI: https://doi.org/10.1007/978-3-642-93503-9_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-54392-3
Online ISBN: 978-3-642-93503-9
eBook Packages: Springer Book Archive