Abstract
We have previously developed an architecture and a set of tools called the Digital electronic Guideline Library (DeGeL), which includes a web-based tool for structuring (marking-up) free-text clinical guidelines (GLs), namely, the URUZ Mark-up tool. In this study, we developed and evaluated a methodology and a tool for a mark-up-based specification and assessment of the quality of that specification, of procedural and declarative knowledge in clinical GLs. The methodology includes all necessary activities before, during and after the mark-up process, and supports specification and conversion of the GL’s free-text representation through semi-structured and semi-formal representations into a machine comprehensible representation. For the evaluation of this methodology, three GLs from different medical disciplines were selected. For each GL, as an indispensable step, an ontology-specific consensus was created, determined by a group of expert physicians and knowledge engineers, based on GL source. For each GL, two mark-ups in a chosen GL ontology (Asbru) were created by a distinct clinical editor; each of the clinical editors created a semi-formal mark-up of the GL using the URUZ tool. To evaluate each mark-up, a gold standard mark-up was created by collaboration of physician and knowledge engineer, and a specialized mark-up-evaluation tool was developed, which enables assessment of completeness, as well as of syntactic and semantic correctness of the mark-up. Subjective and objective measures were defined for qualitative and quantitative evaluation of the correctness (soundness) and completeness of the marked-up knowledge, with encouraging results.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Grimshaw, J.M., Russel, I.T.: Effect of clinical guidelines on medical practice: A systematic review of rigorous evaluations. Lancet 342, 1317–1322 (1993)
Tu, S.W., Musen, M.A.: A flexible approach to guideline modeling. In: Proc. AMIA Symp., pp. 420–424 (1999)
Johnson, P.D., Tu, S.W., Booth, N., Sugden, B., Purves, I.N.: Using scenarios in chronic disease management guidelines for primary care. In: Proc. AMIA Annu. Fall Symp., pp. 389–393 (2000)
Boxwala, A.A., Peleg, M., Tu, S., et al.: GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines. J. Biomed. Inform. 37(3), 147–161 (2004)
Sutton, D.R., Fox, J.: The Syntax and Semantics of the PROforma guideline modelling language. J. Am. Med. Inform. Assoc. 10(5), 433–443 (2003)
Quaglini, S., Stefanelli, M., Lanzola, G., Caporusso, V., Panzarasa, S.: Flexible guideline-based patient careflow systems. Artif. Intell. Med. 22, 65–80 (2001)
Shiffman, R.N., Karras, B.T., Agrawal, A., Chen, R., Marenco, L., Nath, S.: GEM: a proposal for a more comprehensive guideline document model using XML. J. Am. Med. Inform. Assoc. 7(5), 488–498 (2000)
Noy, N.F., Crubezy, M., Fergerson, R.W., et al.: Protégé-2000: An Open-source Ontology-development and Knowledge-acquisition Environment. In: Proc. AMIA Symp., p. 953 (2003)
Votruba, P., Miksch, S., Kosara, R.: Facilitating knowledge maintenance of clinical guidelines and protocols. Medinfo. 11(Pt 1), 57–61 (2004)
Ruzicka, M., Svatek, V.: Mark-up based analysis of narrative guidelines with the Stepper tool. Stud.
Shahar, Y., Young, O., Shalom, E., Galperin, M., Mayaffit, A., Moskovitch, R., Hessing, A.: A Framework for a Distributed, Hybrid, Multiple-Ontology Clinical-Guideline Library and Automated Guideline-Support Tools. Journal of Biomedical Informatics 37(5), 325–344 (2004)
Shahar, Y., Miksch, S., Johnson, P.: The Asgaard project: A task-specific framework for the application and critiquing of time-oriented clinical guidelines. Artificial Intelligence in Medicine (14), 29–51 (1998)
Peleg, M., Tu, S., Bury, J., Ciccarese, P., Fox, J., Greenes, R.A., et al.: Comparing computer-interpretable guideline models: a case-study approach. J. Am. Med. Inform. Assoc. 10(1), 52–68 (2003)
De Clercq, P.A., Blom, J.A., Korsten, H.H., Hasman, A.: Approaches for creating computer-interpretable guidelines that facilitate decision support. Artif. Intell. Med. 31(1), 1–27 (2004)
Peleg, M., Gutnik, L., Snow, V., Patel, V.L.: Interpreting procedures from descriptive guidelines. Journal of Biomedical Informatics (2005) (in press)
Miller, R.A., Waitman, L.R., Chen, S., Rosenbloom, S.T.: The anatomy of decision support during inpatient care provider order entry (CPOE): Empirical observations from a decade of CPOE experience at Vanderbilt. J. Biomed. Inform. 38(6), 469–485 (2005)
Shalom, E., Shahar, Y., Lunenfeld, E., Taieb-Maimon, M., Young, O., Bar, G., et al.: The importance of creating an ontology-specific consensus before a markup-based specification of clinical guidelines. In: The 17th European Conference on Artificial Intelligence (ECAI2006), the workshop on AI techniques in healthcare: evidence-based guidelines and protocols, Trento, Italy, August 29. IOS Press, Amsterdam (2006)
Shalom, E., Shahar, Y., Taieb-Maimon, M., Lunenfeld, E.: A Quality Assessment Tool for Markup-Based Clinical Guidelines. In: AMIA Annu. Symp. Proc., Washington, DC, November 6, p. 1127 (2008)
Centers for Disease Control and Prevention (CDC) web site. Sexually Transmitted Diseases Treatment Guidelines (2002), http://www.cdc.gov/mmwr/preview/mmwrhtml/rr5106a1.htm
Inpatient Management of COPD: Emergency Room and Hospital Ward Management (B1), Veterans Affairs (VA) web site (2005), http://www.oqp.med.va.gov/cpg/COPD/copd_cpg/content/b1/annoB1.htm
The American Association of Clinical Endocrinologists (AACE) Web site. American Association of Clinical Endocrinologists medical guidelines for clinical practice for the evaluation and treatment of hyperthyroidism and hypothyroidism (2002), http://www.aace.com/pub/pdf/guidelines/hypo_hyper.pdf
Shalom, E.: An Evaluation of a methodology for Specification of Clinical Guidelines at Multiple Representation Levels. Master Thesis. 2006; Technical report No. 14942, Dpt. of Information Systems Engineering, Faculty of Engineering, Ben Gurion University, Beer Sheva, Israel (2006)
Shalom, E., Shahar, Y., Taieb-Maimon, M., Bar, G., Young, O.B., Martins, S., Vaszar, L., Liel, Y., Yarkoni, A.K., Goldstein, M., Leibowitz, A., Marom, T., Lunenfeld, E.: A Quantitative Evaluation of a Methodology for Collaborative Specification of Clinical Guidelines at Multiple Representation Levels. Journal of Biomedical Informatics 41(6), 889–903 (2008)
Hatsek, A., Shahar, Y., Taieb-Maimon, M., Shalom, E., Dubi-sobol, A., Bar, G., et al.: A Methodological Specification of a Guideline for Diagnosis and Management of PreEclampsia. In: The 18th European Conference on Artificial Intelligence (ECAI 2008), Workshop on Knowledge Management for HealthCare Processes, Greece, July 21. IOS Press, Amsterdam (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shalom, E. et al. (2009). Can Physicians Structure Clinical Guidelines? Experiments with a Mark-Up-Process Methodology. In: Riaño, D. (eds) Knowledge Management for Health Care Procedures. K4HelP 2008. Lecture Notes in Computer Science(), vol 5626. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03262-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-03262-2_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03261-5
Online ISBN: 978-3-642-03262-2
eBook Packages: Computer ScienceComputer Science (R0)