Skip to main content

Advertisement

SpringerLink
Log in

Development of Test Toolkit of Hard Review to Evaluate a Random Clinical Decision Support System for the Management of Chronic Adult Diseases

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Over 30 % of Korean population suffers from chronic diseases, and the management cost of this portion of the population is estimated to be more than 7 % of the gross domestic product and is expected to continue to increase with the aging of society. The u-healthcare (ubiquitous healthcare)-based home healthcare service has been emerging as a solution to this issue. Clinical decision support system (CDSS) is software that provides professional medical knowledge to help people make medical decisions, and is required for the efficient operation of u-healthcare as a core technology. U-healthcare-based CDSS is meant to improve accessibility of medical information for the public, but it at the same time carries a substantial risk of misuse. Hence, a certain level of standards and specifications is required to guarantee the quality of u-healthcare-based CDSS to protect public health. In this context, this project aimed to develop technologies to evaluate reliabilities of u-healthcare-based CDSS dealing with diabetes mellitus and hypertension. This study created a Test Toolkit to evaluate random CDSS with a function to confirm results obtained from CDSS performance evaluation technologies. Results of CDSS were obtained based on screening test items. The design descriptions are defined as (1) creation of test scenario to test CDSS, (2) grading function using returned answers to CDSS, and (3) confirmation of test result. The functions of the Test Toolkit are divided into two types. (1) Test scenarios and the answers to the scenarios are created by reading and fabricating standard scenarios from the DB based on test items input by the evaluator. (2) Appraisal CDSS creates a file of result values using a given test scenario file, and then a CDSS evaluation report, classified by test item, is formed by comparing answers to those found in (1). It should be noted that functions (1) and (2) are completely independent. Conclusively, researchers developed a toolkit to evaluate clinical reliabilities and software stabilities of CDSS for healthcare free from misjudgments caused by human factors and to speed up overall evaluation processes tremendously and efficiently. This toolkit will ensure proper usage of CDSS by the public for health benefits.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Ministry of Health and Welfare (2010). Administrative publication 11–1351159-000027-10. National Health Statistics 2009.

  2. Ministry of Health and Welfare (2012). 2010–2020 Healthcare expenditure mid-to-long term prospects. Republic of Korea.

  3. Kailas, A., & Ingram, M. A. (2009). Wireless aspects of telehealth. Wireless Personal Communication, 51, 673–686.

    Article  Google Scholar 

  4. Oleshchuk, V., & Fensli, R. (2011). Remote patient monitoring within a future 5G infrastructure. Wireless Personal Communication, 57, 431–439.

    Article  Google Scholar 

  5. Samsung Economics Research Institute (2007). The beginning of u-healthcare diffusion. Republic of Korea.

  6. Dinesen, B., & Toft, E. (2009). Telehomecare challenge collaboration among healthcare professionals. Wireless Personal Communication, 51, 711–724.

    Article  Google Scholar 

  7. Boye, N. (2009). The citizen as co-producer of health: The need for “Infusion of Medicine into Technology” in future application of information and communication technology in health. Wireless Personal Communications, 51, 739–751.

    Article  Google Scholar 

  8. Hunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998). Effects of computer-based clinical decision support systems on physician performance and patient outcomes: A systematic review. JAMA, 280(15), 1339–1346.

    Article  Google Scholar 

  9. Johnston, M. E., Langton, K. B., Haynes, R. B., & Mathieu, A. (1994). Effects of computer-based clinical decision support systems on clinician performance and patient outcome: A critical appraisal of research. Annals of Internal Medicine, 120(2), 135–142.

    Article  Google Scholar 

  10. Lawrence, S., & Giles, C. L. (1999). Accessibility of information on the web. Nature, 400(6740), 107–109.

    Article  Google Scholar 

  11. Miller, R. A. (1994). Medical diagnostic decision support systems-past, present, and future: A threaded bibliography and brief commentary. Journal of American Medical Informatics Association, 1(1), 8–27.

    Article  Google Scholar 

  12. Shortliffe, E. H. (1990). Medical informatics: Computer applications in health care. MA: Addison Wesley.

    Google Scholar 

  13. Musen, M. A. (1997). Modelling of decision support. In J. H. V. Bemmel & M. A. Musen (Eds.), Handbook of medical informatics. Houten: Bohn Stafleu Van Loghum.

    Google Scholar 

  14. Korea Food and Drug Administration (2007). Administrative Publication 11–1470000-001483-01. Guidelines for medical software validation. Republic of Korea.

  15. Ahn, J. T., Son, J., Lim, C. S., Ahn, J. C., Lee, H. S., Kang, J., Park, G. H., Cha, J., & Park, K. (2013). Study on the evaluation technology for effectiveness and safety of clinical decision support system for the management of chronic adult disease. The 1st International Conference on Digital Policy and Management, 35–37.

  16. Sintchenko, V., Westbrook, J., Tipper, S., Mathie, M., & Coiera, E. (2003). Electronic decision support activities in different healthcare settings in Australia. Electronic Decision Support for Australia’s Health Sector (Appendix A).

  17. The Korean Society of Hypertension (2005). Practice guideline for hypertension in Korea. Republic of Korea.

  18. The Korean Diabetes Association (2011). Clinical practice guidelines for diabetes in Korea. Republic of Korea.

  19. IEC 60601-1-4 Consol. Ed. 1.1 (incl. am1) (2000). Bilingual, Medical electrical equipment—part 1–4: General requirements for safety—collateral standard: Programmable electrical medical systems. USA.

Download references

Acknowledgments

This study was performed with the support of the research project of the Korea Food and Drug Administration (KFDA), Grant Number: 08142 Medical Equipment 365 (Research on performance evaluation guidelines of u-healthcare-based CDSS).

Author information

Authors and Affiliations

  1. Department of Biochemistry, College of Medicine, Korea University, Seoul, 136-701, Korea

    Joon Tae Ahn, Gil Hong Park & Jaebum Son

  2. Department of Laboratory Medicine, Guro Hospital, Korea University, Seoul, 136-701, Korea

    Chae Seung Lim

  3. College of Information and Communications, Korea University, Seoul, 136-701, Korea

    Jaewoo Kang

  4. National Institute of Food and Drug Safety Evaluation, Cheongju, 363-951, Chungcheongbuk-do, Korea

    Jihun Cha & Kijung Park

  5. Department of Creative Arts Therapy, College of Medical Science, Jeonju University, Jeonju, 560-759, Jeollabuk-do, Korea

    Dong Min Kim

Authors
  1. Joon Tae Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gil Hong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jaebum Son
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chae Seung Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jaewoo Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jihun Cha
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kijung Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Dong Min Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dong Min Kim.

Additional information

Joon Tae Ahn and Gil Hong Park contributed equally to this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahn, J.T., Park, G.H., Son, J. et al. Development of Test Toolkit of Hard Review to Evaluate a Random Clinical Decision Support System for the Management of Chronic Adult Diseases. Wireless Pers Commun 79, 2469–2484 (2014). https://doi.org/10.1007/s11277-014-1835-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-014-1835-7

Keywords

Search

Navigation