Role of patient descriptors in predicting antimicrobial resistance in urinary tract infections using a decision tree approach: A retrospective cohort study

https://doi.org/10.1016/j.ijmedinf.2019.04.020Get rights and content

Highlights

  • Antimicrobials are prescribed empirically for urinary tract infections without microbiological confirmation (pathogen) in general practice.

  • Antimicrobial resistance is driven by antimicrobial prescribing, of which 80% in general practice.

  • A decision tree model based on patient’s descriptors was developed to predict culture positivity and antimicrobial susceptibility.

  • The model shows 68%–92% accuracy in predicting culture and resistance based on patients descriptors.

  • Extending the application of decision tree models could support general practitioners to improve antibiotic prescribing.

Abstract

Background

In general practice, many infections are treated empirically prior to or without microbiological confirmation. Prediction of antimicrobial susceptibility could optimise prescribing thus improving patient outcomes. Decision tree models are a novel idea to predict AMR at the time of clinical presentation. This study aims to apply a prediction model using a decision tree approach to predict the antimicrobial resistance (AMR) of pathogens causing urinary tract infections (UTI) for patients over 65 years based on pre-existing routine laboratory data.

Methods

Data were extracted from the database of the microbiological laboratory of the University Hospitals Galway (UHG). All urine results from patients over 65 years, their microbiological analysis and susceptibility (AST) results from January 2011 to December 2015 were included. The primary endpoint was culture result and resistance to antimicrobials (nitrofurantoin, trimethoprim, ciprofloxacin, co-amoxiclav, and amoxicillin) commonly used to treat UTI. A non-parametric regression tree analysis i.e. a decision tree model was generated with the 75% of the dataset (training set) and validated with the remaining 25% (test set). The model performance was evaluated measuring Area Under the Curve Receiver Operating Characteristic (AUC_ROC) curve.

Results

A total of 99,101 urine samples of patients over 65 years were submitted for culture over the five years and 27% had significant bacteriuria (≥104 cfu/ml) and AST. The most common identified causative organisms were E.coli, Klebsiella spp. and Proteus spp. E.coli was more often resistant to amoxicillin (66%) followed by Proteus spp. (41%). Klebsiella spp. and Proteus spp. were more often resistant to trimethoprim (78% and 54% respectively). E. coli resistance to nitrofurantoin is low (<10%). The decision tree model showed an AUC-ROC score of 0.68 for culture and in between 0.60 to 0.97 for antimicrobial resistance of the pathogens, with the inclusion of patient’s descriptors only. Including the uropathogen in the model did not change model performance.

Conclusions

The decision tree models using patient descriptors available at the time of presentation showed fair to excellent performance in predicting culture and antimicrobial resistance. The presented models provide an alternative approach to decision making on antimicrobial prescribing for UTIs. Increasing more predictors in the model could improve the model performance. Prospective data collection, validation and feasibility testing of the model including data from other laboratories will progress the practical implementation of similar models.

Introduction

Urinary tract infection (UTI) is the most frequently occurring bacterial infection [1]. Both in the UK and the Netherlands 1% of all general practitioners (GPs) consultation are for UTIs [2,3]. In the United States alone 7.9 million physician visits per year are for UTI treatment [4]. The prevalence of UTI increases with age and UTIs occur more often in females than in males [5,6]. Elderly in the community (over 65 years) as well as nursing homes (NHs) residents more often have UTIs [7]. UTI is the number one infection in long-term care facilities (LTCFs) in Europe with 31% of residents reported as having a UTI (10% confirmed and 21% probable UTI) on the day of the survey [8]. UTI is caused by various pathogens, but gram-negative bacteria such as E. coli, Klebsiella species, and Proteus mirabilis species are the most commonly identified pathogens [9,10].The rapid increase in the resistance of these bacterial pathogens to commonly used antimicrobials is a global concern. Due to increased resistance, the number of alternative options of antimicrobials to treat infections is decreasing [11]. The National Institute for Health and Care Excellence (NICE), UK and the Health Service Executive (HSE) Ireland have developed guidelines for appropriate use of antimicrobials for patients over 65 years [12,13]. According to the HSE, trimethoprim and nitrofurantoin (except when renal impairment) are the recommended first-line antimicrobials to treat UTI in patients over 65 years [13]. Co-amoxiclav, ciprofloxacin, or cephalexin are recommended when acute pyelonephritis develops [13,14]. Empiric treatment should take account of local resistance patterns where applicable to ensure effective treatment of the condition in question [13,15]. In the western region of Ireland, it has been shown that 50% of E. coli are resistant to ampicillin and 30% to trimethoprim, making these agents unsuitable for empiric UTI treatment [15,16]. Various guidelines outline about the appropriate prescribing of antimicrobial, but still a high level of inappropriate and overprescribing of antimicrobials has been observed in the community [17]. This has negative consequences including the development and further spread of multidrug resistance (MDR) [18,19]. Studies conducted in NHs estimate that 25–75% of the systemic antimicrobials and up to 60% of topical antimicrobials are prescribed inappropriately [20].

Urine samples constitute the largest category of specimens sent from the community to medical microbiology laboratories [21,22]. Guidelines recommend urine culture in certain conditions such as symptomatic UTI, recurrent UTI, infections of upper urinary tract, during pregnancy or where firstline antimicrobials failed [13,14]. However, in a previous study it was shown that general practitioners routinely submit samples on from all patients suspected to have a UTI [23]. Generally, in patients with typical clinical features of UTI empiric prescribing is initiated prior to microbiological confirmation of bacteriuria and antimicrobial susceptibility testing. Predicting culture results and possible resistance of pathogens to antimicrobials based on patient descriptive characteristics at General Practice could improve prescribing, assist in reducing AMR and ultimately the cost of care. This motivated us to apply a decision tree approach to develop a prediction model on AMR. The model predicts culture results (positive/negative) and resistance of pathogens associated with UTI to commonly prescribed antimicrobials (nitrofurantoin, trimethoprim, ciprofloxacin, amoxicillin, and co-amoxiclav) using basic patient descriptive features.

Section snippets

Study design and population

This study is a retrospective analysis of Antimicrobial Susceptibility Testing (AST) data obtained from the laboratory of University Hospitals Galway (UHG) from January 2011 to December 2015. Essentially all GPs, hospitals and NHs in the catchment area send urine samples of their patients to the UHG laboratory for microbiological analysis including AST. The study included all the urine samples of UTI patients over 65 years of age sent for culture. Urine samples with polymicrobial culture were

Results

A total of 99,101 urine samples of patients over the age of 65 years were submitted from January 2011 to December 2015 to the microbiology laboratory of GUH. Of the submitted urines, 33,862 were primary samples while 65,239 were subsequent samples from a person who had a previous sample submitted during the five-year period. Twenty-seven percent (26,763) of the total submitted samples had significant bacteriuria and has AST performed. Of the AST tested samples, 13,250 (39%) were primary

Discussion

This study demonstrates the application of a decision tree model to predict uropathogen resistance to commonly prescribed antimicrobials using basic patient descriptors. Sex, care type (GP/NH/hospital) and number of previous urine samples were the most important predictors of culture result (positive or negative). For AMR, age was a primary predictor for amoxicillin, ciprofloxacin and co-amoxiclav resistance but for nitrofurantoin and trimethoprim, the number of previously performed AST and

Conclusions

The decision tree models developed including only patients descriptors shows that models can support clinicians with a rule-based mechanism to identify the best treatment for the patient. More research into the application of similar models can further help guiding appropriate prescribing.

Author’s contribution

MT, AV and MoT conceived of the study. MT performed the initial phase of data management and analysis. MoT supported MT in the application of the decision tree algorithm. MT performed the final analysis and drafted the article. AV extensively reviewed the manuscript and shaped the discussion. MC contributed to the discussion and reviewed the manuscript. All authors approved the final manuscript.

Funding

MT is funded by a National University of Ireland Galway (NUIG), School of Medicine, PhD grant College of Medicine, Nursing and Health Science (CMNHS) Scholarship.

Conflict of interest

None

Summary table

What is known already?

  • Urinary tract infections (UTIs) are bacterial infections usually treated empirically without microbiological confirmation.

  • Community urine samples constitute the largest category of specimens for analysis in medical microbiology laboratories

  • Most guidelines do not recommend sending a urine sample for culture for uncomplicated or asymptomatic UTIs.

What adds to body of knowledge?

  • This decision tree model is the first prediction model applied to predict culture

Acknowledgement

Sincere thanks to Ms. Belinda Hanahoe from Department of Medical Microbiology, GUH, Galway for data extraction.

References (54)

  • K.B. Laupland et al.

    Community-onset urinary tract infections: a population-based assessment

    Infection

    (2007)
  • European Centre for Disease Prevention and Control. Point Prevalence Survey of Health Care-associated Infections and Antimicrobial Use in European Long-term Care Facilities

    (2013)
  • A. Pallett et al.

    Complicated urinary tract infections: practical solutions for the treatment of multiresistant Gram-negative bacteria

    J. Antimicrob. Chemother.

    (2010)
  • L.E. Nicolle

    Urinary tract infection in long-term-care facility residents

    Clin. Infect. Dis.

    (2000)
  • A. Nerurkar et al.

    Bacterial pathogens in urinary tract infection and antibiotic susceptibility pattern

    J. Pharm. Biomed. Sci.©(JPBMS).

    (2012)
  • Urinary Tract Infections in Adults

    (2015)
  • HSE

    Guidelines for Antimicrobial Prescribing in Primary Care in Ireland: Health Service Executive

    (2012)
  • SIGN
  • F.O.K. Tadhg-larla Curran et al.

    Current concept in the treatment of UTIs : local resistance patterns to E. coli are improtant in selecting the appropriate antibiotic

    Clin. Rev. Forum

    (2013)
  • M. Ni Chulain et al.

    Antimicrobial resistance inE. Coli associated with urinary tract infection in the West of Ireland

    Ir. J. Med. Sci.

    (2005)
  • P. McClean et al.

    Antimicrobial prescribing in residential homes

    J. Antimicrob. Chemother.

    (2012)
  • T.A. Rowe et al.

    Urinary tract infection in older adults

    Aging health

    (2013)
  • C. Llor et al.

    Antimicrobial resistance: risk associated with antibiotic overuse and initiatives to reduce the problem

    Ther. Adv. Drug Saf.

    (2014)
  • L.E. Nicolle et al.

    Antimicrobial use in long term care facilities

    Infect. Control Hosp. Epidemiol.

    (2000)
  • M.L. Wilson et al.

    Laboratory diagnosis of urinary tract infections in adult patients

    Clin. Infect. Dis.

    (2004)
  • A. Vellinga et al.

    Antimicrobial management and appropriateness of treatment of urinary tract infection in general practice in Ireland

    BMC Fam. Pract.

    (2011)
  • E. Matuschek et al.

    Development of the EUCAST disk diffusion antimicrobial susceptibility testing method and its implementation in routine microbiology laboratories

    Clin. Microbiol. Infect.

    (2014)
  • Cited by (11)

    • Impact of antimicrobial stewardship program on antimicrobial-resistance and prescribing in nursing homes: a systematic review and meta-analysis

      2022, Journal of Global Antimicrobial Resistance
      Citation Excerpt :

      Urine culture is another area of concern in NHs, as they are ordered unnecessarily, and empiric prescribing is common while awaiting culture results [49,50]. NH residents often harbour asymptomatic bacteriuria; hence positive urine culture does not always confirm a UTI [51,52]. The unnecessary UTI culture ordering may lead to erroneous antimicrobial prescribing, even prophylactic prescribing, and subsequently increase the risk of AMR [53,54].

    • Discovering symptom patterns of COVID-19 patients using association rule mining

      2021, Computers in Biology and Medicine
      Citation Excerpt :

      In recent days, machine learning techniques have been widely used in biomedical studies for prediction and knowledge discovery [23,24]. There are several applications of machine learning in biomedicine, such as genomic analysis [25–27], disease-gene analysis [28–31], mortality prediction [32], personalized medicine [33,34], drug discovery [35–38], prediction of adverse drug events [39–42], patient similarity [43,44], and explainable artificial intelligence methods in medicine [45–48]. One area for machine learning approaches in medicine is the association rule mining (ARM).

    • The detection of hospitalized patients at risk of testing positive to multi-drug resistant bacteria using MOCA-I, a rule-based “white-box” classification algorithm for medical data

      2020, International Journal of Medical Informatics
      Citation Excerpt :

      The method described by Jaro-Winkler [16] to identify an address equivalent to a nursing home address was also applied. We followed the same protocol as Tandan et al. [17], we divided the data set into training data and test data to detect overfitting. Table 2 gives insights about the data set repartition.

    View all citing articles on Scopus
    View full text