Review article
Impacts of structuring the electronic health record: Results of a systematic literature review from the perspective of secondary use of patient data

https://doi.org/10.1016/j.ijmedinf.2016.10.004Get rights and content

Highlights

  • The impact of various methods for structuring EHR content – incl. both at the time of care and post hoc structuring approaches – were reviewed from the viewpoint of secondary use of data.

  • Information and system quality were common evaluation topics, and the evaluation outcomes were structure and context sensitive.

  • Evaluation of NLP-applications and their potential in free text re-use in the secondary use context is the predominant research focus of an increasing number of studies after 2005. Parallel to NLP-application evaluations, research of ad hoc structuring methods showed a clear increase in volume after 2000.

  • The benefits of standardized structured EHR data warrant further research, as potential benefits in the secondary use context are based on standardized and interoperable structured patient data.

  • Common evaluation methods would enhance comparable studies on structuring methods to generate more standardized results to be used in evidence-based policy making.

Abstract

Purpose

To explore the impacts that structuring of electronic health records (EHRs) has had from the perspective of secondary use of patient data as reflected in currently published literature. This paper presents the results of a systematic literature review aimed at answering the following questions; (1) what are the common methods of structuring patient data to serve secondary use purposes; (2) what are the common methods of evaluating patient data structuring in the secondary use context, and (3) what impacts or outcomes of EHR structuring have been reported from the secondary use perspective.

Methods

The reported study forms part of a wider systematic literature review on the impacts of EHR structuring methods and evaluations of their impact. The review was based on a 12-step systematic review protocol adapted from the Cochrane methodology. Original articles included in the study were divided into three groups for analysis and reporting based on their use focus: nursing documentation, medical use and secondary use (presented in this paper). The analysis from the perspective of secondary use of data includes 85 original articles from 1975 to 2010 retrieved from 15 bibliographic databases.

Results

The implementation of structured EHRs can be roughly divided into applications for documenting patient data at the point of care and application for retrieval of patient data (post hoc structuring). Two thirds of the secondary use articles concern EHR structuring methods which were still under development or in the testing phase.

Methods

of structuring patient data such as codes, terminologies, reference information models, forms or templates and documentation standards were usually applied in combination. Most of the identified benefits of utilizing structured EHR data for secondary use purposes concentrated on information content and quality or on technical quality and reliability, particularly in the case of Natural Language Processing (NLP) studies. A few individual articles evaluated impacts on care processes, productivity and costs, patient safety, care quality or other health impacts. In most articles these endpoints were usually discussed as goals of secondary use and less as evidence-supported impacts, resulting from the use of structured EHR data for secondary purposes.

Conclusions

Further studies and more sound evaluation methods are needed for evidence on how EHRs are utilized for secondary purposes, and how structured documentation methods can serve different users’ needs, e.g. administration, statistics and research and development, in parallel to medical use purposes.

Introduction

Electronic Health Record (EHR) systems have been widely implemented in health care organizations and are in routine use in most European countries [1]. The European aim is to promote high-quality health care delivery with efficient and integrated services [2]. To support achievement of this aim, several countries have progressed from local to national information systems, including Finland where the decision has been made to extensively document patient data in a structured form at the point of care. National level systems offer health care professionals and other authorized user groups access to patients’ data regardless of where it has been produced and for a variety of purposes beyond patient care, collectively referred to as ‘secondary use of data’.

Secondary use of patient data has been defined as “non-direct care use of Personal Health Information including but not limited to analysis, research, quality/safety measurement, public health, payment, provider certification or accreditation, and marketing and other business including strictly commercial activities” [3].

Completeness and interoperability of health data are key requirements when patient information is to be utilized for secondary purposes and also constitute main goals in developing structured patient records. In most large-scale development cases, standardized patient information is indeed seen as crucial. Structured patient information is perceived to support clinical processes and evidence-based practices. It is expected to facilitate new technologies for patient safety and care quality monitoring in health care service processes [5]. On the other hand, free text documentation is typically deemed as important by primary users of EHR data, who are highly concerned that important information could otherwise be omitted.

In spite the wide and extensive implementations of EHRs, evidence regarding the impacts – positive and negative – of structuring EHR data remains limited. We set out to fill this gap by means of a systematic literature review exploring the impacts that structuring of electronic health records (EHRs) has had from the perspective of secondary use of data. The study is part of a larger systematic literature review on the impacts of EHR data structures and various structuring methods from three different perspectives: nursing [6], medical use [7] and secondary use. This paper reports on (1) what methods of structuring patient data are applied for secondary use purposes, (2) what the common methods of evaluating patient data structuring are in the secondary use context, and (3) what outcomes have been reported from the secondary use perspective.

Section snippets

Methods and description of study material

The systematic literature review on the impacts of structuring the EHR was designed as a 12-step research protocol based on Cochrane reviews and protocols [8]. Our methods – the review protocol, search strategy, databases searched, exclusion and inclusion criteria and the analytical framework – have been detailed in an earlier publication [5]. Literature searches were conducted in 15 bibliographic databases, for which search strategies were defined along PICO-elements: population, intervention,

Structuring patient data for secondary use purposes

Methods for structuring patient records are described in Table 2. Of the reviewed articles, 30% studied combinations of patient data structuring methods, and 26% evaluated specific code sets, classifications or terminologies. Documentation standards or standardized forms for data entry were evaluated in 19% of the articles. In 16% of the articles, the structures consisted of narrative, free text entries, whereby structuring took place after primary documentation of care. Structuring patient

Discussion

Data documented in structured patient records is required to be sufficiently complete, uniformly coded and documented in order to be reliable and interoperable for utilization in contexts other than direct patient care, such as for secondary use purposes. Various methods of structuring, such as classifications, terminologies and documentation standards can support achievement of this goal and, in most cases, can be used in combination within an EHR. Two main secondary use themes emerged in our

Conclusions

The most prominent secondary users’ viewpoint in the reviewed articles was that of researchers and developers building improved EHRs and integrated NLP- and DSS-tools. Although structured documentation contributed to more complete and reliable records, there was limited evidence that structured EHRs would result in higher quality care of patients. Further studies will need to provide valuable evidence on how structured patient data in EHRs is utilized for secondary purposes, and how

Conflict of interest

No reported conflict of interests although Päivi Mäkelä-Bengs and Riikka Vuokko are involved in the definition of obligatory EHR structured data for the Finnish national eHealth architecture.

Author contributions

All the authors contributed to the wider review methodology development and its implementation, the analysis of articles reported in this paper, as well as drafting the original text. Riikka Vuokko and Persephone Doupi had the main responsibility for subsequent revisions and producing the final version of the article. Päivi Mäkelä-Bengs and Persephone Doupi provided medical expertise and Hannele Hyppönen had the main responsibility of the systematic literature review project.

Acknowledgement

The authors wish to thank Matt Cobb for suggestions on how to improve clarity of the article.

References (105)

  • B. Hazlehurst et al.

    Natural language processing in the electronic medical record: assessing clinician adherence to tobacco treatment guidelines

    Am. J. Prev. Med.

    (2005)
  • J.E. Heffner et al.

    Using intranet-based order sets to standardize clinical care and prepare for computerized physician order entry

    Joint Comm. J. Qual. Saf.

    (2004)
  • G. Hripcsak et al.

    Using discordance to improve classification in narrative clinical databases: an application to community-acquired pneumonia

    Comput. Biol. Med.

    (2007)
  • G. Jiang et al.

    Context-based ontology building support in clinical domains using formal concept analysis

    Int. J. Med. Inf.

    (2003)
  • R.A. Leth et al.

    Surveillance of selected post-caesarean infections based on electronic registries: validation study including post-discharge infections

    J. Hosp. Infect.

    (2010)
  • G. Melton et al.

    Automated detection of adverse events using natural language processing of discharge summaries

    J. Am. Med. Inform. Assoc.

    (2005)
  • G. Mikkelsen et al.

    Manual semantic tagging to improve access to information in narrative electronic medical records

    Int. J. Med. Inf.

    (2002)
  • S.V. Pakhomov et al.

    Prospective recruitment of patients with congestive heart failure using an ad-hoc binary classifier

    J. Biomed. Inform.

    (2005)
  • S.V. Pakhomov et al.

    Epidemiology of angina pectoris: role of natural language processing of the medical record

    Am. Heart J.

    (2007)
  • J.L. Schnipper et al.

    Smart form in an electronic medical record: documentation-based clinical decision support to improve disease management

    J. Am. Med. Inform. Assoc.

    (2008)
  • E. Silfen

    Documentation and coding of ED patient encounters: an evaluation of the accuracy of an electronic medical record

    Am. J. Emerg. Med.

    (2006)
  • Jason M. Sutherland et al.

    Hospital factors associated with clinical data quality

    Health Policy

    (2009)
  • K. Tu et al.

    Diabetics can be identified in an electronic medical record using laboratory tests and prescriptions

    J. Clin. Epidemiol.

    (2011)
  • Xiaoyan Wang et al.

    Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: a feasibility study

    J. Am. Med. Inform. Assoc.

    (2009)
  • H. Ware et al.

    Natural language processing framework to assess clinical conditions

    J. Am. Med. Inform. Assoc.

    (2009)
  • J. Voorham et al.

    Computerized extraction of information on the quality of diabetes care from free text in electronic patient records of general practitioners

    J. Am. Med. Inform. Assoc.

    (2007)
  • H. Yang et al.

    A text mining approach to the prediction of disease status from clinical discharge summaries

    J. Am. Med. Inform. Assoc.

    (2009)
  • F. Bakhshi-Raiez et al.

    A usability evaluation for a SNOMED CT based compositional interface terminology for intensive care

    Int. J. Med. Inf.

    (2012)
  • C. Codagnone, F. Lupiañez-Villanueva, Benchmarking Deployment of eHealth among General Practitioners. European...
  • J. Adler-Milstein et al.

    Benchmarking health IT among OECD countries: better data for better policy

    J. Am. Med. Inform. Assoc.

    (2014)
  • C. Safran et al.

    Toward a national framework for the secondary use of health data, an american medical informatics association white paper

    Am. Med. Inform. Assoc.

    (2007)
  • Z. Morrison et al.

    National evaluation of the benefits and risks of greater structuring and coding of the electronic health record: exploratory qualitative investigation

    J. Am. Med. Inform. Assoc.

    (2014)
  • K. Saranto et al.

    Impacts of structuring nursing records: a systematic review

    Scand. J. Caring Sci.

    (2013)
  • H. Forsvik, V. Voipio, J. Lamminen, P. Doupi, R. Vuokko, H. Hyppönen, (In review) Literature review of patient record...
  • J.P.T. Higgins, S. Green, Cochrane Handbook for systematic reviews of interventions, version...
  • W.H. DeLone et al.

    The DeLone and McLean model of information systems success: a ten-year update

    J. Manage. Inf. Syst.

    (2003)
  • R. Vuokko et al.

    Secondary use of structured patient data: interim results of a systematic review

    Proceedings of MIE 2015, Series Studies in Health Technology and Informatics

    (2015)
  • H. Alamgir et al.

    An evaluation of hospital discharge records as a tool for serious work related injury surveillance

    Occup. Environ. Med.

    (2006)
  • K. Atalag et al.

    Evaluation of the Turkish translation of the Minimal Standard Terminology for Digestive Endoscopy by development of an endoscopic information system

    Turk. J. Gastroenterol.

    (2007)
  • P. Avillach et al.

    Improving the quality of the coding of primary diagnosis in standardized discharge summaries

    Health Care Manage. Sci.

    (2008)
  • D.W. Baker et al.

    Automated review of electronic health records to assess quality of care for outpatients with heart failure

    Ann. Intern. Med.

    (2007)
  • J.L. Bezanson et al.

    Assessing data adequacy for clinical research: reliability and validity of a surgical database

    J. Nurs. Meas.

    (2002)
  • P.J. Brown et al.

    Evaluation of the quality of information retrieval of clinical findings from a computerized patient database using a semantic terminological model

    J. Am. Med. Inform. Assoc.

    (2000)
  • D. Byrne et al.

    Medical Practitioners Act 2007: the increased medical record burden

    Ir. Med. J.

    (2010)
  • L.A. Camacho et al.

    Assessment of the validity and reliability of three systems of medical record screening for quality of care assessment

    Med. Care

    (1998)
  • R. Carroll et al.

    Reporting hospital adverse events using the Alfred Hospital's morbidity data

    Aust. Health Rev.

    (2003)
  • E.S. Casper

    Innovations: medical record standards compliance as a function of selected staff variables

    Top. Health Rec. Manage.

    (1989)
  • I. Chamisa et al.

    Setting the records straight-a prospective audit of the quality of case notes in a surgical department

    S. Afr. J. Surg.

    (2007)
  • W. Chapman Wendy et al.

    Fever detection from free-text clinical records for biosurveillance

    J. Biomed. Inform.

    (2004)
  • H.S. Chase et al.

    Under-documentation of chronic kidney disease in the electronic health record in outpatients

    J. Am. Med. Inform. Assoc.

    (2010)
  • Cited by (49)

    • (Re)configuration of digital health records to optimize diagnosis and therapy

      2024, Handbook of Digital Technologies in Movement Disorders
    • Prediagnostic expressions in health records predict mortality in Parkinson's disease: A proof-of-concept study

      2022, Parkinsonism and Related Disorders
      Citation Excerpt :

      EHR systems are currently in routine use in many countries, including Finland [12], and the increasing amount of data can be used for several secondary purposes, such as statistics and decision support [12]. There is potentially valuable information inside EHRs that could be utilized using data mining of language processing [12]. Therefore, in this retrospective record-based cohort study, we sought to investigate whether data mining of prediagnostic language can be used for PD research.

    • Behavior change techniques to promote healthcare professionals’ eHealth competency: A systematic review of interventions

      2021, International Journal of Medical Informatics
      Citation Excerpt :

      Fig. 1 depicts the COM-B model for eHealth performance in the course of an organizational intervention. Previous systematic reviews of interventions promoting healthcare professionals’ eHealth performance have focused only on electronic health records (EHRs) and a specific healthcare setting [13,14] or type of intervention [15,16]. The review by Gagnon et al. [17] focused on interventions promoting eHealth adoption, but more than ten years have passed from its data collection.

    View all citing articles on Scopus
    View full text