Concordance of information in parallel electronic and paper based patient records

https://doi.org/10.1016/S1386-5056(01)00152-6Get rights and content

Abstract

Objective: to evaluate the results of parallel use of both paper based and electronic patient records with respect to concordance of corresponding information in two continuously updated versions of the same records. Design: retrospective evaluation of patient records, comparing documentation in electronic and paper based patient records. Setting: Department of Neurology in a Norwegian university hospital using paper based and electronic patient records in parallel during migration towards completely electronic patient records. Material: electronic and paper based patient records of 90 randomly selected patients visiting the department between 1 November 1997 and 30 April 1999. Results: seven percent of the electronic documents were significantly different in some way from the corresponding paper documents. About 4–13% of the documents in the electronic record were missing; one percent were missing from the paper record. Conclusion: parallel use of electronic and paper based patient records has resulted in inconsistencies between the record systems in our setting. Documentation is missing in both the electronic and paperbased records. When implementing electronic record systems intended to operate in parallel with paperbased systems, focus should be on securing the validity of all versions of the record.

Introduction

The implementation of electronic patient record (EPR) systems in hospitals is a major task [1], [2], [3]. The diversity and size of the hospital organization together with the complexity of the information systems make widespread implementation of EPR systems an overwhelming effort for most hospitals of more than minimal size [4], [5], [6]. To avoid dramatic organizational changes and to secure operational records all the time during the implementation process, gradual replacement of paper-based records by electronic systems may be a rational strategy [7], [8], [9], [10]. In this way, electronic handling of various aspects of the patient record can be implemented gradually over time, leaving room for the organization to get accustomed to new ways of working while paper records are still available as backup.

This strategy does, however, imply parallel maintenance of both paper records and electronic records until the EPR system has completely substituted the paper based patient records. Information systems operating in parallel, i.e. handling corresponding and continuously updated information, are at risk of becoming inconsistent. This definitely is the situation when patient records are maintained in both electronic and paper based versions, in which updating of one system is possible without necessarily updating the other. If functionality of the electronic system and overall routines for production of patient records are not focused on keeping both systems consistent, chances are substantial that inconsistencies of the information in the two systems will arise. Information present in one system may be missing or appear different in the other, leaving doubt regarding the reliability of information in the two systems. The aspect of inconsistency is a qualitative aspect that must be considered when clinical patient documentation is maintained in several different information systems. Needless to say, failure of the record systems to provide consistent information may have serious consequences. In addition to consequences for the delivery of care and legal problems, failure of the record systems to provide correct and complete documentation of patients encounters with the health care organization may cause decreased confidence in the validity of the patient record among users of the record and among patients. Users may end up feeling obliged to check several sources for verification of important information, causing frustration and impaired efficiency.

On this background we wanted to evaluate the consistency of information in electronic patient records and corresponding paper records in a setting where paper records operate in parallel with an electronic patient record system. Specifically, we wanted to measure the degree of concordance between defined parts of the paper based and electronic records with regard to informational content. Our hypothesis was that there are inconsistencies between the systems, caused by failure to update both parallel versions of the record. Additionally, we expected paper records in general to contain more complete information than electronic records, due to routines for maintaining patient records in our department at the time.

Section snippets

Setting

The study was performed in the Department of Neurology (DoN) in a Norwegian university hospital. The department has 25 beds of a total of 971 in the hospital. In 1998, the number of inpatient encounters in the DoN was 1172 and the number of outpatient encounters was 6945. In total, the hospital had 42 995 and 250 617 inpatient and outpatient encounters, respectively, the same year. The hospital has been actively working towards a full replacement of paper based patient records by electronic

Results

A total of 299 documents of different types produced in the DoN were found belonging to patients included (Table 1). Two-hundred-and-sixty documents were found in the electronic system, 295 in the paper record. Two-hundred-and-fifty-six documents occurred in both record systems. One document found in the electronic system was excluded from further calculation as it was obviously not valid and should have been removed from the system. Mean number of documents per patient was 3.3 with a range of

Discussion

Observed level of inconsistency, i.e. the proportion of information not available or not identical in both systems, is slightly over 5% ,as the most important sources of inconsistency are the missing documents in the electronic record (4%) and in the paper record (1%). Documents found in both systems, but with partly different content due to modifications made in one of the systems, contribute less to the total level of inconsistency, as only a fraction of the total information in these

Conclusion

Parallel maintenance of electronic and paper based patient records has resulted in inconsistent record information in our setting. Information is missing in both electronic and paper based records, more information appears to be missing from the relevant parts of the electronic records than the paper records. To avoid complications of inconsistency when electronic patient record systems are implemented in parallel with paper based systems, careful attention should be paid to securing

Acknowledgements

The Norwegian Research Council financially supported the study, grant no. 125721/320.

References (18)

  • P. Griep et al.

    An epilepsy information system to support routine and research

    Int. J. Bio-Med. Comput.

    (1996)
  • R.S. Dick et al.
  • N.M. Lorenzi et al.

    Medical informatics: the key to an organization's place in the new health environment

    J. Am. Med. Inform. Assoc.

    (1995)
  • C. Sicotte et al.

    The computer based patient record: a strategic issue in process innovation

    J. Med. Syst.

    (1998)
  • F.C. Southon et al.

    Information technology in complex health services: organizational impediments to successful technology transfer and diffusion

    J. Am. Med. Inform. Assoc.

    (1997)
  • J.D. Anderson

    Increasing the acceptance of clinical information systems

    MD Comput.

    (1999)
  • N.M. Lorenzi et al.

    Managing change: an overview

    J. Am. Med. Inform. Assoc.

    (2000)
  • A.S. Tonnesen, A. LeMaistre, D. Tucker, Electronic medical record implementation Barriers encountered during...
  • B. Burgess et al.

    Clinics go electronic: two stories from the field

    J. AHIMA

    (1999)
There are more references available in the full text version of this article.

Cited by (82)

  • The WHO methodology for point prevalence surveys on antibiotics use in hospitals should be improved: Lessons from pilot studies in four Mexican hospitals

    2021, International Journal of Infectious Diseases
    Citation Excerpt :

    Discordances between the information recorded for prescribed or dispensed antimicrobials raise certain dilemmas that may compromise the accuracy of estimates for antimicrobial use, without guidance for resolution. The lack of supervision and quality control with regards to the recording of clinical data in different documents generated a range of inconsistencies (Mikkelsen and Aasly, 2001). In the hospitals evaluated in this study, we identified discordances even between the prescribed therapy according to medical notes and the administered agents recorded in nursing sheets.

  • Validation of the accuracy of postpartum haemorrhage data in the ObstetriX database: A retrospective cohort study

    2018, International Journal of Medical Informatics
    Citation Excerpt :

    Midwifery staff, on the other hand, are also given the flexibility of documentation in patients’ paper record in addition to recording into ObstetriX database. Mikkelsen and Aasly [22] found that “parallel use of electronic and paper-based patient records result in inconsistencies between the record systems” and “…documentation missing in both.” In a study comparing paper recording note with electronic recording system, Jurgen Stausber [23] concluded that the paper-based patient record should not be taken as the gold standard over the electronic record when circumstances create two different and supplemental records.

  • Comprehensible knowledge model creation for cancer treatment decision making

    2017, Computers in Biology and Medicine
    Citation Excerpt :

    For future analysis, the clinical data are either manually analyzed or entered into a computer system by humans. However, manual methods generate unintentional errors [7], and deliberate modification of data may influence the quality of the information [8]. With increasing use of information technology and wider adoption of electronic health records (EHRs), there is a need to expand the use of clinical data to support clinical decisions and research [9,10].

View all citing articles on Scopus
View full text