research-article

Using cTAKES to Build a Simple Speech Transcriber Plugin for an EMR

Authors:

Stephen John Matthew C. Wenceslao,

Maria Regina Justina E. EstuarAuthors Info & Claims

ICMHI '19: Proceedings of the 3rd International Conference on Medical and Health Informatics

Pages 78 - 86

https://doi.org/10.1145/3340037.3340044

Published: 17 May 2019 Publication History

Abstract

Electronic medical records (EMR) in general provide significant benefits to healthcare organizations and clinicians. However, a major challenge of clinicians who use EMRs is the lowered perceived quality of patient-doctor communication and interaction as a result of doctors being distracted with EMR use during consultations. A unique approach to this problem is through applications that automatically document clinical encounters in real-time. This study aims to develop a speech transcriber plugin for a web-based EMR for real-time clinical encounter documentation. We make use of available speech-to-text services on the web as well as cTAKES for clinical annotation. A draft summary of the clinical encounter is presented to the user in editable SOAP format. Blockchain technology for the speech recording is also explored to secure access to the recording. Internal testings showed that the prototype is able to capture audio conversations into text and parse the transcription for medical concepts. However, after a single formal usability evaluation we found that there is much to be done in terms of the usability of the summarization component.

References

[1]

Ofir Ben-Assuli, Itamar Shabtai, and Moshe Leshno. 2013. The impact of EHR and HIE on reducing avoidable admissions: controlling main differential diagnoses. BMC medical informatics and decision making 13, 1 (2013), 49.

[2]

David Blumenthal and John P Glaser. 2007. Information technology comes to medicine.

[3]

DR HARRY McCONNELL FPCPC. {n. d.}. International efforts in implementing national health information infrastructure and electronic health records. World Hospitals and Health Services 40, 1 ({n. d.}).

[4]

Dennis Giokas. 2005. Canada health infoway-towards a national interoperable electronic health record (EHR) solution. Studies in health technology and informatics 115 (2005), 108--140.

[5]

Jeffery L Belden, Rebecca Grayson, and Janey Barnes. 2009. Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. Technical Report. Healthcare Information and Management Systems Society (HIMSS).

[6]

Wendy W Chapman, Prakash M Nadkarni, Lynette Hirschman, Leonard W D'avolio, Guergana K Savova, and Ozlem Uzuner. 2011. Overcoming barriers to NLP for clinical text: the role of shared tasks and the need for additional creative solutions.

[7]

Robert G Hill Jr, Lynn Marie Sears, and Scott W Melanson. 2013. 4000 clicks: a productivity analysis of electronic medical records in a community hospital ED. The American journal of emergency medicine 31, 11 (2013), 1591--1594.

[8]

Kushtrim Kuqi, Tim Eveleigh, Thomas Holzer, Shahryar Sarkani, James E Levin, and Rebecca S Crowley. 2013. Design of electronic medical record user interfaces: a matrix-based method for improving usability. Journal of healthcare engineering 4, 3 (2013), 427--451.

[9]

Ruth Stashefsky Margalit, Debra Roter, Mary Ann Dunevant, Susan Larson, and Shmuel Reis. 2006. Electronic medical record use and physician--patient communication: an observational study of Israeli primary care encounters. Patient education and counseling 61, 1 (2006), 134--141.

[10]

Blackford Middleton, Meryl Bloomrosen, Mark A Dente, Bill Hashmat, Ross Koppel, J Marc Overhage, Thomas H Payne, S Trent Rosenbloom, Charlotte Weaver, and Jiajie Zhang. 2013. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. Journal of the American Medical Informatics Association 20, e1 (2013), e2--e8.

[11]

Pertti Saariluoma and Jussi PP Jokinen. 2014. Emotional dimensions of user experience: A user psychological analysis. International Journal of Human-Computer Interaction 30, 4 (2014), 303--320.

[12]

Aviv Shachak and Shmuel Reis. 2009. The impact of electronic medical records on patient--doctor communication during consultation: a narrative literature review. Journal of evaluation in clinical practice 15, 4 (2009), 641--649.

[13]

Francis Lau, Morgan Price, Jeanette Boyd, Colin Partridge, Heidi Bell, and Rebecca Raworth. 2012. Impact of electronic medical record on physician practice in office settings: a systematic review. BMC medical informatics and decision making 12, 1 (2012), 10.

[14]

Aviv Shachak, Michal Hadas-Dayagi, Amitai Ziv, and Shmuel Reis. 2009. Primary care physicians use of an electronic medical record system: a cognitive task analysis. Journal of general internal medicine 24, 3 (2009), 341--348.

[15]

Maryam Zahabi, David B Kaber, and Manida Swangnetr. 2015. Usability and safety in electronic medical records interface design: a review of recent literature and guideline formulation. Human factors 57, 5 (2015), 805--834.

[16]

Gregory Finley, Erik Edwards, Amanda Robinson, Michael Brenndoerfer, Najmeh Sadoughi, James Fone, Nico Axtmann, Mark Miller, and David SuendermannOeft. 2018. An automated medical scribe for documenting clinical encounters. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations. 11--15.

[17]

Jeffrey G Klann and Peter Szolovits. 2009. An intelligent listening framework for capturing encounter notes from a doctor-patient dialog. BMC medical informatics and decision making 9, 1 (2009), S3.

[18]

Xavier Anguera, Simon Bozonnet, Nicholas Evans, Corinne Fredouille, Gerald Friedland, and Oriol Vinyals. 2012. Speaker diarization: A review of recent research. IEEE Transactions on Audio, Speech, and Language Processing 20, 2 (2012), 356--370.

Digital Library

[19]

Jennifer Fong Ha, Dip Surg Anat, and Nancy Longnecker. 2010. Doctor-Patient Communication: A Review. The Ochsner Journal 10 (2010), 38--43.

[20]

Carol Teutsch et al. {n. d.}. Patient-doctor communication. ({n. d.}).

[21]

Steven Y Lin, Tait D Shanafelt, and Steven M Asch. 2018. Reimagining Clinical Documentation With Artificial Intelligence. In Mayo Clinic Proceedings, Vol. 93. Elsevier, 563--565.

[22]

Chung-Cheng Chiu, Anshuman Tripathi, Katherine Chou, Chris Co, Navdeep Jaitly, Diana Jaunzeikare, Anjuli Kannan, Patrick Nguyen, Hasim Sak, Ananth Sankar, et al. 2017. Speech recognition for medical conversations. arXiv preprint arXiv:1711.07274 (2017).

[23]

Guergana K Savova, James J Masanz, Philip V Ogren, Jiaping Zheng, Sunghwan Sohn, Karin C Kipper-Schuler, and Christopher G Chute. 2010. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. Journal of the American Medical Informatics Association 17, 5 (2010), 507--513.

[24]

Taqi Jaffri Dan Ehrlich MatthewVita, Gandhirajan. 2018. cTAKES Rest Service. https://github.com/GoTeamEpsilon/ctakes-rest-service.

[25]

John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[26]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies 4, 3 (2009), 114--123.

Digital Library

[27]

Jeff Sauro. 2011. Sustisfied? little-known system usability scale facts. UX Magazine 10, 3 (2011), 2011--3.

Cited By

Saadat SKhalilizad Darounkolaei MQorbani MHemmat AHariri S(2025)Enhancing Clinical Documentation with AI: Reducing Errors, Improving Interoperability, and Supporting Real-Time Note-TakingInfoScience Trends10.61186/ist.202502.01.012:1(1-13)Online publication date: 14-Jan-2025
https://doi.org/10.61186/ist.202502.01.01
Falcetta Fde Almeida FLemos JGoldim Jda Costa C(2023)Automatic documentation of professional health interactionsArtificial Intelligence in Medicine10.1016/j.artmed.2023.102487137:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.artmed.2023.102487
Froehlich MWaltenberger FTrotter LAlt FSchmidt A(2022)Blockchain and Cryptocurrency in Human Computer Interaction: A Systematic Literature Review and Research AgendaProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533478(155-177)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533478
Show More Cited By

Index Terms

Using cTAKES to Build a Simple Speech Transcriber Plugin for an EMR
1. Applied computing
  1. Life and medical sciences
    1. Consumer health
    2. Health care information systems
2. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Speech recognition

Recommendations

Designing flexible EMR systems for recording and summarizing doctor-patient interactions
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

Electronic Medical Records (EMR) are increasingly transitioning from desktop systems to mobile devices. This innovation presents challenges to medical practitioners in terms of doctor-patient interaction, patient record integrity and continuing reliance ...
Identification and Correction of Misspelled Drugsź Names in Electronic Medical Records (EMR)
ICEIS 2016: Proceedings of the 18th International Conference on Enterprise Information Systems

Medications are an important element of medical records but they usually contain significant data errors. This situation may result from haphazardness or possibly careless storage of valuable information. In either case, this misspelled data can cause ...
Organizational and Environmental Determinants of Hospital EMR Adoption: A National Study

The recent focus on health care quality improvement and cost containment has led some policymakers and practitioners to advocate the adoption of health information technology. One such technology is the Electronic Medical Record (EMR), which is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICMHI '19: Proceedings of the 3rd International Conference on Medical and Health Informatics

May 2019

207 pages

ISBN:9781450371995

DOI:10.1145/3340037

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

University of Electronic Science and Technology of China: University of Electronic Science and Technology of China

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICMHI 2019

ICMHI 2019: The third International Conference on Medical and Health Informatics 2019

May 17 - 19, 2019

Xiamen, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)5

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Saadat SKhalilizad Darounkolaei MQorbani MHemmat AHariri S(2025)Enhancing Clinical Documentation with AI: Reducing Errors, Improving Interoperability, and Supporting Real-Time Note-TakingInfoScience Trends10.61186/ist.202502.01.012:1(1-13)Online publication date: 14-Jan-2025
https://doi.org/10.61186/ist.202502.01.01
Falcetta Fde Almeida FLemos JGoldim Jda Costa C(2023)Automatic documentation of professional health interactionsArtificial Intelligence in Medicine10.1016/j.artmed.2023.102487137:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.artmed.2023.102487
Froehlich MWaltenberger FTrotter LAlt FSchmidt A(2022)Blockchain and Cryptocurrency in Human Computer Interaction: A Systematic Literature Review and Research AgendaProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533478(155-177)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533478
Sharma VHalevi T(2022)A Survey on Research Directions in Blockchain Applications UsabilityProceedings of Seventh International Congress on Information and Communication Technology10.1007/978-981-19-1610-6_64(727-738)Online publication date: 27-Jul-2022
https://doi.org/10.1007/978-981-19-1610-6_64
Guerino GValentim NCavalcante EDantas FBatista T(2020)Usability and User eXperience Evaluation of Conversational SystemsProceedings of the XXXIV Brazilian Symposium on Software Engineering10.1145/3422392.3422421(427-436)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3422392.3422421

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten