Abstract
The ability of a Real Time Location System (RTLS) to provide correct information in a clinical environment is an important consideration in evaluating the effectiveness of the technology. While past efforts describe how well the technology performed in a lab environment, the performance of such technology has not been specifically defined or evaluated in a practice setting involving workflow and movement. Clinical environments pose complexity owing to various layouts and various movements. Further, RTL systems are not equipped to provide true negative information (where an entity is not located). Hence, this study defined sensitivity and precision in this context, and developed a simulation protocol to serve as a systematic testing framework using actors in a clinical environment. The protocol was used to measure the sensitivity and precision of an RTL system in the emergency department space of a quaternary care medical center. The overall sensitivity and precision were determined to be 84 and 93% respectively. These varied for patient rooms, staff area, hallway and other rooms.
Similar content being viewed by others
References
Nambiar A. RFID Technology: A Review of its Applications. Lecture Notes in Engineering and Computer Science. 2009;2179(1):1253-9.
Ngai EWT, Moon KKL, Riggins FJ, Yi CY. RFID research: An academic literature review (1995–2005) and future research directions. International Journal of Production Economics. 2008;112(2):510-20.
Chao C-C, Yang J-M, Jen W-Y. Determining technology trends and forecasts of RFID by a historical review and bibliometric analysis from 1991 to 2005. Technovation. 2007;27(5):268-79.
Domdouzis K, Kumar B, Anumba C. Radio-Frequency Identification (RFID) applications: A brief introduction. Advanced Engineering Informatics. 2007;21(4):350-5.
Bendavid Y, Boeck H, Philippe R. RFID-enabled traceability system for consignment and high value products: a case study in the healthcare sector. J Med Syst. 2012;36(6):3473-89.
Rousek JB, Pasupathy K, Gannon D, Hallbeck S. Asset management in healthcare: Evaluation of RFID. IIE Transactions on Healthcare Systems Engineering. 2014;4(3):144-55.
Ajami S, Rajabzadeh A. Radio Frequency Identification (RFID) technology and patient safety. J Res Med Sci. 2013;18(9):809-13.
Chang SI, Ou CS, Ku CY, Yang M. A study of RFID application impacts on medical safety. Int J Electron Healthc. 2008;4(1):1-23.
Ohashi K, Ota S, Ohno-Machado L, Tanaka H. Smart medical environment at the point of care: auto-tracking clinical interventions at the bed side using RFID technology. Comput Biol Med. 2010;40(6):545-54.
Martinez Perez M, Vazquez Gonzalez G, Dafonte C. Safety and Traceability in Patient Healthcare through the Integration of RFID Technology for Intravenous Mixtures in the Prescription-Validation-Elaboration-Dispensation-Administration Circuit to Day Hospital Patients. Sensors (Basel, Switzerland). 2016;16(8).
Reyes PM, Li SH, Visich JK. Accessing antecedents and outcomes of RFID implementation in health care. International Journal of Production Economics. 2012;136(1):137-50.
Sun PR, Wang BH, Wu F. A new method to guard inpatient medication safety by the implementation of RFID. J Med Syst. 2008;32(4):327-32.
Janz BD, Pitts MG, Otondo RF. Information Systems and Health Care-II: Back to the Future with RFID: Lessons Learned - Some Old, Some New. Communications of the Association for Information Systems. 2005;15(7):132-47.
Perez MM, Cabrero-Canosa M, Hermida JV, Garcia LC, Gomez DL, Gonzalez GV, et al. Application of RFID Technology in Patient Tracking and Medication Traceability in Emergency Care. Journal of Medical Systems. 2012;36(6):3983-93.
Coustasse A, Tomblin S, Slack C. Impact of radio-frequency identification (RFID) technologies on the hospital supply chain: a literature review. Perspect Health Inf Manag. 2013;10:1d.
Davis R, Geiger B, Gutierrez A, Heaser J, Veeramani D. Tracking blood products in blood centres using radio frequency identification: a comprehensive assessment. Vox Sang. 2009;97(1):50-60.
Najera P, Lopez J, Roman R. Real-time location and inpatient care systems based on passive RFID. Journal of Network and Computer Applications. 2011;34(3):980-9.
van der Togt R, Bakker PJ, Jaspers MW. A framework for performance and data quality assessment of Radio Frequency IDentification (RFID) systems in health care settings. Journal of biomedical informatics. 2011;44(2):372-83.
Carr Amelia S. RFID Technology: Implications for Healthcare Organizations. American Journal of Business. 2010;25(2):25-40.
Kumar S, Swanson E, Tran T. RFID in the healthcare supply chain: usage and application. Int J Health Care Qual Assur. 2009;22(1):67-81.
Yao W, Chu CH, Li Z. The adoption and implementation of RFID technologies in healthcare: a literature review. J Med Syst. 2012;36(6):3507-25.
Yazici HJ. An exploratory analysis of hospital perspectives on real time information requirements and perceived benefits of RFID technology for future adoption. International Journal of Information Management. 2014;34(5):603-21.
Zhou W, Piramuthu S. Framework, strategy and evaluation of health care processes with RFID. Decis Support Syst. 2010;50(1):222-33.
Miller MJ, Ferrin DM, Flynn T, Ashby M, White KP, Mauer MG, editors. Using RFID Technologies to Capture Simulation Data in a Hospital Emergency Department. Proceedings of the 2006 Winter Simulation Conference; 2006 3-6 Dec. 2006.
David AC, Kalyan SP. Process Mapping and RFID: Complementarities. Encyclopedia of Business Analytics and Optimization. Hershey, PA, USA: IGI Global; 2014. p. 1898-909.
Fisher JA, Monahan T. Evaluation of real-time location systems in their hospital contexts. Int J Med Inform. 2012;81(10):705-12.
Pineles LL, Morgan DJ, Limper HM, Weber SG, Thom KA, Perencevich EN, et al. Accuracy of a radiofrequency identification (RFID) badge system to monitor hand hygiene behavior during routine clinical activities. Am J Infect Control. 2014;42(2):144-7.
Min D, Yih Y. Fuzzy logic-based approach to detecting a passive RFID tag in an outpatient clinic. J Med Syst. 2011;35(3):423-32.
Hung GR, Doan Q. Assessment of the reliability of active radiofrequency identification technology for patient tracking in the pediatric emergency department. Pediatr Emerg Care. 2013;29(2):162-4.
Parlak S, Sarcevic A, Marsic I, Burd RS. Introducing RFID technology in dynamic and time-critical medical settings: requirements and challenges. Journal of biomedical informatics. 2012;45(5):958-74.
Krohn R. The optimal RTLS solution for hospitals. Breaking through a complex environment. J Healthc Inf Manag. 2008;22(4):14-5.
Li S, Visich J, Khumawala B, Zhang C. Radio frequency identification technology: Applications, technical challenges and strategies. Sensor Review. 2006;26:193-202.
Okoniewska B, Graham A, Gavrilova M, Wah D, Gilgen J, Coke J, et al. Multidimensional evaluation of a radio frequency identification wi-fi location tracking system in an acute-care hospital setting. J Am Med Inform Assoc. 2012;19(4):674-9.
Bekkali A, Sanson H, Matsumoto M, editors. RFID Indoor Positioning Based on Probabilistic RFID Map and Kalman Filtering. Third IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob 2007); 2007 8-10 Oct. 2007.
Liu X, Shannon J, Voun H, Truijens M, Chi HL, Wang X. Spatial and temporal analysis on the distribution of active radio-frequency identification (RFID) tracking accuracy with the Kriging method. Sensors (Basel, Switzerland). 2014;14(11):20451-67.
Oztekin A, Pajouh FM, Delen D, Swim LK. An RFID network design methodology for asset tracking in healthcare. Decis Support Syst. 2010;49(1):100-9.
Acknowledgements
The authors thank the following Mayo Clinic Departments: Mayo Clinical Engineering Learning Lab, Emergency Department, Information Technology, Kern Center for the Science of Health Care Delivery, and other Mayo Clinic staff, and the vendor that made this study possible.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Systems-Level Quality Improvement
Rights and permissions
About this article
Cite this article
Koenig, K.R., Pasupathy, K.S., Hellmich, T.R. et al. Measuring Sensitivity and Precision of Real-Time Location Systems (RTLS): Definition, Protocol and Demonstration for Clinical Relevance. J Med Syst 45, 15 (2021). https://doi.org/10.1007/s10916-020-01606-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-020-01606-6