Skip to main content

Advertisement

Measuring Sensitivity and Precision of Real-Time Location Systems (RTLS): Definition, Protocol and Demonstration for Clinical Relevance

  • Systems-Level Quality Improvement
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

The ability of a Real Time Location System (RTLS) to provide correct information in a clinical environment is an important consideration in evaluating the effectiveness of the technology. While past efforts describe how well the technology performed in a lab environment, the performance of such technology has not been specifically defined or evaluated in a practice setting involving workflow and movement. Clinical environments pose complexity owing to various layouts and various movements. Further, RTL systems are not equipped to provide true negative information (where an entity is not located). Hence, this study defined sensitivity and precision in this context, and developed a simulation protocol to serve as a systematic testing framework using actors in a clinical environment. The protocol was used to measure the sensitivity and precision of an RTL system in the emergency department space of a quaternary care medical center. The overall sensitivity and precision were determined to be 84 and 93% respectively. These varied for patient rooms, staff area, hallway and other rooms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Nambiar A. RFID Technology: A Review of its Applications. Lecture Notes in Engineering and Computer Science. 2009;2179(1):1253-9.

    Google Scholar 

  2. Ngai EWT, Moon KKL, Riggins FJ, Yi CY. RFID research: An academic literature review (1995–2005) and future research directions. International Journal of Production Economics. 2008;112(2):510-20.

    Article  Google Scholar 

  3. Chao C-C, Yang J-M, Jen W-Y. Determining technology trends and forecasts of RFID by a historical review and bibliometric analysis from 1991 to 2005. Technovation. 2007;27(5):268-79.

    Article  Google Scholar 

  4. Domdouzis K, Kumar B, Anumba C. Radio-Frequency Identification (RFID) applications: A brief introduction. Advanced Engineering Informatics. 2007;21(4):350-5.

    Article  Google Scholar 

  5. Bendavid Y, Boeck H, Philippe R. RFID-enabled traceability system for consignment and high value products: a case study in the healthcare sector. J Med Syst. 2012;36(6):3473-89.

    Article  Google Scholar 

  6. Rousek JB, Pasupathy K, Gannon D, Hallbeck S. Asset management in healthcare: Evaluation of RFID. IIE Transactions on Healthcare Systems Engineering. 2014;4(3):144-55.

    Article  Google Scholar 

  7. Ajami S, Rajabzadeh A. Radio Frequency Identification (RFID) technology and patient safety. J Res Med Sci. 2013;18(9):809-13.

    PubMed  PubMed Central  Google Scholar 

  8. Chang SI, Ou CS, Ku CY, Yang M. A study of RFID application impacts on medical safety. Int J Electron Healthc. 2008;4(1):1-23.

    Article  Google Scholar 

  9. Ohashi K, Ota S, Ohno-Machado L, Tanaka H. Smart medical environment at the point of care: auto-tracking clinical interventions at the bed side using RFID technology. Comput Biol Med. 2010;40(6):545-54.

    Article  Google Scholar 

  10. Martinez Perez M, Vazquez Gonzalez G, Dafonte C. Safety and Traceability in Patient Healthcare through the Integration of RFID Technology for Intravenous Mixtures in the Prescription-Validation-Elaboration-Dispensation-Administration Circuit to Day Hospital Patients. Sensors (Basel, Switzerland). 2016;16(8).

  11. Reyes PM, Li SH, Visich JK. Accessing antecedents and outcomes of RFID implementation in health care. International Journal of Production Economics. 2012;136(1):137-50.

    Article  Google Scholar 

  12. Sun PR, Wang BH, Wu F. A new method to guard inpatient medication safety by the implementation of RFID. J Med Syst. 2008;32(4):327-32.

    Article  Google Scholar 

  13. Janz BD, Pitts MG, Otondo RF. Information Systems and Health Care-II: Back to the Future with RFID: Lessons Learned - Some Old, Some New. Communications of the Association for Information Systems. 2005;15(7):132-47.

    Google Scholar 

  14. Perez MM, Cabrero-Canosa M, Hermida JV, Garcia LC, Gomez DL, Gonzalez GV, et al. Application of RFID Technology in Patient Tracking and Medication Traceability in Emergency Care. Journal of Medical Systems. 2012;36(6):3983-93.

    Article  Google Scholar 

  15. Coustasse A, Tomblin S, Slack C. Impact of radio-frequency identification (RFID) technologies on the hospital supply chain: a literature review. Perspect Health Inf Manag. 2013;10:1d.

  16. Davis R, Geiger B, Gutierrez A, Heaser J, Veeramani D. Tracking blood products in blood centres using radio frequency identification: a comprehensive assessment. Vox Sang. 2009;97(1):50-60.

    Article  Google Scholar 

  17. Najera P, Lopez J, Roman R. Real-time location and inpatient care systems based on passive RFID. Journal of Network and Computer Applications. 2011;34(3):980-9.

    Article  Google Scholar 

  18. van der Togt R, Bakker PJ, Jaspers MW. A framework for performance and data quality assessment of Radio Frequency IDentification (RFID) systems in health care settings. Journal of biomedical informatics. 2011;44(2):372-83.

    Article  Google Scholar 

  19. Carr Amelia S. RFID Technology: Implications for Healthcare Organizations. American Journal of Business. 2010;25(2):25-40.

    Article  Google Scholar 

  20. Kumar S, Swanson E, Tran T. RFID in the healthcare supply chain: usage and application. Int J Health Care Qual Assur. 2009;22(1):67-81.

    Article  Google Scholar 

  21. Yao W, Chu CH, Li Z. The adoption and implementation of RFID technologies in healthcare: a literature review. J Med Syst. 2012;36(6):3507-25.

    Article  Google Scholar 

  22. Yazici HJ. An exploratory analysis of hospital perspectives on real time information requirements and perceived benefits of RFID technology for future adoption. International Journal of Information Management. 2014;34(5):603-21.

    Article  Google Scholar 

  23. Zhou W, Piramuthu S. Framework, strategy and evaluation of health care processes with RFID. Decis Support Syst. 2010;50(1):222-33.

    Article  Google Scholar 

  24. Miller MJ, Ferrin DM, Flynn T, Ashby M, White KP, Mauer MG, editors. Using RFID Technologies to Capture Simulation Data in a Hospital Emergency Department. Proceedings of the 2006 Winter Simulation Conference; 2006 3-6 Dec. 2006.

  25. David AC, Kalyan SP. Process Mapping and RFID: Complementarities. Encyclopedia of Business Analytics and Optimization. Hershey, PA, USA: IGI Global; 2014. p. 1898-909.

  26. Fisher JA, Monahan T. Evaluation of real-time location systems in their hospital contexts. Int J Med Inform. 2012;81(10):705-12.

    Article  Google Scholar 

  27. Pineles LL, Morgan DJ, Limper HM, Weber SG, Thom KA, Perencevich EN, et al. Accuracy of a radiofrequency identification (RFID) badge system to monitor hand hygiene behavior during routine clinical activities. Am J Infect Control. 2014;42(2):144-7.

    Article  Google Scholar 

  28. Min D, Yih Y. Fuzzy logic-based approach to detecting a passive RFID tag in an outpatient clinic. J Med Syst. 2011;35(3):423-32.

    Article  Google Scholar 

  29. Hung GR, Doan Q. Assessment of the reliability of active radiofrequency identification technology for patient tracking in the pediatric emergency department. Pediatr Emerg Care. 2013;29(2):162-4.

    Article  Google Scholar 

  30. Parlak S, Sarcevic A, Marsic I, Burd RS. Introducing RFID technology in dynamic and time-critical medical settings: requirements and challenges. Journal of biomedical informatics. 2012;45(5):958-74.

    Article  Google Scholar 

  31. Krohn R. The optimal RTLS solution for hospitals. Breaking through a complex environment. J Healthc Inf Manag. 2008;22(4):14-5.

    PubMed  Google Scholar 

  32. Li S, Visich J, Khumawala B, Zhang C. Radio frequency identification technology: Applications, technical challenges and strategies. Sensor Review. 2006;26:193-202.

    Article  Google Scholar 

  33. Okoniewska B, Graham A, Gavrilova M, Wah D, Gilgen J, Coke J, et al. Multidimensional evaluation of a radio frequency identification wi-fi location tracking system in an acute-care hospital setting. J Am Med Inform Assoc. 2012;19(4):674-9.

    Article  Google Scholar 

  34. Bekkali A, Sanson H, Matsumoto M, editors. RFID Indoor Positioning Based on Probabilistic RFID Map and Kalman Filtering. Third IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob 2007); 2007 8-10 Oct. 2007.

  35. Liu X, Shannon J, Voun H, Truijens M, Chi HL, Wang X. Spatial and temporal analysis on the distribution of active radio-frequency identification (RFID) tracking accuracy with the Kriging method. Sensors (Basel, Switzerland). 2014;14(11):20451-67.

  36. Oztekin A, Pajouh FM, Delen D, Swim LK. An RFID network design methodology for asset tracking in healthcare. Decis Support Syst. 2010;49(1):100-9.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the following Mayo Clinic Departments: Mayo Clinical Engineering Learning Lab, Emergency Department, Information Technology, Kern Center for the Science of Health Care Delivery, and other Mayo Clinic staff, and the vendor that made this study possible.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kalyan S. Pasupathy.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on Systems-Level Quality Improvement

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Koenig, K.R., Pasupathy, K.S., Hellmich, T.R. et al. Measuring Sensitivity and Precision of Real-Time Location Systems (RTLS): Definition, Protocol and Demonstration for Clinical Relevance. J Med Syst 45, 15 (2021). https://doi.org/10.1007/s10916-020-01606-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-020-01606-6

Keywords