Skip to main content

A Novel Mobile Application for Medication Adherence Supervision Based on AR and OpenCV Designed for Elderly Patients

  • Conference paper
  • First Online:
Human Aspects of IT for the Aged Population. Supporting Everyday Life Activities (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12787))

Included in the following conference series:

Abstract

Elderly people or individuals diagnosed in the very early stages of Alzheimer’s Disease might have difficulty in taking medications according to the doctors’ instructions due to the vision problems or memory loss. However, medication adherence can be crucial for good health or cause a major health setback. Traditional apps for medication adherence supervision use time reminders when the doses are supposed to be taken. This paper has developed a novel Android app to track the patient’s action of taking medication for avoiding skipping the doses or taking too much medication. The app includes two modules, i.e. the AR medicine packaging box recognition module and the medication adherence supervision module. The former uses the surface of the medicine packaging box as an AR trigger and displays the virtual words of medical prescription to help the elderly patients identify the correct medications. The second module tracks the date and time of taking medications by recognizing the pills in the photo taken by the user. The pill detection is accomplished by applying the OpenCV image processing library to identify the pill contours based on dimensions and shape. Finally the pill detection tests were conducted to measure the detection accuracy and robustness of the app considering lighting conditions, different locations the pills were placed and the pills overlapped with each other.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cramer, J.A., et al.: Medication compliance and persistence: terminology and definitions. Value Health 11(1), 44–47 (2008)

    Article  Google Scholar 

  2. Koper, D., Kamenski, G., Flamm, M., Böhmdorfer, B., Sönnichsen, A.: Frequency of medication errors in primary care patients with polypharmacy. Fam. Pract. 30(3), 313–319 (2013)

    Article  Google Scholar 

  3. Kanno, K.M., Lamounier, E.A., Cardoso, A., Lopes, E.J., de Lima, G.F.M.: Augmented reality system for aiding mild Alzheimer patients and caregivers. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 593–594. IEEE, March 2018

    Google Scholar 

  4. Kanno, K.M., Lamounier Jr, E.A., Cardoso, A., Lopes, E.J., Fakhouri Filho, S.A.: Assisting individuals with Alzheimer’s disease using mobile augmented reality with voice interaction: an acceptance experiment with individuals in the early stages. Res. Biomed. Eng. 35(3), 223–234 (2019)

    Google Scholar 

  5. Ingeson, M., Blusi, M., Nieves, J.C.: Smart augmented reality mHealth for medication adherence. In: AIH@IJCAI, pp. 157–168 (2018)

    Google Scholar 

  6. https://www.dorsetccg.nhs.uk/wp-content/uploads/2018/04/Standard-E1-storage-safe-custody-of-medicines.pdf.

  7. Cunha, A., Adão, T., Trigueiros, P.: Helpmepills: a mobile pill recognition tool for elderly persons. Procedia Technol. 16, 1523–1532 (2014)

    Article  Google Scholar 

  8. Annasaro, E., Hema, A.: Color and shape feature extraction and matching in pill identification systems. Int. J. Comput. Sci. Inf. Technol. 5(2), 1011–1015 (2014)

    Google Scholar 

  9. Lee, Y.B., Park, U., Jain, A.K., Lee, S.W.: Pill-ID: matching and retrieval of drug pill images. Pattern Recogn. Lett. 33(7), 904–910 (2012)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xingxi He .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, S., Pang, X., He, X. (2021). A Novel Mobile Application for Medication Adherence Supervision Based on AR and OpenCV Designed for Elderly Patients. In: Gao, Q., Zhou, J. (eds) Human Aspects of IT for the Aged Population. Supporting Everyday Life Activities. HCII 2021. Lecture Notes in Computer Science(), vol 12787. Springer, Cham. https://doi.org/10.1007/978-3-030-78111-8_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78111-8_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78110-1

  • Online ISBN: 978-3-030-78111-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics