Skip to main content

A Reinforcement Learning and Transformers Based Intelligent System for the Support of Alzheimer’s Patients in Daily Life Activities

  • Conference paper
  • First Online:
Computational Collective Intelligence (ICCCI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13501))

Included in the following conference series:

Abstract

Alzheimer’s disease is one of the most well-known diseases among the elderly. It is a neuro-degenerative and irreversible brain disease that gradually erodes memory, thinking skills, and, eventually, the capacity to do even basic daily activities. Therefore, patients should be aided at all times in carrying out their daily tasks. In this study, we propose a new assistance system for Alzheimer’s patients to help them performing daily life activities independently. The proposed assistance system is composed of a human activity recognition module, based on 3D skeletons data and transformer encoder, in order to monitor the patient behavior and an assistance module, based on reinforcement learning (RL), to detect anomalies in the patient behavior and provide alerts accordingly. Experiments carried out on the DemCare dataset proved the effectiveness of our RL-based assistance system compared to state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://demcare.eu/datasets/.

  2. 2.

    https://github.com/ibaiGorordo/ONNX-Mobile-Human-Pose-3D.

References

  1. Avgerinakis, K., Briassouli, A., Kompatsiaris, Y.: Activity detection using sequential statistical boundary detection (SSBD). Comput. Vis. Image Underst. 144, 46–61 (2016)

    Article  Google Scholar 

  2. Chen, H., Soh, Y.: A cooking assistance system for patients with Alzheimers disease using reinforcement learning. Int. J. Inf. Technol. 23(2) (2018)

    Google Scholar 

  3. Chernbumroong, S., Cang, S., Atkins, A., Yu, H.: Elderly activities recognition and classification for applications in assisted living. Expert Syst. Appl. 40(5), 1662–1674 (2013). https://doi.org/10.1016/j.eswa.2012.09.004

    Article  Google Scholar 

  4. Division, U.: World population ageing, 2019: highlights, p. 37 (2019)

    Google Scholar 

  5. Dua, T., Seeher, K., Sivananthan, S., Chowdhary, N., Pot, A., Saxena, S.: World health organization’s global action plan on the public health response to dementia 2017–2025. Alzheimer’s & Dementia 13, P1450–P1451, June 2017. https://doi.org/10.1016/j.jalz.2017.07.758

  6. Jang, B., Kim, M., Harerimana, G., Kim, J.W.: Q-learning algorithms: a comprehensive classification and applications. IEEE Access 7, 133653–133667 (2019). https://doi.org/10.1109/ACCESS.2019.2941229

    Article  Google Scholar 

  7. Jarray, R., Snoun, A., Bouchrika, T., Jemai, O.: Deep human action recognition system for assistance of Alzheimer’s patients. In: HIS (2020)

    Google Scholar 

  8. Jean-Baptiste, E., Mihailidis, A.: Benefits of automatic human action recognition in an assistive system for people with dementia. In: 2017 IEEE Canada International Humanitarian Technology Conference (IHTC), pp. 61–65 (2017)

    Google Scholar 

  9. Karakostas, A., Briassouli, A., Avgerinakis, K., Kompatsiaris, I., Tsolaki, M.: The dem@care experiments and datasets: a technical report, December 2016

    Google Scholar 

  10. Ling, Y., et al.: Diagnostic inferencing via improving clinical concept extraction with deep reinforcement learning: a preliminary study. In: Proceedings of the 2nd Machine Learning for Healthcare Conference. Proceedings of Machine Learning Research, vol. 68, pp. 271–285. PMLR, 18–19 August 2017

    Google Scholar 

  11. Peters, C., Hermann, T., Wachsmuth, S., Hoey, J.: Automatic task assistance for people with cognitive disabilities in brushing teeth - a user study with the tebra system. ACM Trans. Access. Comput. 5(4) (2014). https://doi.org/10.1145/2579700. https://doi.org/10.1145/2579700

  12. Poularakis, S., Avgerinakis, K., Briassouli, A., Kompatsiaris, Y.: Efficient motion estimation methods for fast recognition of activities of daily living. Signal Process. Image Commun. 53, 1–12 (2017)

    Article  Google Scholar 

  13. Snoun., A., Bouchrika., T., Jemai., O.: View-invariant 3d skeleton-based human activity recognition based on transformer and spatio-temporal features. In: Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - ICPRAM, pp. 706–715. INSTICC, SciTePress (2022). https://doi.org/10.5220/0010895300003122

  14. Snoun, A., Jlidi, N., Bouchrika, T., Jemai, O., Zaied, M.: Towards a deep human activity recognition approach based on video to image transformation with skeleton data. Multimed. Tools Appl. 80(19), 29675–29698 (2021). https://doi.org/10.1007/s11042-021-11188-1

    Article  Google Scholar 

  15. Zhang, J., Bareinboim, E.: Designing optimal dynamic treatment regimes: a causal reinforcement learning approach. In: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, JMLR.org (2020)

    Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the financial support of this work by grants from General Direction of Scientific Research (DGRST), Tunisia, under the ARUB program.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ahmed Snoun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Snoun, A., Bouchrika, T., Jemai, O. (2022). A Reinforcement Learning and Transformers Based Intelligent System for the Support of Alzheimer’s Patients in Daily Life Activities. In: Nguyen, N.T., Manolopoulos, Y., Chbeir, R., Kozierkiewicz, A., Trawiński, B. (eds) Computational Collective Intelligence. ICCCI 2022. Lecture Notes in Computer Science(), vol 13501. Springer, Cham. https://doi.org/10.1007/978-3-031-16014-1_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-16014-1_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-16013-4

  • Online ISBN: 978-3-031-16014-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics