Skip to main content

A Multi-agent Body Tracking Application Framework Applied to Physical and Neurofunctional Rehabilitation

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2022 Workshops (ICCSA 2022)

Abstract

Stroke is one of the most disabling diseases today, so investigating methods for rehabilitation of post-stroke patients is of utmost importance. Thus, significant benefits can be achieved by using body tracking systems and virtual environments. However, the development of such applications involves a large set of requirements, such as the construction of virtual environments, the interaction devices, and the storage and processing of data collected during rehabilitation sessions. This paper presents a multi-agent framework that abstracts the difficulties involved in developing applications using body tracking devices and virtual environments in neuromotor and neurofunctional rehabilitation.

Supported by organization UFSJ.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. On-device, real-time hand tracking with mediapipe (2019). https://ai.googleblog.com/2019/08/on-device-real-time-hand-tracking-with.html

  2. Amiri, A.M., Shoaib, N., Hiremath, S.V.: A framework to enhance assistive technology based mobility tracking in individuals with spinal cord injury. In: 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp. 467–471. IEEE (2017)

    Google Scholar 

  3. Barnes, T., Encarnação, L.M., Shaw, C.D.: Serious games. IEEE Comput. Graph. Appl. 29(2), 18–19 (2009)

    Article  Google Scholar 

  4. Braga, R.T.V.: Um processo para construção e instanciação de frameworks baseados em uma linguagem de padrões para um domínio específico. Ph.D. thesis, Universidade de São Paulo (2002)

    Google Scholar 

  5. Brandão, A.F.: Biomechanics sensor node for virtual reality: a wearable device applied to gait recovery for neurofunctional rehabilitation. In: Gervasi, O., et al. (eds.) ICCSA 2020. LNCS, vol. 12255, pp. 757–770. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58820-5_54

    Chapter  Google Scholar 

  6. Brown, L., García-Vergara, S., Howard, A.M.: Evaluating the effect of robot feedback on motor skill performance in therapy games. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, pp. 1060–1065. IEEE (2015)

    Google Scholar 

  7. Chang, R., Lau, S., Sim, K., Too, M.: Kinect-based framework for motor rehabilitation. In: 2016 International Conference on Robotics, Automation and Sciences (ICORAS), pp. 1–4. IEEE (2016)

    Google Scholar 

  8. Cifuentes, C.A., Rodriguez, C., Frizera-Neto, A., Bastos-Filho, T.F., Carelli, R.: Multimodal human-robot interaction for walker-assisted gait. IEEE Syst. J. 10(3), 933–943 (2014)

    Article  Google Scholar 

  9. Da Gama, A., Chaves, T., Figueiredo, L., Teichrieb, V.: Poster: improving motor rehabilitation process through a natural interaction based system using kinect sensor. In: 2012 IEEE Symposium on 3D User Interfaces (3DUI), pp. 145–146. IEEE (2012)

    Google Scholar 

  10. Dhawan, A.P., Huang, B.H., Kim, D.S.: Principles and Advanced Methods in Medical Imaging and Image Analysis. World Scientific, Singapore (2008)

    Book  Google Scholar 

  11. Drobnjakovic, F., et al.: Fusing data from inertial measurement units and a 3D camera for body tracking. In: 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1–6. IEEE (2018)

    Google Scholar 

  12. Duarte, N., Postolache, O., Scharcanski, J.: KSGphysio-kinect serious game for physiotherapy. In: 2014 International Conference and Exposition on Electrical and Power Engineering (EPE), pp. 606–611. IEEE (2014)

    Google Scholar 

  13. Ferreira, I.A., de Resende, A.M.P., Costa, H.A.X.: Análise do impacto da aplicação de padrões de projeto na manutenibilidade de um sistema orientado a objetos. Monografia de Graduação do Departamento de Ciência da Computação da Universidade Federal de Lavras, 78p (2012)

    Google Scholar 

  14. Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach. Pearson, London (2012)

    Google Scholar 

  15. Fowler, M.: Padrões de arquitetura de aplicações corporativas. Bookman (2009)

    Google Scholar 

  16. Gamma, E.: Design Patterns. Pearson Education India (1995)

    Google Scholar 

  17. Gamma, E.: Padrões de projetos: soluções reutilizáveis. Bookman editora (2009)

    Google Scholar 

  18. Gauthier, S., Cretu, A.M.: Human movement quantification using Kinect for in-home physical exercise monitoring. In: 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 6–11. IEEE (2014)

    Google Scholar 

  19. Gavrila, D.M.: The visual analysis of human movement: a survey. Comput. Vis. Image Underst. 73(1), 82–98 (1999)

    Article  Google Scholar 

  20. Gordon, C., Roopchand-Martin, S., Gregg, A.: Potential of the nintendo wii™ as a rehabilitation tool for children with cerebral palsy in a developing country: a pilot study. Physiotherapy 98(3), 238–242 (2012)

    Article  Google Scholar 

  21. Van de Graaff, K.M.: Anatomia humana. In: Anatomia Humana, p. 840 (2003)

    Google Scholar 

  22. Gwak, M., et al.: EXTRA: exercise tracking and analysis platform for remote-monitoring of knee rehabilitation. In: 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 1–4. IEEE (2019)

    Google Scholar 

  23. Kitsunezaki, N., Adachi, E., Masuda, T., Mizusawa, J.I.: Kinect applications for the physical rehabilitation. In: 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp. 294–299. IEEE (2013)

    Google Scholar 

  24. Kurillo, G., Han, J.J., Nicorici, A., Bajcsy, R.: Tele-MFAsT: kinect-based tele-medicine tool for remote motion and function assessment. In: MMVR, pp. 215–221 (2014)

    Google Scholar 

  25. Macknojia, R., Chávez-Aragón, A., Payeur, P., Laganière, R.: Calibration of a network of kinect sensors for robotic inspection over a large workspace. In: 2013 IEEE Workshop on Robot Vision (WORV), pp. 184–190. IEEE (2013)

    Google Scholar 

  26. Maggiorini, D., Ripamonti, L., Scambia, A.: Videogame technology to support seniors. In: Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques, pp. 270–277 (2012)

    Google Scholar 

  27. Maggiorini, D., Ripamonti, L.A., Zanon, E.: Supporting seniors rehabilitation through videogame technology: a distributed approach. In: 2012 Second International Workshop on Games and Software Engineering: Realizing User Engagement with Game Engineering Techniques (GAS), pp. 16–22. IEEE (2012)

    Google Scholar 

  28. Myagmarbayar, N., Yuki, Y., Imamoglu, N., Gonzalez, J., Otake, M., Yu, W.: Human body contour data based activity recognition. In: 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5634–5637. IEEE (2013)

    Google Scholar 

  29. de Oliveira, C.E.N., Salina, M.E., Annunciato, N.F.: Fatores ambientais que influenciam a plasticidade do snc. Acta Fisiátrica 8(1), 6–13 (2001)

    Article  Google Scholar 

  30. Patterns, D.: Erich gamma, richard helm, ralph johnson, john vlissides. 2003 (1994)

    Google Scholar 

  31. Postolache, O.: Physical rehabilitation assessment based on smart training equipment and mobile apps. In: 2015 E-Health and Bioengineering Conference (EHB), pp. 1–6. IEEE (2015)

    Google Scholar 

  32. Rodriguez-Martin, D., Sama, A., Perez-Lopez, C., Catala, A., Cabestany, J., Rodriguez-Molinero, A.: SVM-based posture identification with a single waist-located triaxial accelerometer. Expert Syst. Appl. 40(18), 7203–7211 (2013)

    Article  Google Scholar 

  33. Sinha, S., Bhowmick, B., Sinha, A., Das, A.: Accurate estimation of joint motion trajectories for rehabilitation using Kinect. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3864–3867. IEEE (2017)

    Google Scholar 

  34. Stütz, T., et al.: An interactive 3D health app with multimodal information representation for frozen shoulder. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–11 (2017)

    Google Scholar 

  35. Vaghetti, C.A., Duarte, M.A., Ribeiro, P.O., Botelho, S.S.: Using exergames as social networks: testing the flow theory in the teaching of physical education. In: Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), vol. 23 (2012)

    Google Scholar 

  36. Whitall, J., Waller, S.M., Silver, K.H., Macko, R.F.: Repetitive bilateral arm training with rhythmic auditory cueing improves motor function in chronic hemiparetic stroke. Stroke 31(10), 2390–2395 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Felipe Reis Valente .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Valente, F.R., de Paiva Guimarães, M., Cirilo, E.J.R., Dias, D.R.C. (2022). A Multi-agent Body Tracking Application Framework Applied to Physical and Neurofunctional Rehabilitation. In: Gervasi, O., Murgante, B., Misra, S., Rocha, A.M.A.C., Garau, C. (eds) Computational Science and Its Applications – ICCSA 2022 Workshops. ICCSA 2022. Lecture Notes in Computer Science, vol 13382. Springer, Cham. https://doi.org/10.1007/978-3-031-10592-0_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-10592-0_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-10591-3

  • Online ISBN: 978-3-031-10592-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics