Skip to main content
SpringerLink
Log in

Gamified platform for rehabilitation after total knee replacement surgery employing low cost and portable inertial measurement sensor node

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper introduces an innovative gamified rehabilitation platform comprising of a mobile game and a custom sensor placed on the knee, intended for patients that have undergone Total Knee Replacement surgery, in collaboration with the General Hospital in Chania. Initial testing of the system is conducted in the Hospital Orthopaedic Clinic, in collaboration with Orthopeadic Surgeons and Physiotherapists. The application uses a single custom-made, light, portable and low-cost sensor node consisting of an Inertial Measurement Unit (IMU) attached on a lower limb in order to capture its orientation in space in real-time, while the patient is completing a physiotherapy protocol. The aim is to increase patient engagement during physiotherapy by motivating the user to participate in a game. The proposed sensor node attached on the lower limb provides input to the gamified experience displayed on an Android mobile device, offering feedback to the patient in relation to whether the performed exercises were accurately conducted. A classification algorithm is proposed that automatically classifies an exercise in real-time as correct or incorrect, according to physiotherapists’ set criteria. The game projects a graphical image of the patient’s limb motion as part of a 3D computer graphics scene. It then classifies the exercise performed during physiotherapy as accurately performed or not and increases patient compliance via a reward system. Our goal is to reduce the need for the physical presence of a physiotherapist by aiding the efficient performance of exercise sessions at any location, e.g. at home, indoors and outdoors by just utilizing a light sensor and an Android device. Initial testing of the application in the Chania’s General Hospital Orthopaedic Clinic, Greece, indicates that patient engagement is enhanced in most cases, even when elderly patients are concerned.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Artz N, Elvers KT, Lowe CM, Sackley C, Jepson P, Beswick AD (2015) Effectiveness of physiotherapy exercise following total knee replacement: systematic review and meta-analysis. BMC Musculoskelet Disord 16(1):15

    Article  Google Scholar 

  2. Bachmann ER, McGhee RB, Yun X, Zyda MJ (2001) Inertial and magnetic posture tracking for inserting humans into networked virtual environments. In: Proceedings of the ACM symposium on Virtual reality software and technology (pp. 9–16). ACM

  3. Blagojevic M, Jinks C, Jeffery A, Jordan KP (2010) Risk factors for onset of osteoarthritis of the knee in older adults: a systematic review and meta-analysis. Osteoarthr Cartil 18(1):24–33

    Article  Google Scholar 

  4. Bo APL, Hayashibe M, Poignet P (2011) Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE (pp. 3479–3483). IEEE

  5. Buonocunto P, Marinoni M (2014). Tracking limbs motion using a wireless network of inertial measurement units. In Industrial Embedded Systems (SIES), 2014 9th IEEE International Symposium on (pp. 66–76). IEEE

  6. Chang YJ, Chen SF, Huang JD (2011) A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res Dev Disabil 32(6):2566–2570

    Article  Google Scholar 

  7. Convery FR, Beber CA (1973) Total knee arthroplasty: indications, evaluation and postoperative management. Clin Orthop Relat Res 94:42–49

    Article  Google Scholar 

  8. Crocher V, Hur P, Seo NJ (2013). Low-cost virtual rehabilitation games: House of quality to meet patient expectations. In: Virtual Rehabilitation (ICVR), 2013 International Conference on (pp. 94–100). IEEE

  9. Field M, Stirling D, Ros M, Pan Z, Naghdy F (2013) Inertial sensing for human motor control symmetry in injury rehabilitation. In: Advanced Intelligent Mechatronics (AIM), 2013 IEEE/ASME International Conference on (pp. 1470–1475). IEEE

  10. Fung V, Ho A, Shaffer J, Chung E, Gomez M (2012) Use of Nintendo Wii Fit™ in the rehabilitation of outpatients following total knee replacement: a preliminary randomised controlled trial. Physiotherapy 98(3):183–188

    Article  Google Scholar 

  11. Giggins OM, Sweeney KT, Caulfield B (2014) Rehabilitation exercise assessment using inertial sensors: a cross-sectional analytical study. Journal of Neuroengineering and Rehabilitation 11(1):158

    Article  Google Scholar 

  12. Grewal MS (2011) Kalman filtering. In International Encyclopedia of Statistical Science (pp. 705–708). Springer Berlin Heidelberg

    Chapter  Google Scholar 

  13. Harada T, Mori T, Sato T (2004) Human posture probability density estimation based on actual motion measurement and eigenpostures. In: Systems, Man and Cybernetics, 2004 IEEE International Conference on (Vol. 2, pp. 1595–1600). IEEE

  14. Harmelink KE, Zeegers AVCM, Tönis TM, Hullegie W, Staal JB (2017) The effectiveness of the use of a digital activity coaching system in addition to a two-week home-based exercise program in patients after total knee arthroplasty: study protocol for a randomized controlled trial. BMC Musculoskelet Disord 18(1):290

    Article  Google Scholar 

  15. Harmer AR, Naylor JM, Crosbie J, Russell T (2009) Land-based versus water-based rehabilitation following total knee replacement: A randomized, single-blind trial. Arthritis Care Res 61(2):184–191

    Article  Google Scholar 

  16. Huang B, Giggins O, Kechadi T, Caulfield B (2016) The limb movement analysis of rehabilitation exercises using wearable inertial sensors. In: Engineering in Medicine and Biology Society (EMBC), 2016 IEEE 38th Annual International Conference of the (pp. 4686–4689). IEEE

  17. Kalman RE (1960) A new approach to linear filtering and prediction problems. Transactions of the ASME Journal of Basic Engineering 82:35–45

    Article  MathSciNet  Google Scholar 

  18. Lee K, Lin HC, Kan YC, Chiang SY (2013) A pilot study of activity recognition on rehabilitation exercise of frozen shoulder using wireless inertial sensor node. In: Medical Information and Communication Technology (ISMICT), 2013 7th International Symposium on (pp. 117–120). IEEE

  19. Levin MF, Snir O, Liebermann DG, Weingarden H, Weiss PL (2012) Virtual reality versus conventional treatment of reaching ability in chronic stroke: clinical feasibility study. Neurology and Therapy 1(1):3

    Article  Google Scholar 

  20. Mahony R, Hamel T, Pflimlin JM (2008) Nonlinear complementary filters on the special orthogonal group. IEEE Trans Autom Control 53(5):1203–1218

    Article  MathSciNet  Google Scholar 

  21. Martin GM, Thornhill TS, Katz JN (2014) Total knee arthroplasty. UpToDate

  22. Menache A (2000) Understanding motion capture for computer animation and video games. Morgan kaufmann

  23. Paraskevopoulos IT, Tsekleves E, Craig C, Whyatt C, Cosmas J (2014) Design guidelines for developing customised serious games for Parkinson’s Disease rehabilitation using bespoke game sensors. Entertainment Computing 5(4):413–424

    Article  Google Scholar 

  24. Pirovano M, Surer E, Mainetti R, Lanzi PL, Borghese NA (2016) Exergaming and rehabilitation: A methodology for the design of effective and safe therapeutic exergames. Entertainment Computing 14:55–65

    Article  Google Scholar 

  25. Rand D, Schejter-Margalit T, Dudkiewicz I, Kizony R, Zeilig G (2013) The use of the iPad for poststroke hand rehabilitation; a pilot study. In: Virtual Rehabilitation (ICVR), 2013 International Conference on (pp. 109–113). IEEE

  26. Roetenberg D, Luinge H, Slycke P (2007) Moven: Full 6dof human motion tracking using miniature inertial sensors. Xsen Technologies 2(3):8

    Google Scholar 

  27. Shen Y, Ong SK, Nee AYC (2008) An augmented reality system for hand movement rehabilitation. In: Proceedings of the 2nd International Convention on Rehabilitation Engineering & Assistive Technology (pp. 189–192). Singapore Therapeutic, Assistive & Rehabilitative Technologies (START) Centre

  28. Skou ST, Graven-Nielsen T, Rasmussen S, Simonsen OH, Laursen MB, Arendt-Nielsen L (2014) Facilitation of pain sensitization in knee osteoarthritis and persistent post-operative pain: A cross-sectional study. Eur J Pain 18(7):1024–1031

    Article  Google Scholar 

  29. Solazzi M, Frisoli A, Bergamasco M (2010) Design of a novel finger haptic interface for contact and orientation display. In Haptics Symposium, 2010 IEEE (pp. 129–132). IEEE

  30. Stevens-Lapsley JE, Balter JE, Wolfe P, Eckhoff DG, Kohrt WM (2012) Early neuromuscular electrical stimulation to improve quadriceps muscle strength after total knee arthroplasty: a randomized controlled trial. Phys Ther 92(2):210–226

    Article  Google Scholar 

  31. Tipping M (2003) U.S. Patent No. 6,633,857. U.S. Patent and Trademark Office, Washington, DC

    Google Scholar 

  32. Tousignant M, Moffet H, Boissy P, Corriveau H, Cabana F, Marquis F (2011) A randomized controlled trial of home telerehabilitation for post-knee arthroplasty. J Telemed Telecare 17(4):195–198

    Article  Google Scholar 

  33. Tsekleves E, Warland A, Kilbride C, Paraskevopoulos I, Skordoulis D (2014) The use of the Nintendo Wii in motor rehabilitation for virtual reality interventions: a literature review. In Virtual, Augmented Reality and Serious Games for Healthcare 1 (pp. 321–344). Springer Berlin Heidelberg

    Chapter  Google Scholar 

  34. Wang PT, King CE, Do AH, Nenadic Z (2011) A durable, low-cost electrogoniometer for dynamic measurement of joint trajectories. Med Eng Phys 33(5):546–552

    Article  Google Scholar 

  35. Wouters P, Van Nimwegen C, Van Oostendorp H, Van Der Spek ED (2013) A meta-analysis of the cognitive and motivational effects of serious games. J Educ Psychol 105(2):249

    Article  Google Scholar 

  36. Bohannon RW, Harrison S, Kinsella-Shaw J (2009) Reliability and validity of pendulum test measures of spasticity obtained with the Polhemus tracking system from patients with chronic stroke. J Neuroeng Rehabil 6(1):30

    Article  Google Scholar 

Download references

Acknowledgements

This study was performed by the Technical University of Crete in collaboration with the Chania General Hospital Orthopaedic Clinic. The current project wouldn’t be possible without the formal authorization of the hospital to work with physiotherapists, orthopaedics and TKR patients and the voluntary consent of TKR patients themselves to contribute to this study.

Author information

Authors and Affiliations

  1. Technical University of Crete, Chania, Greece

    Gregory Kontadakis & Katerina Mania

  2. General Hospital Of Chania, Chania, Greece

    Dimitrios Chasiouras, Despoina Proimaki, Manolis Halkiadakis & Maria Fyntikaki

Authors
  1. Gregory Kontadakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dimitrios Chasiouras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Despoina Proimaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manolis Halkiadakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maria Fyntikaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Katerina Mania
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gregory Kontadakis.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(MP4 16,158 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kontadakis, G., Chasiouras, D., Proimaki, D. et al. Gamified platform for rehabilitation after total knee replacement surgery employing low cost and portable inertial measurement sensor node. Multimed Tools Appl 79, 3161–3188 (2020). https://doi.org/10.1007/s11042-018-6572-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6572-6

Keywords

Search

Navigation