Skip to main content

Advertisement

SpringerLink
Log in

KeepStep: Accommodating user diversity through individualized, projection-mapping based exergames for rehabilitation in people with multiple sclerosis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

People with central nervous shortages, such as MS can utilize appropriate training approaches that improve their ability to accomplish activities in daily life. The MS symptoms and disease progression in People with Multiple Sclerosis (PwMS) are different, and each has its development speed. It is essential to accommodate adaptive training with patient’s characteristics, and rehabilitation needs to address this diversity. This paper proposes a new gait rehabilitation approach in PwMS training using adaptive, individualized exergames. The exergames have been designed and developed inspired by four regular physiotherapy exercises. The suggested games are displayed on the floor using a projection-mapping approach to provide a stable environment and ensure practical exercise training for PwMS. Furthermore, the proposed method is empowered using dynamic difficulty adjustment algorithms to control the adaptivity of the games. We conducted a user study to evaluate patients’ reactions to the automated difficulty adjustment of game levels. Our findings showed that none of the PwMS followed the same training path as the others. It reveals that each patient recovers at a different rate, underlining the importance of adaptability in this type of treatment. Individualized adaptive training, which was provided to each MS patient based on their development, has been described as beneficial and appreciated.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. Information and communication technology

  2. KeepStep was chosen as the best Academic game in the GALA game competition 2020 in France.

  3. The extended disability status scale

References

  1. Aguilar VS, Lamoth C, Maurits N, Roerdink J (2018) Assessing dynamic postural control during exergaming in older adults: A probabilistic approach. Gait & Posture 60:235–240

    Article  Google Scholar 

  2. Amatya B, Galea MP, Kesselring J, Khan F (2015) Effectiveness of telerehabilitation interventions in persons with multiple sclerosis: A systematic review. Multiple Sclerosis and Related Disorders 4(4):358–369

    Article  Google Scholar 

  3. Amiri Z, Sekhavat YA (2019) Intelligent adjustment of game properties at run time using multi-armed bandits. The Computer Games Journal 8 (3-4):143–156

    Article  Google Scholar 

  4. Amiri Z, Sekhavat YA, Goljaryan S (2018) A framework for rehabilitation games to improve balance in people with multiple sclerosis (ms). In: 2018 2Nd national and 1st international digital games research conference: Trends, technologies, and applications (DGRC), IEEE, pp 76–81

  5. Amiri Z, Sekhavat YA, Goljaryan S (2021) Keepstep: Interactive projection-mapping based exergames for people with multiple sclerosis. In: 2021 IEEE Conference on games (cog), IEEE, pp 1–3

  6. Anderson F, Grossman T, Matejka J, Fitzmaurice G (2013) Youmove: Enhancing movement training with an augmented reality mirror. pp 311–320

  7. Andrade KO, Joaquim RC, Caurin GA, Crocomo MK (2018) Evolutionary algorithms for a better gaming experience in rehabilitation robotics. Computers in Entertainment (CIE) 16(2):1–15

    Article  Google Scholar 

  8. Badesa FJ, Morales R, Garcia-Aracil N, Sabater JM, Casals A, Zollo L (2014) Auto-adaptive robot-aided therapy using machine learning techniques. Computer Methods and Programs in Biomedicine 116(2):123–130

    Article  Google Scholar 

  9. Burdea GC, Cioi D, Kale A, Janes WE, Ross SA, Engsberg JR (2012) Robotics and gaming to improve ankle strength, motor control, and function in children with cerebral palsy—a case study series. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21(2):165–173

    Article  Google Scholar 

  10. Casuso-Holgado MJ, Martín-valero R, Carazo AF, Medrano-Sánchez EM, Cortés-Vega MD, Montero-Bancalero FJ (2018) Effectiveness of virtual reality training for balance and gait rehabilitation in people with multiple sclerosis: A systematic review and meta-analysis. Clinical Rehabilitation 32(9):1220–1234

    Article  Google Scholar 

  11. Caurin GA, Siqueira AA, Andrade KO, Joaquim RC, Krebs HI (2011) Adaptive strategy for multi-user robotic rehabilitation games. In: 2011 Annual international conference of the IEEE engineering in medicine and biology society, IEEE, pp 1395–1398

  12. Csikszentmihalyi M (1990) Csíkszentmihályi, mihály. Flow: The Psychology of Optimal Experience New york: Harper and Row

  13. Da Gama A, Chaves T, Figueiredo L, Teichrieb V (2012) Poster: Improving motor rehabilitation process through a natural interaction based system using kinect sensor. pp 145–146

  14. Da Gama A, Fallavollita P, Teichrieb V, Navab N (2015) Motor rehabilitation using kinect: A systematic review. Games for Health Journal 4(2):123–135

    Article  Google Scholar 

  15. Dal Jae Im JK, Kim YJ, Cho S, Cho YK, Lim T, Lee HS, Kim HJ, Kang YJ (2015) Utility of a three-dimensional interactive augmented reality program for balance and mobility rehabilitation in the elderly: A feasibility study. Annals of Rehabilitation Medicine 39(3):462

    Article  Google Scholar 

  16. Dalmazane M, Gallou-Guyot M, Compagnat M, Magy L, Montcuquet A, Daviet JC, Perrochon A (2021) Effects on gait and balance of home-based active video game interventions in persons with multiple sclerosis: A systematic review. Multiple sclerosis and related disorders p 102928

  17. De Luca R, Leonardi S, Portaro S, Le Cause M, De Domenico C, Colucci PV, Pranio F, Bramanti P, Calabrò RS (2021) Innovative use of virtual reality in autism spectrum disorder: A case-study. Applied Neuropsychology: Child 10(1):90–100

    Article  Google Scholar 

  18. De Luca R, Lo Buono V, Leo A, Russo M, Aragona B, Leonardi S, Buda A, Naro A, Calabrò RS (2019) Use of virtual reality in improving poststroke neglect: Promising neuropsychological and neurophysiological findings from a case study. Applied Neuropsychology: Adult 26(1):96–100

    Article  Google Scholar 

  19. De Luca R, Torrisi M, Piccolo A, Bonfiglio G, Tomasello P, Naro A, Calabrò RS (2018) Improving post-stroke cognitive and behavioral abnormalities by using virtual reality: A case report on a novel use of nirvana. Applied Neuropsychology: Adult 25(6):581–585

    Article  Google Scholar 

  20. Döring A, Pfueller CF, Paul F, Dörr J (2012) Exercise in multiple sclerosis–an integral component of disease management. Epma Journal 3 (1):2

    Article  Google Scholar 

  21. Feys P, Alders G, Gijbels D, De Boeck J, De Weyer T, Coninx K, Raymaekers C, Truyens V, Groenen P, Meijer K et al (2009) Arm training in multiple sclerosis using phantom: Clinical relevance of robotic outcome measures. In: 2009 IEEE International conference on rehabilitation robotics, IEEE, pp 576–581

  22. Feys P, Moumdjian L, Van Halewyck F, Wens I, Eijnde BO, Van Wijmeersch B, Popescu V, Van Asch P (2019) Effects of an individual 12-week community-located “start-to-run” program on physical capacity, walking, fatigue, cognitive function, brain volumes, and structures in persons with multiple sclerosis. Multiple Sclerosis Journal 25(1):92–103

    Article  Google Scholar 

  23. Giang C, Pirondini E, Kinany N, Pierella C, Panarese A, Coscia M, Miehlbradt J, Magnin C, Nicolo P, Guggisberg A et al (2020) Motor improvement estimation and task adaptation for personalized robot-aided therapy: A feasibility study. Biomedical Engineering Online 19:1–25

    Article  Google Scholar 

  24. Givon Schaham N, Zeilig G, Weingarden H, Rand D (2018) Game analysis and clinical use of the xbox-kinect for stroke rehabilitation. Int J Rehabil Res 41(4):323–330

    Article  Google Scholar 

  25. Gutiérrez RO, Galan del Rio F, Cano de la Cuerda R, Alguacil Diego IM, González RA, Page JCM (2013) A telerehabilitation program by virtual reality-video games improves balance and postural control in multiple sclerosis patients. NeuroRehabilitation 33(4):545–554

    Article  Google Scholar 

  26. Gutman SA (2008) Quick reference neuroscience for rehabilitation professionals: The essential neurologic principles underlying rehabilitation practice. Slack Incorporated

  27. Hoang P, Schoene D, Gandevia S, Smith S, Lord SR (2016) Effects of a home-based step training programme on balance, stepping, cognition and functional performance in people with multiple sclerosis–a randomized controlled trial. Multiple Sclerosis Journal 22(1):94–103

    Article  Google Scholar 

  28. Hoe ZY, Lee IJ, Chen CH, Chang KP (2019) Using an augmented reality-based training system to promote spatial visualization ability for the elderly. Univ Access Inf Soc 18(2):327–342

    Article  Google Scholar 

  29. Huang SY, Yu JP, Wang YK, Liu JW (2017) Designing an exergaming system for exercise bikes using kinect sensors and google earth. Multimedia Tools and Applications 76(10):12,281–12,314

    Article  Google Scholar 

  30. Huijgen BC, Vollenbroek-Hutten MM, Zampolini M, Opisso E, Bernabeu M, Van Nieuwenhoven J, Ilsbroukx S, Magni R, Giacomozzi C, Marcellari V et al (2008) Feasibility of a home-based telerehabilitation system compared to usual care: Arm/hand function in patients with stroke, traumatic brain injury and multiple sclerosis. Journal of Telemedicine and Telecare 14(5):249–256

    Article  Google Scholar 

  31. Kan P, Huq R, Hoey J, Goetschalckx R, Mihailidis A (2011) The development of an adaptive upper-limb stroke rehabilitation robotic system. Journal of Neuroengineering and Rehabilitation 8(1):33

    Article  Google Scholar 

  32. Khan F, Turner-Stokes L, Ng L, Kilpatrick T, Amatya B (2007) Multidisciplinary rehabilitation for adults with multiple sclerosis. Cochrane Database of Systematic Reviews (2)

  33. Kramer A, Dettmers C, Gruber M (2014) Exergaming with additional postural demands improves balance and gait in patients with multiple sclerosis as much as conventional balance training and leads to high adherence to home-based balance training. Archives of Physical Medicine and Rehabilitation 95(10):1803–1809

    Article  Google Scholar 

  34. Lee Y, Chen K, Ren Y, Son J, Cohen BA, Sliwa JA, Zhang LQ (2017) Robot-guided ankle sensorimotor rehabilitation of patients with multiple sclerosis. Multiple Sclerosis and Related Disorders 11:65–70

    Article  Google Scholar 

  35. Liu J, Mei J, Zhang X, Lu X, Huang J (2017) Augmented reality-based training system for hand rehabilitation. Multimedia Tools and Applications 76(13):14,847–14,867

    Article  Google Scholar 

  36. Lozano-Quilis JA, Gil-Gomez H, Gil-Gómez JA, Albiol-Perez S, Palacios G, Fardoum HM, Mashat AS (2013) Virtual reality system for multiple sclerosis rehabilitation using kinect. In: 2013 7Th international conference on pervasive computing technologies for healthcare and workshops, IEEE, pp 366–369

  37. Luo X, Kenyon RV, Kline T, Waldinger HC, Kamper DG (2005) An augmented reality training environment for post-stroke finger extension rehabilitation. In: 9Th international conference on rehabilitation robotics, 2005. ICORR 2005., IEEE, pp 329–332

  38. Ma M, Proffitt R, Skubic M (2018) Validation of a kinect v2 based rehabilitation game. PloS One 13(8):e0202,338

    Article  Google Scholar 

  39. Maris A, Coninx K, Seelen H, Truyens V, De Weyer T, Geers R, Lemmens M, Coolen J, Stupar S, Lamers I et al (2018) The impact of robot-mediated adaptive i-travle training on impaired upper limb function in chronic stroke and multiple sclerosis. Disability and Rehabilitation: Assistive Technology 13(1):1–9

    Google Scholar 

  40. Motl RW (2014) Lifestyle physical activity in persons with multiple sclerosis: The new kid on the ms block. Multiple Sclerosis Journal 20(8):1025–1029

    Article  Google Scholar 

  41. Motl RW, Sandroff BM (2015) Benefits of exercise training in multiple sclerosis. Current Neurology and Neuroscience Reports 15(9):62

    Article  Google Scholar 

  42. Motl RW, Sandroff BM, Kwakkel G, Dalgas U, Feinstein A, Heesen C, Feys P, Thompson AJ (2017) Exercise in patients with multiple sclerosis. The Lancet Neurology 16(10):848–856

    Article  Google Scholar 

  43. Mouawad MR, Doust CG, Max MD, McNulty PA (2011) Wii-based movement therapy to promote improved upper extremity function post-stroke: A pilot study. Journal of Rehabilitation Medicine 43(6):527–533

    Article  Google Scholar 

  44. Ni T, Karlson AK, Wigdor D (2011) Anatonme: Facilitating doctor-patient communication using a projection-based handheld device. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 3333–3342

  45. Octavia JR, Coninx K (2014) Adaptive personalized training games for individual and collaborative rehabilitation of people with multiple sclerosis. BioMed research international 2014

  46. Ortiz-Gutiérrez R., Cano-de-la Cuerda R, Galán-del Río F, Alguacil-Diego IM, Palacios-Ceña D, Miangolarra-Page JC (2013) A telerehabilitation program improves postural control in multiple sclerosis patients: A spanish preliminary study. International Journal of Environmental Research and Public Health 10 (11):5697–5710

    Article  Google Scholar 

  47. O’Toole ML (1998) Overreaching and overtraining in endurance athletes. Overtraining in sport, pp 3–18

  48. Ozdogar AT, Ertekin O, Kahraman T, Yigit P, Ozakbas S (2020) Effect of video-based exergaming on arm and cognitive function in persons with multiple sclerosis: A randomized controlled trial. Multiple Sclerosis and Related Disorders 40(101):966

    Google Scholar 

  49. Pazzaglia C, Imbimbo I, Tranchita E, Minganti C, Ricciardi D, Monaco RL, Parisi A, Padua L (2020) Comparison of virtual reality rehabilitation and conventional rehabilitation in parkinson’s disease: A randomised controlled trial. Physiotherapy 106:36–42

    Article  Google Scholar 

  50. Peña O, Cibrian FL, Tentori M (2020) Circus in motion: A multimodal exergame supporting vestibular therapy for children with autism. Journal on Multimodal User Interfaces, pp 1–17

  51. Plow M, Finlayson M (2014) A qualitative study exploring the usability of nintendo wii fit among persons with multiple sclerosis. Occupational Therapy International 21(1):21–32

    Article  Google Scholar 

  52. Polman CH, Reingold SC, Banwell B, Clanet M, Cohen JA, Filippi M, Fujihara K, Havrdova E, Hutchinson M, Kappos L et al (2011) Diagnostic criteria for multiple sclerosis: 2010 revisions to the mcdonald criteria. Annals of Neurology 69(2):292–302

    Article  Google Scholar 

  53. Rego P, Moreira PM, Reis LP (2010) Serious games for rehabilitation: A survey and a classification towards a taxonomy. In: 5Th iberian conference on information systems and technologies, IEEE, pp 1–6

  54. Rosenthal O, Wing AM, Wyatt JL, Punt D, Brownless B, Ko-Ko C, Miall RC (2019) Boosting robot-assisted rehabilitation of stroke hemiparesis by individualized selection of upper limb movements–a pilot study. Journal of Neuroengineering and Rehabilitation 16(1):1–14

    Google Scholar 

  55. Schweighofer N, Choi Y, Winstein C, Gordon J (2012) Task-oriented rehabilitation robotics. American Journal of Physical Medicine & Rehabilitation 91(11):S270–S279

    Article  Google Scholar 

  56. Sebastião E, McAuley E, Shigematsu R, Adamson BC, Bollaert RE, Motl RW (2018) Home-based, square-stepping exercise program among older adults with multiple sclerosis: Results of a feasibility randomized controlled study. Contemporary Clinical Trials 73:136–144

    Article  Google Scholar 

  57. Sekhavat YA (2017) Mprl: Multiple-periodic reinforcement learning for difficulty adjustment in rehabilitation games. In: 2017 IEEE 5Th international conference on serious games and applications for health (seGAH), IEEE, pp 1–7

  58. Sekhavat YA (2020) Collaboration or battle between minds? an attention training game through collaborative and competitive reinforcement. Entertainment Computing 34(100):360

    Google Scholar 

  59. Sekhavat YA, Namani MS (2018) Projection-based ar: Effective visual feedback in gait rehabilitation. IEEE Transactions on Human-Machine Systems 48 (6):626–636

    Article  Google Scholar 

  60. Severini G, Straudi S, Pavarelli C, Da Roit M, Martinuzzi C, Pizzongolo LDM, Basaglia N (2017) Use of nintendo wii balance board for posturographic analysis of multiple sclerosis patients with minimal balance impairment. Journal of Neuroengineering and Rehabilitation 14(1):1–14

    Article  Google Scholar 

  61. Shanahan CJ, Boonstra F, Cofré Lizama LE, Strik M, Moffat BA, Khan F, Kilpatrick TJ, Van Der Walt A, Galea MP, Kolbe SC (2018) Technologies for advanced gait and balance assessments in people with multiple sclerosis. Frontiers in Neurology 8:708

    Article  Google Scholar 

  62. Sigrist R, Rauter G, Riener R, Wolf P (2013) Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomic Bulletin & Review 20(1):21–53

    Article  Google Scholar 

  63. Smeddinck JD, Siegel S, Herrlich M (2013) Adaptive difficulty in exergames for parkinson’s disease patients. pp 141–148

  64. Sousa M, Vieira J, Medeiros D, Arsenio A, Jorge J (2016) Sleevear: Augmented reality for rehabilitation using realtime feedback

  65. Su CH (2016) Developing and evaluating effectiveness of 3d game-based rehabilitation system for total knee replacement rehabilitation patients. Multimedia Tools and Applications 75(16):10,037–10,057

    Article  Google Scholar 

  66. Taylor MJ, Griffin M (2015) The use of gaming technology for rehabilitation in people with multiple sclerosis. Multiple Sclerosis Journal 21(4):355–371

    Article  Google Scholar 

  67. Taylor MJ, McCormick D, Shawis T, Impson R, Griffin M (2011) Activity-promoting gaming systems in exercise and rehabilitation. Journal of Rehabilitation Research and Development 48(10):1171–1186

    Article  Google Scholar 

  68. Theodoros D, Russell T, Latifi R (2008) Telerehabilitation: Current perspectives. Studies in Health Technology and Informatics 131(1):191–210

    Google Scholar 

  69. Vanacken L, Notelaers S, Raymaekers C, Coninx K, van den Hoogen W, IJsselsteijn W, Feys P (2010) Game-based collaborative training for arm rehabilitation of ms patients: A proof-of-concept game. Proceedings of GameDays 2010:65–75

    Google Scholar 

  70. Ventura S, Baños RM, Botella C, Mohamudally N (2018) Virtual and augmented reality: New frontiers for clinical psychology. State of the Art Virtual Reality and Augmented Reality Knowhow, pp 99–118

  71. Wagner JM, Norris RA, Van Dillen LR, Thomas FP, Naismith RT (2013) Four square step test in ambulant persons with multiple sclerosis: Validity, reliability, and responsiveness. Int J Rehabil Res 36(3):253–259

    Article  Google Scholar 

  72. Woldag H, Hummelsheim H (2002) Evidence-based physiotherapeutic concepts for improving arm and hand function in stroke patients. Journal of Neurology 249(5):518–528

    Article  Google Scholar 

  73. Yazgan YZ, Tarakci E, Tarakci D, Ozdincler AR, Kurtuncu M (2020) Comparison of the effects of two different exergaming systems on balance, functionality, fatigue, and quality of life in people with multiple sclerosis: A randomized controlled trial. Multiple Sclerosis and Related Disorders 39(101):902

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Multimedia, Tabriz Islamic Art University, Tabriz, 5164736931, Iran

    Zahra Amiri, Yoones A. Sekhavat & Samad Roohi

  2. Faculty of Rehabilitation, Tabriz University of Medical Sciences, Tabriz, Iran

    Sakineh Goljaryan

Authors
  1. Zahra Amiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yoones A. Sekhavat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sakineh Goljaryan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Samad Roohi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Zahra Amiri or Yoones A. Sekhavat.

Ethics declarations

Ethics approval

The research started after receiving approval from the Committee of Ethics (code: IR.TABRIZU.REC.1399.059), evaluated by University of Tabriz (Biomedical Research Ethics Committee). They agreed that the project met the ethical principles as well as the national norms and standards for conducting medical research in Iran. The information of all patients was anonymous and they could quit the study on personal desire, regardless of the study stage. All patients met the study’s inclusion criteria.

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Informed consent

Informed consent was obtained from all participants included in the study.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This paper is an excerpt from the master’s thesis of Zahra Amiri.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amiri, Z., Sekhavat, Y.A., Goljaryan, S. et al. KeepStep: Accommodating user diversity through individualized, projection-mapping based exergames for rehabilitation in people with multiple sclerosis. Multimed Tools Appl 81, 27991–28019 (2022). https://doi.org/10.1007/s11042-022-12771-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12771-w

Keywords

Search

Navigation