Elham Saraee
Saurabh Singh
Margrit Betke
ABSTRACT
Home-based exercising is a vital part of any physical therapy program. With correct execution of the exercises, faster recovery from physical impairments can be achieved. With the conventional approaches, however, a home-based physical therapy program may not be as effective due to the lack of supervision by the therapist at home. ExerciseCheck is designed as a remote monitoring and evaluation platform for individuals involved in home-based physical therapy. The goal of ExerciseCheck is to provide patients and physical therapists with real-time visual feedback and quantitative analysis. In this paper, we discuss the progress we have made toward (1) a more comprehensive analysis of the performance of the patient and (2) informative feedback to the patient and the physical therapist. Furthermore, in order to validate the feasibility and effectiveness of our system, we have performed an experiment in a clinical setting involving five patients with Parkinson disease. We describe how ExerciseCheck can quantitatively evaluate the user's performance and identify their problems. We assessed how ExerciseCheck can impact the performance and the overall experience of the patient. Our results show that ExerciseCheck is a user-friendly system that patients and physical therapists can easily interact with. Patients benefit from visual and quantitative feedback and apply this to subsequent repetitions of the exercises.
- Gazihan Alankus, Rachel Proffitt, Caitlin Kelleher, and Jack Engsberg. Stroke therapy through motion-based games: a case study. ACM Transactions on Accessible Computing (TACCESS), 4(1):3, 2011. Google Scholar
Digital Library
- Ahmed Allam, Zlatina Kostova, Kent Nakamoto, and Peter Johannes Schulz. The effect of social support features and gamification on a web-based intervention for rheumatoid arthritis patients: randomized controlled trial. Journal of medical Internet research, 17(1), 2015.Google Scholar
- Donald J. Berndt and James Clifford. Using Dynamic Time Warping to Find Patterns in Time Series. In Knowledge Discovery and Data Mining (KDD) Workshop, pages 359--370, 1994. Google ScholarDigital Library
- James William Burke, MDJ McNeill, Darryl K Charles, Philip J Morrow, Jacqui H Crosbie, and Suzanne M McDonough. Optimising engagement for stroke rehabilitation using serious games. The Visual Computer, 25(12):1085, 2009. Google ScholarDigital Library
- Alana Da Gama, Pascal Fallavollita, Veronica Teichrieb, and Nassir Navab. Motor rehabilitation using Kinect: a systematic review. Games for health journal, 4(2):123--135, 2015.Google Scholar
- Dylan Ebert, Vangelis Metsis, and Fillia Makedon. Development and evaluation of a unity-based, Kinect-controlled avatar for physical rehabilitation. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, page 88. ACM, 2015. Google ScholarDigital Library
- OTR Gargin, OTR Pizzi, et al. Wii-hab: Using the wii video game system as an occupational therapy intervention with patients in the hospital setting. Population Health Matters (Formerly Health Policy Newsletter), 23(1):4, 2010.Google Scholar
- Belinda Lange, Sebastian Koenig, Eric McConnell, Chien-Yen Chang, Rick Juang, Evan Suma, Mark Bolas, and Albert Rizzo. Interactive game-based rehabilitation using the microsoft kinect. In 2012 IEEE Virtual Reality Workshops (VRW), pages 171--172. IEEE, 2012. Google ScholarDigital Library
- Wan-wen Liao, Sandy McCombe Waller, and Jill Whitall. Kinect-based individualized upper extremity rehabilitation is effective and feasible for individuals with stroke using a transition from clinic to home protocol. Cogent Medicine, 5(1), 2018. 12 pages.Google Scholar
- Jonathan Feng-Shun Lin and Dana Kulic. Online segmentation of human motion for automated rehabilitation exercise analysis. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22(1):168--180, 2014.Google ScholarCross Ref
- Alexandros Lioulemes, Michail Theofanidis, Varun Kanal, Konstantinos Tsiakas, Maher Abujelala, Chris Collander, William B Townsend, Angie Boisselle, and Fillia Makedon. MAGNI Dynamics: A vision-based kinematic and dynamic upper-limb model for intelligent robotic rehabilitation. WASET, International Journal of Medical, Health, Biomedical, Bioengineering and Pharmaceutical Engineering, 11(4):158--167, 2017.Google Scholar
- Jun Liu, Henghui Ding, Amir Shahroudy, Ling-Yu Duan, Xudong Jiang, Gang Wang, and Alex C Kot. Feature boosting network for 3D pose estimation. arXiv preprint arXiv:1901.04877, 2019.Google Scholar
- Alexander Mathis, Pranav Mamidanna, Kevin M. Cury, Taiga Abe, Venkatesh N. Murthy, Mackenzie Weygandt Mathis, and Mathias Bethge. DeepLabCut: Markerless pose estimation of user-defined body parts with deep learning. Nature Neuroscience, 21:1281--1289, 2018.Google ScholarCross Ref
- Rahil Mehrizi, Xi Peng, Zhiqiang Tang, Xu Xu, Dimitris Metaxas, and Kang Li. Toward marker-free 3D pose estimation in lifting: A deep multi-view solution. In The 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pages 485--491, 2018.Google ScholarCross Ref
- Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, and Christian Theobalt. VNect: Real-time 3D human pose estimation with a single RGB camera. ACM Transactions on Graphics (TOG), 36(4):44:1--44:14, 2017. Google ScholarDigital Library
- Hossein Mousavi Hondori and Maryam Khademi. A review on technical and clinical impact of microsot Kinect on physical therapy and rehabilitation. Journal of medical engineering, 2014, 2014.Google Scholar
- Carlos Palma, Augusto Salazar, and Francisco Vargas. HMM and DTW for evaluation of therapeutical gestures using Kinect. arXiv preprint arXiv:1602.03742, 2016.Google Scholar
- Shreya Pandit, San Tran, Yiwen Gu, Elham Saraee, Frederick Jansen, Saraubh Singh, Shirene Cao, Arezoo Sadeghi, Eugenia Shandelman, Terry Ellis, and Margrit Betke. ExerciseCheck: A scalable platform for remote physical therapy deployed as a hybrid desktop and web application. In Submitted to the 12th International ACM Conference on Pervasive Technologies Related to Assistive Environments (PETRA'19), Rhodes, Greece, pages 1--9, 2019. Google ScholarDigital Library
- Elham Saraee and Margrit Betke. Dynamic adjustment of physical exercises based on performance using the proicio robotic arm. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, page 8. ACM, 2016. Google ScholarDigital Library
- Elham Saraee, Kratesh Ramrakhyani, Ashutosh Sanan, Saurabh Singh, and Margrit Betke. The Kinect versus the proficio: Measuring hand position during exercise monitoring. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, page 88. ACM, 2016. Google ScholarDigital Library
- Elham Saraee, Saurabh Singh, Kathryn Hendron, Mingxin Zheng, Ajjen Joshi, Terry Ellis, and Margrit Betke. Exercisecheck: remote monitoring and evaluation platform for home based physical therapy. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, pages 87--90. ACM, 2017. Google ScholarDigital Library
- L Enrique Sucar, Roger Luis, Ron Leder, Jorge Hernández, and Israel Sánchez. Gesture therapy: A vision-based system for upper extremity stroke rehabilitation. In Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE, pages 3690--3693. IEEE, 2010.Google ScholarCross Ref
- Michail Theofanidis, Alexandros Lioulemes, and Fillia Makedon. A motion and force analysis system for human upper-limb exercises. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, PETRA '16, pages 9:1--9:8. ACM, 2016. Google ScholarDigital Library
- Konstantinos Tsiakas, Manfred Huber, and Fillia Makedon. A multimodal adaptive session manager for physical rehabilitation exercising. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, PETRA '15, pages 33:1--33:8. ACM, 2015. Google ScholarDigital Library
- Ondřej Ťupa, Aleš Procházka, Oldřich Vyšata, Martin Schätz, Jan Mareš, Martin Vališ, and Vladimír Mařík. Motion tracking and gait feature estimation for recognising parkinsonfis disease using ms kinect. Biomedical engineering online, 14(1):97, 2015.Google Scholar
- Janani Venugopalan, Chihwen Cheng, Todd H Stokes, and May D Wang. Kinect-based rehabilitation system for patients with traumatic brain injury. In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pages 4625--4628. IEEE, 2013.Google ScholarCross Ref
- David Webster and Ozkan Celik. Systematic review of Kinect applications in elderly care and stroke rehabilitation. Journal of neuroengineering and rehabilitation, 11(1):108--132, 2014.Google Scholar
- Wenchuan Wei, Yao Lu, Eric Rhoden, and Sujit Dey. User performance evaluation and real-time guidance in cloud-based physical therapy monitoring and guidance system. Multimedia Tools and Applications, pages 1--31, 2017. Google ScholarDigital Library
- Yu-Chian Wu, Te-Yen Wu, Paul Taele, Bryan Wang, Jun-You Liu, Pin-sung Ku, Po-En Lai, and Mike Y Chen. Activeergo: Automatic and personalized ergonomics using self-actuating furniture. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, page 558. ACM, 2018. Google ScholarDigital Library
Index Terms
- ExerciseCheck: data analytics for a remote monitoring and evaluation platform for home-based physical therapy
Recommendations
ExerciseCheck: Remote Monitoring and Evaluation Platform for Home Based Physical Therapy
PETRA '17: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive EnvironmentsA daily exercise program designed by a physical therapist or physician may be crucial for a patient's physical rehabilitation. However, when these exercises are performed at home without the supervision of the therapist, they may not be as effective as ...
ExerciseCheck: a scalable platform for remote physical therapy deployed as a hybrid desktop and web application
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsExerciseCheck is a scalable, accessible platform designed and developed for the remote monitoring and evaluation of physical therapy. Physical rehabilitation is an important aspect of a patient's recovery from injury and often requires the patient to ...
A technology probe of wearable in-home computer-assisted physical therapy
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPhysical therapists could make better treatment decisions if they had accurate patient home exercise data but today this information is only available from patient self-report. A more accurate source of data could be gained from wearable computing ...
Comments