skip to main content
research-article

KneeGuard: A Calibration-free Wearable Monitoring System for Knee Osteoarthritis Gait Re-training via Effortless Wearing

Published: 21 November 2024 Publication History

Abstract

Gait re-training is an effective approach to slow disease progression and alleviate pain in knee osteoarthritis (KOA) patients. Personalized gait re-training strategies, based on knee loading and muscle forces, have shown promise in improving rehabilitation outcomes. Laboratory systems to monitor these metrics are unsuitable for daily use owing to the complicated setup and high-cost. Recently proposed wearable solutions try to fill this gap, but their in-lab calibration requirement still hinders practical usage. This paper introduces KneeGuard, a calibration-free gait re-training monitoring system that can estimate knee loading and muscle forces via effortless wearing. We identify the main issue of current calibration-needed systems is insufficient biomechanical information retrieval and modeling. To address this, we propose a user-friendly wearable prototype incorporating inertial measurement unit (IMU) and surface electromyography (sEMG) to obtain comprehensive biomechanical information including body geometrical changes and muscle contractions. For modeling, we design a biomechanic-inspired fusion framework based on multi-task learning and cross-modality attention to capture inter-modality biomechanical correlations. Additionally, since precise sensor placement required by current sEMG-based solutions is difficult to locate, we develop a circular sEMG array and propose a spatial-aware feature extraction module, achieving effective biomechanical feature extraction under effortless wearing. We collaborate with a medical center and collect a dataset from 21 KOA patients and 17 healthy subjects at different speeds. Notably, our dataset includes six gait types for KOA gait re-training, making it the first gait dataset with comprehensive re-training strategies. Evaluation demonstrates that KneeGuard achieves an average normalized root-mean-square error (NRMSE) of 9.95% in knee loading estimation and an average NRMSE of 8.75% in the estimation of muscle forces, comparable to the with-calibration results in existing works. We have open-sourced the code and a sample dataset in https://github.com/KneeGuard/KneeGuard.

References

[1]
2024. Bertec Split-Belt Treadmill. https://www.bertec.com/products/instrumented-treadmills.
[2]
2024. Qualisys Miqus. https://www.qualisys.com/miqus.
[3]
Zainab Altai, Issam Boukhennoufa, Xiaojun Zhai, Andrew Phillips, Jason Moran, and Bernard XW Liew. 2023. Performance of multiple neural networks in predicting lower limb joint moments using wearable sensors. Frontiers in Bioengineering and Biotechnology 11 (2023), 1215770.
[4]
MJ Booij, R Richards, J Harlaar, and JC van den Noort. 2020. Effect of walking with a modified gait on activation patterns of the knee spanning muscles in people with medial knee osteoarthritis. The Knee 27, 1 (2020), 198--206.
[5]
Melissa A Boswell, Scott D Uhlrich, K Thomas, JA Kolesar, GE Gold, GS Beaupre, SL Delp, et al. 2021. A neural network to predict the knee adduction moment in patients with osteoarthritis using anatomical landmarks obtainable from 2D video analysis. Osteoarthritis and cartilage 29, 3 (2021), 346--356.
[6]
Scott F Brennan, Andrew G Cresswell, Dominic J Farris, and Glen A Lichtwark. 2018. The effect of muscle-tendon unit vs. fascicle analyses on vastus lateralis force-generating capacity during constant power output cycling with variable cadence. Journal of Applied Physiology 124, 4 (2018), 993--1002.
[7]
Thomas S Buchanan, David G Lloyd, Kurt Manal, and Thor F Besier. 2005. Estimation of muscle forces and joint moments using a forward-inverse dynamics model. Medicine & Science in Sports & Exercise 37, 11 (2005), 1911--1916.
[8]
Jonathan Camargo, Dean Molinaro, and Aaron Young. 2022. Predicting biological joint moment during multiple ambulation tasks. Journal of Biomechanics 134 (2022), 111020.
[9]
Jonathan Camargo, Aditya Ramanathan, Will Flanagan, and Aaron Young. 2021. A comprehensive, open-source dataset of lower limb biomechanics in multiple conditions of stairs, ramps, and level-ground ambulation and transitions. Journal of Biomechanics 119 (2021), 110320.
[10]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7291--7299.
[11]
RTH Cheung, KKW Ho, IPH Au, Winko W An, JHW Zhang, ZYS Chan, K Deluzio, and Michael J Rainbow. 2018. Immediate and short-term effects of gait retraining on the knee joint moments and symptoms in patients with early tibiofemoral joint osteoarthritis: a randomized controlled trial. Osteoarthritis and Cartilage 26, 11 (2018), 1479--1486.
[12]
Aiyong Cui, Huizi Li, Dawei Wang, Junlong Zhong, Yufeng Chen, and Huading Lu. 2020. Global, regional prevalence, incidence and risk factors of knee osteoarthritis in population-based studies. EClinicalMedicine 29 (2020).
[13]
Scott L Delp, Frank C Anderson, Allison S Arnold, Peter Loan, Ayman Habib, Chand T John, Eran Guendelman, and Darryl G Thelen. 2007. OpenSim: open-source software to create and analyze dynamic simulations of movement. IEEE transactions on biomedical engineering 54, 11 (2007), 1940--1950.
[14]
Analog Devices. 2010. AD8646 Rail-to-Rail, Low Power, Single-Supply Amplifiers. https://www.analog.com/media/en/technical-documentation/data-sheets/AD8646.pdf.
[15]
TA Gerbrands, MF Pisters, S Verschueren, and B Vanwanseele. 2023. Determining the optimal gait modification strategy for patients with knee osteoarthritis: Trunk lean or medial thrust? Gait & Posture 102 (2023), 1--9.
[16]
Samaneh Gholami, Giti Torkaman, Fariba Bahrami, and Noushin Bayat. 2022. Gait modification with subject-specific foot progression angle in people with moderate knee osteoarthritis: Investigation of knee adduction moment and muscle activity. The Knee 35 (2022), 124--132.
[17]
Reed D Gurchiek, Nicole Donahue, Niccolo M Fiorentino, and Ryan S McGinnis. 2021. Wearables-only analysis of muscle and joint mechanics: an EMG-driven approach. IEEE Transactions on Biomedical Engineering 69, 2 (2021), 580--589.
[18]
Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015).
[19]
Hermie J Hermens, Bart Freriks, Roberto Merletti, Dick Stegeman, Joleen Blok, Günter Rau, Cathy Disselhorst-Klug, and Göran Hägg. 1999. European recommendations for surface electromyography. Roessingh research and development 8, 2 (1999), 13--54.
[20]
MA Hunt, JM Charlton, NM Krowchuk, CTF Tse, and GL Hatfield. 2018. Clinical and biomechanical changes following a 4-month toe-out gait modification program for people with medial knee osteoarthritis: a randomized controlled trial. Osteoarthritis and cartilage 26, 7 (2018), 903--911.
[21]
Forrest N. Iandola, Song Han, Matthew W. Moskewicz, Khalid Ashraf, William J. Dally, and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. arXiv:1602.07360 (2016).
[22]
InvenSense Inc. 2015. MPU-9250 Product Specification. https://www.invensense.com/wp-content/uploads/2015/02/PS-MPU-9250A-01-v1.1.pdf.
[23]
Texas Instruments. 2015. INA333 Low-Power, Zero-Drift Instrumentation Amplifier. https://www.ti.com/lit/ds/symlink/ina333.pdf.
[24]
Intel®. [n.d.]. Intel® Core™ i5-12500H Processor. [Online]. https://www.intel.com/content/www/us/en/products/sku/96141/intel-core-i512500h-processor-18m-cache-up-to-4-50-ghz/specifications.html.
[25]
Yu Iwama, Kengo Harato, Shu Kobayashi, Yasuo Niki, Naomichi Ogihara, Morio Matsumoto, Masaya Nakamura, and Takeo Nagura. 2021. Estimation of the external knee adduction moment during gait using an inertial measurement unit in patients with knee osteoarthritis. Sensors 21, 4(2021), 1418.
[26]
Hans Kainz, David Graham, Julie Edwards, Henry PJ Walsh, Sheanna Maine, Roslyn N Boyd, David G Lloyd, Luca Modenese, and Christopher P Carty. 2017. Reliability of four models for clinical gait analysis. Gait & posture 54 (2017), 325--331.
[27]
Irfan A Khan, Bruno Bordoni, and Matthew Varacallo. 2023. Anatomy, Bony Pelvis and Lower Limb: Thigh Gracilis Muscle. In StatPearls [Internet]. StatPearls Publishing.
[28]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[29]
Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter. 2017. Self-normalizing neural networks. Advances in neural information processing systems 30 (2017).
[30]
Myunghyun Lee and Sukyung Park. 2020. Estimation of three-dimensional lower limb kinetics data during walking using machine learning from a single IMU attached to the sacrum. Sensors 20, 21 (2020), 6277.
[31]
Hyerim Lim, Bumjoon Kim, and Sukyung Park. 2019. Prediction of lower limb kinetics and kinematics during walking by a single IMU on the lower back using machine learning. Sensors 20, 1 (2019), 130.
[32]
Kun Liu, Yong Liu, Shuo Ji, Chi Gao, and Jun Fu. 2024. Estimation of Muscle Forces of Lower Limbs Based on CNN-LSTM Neural Network and Wearable Sensor System. Sensors 24, 3 (2024), 1032.
[33]
May Q Liu, Frank C Anderson, Michael H Schwartz, and Scott L Delp. 2008. Muscle contributions to support and progression over a range of walking speeds. Journal of biomechanics 41, 15 (2008), 3243--3252.
[34]
Xiaolei Lv, Jinxiang Chai, and Shihong Xia. 2016. Data-driven inverse dynamics for human motion. ACM Transactions on Graphics (TOG) 35, 6(2016), 1--12.
[35]
Lyken17. [n.d.]. THOP: PyTorch-OpCounter. [Online]. https://github.com/Lyken17/pytorch-OpCounter/.
[36]
Ningning Ma, Xiangyu Zhang, Hai-Tao Zheng, and Jian Sun. 2018. Shufflenet v2: Practical guidelines for efficient cnn architecture design. In Proceedings of the European conference on computer vision (ECCV). 116--131.
[37]
Shuhao Ma, Jie Zhang, Chaoyang Shi, Pei Di, Ian D Robertson, and Zhi-Qiang Zhang. 2024. Physics-informed Deep Learning for Muscle Force Prediction with Unlabeled sEMG Signals. IEEE Transactions on Neural Systems and Rehabilitation Engineering (2024).
[38]
Andrzej Maćkiewicz and Waldemar Ratajczak. 1993. Principal components analysis (PCA). Computers & Geosciences 19, 3 (1993), 303--342.
[39]
Emilie Mathieu, Sylvain Crémoux, David Duvivier, David Amarantini, and Philippe Pudlo. 2023. Biomechanical modeling for the estimation of muscle forces: toward a common language in biomechanics, medical engineering, and neurosciences. Journal of NeuroEngineering and Rehabilitation 20, 1 (2023), 130.
[40]
Shima Mohammadi Moghadam, Ted Yeung, and Julie Choisne. 2023. A comparison of machine learning models' accuracy in predicting lower-limb joints' kinematics, kinetics, and muscle forces from wearable sensors. Scientific reports 13, 1 (2023), 5046.
[41]
Evan Mostafa, Steven B Graefe, and Matthew Varacallo. 2023. Anatomy, Bony Pelvis and Lower Limb: Leg Posterior Compartment. In StatPearls [Internet]. StatPearls Publishing.
[42]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
[43]
PJRC. 2019. Teensy 4.0 Technical Specifications. https://www.pjrc.com/store/teensy40.html.
[44]
R Richards, J Van Den Noort, J Dekker, and J Harlaar. 2016. Effects of gait retraining with real-time biofeedback in patients with knee osteoarthritis: systematic review and meta-analysis. Osteoarthritis and Cartilage 24 (2016), S470.
[45]
R Richards, JC Van Den Noort, M Van der Esch, MJ Booij, and J Harlaar. 2018. Gait retraining using real-time feedback in patients with medial knee osteoarthritis: Feasibility and effects of a six-week gait training program. The Knee 25, 5 (2018), 814--824.
[46]
Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4510--4520.
[47]
Leena Sharma. 2021. Osteoarthritis of the knee. New England Journal of Medicine 384, 1 (2021), 51--59.
[48]
Peter B Shull, Yangjian Huang, Taylor Schlotman, and Jeffrey A Reinbolt. 2015. Muscle force modification strategies are not consistent for gait retraining to reduce the knee adduction moment in individuals with knee osteoarthritis. Journal of biomechanics 48, 12 (2015), 3163--3169.
[49]
Ryan Timmins, Stephanie Woodley, Anthony Shield, and David Opar. 2020. Anatomy of the Hamstrings. Prevention and rehabilitation of hamstring injuries (2020), 1--30.
[50]
Hsin-Ruey Tsai, Shih-Yao Wei, Jui-Chun Hsiao, Ting-Wei Chiu, Yi-Ping Lo, Chi-Feng Keng, Yi-Ping Hung, and Jin-Jong Chen. 2016. iKneeBraces: knee adduction moment evaluation measured by motion sensors in gait detection. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 386--391.
[51]
Scott D Uhlrich, Rachel W Jackson, Ajay Seth, Julie A Kolesar, and Scott L Delp. 2022. Muscle coordination retraining inspired by musculoskeletal simulations reduces knee contact force. Scientific reports 12, 1 (2022), 9842.
[52]
Scott D Uhlrich, Julie A Kolesar, Łukasz Kidziński, Melissa A Boswell, Amy Silder, Garry E Gold, Scott L Delp, and Gary S Beaupre. 2022. Personalization improves the biomechanical efficacy of foot progression angle modifications in individuals with medial knee osteoarthritis. Journal of biomechanics 144 (2022), 111312.
[53]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
[54]
Yi Wan, Polly McGuigan, James Bilzon, and Logan Wade. 2023. The effectiveness of a 6-week biofeedback gait retraining programme in people with knee osteoarthritis: protocol for a randomised controlled trial. BMC Musculoskeletal Disorders 24, 1 (2023), 984.
[55]
Chao Wang, Peter PK Chan, Ben MF Lam, Sizhong Wang, Janet H Zhang, Zoe YS Chan, Rosa HM Chan, Kevin KW Ho, and Roy TH Cheung. 2020. Real-time estimation of knee adduction moment for gait retraining in patients with knee osteoarthritis. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28, 4 (2020), 888--894.
[56]
Sizhong Wang, Peter PK Chan, Ben MF Lam, Zoe YS Chan, Janet HW Zhang, Chao Wang, Wing Kai Lam, Kevin Ki Wai Ho, Rosa HM Chan, and Roy TH Cheung. 2021. Sensor-based gait retraining lowers knee adduction moment and improves symptoms in patients with knee osteoarthritis: a randomized controlled trial. Sensors 21, 16 (2021), 5596.
[57]
Huatao Xu, Pengfei Zhou, Rui Tan, Mo Li, and Guobin Shen. 2021. Limu-bert: Unleashing the potential of unlabeled data for imu sensing applications. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 220--233.
[58]
Felix E Zajac. 1989. Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. Critical reviews in biomedical engineering 17, 4 (1989), 359--411.
[59]
Jie Zhang, Yihui Zhao, Fergus Shone, Zhenhong Li, Alejandro F Frangi, Sheng Quan Xie, and Zhi-Qiang Zhang. 2022. Physics-informed deep learning for musculoskeletal modeling: Predicting muscle forces and joint kinematics from surface EMG. IEEE Transactions on Neural Systems and Rehabilitation Engineering 31 (2022), 484--493.
[60]
Longbin Zhang, Davit Soselia, Ruoli Wang, and Elena M Gutierrez-Farewik. 2022. Lower-limb joint torque prediction using LSTM neural networks and transfer learning. IEEE Transactions on Neural Systems and Rehabilitation Engineering 30 (2022), 600--609.
[61]
Bo Zhou, Sungho Suh, Vitor Fortes Rey, Carlos Andres Velez Altamirano, and Paul Lukowicz. 2022. Quali-mat: Evaluating the quality of execution in body-weight exercises with a pressure sensitive sports mat. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--45.

Cited By

View all
  • (2024)Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading ActivitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870358:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCICompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681826(716-719)Online publication date: 11-Nov-2024
  • (2024)GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and LearningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676356(1-17)Online publication date: 13-Oct-2024

Index Terms

  1. KneeGuard: A Calibration-free Wearable Monitoring System for Knee Osteoarthritis Gait Re-training via Effortless Wearing

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 4
      December 2024
      1788 pages
      EISSN:2474-9567
      DOI:10.1145/3705705
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 November 2024
      Published in IMWUT Volume 8, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)192
      • Downloads (Last 6 weeks)84
      Reflects downloads up to 17 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading ActivitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870358:CSCW2(1-25)Online publication date: 8-Nov-2024
      • (2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCICompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681826(716-719)Online publication date: 11-Nov-2024
      • (2024)GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and LearningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676356(1-17)Online publication date: 13-Oct-2024

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media