Skip to main content
SpringerLink
Log in

An RGB-D sensor-based instrument for sitting balance assessment

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Sitting balance is an important aspect of overall motor control, particularly for individuals who are not able to stand. Typical clinical assessment methods for sitting balance rely on human observation, making them subjective, imprecise, and sometimes time-consuming. The primary objective of this study is to develop an improved system for assessing sitting balance in clinical settings. We designed a software tool that takes input from an RGB-D camera system to track human movement during sitting balance assessment. We validated the system by tracking subject’s movements during two seated balance exercises. To assess the accuracy of our system’s measurements, we compared them with measurements taken using a ruler and measurements captured from still images from a video recording. The agreement of body angle measurement was an average of 2.19 ± 2.29 degrees, and agreement of forward reach distance was an average of 0.1 ± 0.25 in.. The results show that our approach can track a person’s body movements with clinically relevant accuracy, suggesting that this RGB-D camera-based system could offer advantages over existing observational methods of sitting balance assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Abobakr A, Nahavandi D, Iskander J, Hossny M, Nahavandi S, Smets M (2017) A kinect-based workplace postural analysis system using deep residual networks. In: Systems engineering symposium (ISSE), 2017 IEEE international. IEEE, pp 1-6

  2. Abou L, de Freitas GR, Palandi J, Ilha J (2018) Clinical instruments for measuring unsupported sitting balance in subjects with spinal cord injury: a systematic review. Top Spinal Cord Inj Rehabil 24(2):177–193. https://doi.org/10.1310/sci17-00027

    Article  Google Scholar 

  3. Abreu J et al (2017) Assessment of microsoft kinect in the monitoring and rehabilitation of stroke patients. In: Rocha Á, Correia A, Adeli H, Reis L, Costanzo S (eds) Recent Advances in Information Systems and Technologies. WorldCIST 2017. Advances in intelligent systems and computing, vol 570. Springer, Cham

  4. Arora T, Oates A, Lynd K, Musselman KE (2020) Current state of balance assessment during transferring, sitting, standing and walking activities for the spinal cord injured population: a systematic review. J Spinal Cord Med 43(1):10–23. https://doi.org/10.1080/10790268.2018.1481692

    Article  Google Scholar 

  5. Asaeda M, Kuwahara W, Fujita N, Yamasaki T, Adachi N (2018) Validity of motion analysis using the Kinect system to evaluate single leg stance in patients with hip disorders. Gait Posture 62:458–462

    Google Scholar 

  6. Ayed I, Ghazel A, Jaume-i-Capó A, Moya-Alcover G, Varona J, Martínez-Bueso P (2018) Feasibility of Kinect-based games for balance rehabilitation: a case study. J Healthc Eng 2018:7574860

    Google Scholar 

  7. Bakhti KKA, Laffont I, Muthalib M, Froger J, Mottet D (2018) Kinect-based assessment of proximal arm non-use after a stroke. J NeuroEng Rehabil 15(1):104

    Google Scholar 

  8. Bartlett KA, Forth KE, Layne CS, Madansingh S (2019) Validating a low-cost, consumer force-measuring platform as an accessible alternative for measuring postural sway. J Biomech 90:138–142. https://doi.org/10.1016/j.jbiomech.2019.04.039

    Article  Google Scholar 

  9. Beaulieu-Boire L, Belzile-Lachapelle S, Blanchette A, Desmarais PO, Lamontagne-Montminy L, Tremblay C, Tousignant M (2015) Balance rehabilitation using Xbox Kinect among an elderly population: a pilot study. J Nov Physiother 5(02):261

    Google Scholar 

  10. Berg K, Wood-Dauphine S, Williams JI, Gayton D (1989) Measuring balance in the elderly: preliminary development of an instrument. Physiother Can 41(6):304–311

    Google Scholar 

  11. Birnbaum M, Hill K, Kinsella R, Black S, Clark R, Brock K (2018) Comprehensive clinical sitting balance measures for individuals following stroke: a systematic review on the methodological quality. Disabil Rehabil 40(6):616–630. https://doi.org/10.1080/09638288.2016.1261947

    Article  Google Scholar 

  12. Bland JM, Altman D (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 327(8476):307–310

    Google Scholar 

  13. Bo APL, Hayashibe M, Poignet P (2011) Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect. In: Engineering in medicine and biology society, EMBC, 2011 annual international conference of the IEEE. IEEE, pp 3479-3483

  14. Botner EM, Miller WC, Eng JJ (2005) Measurement properties of the activities-specific balance confidence Scale among individuals with stroke. Disabil Rehabil 27(4):156–163

    Google Scholar 

  15. Cai L, Ma Y, Xiong S, Zhang Y (2019) Validity and reliability of upper limb functional assessment using the Microsoft Kinect V2 sensor. Appl Bionics Biomech 2019:7175240–7175214

    Google Scholar 

  16. Chang YJ, Chen SF, Huang JD (2011) A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Res Dev Disabil 32(6):2566–2570

    Google Scholar 

  17. Chen CL, Yeung KT, Bih LI, Wang CH, Chen MI, Chien JC (2003) The relationship between sitting stability and functional performance in patients with paraplegia. Arch Phys Med Rehabil 84(9):1276–1281

    Google Scholar 

  18. Clark RA, Pua YH, Fortin K, Ritchie C, Webster KE, Denehy L, Bryant AL (2012) Validity of the Microsoft Kinect for assessment of postural control. Gait Posture 36(3):372–377

    Google Scholar 

  19. Clark RA, Vernon S, Mentiplay BF, Miller KJ, McGinley JL, Pua YH, Paterson K, Bower KJ (2015a) Instrumenting gait assessment using the Kinect in people living with stroke: reliability and association with balance tests. J Neuroeng Rehabil 12(1):15

    Google Scholar 

  20. Clark RA, Pua YH, Oliveira CC, Bower KJ, Thilarajah S, McGaw R, Hasanki K, Mentiplay BF (2015b) Reliability and concurrent validity of the Microsoft Xbox one Kinect for assessment of standing balance and postural control. Gait Posture 42(2):210–213

    Google Scholar 

  21. Dehbandi B, Barachant A, Smeragliuolo AH, Long JD, Bumanlag SJ, He V, Lampe A, Putrino D (2017) Using data from the Microsoft Kinect 2 to determine postural stability in healthy subjects: a feasibility trial. PLoS ONE 12(2):e0170890

    Google Scholar 

  22. Diego-Mas JA, Alcaide-Marzal J (2014) Using Kinect™ sensor in observational methods for assessing postures at work. Appl Ergon 45(4):976–985

    Google Scholar 

  23. Duffy P, Smeaton AF (2013) Measuring the effectiveness of user interventions in improving the seated posture of computer users. In: International joint conference on ambient intelligence. Springer, Cham, pp 3–12

  24. Dutta T (2012) Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. Appl Ergon 43(4):645–649

    Google Scholar 

  25. Eltoukhy M, Kuenze C, Oh J, Wooten S, Signorile J (2017) Kinect-based assessment of lower limb kinematics and dynamic postural control during the star excursion balance test. Gait Posture 58:421–427

    Google Scholar 

  26. Ferreira RN, Ribeiro NF, Santos CP (2022) Fall risk assessment using wearable sensors: a narrative review. Sensors 22(3):984. https://doi.org/10.3390/s22030984

    Article  Google Scholar 

  27. Galna B, Barry G, Jackson D, Mhiripiri D, Olivier P, Rochester L (2014) Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson’s disease. Gait Posture 39(4):1062–1068

    Google Scholar 

  28. Ganz DA, Higashi T, Rubenstein LZ (2005) Monitoring falls in cohort studies of community-dwelling older people: effect of the recall interval. J Am Geriatr Soc 53(12):2190–2194. https://doi.org/10.1111/j.1532-5415.2005.00509.x

    Article  Google Scholar 

  29. Grooten WJA, Sandberg L, Ressman J, Diamantoglou N, Johansson E, Rasmussen-Barr E (2018) Reliability and validity of a novel Kinect-based software program for measuring posture, balance and side-bending. BMC Musculoskelet Disord 19(1):6

    Google Scholar 

  30. Hondori HM, Khademi M (2014) A review on technical and clinical impact of Microsoft Kinect on physical therapy and rehabilitation. J Med Eng, 2014

  31. Hsiao M-Y, Li C-M, Lu I-S, Lin Y-H, Wang T-G, Han D-S (2018) An investigation of the use of the Kinect system as a measure of dynamic balance and forward reach in the elderly. Clin Rehabil 32(4):473–482

    Google Scholar 

  32. Johnson L, Fry A, Dehbandi B, Rubin L, Halem M, Barachant A, Smeragliuolo AH, Putrino D (2019) An automated, electronic assessment tool can accurately classify older adult postural stability. J Biomech 93:6–10

    Google Scholar 

  33. Jung S, Song S, Lee D, Lee K, Lee G (2020) Effects of Kinect video game training on lower extremity motor function, balance, and gait in adolescents with spastic Diplegia cerebral palsy: a pilot randomized controlled trial. Dev Neurorehabil 1–7

  34. Kitsunezaki N, Adachi E, Masuda T, Mizusawa JI (2013) KINECT applications for the physical rehabilitation. In: Medical measurements and applications proceedings (MeMeA), 2013 IEEE international symposium on. IEEE, pp 294-299

  35. Kloos AD, Kegelmeyer DA, Young GS, Kostyk SK (2010) Fall risk assessment using the Tinetti mobility test in individuals with Huntington’s disease. Mov Disord 25(16):2838–2844

    Google Scholar 

  36. Latorre J, Colomer C, Alcañiz M, Llorens R (2019) Gait analysis with the Kinect v2: normative study with healthy individuals and comprehensive study of its sensitivity, validity, and reliability in individuals with stroke. J NeuroEng Rehabil 16(1):97

    Google Scholar 

  37. Lim D, Kim C, Jung H, Jung D, Chun KJ (2015) Use of the Microsoft Kinect system to characterize balance ability during balance training. Clin Interv Aging 10:1077

    Google Scholar 

  38. Lloréns R, Gil-Gómez JA, Alcañiz M, Colomer C, Noé E (2015) Improvement in balance using a virtual reality-based stepping exercise: a randomized controlled trial involving individuals with chronic stroke. Clin Rehabil 29(3):261–268

    Google Scholar 

  39. Ma M, Proffitt R, Skubic M (2018) Validation of a Kinect V2 based rehabilitation game. PLoS ONE 13(8):e0202338

    Google Scholar 

  40. Manghisi VM, Uva AE, Fiorentino M, Bevilacqua V, Trotta GF, Monno G (2017) Real time RULA assessment using Kinect v2 sensor. Appl Ergon 65:481–491

    Google Scholar 

  41. Martin CC, Burkert DC, Choi KR, Wieczorek NB, McGregor PM, Herrmann RA, Beling PA (2012) A real-time ergonomic monitoring system using the Microsoft Kinect. In: Systems and information design symposium (SIEDS), 2012 IEEE. IEEE, pp 50-55

  42. Maudsley-Barton S, Hoon Yap M, Bukowski A, Mills R, McPhee J (2020) A new process to measure postural sway using a Kinect depth camera during a Sensory Organisation Test. Plos one 15(2):e0227485

  43. Medley A, Thompson M (2011) Development, reliability, and validity of the sitting balance Scale. Physiother Theory Pract 27(7):471–481

    Google Scholar 

  44. Mentiplay BF, Hasanki K, Perraton LG, Pua Y-H, Charlton PC, Clark RA (2018) Three-dimensional assessment of squats and drop jumps using the Microsoft Xbox one Kinect: reliability and validity. J Sports Sci 36(19):2202–2209

    Google Scholar 

  45. Mishra AK, Skubic M, Willis BW, Guess T, Razu SS, Abbott C, Gray AD (2017) Examining methods to estimate static body sway from the Kinect V2. 0 skeletal data: implications for clinical rehabilitation. In: Proceedings of the 11th EAI international conference on pervasive computing Technologies for Healthcare. ACM, pp 127-135

  46. Phommahavong S, Haas D, Yu J, Krüger-Ziolek S, Möller K, Kretschmer J (2015) Evaluating the microsoft kinect skeleton joint tracking as a tool for home-based physiotherapy. Curr Dir Biomed Eng 1(1):184–187

    Google Scholar 

  47. Plantard P, Shum HP, Le Pierres AS, Multon F (2017) Validation of an ergonomic assessment method using Kinect data in real workplace conditions. Appl Ergon 65:562–569

    Google Scholar 

  48. Reither LR, Foreman MH, Migotsky N, Haddix C, Engsberg JR (2018) Upper extremity movement reliability and validity of the Kinect version 2. Disabil Rehabil Assist Technol 13(1):54–59

    Google Scholar 

  49. Sápi M, Domján A, Kiss AK, Pintér S (2019) Is Kinect training superior to conventional balance training for healthy older adults to improve postural control? Games Health 8(1):41–48

    Google Scholar 

  50. Sheehy L, Taillon-Hobson A, Sveistrup H, Bilodeau M, Yang C, Finestone H (2020) Sitting balance exercise performed using virtual reality training on a stroke rehabilitation inpatient service: a randomized controlled study. PM&R 12(8):754–765

    Google Scholar 

  51. Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A (2011) Real-time human pose recognition in parts from single depth images. In: Computer vision and pattern recognition (CVPR), 2011 IEEE conference on. IEEE, pp 1297-1304

  52. Simonsen D, Spaich EG, Andersen OK (2017) Microsoft Kinect-based system for automatic evaluation of the modified Jebsen test of hand function. In: Converging clinical and engineering research on neurorehabilitation II. Springer, Cham, pp 1299–1303

  53. Springer BA, Marin R, Cyhan T, Roberts H, Gill NW (2007) Normative values for the unipedal stance test with eyes open and closed. J Geriatr Phys Ther 30(1):8–15

    Google Scholar 

  54. Tao G, Archambault PS, Levin MF (2013) Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis. In: Virtual rehabilitation (ICVR), 2013 international conference on. IEEE, pp 164-165

  55. Usmani S, Saboor A, Haris M, Khan MA, Park H (2021) Latest research trends in fall detection and prevention using machine learning: a systematic review. Sensors 21(15):5134. https://doi.org/10.3390/s21155134

    Article  Google Scholar 

  56. Van Diest M, Lamoth CJ, Stegenga J, Verkerke GJ, Postema K (2013) Exergaming for balance training of elderly: state of the art and future developments. J Neuroeng Rehabil 10(1):101

    Google Scholar 

  57. Vernadakis N, Derri V, Tsitskari E, Antoniou P (2014) The effect of Xbox Kinect intervention on balance ability for previously injured young competitive male athletes: a preliminary study. Phys Ther Sport 15(3):148–155

    Google Scholar 

  58. Wadhwa G, Aikat R (2016) Development, validity and reliability of the ‘sitting balance measure’(SBM) in spinal cord injury. Spinal Cord 54(4):319–323

    Google Scholar 

  59. Watson PF, Petrie A (2010) Method agreement analysis: a review of correct methodology. Theriogenology 73(9):1167–1179

    Google Scholar 

  60. Webster D, Celik O (2014) Systematic review of Kinect applications in elderly care and stroke rehabilitation. J Neuroeng Rehabil 11(1):108

    Google Scholar 

  61. Wochatz M, Tilgner N, Mueller S, Rabe S, Eichler S, John M, Völler H, Mayer F (2019) Reliability and validity of the Kinect V2 for the assessment of lower extremity rehabilitation exercises. Gait Posture 70:330–335

    Google Scholar 

  62. Xu X, McGorry RW (2015) The validity of the first and second generation Microsoft Kinect™ for identifying joint center locations during static postures. Appl Ergon 49:47–54

    Google Scholar 

  63. Yang Y, Pu F, Li Y, Li S, Fan Y, Li D (2014) Reliability and validity of Kinect RGB-D sensor for assessing standing balance. IEEE Sensors J 14(5):1633–1638

    Google Scholar 

  64. Yang CM, Chen Hsieh JS, Chen YC, Yang SY, Lin HK (2020) Effects of Kinect exergames on balance training among community older adults: a randomized controlled trial. Medicine 99(28):e21228

    Google Scholar 

  65. Yeung LF, Cheng KC, Fong CH, Lee WC, Tong KY (2014) Evaluation of the Microsoft Kinect as a clinical assessment tool of body sway. Gait Posture 40(4):532–538

    Google Scholar 

  66. Zaki R, Bulgiba A, Ismail R, Ismail NA (2012) Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: a systematic review. PLoS ONE 7(5):e37908

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Jeff Feng for encouraging us to finally publish our work.

Author information

Authors and Affiliations

  1. School of Engineering Technology, Purdue University, West Lafayette, IN, USA

    Kristin A. Bartlett & Jorge D. Camba

Authors
  1. Kristin A. Bartlett
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jorge D. Camba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jorge D. Camba.

Ethics declarations

Competing interests

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bartlett, K.A., Camba, J.D. An RGB-D sensor-based instrument for sitting balance assessment. Multimed Tools Appl 82, 27245–27268 (2023). https://doi.org/10.1007/s11042-023-14518-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14518-7

Keywords

Search

Navigation