Skip to main content
Log in

Intra-protocol repeatability and inter-protocol agreement for the analysis of scapulo-humeral coordination

  • Special Issue - Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Multi-center clinical trials incorporating shoulder kinematics are currently uncommon. The absence of repeatability and limits of agreement (LoA) studies between different centers employing different motion analysis protocols has led to a lack dataset compatibility. Therefore, the aim of this work was to determine the repeatability and LoA between two shoulder kinematic protocols. The first one uses a scapula tracker (ST), the International Society of Biomechanics anatomical frames and an optoelectronic measurement system, and the second uses a spine tracker, the INAIL Shoulder and Elbow Outpatient protocol (ISEO) and an inertial and magnetic measurement system. First within-protocol repeatability for each approach was assessed on a group of 23 healthy subjects and compared with the literature. Then, the between-protocol agreement was evaluated. The within-protocol repeatability was similar for the ST (\(\overline{\text{RMSE}}\) = 2.35°, \(\sigma_{\text{RMSE}}\) = 0.97°, SEM = 2.5°) and ISEO (\(\overline{\text{RMSE}}\) = 2.24°, \(\sigma_{\text{RMSE}}\) = 0.97°, SEM = 2.3°) protocols and comparable with data from published literature. The between-protocol agreement analysis showed comparable scapula medio-lateral rotation measurements for up to 120° of flexion-extension and up to 100° of scapula plane ab-adduction. Scapula protraction–retraction measurements were in agreement for a smaller range of humeral elevation. The results of this study suggest comparable repeatability for the ST and ISEO protocols and between-protocol agreement for two scapula rotations. Different thresholds for repeatability and LoA may be adapted to suit different clinical hypotheses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Abbreviations

IMMS:

Inertial and magnetic measurement system

ISEO:

Spine tracker

ST:

Scapula tracker

AB-AD:

Ab-adduction of the humerus in the scapular plane

FL-EX:

Flexion–extension of the humerus in the sagittal plane

ME-LA:

Medio-lateral rotation of the scapula

P-A:

Posterior–anterior tilt of the scapula

PR-RE:

Pro-retraction of the scapula

h :

Humeral elevation angle

Between :

Between protocols, i.e., between ST and ISEO

Within :

Within each protocol, i.e., within ST or within ISEO

CR:

Coefficient of repeatability

LoA:

Limits of agreement

RMSE:

Root mean square error

\(\overline{\text{RMSE}}\) :

Mean RMSE

σ RMSE :

Standard deviation of RMSE

SEM:

Standard error of measurement

SD:

Standard deviation

References

  1. Bartlett JW, Frost C (2008) Reliability, repeatability and reproducibility: analysis of measurement errors in continuous variables. Ultrasound Obstet Gynecol 31:466–475

    Article  CAS  PubMed  Google Scholar 

  2. Bland JM, Altman DG (2003) Applying the right statistics: analyses of measurement studies. Ultrasound Obstet Gynecol 22:85–93

    Article  CAS  PubMed  Google Scholar 

  3. Cutti AG, Giovanardi A, Rocchi L, Davalli A, Sacchetti R (2008) Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors. Med Bio Eng Comput 46(2):169–178

    Article  Google Scholar 

  4. De Baets L, Jaspers E, Desloovere K, Van Deun S (2012) A systematic review of 3D scapular kinematics and muscle activity during elevation in stroke subjects and controls. J Electromyogr Kinesiol. doi:10.1016/j.jelekin.2012.06.007

  5. de Vries WH, Veeger HE, Cutti AG, Baten C, van der Helm FC (2010) Functionally interpretable local coordinate systems for the upper extremity using inertial and magnetic measurement systems. J Biomech 43(10):1983–1988

    Article  PubMed  Google Scholar 

  6. Ebaugh DD, McClure PW, Karduna AR (2005) Three-dimensional scapulothoracic motion during active and passive arm elevation. Clin Biomech 20(7):700–709

    Article  Google Scholar 

  7. Fayad F, Roby-Brami A, Yazbeck C, Hanneton S, Lefevre-Colau MM, Gautheron V, Poiraudeau S, Revel M (2008) Three-dimensional scapular kinematics and scapulohumeral rhythm in patients with glenohumeral osteoarthritis or frozen shoulder. J Biomech 41(2):326–332

    Article  PubMed  Google Scholar 

  8. Karduna AR, McClure PW, Michener LA, Sennett B (2001) Dynamic measurement of three-dimensional scapular kinematics: a validation study. J Biomech Eng 123(2):184–190

    Article  CAS  PubMed  Google Scholar 

  9. Kontaxis A, Johnson GR (2008) Adaptation of scapula lateral rotation after reverse anatomy shoulder replacement. Comput Methods Biomech Biomed Engin 11(1):73–80

    Article  PubMed  Google Scholar 

  10. Kontaxis A, Cutti AG, Johnson GR, Veeger HE (2009) A framework for the definition of standardized protocols for measuring upper-extremity kinematics. Clin Biomech (Bristol, Avon) 24(3):246–253

    Article  CAS  Google Scholar 

  11. Lovern B, Stroud LA, Evans RO et al (2009) Dynamic tracking of the scapula using skin-mounted markers. Proc Inst Mech Eng H 223(7):823–831

    Article  CAS  PubMed  Google Scholar 

  12. Ludewig PM, Cook TM (2000) Alterations in shoulder kinematics and associated muscle activity in people with symptoms of shoulder impingement. Phys Ther 80(3):276–291

    CAS  PubMed  Google Scholar 

  13. Ludewig PM, Phadke V, Braman JP, Hassett DR, Cieminski CJ, LaPrade RF (2009) Motion of the shoulder complex during multiplanar humeral elevation. J Bone Joint Surg Am 91(2):378–389

    Article  PubMed Central  PubMed  Google Scholar 

  14. McClure PW, Michener LA, Sennett BJ, Karduna AR (2001) Direct 3-dimensional measurement of scapular kinematics during dynamic movements in vivo. J Shoulder Elbow Surg 10(3):269–277

    Article  CAS  PubMed  Google Scholar 

  15. Mell AG, LaScalza S, Guffey P, Ray J, Maciejewski M, Carpenter JE, Hughes RE (2005) Effect of rotator cuff pathology on shoulder rhythm. J Shoulder Elbow Surg 14(1 Suppl S):58S–64S

    Article  PubMed  Google Scholar 

  16. Meskers CG, van de Sande MA, de Groot JH (2007) Comparison between tripod and skin-fixed recording of scapular motion. J Biomech 40(4):941–946

    Article  PubMed  Google Scholar 

  17. Parel I, Cutti AG, Fiumana G, Porcellini G, Verni G, Accardo AP (2012) Ambulatory measurement of the scapulohumeral rhythm: intra- and inter-operator agreement of a protocol based on inertial and magnetic sensors. Gait Posture 35(4):636–640

    Article  CAS  PubMed  Google Scholar 

  18. Prinold JAI, Shaheen AF, Bull AMJ (2011) Skin-fixed scapula trackers: a comparison of two dynamic methods across a range of calibration positions. J Biomech 44(10):2004–2007

    Article  PubMed  Google Scholar 

  19. Schwartz MH, Rozulmalski A (2005) A new method for estimating joint parameters from motion data. J Biomech 38(1):107–116

    Article  PubMed  Google Scholar 

  20. Shaheen AF, Alexander CM, Bull AMJ (2011) Effects of attachment position and shoulder orientation during calibration on the accuracy of the acromial tracker. J Biomech 44:1410–1413

    Article  CAS  PubMed  Google Scholar 

  21. Thigpen CA, Gross MT, Karas SG (2005) The repeatability of scapular rotations across three planes of humeral elevation. Res Sports Med 13(3):181–198

    Article  PubMed  Google Scholar 

  22. van Andel C, van Hutten K, Eversdijk M, Veeger D, Harlaar J (2009) Recording scapular motion using an acromion marker cluster. Gait Posture 29(1):123–128

    Article  PubMed  Google Scholar 

  23. van del Helm FC (1997) A standardized protocol for motion recordings of the shoulder. In: Proceedings of the First Conference of the ISG, ISBN90-423-0008-6 by Shaker Publishing B.V., pp 7–12

  24. Veeger HE (2000) The position of the rotation center of the glenohumeral joint. J Biomech 33(12):1711–1715

    Article  CAS  PubMed  Google Scholar 

  25. Vermeulen HM, Stokdijk M, Eilers PH, Meskers CG, Rozing PM, Vliet Vlieland TP (2002) Measurement of three dimensional shoulder movement patterns with an electromagnetic tracking device in patients with a frozen shoulder. Ann Rheum Dis 61(2):115–120

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  26. Weir JP (2005) Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res 19(1):231–240

    PubMed  Google Scholar 

  27. Wu G, van der Helm FC, Veeger HE, Makhsous M, Van Roy P, Anglin C, Nagels J, Karduna AR, McQuade K, Wang X, Werner FW, Buchholz B (2005) ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion–Part II: shoulder, elbow, wrist and hand. J Biomech 38(5):981–992

    Article  CAS  PubMed  Google Scholar 

  28. Bland M (2000) An introduction to medical statistics, 3rd Ed, Oxford University Press, New York, p 273

    Google Scholar 

  29. Yano Y, Hamada J, Tamai K, Yoshizaki K, Sahara R, Fujiwara T, Nohara Y (2010) Different scapular kinematics in healthy subjects during arm elevation and lowering: glenohumeral and scapulothoracic patterns. J Shoulder Elbow Surg 19(2):209–215

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to I. Parel.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOC 93 kb)

Appendix

Appendix

In order to compare our findings of repeatability of each method to those in the literature it was necessary to compute the mean and standard deviation of RMSE (of Eq. 1) as well as the SEM.

  1. i)

    The mean and standard deviation (SD) of the dataset are computed by polling together the scapula \({\text{RMSE}}_{\text{within - protocol}}^{h}\) (Eq. 1) of all humerus elevation angles [21]:

    $$\overline{\text{RMSE}} = \frac{{\sum\nolimits_{h = 1}^{11} {{\text{RMSE}}_{\text{within - protocol}}^{h} } }}{11}$$
    $$\sigma_{\text{RMSE}} = {\text{SD}}({\text{RMSE}}_{\text{within - protocol}}^{1} , \ldots ,{\text{RMSE}}_{\text{within - protocol}}^{11} )$$
  2. ii)

    the SEM for the scapula kinematics is [22]:

    $${\text{SEM}}\; = \;\sqrt {{\text{MS}}_{W} }$$

    where MSW is the sum of squares due to the within-subject variability, computed from one-way repeated measures ANOVA [14, 26]

CR is related to SEM [1] by the formula:

$${\text{SEM }} = {\text{ CR}}/( 1. 9 6*\surd 2)$$

This relationship was used to convert values of SEM that was published by van Andel [22] to CRwithin and compare the results of the within-protocol repeatability of this study with the literature.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Parel, I., Cutti, A.G., Kraszewski, A. et al. Intra-protocol repeatability and inter-protocol agreement for the analysis of scapulo-humeral coordination. Med Biol Eng Comput 52, 271–282 (2014). https://doi.org/10.1007/s11517-013-1121-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-013-1121-y

Keywords

Navigation