Research article | Open | Open Peer Review | Published:
Range of shoulder motion in patients with adhesive capsulitis; Intra-tester reproducibility is acceptable for group comparisons
BMC Musculoskeletal Disordersvolume 9, Article number: 49 (2008)
Measurements of range of motion play a key role in shoulder research. The purpose of this study is to investigate intra-observer reproducibility of measurements of active and passive range of motion in patients with adhesive capsulitis.
The study was carried out in a population consisting of 32 patients with clinical signs of adhesive capsulitis. A specified measurement protocol was used, and range of motion in affected and non-affected shoulders was measured twice for each patient with a one-week interval.
For most of the investigated individual movements, test-retest differences in range of motion score of more than approximately 15° are not likely to occur as a result of measurement error only. Point-estimates for the intraclass correlation coefficient ranged from 0.61 to 0.93.
Range of motion of patients with adhesive capsulitis can be measured with acceptable reproducibility in settings where groups are compared. Scores for individual patients should be interpreted with caution.
During the last few decades, increased focus has been placed on evidence-based medicine in the orthopedic disciplines. This development has made it essential to utilize instruments and methods that can detect clinically relevant changes. In shoulder research, measurements of range of motion (ROM) have been used as outcome measures in the vast majority of reported trials .
Shoulder ROM measurements can be divided into methods where passive or active movements are measured. In short, shoulder passive ROM is a measure of how far the observer can move the arm of the patient, while shoulder active ROM is a measure of how far the patient can move the arm himself.
The choice of an evaluative method is based on many considerations. What is crucial is high reproducibility, indicating little variation between measurements of the same quantity for the same individual. Measurement errors of shoulder ROM have been reported in several studies. Acceptable reproducibility of passive shoulder ROM measurements was reported in a study by Clarke et al. in 1974 , investigating healthy volunteers with a gravity-dependent goniometer. More recently, other researchers [3, 4] have reported larger measurement errors when actual shoulder patients have been included. In one study , inter-observer differences between single observations of less than 20–25 degrees could not be distinguished from measurement error even with a well-adapted method. Such findings indicate that measurement errors for passive ROM are so large that important "true" changes may be misinterpreted. It has been argued that passive ROM is more difficult to measure reliably than active ROM . Regarding shoulder measurements, however, there is limited evidence that measurement errors for active ROM are any smaller than for passive ROM.
Estimates of reproducibility of active ROM vary considerably. Some researchers investigating measurement errors for active ROM in shoulder patients have reported absolute measurement errors that are comparable to , or somewhat larger than [7, 8], the results mentioned above [3, 4] for PROM. Another group reported much larger measurement errors than this . The conflicting results indicate that differences in procedures, study design or investigated population may have a large impact on reproducibility estimates. Gajdosik and Bohannon stated in a review article in 1987: "...results suggest a tremendous need for studies of the reliability of measuring ROM among the different patient types..." . This statement may still be true today.
Adhesive capsulitis is a common cause of shoulder pain, estimated to affect 2% in the normal population . It is characterized by a usually spontaneous onset of shoulder pain accompanied by progressive restriction in active and passive ROM of the glenohumeral joint. The objective of this study is to estimate intra-observer reproducibility of ROM measurements in affected and non-affected shoulders of such patients.
As part of preparing for a randomized clinical trial (RCT) investigating patients with adhesive capsulitis, we developed a specific protocol for measuring range of motion in the shoulder. The reproducibility of these measurements was studied within the framework of the RCT project. The regional ethics committee granted ethical approval. The procedures followed protocol and complied with the Helsinki Declaration as revised in 1983 and current national ethical standards for such studies.
Patients referred to the Ullevål University Hospital's Department of Physical Medicine and Rehabilitation in the time period August 2004 – June 2005 were considered for the study. Patients were assessed for eligibility according to the following criteria (same as for the RCT):
Limitation of passive movement in the glenohumeral joint compared with the unaffected side, more than 30 degrees for at least two of these three movements: forward flexion, abduction or external rotation. Patients with previous adhesive capsulitis in the opposite shoulder were accepted even if the differences between sides were somewhat smaller than 30 degrees. Patients were not eligible if they could not comply with passive range of motion measurement procedures due to e.g. excessive pain during measurements or huge difficulties in relaxing sufficiently to allow the investigator to make adequate recordings.
Pain in predominantly one shoulder lasting for more than 3 months, less than 2 years.
Willingness and ability to fill out shoulder self-report form.
Patients were included after informed consent unless they met any of the following criteria (same as for the RCT):
Diabetes mellitus (DM).
Trauma to the shoulder the last six months that required hospital care.
Serious mental illness.
Age under 18 or over 70.
Various contraindications to injections: allergy to injection material, blood coagulation disorders.
Patients with cancer and patients not expected to be able to follow treatment or follow-up protocol for practical or other reasons.
Patients currently taking corticosteroid tablets.
Reduction of glenohumeral range of motion for reasons other than "classic" adhesive capsulitis, e.g. X-ray signs of glenohumeral arthritis, dislocation or full-thickness rotator cuff tears with displacement of the humeral head.
Thirty-two patients were included. Nineteen participants (59%) were female, and mean age was 50 years (SD 6). Mean duration of the current episode was seven months (SD 4), and six of the patients had a history of frozen shoulder in the contralateral shoulder. Mean score of the Shoulder Pain and Disability Index (SPADI) [11, 12] was 63 (0 is best, 100 is worst possible score). Mean restriction of glenohumeral passive ROM of the affected side compared to the non-affected side was approximately 60° for external rotation and approximately 45° for abduction, flexion and internal rotation.
Several methods for shoulder ROM measurements have been proposed, using instruments that range from visual estimation [9, 13–15] to still photography , goniometers [2, 4, 7, 9, 15–20] or advanced three-dimensional tracking systems . We employed a gravity-dependent goniometer, also called an inclinometer (Cybex Electronic Digital Inclinometer, EDI 320 from Cybex Inc, Ronkonkoma, NY). Gravity-dependent goniometers have been used in recent clinical trials [22–25] investigating patients with adhesive capsulitis. They have also been tested in previous shoulder ROM reproducibility investigations [2, 3, 7, 8, 26–29]. These instruments are relatively inexpensive and easy to use. This particular instrument has a portable display and a hand-held unit. The display shows the change in position when the hand-held unit is rotated in the vertical plane. In order to produce a solid base for the hand-held unit for determining the different positions, we used a plastic plate with wraps that were easily attached to the patients' arms (Figure 1).
When the measurement protocol was worked out, we selected a strategy in which previously reported ways of measuring were employed to a maximum degree. Unfortunately, studies often do not give specific details on how measurements were made . Furthermore, some methods reported in other studies were not suited for our study population. The measurement protocol is a mixture of previous recommendations, and to some extent, our own clinical experience. The protocol involved measuring the range of passive and active motion of four different movements of the shoulder.
1. Abduction in the coronal plane
Passive abduction (P. ABD): The patient is standing. The plate is placed along the humeral shaft, laterally on the mid-section of the upper arm, and attached with the plate perpendicular to the abduction movement. The patient is instructed to relax. His elbow is held at 90° with the lower arm pointing forward under the entire movement. His upper arm is held parallel to the longitudinal axis of the body when determining the starting position. The physician stabilizes the patient's scapula with fingers holding the inferior angle. With the other arm, the physician then moves the arm carefully (Figure 2). The movement is stopped when resistance is met and the fingers holding the inferior angle of the scapula sense that the scapula is starting to move. At this end-point, the observer stabilizes the patient's arm and reads the inclinometer (Figure 3).
2. Flexion in the sagittal plane
Passive flexion (P. FLE): The patient stands upright with his palms facing medially. The plate is placed along the biceps muscle, perpendicular to the flexion movement. The physician holds the arm parallel to the body's longitudinal axis, and instructs the patient to relax. The starting position is determined, and the inferior angle of scapula is stabilized as for P. ABD. The physician then moves the arm in the sagittal plane with minimum rotation of the arm. The end-point is determined and measured as for P. ABD.
3. External rotation at 45 degrees of abduction
Passive external rotation (P. EXT): The patient is lying down. The plate is placed along the distal, medial part of the ulnar and radial shafts. The patient's upper arm is held at about 45 degrees of abduction (allowing for necessary movement of the scapula in order to reach this position). The elbow is held at 90° with the lower arm vertical in the starting position. The physician stabilizes the acromion during the movement while the patient's arm is slowly rotated to the end-point (Figure 4). The plate is held perpendicular to the movement. The end-point is determined at the point where resistance to the movement is felt and before the acromion begins to move. The arm is stabilized and the inclinometer is read (Figure 5).
4. Internal rotation at 45 degrees of abduction
Passive internal rotation (P. INT): The starting position is the same as for P. EXT, except that the plastic plate is attached to the lateral side of the lower arm. The arm is rotated internally. The rotation is stopped when resistance is met, and before the acromion begins to move. The arm is stabilized and the inclinometer read.
The corresponding measures of active ROM (A. ABD/A. FLE/A. EXT/A. INT) were made using similar patient starting positions as for the passive movements. The patient was instructed to move the arm as far as possible in the requested direction with minimal additional movement (change of wrist/elbow position, undue rotation, change in body posture and similar efforts). Scapular/clavicular movement was not restricted by the observer with these movements. When the inclinometer was read at the end-point, the plastic plate was held perpendicular to the movement. ROM was not measured during symmetrical movements.
Range of motion in both shoulders was measured twice for each patient with a one-week interval. This time interval was chosen because it seemed long enough for the observer to forget details concerning the first measurements, yet short enough to avoid any important change in "true" glenohumeral ROM for patients with this long-lasting [6, 30] condition. The order of measurements was the same for both appointments. All measurements were made by the same observer. No patient started any new treatment in the one-week period.
An overall measure of ROM was calculated numerically for the passive and active movements. It was defined as the sum of the four individual movements, and the measures were labeled "C. PROM" for the passive movements, and "C. AROM" for the active movements. Using single parameters to represent multiple movements may be unusual concerning shoulder ROM, but advantages with such parameters have been demonstrated when investigating motion in the cervical spine .
Reproducibility is reported in our study by both absolute and relative measurement error indices. Absolute measurement error (agreement) reflects the actual difference between observations. It is important when one wants to detect changes in health status over time . Absolute measurement errors are in this study reported by the "within-subject standard deviation" (sw) derived from a one-way analysis of variance (ANOVA) as suggested by Bland and Altman . We also report the "smallest detectable difference" (SDD). SDD, also known as repeatability, is defined as √2 × 1.96 sw = 2.77 sw . The difference between two measurements for the same subject is expected to be less than the SDD for 95% of pairs of observations. Using a similar approach, we also report corresponding figures when levels of 90%, 80% and 50% are used.
The calculation of a common standard deviation for the measurements is based on the absence of heteroscedasticity . Heteroscedasticity refers to a situation where measurement errors are dependent on the size of the various readings. We investigated the relationship between observed week-to-week differences and ROM means for each patient by using plots as proposed by Bland and Altman .
Relative measurement error is reported by the intraclass correlation coefficient (ICC). ICC is the correlation between one measurement on a target and another measurement obtained on that target . ICC was computed using a one-way ANOVA model (single measures). Its values can theoretically range from 0 to 1. A high ICC indicates that the within-patient differences between the two measurements are small compared with the between-patient differences for this movement. Previous researchers have suggested that reliability above 0.70 is acceptable for group comparisons . All statistical analyses were carried out using the software package SPSS 13.0 for Windows® (SPSS, Chicago, IL, USA).
Results for reproducibility are given in Table 1 for PROM and in Table 2 for AROM. Observation 2 tended to display slightly lower scores than observation 1. According to paired t-tests, the difference was significant for P. ABD and A. ABD for the non-affected shoulder. In our analyses, we used a one-way ANOVA model to estimate absolute and relative reliability, and a possible and unexpected bias (approximately 1°–2°) was not corrected for by this method. However, we also calculated the indices using a two-way model (data not shown), where a possible session effect was included. This resulted in estimates that were quite similar to the ones obtained by the one-way model.
For PROM, estimated SDDs range from 12° to 20° for the individual movements and from 31° to 37° for the combined movement (C. PROM). For approximately 50% of pairs of PROM observations, test-retest difference was 5° or below (individual movements). SDD estimates for AROM ranged from 13° to 28° for the individual movements and from 44° to 52° for the combined movement (C. AROM). Estimated ICCs were in the area of 0.60–0.90 for both active and passive movements.
Figures 6 and 7 show the C. PROM and C. AROM difference between the two observations, plotted against the corresponding mean value of the two observations for each patient. Results for the affected and the non-affected side are presented within the same diagrams. Reproducibility seems to be independent of the magnitude of the score for the affected as well as the non-affected shoulder.
We have investigated the intra-observer reproducibility of measurements obtained with a standardized protocol for measuring range of motion in patients with adhesive capsulitis. Thirty-two patients were included in the study. This low number means that figures presented are only "rough" estimates of the reproducibility that can be expected in similar settings.
We observed a tendency for the scores of the second observation to be lower than those of the first observation. We have no good explanation for this possible bias, but would like to point out that any "true" within-patient changes in ROM during the one-week interval will lead to over-estimation of measurement error in a study of this type.
Even though we made a great effort to determine starting points and end-points consistently, this was probably a key source of error. The determination of these points involved deciding when the adequate patient/arm position was reached, the stabilization of arm position, placement of the inclinometer, and finally reading the display. These actions are all likely to add variability to measurements.
When measuring PROM, we stabilized scapula during movements, and used initiation of scapular movement to help determine end-points of glenohumeral motion. This procedure was not problem-free, and especially for flexion, it was sometimes difficult to determine when the scapula started to move. For all movements, patient muscle use could interfere with the passive movements, making representative scores difficult to obtain. Although we sometimes experienced problems with the technique, we share the view that it is essential to restrict scapulothoracic motion in order to more accurately reflect the range of motion of the glenohumeral joint [2, 26, 36]. There are also indications that stabilizing the scapula may produce more reliable results for some movements . Furthermore, strict control of the scapula may be necessary in order to determine end-points of PROM with a method that does not cause excessive pain for the patient. The alternative might have been to determine end-point as the "point of first pain"  or as the point where pain makes further movement intolerable . However, it is problematic to use pain as an end-point indicator in patients who experience pain more or less constantly, as many of the patients in our study did. It is our view that this would also affect validity when interpreting PROM values. When reported pain is used to indicate end-of-range, would we be measuring changes in the connective tissues surrounding the joint, or changes in patient pain status? Few clinical studies of patients with adhesive capsulitis have indicated how PROM end-of-range was determined. It will be advantageous if future researchers are more specific when reporting these procedures.
Testing positions are, of course, important when measuring ROM, and reproducibility is probably affected by the choice of testing positions . In this study, we measured shoulder rotation from a 45° abducted position. It would have been more practical to measure rotation at 90° abduction, using positions described by Clarke  and others [16, 17, 26, 27, 29]. However, the rigid shoulders of our study population made it necessary to use a narrower angle.
Test positions and poor fixation of scapular movements may result in compensatory movements and thereby increased variation of measurements, in particular for active movements. Patients use various techniques to maximize their performance, some of which may be problematic to correct. Reliable (and valid!) measurements of these movements probably require very strict instructions to the patients. In many settings, however, there may be problems with the application of such methods.
We used a plastic plate in order to reduce "wobble" when applying the inclinometer. When experimenting without such a plate, we noted larger differences between subsequent measurements. We suspect that this method could be refined further, perhaps by using a longer plate, or stiffer material, or by improving plate attachment to the arm. Alternatively, attachment of the inclinometer itself to the arm during the entire movement, in a method similar to Clarke's [2, 29], may be superior to the method we used.
For passive movements, smallest detectable difference (on the 95% level) was estimated to be approximately 15° for the individual movements. In a clinical setting, this indicates that differences between two single observations exceeding 15° can be trusted to represent a ''true'' difference. For some movements of active ROM, SDD (95%) was about 25°. Relative reproducibility estimates (ICC) in our study were 0.61–0.93 for the various movements. In general, reproducibility seems satisfactory for group comparisons, but may be insufficient for individual comparisons in many settings. However, confidence intervals are wide and indicate that larger studies are necessary for definite statements to be made. Riddle et al., investigating shoulder patients , reported intra-observer correlation of 0.87–0.99, but absolute measurement errors were not given. This makes comparisons problematic . With the exception of this single study, measurement errors (absolute or relative) reported in comparable studies investigating intra-observer reproducibility in shoulder patient populations [4, 7, 9, 27, 28, 37] are not smaller than the ones reported in our study of patients with adhesive capsulitis.
There was a tendency that SDD for AROM was larger than for PROM in this study. This may not be due to larger "measurement errors", strictly interpreted. It may be due to the patients' exhibiting truly more variable AROM than PROM. When measuring AROM, patients were asked to move their arm as far as possible in the requested direction, allowing for necessary scapular movement. The largest measurement errors in the study were noted for movements of active abduction and flexion, both of which are movements involving potentially large contributions by other joints. Furthermore, active ROM depends not only on the joints, but also very much on the overall function of the neuromuscular system. In addition to pain , AROM measurements may be seriously affected by motivation, learning effects or fear avoidance, all very fluctuating parameters.
One must consider that the patients in our study were selected to some degree. Because we wanted to study patients with adhesive capsulitis, we only included patients whose passive ROM could be adequately observed. There are undoubtedly some patients with painful shoulders whose ROM can only with difficulty be reliably and validly measured. This may be associated with pain , but the relationship is unclear . One might speculate that other factors such as muscle tone, motivation or fear avoidance could play an important role. If this situation is suspected when ROM measurements must be made in patients, the use of anesthesia might be considered. Studying reproducibility under such conditions was beyond the scope of this project.
In this study, we employed a measure of "combined" total ROM. The corresponding SDD for PROM was 31° – 37°, meaning that differences larger than 8°–9° on average for four single movements are probably not due to measurement error. For combined total AROM, SDD was 44° – 52°, with corresponding figures of 11° – 13°. Average random error for each movement is reduced when several movements are combined like this . Future researchers may want to investigate whether "combined" shoulder ROM is a useful parameter in various clinical settings.
The present study of shoulder ROM measurements in patients with adhesive capsulitis indicates that reproducibility is acceptable for group comparisons, while scores for individual patients need to be interpreted with caution. We advise future researchers to carefully consider measurement protocols and study designs when investigating range of motion in patients with adhesive capsulitis.
Green S, Buchbinder R, Glazier R, Forbes A: Interventions for shoulder pain. The Cochrane Library. 2002, 3
Clarke GR, Willis LA, Fish WW, Nichols PJR: Assessment of movement at the gleno-humeral joint. Orthopaedics. 1974, 7: 55-71.
De Winter AF, Heemskerk MAMB, Terwee CB, Jans MP, Devillé W, van Schaardenburg DJ, Scholten RJPM, Bouter LM: Inter-observer reproducibility of measurements of range of motion in patients with shoulder pain using a digital inclinometer. BMC Musculoskelet Disord. 2004, 5: 18-10.1186/1471-2474-5-18.
MacDermid JC, Chesworth BM, Patterson S, Roth JH: Intratester and intertester reliability of goniometric measurement of passive lateral shoulder rotation. J Hand Ther. 1999, 12: 187-192.
Gajdosik RL, Bohannon RW: Clinical measurement of range of motion. Review of goniometry emphasizing reliability and validity. Phys Ther. 1987, 67: 1867-1872.
Shaffer B, Tibone JE, Kerlan RK: Frozen shoulder. A long-term follow-up. J Bone Joint Surg. 1992, 74: 738-746.
Geertzen JHB, Dijkstra PU, Stewart RE, Groothoff JW, Duis HJT, Eisma WH: Variation of measurements of range of motion: A study in reflex sympathetic dystrophy patients. Clin Rehabil. 1998, 12: 254-264. 10.1191/026921598675343181.
Triffitt PD, Wildin C, Hajioff D: The reproducibility of measurement of shoulder movement. Acta Orthop Scand. 1999, 70: 322-324.
Hayes K, Walton JR, Szomor ZL, Murrell GAC: Reliability of five methods for assessing shoulder range of motion. Austr J Physiother. 2001, 47: 289-294.
Hannafin JA, Chiaia TA: Adhesive Capsulitis: A treatment approach. Clin Orthop. 2000, 372: 95-109. 10.1097/00003086-200003000-00012.
Roach KE, Budiman-Mak E, Songsiridej N, Lertratanakul : Development of a shoulder pain and disability index. Arthritis Care Res. 1991, 4: 143-149. 10.1002/art.1790040403.
Juel NG: Norsk fysikalsk medisin. 2007, Oslo: Fagbokforlaget, 71-
Croft P, Pope D, Boswell R, Rigby A, Silman A: Observer variability in measuring elevation and external rotation of the shoulder. Br J Rheumatol. 1994, 33: 942-946. 10.1093/rheumatology/33.10.942.
Terwee CB, de Winter AF, Scholten RJ, Jans MP, Devillé W, van Schaardenburg D, Bouter LM: Interobserver reproducibility of the visual estimation of range of motion of the shoulder. Arch Phys Med Rehabil. 2005, 86: 1356-1361. 10.1016/j.apmr.2004.12.031.
Williams JG, Callaghan M: Comparison of visual estimation and goniometry in determination of a shoulder joint angle. Physiotherapy. 1990, 76: 655-657.
Boon AJ, Smith J: Manual scapular stabilization: its effect on shoulder rotational range of motion. Arch Phys Med Rehabil. 2000, 81: 978-983. 10.1053/apmr.2000.5617.
Boone DC, Azen SP, Lin C-M, Spence C, Baron C, Lee L: Reliability of goniometric measurements. Phys Ther. 1978, 58: 1355-1360.
Bovens AM, van Baak MA, Vrencken JC, Wijnen JA, Verstappen FT: Variability and reliability of joint measurements. Am J Sports Med. 1990, 18: 58-63. 10.1177/036354659001800110.
Riddle DL, Rothstein JM, Lamb RL: Goniometric reliability in a clinical setting. Shoulder measurements. Phys Ther. 1987, 67: 668-673.
Sabari JS, Maltzev I, Lubarsky D, Liszkay E, Hemel P: Goniometric assessment of shoulder range of motion: comparison of testing in supine and sitting positions. Arch Phys Med Rehabil. 1998, 79: 647-651. 10.1016/S0003-9993(98)90038-7.
Jordan K, Dziedzic K, Jones PW, Ong BN, Dawes PT: The reliability of the three-dimensional FASTRAK measurement system in measuring cervical spine and shoulder range of motion in healthy subjects. Rheumatology. 2000, 39: 382-388. 10.1093/rheumatology/39.4.382.
Buchbinder R, Green S, Forbes A, Hall S, Lawler G: Arthrographic joint distension with saline and steroid improves function and reduces pain in patients with painful stiff shoulder: results of a randomised, double blind, placebo controlled trial. Ann Rheum Dis. 2004, 63: 302-309. 10.1136/ard.2002.004655.
Buchbinder R, Hoving JL, Green S, Hall S, Forbes A, Nash P: Short course prednisolone for adhesive capsulitis (frozen shoulder or stiff painful shoulder): a randomised, double blind, placebo controlled trial. Ann Rheum Dis. 2004, 63: 1460-1469. 10.1136/ard.2003.018218.
Carette S, Moffet H, Tardif J, Bessette L, Morin F, Frémont P, Bykerk V, Thorne C, Bell M, Bensen W, Blanchette C: Intraarticular corticosteroids, supervised physiotherapy, or a combination of the two in the treatment of adhesive capsulitis of the shoulder: A placebo-controlled trial. Arthritis & Rheumatism. 2003, 48: 829-838. 10.1002/art.10954.
Van Royen BJ, Pavlov P: Treatment of frozen shoulder by distension and manipulation under local anaesthesia. Int Orthop. 1996, 20: 207-210. 10.1007/s002640050064.
Awan R, Smith J, Boon AJ: Measuring shoulder internal rotation range of motion: A comparison of 3 techniques. Arch Phys Med Rehab. 2002, 83: 1229-1234. 10.1053/apmr.2002.34815.
Green S, Buchbinder R, Forbes A, Bellamy N: A standardized protocol for measurement of range of movement of the shoulder using the Plurimeter-V inclinometer and assessment of its intrarater and interrater reliability. Arthritis Care Res. 1998, 11: 43-52. 10.1002/art.1790110108.
Hoving JL, Buchbinder R, Green S, Forbes A, Bellamy N, Brand C, Buchanan R, Hall S, Patrick M, Ryan P, Stockman A: How reliably do rheumatologists measure shoulder movement?. Ann Rheum Dis. 2002, 61: 612-616. 10.1136/ard.61.7.612.
Bower K: The hydrogoniometer and assessment of gleno-humeral joint motion. Aus J Physiother. 1992, 28: 12-17.
Reeves B: The natural history of the frozen shoulder syndrome. Scand J Rheumatol. 1975, 4: 193-196.
Dvir Z, Gal-Eshel N, Shamir B, Prushansky T, Pevzner E, Peretz C: Cervical motion in patients with chronic disorders of the cervical spine: a reproducibility study. Spine. 2006, 31: E394-399. 10.1097/01.brs.0000219951.79922.df.
De Vet HC, Terwee CB, Bouter LM: Current challenges in clinimetrics. J Clin Epidemiol. 2003, 56: 1137-1141. 10.1016/j.jclinepi.2003.08.012.
Bland JM, Altman DG: Measurement error. BMJ. 1996, 312: 1654-
Atkinson G, Nevill AM: Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998, 26: 217-238. 10.2165/00007256-199826040-00002.
Shrout PE, Fleiss JL: Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 1979, 86: 420-428. 10.1037/0033-2909.86.2.420.
Ellenbecker TS, Roetert EP, Piorkowski PA, Schulz DA: Glenohumeral joint internal and external rotation range of motion in elite junior tennis players. J Orthopaedic Sports Phys Ther. 1996, 24: 336-341.
Boström C, Harms-Ringdahl K, Nordemar R: Clinical reliability of shoulder function assessment in patients with rheumatoid arthritis. Scand J Rheumatol. 1991, 20: 36-48.
Rousson V, Gasser T, Seifert B: Assessing intrarater, interrater and test-retest reliability of continuous measurements. Stat Med. 2002, 21: 3431-3446. 10.1002/sim.1253.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/9/49/prepub
This study was supported by the Research Council of Norway, the University of Oslo and Ullevål University Hospital, represented by the Department of Physical Medicine and Rehabilitation.
The author(s) declare that they have no competing interests.
All authors contributed to study design. EKT recruited the patients, measured range of motion, performed the statistical analysis and drafted the manuscript. OME, NGJ and EBH helped to draft the manuscript. All authors read and approved the final manuscript.