- Research article
- Open Access
- Open Peer Review
Inter- and intraobserver reliability of the MTM-classification for proximal humeral fractures: A prospective study
BMC Musculoskeletal Disordersvolume 9, Article number: 21 (2008)
A precise modular topographic-morphological (MTM) classification for proximal humeral fractures may address current classification problems. The classification was developed to evaluate whether a very detailed classification exceeding the analysis of fractured parts may be a valuable tool.
Three observers classified plain radiographs of 22 fractures using both a simple version (fracture displacement, number of parts) and an extensive version (individual topographic fracture type and morphology) of the MTM classification. Kappa-statistics were used to determine reliability.
An acceptable reliability was found for the simple version classifying fracture displacement and fractured main parts. Fair interobserver agreement was found for the extensive version with individual topographic fracture type and morphology.
Although the MTM-classification covers a wide spectrum of fracture types, our results indicate that the precise topographic and morphological description is not delivering reproducible results. Therefore, simplicity in fracture classification may be more useful than extensive approaches, which are not adequately reliable to address current classification problems.
Proximal humerus fractures have a great variability and complexity. In general only two systems are used for classification: the Neer classification and the classification of the Arbeitsgemeinschaft für Osteosynthesefragen/Association for the Study of Internal Fixation (AO/ASIF) [1–4]. During the last years, a few studies presented fracture types, which were not accurately described with either of the two classification systems [5–7]. Several studies have also shown high rates of inter- and intraobserver variability in both classifications [8–16]. Only the analysis of fractured parts according to Neer and the AO-main-types led to a moderate to substantial reliability. Reliability studies that specifically analysed a very detailed classification (Neer parts and groups, AO – types and groups and subgroups) showed only fair to slight reliability. A low reliability reported in these studies could be a possible reason for discrepancies when comparing outcome studies especially after treatment of complex three-and four-part-fractures .
Therefore, new classification systems were introduced during the last years [18, 19]. A new system based on the analysis of more than 250 humeral fractures-was developed, which allows a detailed modular classification of proximal humeral fractures condensing Neer and AO with special regard to defined topographic and morphological criteria (MTM-Classification). The current study assessed the reliability of the MTM-classification and compared the results with fractured parts of the proximal humerus according to Neer-classification using plain x-rays. We also wanted to answer the question whether classification of proximal humeral fractures in this very detailed way, exceeding the analysis of fractured parts (according to Neer), may be limited by its reliability.
Presentation of the Classification
The alphanumeric classification consists of a m odular t opographic and m orphologic (MTM-) classification. To facilitate a more precise, reliable and reproducible fracture differentiation, initial radiological assessment, standardized plain x-rays in a.p. and axillary views were mandatory.
The Topographical Basis
The topographic basis is the division of the proximal humerus into two segments-the articular segment (with C-fractures from C = Caput = Humeral head) and the extraarticular segment. This extraarticular segment (with A-fractures) is further divided into the three subsegments metaphysis (M), Greater tuberosity (G) and Lesser tuberosity (L).
Both the articular and the extraarticular segments are divided by the anatomical neck (see Figure 1).
The fracture types
A-Fractures comprise fractures in the extraarticular segment. Two-part-A fractures are divided in two-part metaphyseal fractures (M) that extend through the surgical neck, two-part greater tuberosity (G) and two-part lesser tuberosity fractures (L). The tuberosity fractures are defined by a complete separation of the tuberosity from the metaphysis and the anatomical neck.
Three-part A fractures (MG and ML fractures) are a metaphyseal fracture (M) with a fracture of one tuberosity (G or L).
Four-part A fractures (MT fracture) are a metaphyseal fracture (M) with a fracture of both tuberosities (G+L = T) (see Figure 2a–f).
Type B: Incomplete Articular Fractures
Incomplete articular fractures show an incomplete fracture through the anatomic neck and extend into one of the extraarticular subsegments. This type describes a tuberosity or a medial wedge-shaped fragment, which is separated from the metaphysis and remains at the humeral head. Two-part B fractures are divided into three subtypes such as incomplete articular fractures with an medial metaphyseal wedge shaped fragment at the humeral head (MB), an incomplete fracture of the anatomical neck with the greater tuberosity at the humeral head (GB) and an incomplete fracture of the anatomical neck with the lesser tuberosity connected to the humeral head (LB).
The further division of type B fractures depends on the additionally occurring tuberosity fractures. These three-part B fractures are GB fractures with a separate fracture of the lesser tuberosity (GBL), LB fractures with a separate fracture of the greater tuberosity (LBG), MB fractures with a separate fracture of the greater tuberosity (MBG) and MB fractures with a separate fracture of the lesser tuberosity (MBL).
Type C: Complete Articular Fractures
Type C articular fractures completely pass through the anatomic neck, but also may extend through the humeral head, which is completely separated from the extraarticular segment. Type C fractures are divided into five subtypes. Two-part C fractures with just one complete fracture through the anatomic neck are isolated articular fractures (SC).
Three-part C fractures showing a fracture of the greater tuberosity (CG), with a fracture of the lesser tuberosity (CL). Four-part C fractures show a fracture of both tuberosities fractures (CT). Along with four-part fractures there is often a fracture of the metaphyseal subsegment. These even more complex fractures are called (CTM) (see Figure 5).
Type D-Fractures (Fracture-Dislocations)
D fractures are fracture-dislocations. D fractures are divided in type C fracture-dislocations (DC), type B fracture-dislocations (DB) and type A fracture-dislocations (DA).
The further classification of DA fractures depends on the fractures in the extraarticular segment: fracture-dislocation with a metaphyseal fracture (DM), anterior fracture-dislocation dislocation and fracture of the greater tuberosity (DG) and posterior fracture-dislocation and fracture of the lesser tuberosity (DL).
The morphological basis
For morphological analysis, the MTM classification is based on four defined specifications, which are relevant for therapy and prognosis.
These specifications are organized by increasing fracture severity: minimally displaced and stable (S1), minimally displaced and unstable (S2), displaced (S3), displaced and comminuted (S4). In fractures with several parts, each part has to be classified individually. (see Figure 6).
S1: Minimally Displaced and Stable
The minimally displaced fractures (S 1) are defined as fractures with angulations up to 25°, a displacement of the tuberosities and the anatomical neck up to 5 mm, and a metaphyseal fracture displacement of 10 mm. Up to this extent of displacement, a real impairment of shoulder function is not to be expected.
Fracture stability is given if – through impaction of the main parts and preserved soft tissues – mobility between the main parts resulting in further displacement is unlikely. Thus, the fracture position, induced by the trauma, is not changing by careful functional strain of the shoulder.
Therefore, minimally displaced and stable fractures are amenable to nonoperative treatment including early functional exercises. Regardless of fracture type and the number of main fragments, those fractures can be grouped together as S1 fractures since they are almost analogous in treatment and prognosis.
S2: Minimally Displaced and Unstable
The displacement of S2 fractures is defined similar to S1 fractures as a displacement of the tuberosities and the anatomical neck up to 5 mm, and a metaphyseal fracture displacement of 10 mm. Those fractures were defined as unstable when fractured parts were not impacted into each other resulting in instability between the fractured parts. Thus, through muscle pull and shoulder mobilization further displacements beyond the initial radiographically diagnosed extent may occur.
Assessment of Stable and Unstable Fractures
If the above-defined criteria for stability and instability cannot clearly be applied radiologically, an additional fluoroscopic examination of the fracture is recommended. In this examination, a gentle abduction and rotation is applied in true a.p. view. If mobility can be visualized between fractured parts, the fracture is defined as unstable.
S3 fractures always show a stronger malalignment and fragment separation, and, thus, the interfragmental soft tissue is ruptured more strongly, mostly induced by a combination of angulatory, rotatory and translatory displacement. Often, a compression mechanism leads to strong displacement with impaction. In displaced C fractures, the blood supply to the humeral head is completely destroyed. In cases with translatory and rotatory displacement of the humeral head, there is no integrity of the medial hinge and capsular and periosteal vessels ascending intraosteally to the humeral head are ruptured[18, 20].
S4: Displaced and Comminuted
In addition to the displacement, S4 fractures show comminution of the main part complicating the therapeutic procedure and worsening the prognosis. For example displaced head-splitting fractures define the fracture of the humeral head in several single fragments (C4).
The application of the classification
Due to its modularity, the classification can be applied in several ways depending on application purposes.
The short topographic version allows to classify into main types (A, B, C, D) or into the number of main parts (2, 3, 4) or into a combination of both the main-fracture-type and parts (2-p-A-fracture to 4-p-C-fracture).
A more detailed approach evaluated individual fracture types (M to CTM) or fracture types in combination with the individual specification (M to CTM and S1 to S4).
For example, a stable fracture of the anatomical neck with a displaced fracture of the greater tuberosity could be classified as C1G3.
To allow the comparism with other studies we also classified the fractures according to the determination between minimal-displaced and displaced fractures (S1/S2 to S3/S4).
In a prospective study during March 2005 and August 2005 a consecutive series of 22 patients with 22 proximal humeral fractures presented at the BG Trauma Centre of the University of Tuebingen were included into the study. All patients were diagnosed with standardized plain x-rays in a.p. and axillary views with the patient supine using a shoulder splint with at least 60° abduction of the arm. In addition, suspected instability in minimally displaced fractures was assessed using fluoroscopy (n = 4). All x-rays were reviewed by an experienced trauma surgeon, who was not participating in the evaluation to ensure that the x-ray quality of all 22 patients was sufficient for later classification. All x-rays were collected and numerated; patient identification data was rendered anonymously. Then, the x-rays were submitted to three observers. Observer 1 was an experienced orthopaedic surgeon with fellowship training in shoulder surgery. Observer 2 was an experienced trauma surgeon with a special interest in bone and joint orthopaedic surgery. Observer 3 was a fellow for trauma surgery with a special interest in bone and joint surgery. None of the examiners were employed by the hospital, in which the fractures were seen. During routine work of the three observers only the Neer and AO classification were used. None of the observers had any experience with the MTM classification before study onset to exclude the influence of training on reliability.
At the beginning of the study, the MTM classification was provided to the examiners in English and German language. In addition, the first author gave a 15-minute presentation of the MTM-Classification. A goniometer and a pen were given to the examiners. The data acquisition of the three examiners took place independently.
All fractures were classified by the observers according to the following guidelines:
b) Topographical analysis by individual fracture types (M to CTM) (see Table 1).
c) Analysis by a combination of both main fracture types (A, B, C, D) and number of parts (2–4) (see Table 1).
a) Analysis by the 4 main fracture types (A, B, C or D) (Table 1).
d) Analysis by number of main parts (2-part, 3-part, and 4-part according to Neer-classification) (see Table 1).
e) Morphological distinction between minimal-displaced fracture and displaced fracture (S1/S2 or S3/S4) (see Figures 6).
After initial analysis, a second evaluation of the x-rays took place after 4 months. Prior to this part of the study, none of the examiners had knowledge about this second evaluation. The classification was presented again in English and German languages. A routine application of the MTM classification during routine work did not take place. The second evaluation was performed as described above except that radiographs were presented in reverse order. All except one fracture, that was treated conservatively, were stabilized by open reduction and internal fixation with an angular-stable plate osteosynthesis.
Percentage agreement, intraobserver reliability and interobserver reliability were assessed with the JMP-statistical package (Version 6, SAS Campus Drive, Building S, Cary, NC, 27513, USA). For intraobserver reliability and interobserver reliability, the kappa statistic function of the JMP-statistical package was used measuring kappa values (κ) to describe the agreement between observers while correcting for the proportion that may have occurred by chance alone.
A kappa value of 0 represented agreement by chance alone while kappa value of 1 represented a perfect agreement. Kappa values were interpreted using the guidelines proposed by Landis and Koch. Values between 0.81 and 1 indicated excellent or almost perfect, 0.61 and 0.80 substantial, 0.41 and 0.60 moderate, 0.21 and 0.40 fair and 0 and 0.20 slight reliability .
Lowest percentages of agreement were detected for individual fracture type and morphological specification (M to CTM + S1–S4, range 54.5%–68.2%), followed by number of main parts combined with main fracture type (2–4 + A-D, range 68.2%–81.8%) and individual fracture type (M-CTM, range 68.2%–72.7%).
The highest percentage agreement between the observers was found for the parameters of fracture displacement (S1/2 – S3/4, range 90.1%–95.4%), number of main parts (2–4, range 86.4% – 90.1%) and main fracture type (A-D, range 81.8%–90.1%). Statistical analysis showed the lowest kappa values in individual fracture type and morphological specification and the highest intraobserver reliability when fractures where classified according to number of main parts, fracture displacement and main fracture types including number of parts. (See Table 2).
The lowest percentage agreement between all observers was found in the assessment of combination of fracture type and individual specification. Followed by the classification according to individual fracture type and main type and parts.
The highest percentage agreement between all observers was found in the assessment of fracture displacement followed by the classification according to main fracture types and fractured parts.
A fair level of agreement was found in the evaluation of individual fracture type in combination with specification and individual fracture type and analysis of main fracture type and main parts. A moderate to substantial level of agreement was found in the evaluation of fracture displacement and number of main parts. (See Table 3).
The MTM-Classification was developed to advance understanding of proximal humeral fractures. Especially by introduction of incomplete articular fractures (B-fractures) a topographic classification could by possible. By adding morphological aspects and the possibility of a modular application of the system a precise evaluation of almost all fractures may be possible as well. However, the classification of proximal humeral fractures with the MTM-systems results in various differences in reliability depending on the short or extensive version of application. Analyzing the short version of the classification, the interobserver analysis resulted in moderate kappa values in the category 'main parts' (according to Neer-parts) and substantial kappa values for analyzing 'fracture displacement'. Those results were in accordance with the literature[8, 23]. Analyzing the extensive version of the MTM-Classification like evaluation of the main or individual fracture type with inclusion of the specification, only fair results can be expected.
At present the classifications by Neer and the AO for proximal humeral fractures are widely accepted and commonly used although both classifications have received some criticism during the last years [1, 3]. Neither of the two systems achieved the general requirement of classifications to adequately cover the complete spectrum of all possible fracture patterns. The Neer-system does not include 4-part valgus impacted fractures (covered by the AO-Classification as C2.1 or C2.2). Furthermore, the Neer-classification describes a large and rather inhomogeneous group (one-part fractures/minimal-displacement) that consists of all fractures that are angulated less than 45° and displaced less than 1 cm, independently of the number of fractured parts. More so, 3 and 4-part fractures are divided by Neer in types of lesser tuberosity and greater tuberosity fractures. In these complex fractures, it remains unclear whether a fracture runs through the anatomical or the surgical neck. Furthermore, the AO classification includes three types (A, B and C) each divided into 3 groups and 9 subgroups. For further subgroup description, 41 qualifications were used. Despite this detailed approach, complex injuries such as fractures of the anatomical neck with both tuberosities (4-part fractures according to Neer) or isolated lesser tuberosity fractures are inadequately defined.
New classifications systems such as the MTM classification were developed to address these critical points[18, 19]. As a main prerequisite for correct topographic and morphologic fracture assessment, standardized and good-quality anteroposterior and axillary radiographs are required. Tamai published a series of 22 3 and 4-part fractures. He compared plain x-rays in anteroposterior and scapula lateral views with the intraoperative gross anatomy. Eight cases (36.4%) could neither be classified by Neer nor by the AO classification system. The authors concluded that diagnostics in complex fracture situations are difficult and that the classifications used were not as accurate as one would hope. Furthermore, Tamai attributed present difficulties in the choice of correct therapeutic methods to an inadequate fracture classification system.
The MTM classification advanced available classifications by including the fracture model of Codman, the Neer analysis of fractured parts and the AO differentiation of fracture height, allowing for the description of almost all possible fracture types [1, 3, 25].
Published reliability studies differ in observer experience and diagnostic imaging methods. In addition, partly simplified Neer and AO classifications were used, leading only to limited study comparisons. (see Table 4).
Also, comparisons of kappa values from different studies may be problematic, as kappa values change with the prevalence of the diagnosis. Despite these problematic aspects, the author's selected a few studies with comparable methods for discussion.
Several authors assess the intraobserver reliability and interobserver reproducibility. Using conventional radiography and in some studies additional CT-scans, they found a fair to substantial mean intraobserver agreement as well as a fair to substantial mean interobserver agreement for the Neer and for the AO classification. (see Table 4).
The present study used standardized plain x-rays, enlisted experienced trauma surgeons and used the whole range of the classification spectrum. This approach led to an average percentage agreement of the three observers of 49.2% with a fair kappa value of 0.39 for fracture-analysis under consideration of individual fracture type and specification.
Siebenrock and Gerber also stated that the AO classification with three main types (A-C) resulted in better kappa values than the modified Neer classification with four choices of fracture types . These findings were confirmed by our study, in which we found acceptable to good agreement in 2 to 3 groups for determination of fracture displacement or fractured main parts. On the other hand, Sidor found that a simplification of the Neer classification from 16 into 6 categories did not result in significant changes of interobserver reliability. However, a 2-choice question, for example about therapeutic management or (as in the present study) about fracture displacement led to perfect and good reliability, indicating a dependency of interobserver reliability and the number of choices the observer has to select[8, 23].
Sidor also discussed that a differentiation of single fragments due to multiple fractures lines is difficult. He also stresses the importance of a high-quality radiological diagnostics, which makes an overlapping free presentation for the fractured region possible to avoid any classification restriction. For an excellent classification of proximal humeral fractures, a perfect radiological visualization of the fractured region is mandatory. In accordance with other experts, it is possible to increase the information with an axillary view in terms of direction and dimension of fracture dislocation, humeral head involvement, and the degree of displacement of tuberosity fractures, especially considering fractures of the lesser tuberosity [27–29].
Brorson and Shrader analyzed the importance of training in a specific classification system. They could show that kappa values for interobserver reliability were significantly improved from fair to substantial after observers had received a classification training[23, 30, 31].
Since the training in a specific classification system improves reliability, one weakness of the current study was, that the MTM-classification was not used in daily clinical practice. With sufficient training, the reliability of this classification could be higher.
In summary, some complex fracture types are inadequately defined by classification systems such as the present Neer or AO classification. To allow a precise topographic and morphological description, the MTM classification was developed for a better understanding of individual fractures and to address the question whether a very detailed classification of proximal humeral fractures may be limited by its reliability. Unfortunately, the very detailed classification approach led only to fair or unacceptable results and is not helpful to improve reliability.
We concluded that a detailed classification exceeding the part analysis of Neer is not a practical approach to address current problems in classification systems regarding proximal humerus fractures.
For future projects an evaluation of ongoing developments of diagnostic imaging-technology like the CT and here specifically multiplanar visualisation of the fracture in thin-cut technique and 3 D visualisation should be undertaken.
Jakob RP KT: Classifications and aspects of treatment of fractures of the proximal humerus. In: Bateman JE, Welsh RP (esd): Surgery of the shoulder Philiadelphia: CV Mosby Co. 1984, 330-343.
Duparc J, Largier A: [Fracture-dislocations of the upper end of the humerus]. Rev Chir Orthop Reparatrice Appar Mot. 1976, 62 (1): 91-110.
Neer CS: Displaced proximal humeral fractures. I. Classification and evaluation. J Bone Joint Surg Am. 1970, 52 (6): 1077-1089.
Habermeyer P: [Fracture of the head of the humerus]. Unfallchirurg. 1997, 100 (10): 820-837. 10.1007/s001130050199.
Meyer DC, Espinosa N, Hertel R: Combined fracture of the greater and lesser tuberosities with intact connection of the humeral head to the shaft. J Trauma. 2006, 61 (1): 206-208.
Ackermann C, Lam Q, Linder P, Kull C, Regazzoni: [Problems in classification of fractures of the proximal humerus]. Z Unfallchir Versicherungsmed Berufskr. 1986, 79 (4): 209-215.
Tamai K, Hamada J, Ohno W, Saotome K: Surgical anatomy of multipart fractures of the proximal humerus. J Shoulder Elbow Surg. 2002, 11 (5): 421-427. 10.1067/mse.2002.126101.
Bernstein J, Adler LM, Blank JE, Dalsey RM, Williams GR, Iannotti JP: Evaluation of the Neer system of classification of proximal humeral fractures with computerized tomographic scans and plain radiographs. J Bone Joint Surg Am. 1996, 78 (9): 1371-1375.
Sallay PI, Pedowitz RA, Mallon WJ, Vandemark RM, Dalton JD, Speer KP: Reliability and reproducibility of radiographic interpretation of proximal humeral fracture pathoanatomy. J Shoulder Elbow Surg. 1997, 6 (1): 60-69. 10.1016/S1058-2746(97)90072-0.
Sidor ML, Zuckerman JD, Lyon T, Koval K, Cuomo F, Schoenberg N: The Neer classification system for proximal humeral fractures. An assessment of interobserver reliability and intraobserver reproducibility. J Bone Joint Surg Am. 1993, 75 (12): 1745-1750.
Siebenrock KA, Gerber C: The reproducibility of classification of fractures of the proximal end of the humerus. J Bone Joint Surg Am. 1993, 75 (12): 1751-1755.
Sjoden GO, Movin T, Guntner P, Aspelin P, Ahrengart L, Ersmark H, Sperber A: Poor reproducibility of classification of proximal humeral fractures. Additional CT of minor value. Acta Orthop Scand. 1997, 68 (3): 239-242.
Sjoden GO, Movin T, Aspelin P, Guntner P, Shalabi A: 3D-radiographic analysis does not improve the Neer and AO classifications of proximal humeral fractures. Acta Orthop Scand. 1999, 70 (4): 325-328.
Mora Guix JM, Gonzalez AS, Brugalla JV, Carril EC, Banos FG: Proposed protocol for reading images of humeral head fractures. Clin Orthop Relat Res. 2006, 448: 225-233. 10.1097/01.blo.0000205899.28856.98.
Brien H, Noftall F, MacMaster S, Cummings T, Landells C, Rockwood P: Neer's classification system: a critical appraisal. J Trauma. 1995, 38 (2): 257-260.
Kristiansen B, Andersen UL, Olsen CA, Varmarken JE: The Neer classification of fractures of the proximal humerus. An assessment of interobserver variation. Skeletal Radiol. 1988, 17 (6): 420-422. 10.1007/BF00361661.
Rees J, Hicks J, Ribbans W: Assessment and management of three-and four-part proximal humeral fractures. Clin Orthop. 1998, 18-29.
Hertel R: Fractures of the proximal humerus in osteoporotic bone. Osteoporos Int. 2005, 16 Suppl 2: S65-72. 10.1007/s00198-004-1714-2.
Edelson G, Kelly I, Vigder F, Reis ND: A three-dimensional classification for fractures of the proximal humerus. J Bone Joint Surg Br. 2004, 86 (3): 413-425. 10.1302/0301-620X.86B3.14428.
Hertel R, Hempfing A, Stiehler M, Leunig M: Predictors of humeral head ischemia after intracapsular fracture of the proximal humerus. J Shoulder Elbow Surg. 2004, 13 (4): 427-433. 10.1016/j.jse.2004.01.034.
Schnabel M, Bahrs C, Walthers E, Gotzen L: [Marburg shoulder radiography splint (MSR splint) for standardized and high quality plain film radiography in fractures of the proximal humerus]. Unfallchirurg. 2004, 107 (11): 1099-1102. 10.1007/s00113-004-0857-0.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.
Shrader MW, Sanchez-Sotelo J, Sperling JW, Rowland CM, Cofield RH: Understanding proximal humerus fractures: image analysis, classification, and treatment. J Shoulder Elbow Surg. 2005, 14 (5): 497-505. 10.1016/j.jse.2005.02.014.
Jakob RP, Miniaci A, Anson PS, Jaberg H, Osterwalder A, Ganz R: Four-part valgus impacted fractures of the proximal humerus. J Bone Joint Surg Br. 1991, 73 (2): 295-298.
Codman EA: Fractures in relation to the subacromial bursa. In: Codman EA, ed The Shoulder: Rupture of the Supraspinatus Tendon and other Lesions in or about the subacromial Bursa. 1934, Boston, MA , Thomas Todd, 313-333.
Gjorup T: The kappa coefficient and the prevalence of a diagnosis. Methods Inf Med. 1988, 27 (4): 184-186.
Leibman MI, Zuckerman JD: Proximal Humeral Fractures:Clinical Evaluation and Classification. in Shoulder Fractures-The Practical Guide to Management, Zuckerman JD and Koval KJ eds, Thieme New York, Stuttgart. 2005, 1: 37-49.
Ballmer FT, Hertel R: [Indications and results of shoulder prosthetics in complex proximal humerus fractures]. Ther Umsch. 1998, 55 (3): 197-202.
Resch H: [Fractures of the humeral head]. Unfallchirurg. 2003, 106 (8): 602-617. 10.1007/s00113-003-0661-2.
Brorson S, Bagger J, Sylvest A, Hrobjartsson A: Improved interobserver variation after training of doctors in the Neer system. A randomised trial. J Bone Joint Surg Br. 2002, 84 (7): 950-954. 10.1302/0301-620X.84B7.13010.
Brorson S, Bagger J, Sylvest A, Hrobjartsson A: Low agreement among 24 doctors using the Neer-classification; only moderate agreement on displacement, even between specialists. Int Orthop. 2002, 26 (5): 271-273. 10.1007/s00264-002-0369-x.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/9/21/prepub
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.