Skip to content

Advertisement

  • Research article
  • Open Access
  • Open Peer Review

A new acute scaphoid fracture assessment method: a reliability study of the ‘long axis’ measurement

BMC Musculoskeletal Disorders201819:310

https://doi.org/10.1186/s12891-018-2236-y

  • Received: 2 December 2017
  • Accepted: 16 August 2018
  • Published:
Open Peer Review reports

Abstract

Background

The aim of this study was to assess the inter observer and intra observer reliability of acute scaphoid fracture classification methods including a novel ‘long axis’ measurement, a simple method which we have developed with the aim of improving agreement when describing acute fractures.

Methods

We identified sixty patients with acute scaphoid fractures at two centres who had been investigated with both plain radiographs and a CT (Computed Tomography) scan within 4 weeks of injury. The fractures were assessed by three observers at each centre using three commonly used classification systems and the ‘long axis’ method.

Results

Inter observer reliability: based on X-rays the ‘long axis’ measurement demonstrated substantial agreement (Intraclass Correlation Coefficient (ICC) =0.76) and was significantly more reliable than the Mayo (p < 0.01), the most reliable of the established classification systems with moderate levels of agreement (kappa = 0.56). Intra observer reliability: the long axis measurement demonstrated almost perfect agreement whether based on X-ray (ICC = 0.905) or CT (ICC = 0.900).

Conclusions

This study describes a novel pragmatic ‘long axis’ method for the assessment of acute scaphoid fractures which demonstrates substantial inter and intra observer reliability. The ‘long axis’ measurement has clear potential benefits over traditional classification systems which should be explored in future clinical research.

Keywords

  • Scaphoid
  • Fracture
  • Classification
  • Acute
  • Non-union

Background

Scaphoid fractures represent around 2–3% of all fractures and around 10% of all fractures in the hand, while the younger population is more typically affected although fractures do occur in the elderly [1]. Fractures of the mid-portion of the scaphoid, the so-called ‘waist’, are the most common [1]. The existing evidence suggests that the risk non-union is considerably higher for more proximal fractures [2]. Despite large numbers of publications on outcomes of scaphoid fracture management there are large inconsistencies in the published data. Combining these data groups is notoriously difficult for a number of reasons including variable demographics, inconsistent definitions of fracture type, and inconsistent methodology for defining outcome. There is particular interest in the behaviour of proximal pole fractures but no consensus on how this subgroup should be defined. This method could be used to give more reliable and reproducible descriptions of fracture type.

A number of classification systems have been described, with the most widely used being the Herbert, Russe and Mayo methods. However the reliability of these tools has been shown to be rather limited [3]. Despite the frequently-discussed distinction between proximal pole and waist fractures, there is no published reliable method of distinguishing between the two. The Mayo classification system divides the scaphoid into proximal, middle and distal third fractures, as well as distal tubercle and distal intra-articular fractures. Russe divided fractures into those with horizontal oblique, transverse or vertical oblique fracture lines [4]. The Herbert system divides acute fractures into either stable (Type A) and unstable (Type B), with various subdivisions with these types [5]. No study has described a method for determining precisely the location or the size of the proximal pole. For example the SWIFFT study protocol defines a proximal pole fracture as involving the ‘proximal fifth’ but does not describe how one can reliably determine when a fracture involves the proximal fifth [6]. This makes it difficult to compare studies and particularly difficult to perform meta-analysis on data from published cohorts. While the anatomical and radiological definition of proximal pole, waist and distal pole fractures is likely to remain contentious, looking at a more continuous measure of fracture site may give more clarity.

The primary aim of this study was to assess the reliability of acute scaphoid fracture assessment metrics including the new ‘long axis’ measurement. The secondary aims were to compare the reliability of this new method with three established classification systems, and to compare the reliability of each of these methods when using plain radiographs and CT. The null hypothesis was that there would be no difference in reliability between the older methods and the new ‘long axis’ measurement.

Methods

Using local surgical databases we retrospectively identified sixty patients with acute scaphoid fractures across two centres that had been investigated with both plain radiographs and a CT scan within 4 weeks of injury. We excluded non acute scaphoid fractures as well as those associated with acute carpal dislocation. All injuries were sustained from the beginning of 2013 to the end of 2016.

The patient demographics were recorded. Two senior surgical trainees and an experienced hand surgeon analysed the plain radiographs and CT scans in each centre. The observers were briefed on recent literature which describes the long axis passing from the proximal point through the centre of the waist to the most distal point, with the most distal point being very close to the centre of the tubercle just radial to its apex [7, 8].

The Classification according to Russe, Herbert and Mayo systems were recorded. In addition the observers recorded the long axis length of the scaphoid, the distance at which the fracture line crossed the long axis, distance at which the proximal fracture line crossed a line perpendicular to long axis on ulnar border, distance at which fracture line crossed a line perpendicular to long axis on radial border, presence of a sagittal plane deformity, presence of a coronal plane deformity, presence of significant fragmentation and the scapholunate angle. The presence of coronal/sagittal deformity or significant comminution was a subjective observer-based decision, i.e. the observer made a subjective decision as to whether any coronal or sagittal deformity and whether comminution was present in binary terms, no quantifiable metric was used.

The classification and characteristics were recorded separately at different times for both plain radiographs and CT scans. The long axis length of scaphoid was measured from the most proximal ulnar corner of the scaphoid to the centre of the scaphoid tubercle distally (distal point (dp)) (Figs. 1 and 2).
Fig. 1
Fig. 1

Plain radiograph with the key points relating to ‘long axis’ measurement marked. Detailed legend - a scaphoid fracture with the distal point (dp), proximal point (pp), the long axis line, the fracture line, a line perpendicular to the long axis, and the radial and ulnar lines

Fig. 2
Fig. 2

Plain radiograph of a scaphoid fracture demonstrating the measurements made. Detailed legend - the long axis (l) and the distance along the long axis to the fracture site are shown (f, fracture distance), while the ulnar (u) and radial (r) distances to the fracture site are also shown. Note (f) is measured along (l) but for ease of demonstrating the methodology (f) has been moved just adjacent to (l). In this example the long axis measurement is f/l which equals 0.28

The radiographs were analysed pragmatically with the specific (long axis/radial/ulnar) measurements taken from what was deemed the best long axis view by each observer. The CT scans were analysed using InSight PACS (Insignia medical systems, UK) and the scaphoid orientated to obtain the best long axis view in the opinion of the observer for the specific measurements in this plane. The fracture position was measured using the mid-sagittal coronal image. One observer at each centre repeated the X-ray and CT based assessments six months later to test intra-observer reliability.

Statistics

Statistical analysis was carried using SPSS version 24 for Windows (IBM Corp). Data was normally distributed unless otherwise stated. Results are expressed as mean (SD) unless otherwise stated. Inter-observer reliability was determined for ordinal data using Cohen’s Kappa and for continuous data using the Intraclass Correlation Coefficient (ICC). ICCs were denoted as the single measures (average measures). Statistical significance was set at a level of p < 0.05. The interpretation of the degree of agreement determined by the Kappa and ICC is generally graded as slight (0.01–0.2), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80) and almost perfect (> 0.81) [9]. When calculating the ICC for more than two observers the ICC was re-calculated; whereas for the Kappa statistic a mean was used when an overall value was calculated for more than two observers. We did not carry out a formal power calculation, as this is not standard practice for reliability studies [10]; however our sample size and number of observers was comparable with the best practice described within the literature [11].

Results

Patient demographics

Table 1 depicts the basic patient demographics including age, sex and the times from injury to imaging. The mean patient age was close to 30 years and a large majority of patients were male in both centres. All imaging was carried out within a month of injury.
Table 1

Patient demographics and injury details

 

Centre 1

Centre 2

Patient number

30

30

Age

31.4 (11.3)

29 (13.9)

Sex

27 M/3 F

25 M/5 F

Median time from injury to Xrays in days (IQR)

0 (0–7)

0 (0–5)

Median time from injury to CT in days (IQR)

6.5 (5–13)

12.5 (6.5–21)

Inter-observer reliability of X-ray based results

Table 2 and Appendix 1 show the inter observer reliability of the all X-ray based assessments. The Mayo classification system was the most reliable of the established classification systems with moderate agreement (kappa = 0.566), with the Herbert and Russe systems demonstrating fair and slight agreement respectively. The long axis measurement demonstrated substantial agreement (ICC = 0.758) and was more reliable than the ulnar and radial measurements. The degree of agreement of measuring sagittal plain deformity was poor (ICC = 0), while the degree of agreement for coronal plain deformity; comminution and scapholunate angle was moderate.  The reliability of the ‘long axis’ measurement versus established classification systems is shown in Fig. 3, with the 'long axis' measurment demonstrating significantly greater reliability than the established methods.
Table 2

Inter observer reliability of the X-ray based measurements

System

Centre 1

Centre 2

Overall mean

Russe

0.131

0.120

0.126

Herbert

0.345

0.386

0.366

Mayo

0.609

0.522

0.566

Long axis

0.732

0.784

0.758

Sagittal deformity

−0.02

0.0167

0.00

Coronal deformity

0.425

0.438

0.432

Comminution

0.410

0.529

0.470

Scapholunate angle

0.389

0.580

0.485

Fig. 3
Fig. 3

Scatter plot depicting the reliability of the ‘long axis’ measurement in comparison with the more established classification systems. Detailed legend – this demonstrates the reliability of the Russe, Herbert, Mayo and long axis systems. As tested using Bonferroni’s multiple comparison test the long axis measurement system was significantly more reliable than the Mayo (p < 0.01), the Herbert (p < 0.001) and the Russe (p < 0.001) classification systems

Inter-observer reliability of CT based results

Table 3 and Appendix 2 show the reliability of each tool when using CT. Just as with plain radiographs the Mayo classification system was the most reliable of the established classification systems with moderate agreement (kappa = 0.542), with the Herbert and Russe systems demonstrating fair and slight agreement respectively. Long axis measurement demonstrated substantial agreement (ICC = 0.701); measuring using the radial or ulnar border of the scaphoid was less reliable than the central axis. Reliability was lower for CT measurements than those made based on X-rays. However the reliability of assessment of sagittal deformity (ICC = 0.201) and comminution (ICC = 0.525) was better on CT than on plain radiographs.
Table 3

Inter observer reliability of the CT based measurements

System

Centre 1

Centre 2

Overall mean

Russe

0.085

0.055

0.070

Herbert

0.389

0.308

0.348

Mayo

0.531

0.553

0.542

Long axis

0.715

0.686

0.701

Sagittal deformity

0.210

0.192

0.201

Coronal deformity

0.212

0.240

0.226

Comminution

0.328

0.722

0.525

Relationship between X-ray and CT based results

The degree of agreement between the X-ray and CT based assessments are shown in Table 4 and Appendix 3. The Mayo demonstrated substantial agreement (kappa = 0.791) compared to the moderate agreement of the Herbert (kappa = 0.591) and the fair agreement of the Russe (0.217). The long axis measurement demonstrated moderate agreement (ICC = 0.571).
Table 4

The degree of agreement between X-ray and CT based measurements

System

Centre 1

Centre 2

Overall mean

Russe

0.027

0.407

0.217

Herbert

0.506

0.676

0.591

Mayo

0.778

0.799

0.788

Long axis

0.594

0.548

0.571

Sagittal deformity

0.251

0.274

0.262

Coronal deformity

0.339

0.355

0.347

Comminution

0.436

0.325

0.381

Intra-observer reliability of X-ray and CT based results

The data describing the inter-observer reliability is shown in Table 5 and Appendix 4. As regards X-ray based assessment, the Mayo classification system showed the highest inter-observer reliability of the established classification systems with almost perfect agreement (kappa = 0.824), with the Herbert and Russe systems both demonstrating substantial agreement. The long axis measurement demonstrated almost perfect agreement whether based on X-ray (ICC = 0.895) or CT (ICC = 0.889).
Table 5

Intra observer reliability of the X-ray and CT based measurements: the ‘long axis’ measurement versus established classification systems.

System

Xray

CT

Russe

0.583

0.550

Herbert

0.694

0.839

Mayo

0.824

0.855

Long axis

0.895

0.889

Discussion

A simple ‘long axis’ measurement of the relative distance of the fracture site along the long axis of the scaphoid demonstrates a substantial level of inter observer reliability which is significantly better than other scaphoid classification systems. We found The Mayo to be the most reliable of among popular scaphoid classification systems with a moderate level of inter observer reliability. The new ‘long axis’ metric can be reliably measured on both X-ray and CT, while its other significant advantage over other classification systems is that it provides a way of quantifying fracture position with significant potential benefits for use in clinical research.

Our results are consistent with previous work in this area showing limited reliability of traditional methods [3, 12, 13]. Desai et al. demonstrated that the Russe and Herbert systems had fair levels of agreement, similar to the level of reliability shown in this study [12], while assessments of fracture level, comminution and displacement showed moderate inter- and intra-observer reproducibility [12]. Bhat et al. demonstrated that measures such as the intra-scaphoid angles (sagittal and coronal), the height-to-length ratio and the dorsal scaphoid cortical angle have poor reproducibility [13]. To our knowledge no system for quantifying how relatively proximal or distal an acute fracture has either been created or assessed for reliability, although a method with demonstrable reliability has previously been described relating to scaphoid non-unions [14]. We found that assessing the position of the fracture in relation to the long axis was reliable when measuring from plain radiographs and CT scans. While the use of CT scans is important when measuring union [6] they are not uniformly used in treatment planning initially and it is useful to have a valid measure of fracture position based on plain radiographs alone. This method can be used to allow analysis of a more continuous measure of fracture site and outcome, or alternatively as a tool to allocate fractures into categories such as ‘proximal 20%’ or ‘proximal third’. When publishing raw data for meta-analysis this method might allow research teams to remove and reassign category boundaries. It is also likely that with greater standardisation of methodology the data will become more reliable [10]. It is important to note that this study is one of reliability and not validity. It is not possible to state whether the new ‘long axis’ measurement is ‘better’ than any other method, this study has simply shown that it is more reliable. Certainly, future research is necessary to demonstrate that the ‘long axis’ measurement is of real clinical meaning, for example in predicting the likelihood of scaphoid fracture union.

Strengths and limitations

This study was pragmatic in terms of how the ‘long axis’ measurement should be performed and yet reliability was high. We would therefore expect reliability of the ‘long axis’ method to be applicable to other centres. There was a range in the level of experience of the observers taking part in the study. We feel that a variable level of seniority and experience gives more generalisable results which easily translate into clinical practice more realistically; any method of assessing acute scaphoid fractures should be simple to use and not require extensive levels of experience. The slightly poorer reliability of the long axis measurement on CT versus X-ray may be related to the freedom of the instructions given to the observers in terms of how to perform this calculation; it may be that future attempts to calculate a long axis measurement on CT need to be more specific and detailed in terms of precisely how observers should go about this.

The most important strength of this study is that the ‘long axis’ method enables the quantification of fracture position. A limitation of the long axis measurement is that it does not describe any information regarding the obliquity of the fracture in any plane, therefore fractures that are particularly oblique to the long axis in the coronal plan may extend deceptively proximally and this will not be communicated by using the central long axis measurement in isolation. It would be possible to calculate the approximate obliquity of the fracture plane using the long axis, radial and ulnar measurements; this is a feasible area for future research. There are also options of using three dimensional CT reconstructions define the fracture plane in multiple dimensions, relative to the long axis.

Conclusions

This study describes a novel pragmatic ‘long axis’ method for the quantification of acute scaphoid fractures which demonstrates substantial inter and intra observer reliability. The ‘long axis’ method offers benefits over traditional classification in terms of reliability, allocation of fractures to anatomical subgroups, and contributing to future debate on the definition and implications of proximal pole injuries.

Clinical relevance

  • The most widely used acute scaphoid classification systems are not particularly reliable and do not quantify the approximate fracture location

  • A simple ‘long axis’ measurement of the relative distance of the fracture site along the long axis of the scaphoid demonstrates significantly better inter observer reliability than the widely used classification systems

  • This novel ‘long axis’ metric can be reliably measured on both plain radiographs and CT, while it provides a way of reliably quantifying fracture position which has significant potential uses in future clinical research

Abbreviations

CT: 

Computed tomography

ICC: 

Intraclass Correlation Coefficient

Declarations

Acknowledgements

We would like to thanks all the staff at both Oxford University Hospitals and Buckinghamshire Health who have helped in any way in the carrying out of this work.

Funding

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

BJFD, AG, and NR contributed to study conception and design, data collection and analysis, drafting of the article and critical revision of the article. EM, JL, and AT contributed to data collection and analysis, and the critical revision of the article. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This work was undertaken as part of service evaluation work reviewing the imaging of acute scaphoid fractures and therefore no ethical approval was required. This service evaluation work aimed to analyse the standard achieved by the current service in terms of information gathered from X-rays and CT scans before scaphoid surgery.

Consent for publication

Not applicable as no consent is required for the publication of audits/service evaluation projects.

Competing interests

No benefits in any form have been received or will be received from a commercial party related directly or indirectly to the subject of this article. The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences (NDORMS), University of Oxford, Botnar Research Centre, Windmill road, Oxford, OX3 7LD, UK
(2)
Nuffield Orthopaedic Centre, Windmill road, Oxford, OX3 7LD, UK
(3)
Frankston Hospital, Frankston, VIC, Australia
(4)
Buckinghamshire Hospitals NHS Trust, High Wycombe Hospital, High Wycombe, Amersham, HP11 2TT, UK

References

  1. Duckworth AD, Jenkins PJ, Aitken SA, Clement ND, Court-Brown CM, McQueen MM. Scaphoid fracture epidemiology. J Trauma Acute Care Surg. 2012;72(2):E41–5.View ArticlePubMedGoogle Scholar
  2. Eastley N, Singh H, Dias JJ, Taub N. Union rates after proximal scaphoid fractures; meta-analyses and review of available evidence. J Hand Surg European Vol. 2013;38(8):888–97.View ArticleGoogle Scholar
  3. Ten Berg PW, Drijkoningen T, Strackee SD, Buijze GA. Classifications of acute scaphoid fractures: a systematic literature review. J Wrist Surg. 2016;5(2):152–9.View ArticlePubMedPubMed CentralGoogle Scholar
  4. Russe O. Fracture of the carpal navicular. Diagnosis, non-operative treatment, and operative treatment. J Bone Joint Surg Amer Vol. 1960;42-A:759–68.View ArticleGoogle Scholar
  5. Herbert TJ, Fisher WE. Management of the fractured scaphoid using a new bone screw. J Bone Joint Surg Br. 1984;66(1):114–23.View ArticlePubMedGoogle Scholar
  6. Dias J, Brealey S, Choudhary S, et al. Scaphoid waist internal fixation for fractures trial (SWIFFT) protocol: a pragmatic multi-Centre randomised controlled trial of cast treatment versus surgical fixation for the treatment of bi-cortical, minimally displaced fractures of the scaphoid waist in adults. BMC Musculoskelet Disord. 2016;17:248.View ArticlePubMedPubMed CentralGoogle Scholar
  7. Heaton DJ, Trumble T, Rhodes D. Determination of the central Axis of the scaphoid. J Wrist Surg. 2015;4(3):214–20.View ArticlePubMedPubMed CentralGoogle Scholar
  8. Guo Y, Tian GL. The length and position of the long axis of the scaphoid measured by analysis of three-dimensional reconstructions of computed tomography images. J Hand Surg Eur Vol. 2010;36(2):98–101.View ArticlePubMedGoogle Scholar
  9. Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMedGoogle Scholar
  10. Tawonsawatruk T, Hamilton DF, Simpson AH. Validation of the use of radiographic fracture-healing scores in a small animal model. J Orthop Res. 2014;32(9):1117–9.View ArticlePubMedGoogle Scholar
  11. Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101–10.View ArticlePubMedGoogle Scholar
  12. Desai VV, Davis TR, Barton NJ. The prognostic value and reproducibility of the radiological features of the fractured scaphoid. J Hand Surg. 1999;24(5):586–90.View ArticleGoogle Scholar
  13. Bhat M, McCarthy M, Davis TR, Oni JA, Dawson S. MRI and plain radiography in the assessment of displaced fractures of the waist of the carpal scaphoid. J Bone Joint Surg Am. 2004;86(5):705–13.View ArticleGoogle Scholar
  14. Trail I, Stanley D. The Scaphoid edited by Slutsky, D. 1st edition. 2010;Chapter 6.Google Scholar

Copyright

© The Author(s). 2018

Advertisement