- Research article
- Open Access
Reliability of measurements on lateral ankle radiographs
BMC Musculoskeletal Disorders volume 17, Article number: 297 (2016)
The aims of our study were to evaluate the validation of measurement of weight-bearing lateral radiographs. Two hypotheses were tested: the measurements on the lateral radiographs are reliable, and a theoretical limit could be identified when a surgeon can “eyeball” an incongruous ankle joint on lateral radiographs.
To test the first hypothesis, 3 experienced ankle surgeons evaluated 50 normal weight-bearing lateral radiographs of patients. The measurements assessed were the tibial lateral surface angle (TLS), the distance from the center of the talar joint circle to the longitudinal axis of the tibia (x) and the displacement from the center of the talar articular joint circle to the center of the distal tibia articular joint circle (d). To test the second hypothesis, we used CAD software to create schematic diagrams on which lateral radiographs of the ankle joint were not parallel (d = 1, 2, 3, 4 mm). Five experienced ankle surgeons were asked to judge whether the ankle articular surfaces were parallel. Intraobserver reliability was determined using the intraclass correlation coefficients (ICCs) and interobserver agreement by the Kendall coefficient of concordance.
First, the intraobserver reliability was high (Cronbach’s alpha >0.80) with regard to radiographic measurements according to the ICC. Significant interobserver disagreement was found (Kendall tauB, p < 0.01) using the Kendall concordance coefficient. Second, when the d-value was 4 mm, all the observers identified the incongruous ankle joint at two separate times.
Consultation with experienced foot and ankle surgeons and precise definitions for lateral measurement assessments do not guarantee a high level of agreement. Surgeons can observe an incongruous ankle joint on lateral radiographs when the d-value is 4 mm.
The ankle sustains the weight of the body, and when a fracture occurs, restoration of the anatomical alignment during treatment is of foremost importance. It is generally agreed that poor ankle articular reduction results in accelerated development of posttraumatic ankle osteoarthritis [1, 2].
Radiographs of the ankle provide information regarding the integrity of the ankle mortise. Numerous linear and angular relationships have been described in the literature with respect to the anteroposterior (AP) and mortise radiograph characteristics of the ankle joint that are used to evaluate anatomic alignment [3–6]. Many criteria have been documented, including a medial clear space (MCS) less than 4 mm and greater than 1 mm, a tibia fibula clear space (CS) less than 5 mm, and tibia fibula overlap (OL) less than 10 mm [7, 8].
In our clinical cases of postoperative ankle fracture in which AP and mortise radiographs show relatively good realignment, some patients still have residual complaints and poor clinical results. In such cases, we have reviewed the roentgenograms and found different deviations of alignment in lateral radiographs. However, there has not been a report on validation of measurements of the lateral view of ankle alignment.
On a lateral radiograph, the tibiotalar articular surfaces should be parallel, with no extrusion of the talus out of the mortise . The distance from the center of the talar joint circle to the longitudinal axis of the tibia (Fig. 1), and x is considered when evaluating the position of the talus in the ankle joint . In the current study, we investigated the displacement from the center of the talar articular joint circle to the center of the distal tibia articular joint circle (Fig. 2) in lateral radiographs, and d was used to visually assess the parallelism of the articular surface.
The aims of our study were to evaluate the validation of measurement of weight-bearing lateral radiographs. We collected precise measurements from weight-bearing lateral radiographs of the ankle and hypothesized that measurements on the lateral radiographs are reproducible and reliable. A theoretical limit could be identified when a surgeon can “eyeball” an incongruous ankle joint on lateral radiographs using the d measurement.
Our study included 80 consecutive patients at our department who had symptoms of chronic pain, functional damage, or post-traumatic ankle arthritis. All the patients had both ankle weight-bearing plain radiographs due to the unilateral lesions of the ankle. The weight-bearing plain radiographs of the ankle were set up for the first patient according to the predefined protocol. The predetermined quality criteria were the same as in previous studies: the medial joint line of the talus had to superimpose on the lateral joint line, and the distal fibula had to project onto the posterior third of the distal tibia . According to the criteria, 30 patients were excluded because of the subtalar position (10 patients) and oblique lateral radiographs (20 patients). The remaining 50 patients (23 men and 27 women) with a mean age of 45 years (range 18–72) were included in our study.
To test the first hypothesis, 50 normal lateral radiographs were digitally collected through the Picture Archiving Communication System (PACS, EBM Technologies Incorporated, Taiwan, China) between July 2015 and January 2016. We first set the scale distance through the PACS system, and then transferred the images to the CAD (computer-aided design, Autodesk Company, California, USA) software for precise measurement. The tibial lateral surface angle (TLS) was measured (Fig. 3). TLS is an angle between the tibial axis and the distal tibia articular surface that is drawn between the anterior and posterior margins of the tibial plafond . We manually traced a sector of a circle to the talar joint and the distal tibia articular joint. The x was defined as the distance from the center of the talar joint circle to the longitudinal axis of the tibia . The d was defined as the displacement of the center of these two different circles.
Before the start of the analysis, five normal weight-bearing lateral radiographs were evaluated together to ensure that the observers drew angles in the same manner. Three experienced foot and ankle surgeons completed our study. For intraobserver reliability, the same radiographs were measured by each observer after two weeks.
To test the second hypothesis, we used the CAD software to create schematic diagrams on which lateral radiographs of the ankle joint surfaces were not parallel (d = 1, 2, 3, 4 mm; Fig. 4). The diagrams corresponded to the supposed clinical scenario (the talus was extruded anteriorly). Five experienced foot and ankle surgeons, who were blinded to the marked diagrams, were selected and asked to view the slide show and mark “yes” or “no” in response to the question “Are the articular surfaces parallel?”
Intraobserver reliability was determined by the intraclass correlation coefficients (ICCs) for continuous data. A Cronbach’s alpha greater than 0.80 indicated perfect reliability. Interobserver agreement was determined by the Kendall coefficient of concordance (Kendall’s W) when measuring the different parameters for each subject. Kendall’s W varies between 0.0 (no agreement) and 1.0 (maximum agreement). The differences were considered statistically significant if the p-value was less than 0.05. All statistical analyses were performed using SPSS version 22.0 software (SPSS Inc., Chicago, IL).
First, in the standard lateral radiographs, the x, d and TLS were measured by three observers in two separate viewings (Table 1). In the two viewings, the first observer’s measurements were 2.12 ± 0.34 mm and 2.24 ± 0.32 mm for the d-value, 2.24 ± 0.43 mm and 2.22 ± 0.54 mm for the x-value and 81.9 ± 1.92 and 83.2 ± 1.96 for the TLS-value. The d-value (3.20 ± 0.27 mm vs 3.12 ± 0.28 mm), x-value (3.13 ± 0.19 mm vs 3.01 ± 0.18 mm) and TLS-value (78.3 ± 3.64 vs 82.2 ± 3.68) by the second observer. The d-value (4.23 ± 0.26 mm vs 4.33 ± 0.25 mm), x-value (2.07 ± 0.21 mm vs 2.11 ± 0.20 mm) and TLS-value (79.1 ± 3.67 vs 81.1 ± 3.69) by the third observer.
The intraobserver reliability, as determined by the ICC, was very high with regard to radiographic parameters (Table 2). The intraobserver reliability across three observers yielded an alpha statistic greater than 0.8, indicating perfect consistency in the observers’ evaluation of identical radiographs in two separate viewings. The interobserver agreement between three foot and ankle surgeons was significantly different for the x-value, d-value and TLS in two separate measurements (Table 3). These results show that the measurements of the weight-bearing lateral radiographs showed incomplete agreement for all radiographs evaluated.
Second, five observers evaluated schematic diagrams with different d-values in two separate viewings. When the d-value was 1 mm or 2 mm, all the observers identified the congruous ankle joint on lateral radiographs in both viewings. When the d-value was 3 mm, only two observers identified the incongruous ankle joint, each in one viewing. When the d-value was 4 mm, all the observers identified the incongruous ankle joint in both viewings. These results showed that a theoretical d-value of 4 mm enabled surgeons to “eyeball” an incongruous ankle joint on lateral radiographs.
Our study showed the outcomes of precise measurements of weight-bearing lateral radiographs, including the x-value, d-value and TLS. Significant interobserver disagreement was found using the Kendall concordance coefficient. The measurements of the lateral radiographs were not reliable. When the d-value was 4 mm, all the observers identified the incongruous ankle joint in two separate viewings.
Malalignment of the anatomical axis of the ankle joint may alter the normal load distribution and articular congruency, resulting in chronic pain, functional damage, and, ultimately, post-traumatic ankle arthritis [12–14]. Therefore, successful restoration of anatomical alignment with full mortise congruency and joint stability is vital to the treatment of ankle fractures.
It is well known to orthopedic surgeons that poor articular reduction leads to accelerated development of posttraumatic ankle osteoarthritis . Pagenstert et al.  reported that the mid-axis of the tibia passes through the center of talar joint surface on a standing lateral ankle radiograph, but did not report any measurements. Magerkurth et al.  reported the x-value of a normal ankle joint.
In our study, we attempted to evaluate the reliability of a precise measurement on lateral radiographs by testing two hypotheses: 1) measurements on lateral radiographs are reliable and 2) a theoretical limit could be identified at which a surgeon can “eyeball” an incongruous ankle joint on lateral radiographs. The first hypothesis was rejected. The intraobserver reliability was greater than 0.8, indicating perfect consistency in the observers’ evaluation of identical radiographs in two separate viewings. However, the measurements for all three values—x, d and TLS—were not reliable. The significance of this finding, which was supported by lack of interobserver reliability, is far-reaching. It questions the validity of using measurements to determine whether an ankle joint is congruent. In one report, the mean x-value for a normal ankle joint was 1.7 mm; however, a variation of more than 10 mm may be found .
Based on our findings, the second hypothesis was validated. A lateral talar displacement, by even 1 mm, will produce a 42 % reduction in the area of tibiotalar contact, leading to degenerative arthritis . Although the small talar displacement led to early ankle osteoarthritis, all observers identified the congruous ankle joint on lateral radiographs when the d-value was 1 mm or 2 mm. It seems clear that a theoretical d-value of 4 mm could be identified when a surgeon can “eyeball” an incongruous ankle joint on lateral radiographs. The ability to visually detect a minimum d-value of 4 mm is also clinically useful. When surgeons are able to recognize during an operation that the articular surfaces are not parallel, it means that the d-value is more than 4 mm. This suggests that surgeons need to reexamine the impact of articular congruity.
One study reported that displaced osteochondral fragments of 5 mm in width were not consistently recognizable on lateral fluoroscopic radiographs . In that study, the 5 mm malreduction was in the sagittal plane of cadaveric specimens, but we first reported the d-value in lateral radiographs and used it to assess the parallelism of the articular surfaces in the coronal plane of the schematic diagrams.
In our study, accurate assessment of tibiotalar displacement in the lateral view depended on accurate weight-bearing lateral radiographs. It would be very important to obtain such radiographs intraoperatively or immediately after surgery when this information would be of greatest value in preventing later problems. Therefore, we suggest that the ankle position should be neutral using C-arm monitoring during or immediately after surgery in order to obtain normal lateral radiographs according to the above criteria.
Our study had two limitations. First, this is an artificial scenario to evaluate whether the ankle articular surfaces are parallel. Second, our measurements depended on good radiographic technique. Poor radiographic technique may contribute to diagnostic error by invalidating established measurements.
We analyzed the outcomes of precise measurements using a weight-bearing lateral view, including the x-value, d-value and TLS. Input from experienced foot and ankle surgeons could not guarantee a high level of agreement. Surgeons could observe an incongruous ankle joint on lateral radiographs when the d-value was 4 mm. However, further investigation is needed to determine the relationship between articular reduction and lateral measurements in the ankle.
AP, anteroposterior; CAD, computer aided design; CS, clear space; ICCs, intraclass correlation coefficients; MCS, medial clear space; OL, overlap; PACS, Picture Archiving Communication System; TLS,tibial lateral surface
Horisberger M, Valderrabano V, Hintermann B. Posttraumatic ankle osteoarthritis after ankle-related fractures. J Orthop Trauma. 2009;23(1):60–7.
Valderrabano V, Horisberger M, Russell I, Dougall H, Hintermann B. Etiology of ankle osteoarthritis. Clin Orthop Relat Res. 2009;467(7):1800–6.
Weber BG, Simpson LA. Corrective lengthening osteotomy of the fibula. Clin Orthop Relat Res. 1985;199:61–7.
Davis JL, Giacopelli JA. Transfibular osteotomy in the correction of ankle joint incongruity. J Foot Ankle Surg. 1995;34(4):389–99.
Nielson JH, Gardner MJ, Peterson MG, Sallis JG, Potter HG, Helfet DL, Lorich DG. Radiographic measurements do not predict syndesmotic injury in ankle fractures: an MRI study. Clin Orthop Relat Res. 2005;436:216–21.
Schuberth JM, Jennings MM, Lau AC. Arthroscopy-assisted repair of latent syndesmotic instability of the ankle. Arthroscopy. 2008;24(8):868–74.
Mont MA, Sedlin ED, Weiner LS, Miller AR. Postoperative radiographs as predictors of clinical outcome in unstable ankle fractures. J Orthop Trauma. 1992;6(3):352–7.
Shah AS, Kadakia AR, Tan GJ, Karadsheh MS, Wolter TD, Sabb B. Radiographic evaluation of the normal distal tibiofibular syndesmosis. Foot Ankle Int. 2012;33(10):870–6.
Knupp M, Bolliger L, Hintermann B. Treatment of posttraumatic varus ankle deformity with supramalleolar osteotomy. Foot Ankle Clin. 2012;17(1):95–102.
Magerkurth O, Knupp M, Ledermann H, Hintermann B. Evaluation of hindfoot dimensions: a radiological study. Foot Ankle Int. 2006;27(8):612–6.
Lee WC, Moon JS, Lee HS, Lee K. Alignment of ankle and hindfoot in early stage ankle osteoarthritis. Foot Ankle Int. 2011;32(7):693–9.
Brown TD, Johnston RC, Saltzman CL, Marsh JL, Buckwalter JA. Posttraumatic osteoarthritis: a first estimate of incidence, prevalence, and burden of disease. J Orthop Trauma. 2006;20(10):739–44.
Giannini S, Buda R, Faldini C, Vannini F, Romagnoli M, Grandi G, Bevoni R. The treatment of severe posttraumatic arthritis of the ankle joint. J Bone Joint Surg Am. 2007;89 Suppl 3:15–28.
Giannini S, Faldini C, Acri F, Leonetti D, Luciani D, Nanni M. Surgical treatment of post-traumatic malalignment of the ankle. Injury. 2010;41(11):1208–11.
Pagenstert G, Knupp M, Valderrabano V, Hintermann B. Realignment surgery for valgus ankle osteoarthritis. Oper Orthop Traumatol. 2009;21(1):77–87.
Collins MS. Imaging evaluation of chronic ankle and hindfoot pain in athletes. Magn Reson Imaging Clin N Am. 2008;16(1):39–58. v-vi.
Ramsey PL, Hamilton W. Changes in tibiotalar area of contact caused by lateral talar shift. J Bone Joint Surg Am. 1976;58(3):356–7.
Graves ML, Kosko J, Barei DP, Taitsman LA, Tarquinio TA, Russell GV, Woodall Jr J, Porter SE. Lateral ankle radiographs: do we really understand what we are seeing? J Orthop Trauma. 2011;25(2):106–9.
The authors gratefully acknowledge all collaborating researchers in collecting information during this study. We would also like to thank the subjects whose participation made this investigation possible.
This study was supported in part by a research grants from National Natural Science Foundation of China grants (No. 81272051).
Availability of data and materials
All relevant data are freely available to any scientist wishing to use them for non-commercial purposes, without breaching patient confidentiality.
Changjun Guo participated in the analyses, carried out the interpretation of the results and drafted the manuscript. Yuan Zhu and Mu Hu made substantive intellectual contributions to the analyses and the interpretation of the results. Xiangyang Xu and Lianfu Deng designed the plan of the study, supervised data collection and critically reviewed the manuscript. All authors read and approved the final manuscript.
The authors have no conflict of interest.
Ethics approval and consent to participate
The first hypothesis for our study was approved by the Ruijin hospital ethics committee, Shanghai JiaoTong University School of Medicine. Written consent was provided by participants to be included in the study.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Guo, C., Zhu, Y., Hu, M. et al. Reliability of measurements on lateral ankle radiographs. BMC Musculoskelet Disord 17, 297 (2016). https://doi.org/10.1186/s12891-016-1150-4
- Lateral radiographs
- Interobserver study