The value of conventional radiographs for diagnosing internal fixation-associated infection

Abstract

Background

The aim of the study is to  assess the diagnostic value of preoperative conventional radiographs for diagnosing infection associated with internal fixation devices.

Methods

We prospectively collected data of patients undergoing removal of internal fixation devices for any reason. Infection was diagnosed in case of purulence, sinus tract, positive histopathology and/or positive peri-implant tissue or sonication fluid culture. In radiographs radiolucent lines, implant breakage or displacement, or periosteal reaction were assessed. White blood cell count (WBC) and serum C-reactive protein (CRP) were determined at admission.

Results

We included 421 surgeries in 380 patients (median age 53.6 years, range 11–98 years), mainly indicated for infection (24.9%), nonunion (20.0%) and symptomatic implants (13.5%). Radiologic signs of infection included radiolucent lines (11.4%); implant breakage (12.4%) or displacement (10.7%); and periosteal reaction (7.1%). Infection was confirmed in 116 cases (27.6%). Only radiolucent lines (OR = 1.86 [95%CI: 1.00–3.38]) and periosteal reaction (OR = 2.48 [95%CI: 1.17–5.26]) were associated with infection, with a low sensitivity (16.4 and 12.1%, respectively), and high specificity (90.5 and 94.8%, respectively). Preoperative WBC and CRP had a sensitivity of 23.0 and 35.3%, and specificity of 91.7 and 89.5%, respectively.

Conclusions

Radiological signs suggestive of infection were uncommon. Radiolucency and periosteal reaction were associated with infection, though with low sensitivity.

Background

Diagnosing internal fixation-associated infections preoperatively may be challenging, as investigation of body fluids such as synovial fluid in periprosthetic joint infection is not possible. Conventional radiographs are usually the first diagnostic investigation before surgery, including in suspected infection [1, 2]. However, their diagnostic accuracy for infection are limited compared to other imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI), particularly in chronic low-grade infections [3]. Suggestive radiographic signs for infection after internal fixation are radiolucency, implant loosening, sequestration, and lack of progression of bone healing (i.e. nonunion), as well as periosteal bone formation, as determined on a consensus meeting of the international expert group on fracture-related infections defining confirmatory and suggestive criteria for infection [4, 5].

In this study we evaluated the diagnostic accuracy of individual findings of conventional radiographs for the diagnosis of infections after internal fixation, and  compared its performance with that of laboratory biomarkers such as preoperative serum C-reactive protein (CRP) concentration and white blood cell (WBC) count.

Materials and methods

We reviewed consecutive patients in whom an orthopaedic internal fixation device (or part of it) initially inserted for any indication (fractures / elective orthopaedic surgery) was removed for any (presumed septic or aseptic) reason, between December 2014 and December 2017. Data was reviewed from a prospective database collected in a tertiary hospital. Internal fixation devices of any type were included, excluding arthroplasties and spinal and craniofacial fixations. Patients without recent conventional radiographs were excluded. Informed consent was obtained from all study participants included in this database study. In the case of minors (age below 18 years), the informed consent was obtained from a parent and/or legal guardian of the participant.

Internal fixation devices were removed in 473 surgeries from 430 patients. Recent radiographs were unavailable for 52 surgeries in 50 patients, mostly due to lack of digitization in the institution’s electronic health record among patients referred from other clinics. Thirty-three patients had two surgeries and four patients had three surgeries, resulting in 380 patients and 421 surgeries for analysis (Fig. 1). The term case indicates one surgery in one patient; thus, one patient could have several cases included for analysis.

Fig. 1

Patient selection and diagnostic flow chart

We collected data regarding patient demography, index surgery, implant type, and revision surgery performed. Serum CRP concentration and WBC count within the week before surgery were documented, if available. Abnormal values were ≥ 10 mg/l for CRP levels and ≥ 11,000 leukocytes/mm³ for WBC count [6, 7].

Radiographs obtained up to 4 weeks before surgery were evaluated for osteolysis around the implant or at the fracture site (e.g. radiolucent lines of 2 mm of more or progression in successive radiographs) [8], implant displacement (e.g. screw back-out or migration), implant failure or breakage, and presence of periosteal reaction, as previously described [4, 5] (Figs. 2 and 3). Two orthopaedic surgeons, blinded to the patients’ infection status, analysed the radiographs independently. In case of disagreement, the images were re-examined until reaching an agreement.

Fig. 2

Postero-anterior (a) and lateral (b) radiographs of a chronic internal fixation related infection due to Pseudomonas aeruginosa following a Gustilo III-C open fracture of the radial diaphysis in a 62-year-old male. Note the radiolucent line surrounding the plate and the screw backout

Fig. 3

Detail of a postero-anterior standing radiograph of both feet following first metatarsophalangeal joint arthrodesis, in a 48 year-old female. Fusion of the hallux was achieved on the right foot but not on the left. Note the radiolucent line surrounding the implants in the metatarsal end of the fusion, and the periosteal reaction around the screw head. Revision surgery showed the presence of coagulase-negative staphylococci

An interdisciplinary team including an infectious diseases specialist and an orthopaedic surgeon classified each case. Implant-associated infection was defined with the presence of at least one of the following criteria: (i) purulence around the implant and/or a sinus tract communicating with the implant, and/or implant on view; (ii) histology showing inflammation in periimplant tissue [9, 10]; (III) positive culture of periimplant tissue or sonication fluid, as defined below. These criteria were adapted from the Infectious Diseases Society of America (IDSA) criteria for periprosthetic joint infections [11] used in the original trial protocol, in line with the recently proposed criteria for fracture-related infection [4]. Acute infections were defined as those less than four weeks postoperatively, or less than three weeks in acute haematogenous cases. Infections occurring beyond these periods were considered chronic. If infection was suspected preoperatively as per medical records, it was defined as "suggestive"; if infection could not be confirmed after surgery, it was analysed among the aseptic cases.

Periimplant tissue (bone or soft tissue) was obtained at the discretion of the operating surgeon. Tissue cultures were considered positive if (i) a highly virulent organism was identified by culture from ≥1 deep tissue sample or (ii) a phenotypically indistinguishable low-virulence pathogen [11, 12] was identified by culture from ≥2 deep tissue samples. Sonication of explanted devices was performed in the microbiology lab as part of standard procedure [13]. Sonication culture was considered positive if there was growth of ≥1 CFU/ml of a highly virulent organism or > 50 CFU/ml of a low-virulent organism [14].

Statistical analysis

Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, positive and negative likelihood ratio (PLR and NLR, respectively) and diagnostic odds ratio (DOR) of each diagnostic method (conventional radiology, laboratory markers, and microbiological tests) were calculated. For continuous variables, Receiver Operating Characteristic (ROC) curves were plotted and the Area Under the Curve (AUC) calculated, as well as Youden’s J Index, the threshold with a test’s maximum combined sensitivity and specificity. After confirming normal distribution, continuous variables were compared with Student’s t-test. Correlation of each diagnostic method with infection was analysed using chi-square tests. Subgroup analysis was performed for acute vs. chronic infections and for infected vs. aseptic nonunions. For variables with missing data such as tissue cultures, only cases with complete data were considered. Significance was set to p <  0.05 (two-sided). Data was analysed using IBM SPSS Statistics v. 20. The 2015 STARD guidelines [15] were used as reference for analysis and reporting of the results.

Results

The patient median age was 53.6 (range, 11–98) years; 216 (56.8%) were male. Age and sex were similar for fracture vs. non-fracture cases, nonunion vs. consolidated cases, or acute vs. chronic infections. Table 1 summarises the baseline characteristics of the surgery performed. Infection was suspected preoperatively in 105 (24.9%) cases; 50 cases (11.9%) had a sinus tract. All retrieved implants were sonicated. An average of 2.5 ± 2.0 intraoperative deep tissue samples were obtained; ≥3 samples were obtained in 118 (44.7%) surgeries, and none were taken in 16.2%. Infection was confirmed in 116 cases (27.6%). In 26 cases (6.2%) preoperatively suspected infection could not be confirmed and were considered aseptic cases in the analysis.

Table 1 Baseline characteristics of the surgery performed

Table 2 summarizes the frequencies of the radiological and non-radiological findings, their sensitivity, specificity, PPV and NPV, likelihood ratios, and their DORs. Radiological findings had a low sensitivity, with acceptable specificity. Furthermore, it shows the performance of laboratory tests, tissue cultures and culture of sonication fluid as well as combined microbiology a. Radiographic findings were: periimplant radiolucency (48 cases, 11.4%), periosteal reaction (30 cases, 7.1%), and implant breakage or (52 cases, 12.4%) and displacement (45 cases, 10.7%). Only radiolucent lines (p = 0.047; OR = 1.9 [95% CI 1.0–3.5]) and periosteal reaction (p = 0.015; OR = 2.5 [1.2–5.3]) were associated with infection. Sensitivity of radiolucency and periosteal reaction were low (16,4% [95% CI: 10.2–24.4%] and 12,1% [95% CI: 6.1–18.4%], respectively), and specificity acceptable (90.5% [95% CI: 86.6–93.5%] and 94.8% [95% CI: 91.6–97.0%], respectively).

Table 2 Diagnostic performance of radiological and non-radiological findings for the diagnosis of infection (overall cohort)

Preoperative blood analysis was performed in the week preceding surgery in 286 (67.9%) cases. WBC counts were higher among infected patients (8903 ± 3.144 vs. 7399 ± 2574 leukocytes/mm3; p < 0.001), as well as CRP values (38.4 ± 66.8 mg/l vs. 10.2 ± 34.1; p < 0.001). The presence of infection was associated with increased WBC (p = 0.001; DOR = 3.2 [1.6–6.5]), but elevated CRP concentrations were more useful (p < 0.0001; DOR = 4.0 [2.3–7.7]). The AUC for the WBC count and the CRP value were 0.639 and 0.697, respectively. Youden Indexes were highest at ≥7.120 leukocytes/mm3 for WBC count (Youden = 0.23; 68.9% sensitivity and 54.1% specificity), and ≥ 4.25 ml/l for CRP concentrations (Youden = 0.32; 68.8% sensitivity and 63.2% specificity).

Tissue cultures were positive in 94 infected cases (sensitivity 84.7%, specificity 84.5%), while a positive sonication culture increased the odds of infection (DOR = 28.9; sensitivity 92.2%, specificity 70.8%). The combination of tissue cultures and sonication yielded the highest sensitivity (96.6%) and diagnostic accuracy (99.1%) of any of the tests evaluated. The number of tissue samples taken was higher among cases in which infection was confirmed than in aseptic cases (3.3 [SD 2.1] samples vs. 2.2 [SD 1.8] samples). Less than three samples were taken in 233 cases (55.3%); infection was confirmed in 43 of these, in 23 based on sonication fluid cultures. Of the 68 cases without tissue samples, five were considered infected (one based on the presence of a sinus tract, and four based on sonication fluid culture). Histological data was not available for analysis; however, no cases were diagnosed based on histological reports alone.

Acute vs. chronic infections

Of the diagnosed infections, 30 (25.9%) were considered acute, and 86 (74.1%) chronic. Radiologic findings were more common in chronic infections (Table 2), but only radiolucency and periosteal reactions were significant, with a slightly higher sensitivity (20.9 and 15.1%, respectively; Table, Supplemental Digital Content 1). We could not find associations between radiologic findings and acute infection, though the number of cases with observed findings was very low. Diagnostic accuracy of non-radiological findings (laboratory and microbiology tests) was lower for chronic infections than for acute infections (Tables, Supplemental Digital Content 1 and 2). Average CRP values were higher in acute infections (84.4 ± 98.7 [acute infections] vs. 23.8 ± 42.1 mg/l [chronic infections]; p < 0.001), as were WBC counts (11.110 ± 3.361 vs. 7.969 ± 2.551 leukocytes/mm3; p < 0.001). Though CRP values were higher in chronic infections than aseptic cases (p = 0.008), WBC counts were not significantly different (p = 0.167). The AUC was higher in acute infections (0.808 for WBC and 0.873 for CRP); cutoffs with maximum Youden Indexes for acute infections were ≥ 9.390 leukocytes/mm3 for the WBC count (Youden = 0.50; 72.7% sensitivity and 77.7% specificity), and ≥ 8.95 mg/l for CRP concentration (Youden = 0.64; 83.3% sensitivity and 80.3% specificity).

Nonunions

Of 98 nonunions included, 17 were considered infected. Nonunion was not more common in infected (14.7%) than in noninfected cases (26.6%). All radiologic findings were more common in nonunion cases than in consolidated cases (radiolucency 22.4% vs. 8.0%, implant breakage 27.6% vs. 7.7%, implant displacement 14.3% vs. 9.6%, periosteal reaction 15.3% vs. 4.6%, respectively). Only radiolucency and periosteal reaction remained significant  when comparing septic vs. aseptic nonunions (Table, Supplemental Digital Content 3), with a higher sensitivity than in other analyses (41.2 and 35.3%, respectively). Elevated WBC counts were not associated with infected nonunion. Though CRP levels were higher in infected nonunions, sensitivity was low (46.1%).

Fractures vs. non-fracture cases

No differences were found regarding radiologic findings when comparing cases in which the initial indication for internal fixation was a fracture, compared to non-fracture cases (periimplant radiolucency 10.2% vs. 15.9% [p = 0.067], implant breakage 11.7% vs. 14.8% [p = 0.219], implant displacement 11.4% vs. 8.0% [p = 0.176], periosteal reaction 6.3% vs. 8.0% [p = 0.290], respectively). A subanalysis of the 333 cases in which the initial indication was fracture lost significance for radiologic findings on any type, though analysis was underpowered after removing over one fifth of cases. Similar results and limitations were observed when analysing only certain implant types, such as plates and/or screws.

Discussion

Though consensus guidelines include radiographic findings after internal fixation, the diagnostic value of these findings for infection has not been studied. We found that radiolucency surrounding the implant or periosteal reactions were associated with internal fixation-related infection, while implant breakage or displacement showed no association. Though radiological signs were quite specific, sensitivity was low, suggesting that normal radiographs cannot rule out infection. Radiolucency and periosteal reaction were more likely to be observed in infected cases (PLR 1.7 and 2.3, respectively), particularly in chronic infections (PLR 2.2 and 2.9, respectively) and infected nonunions (PLR 2.2 and 3.2, respectively).

While the consensus group proposed the term “fracture-related infection” [4], the term “internal fixation-related infection” may be more appropriate, as about one fifth of our cases were fixations performed as elective procedures (such as the case described in Fig. 3). Other authors used the term “Device-related infections” in contrast to prosthetic joint infections, grouping fracture- and non-fracture cases [16]. No differences were found when evaluating fracture vs. non-fracture cases or cases with a certain type of implant, such as plates and/or screws, or intramedullary nails.

Patients with acute infections or with revision surgery shortly after initial surgery (due to fracture malposition or as planned removal) may not have developed radiological changes yet. Significance was lost when examining radiographs in acute cases. On the other hand, laboratory and microbiological tests had a higher diagnostic accuracy in acute infections; these are usually not as much a diagnostic challenge as chronic infections since they are most commonly caused by virulent pathogens. Most diagnosed infections were chronic infections suspected preoperatively, or found after revision surgery for indications such as nonunion, osteoarthritis, or removal of symptomatic devices. In these, the time between implant insertion and removal was long enough for these infections to be considered chronic.

Radiological findings significantly associated with infection (periimplant radiolucency, periosteal reaction) reflect changes in the bone itself, while implant-related findings (breakage, displacement) were non-significant. Twenty-six cases in which infection was clinically suspected (nonunion, inflammation, etc.) were considered aseptic according to the predefined criteria used for this study. Clinical signs suggestive of infection are nonspecific, and the use of validated criteria including microbiology has improved diagnostic accuracy of implant-associated infections [5]. Finally, intraoperative tissue samples were obtained at the surgeons’ discretion, conditioned by the preoperative indication for implant removal. Less than three tissue samples were taken in 55.3% of cases, and none in 16.2%.

We cannot exclude having missed some cases of implant-associated infection. We were unable to follow the 279 cases in which infection was excluded, and some cases could have developed infection following the revision surgery: this could be because the infection was always present (e.g. a false negative), or because it appeared newly as a complication following the revision surgery. However, the criteria used are based on diagnostic criteria sufficiently validated elsewhere [4, 11], and the lack of positive cultures in patients in whom infection was not suspected preoperatively strongly suggest absence of infection. Of the cases in which less than the three tissue samples were taken, over half of the infections were diagnosed based on sonication alone; we believe standardized sonication of all retrieved implants, regardless of surgical indication, can detect infections that would otherwise go undetected. The strength of this study lies in that it involves one of the largest cohorts of internal-fixation-related infections recorded to date. The surgeons evaluating the radiographs were blinded to the infection status, and the definition of infection was in accordance with internationally accepted guidelines [4, 5, 11].

Previous studies analysed radiological signs in orthopaedic infections including prosthetic joint infections, spinal infections, and paediatric acute haematogenous osteomyelitis; cases were included based on the suspicion of infection. We are not aware of any study analysing all internal fixation device retrievals, regardless of indication, as would be necessary to study diagnostic accuracy. In 1985, Al-Sheikh [17] compared bone scintigraphy and radiography for diagnosing bone infections in 21 orthopaedic patients, reporting 60% sensitivity and 67% specificity. Tumeh [18] examined radiographs in 104 patients with chronic osteomyelitis following fractures, surgery or infection, in search of bone destruction (erosion, lucency around implants), periosteal reaction, sequestra, soft-tissue swelling, cartilage-space narrowing, and changes from prior examinations, with a 37% sensitivity and 84% specificity.  They found some parameters were difficult to recognize and could reflect reactions to the surgery or the fracture itself. In 11 patients evaluated for the presence of spine infection using radiographs and bone scintigraphy, Whalen [19] reported 78% sensitivity and 100% specificity. In a more recent series of paediatric patients with acute haematogenous osteomyelitis, the sensitivity and specificity of early X-rays (performed at admission) were 16 and 96% [20] (Table 3). The relative sensitivity and specificity of some of these studies can also be affected by small sample sizes, leading to wide confidence intervals, and a certain level of selection bias due to their inclusion criteria.

Table 3 Sensitivity and specificity of conventional radiographs reported by other authors and in the current series

Periprosthetic bone loss has been hypothesized to be mediated through osteoclast activation over several pathways originating in cytokine expression by neutrophil granulocytes [21]. Local bone loss leads to loss of mechanical stability and of fixation, observed as displacement of internal fixation and screw backout, which can lead to implant failure and breakage. The periosteal reaction observed in bone infections is due to the elevation of the periosteum with increased pressure. In our series, nonunions were not more common in septic vs. aseptic cases; though infection may impede fracture healing, the sole presence of a nonunion could not be used as a marker for infection. Radiolucency and periosteal reaction remained associated with infection in nonunions, with a higher sensitivity than for the overall analysis.

We do not analyse erythrocyte sedimentation rates (ESR) routinely anymore in our insitution, as it was replaced by newer markers such as CRP levels, reported to be more useful for the diagnosis of osteoarticular infection [22]. Other studies described a similar accuracy of serum markers; inclusion of different types of musculoskeletal infection (osteomyelitis, periprosthetic infection, acute/chronic infection, etc.) and cut-off points [22, 23] limit comparability. The pattern observed in our study was similar to another study analysing laboratory markers in nonunions [24]. Another study also observed a limited value of serum inflammatory markers for diagnosing fracture-related infections [25], with a sensitivity of 38% (using a threshold of only 5.0 mg/l); the AUC was nearly identical to our study.

The diagnostic accuracy of sonication and tissue cultures for fracture-related infection in contrast to prosthetic joint infection has been an area of recent interest [2, 16, 26]. A systematic review by Onsea et al. [26] showed that evidence was scarce, and lower for sonication alone than for tissue cultures, in contrast to our study, though other authors cultured a minimum of three tissue samples [16]. As shown in previous studies, the combination of sonication and tissue cultures yielded the highest diagnostic accuracy [16, 27,28,29,30]. Though antibiotics should be withheld prior to microbiological sampling [4], culture of sonicate fluid could improve the diagnostic accuracy under antimicrobial pressure [27]. Biofilm-associated infections elicit a reaction from bone, even under suppressive antimicrobial treatment [31].

Our study has several limitations. First, the histopathological definition criteria (i.e. presence of ≥5 granulocytes per high-powered field [32]) was implemented later during the study, therefore, histopathology findings are missing in most cases. The index test (radiography) was performed within four weeks of the reference test (confirmation of infection). Second, 50 patients (9.7% of the initial cohort) were excluded due to lack of conventional X-rays within four weeks before surgery. Furthermore, serial radiographs were not analysed in our series, as they were unavailable in many cases that consulted for implant removal and were not managed initially in our centre. Third, only about two thirds of patients had laboratory tests from the week before surgery, as we receive referrals from a wide geographic area and data is not always included in our electronic health records. Fourth, we chose not to include findings such as soft tissue swelling or sequestration because of the subtleness of the former and the superposition of the metallic implants in the latter. Fifth, other imaging modalities such as CT and MRI were not routinely performed prior to implant removal, due to radiation dose and costs. Therefore, we are unable to assess their diagnostic accuracy in this setting. We believe ordering updated conventional X-rays and laboratory tests to all patients presenting for implant removal could increase the likelihood of detecting implant-associated infection; comparison of serial radiographs and using more advanced imaging modalities would increase diagnostic accuracy and improve upon the values observed in our study, taking into account the limitations mentioned.

In conclusion, radiologic signs of infection are uncommon, even in cases of confirmed infection. Recent conventional X-rays should be reviewed prior to implant removal in search of subtle radiographic changes. In particular, (a) radiolucency surrounding the implant and (b) the presence of a periosteal reaction were associated with infection, with a low sensitivity and high specificity, making them useful for ruling in patients in whom infection is likely. However, though they are less common in non-infected cases, the absence of these radiological changes does not rule out infection. Therefore, we recommend obtaining (c) tissue samples for culture and histology and (d) sonication of the retrieved implants if infection is suspected, especially if new implants are to be used in the revision surgery.