Skip to main content

Cross-cultural adaptation and validation of the Spanish version of the Oxford Hip Score in patients with hip osteoarthritis

Abstract

Background

Osteoarthritis (OA) of the hip is a disease that entails a major burden for patients and the society as a whole. One way of measuring this burden for the patient is through impact on Health-related Quality of Life (HRQL). The Oxford Hip Score (OHS) is a well-known tool to measure HRQL in patients with OA of the hip. This study aims to assess the psychometric properties of the Spanish-adapted version of the OHS, including its reliability, validity, and sensitivity to change.

Methods

Prospective observational study that included 361 patients diagnosed with hip OA (according to the criterion of the American College of Rheumatology) from 3 different Spanish regions. Their HRQL was assessed using a generic questionnaire, the EQ-5D-5 L, and two specific ones (the Western Ontario and McMaster Universities Osteoarthritis Index, WOMAC, and the OHS) adapted to Spanish. There was a follow-up period of 6 months, and the acceptability, psychometric properties, presence of ceiling and floor effects, validity, reliability, and sensitivity to changes of the OHS were measured.

Results

The OHS was fully answered in 99.4% of cases with no indication of ceiling or floor effects. Its factor structure can be explained in a single dimension. Its discriminative capacity was very good compared to the groups generated by the WOMAC and the EQ-5D-5 L. The correlation between the OHS and dimensions of the WOMAC or EQ-5D-5 L utilities was ≥0.7. Excellent test-retest reliability (ICC = 0.992; CI95%: 0.994–0.998) and internal consistency (Cronbach’s α = 0.928) were observed. The minimal clinically important difference (MCID) was 7.0 points, and the minimum detectable change (MDC) was 5.5 points. The effect size for moderate improvement in perceived HRQL was 0.73, similar to that of WOMAC dimensions and higher than the EQ-5D-5 L.

Conclusions

The Spanish-adapted version of the OHS is a useful, acceptable tool for the assessment of perceived HRQL in patients with hip OA, and has psychometric properties similar to those of the WOMAC that allow for discriminating both a patient’s condition at a given moment and changes that can occur over time.

Peer Review reports

Background

Osteoarthritis (OA) is the most frequent joint disease, manifesting when structural changes in the joint cause pain and functional impairment. The prevalence of hip OA is high and is augmenting in developed countries due to increases in life expectancy and obesity pandemics [1, 2]. In a literature review by Pereira et al., the prevalence of hip OA was reported to be 10.9% (CI 95%: 10.6–11.2), although the figure was higher when based on radiological diagnosis rather that clinical evidence [3]. The prevalence of hip OA in Spain has been estimated to be 0.9% in the population >40 years of age [4], and 7.4% for people >60 years of age [5].

Hip OA greatly impacts the patient’s perception of health-related quality of life (HRQL) [6], and entails a great burden for the individual and the society as a whole. Studies of international scope have estimated that OA of the knee and hip constitute 0.7% of all disability adjusted life years (DALY) [7]. The DALYs lost due to hip OA increased 60% between 1990 and 2010 [8]. In the USA, the yearly expenditure resulting directly from hip OA was calculated to be $2827 per patient over 65 years of age (in the 1990s), and indirect costs can exceed that figure [1]. In Spain, the health-related expenses derived from OA can amount to 0.25 − 0.50% of the country GDP [9]. A study performed in Spain in 2007 estimated a yearly expenditure of €1500 per patient with hip or knee OA, 86% of which were direct costs [10].

It is necessary to incorporate the patient’s self-perception of health condition to the study of chronic diseases such as OA, both for appraising their current condition and the results of interventions [11]. The HRQL is a measure of the patient’s perception of their health condition that can be assessed via “generic” or “specific” tools. Generic tools are used to appraise health condition for any typology of patients, whereas specific tools are devised for a specific disease (e.g., OA of the hip), population segment (young vs. old), or type of problem (pain, dyspnea, et cetera) [12].

In the case of hip OA, there are several specific tools to evaluate HRQL, such as the Harris Score [13], the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) for the assessment of OA of lower limbs [14], the Hip disability and Osteoarthritis Outcome Score (HOOS) for patients undergoing conservative treatment or surgery, the Hip Outcome Score [15] for patients about to undergo arthroscopy, or the Oxford Hip Score (OHS). Of them, only the WOMAC [16] and the Hip Outcome Score are validated in Spanish [17].

Although the OHS has been adapted to Spanish, its psychometric properties have not been assessed in the Spanish population setting. The OHS was designed to appraise the impact of total hip replacement surgery and was found to be more accurate than other generic questionnaires for that purpose [18]. Owing to its good psychometric properties, it has been favorably compared to other widely used tools that are more difficult to administer [19]. It has been adapted to Dutch [20], French [21], German [22], Italian [23], Danish [24], Turkish [25], and several Asian languages [26,27,28]. The questionnaire was also adapted to Spanish in Colombia and partially validated, although neither its sensitivity to changes nor factorial structure were checked [29]. Of all the mentioned adaptations, the factorial structure has only been validated by means of a confirmatory factor analysis in the original version of the OHS.

This study aims to assess the psychometric properties of the Spanish-adapted version of the OHS, including its factorial structure and other aspects of reliability, validity, and capacity to detect changes.

Methods

Design

Prospective, observational study, with a follow-up period for the recruited subjects of 6 months.

Sampling and sample size

Opportunistic sampling was performed. Patients diagnosed with hip OA according to the criterion of the American College of Rheumatology [30] were recruited from traumatology, rheumatology, and primary care consultations in Vizcaya, Madrid, and Tenerife. Subjects were included in a consecutive way between January and December 2015. Not understanding Spanish, illiteracy, or being diagnosed with cognitive impairment were considered to be exclusion criteria.

Sample size was calculated on the basis of the most stringent analysis method employed: three hundred patients were estimated necessary to perform a confirmatory factorial analysis (CFA) using a single questionnaire that comprised 12 items [31]. This sample size allowed for estimating intraclass correlation coefficients (ICC) >0.8 with precision values ≥10% [32].

Variables

The following personal characteristics were recorded for all participants: age, gender, body mass index (BMI), arthritis-affected joints, previous joint replacement surgery, and comorbidity, measured using the Charlson’s index [33]. In order to evaluate self-perception of HRQL, patients completed 3 questionnaires in their Spanish-adapted version: a generic one, the EQ-5D with a 5-level scale (EQ-5D-5 L) [34], and two specific ones, the WOMAC [14] and the OHS [18].

The EQ-5D-5 L [34] inquires about current self-perceived health condition and comprises two parts. The first part includes 5 questions on mobility, self-care, performance of daily-life activities, pain/discomfort, and anxiety/depression; each dimension is measured on a scale from 1 to 5; a single weighted score, called the utility index, is then obtained from these 5 questions, so that the greater the score the better the health condition [35]. The second part consists of a visual analogue scale (VAS) ranging from 0 (worst health condition) to 100 (best imaginable health condition).

The WOMAC [14] is a self-completed questionnaire, specifically aimed at patients suffering from OA of the hip or knee. Its multidimensional scale comprises 24 items clustered according to 3 dimensions: pain (5 items), stiffness (2 items), and physical functionality (17 items). A Likert-type scale was used with 5 possible answers to account for the intensity of each item (none, slight, moderate, severe, extreme), so each item receives a score from 0 to 4. The scores are then summed and standardized from 0 to 100 (best to worst), so that the greater the score the worse the patient’s health condition. This questionnaire has been adapted and validated for the Spanish setting [16].

The OHS is a self-administered questionnaire that can be completed via a personal interview or mailed by the patient after completion. It comprises 12 questions, with 5 possible answers each, to assess the patient’s perception of quality of life during the last 4 weeks. It has been employed with patients suffering from hip OA, both to study their baseline condition and to evaluate changes following prosthetic implant. Each answer receives a score from 0 to 4, where 4 is the best possible outcome [36]. A total score is obtained from the sum of all answers, ranging from 0 to 48, where 48 is the best possible outcome. The Spanish-adapted version was developed by performing a translation and linguistic validation using protocols consistent with internationally recognized good-practice guidelines under agreement with Oxford University Innovation ™ (see Additional file 1).

The recruited participants from Madrid were interviewed 7 to 14 days after the inclusion visit and, after verifying that there were no changes in their health condition, the OHS was repeated to check test-retest reliability.

All included patients were interviewed after a 6 months follow-up period: they were asked if they had undergone replacement surgery, all the questionnaires were repeated (EQ-5D-5 L, WOMAC, and OHS), and transition questions were posed to check for changes in their perception of global health.

Statistical analysis

Continuous variables are described by their central tendency and dispersion, whereas qualitative variables are expressed by their percentages. Confidence intervals were set at 95% (CI 95%).

Acceptability and ceiling and floor effects

The number of non-completed questionnaires and unanswered questions was recorded.

Ceiling or floor effects were considered to be present if more than 15% of respondents reported the highest or lowest possible score, respectively [37].

Analysis of psychometric properties

Validity

The construct validity was assessed via an exploratory factor analysis (EFA). Barlett’s test of sphericity and a Kaiser-Meyer-Olkin (KMO) test were performed to evaluate the adequacy of employing such analysis. The null hypothesis of Barlett’s test states that the matrix of observed correlations is a singular matrix. Rejecting the null hypothesis allows for confirming the existence of linear relationships between factors and the explanatory variable. The KMO sampling adequacy test provides a measure of the variance among variables, and values >0.90 are considered optimal [38]. Factor loadings were calculated, with values >0.40 considered to be optimal, and so were communalities, that express the percentage of the item’s variance explained by each of the studied factors.

In order to complement our results and confirm the hypothesis of unidimensionality of the questionnaire, a confirmatory factor analysis (CFA) for categorical variables was carried out. The robust unweighted least squares estimator was used and the following fit indices were calculated [39, 40]: the root mean square error of approximation (RMSEA), for which a value <0.08 was acceptable, and the Tucker-Lewis Index (TLI) and Comparative Fit Index (CFI), both of which had to be >0.95 to be considered satisfactory [41]. Additionally, factor loadings were examined and those ≥0.40 were considered acceptable. The model was considered satisfactory if it surpassed these acceptability criteria.

The validity of the known groups was appraised by comparing the scores obtained in the OHS with each tercile of the EQ-5D-5 L and WOMAC distributions.

Convergent validity was assessed by calculating Pearson’s r or Spearman’s rho, which were then used to find the correlations between the scales of the OHS and those of the WOMAC and the EQ-5D-5 L. A threshold of 0.7 was set [37] for associations to be considered strong.

Reliability

Internal consistency was assessed by calculating Cronbach’s α [42] for the scores obtained at the inclusion visit. This coefficient accounts for internal correlations of all items in a scale, so the greater Cronbach’s α is (range 0.0 to 1.0), the greater the consistency of the scale and the greater the probability that the questionnaire underlies a single dimension. In the case of a unidimensional tool comprising 12 items, Cronbach’s α is required to be >0.85 for the internal consistency to be considered optimal [43].

The test-retest reliability was checked using the ICC for comparing the scores of the test with the retest in the sub-sample from Madrid. According to the suggested classification for different reliability measurements [44], ICC values >0.7 are considered to be acceptable and >0.9 optimal.

Sensitivity to change

The OHS questionnaire was repeated 6 months after the inclusion visit in order to evaluate its capacity to detect changes in the evolution of the disease. Transition questions were posed that inquired about the change in the hip condition perceived by the patient relative to the 6 previous months. Five possible answers (much worse, slightly worse, equal, slightly better, much better) were given and recorded on a scale. These questions aimed at appraising the sensitivity to change of the OHS questionnaire. Transition questions for the WOMAC were answered on the same scale, but they were specific for each of its domains (pain, stiffness, and physical functionality). Correlations between score changes in HRQL questionnaires and transition questions were assessed by calculating Spearman’s rho.

Changes in the OHS and EQ-5D-5 L questionnaires were calculated by subtracting initial from final scores, so positive values indicated an improvement in general condition. This was the opposite for the WOMAC, where final scores were subtracted from initial ones, and therefore positive values also indicated improvement. For each group of patients, baseline scores were then compared to those obtained at the follow-up period of 6 months to check if significant changes had occurred according to the transition questions. For every observed change, the effect size (ES) was calculated as the ratio between the mean and standard deviation (SD). Changes were considered to be moderate for values >0.5, and large for >0.8 [45]. Obtained values of ES were then compared to those of the WOMAC and EQ-5D-5 L scales. Responsiveness parameters were also estimated separately for patients who had suffered a hip arthroplasty and those who did not.

Additionally, the minimal clinically important difference (MCID) and the minimal detectable change (MDC) were estimated. These two measures correlate with responsiveness, but are more clinically oriented and focused at the individual level. The MCID was calculated using the mean change of patients that reported moderate improvement (feeling “slightly better”) at 6 months of the follow-up [46].

The MDC expresses the minimal magnitude of change above which the observed change is likely to be real and not just measurement error. The standard error of measurement (SEM), which represents the amount of error associated with a particular individual’s assessment, was estimated as the square root of the mean square error term from the ANOVA [47, 48]. From the SEM, the MDC was derived as follows [37, 47].

$$ \mathrm{MDC}=\mathrm{SEM} \times \mathrm{z}-\mathrm{score} \times \sqrt{2} $$

A 95% confidence level (MDC95%) was established, corresponding to a z-value of 1.96. The interpretation of MDC95% is that if a patient has a change score equal to or higher than the MDC95% threshold, it is possible to state with 95% confidence that this change is reliable and not the result of measurement error. Finally, to determine if the MCID surpassed the MDC95%, MCID was divided by the MDC95% [49] so that if this ratio exceeded 1, the MCID could be discriminated from measurement error.

All effects were considered statistically significant at p < 0.05.

Results

The study included 361 subjects: 157 from Vizcaya, 124 from Madrid, and 80 from Tenerife. Patients were recruited at primary care (37.7%), traumatology (46.5%), and rheumatology (10.8%) consultations. Women comprised 53.2% (CI 95%: 48.0–58.4%) of the sample and the average age was 67.8 years (CI 95%: 66.7–69.1 years).

Replacement of the contralateral hip had occurred in 17.5% (CI 95%: 13.6–21.4%) of cases. Charlson’s index had an average value of 0.8 points (CI 95%: 0.7–1.0), and mean BMI was 28.2 (CI 95%: 27.7–28.6).

Table 1 shows the outcome expressed by patients for the OHS, WOMAC, and EQ-5D-5 L questionnaires.

Table 1 Scores from the OHS, WOMAC, and EQ-5D-5 L questionnaires

Acceptability and ceiling and floor effects

The obtained data allowed for summarizing the outcome of the OHS questionnaire in 359 cases (99.4%; CI95%: 98.7–100%). Questions 3 and 4 were answered in all cases, and questions 2, 5, 7, 8, and 10 in all but one. Questions 2, 6, and 11 were not answered in 2 occasions, and questions 9 and 12 in 3 occasions. The possible responses were the same for all questions, and so was the possible score range (0 to 4). There was no question for which more than 35% of the responses were concentrated at the top or lowest end of the scale: question 6 obtained the greatest percentage of responses for the lowest score (27.7%), and question 9 for the highest possible score (33.8%). For the total score, there was no aggregation at the low end of the scale and only 0.84% of the responses scored 48 out of 48 possible points in the inclusion visit. This score was reached by 3.08% of the patients that underwent hip replacement in the visit after six months. Hence, the presence of floor or ceiling effects was ruled out.

Validity

In order to study the validity of the construct, an EFA was performed and a unidimensional structure was revealed with a single factor that explained 55.5% of variance (KMO = 0.945, Bartlett’s test of sphericity χ 2 = 2667, 66 degrees of freedom, p <0.001). Every factor loading was >0.50, and communalities were ≥0.40 with the exception of questions 6 and 10 (Table 2).

Table 2 Exploratory factor analysis of the Oxford Hip Score (OHS) items

Fit indices resulting from the performed CFA were adequate (Fig. 1): (a) the RMSEA was 0.082, a very close value to the set threshold of 0.08; and (b) the CFI and TLI were 0.982 and 0.977, respectively, both exceeding the benchmark of 0.95. All factor loadings were statistically significant (p <0.001), ranging from 0.57 to 0.88.

Fig. 1
figure 1

Confirmatory factor analysis for categorical data of the Oxford Hip Score (OHS) questionnaire. Standardized parameters and standard errors are shown. Fit indices are as follows: χ 2 = 174.6, degrees of freedom = 52, p <0.0001; RMSEA = 0.082 (CI 90%: 0.069 – 0.096); CFI = 0.982; TLI = 0.977

Validity of known groups, which is a measure of the questionnaire’s discriminatory capacity, can be observed in Table 3. It shows average scores of the OHS with their CI95% for each tercile of the distributions of the WOMAC and EQ-5D-5 L scales. Differences between the 3 groups are clearly shown by the OHS scores, with average changes of 4.7 to 12.0 points per tercile.

Table 3 Average scores of the OHS. Patients are classified according to the terciles obtained from the WOMAC and EQ-5D-5 L questionnaires

Table 4 shows the correlations between the OHS scores and the WOMAC domains or the EQ-5D-5 L domains, utility index and VAS. Given the different types of scale measures, negative correlations with the WOMAC and positive ones with the EQ-5D-5 L were to be expected. All associations were strong except for the stiffness scale of the WOMAC questionnaire, where the correlation was at the limit of the set threshold, and the EQ-5D-5 L VAS.

Table 4 Correlations between the OHS score and the WOMAC scales or the EQ-5D-5 L

Correlations between the scores of the WOMAC scales on pain, stiffness, and physical functionality and the EQ-5D utilities were −0.769, −0.628, and −0.829, respectively (all values were statistically significant, p <0.001). Correlations between the scores of the WOMAC scales on pain, stiffness, and physical functionality and the EQ-5D VAS were −0.563, −0.410, and −0.560, respectively (all values were statistically significant, p <0.001).

Reliability

Internal consistency was assessed via Cronbach’s α, which was calculated to be 0.928 for the OHS questionnaire. For the 124 subjects that repeated the questionnaire 7 to 14 days after their inclusion in the study, ICC was 0.992 (CI 95%: 0.994–0.998).

Sensitivity to change

A follow-up on 313 subjects took place after 6 months. Of them, 65 had undergone hip replacement surgery and 94 (30.0%, CI 95%: 25.0–35.1%) reported feeling “slightly better” or “much better” on the side of the hip for which they entered the study. Of the follow-up sample, 133 (42.5%; CI 95%: 37.0–48.0%) stated feeling “slightly worse” or “much worse”.

Table 5 shows the mean change in the scores obtained from the employed questionnaires when the patient had perceived a change in their health condition. First, the correlations between score changes between the HRQL questionnaires and transition questions were assessed. The correlation between the change in the OHS score and transition questions was moderate (Spearman’s rho = 0.636, p <0.0001). The correlations between changes in the domains of the WOMAC and specific transition questions were also moderate (Spearman’s rho absolute value between 0.544 and 0.635; p <0.0001)

Table 5 Changes observed in the OHS, EQ-5D-5 L, and WOMAC questionnaires at 6 months of the follow-up period, in patients that reported health condition changes

The ES of the change in the OHS was 0.73 for subjects that reported feeling “slightly better” and 1.71 for those that reported feeling “much better”. Sensitivity to change obtained lower ES values for negative changes, with values of 0.42 and 0.69 in the case of subjects reporting “slightly worse” and “much worse”, respectively. A clear gradient in the scores was observed that depended on the change perceived by the patient, which was significantly different for those feeling “slightly worse”, “slightly better”, and “much better”. There was a small overlap between subjects feeling “much worse” and “slightly worse”. The OHS questionnaire proved to be a more sensitive tool than the EQ-5D-5 L, and similar to the WOMAC.

Table 6 shows the mean change in the scores obtained from the OHS questionnaires for both patients that had undergone hip arthroplasty and those who did not. Results were consistent with those from the whole sample, although improvements perceived by patients who underwent hip arthroplasty were significantly greater.

Table 6 Changes observed in the OHS questionnaires at a 6 months follow-up for patients having undergone hip arthroplasty or not

The average change in the OHS scores was 7.0 points (SD = 9.6) in the case of subjects that felt moderate improvement, which was the figure used for calculating the MCID. The SEM was calculated to be 2.0 and hence, the estimated value of MDC95% was 5.5. The obtained ratio MCID/MDC95% was 1.3.

Discussion

The Spanish version of the OHS is a valid tool for measuring HRQL in patients suffering from hip OA, and is both reliable and sensitive to changes. Additionally, it is very well accepted by the population it addresses, as proven by the extraordinarily high response rate, although in this case it could be influenced by the way in which it was administered, in the clinical setting.

The validity of the OHS has been assessed from different perspectives, although apparent validity was not one of them given it is an adaptation.

The validity of known groups, namely its discriminatory validity, appears to be adequate since scores differ between subjects classified according to their HRQL, via specific or general questionnaires. Significant ceiling or floor effects that could compromise such discriminatory capacity were not found. The presence of floor effect has not ever reported with the OHS. On the contrary, certain studies have observed a ceiling effect in postoperative patients [24], although the majority have not [21, 22, 50]. The previously shown results rule out the presence of ceiling effect, even in patients who had undergone hip replacement, in agreement with the results of the original version [51].

The analysis of convergent validity showed correlations with the specific scales of the WOMAC and the generic scales of the EQ-5D-5 L. Such correlations were stronger than those found between the original questionnaire and generic tools for measuring HRQL [51], and similar or slightly stronger than adapted versions of the OHS to other languages, such as German [22] or Dutch [20].

The construct validity was also part of the validation. The factorial structure of the OHS has been previously discussed, and several authors have proposed to differentiate 2 domains within it: pain and physical functionality [52]. When attempting to check if a single- or double-factor structure worked better, the outcome supported both possibilities, although there were several items that saturated both factors when considering a bidimensional structure [53]. For these reasons and in view of the outcome of the performed EFA, which was similar to other adapted versions [54], a unidimensional structure was tested, which seemed a correct approach for this adaptation given that the values obtained in the CFA were close to the acceptability threshold for the RMSEA and optimal for the TLI and CFI [41].

Cronbach’s α, which accounts for internal consistency, was better than for the original scale at the inclusion visit (0.93 vs 0.84) [55]. Although a very high value of Cronbach’s α could indicate that the items are redundant, this is unlikely to be the case, since it was ruled out by the factorial analysis. This coefficient is useful for estimating reliability, particularly for a unidimensional test. If a test shows a high value of α, then it can be concluded that its variance is largely attributable to general and group factors. When the existence of a single factor has been demonstrated, then Cronbach’s α can be used to conclude that the set of items is unidimensional [43].

Test-retest reliability was measured via ICCs and found to be excellent, with values >0.90 that in a sample of 124 patients allows for classifying the tool as reliable [37]. Reported values of ICC were slightly higher than those found in other studies (range from 0.89 to 0.97) [22,23,24, 27, 50], which may be due to the way in which the OHS score was obtained in the follow-up, namely by telephone interview.

The reliability study of this adapted version of the OHS yielded values of internal consistency and reliability that were similar to another Spanish-validated tool, the Hip Outcomes Score, which is also designed to appraise changes in perceived HRQL by patients following hip surgery [17].

The discriminatory capacity of the questionnaire, which accounts for its potential to discriminate patients in different situations, was satisfactory; however, the tool has also proven its usefulness to study the subject’s perception of change in their own situation, that is, its evaluative capacity is adequate [11]. The instrument was originally designed for this purpose and this study has confirmed the potential of its adaptation to Spanish, not only in patients that undergo hip surgery but also in the short-term evolution of a cohort of patients suffering from hip OA.

The ES for “moderate” positive changes showed values that were slightly under the set threshold of 0.8 points, and similar to those of the WOMAC. The ES for changes following surgery was 1.93 in the validation process of the original questionnaire [56], which is only comparable with improvements in patients that underwent hip replacement (ES = 1.35). The OHS proved to be superior to other questionnaires, like the WOMAC and the generic EQ-5D-5 L, when assessing significant changes, as is the case of hip replacement [51]. In this work, the OHS showed a similar capacity for detecting “moderate” changes compared to the WOMAC, but was slightly better when examining “significant” changes.

For subjects that reported feeling a “moderate” improvement in their condition, MCID was 7.0 points. For the original version of the OHS, MCID was calculated from the scores reported by patients that had underdone hip replacement surgery, and values of 7.5 points were obtained [57]. Using the criterion of estimating MCID as half the SD of the distribution of scores given by subjects that had experienced changes [58], MCID can be calculated to be around 4.8 points. According to this criterion, the values of MCID for the original version would be between 3 and 5 points, similarly to those obtained in our study [36].

In agreement with other studies, the evaluative capacity was greater for detecting positive rather than negative changes [59], although the capacity observed for the OHS to detect negative changes was similar or greater than the WOMAC and, of course, than that of generic questionnaires like the EQ-5D-5 L.

The MDC95% was 5.5 points as calculated from the SEM, a value that is similar to the original questionnaire (MDC90% = 4.85 points) [57]. The MDC represents the lowest score change (at the particular patient level) that is not the result of measurement error of the instrument. The MDC is based on the standard error of measurement, which depends on the accuracy and variability of its components [47], and can be understood as the lowest bound of real change, although it may not indicate clinical significance. The ratio between the MCID and MDC95% was higher than 1, indicating that the MCID can be discriminated clearly from measurement error.

There are some limitations to this work. The studied sample may not be representative of the Spanish population, despite including patients from different geographic regions and at various stages of the disease evolution. On the other hand, the used methodology (the classical test theory), with its assumptions and constraints, entails certain limitations to evaluate psychometric properties; in order to overcome them, the validation process has been complemented by performing a CFA specific for categorical data, which employs statistical analysis to validate a priori made assumptions [39].

Traditionally, the OHS has been used to assess the impact of hip replacement surgery [60] on HRQL, as well as other surgical [50] or non-surgical [23] procedures. Few studies have focused on its discriminatory capacity [25, 29]. This work highlights the discriminatory capacity of the tool and appraises its sensitivity to changes in the general evolution of the disease, including both patients that undergo joint replacement and those who do not. Its usefulness is similar to other instruments having a broad experience of use after being adapted to other languages, like the WOMAC, and displays greater capability to detect changes than generic tools like the EQ-5D-5 L.

Conclusions

The Spanish adaptation of the OHS is a useful instrument to assess perception of HRQL in patients suffering from hip OA, being well-accepted, and with good psychometric properties that support its use for evaluating a patient’s condition at a given moment, and for appraising changes over time.

Incorporating this kind of tools to usual clinical practice will facilitate the valid and reliable evaluation of a patient’s self-perceived health condition and the outcome of interventions, both at the individual and population level.

Abbreviations

BMI:

Body mass index

CFA:

Confirmatory factor analysis

CFI:

Comparative fit index

CI95%:

95% confidence interval

EFA:

Exploratory factor analysis

ES:

Effect size

GDP:

Gross domestic product

HRQL:

Health-related quality of life

ICC:

Intraclass correlation coefficient

KMO:

Kaiser-Meyer-Olkin

MCID:

Minimal clinically important difference

MDC:

Minimal detectable change

OA:

Osteoarthritis

OHS:

Oxford hip score

RMSEA:

Root mean square error of approximation

SEM:

Standard error of measurement

TLI:

Tucker-lewis index

VAS:

Visual analogue scale

WOMAC:

Western Ontario and McMaster Universities Osteoarthritis Index

References

  1. Nho SJ, Kymes SM, Callaghan JJ, Felson DT. The burden of hip osteoarthritis in the United States: epidemiologic and economic considerations. J Am Acad Orthop Surg. 2013;21 Suppl 1:S1–6.

    PubMed  Google Scholar 

  2. Ackerman IN, Osborne RH. Obesity and increased burden of hip and knee joint disease in Australia: results from a national survey. BMC Musculoskelet Disord. 2012;13:254.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Pereira D, Peleteiro B, Araújo J, Branco J, Santos RA, Ramos E. The effect of osteoarthritis definition on prevalence and incidence estimates: a systematic review. Osteoarthr Cartil. 2011;19:1270–85. Elsevier Ltd.

    Article  CAS  PubMed  Google Scholar 

  4. Prieto-Alhambra D, Judge A, Javaid MK, Cooper C, Diez-Perez A, Arden NK. Incidence and risk factors for clinically diagnosed knee, hip and hand osteoarthritis: influences of age, gender and osteoarthritis affecting other joints. Ann Rheum Dis. 2014;73:1659–64.

    Article  PubMed  Google Scholar 

  5. Quintana JM, Arostegui I, Escobar A, Azkarate J, Goenaga JI, Lafuente I. Prevalence of knee and hip osteoarthritis and the appropriateness of joint replacement in an older population. Arch Intern Med. 2008;168:1576–84.

    Article  PubMed  Google Scholar 

  6. van der Waal JM, Terwee CB, van der Windt DAWM, Bouter LM, Dekker J. The impact of non-traumatic hip and knee disorders on health-related quality of life as measured with the SF-36 or SF-12. A systematic review. Qual Life Res. 2005;14:1141–55.

    Article  PubMed  Google Scholar 

  7. Cross M, Smith E, Hoy D, Nolte S, Ackerman I, Fransen M, et al. The global burden of hip and knee osteoarthritis: estimates from the global burden of disease 2010 study. Ann Rheum Dis. 2014;73:1323–30.

    Article  PubMed  Google Scholar 

  8. Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2163–96.

    Article  PubMed  Google Scholar 

  9. Puig-Junoy J, Ruiz Zamora A. Socio-economic costs of osteoarthritis: a systematic review of cost-of-illness studies. Semin Arthritis Rheum. 2015;44:531–41.

    Article  PubMed  Google Scholar 

  10. Loza E, Lopez-Gomez JM, Abasolo L, Maese JJ, Carmona L, Batlle-Gualda E. Economic burden of knee and hip osteoarthritis in Spain. Arthritis Rheum. 2009;61:158–65.

    Article  PubMed  Google Scholar 

  11. Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118:622–9.

    Article  CAS  PubMed  Google Scholar 

  12. McHorney CA. Health status assessment methods for adults: past accomplishments and future challenges 1. Annu Rev Public Health. 1999;20:309–35. Annual Reviews 4139 El Camino Way, PO Box 10139, Palo Alto, CA 94303–0139.

    Article  CAS  PubMed  Google Scholar 

  13. Harris WH. Traumatic arthritis of the hip after dislocation and acetabular fractures: treatment by mold arthroplasty. J Bone Jt Surg Am. 1969;51:737–55. The American Orthopedic Association.

    Article  CAS  Google Scholar 

  14. Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15:1833–40.

    CAS  PubMed  Google Scholar 

  15. Martin RL, Kelly BT, Philippon MJ. Evidence of validity for the hip outcome score. Arthroscopy. 2006;22:1304–11.

    Article  PubMed  Google Scholar 

  16. Escobar A, Quintana JM, Bilbao A, Azkárate J, Güenaga JI. Validation of the Spanish version of the WOMAC questionnaire for patients with hip or knee osteoarthritis. Western Ontario and McMaster Universities Osteoarthritis Index. Clin Rheumatol. 2002;21:466–71.

    Article  CAS  PubMed  Google Scholar 

  17. Seijas R, Sallent A, Ruiz-Ibán MA, Ares O, Marín-Peña O, Cuéllar R, et al. Validation of the Spanish version of the hip outcome score: a multicenter study. Health Qual Life Outcomes. 2014;12:70.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Dawson J, Fitzpatrick R, Murray D, Carr A. Comparison of measures to assess outcomes in total hip replacement surgery. Qual Saf Heal Care. 1996;5:81–8.

    Article  CAS  Google Scholar 

  19. Kalairajah Y, Azurza K, Hulme C, Molloy S, Drabu KJ. Health outcome measures in the evaluation of total hip arthroplasties - A comparison between the harris hip score and the Oxford Hip Score. J Arthroplasty. 2005;20:1037–41.

    Article  PubMed  Google Scholar 

  20. Gosens T, Hoefnagels NHM, de Vet RCW, Dhert WJA, van Langelaan EJ, Bulstra SK, et al. The “Oxford Heup Score”. Acta Orthop. 2005;76:204–11.

    Article  PubMed  Google Scholar 

  21. Delaunay C, Epinette JA, Dawson J, Murray D, Jolles BM. Cross-cultural adaptations of the Oxford-12 HIP score to the French speaking population. Orthop Traumatol Surg Res. 2009;95:89–99.

    Article  CAS  PubMed  Google Scholar 

  22. Naal FD, Sieverding M, Impellizzeri FM, von Knoch F, Mannion AF, Leunig M. Reliability and validity of the cross-culturally adapted German Oxford Hip Score. Clin Orthop Relat Res. 2009;467:952–7.

    Article  PubMed  Google Scholar 

  23. Martinelli N, Longo UG, Marinozzi A, Franceschetti E, Costa V, Denaro V. Cross-cultural adaptation and validation with reliability, validity, and responsiveness of the Italian version of the Oxford Hip Score in patients with hip osteoarthritis. Qual Life Res. 2011;20:923–9.

    Article  PubMed  Google Scholar 

  24. Paulsen A, Odgaard A, Overgaard S. Translation, cross-cultural adaptationand validation of the Danish version of the Oxford Hip Score: assessed against generic and disease-specific questionnaires. Bone Jt Res. 2012;1:225–33.

    Article  CAS  Google Scholar 

  25. Tuğay BU, Tuğay N, Güney H, Hazar Z, Yüksel İ, Atilla B. Cross-cultural adaptation and validation of the Turkish version of Oxford Hip Score. Arch Orthop Trauma Surg. 2015;135:879–89.

    Article  PubMed  Google Scholar 

  26. Lee Y-K, Chung CY, Park MS, Lee KM, Koo K-H, Lee DJ, et al. Transcultural adaptation and testing of psychometric properties of the Korean version of the Oxford Hip Score. J Orthop Sci. 2012;17:377–81.

    Article  PubMed  Google Scholar 

  27. Zheng W, Li J, Zhao J, Liu D, Xu W. Development of a valid simplified chinese version of the Oxford Hip Score in patients with hip osteoarthritis. Clin Orthop Relat Res. 2014;472:1545–51.

    Article  PubMed  Google Scholar 

  28. Uesugi Y, Makimoto K, Fujita K, Nishii T, Sakai T, Sugano N. Validity and responsiveness of the Oxford Hip Score in a prospective study with Japanese total hip arthroplasty patients. J Orthop Sci. 2009;14:35–9. Elsevier.

    Article  PubMed  Google Scholar 

  29. Martínez JP, Arango AS, Castro AM, Martínez Rondanelli A. Validación de la versión en español de las escalas de Oxford para rodilla y cadera. Rev Colomb Ortop y Traumatol. 2016;30(2):61–6.

  30. Altman RD. Criteria for classification of clinical osteoarthritis. J Rheumatol Suppl. 1991;27:10–2.

    CAS  PubMed  Google Scholar 

  31. Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educ Psychol Meas. 2013;73:913–34.

    Article  Google Scholar 

  32. Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21:1331–5. John Wiley & Sons, Ltd.

    Article  PubMed  Google Scholar 

  33. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.

    Article  CAS  PubMed  Google Scholar 

  34. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5 L). Qual Life Res. 2011;20:1727–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Ramos-Goñi J, Craig B, Oppe M, Ramallo-Fariña Y, Pinto-Prades J, Luo N, et al. How to handle data quality issues in EQ-5D-5 L valuation studies. The Spanish case. Value Heal. 2016;19:A376.

    Article  Google Scholar 

  36. Murray DW, Fitzpatrick R, Rogers K, Pandit H, Beard DJ, Carr AJ, et al. The use of the Oxford hip and knee scores. J Bone Jt Surg. 2007;89:1010–4.

    Article  CAS  Google Scholar 

  37. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.

    Article  PubMed  Google Scholar 

  38. Beavers AS, Lounsbury JW, Richards JK, Huck SW, Skolits GJ, Esquivel SL. Practical considerations for using exploratory factor analysis in educational research. Pract Assessment, Res Eval. 2013;18:1–13.

    Google Scholar 

  39. Batista-Foguet JM, Coenders G, Alonso J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med Clin (Barc). 2004;122:21–7.

    Article  Google Scholar 

  40. Mulaik SA, James LR, Van Alstine J, Bennett N, Lind S, Stilwell CD. Evaluation of goodness-of-fit indices for structural equation models. Psychol Bull. 1989;105:430. American Psychological Association.

    Article  Google Scholar 

  41. Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99:323–38. Taylor & Francis.

    Article  Google Scholar 

  42. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.

    Article  Google Scholar 

  43. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:98–104.

    Article  Google Scholar 

  44. Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. JSTOR. 1977;33(2):363–74.

  45. Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27:S178–89. LWW.

    Article  CAS  PubMed  Google Scholar 

  46. Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56:395–407.

    Article  PubMed  Google Scholar 

  47. Schmitt JS, Di Fabio RP. Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. J Clin Epidemiol. 2004;57:1008–18. Elsevier.

    Article  PubMed  Google Scholar 

  48. Weir JP. The intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40.

    PubMed  Google Scholar 

  49. De Boer MR, De Vet HCW, Terwee CB, Moll AC, Völker-Dieben HJM, Van Rens GHMB. Changes to the subscales of two vision-related quality of life questionnaires are proposed. J Clin Epidemiol. 2005;58:1260–8.

    Article  PubMed  Google Scholar 

  50. Impellizzeri FM, Mannion AF, Naal FD, Leunig M. Validity, reproducibility, and responsiveness of the Oxford Hip Score in patients undergoing surgery for femoroacetabular impingement. Arthroscopy. 2015;31:42–50. Elsevier.

    Article  PubMed  Google Scholar 

  51. Ostendorf M, Van Stel HF, Buskens E, Schrijvers AJP, Marting LN, Verbout AJ, et al. Patient-reported outcome in total hip replacement. J Bone Jt Surg. 2004;86:801–8.

    Article  CAS  Google Scholar 

  52. Norquist JM, Fitzpatrick R, Dawson J, Jenkinson C. Comparing alternative Rasch-based methods vs raw scores in measuring change in health. Med Care. 2004;42:I-25. LWW.

    Article  Google Scholar 

  53. Harris KK, Price AJ, Beard DJ, Fitzpatrick R, Jenkinson C, Dawson J. Can pain and function be distinguished in the Oxford Hip Score in a meaningful way? : an exploratory and confirmatory factor analysis. Bone Joint Res. 2014;3:305–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Paulsen A. Patient reported outcomes in hip arthroplasty registries. Dan Med J. 2014;61:B4845.

    PubMed  Google Scholar 

  55. Dawson J, Fitzpatrick R, Carr A, Murray D. Questionnaire on the perceptions of patients about total hip replacement. J Bone Jt Surg. 1996;78–B:185–90.

    Google Scholar 

  56. Dawson J, Fitzpatrick R, Frost S, Gundle R, McLardy-Smith P, Murray D. Evidence for the validity of a patient-based instrument for assessment of outcome after revision hip replacement. J Bone Joint Surg (Br). 2001;83:1125–9.

    Article  CAS  Google Scholar 

  57. Beard DJ, Harris K, Dawson J, Doll H, Murray DW, Carr AJ, et al. Meaningful changes for the Oxford hip and knee scores after joint replacement surgery. J Clin Epidemiol. 2015;68:73–9. Elsevier Inc.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41:582–92.

    PubMed  Google Scholar 

  59. Strand LI, Ljunggren AE, Bogen B, Ask T, Johnsen TB. The short-form McGill pain questionnaire as an outcome measure: test-retest reliability and responsiveness to change. Eur J Pain. 2008;12:917–25.

    Article  PubMed  Google Scholar 

  60. Thorborg K, Roos E, Bartels E, Petersen J, Holmich P. Validity, reliability and responsiveness of patient-reported outcome questionnaires when assessing hip and groin disability: a systematic review. Br J Sports Med. 2010;44:1186–96.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This study has been financed by the Instituto de Salud Carlos III and the FEDER (European Regional Development Fund) (PI1300560, PI1300518, and PI1300648).

We would like to thank Oxford University Innovation for providing us with the adapted version of the Oxford Hip Score - Spanish (Spain).

Funding

This study has been financed by the Instituto de Salud Carlos III and the FEDER (European Regional Development Fund) (PI1300560, PI1300518 y PI1300648).

Availability of data and materials

The datasets used or analyzed during the current study are available from the corresponding author upon reasonable request.

Authors’ contributions

JMF, RGM, LGP, VRG and AB conceived and designed the experiments. JMF, PGL, AMS, JMM, IGS and OCC performed the experiments. JMF and AB analyzed the data. JMF, PGL, AMS, JMM, RGM, IGS, LGP, VRG, OCC and AB discussed the results. JMF and AB drafted the manuscript. JMF, PGL, AMS, JMM, RGM, IGS, LGP, VRG, OCC and AB revised and approved the manuscript.

Competing interests

The authors declare that they have no competing interests.

Ethics approval and consent to participate

All included patients provided written consent to participate in the study and approval was granted by all the relevant Ethics Committees for Clinical Research (CEIC de Euskadi, Hospital Fundación Jiménez Díaz, Hospital Universitario de Fuenlabrada, Hospital Universitario Fundación Alcorcón, Hospital Universitario de Canarias, Hospital Universitario Nuestra Señora de Candelaria).

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jesús Martín-Fernández.

Additional file

Additional file 1:

Adapted version of the Oxford Hip Score - Spanish (Spain). (DOC 47 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martín-Fernández, J., Gray-Laymón, P., Molina-Siguero, A. et al. Cross-cultural adaptation and validation of the Spanish version of the Oxford Hip Score in patients with hip osteoarthritis. BMC Musculoskelet Disord 18, 205 (2017). https://doi.org/10.1186/s12891-017-1568-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-017-1568-3

Keywords