Skip to main content
Download PDF

Construct validity and reliability of the Finnish version of the Knee Injury and Osteoarthritis Outcome Score

BMC Musculoskeletal Disorders volume 19, Article number: 155 (2018) Cite this article

Abstract

Background

The Knee Injury and Osteoarthritis Outcome Score (KOOS) is a commonly used knee assessment and outcome tool in both clinical work and research. However, it has not been formally translated and validated in Finnish. The purpose of this study was to translate and culturally adapt the KOOS questionnaire into Finnish and to determine its validity and reliability among Finnish middle-aged patients with knee injuries.

Methods

KOOS was translated and culturally adapted from English into Finnish. Subsequently, 59 patients with knee injuries completed the Finnish version of KOOS, Western Ontario and McMaster Osteoarthritis Index (WOMAC), Short-Form 36 Health Survey (SF-36) and Numeric Pain Rating Scale (Pain-NRS). The same KOOS questionnaire was re-administered 2 weeks later. Psychometric assessment of the Finnish KOOS was performed by testing its construct validity and reliability by using internal consistency, test-retest reliability and measurement error. The floor and ceiling effects were also examined.

Results

The cross-cultural adaptation revealed only minor cultural differences and was well received by the patients. For construct validity, high to moderate Spearman’s Correlation Coefficients were found between the KOOS subscales and the WOMAC, SF-36, and Pain-NRS subscales. The Cronbach’s alpha was from 0.79 to 0.96 for all subscales indicating acceptable internal consistency. The test-retest reliability was good to excellent, with Intraclass Correlation Coefficients ranging from 0.73 to 0.86 for all KOOS subscales. The minimal detectable change ranged from 17 to 34 on an individual level and from 2 to 4 on a group level. No floor or ceiling effects were observed.

Conclusion

This study yielded an appropriately translated and culturally adapted Finnish version of KOOS which demonstrated good validity and reliability. Our data indicate that the Finnish version of KOOS is suitable for assessment of the knee status of Finnish patients with different knee complaints. Further studies are needed to evaluate the predictive ability of KOOS in the Finnish population.

Peer Review reports

Background

Knee pain is common complaint affecting people of all ages. In adult populations, the reported prevalence of knee pain has been 25–28% depending on the age of the examined persons and the level of pain chronicity [1,2,3]. In the younger age groups, knee pain is commonly secondary to increased activity, injury or contact sports [4,5,6]. In older people, however, knee pain that gets progressively worse over time is often sign of osteoarthritis (OA) [7, 8]. Knee OA in particular is associated with severe disability, owing to the weight-bearing function of the knee and the large range of movements it performs.

To be able to detect and treat individuals with a variety of knee problems effectively requires reliable and valid outcome measures, preferably at low cost. During recent decades, a few well-validated outcome measures have been developed for the assessment of symptoms and function in subjects with knee or hip OA [9,10,11]. In the elderly population, the Western Ontario and McMaster Osteoarthritis Index (WOMAC) is the self-administered instrument most commonly used to measure pain, stiffness and function in daily living. However, in younger and/or more physically active subjects, joint injuries cause knee problems more often than primary knee OA per se. Younger patients also often have higher expectations regarding physical functioning. Thus, the WOMAC may not be appropriate for these subjects. Partly for this reason, the Knee injury and Osteoarthritis Outcome Score (KOOS) was developed in the late 1990s as an extension of the WOMAC index to address problems associated with knee injuries and/or knee OA [12].

KOOS is a disease-specific, patient-reported outcome (PRO) measure assessing perceived pain, other symptoms, activities of daily living, sport and recreation functions, and knee-related quality of life. It is freely accessible, and intended for use over the short- and long-term for both research and clinical purposes. KOOS has been found to be a valid, reliable and responsive outcome measure in different patient populations with varying knee injuries (of menisci, ACL or cartilage) [13, 14], knee OA [15,16,17,18,19] and total knee replacement [20]. Currently, KOOS is available in 50 different languages and language variants [21]. However, the validity and reliability of the Finnish version of KOOS in subjects with different knee problems or OA have not been previously reported. Hence, the purpose of this study was to produce a Finnish version of KOOS and to evaluate its construct validity and reliability in a sample of middle-aged patients with knee injuries.

Methods

Cross-cultural adaptation

Prior to the implementation of the KOOS questionnaire, a cross-cultural adaptation of the measure was performed in accordance with the recommendations by Beaton et al. (2000) [22]. The American-English KOOS [12] was translated into Finnish by two translators independently, one translator was an experienced orthopedic surgeon (T1) and the other a professional translator with no medical background or special knowledge of the concepts in question (T2). Both versions were then collated in a consensus meeting. This consensus version was translated back into English independently by two Finnish-speaking translators of English origin (BT1 and BT2) unfamiliar with the original questionnaire or concepts therein. The translations into Finnish and back translations into English were thereafter discussed and collated in a second consensus meeting. This version was then pre-tested with 16 postmenopausal women with mild knee OA to confirm if all the items in the questionnaire were understandable and whether the subjects experienced problems in answering any of them.

Patients and data acquisition

The study population comprised patients with diverse knee problems, including OA, post-traumatic injuries, meniscus and ligament problems. The patients had been referred to the Department of Orthopedics and Traumatology in Helsinki University Hospital from primary health care centers in the Hospital District of Helsinki and Uusimaa, where, based on clinical and radiographic or Magnetic Resonance Imaging findings, they were diagnosed as having OA or Anterior Cruciate Ligament (ACL), meniscus or combined ACL and meniscus injuries. For this study, all the assessed patients had to be in a clinically stable condition and not expected to undergo urgent surgery. The patients were recruited between March 2014 and May 2015 using a systematic sampling technique. The inclusion criteria were age 18 years or over, unresponsive to conservative treatment, and the ability to communicate in written Finnish. Eligible patients were informed about the study, and indicated their willingness to participate by giving their informed consent. For test-retest purposes, the participants were asked to complete KOOS twice: first, during the hospital visit, and then again 2 weeks later at home. During the hospital visit the patients were asked to fill in the KOOS along with the WOMAC, the SF-36 and the Numeric Rating Scale of Pain forms. One hundred thirty-one patients completed all four questionnaires during the hospital visit. Of these patients, 59 returned the KOOS questionnaire 2 weeks later from home by regular mail in a pre-paid envelope, yielding a sample of 59 patients for the study. The local Medical Ethics Committee of Helsinki University Hospital approved the study plan (Approval number 37/13/03/02/2014). Written informed consents were obtained and participants’ rights protected.

Questionnaires

KOOS

KOOS is a patient-administered knee-specific questionnaire comprising five subscales: Pain (nine items); Symptoms (seven items); Activities of Daily Living (ADL) (17 items); Sport and Recreation (five items); and Knee-Related Quality of Life (QOL) (four items). Each item is scored from 0 (best) to 4 (worst) using a Likert type scale with 5 boxes. The raw score for each subscale is the sum of the item scores. Scores are then transformed to a 0 to 100 scale. The scores of the five subscales can be expressed as an outcome profile, higher scores indicating fewer problems. A total score has not been validated and is not recommended according to the KOOS Users Guide [21]. When filling the questionnaire the subjects are instructed to consider the previous week when answering the questions. The KOOS has a self-explanatory format and the questionnaire takes about 10 min to complete [12].

WOMAC

The Western Ontario and McMaster Osteoarthritis Index (WOMAC) is a disease-specific, self-administered health status instrument assessing pain, stiffness, and function in subjects with OA of the hip or knee [10]. The index consists of 24 questions in three dimensions: knee pain (5 questions), joint stiffness (2 questions) and functional ability (17 questions). These dimensions are often analyzed and reported separately, but the WOMAC index can also be aggregated into a single score. The original WOMAC is available in two formats: Visual Analog Scales (VAS) and Likert-boxes. In this study, we used the VAS format (0–100 mm), where the sum of the raw scores was transformed to a 0–100 scale. Higher scores indicate a higher level of joint pain, joint stiffness and functional limitation. For this study, however, to allow comparison between the KOOS and WOMAC outcomes, we reversed the scoring direction of the WOMAC outcomes, meaning that higher scores indicate decreased pain, joint stiffness and functional limitation. WOMAC has been extensively tested for reliability, validity and responsiveness in different countries [23]. The Finnish version of WOMAC has been validated for the short- and long-term follow-up of patients scheduled for total knee or hip arthroplasty [24].

SF-36

Health-related quality of life was measured using the Short-Form 36 Health Survey (SF-36) [25]. SF-36 is a generic survey comprising 8 distinct dimensions of health status: Physical Functioning, General Health, Vitality, Mental Health, Role- Physical, Role-Emotional, Social Functioning and Bodily Pain. The scale runs from 0 to 100 in each dimension, with a higher score indicating better health.

Pain-NRS

The subjective intensity of pain in general and in different body regions was measured on the numeric pain rating scale (Pain-NRS). The body regions in this study were neck, back, upper limb, lower limb and knee. The Pain-NRS is an 11-point scale ranging from 0 to 10, where 0 represents “no pain” and 10 represents “the most intense pain imaginable”. For this study, however, as with WOMAC we reversed the scoring direction of the Pain-NRS outcomes, meaning that higher scores indicate “no pain” and lower scores indicate “the most intense pain imaginable”. When filling the form, patients are asked to select the value that best describes the intensity of pain that they have experienced during the past week.

Background data

During their visit to the outpatient clinic, in addition to demographic data, patients were asked for anamnestic information regarding their knee problem, and to describe the intensity of their habitual physical activity (low = 1, moderate = 2, or high = 3–4).

Assessment of psychometric properties

Construct validity was determined by comparing the first administration of the five KOOS subscales against the five WOMAC subscales, the eight SF-36 subscales, and the six Pain-NRS subscales. On the assumption that the highest correlations can be expected to be observed when comparing scales that are intended to measure the same or similar constructs, we posited a priori sets of hypotheses about convergent relationships between physical health properties which are given in Table 4 in the results section. We defined the construct validity of the KOOS questionnaire as good if at least 75% of the hypotheses could be supported [26]. The internal consistency of the first-administered KOOS was determined by defining the degree of inter-relatedness among the items. Test-retest reliability was determined by comparing the scores of the first- and second-administered KOOS questionnaires. Measurement error is the systematic and random error of a patient’s score that is not attributed to true changes in the construct to be measured [27]. The standard error of measurement (SEM) is a measure of the absolute measurement error of how much measured test scores tend to be distributed around a “true” score. SEM is expressed in the unit of measurement of the instrument. The minimal detectable change (MDC), in turn, is the threshold for determining clinical changes outside measurement error. The floor and ceiling effect of the KOOS was also examined. We checked each questionnaire for missing values prior to further analysis. The KOOS Users Guide 2012 rule was applied for missing items [21].

Statistical analyses

Quantitative variables are described using mean and standard deviation (SD) or median and interquartile range (IQR) values, and categorical variables are described using frequency and percentage values. Construct validity was calculated by using Spearman’s correlation coefficient to assess the relationships between the KOOS subscales and the WOMAC, SF-36 and numeric pain rating scales. Correlation coefficients less than 0.2 were considered very weak, between 0.2 and 0.39 weak, between 0.4 and 0.59 moderate, between 0.6 and 0.79 strong, and above 0.79 very strong [28]. Internal consistency was determined by calculating Cronbach’s α coefficient. A Cronbach’s α equal to, or greater than, 0.70 is generally regarded as acceptable for internal consistency [29, 30]. Test-retest reliability, indicating the consistency of the KOOS scores between the first and second administration of the questionnaire, was calculated using the two-way random effect model of the intraclass correlation coefficient (ICC) presented with 95% confidence intervals (CI). ICC values above 0.81 were interpreted as excellent, whereas values between 0.80 and 0.61 indicated good, values between 0.60 and 0.41 moderate, values between 0.40 and 0.21 fair, and values below 0.20 low reliability [31]. SEM was calculated using the formula: SEM = 1.96√(1-R), where 1.96 derives from the 0.95% CI and R represents the calculated ICC coefficient. MDC was calculated using the formula: MDC = SEM*1.96√2, where 2 represents two measurements evaluating the change [32]. For group comparison the MDC can be calculated, depending on the size of the group (n = 59), as follows: MDCgroup = MDCindividual/√n [33]. The floor and ceiling values representing the percentages of the patients who obtained the lowest or highest scores were calculated for each KOOS subscale separately. Floor and ceiling effects are considered present if more than 15% of the respondents achieve the lowest or highest possible scores [26].

Results

Patients

A total of 59 patients were included in the validity, internal consistency, test-retest, measurement error and floor/ceiling effects assessments. Mean participant age was 49 (SD 14), most were women (78%), and the median duration of knee symptoms was 7 months for women (IQR 4, 12) and 6 months for men (IQR 3, 18). Mean self-reported knee pain for all patients was 5.6 (SD 2.6) on a NRS scale of 0 to 10. The characteristics of the study population are presented in Table 1.

Table 1 Demographic and clinical characteristics of patients
Full size table

Only a few individual items (2%), all from the Pain and Sport and Recreation Function subscales, were missing, and hence a total score for all the subscales was available for all patients (Table 2). The lowest possible scores were reported by 5 (9%) patients for the subscale Sport and Recreation Function and by 4 (7%) patients for the subscale QOL. The best possible scores were reported by one patient (2%) for the subscales Pain and QOL, and by 2 patients (3%) for the subscales ADL and Sport and Recreation Function (Table 2).

Table 2 Mean scores, response rates and floor and ceiling percentages for the Finnish KOOS subscales
Full size table

Cross-cultural adaptation

The cross-cultural adaptation revealed minor cultural differences. In the subscale Activities of Daily Living, items A9 and A11 (“Putting on socks/stockings”, and “Taking off stocks /stockings”) the word “stockings” was omitted. In addition, item A13 on the same subscale (“Getting in/out of the bath”) the word “shower” was added as an alternative to bath. The Finnish version of the KOOS questionnaire was well received by the sample of 16 postmenopausal women with mild knee OA. All the questions and response options were considered understandable and applicable. The back-translation of the Finnish version of the KOOS questionnaire is available in the additional file [see Additional file 1].

Construct validity

Overall, the highest correlations were found between the KOOS subscales and WOMAC subscales. As shown in Table 3, all the KOOS and WOMAC subscales correlated significantly, with values of r within the range 0.33 to 0.86. The highest correlations were between the subscales intended to measure similar constructs (KOOS ADL vs. WOMAC Physical function, r = 0.86; KOOS Pain vs. WOMAC Pain, r = 0.81). In addition, the KOOS Symptoms and WOMAC Stiffness subscales correlated moderately (r = 0.48). Thus, the set of a priori hypotheses posited for KOOS and WOMAC was supported (Table 4).

Table 3 Spearman’s correlation coefficients for comparisons of the five KOOS subscales with the three WOMAC subscales, eight SF-36 subscales, and the six Pain-NRS subscales
Full size table
Table 4 A priori hypotheses of the expected correlations and realized correlations between the KOOS subscales and the subscales of the WOMAC, SF-36 and Pain-NRS. The correlations are given as Spearman’s correlation coefficient (r) values
Full size table

Higher correlations were found for the KOOS scales and the SF-36 scales, indicating their high ability to measure physical health, i.e., Physical Functioning, Role-Physical, and Bodily Pain (Table 3). As with WOMAC, the highest correlation between KOOS and SF-36 was found between the subscales intended to measure similar constructs (KOOS Pain vs. SF-36 Bodily Pain, r = 0.69; KOOS ADL vs. SF-36 Physical Functioning, r = 0.83). The KOOS Sport and Recreation Function and SF-36 Physical Functioning subscales also correlated strongly (r = 0.67), thus supporting the set of a priori hypotheses posited for KOOS and SF-36 (Table 4). The correlations between the KOOS subscales and the SF-36 dimensions of General Health, Vitality, Mental Health, Role-Emotional and Social Functioning, were lower, indicating the KOOS’s ability to measure rather physical than mental health.

The highest correlations between the KOOS and Pain-NRS subscales pertaining to different regions of the body were found for the knee area (r = 0.46–0.68) and lower limbs (r = 0.37–0.61) (Table 3). In addition, overall general pain showed moderate correlations with most of the KOOS subscales. The hypotheses of a strong correlation between KOOS ADL and Pain-NRS Knee (r = 0.68), and moderate correlation between KOOS QOL and Pain-NRS Knee (r = 0.53) were both supported. However, KOOS Pain and Pain-NRS Knee showed strong correlation (r = 0.66) instead of expected very strong correlation (Table 4).

Reliability

The mean change in the second measurement varied from − 0.7 in the Symptoms subscale to 8.7 in the Sport and Recreation Function subscale (Table 5).

Table 5 Difference between first and second measurement, internal consistency, test-retest reliability, and measurement error of the KOOS subscales
Full size table

Internal consistency

Cronbach’s α ranged from 0.79 to 0.96, indicating good internal consistency in all the KOOS subscales (Table 5).

Test-retest reliability

The test-retest reliability of the KOOS was excellent for the Pain, ADL and Knee-related Quality of Life subscales, with ICCs ranging from 0.83 to 0.86. In the Symptoms and Sport and Recreation Function subscales, reliability was good, with ICCs (95% CIs) of 0.73 (0.59 to 0.83) and 0.72 (0.57 to 0.82), respectively (Table 5).

Measurement error

The SEM values ranged from 6.0 to 12.2, with the lowest for the Symptoms subscale and highest for the Sport and Recreation Function subscale (Table 5). Correspondingly, at the individual level the MDC was lowest (16.6) for the Symptoms subscale and highest (33.8) for the Sport and Recreation Function subscale. At the group level, MDC ranged between 2.2 and 4.4 (Table 5).

Discussion

This study reports on the cross-cultural adaptation and translation of KOOS into Finnish and its reliability, construct validity and floor/ceiling effects in patients with knee injuries and/or OA. The results indicated that the Finnish version of KOOS has good construct validity, and that the questionnaire is a reliable measure of pain, symptoms, activities of daily living, sport and recreation, and quality of life in Finnish-speaking patients with knee injuries of different kinds.

The psychometric properties of the Finnish version of KOOS were in line with those of the original KOOS [13, 34, 35] and with the Persian version of KOOS [14], which studied a group of patients with knee injuries, similar to those in the present study, although not including knee OA. The mean scores for the Sport and Recreation Function and QOL subscales were considerably lower than the scores for the other subscales, as previously reported [12, 15, 16, 34, 36]. The likely reason for these low values, especially for the Sport and Recreation Function, is that knee injury patients tend to avoid risky activities in their daily lives. The present study demonstrated neither floor nor ceiling effects, as the proportion of worst or best possible percentage scores for the KOOS subscale with the highest scores was only 9%. This demonstrates the appropriateness and comprehensiveness of the questionnaire for a patient population with relatively moderate knee pain and other knee injury symptoms.

The construct validity of the KOOS was determined by comparing the KOOS subscales with the subscales of the WOMAC, SF-36 and Pain-NRS. The KOOS subscales are as representative as those of the WOMAC for measuring pain, stiffness and function. It was therefore expected that strong or very strong correlations between the KOOS and WOMAC subscales would be found. However, in interpreting these coefficients it must be acknowledged that all these measurements overlap to a certain extent. The WOMAC Pain items are included in the KOOS subscale of Pain, the WOMAC Stiffness items are included in the KOOS subscale of Symptoms, and the WOMAC Physical Function items are identical to the KOOS ADL items. Thus, in the latter, the subscale response options (VAS vs Likert) are compared rather than the constructs. Due to overlapping subscales between the KOOS and WOMAC, it was essential in this study to compare and correlate the subscales of the KOOS also with other questionnaire’s subscales assessing similar constructs than those of the WOMAC.

We found, somewhat surprisingly, that the KOOS subscale of Symptoms and the WOMAC subscale of Stiffness showed “only” a moderate correlation. This may partially be due to fact, as referred to above, that the KOOS Symptoms subscale contains five items in addition to the two original WOMAC items, as it also takes symptoms related to knee movement into account. Also noteworthy, alongside the KOOS subscales of Pain, Symptoms and Activities of Daily Living, were the subscales of Sport and Recreation Function and QOL, which showed a moderate or strong correlation with all the WOMAC subscales.

When the KOOS and SF-36 were compared for construct validity, we found strong correlations between the KOOS subscales and those of the SF-36 that measured similar constructs. The highest correlations were observed between the SF-36 subscale of Physical Functioning and the KOOS subscales of ADL and Pain. The SF-36 subscale of Bodily Pain and the KOOS subscales of Pain and ADL also showed strong correlations. In contrast, the KOOS subscale of Symptoms showed the lowest correlations with all the SF-36 subscales. This is in line with the findings of Salavati et al. (2008) in patients with knee injuries, and of Roos et al. (1998) in subjects with knee OA. In fact, Roos et al. concluded that the KOOS Symptoms subscale is not as important as the other four subscales as a determinate of Physical Health. The authors suggested that symptoms and functional limitations should be reported separately and not aggregated into a single score [13]. All in all, the construct validity for the patients in our study was at more or less the same level as observed in patients with knee injuries [14] and less severe forms of OA [18], but higher than that obtained in elderly patients with advanced OA eligible for total joint replacement [15, 34].

The numeric pain rating scale used in this study measures the intensity of pain experienced in general as well as in specific body regions. It contains subscales that make it possible to explore correlations with the KOOS subscales. As expected, we found strong and moderate correlations between all the KOOS and Pain-NRS subscales, particularly those focusing on the lower extremities and the knee region. These findings, in conjunction with the fact that self-reported knee pain was more severe than pain in any other body region, confirm the utility of the KOOS as a lower-extremity PRO measure in subjects with diverse knee problems. Also of note was the finding of strong correlations between the Pain-NRS Knee and lower limb subscales and the KOOS Activities of Daily Living subscale. This is understandable, given that the knee is a large weight-bearing joint with a large range of movements, and that managing the activities of daily living presumes an extensive repertoire of pain-free weight-bearing movements. However, somewhat surprisingly, the KOOS Pain subscale correlated only strongly instead of, as expected, very strongly with the Pain-NRS Knee subscale. This is most likely due to only partial similarity between the constructs in the two subscales. While the nine-item KOOS Pain subscale is designed to elicit the prevalence and degree of pain during different activities and rest, the Pain-NRS Knee subscale consists of a single item in asking about the intensity of pain experienced during the past week. Nevertheless, the use of the Pain-NRS yielded new information, since to our knowledge no previous KOOS validation studies have investigated the correlations between the KOOS and Pain-NRS subscales. From our pre-defined hypotheses altogether 89% could be confirmed.

Internal consistency was good for all five subscales, exceeding the cutoff value of 0.70. This result is comparable to observations in other languages and patient populations, such as in the Swedish version with preoperative patients [13], the Dutch version with patients with focal cartilage defects [37], the Persian version with patients with knee injuries [14], and the Singapore English and Singapore Chinese [15], Dutch [17], Portuguese [18] and French [16] versions with knee OA patients. Two recent Polish validation studies with test-retest intervals of one to 2 weeks found Cronbach’s αs higher than 0.90 in patients undergoing ACL reconstruction [38] and total knee replacement [36]. The authors concluded that this might be due to the relative homogeneity of their patient group. Accordingly, it has been claimed that, for clinical application, high Cronbach’s α values, of at least 0.90, are needed [39]. However, given that, our Cronbach’s α values were, with the exception of the Symptoms subscale, all around borderline significance, we consider them reasonable for clinical purposes. The result of the item analysis also suggests that all five subscales are acceptable for inclusion in the Finnish version of KOOS.

The ICC values for test-retest reliability for all the KOOS subscales were good, ranging from 0.72 to 0.86, thereby indicating sufficient standardization of the KOOS questionnaire. Overall, our results are comparable to those of previous methodological studies of KOOS [12, 13] and other studies [14, 17,18,19, 36, 37, 40, 41] where ICC values over 0.70 have indicated good or excellent test-retest reliability. Noteworthy, the ICC value for Sport and Recreation Function in our study was somewhat lower than expected. It is commonly seen that Sport and Recreation Function has higher ICC value than Symptoms [17, 36, 40, 41].We cannot find an exact reason why Sport and Recreation Function had relatively low value, but it is possible that some patients may have changed their activity level during 2 week interval.

The MDC value of 4.4 points at the group level indicates that the Finnish version of the KOOS has an ability to detect a minimum change of 4.5 points between the measurements. The MDC should be smaller than the minimal important change (MIC), which is regarded as the smallest change score needed for the effect to be considered clinically relevant [42]. For the different KOOS subscales a MIC of 8–10 points has been considered to be appropriate [34]. Thus the Finnish version of the KOOS is applicable to detect such a change without difficulties. However, it is important to note that the mentioned MDC values apply to patient groups and not to individual patients. The MDC values at the individual level were considerably higher ranging from 16.6 to 33.8 for the different KOOS subscales. The MDC values in our study are of same magnitude or somewhat higher than those found in two recent studies in people with OA awaiting arthroplasty [36, 43].

We recognize some limitations of this study. First, our sample size was rather small. The response rate for the re-test remained low (~ 45%), meaning that a relatively small number of participants were investigated. The reasons why some subjects did not respond to the second KOOS questionnaire remain unknown. Nevertheless, according to the Consensus-based Standards for the selection of health status Measurement Instruments (COSMIN) group [44], the sample size of 50 to 99 is considered sufficient. Second, participants in the present study may not represent patients with entire spectrum of knee OA and some common knee complaints affecting pain, such as patellofemoral pain syndrome, rheumatoid arthritis, plica syndrome, Bakers cyst and bursitis. However, it must be borne in mind that the KOOS questionnaire is intended to be used particularly for knee injuries that can result for a variety of reasons, including OA. In addition, the initial participant group recruited to this study was representative of their population, as all knee patients attending the outpatient clinic were invited to take part to the study. Third, due to its cross-sectional design, the responsiveness of the questionnaire was not assessed in this study, which may limit the instrument’s ability to detect clinically important changes over time. For these reasons, we recommend further validation of this preliminary Finnish version of KOOS and consideration of its responsiveness with a larger number of patients with knee complaints, including patients across the full radiographic spectrum of knee OA.

Conclusions

This research effort produced an appropriately translated and culturally adapted version of KOOS. The Finnish version of KOOS is a reliable and valid measure that can be applied as a self-report and disease-specific questionnaire for use in middle-aged patients with knee injuries. The responsiveness of the Finnish version of KOOS in larger groups of patients with knee complaints remains to be tested.

Abbreviations

ACL:

Anterior cruciate ligament

ADL:

Activities of daily living

CI:

Confidence interval

COSMIN:

Consensus-based standards for the election of health status measurement instruments

ICC:

Intraclass correlation coefficient

IQR:

Interquartile range

KOOS:

Knee Injury and Osteoarthritis Outcome Score

LTPA:

Leisure time physical activity

MDC:

Minimal detectable change

MIC:

Minimal important change

OA:

Osteoarthritis

Pain-NRS:

Pain numeric rating scale

PRO:

Patient-reported outcome

QOL:

Quality of life

SD:

Standard deviation

SEM:

Standard error of measurement

SF-36:

Short-Form 36 Health Survey

VAS:

Visual Analog Scale

WOMAC:

Western Ontario and McMaster Osteoarthritis Index

References

  1. Urwin M, Symmons D, Allison T, Brammah T, Busby H, Roxby M, Simmons A, Williams G. Estimating the burden of musculoskeletal disorders in the community: the comparative prevalence of symptoms at different anatomical sites, and the relation to social deprivation. Ann Rheum Dis. 1998;57:649–55.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  2. O'Reilly SC, Muir KR, Doherty M. Knee pain and disability in the Nottingham community: association with poor health status and psychological distress. Br J Rheumatol. 1998;37:870–3.

    Article  PubMed  CAS  Google Scholar 

  3. Jinks C, Jordan K, Ong BN, Croft P. A brief screening tool for knee pain in primary care (KNEST). 2. Results from a survey in the general population aged 50 and over. Rheumatology (Oxford). 2004;43:55–61.

    Article  CAS  Google Scholar 

  4. Kujala UM, Kvist M, Osterman K. Knee injuries in athletes. Review of exertion injuries and retrospective study of outpatient sports clinic material. Sports Med. 1986;3:447–60.

    Article  PubMed  CAS  Google Scholar 

  5. Maffulli N, Longo UG, Gougoulias N, Loppini M, Denaro V. Long-term health outcomes of youth sports injuries. Br J Sports Med. 2010;44:21–5.

    Article  PubMed  CAS  Google Scholar 

  6. Molloy MG, Molloy CB. Contact sport and osteoarthritis. Br J Sports Med. 2011;45(4):275–7.

    Article  PubMed  Google Scholar 

  7. Busija L, Bridgett L, Williams SR, Osborne RH, Buchbinder R, March L, Fransen M. Osteoarthritis. Best Pract Res Clin Rheumatol. 2010;24:757–68.

    Article  PubMed  Google Scholar 

  8. Loeser RF. Age-related changes in the musculoskeletal system and the development of osteoarthritis. Clin Geriatr Med. 2010;26:371–86.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Tegner Y, Lysholm J. Rating systems in the evaluation of knee ligament injuries. Clin Orthop Relat Res. 1985;198:43–9.

    Google Scholar 

  10. Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15:1833–40.

    PubMed  CAS  Google Scholar 

  11. Lequesne M. Informational indices. Validation of criteria and tests. Scand J Rheumatol Suppl. 1989;80:17–28.

    Article  PubMed  CAS  Google Scholar 

  12. Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)--development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28:88–96.

    Article  PubMed  CAS  Google Scholar 

  13. Roos EM, Roos HP, Ekdahl C, Lohmander LS. Knee Injury and Osteoarthritis Outcome Score (KOOS)--validation of a Swedish version. Scand J Med Sci Sports. 1998;8:439–48.

    Article  PubMed  CAS  Google Scholar 

  14. Salavati M, Mazaheri M, Negahban H, Sohani SM, Ebrahimian MR, Ebrahimi I, Kazemnejad A, Salavati M. Validation of a Persian-version of Knee Injury and Osteoarthritis Outcome Score (KOOS) in Iranians with knee injuries. Osteoarthr Cartil. 2008;16:1178–82.

    Article  PubMed  CAS  Google Scholar 

  15. Xie F, Li SC, Roos EM, Fong KY, Lo NN, Yeo SJ, Yang KY, Yeo W, Chong HC, Thumboo J. Cross-cultural adaptation and validation of Singapore English and Chinese versions of the Knee Injury and Osteoarthritis Outcome Score (KOOS) in Asians with knee osteoarthritis in Singapore. Osteoarthr Cartil. 2006;14:1098–103.

    Article  PubMed  CAS  Google Scholar 

  16. Ornetti P, Parratte S, Gossec L, Tavernier C, Argenson JN, Roos EM, Guillemin F, Maillefert JF. Cross-cultural adaptation and validation of the French version of the Knee Injury and Osteoarthritis Outcome Score (KOOS) in knee osteoarthritis patients. Osteoarthr Cartil. 2008;16:423–8.

    Article  PubMed  CAS  Google Scholar 

  17. de Groot IB, Favejee MM, Reijman M, Verhaar JA, Terwee CB. The Dutch version of the Knee Injury and Osteoarthritis Outcome Score: a validation study. Health Qual Life Outcomes. 2008;6:16. https://doi.org/10.1186/1477-7525-6-16.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Goncalves RS, Cabri J, Pinheiro JP, Ferreira PL. Cross-cultural adaptation and validation of the Portuguese version of the Knee Injury and Osteoarthritis Outcome Score (KOOS). Osteoarthr Cartil. 2009;17:1156–62.

    Article  PubMed  CAS  Google Scholar 

  19. Nakamura N, Takeuchi R, Sawaguchi T, Ishikawa H, Saito T, Goldhahn S. Cross-cultural adaptation and validation of the Japanese Knee Injury and Osteoarthritis Outcome Score (KOOS). J Orthop Sci. 2011;16:516–23.

    Article  PubMed  Google Scholar 

  20. Collins NJ, Prinsen CA, Christensen R, Bartels EM, Terwee CB, Roos EM. Knee Injury and Osteoarthritis Outcome Score (KOOS): systematic review and meta-analysis of measurement properties. Osteoarthr Cartil. 2016;24:1317–29.

    Article  PubMed  CAS  Google Scholar 

  21. Knee Injury and Osteoarthritis Outcome Score. http://www.koos.nu/index.html. Accessed 15 Mar 2018.

  22. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–91.

    Article  PubMed  CAS  Google Scholar 

  23. WOMAC 3.1 Index. Knee and Hip Osteoarthritis Index. http://www.womac.org/womac/index.htm. Accessed 15 Mar 2018.

  24. Soininen JV, Paavolainen PO, Gronblad MA, Kaapa EH. Validation study of a Finnish version of the Western Ontario and McMasters University osteoarthritis index. Hip Int. 2008;18:108–11.

    Article  PubMed  CAS  Google Scholar 

  25. Ware JE, Kosinski M, Keller SK. SF-36 physical and Mental health summary scales: a user's manual. Boston: The Health Institute; 1994.

    Google Scholar 

  26. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.

    Article  PubMed  Google Scholar 

  27. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–45.

    Article  PubMed  Google Scholar 

  28. Evans JD. Straightforward statistics for the behavioral sciences. Pacific Grove: Brooks/Cole Publishing; 1996.

    Google Scholar 

  29. Hays RD, Anderson RT, Revicki D. Assessing reliability and validity of measurement in clinical trials. In: Staquet MJ, Hays RD, Fayers PM, editors. Quality of life assessment in clinical trials methods and practice. Oxford: Oxford University Press; 1998. p. 169–82.

    Google Scholar 

  30. Fayers PM, Machin D. Quality of life: assessment, analysis and interpretation. Chichester: Wiley; 2000.

    Book  Google Scholar 

  31. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  PubMed  CAS  Google Scholar 

  32. Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26:217–38.

    Article  PubMed  CAS  Google Scholar 

  33. de Vet HC, Bouter LM, Bezemer PD, Beurskens AJ. Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001;17:479–87.

    Article  PubMed  CAS  Google Scholar 

  34. Roos EM, Toksvig-Larsen S. Knee Injury and Osteoarthritis Outcome Score (KOOS) - validation and comparison to the WOMAC in total knee replacement. Health Qual Life Outcomes. 2003;1:17.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Roos EM, Lohmander LS. The Knee Injury and Osteoarthritis Outcome Score (KOOS): from joint injury to osteoarthritis. Health Qual Life Outcomes. 2003;1:64.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Paradowski PT, Keska R, Witonski D. Validation of the Polish version of the Knee Injury and Osteoarthritis Outcome Score (KOOS) in patients with osteoarthritis undergoing total knee replacement. BMJ Open. 2015;5:e006947. https://doi.org/10.1136/bmjopen-2014-006947.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Bekkers JE, de Windt TS, Raijmakers NJ, Dhert WJ, Saris DB. Validation of the Knee Injury and Osteoarthritis Outcome Score (KOOS) for the treatment of focal cartilage lesions. Osteoarthr Cartil. 2009;17:1434–9.

    Article  PubMed  CAS  Google Scholar 

  38. Paradowski PT, Witonski D, Keska R, Roos EM. Cross-cultural translation and measurement properties of the Polish version of the Knee Injury and Osteoarthritis Outcome Score (KOOS) following anterior cruciate ligament reconstruction. Health Qual Life Outcomes. 2013;11:107. https://doi.org/10.1186/1477-7525-11-107.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Bland JM, Altman DG. Cronbach’s alpha. BMJ. 1997;314(7080):572.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  40. Monticone M, Ferrante S, Salvaderi S, Rocca B, Totti V, Foti C, Roi GS. Development of the Italian version of the knee injury and osteoarthritis outcome score for patients with knee injuries: cross-cultural adaptation, dimensionality, reliability, and validity. Osteoarthr Cartil. 2012;20:330–5.

    Article  PubMed  CAS  Google Scholar 

  41. Almangoush A, Herrington L, Attia I, Jones R, Aldawoudy A, Abdul Aziz A, Waley A. Cross-cultural adaptation, reliability, internal consistency and validation of the Arabic version of the knee injury and osteoarthritis outcome score (KOOS) for Egyptian people with knee injuries. Osteoarthr Cartil. 2013;21:1855–64.

    Article  PubMed  CAS  Google Scholar 

  42. de Vet HC, Ostelo RW, Terwee CB, van der Roer N, Knol DL, Beckerman H, Boers M, Bouter LM. Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007;16:131–42.

    Article  PubMed  Google Scholar 

  43. Naylor JM, Hayen A, Davidson E, Hackett D, Harris IA, Kamalasena G, Mittal R. Minimal detectable change for mobility and patient-reported tools in people with osteoarthritis awaiting arthroplasty. BMC Musculoskelet Disord. 2014;15:235. https://doi.org/10.1186/1471-2474-15-235.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–49.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors thank Michael Freeman for revising the English language of the manuscript. The authors also thank all the participants for their valuable contribution to the study.

Funding

This work was supported by grants from Helsinki University Hospital (HUS) and the Scientific Advisory Board for Defense (MATINE). The first author Juhani Multanen was funded by the Academy of Finland (Project No. 311587) when preparing the manuscript for publication. The funding agencies had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Availability of data and materials

The datasets generated and analyzed during the study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

  1. Department of Physical Medicine and Rehabilitation, Central Finland Central Hospital, Keskussairaalantie 19, FI-40620, Jyväskylä, Finland

    Juhani Multanen & Arja Häkkinen

  2. Department of Surgery, Mikkeli Central Hospital, Mikkeli, Finland

    Mikko Honkanen

  3. Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland

    Arja Häkkinen

  4. Department of Orthopaedics and Traumatology, University of Helsinki, and Helsinki University Hospital, Helsinki, Finland

    Ilkka Kiviranta

Authors
  1. Juhani Multanen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mikko Honkanen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arja Häkkinen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ilkka Kiviranta
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AH and IK were involved in the conception of the study plan and design. MH gathered the patient data. IK and JM analyzed and interpreted the patient data. JM was a major contributor in writing the manuscript. All authors were involved in revising the article critically for important intellectual content, and all authors approved the final manuscript.

Corresponding author

Correspondence to Juhani Multanen.

Ethics declarations

Ethics approval and consent to participate

The local Medical Ethics Committee of Helsinki University Hospital approved the study plan (Approval number 37/13/03/02/2014). Written informed consent was obtained from participants prior to study start.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The back-translation of the Finnish version of the KOOS questionnaire “KOOS KNEE QUESTIONNAIRE”. (PDF 87 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Multanen, J., Honkanen, M., Häkkinen, A. et al. Construct validity and reliability of the Finnish version of the Knee Injury and Osteoarthritis Outcome Score. BMC Musculoskelet Disord 19, 155 (2018). https://doi.org/10.1186/s12891-018-2078-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-018-2078-7

Keywords

BMC Musculoskeletal Disorders

ISSN: 1471-2474

Contact us