Prognosis of patients with whiplash-associated disorders consulting physiotherapy: development of a predictive model for recovery
© Bohman et al.; licensee BioMed Central Ltd. 2012
Received: 16 August 2012
Accepted: 23 December 2012
Published: 29 December 2012
Patients with whiplash-associated disorders (WAD) have a generally favourable prognosis, yet some develop longstanding pain and disability. Predicting who will recover from WAD shortly after a traffic collision is very challenging for health care providers such as physical therapists. Therefore, we aimed to develop a prediction model for the recovery of WAD in a cohort of patients who consulted physical therapists within six weeks after the injury.
Our cohort included 680 adult patients with WAD who were injured in Saskatchewan, Canada, between 1997 and 1999. All patients had consulted a physical therapist as a result of the injury. Baseline prognostic factors were collected from an injury questionnaire administered by Saskatchewan Government Insurance. The outcome, global self-perceived recovery, was assessed by telephone interviews six weeks, three and six months later. Twenty-five possible baseline prognostic factors were considered in the analyses. A prediction model was built using Cox regression. The predictive ability of the model was estimated with concordance statistics (c-index). Internal validity was checked using bootstrapping.
Our final prediction model included: age, number of days to reporting the collision, neck pain intensity, low back pain intensity, pain other than neck and back pain, headache before collision and recovery expectations. The model had an acceptable level of predictive ability with a c-index of 0.68 (95% CI: 0.65, 0.71). Internal validation showed that our model was robust and had a good fit.
We developed a model predicting recovery from WAD, in a cohort of patients who consulted physical therapists. Our model has adequate predictive ability. However, to be fully incorporated in clinical practice the model needs to be validated in other populations and tested in clinical settings.
KeywordsPrediction Prognosis Whiplash-associated disorders Neck pain Physical therapy Cohort Recovery Regression Discrimination
Whiplash injuries result from an acceleration-deceleration mechanism to the neck, usually following a traffic collision and whiplash-associated disorders (WAD) describes the symptomatology related to these injuries. WAD includes neck pain, headache, arm pain and other physical complaints . The pathophysiology of WAD is not well understood, but its aetiology likely combines physical and psychological causes .
The annual incidence of WAD in Western countries is estimated to be at least 300 per 100,000 inhabitants . WAD is associated with a significant financial burden to society. In the United States and Europe the annual cost of WAD was estimated to be $3.9 billion and $13.4 billion respectively [4, 5]. Physical therapy is a common health care option for persons with neck pain, including WAD, and a large proportion of patients consulting physical therapists have neck pain [6–8].
Although the prognosis of WAD is generally favourable, previous studies have found as much as 50% of the affected individuals to be symptomatic one year after the injury [5, 9]. To date, predicting the outcome of WAD remains challenging and few clinical prediction tools exists to assist health care providers in establishing the prognosis for patients. Searching the literature, we found only one prediction model developed for patients with WAD . The authors found increasing age, number of initial physical symptoms, initial upper back pain, upper extremity numbness and vision disturbances to predict persistent symptoms six months post-injury in patients who presented to emergency departments .
Post-injury symptoms such as pain and disability are well-established prognostic factors for the recovery from WAD [9, 11, 12]. In addition there is evidence that psychological factors such as recovery expectations, pain catastrophizing and depression predict poor recovery [9, 11, 13]. However, there is conflicting evidence for the prognostic value of prior pain, prior health and comorbidities as well as for socio-demographic variables [9, 11, 12].
It is important for health care providers such as physical therapists to predict which patients with WAD are more likely to make a successful recovery. This knowledge can improve the care of patients with WAD and help manage their expectations. It is recommended that prediction tools be developed in well-defined patient population so that their application is generalizable to similar populations. Therefore, different prediction tools need to be developed for patient groups that consult different health care providers [14, 15]. The purpose of our study was to develop a predictive model for the recovery of WAD in a sample of patients who consulted physical therapists within six weeks of their injury.
Design and study population
Prognostic factors for the predictive model
Potential prognostic factors were collected from the baseline study questionnaire included in the SGI form filled in by the patient. The study questionnaire included items on socio-demographics, injury-related pain intensity and location, activity limitations, comorbid health conditions, pre- and post-injury general health, health care provision, depressive symptomatology and work status. We selected potential prognostic factors based on the literature and clinical experience of the authors (Table 1) [9, 11, 12, 20]. The selected factors were grouped into three domains that represented the sequential approach of the medical history obtained by a physical therapist during an initial consultation. The rationale for using this approach was to determine if expanding the breadth of information collected during the medical history improve the ability of physical therapists to predict recovery. The three domains were:
Age, sex, marital status (single, married, widowed, separated/divorced), education (< grade 8, grade 8, high school, post-secondary school, technical school, university) and work status (not working; unemployed, disability leave, maternity leave, retired, homemaker/working; fulltime, part time, student).
2) Collision, symptoms, comorbidity and health care:
Number of days to reporting the collision (0-42 days), average pain intensity, reported at baseline, in neck/shoulder, low back and of headache. Pain intensity was measured on an 11-point Numeric rating scale (NRS: 0-10) where “0” means “no” pain and “10” means “pain as bad as it could be”. The NRS is a reliable and valid method for assessing pain in various patient categories [21, 22]. According to the optimal cut-points for classifying neck pain intensity of 4/7, suggested by Fejer and colleagues, neck/shoulder pain intensity (from now denoted as neck pain intensity) was categorized into no (0), mild (1-4), moderate (5-7) and severe (8-10) pain . The same categories were used for headache and back pain intensity as we only found varying cut-points for these measures in literature [24, 25]. Other factors in this domain were; pain other than neck and back pain, feeling of numbness, tingling or pain in arms or hands, pain when moving the neck, reduced neck movement and sleeping problems. All assessed by the answer “Yes” or “No”. Musculoskeletal problems and headache affecting health within 6 months before the collision were categorized as absent, no/mild effect or severe effect on health. Activity restrictions were measured by answering “Yes” to the question: “Have the injuries prevented you from carrying out any of the following activities?”; daily home activities, leisure activities (activities not related to home, work or education). Finally the number of self-reported visits to PT and medical doctors (MD) since collision was considered.
3) General health and psychology:
Baseline characteristics of the study population and the “complete study sample”
Characteristics (potential prognostic factors)*
Study population (n=680)
Complete study sample**(n=569)
Age, mean (SD)
< Grade 8
Collision, symptoms, comorbidity and health care
No. of days to reporting the collision, mean (SD)
Neck pain intensitye
Low back pain intensitye
Pain other than neck and back pain
Symptoms in arms or handsf
Pain when moving neck
Reduced neck movement
Musculoskeletal problem before collisiong
Headache before collisionh
Restrictions in daily home activity
Restrictions in leisure activityi
MD visits since collisionj
PT visits since collisionk
General health and psychology
Better slowly/Never better
Current general healthm
General health the month before collisionn
Anxiety or worry
All patients were followed by telephone interviews six weeks and three, six, nine and 12 months after their collision. In the current study, we restricted our analyses to data collected up to the six-month follow-up because it corresponds to the period where maximal clinical improvement is expected . The follow-up interviews provided information on self-rated recovery, pain location, pain intensity, disability, health-related quality of life, exercise, activity limitation, health care provision, depressive symptoms and work status. We used self-reported recovery from WAD as our outcome, measured with the global recovery question: “How well do you feel that you are recovering from your injuries”? Patients answering “All better (cured)” or “There has been quite a bit of improvement” were defined as recovered. Not recovered was equal to answer; “There has been some improvement”, “There has been no improvement”, “I am getting a little worse” or “I am getting much worse”. This question has been shown to have adequate reliability and validity for use in epidemiological studies of WAD [18, 19, 30]. Time to recovery was defined at the first follow-up where the patients were defined as recovered.
We used the Kaplan-Meier method to describe the median time to recovery of our sample. Patients who were lost to follow-up were censored at the mid-point between the last completed follow-up and the next follow-up time.
Further analysis included three phases;
We performed a univariate Log-rank test (LRT) for equality of survivor functions on all potential prognostic factors. Factors with p-value ≤ 0.2 were considered for the following multivariable analyses [31, 32].
Correlation between all potential prognostic factors were tested to assess collinearity. Collinearity was deemed to be present if the Spearman pairwise correlation was greater than 0.5 . The presence of collinearity was managed by eliminating from the analyses the factor that was judged to be the least important from a clinical perspective.
The presence of clinically relevant statistical interactions between neck pain intensity and recovery expectations or depression were tested [9, 17]. An interaction significant at p ≤ 0.05 was included in further analyses .
Multivariable phase - developing the predictive models
We used a manual backward selection procedure based on the Cox′s proportional hazard regression to build the models (described below) . The strategy included the development of three models with possible prognostic factors from the domains representing the sequential gathering of medical history done by a physical therapist. The associations between a prognostic factor and recovery was reported as beta coefficients (β) with standard error (SE) and hazard rate ratios (HRR) with 95% confidence interval (95% CI).
Factors from the domain “socio-demographics” were considered. In the selection procedure the factor with the highest p-value was excluded one by one until all prognostic factor themselves (or at least one category) had a p-value of < 0.1 [32, 35]. The likelihood ratio test statistics was used to compare the model before and after exclusion of a factor [34, 36]. A p-value of more than 0.05 indicated that excluding the variable did not significantly change the fit of the model.
Significant factors from model 1 and factors related to “collision, symptoms, comorbidity and health care” were combined using the same method as for building model 1.
Final prediction model 3
Included the remaining factors from model 2 and the “general health and psychology” variables and were constructed using the methodology described above. Signs of collinearity were assessed using the variance inflation factor of more than 10 as the criteria for collinearity. Presence of collinearity was handled as in the univariate phase.
The predictive ability of the models was measured with the Harrell′s concordant statistics (c-index) with 95% CI. A model with a c-index of 0.5 has no predictive ability while a c-index of 1.0 indicates perfect predictive ability . The internal validity of the final model was checked by cross validating 500 bootstrap replicate to get bias corrected c-index with 95% CI [34, 37]. This c-index indicates the predictive ability of the model in similar WAD populations as in this study. We assessed overfitting by computing the shrinkage factor [34, 37]. A shrinkage factor of 1.0 indicates perfect fit of the model while a factor of for example 0.8 indicates that 20% of the inference is due to overfitting. The overall goodness of fit of the final model was assessed by plotting Cox-Snell residuals and by computing a score test based on the Martingale residuals [31, 34].
To evaluate the impact of missing data we repeated the univariate and multivariable analyses with a “complete study sample”. In this sample we excluded patients who were lost to follow-up and/or with missing data on potential prognostic factors.
All p-values were two-sided and analyses were completed using SAS version 9.3 TS level 1MO (Cary, NC: SAS Institute) and Stata/IC version 12.1 (Stata Corp LP, USA). This study was approved by the University Health Network Research Ethics Board (REB 10-0216-AE), Toronto, Ontario, Canada. The original inception cohort study was approved by the Research ethics Boards of University of Saskatchewan and the University of Alberta .
All potential prognostic factors except marital status, work status and pain when moving the neck met the LRT criteria to be included in the multivariable phase. We found no statistical significant interactions, bivariate correlations or violations of the proportionality assumption.
Results from the multivariable analyses of recovery from WAD a , c-index and internally validated c-index (n=680)
Final model 3a(n=633)b
HRR (95% CI)
0.99 (0.98, 1.00)*
< Grade 8**
No. of days to reporting the collision
0.98 (0.97, 0.99)
Neck pain intensity c
0.65 (0.50, 0.85)
0.61 (0.45, 0.82)
Low back pain intensity c
1.19 (0.88, 1.61)
0.85 (0.68, 1.07)
0.66 (0.49, 0.89)
Pain other than neck and back pain
0.71 (0.57, 0.88)
Musculoskeletal problem before collision d
Headache before collision
1.32 (1.07, 1.63)
0.97 (0.72, 1.31)
MD visits since collision e
Recovery expectations f
Better slowly/Never better
0.51 (0.41, 0.65)
0.34 (0.26, 0.44)
C-index (95% CI)
0.56 (0.53, 0.59)
0.65 (0.63, 0.68)
0.68 (0.65, 0.71)
Internal validated c-index (95% CI)
0.55 (0.51, 0.58)
0.63 (0.59, 0.66)
0.67 (0.63, 0.70)
The predictive ability (c-index) increased for each model and reached an acceptable level of 0.68 (95% CI: 0.65, 0.71) for the final model . Internal validation (c-index: 0.67 (95% CI: 0.63, 0.70)) showed a robust final model with acceptable ability to predict self-reported recovery from WAD in similar populations of WAD patients. The Cox-Snell residual plots, the score test (p=0.66) and a shrinkage factor of 0.93 all indicated that the final model 3 was robust and had a good fit.
We rebuilt our three models using the sample of patients with complete data (n=569) resulting in a final model 3 with the same prognostic factors as in the main analyses. The c-index for the final model 3 in the sensitivity analyses was 0.67 (95% CI: 0.64, 0.70).
We developed and internally validated a predictive model for recovery among patients with WAD consulting physical therapists within six weeks after the injury. The model has acceptable predictive ability.
Information about prognostic factors incorporated in the model is easily gathered in the medical history taken by a physical therapist. Furthermore, our results indicate that expanding the breadth of information from the medical history improves the ability to predict recovery from WAD. Patients with WAD frequently seek physical therapists and this model may be an important tool to help physical therapists in their management of these patients.
Comparison with previous literature
To the best of our knowledge, our study is the first to develop a predictive model of recovery from WAD in patients who consulted a physical therapist. Therefore we cannot compare the developed predictive model with previous prediction studies.
Our final predictive model includes seven prognostic factors. Four of these factors (neck pain intensity, low back pain intensity, pain other than neck and back pain and recovery expectations) have previously been reported to be independent prognostic factors of recovery from WAD [9, 11, 12]. According to the “2000-2010 Bone and Joint Decade Task Force on Neck Pain and Its Associated Disorders”, the available evidence varies about the prognostic role of age and prior headaches . Our results agree with those of Kamper and colleagues who reported that the rate of recovery from WAD is faster within the first few weeks after the collision and then slows down (Figure 2) . Considering this, it seems reasonable that the factor “number of days to reporting the collision”, reflecting duration of neck pain, is one of the predictors in our final model. Although there is evidence from other studies that depressed mood predicts poor recovery in WAD, our final model did not include this factor [9, 11, 16]. It is possible that the physical therapists’ active clinical management of these patients attenuates the effect of depressed mood on recovery.
Strengths and limitations
Our study meets the criteria for an optimal design of prediction studies of WAD and physical therapy [39, 40]. First, we used a sample recruited shortly after the injury. Second, we clearly described our study population and prognostic factors. Our sample was population-based. All Saskatchewan health care providers were mandated to report whiplash injuries to SGI. Third, we used a long enough follow-up period for the outcome to develop. Fourth, we selected potential prognostic factors based on published evidence and clinical relevance with acceptable psychometric properties of the measurements used. Fifth, the patients were blinded to the study objective. Sixth, we used bootstrap to cross validate our model. Finally, our sample size was large enough for the numbers of associations tested in the multivariate analyses (≥ 10 events/association) [34, 40]. Our follow-up rate was 88% and there were only minor differences between the study population and “the complete sample”. Furthermore, the sensitivity analyses did not differ to the main analyses. This provides confidence that attrition was not associated with our outcome of interest.
Because all patients in our sample consulted a physical therapist and a medical doctor, our prediction model should be restricted to this population. We do not know if the model is valid for patients who consulted other health care providers such as chiropractors and massage therapists [14, 15].
Our study also has limitations. We did not have information about the specific treatment received by the patients prior to baseline. Treatment may have the potential to change recovery rate and if it is an important prognostic factor, this information could have improved the predictive ability of the model. Information on lifestyle factors such as e.g. physical activity, smoking and alcohol consumption were not collected with the baseline questionnaire. Moreover, self-reported measures of pain and other comorbidities prior to collision tend to be under reported by patients with post-collision neck pain, something that maybe affected our predictive model . We used the data collected in the baseline questionnaire as a proxy for medical history collected by a physical therapist. It is possible that patients would answer differently when consulting a physical therapist. Therefore the predictive ability of the predictors considered in our study may have been influenced by the methods used to collect the data.
Despite these limitations, we believe the findings of this study are sound and can be reproduced.
This predictive model for recovery from WAD among patients consulting physical therapy has an acceptable predictive ability, is robust and has a good fit. Our model can guide physical therapists to assess medical history information that are important for predicting recovery from WAD. Furthermore, our result can give researchers some useful information for future studies on the prognosis of WAD. Our study is the first step (derivation) in the development of a prediction rule. We recommend that our model be tested in different WAD populations (external validation). Similarly, the model needs to be tested in clinical settings to determine its impact on practice pattern, outcome and costs of care for patients with WAD (impact analysis) .
The Saskatchewan Government Insurance
Numeric rating scale
Centre for Epidemiologic Studies Depression Scale
Hazard rate ratio
The original study was funded by a grant in aid of research from Saskatchewan Government Insurance to the University of Saskatchewan (JDC and LJC at the University of Saskatchewan). The salary for TB was provided by the Health Care Science Postgraduate School at Karolinska Institutet and for ES by the Swedish Council of Working Life and Social Research. The authors thank Matteo Bottai for supporting in statistical matters. We also thank Lars Alfredsson, Eva Vingård and Irene Jensen for general support and useful advice during the work with the study.
- Spitzer WO, Skovron ML, Salmi LR, Cassidy JD, Duranceau J, Suissa S, Zeiss E: Scientific monograph of the Quebec task force on whiplash-associated disorders: redefining "whiplash" and its management. Spine. 1995, 20: 1S-73S. 10.1097/00007632-199501000-00001.View ArticlePubMedGoogle Scholar
- Curatolo M, Bogduk N, Ivancic PC, McLean SA, Siegmund GP, Winkelstein BA: The role of tissue damage in whiplash-associated disorders: discussion paper 1. Spine. 2011, 36: S309-S315.View ArticlePubMedPubMed CentralGoogle Scholar
- Holm LW, Carroll LJ, Cassidy JD, Hogg-Johnson S, Cote P, Guzman J, Peloso P, Nordin M, Hurwitz E, van der Velde G, Carragee E, Haldeman S: The burden and determinants of neck pain in whiplash-associated disorders after traffic collisions: results of the bone and joint decade 2000-2010 task force on neck pain and its associated disorders. J Manipulative Physiol Ther. 2009, 32: S61-S69. 10.1016/j.jmpt.2008.11.011.View ArticlePubMedGoogle Scholar
- Conlin A, Bhogal S, Sequeira K, Teasell R: Treatment of whiplash-associated disorders–part I: Non-invasive interventions. Pain Res Manag. 2005, 10: 21-32.View ArticlePubMedGoogle Scholar
- Kamper SJ, Rebbeck TJ, Maher CG, McAuley JH, Sterling M: Course and prognostic factors of whiplash: a systematic review and meta-analysis. Pain. 2008, 138: 617-629. 10.1016/j.pain.2008.02.019.View ArticlePubMedGoogle Scholar
- Di Fabio RP, Boissonnault W: Physical therapy and health-related outcomes for patients with common orthopaedic diagnoses. J Orthop Sports Phys Ther. 1998, 27: 219-230.View ArticlePubMedGoogle Scholar
- Jette DU, Jette AM: Physical therapy and health outcomes in patients with spinal impairments. Phys Ther. 1996, 76: 930-941. discussion 942-935PubMedGoogle Scholar
- Bassols A, Bosch F, Banos JE: How does the general population treat their pain? A survey in Catalonia, Spain. J Pain Symptom Manage. 2002, 23: 318-328. 10.1016/S0885-3924(01)00415-8.View ArticlePubMedGoogle Scholar
- Carroll LJ, Holm LW, Hogg-Johnson S, Cote P, Cassidy JD, Haldeman S, Nordin M, Hurwitz EL, Carragee EJ, van der Velde G, Peloso P, Guzman J: Course and prognostic factors for neck pain in whiplash-associated disorders (WAD): results of the bone and joint decade 2000-2010 task force on neck pain and its associated disorders. J Manipulative Physiol Ther. 2009, 32: S97-S107. 10.1016/j.jmpt.2008.11.014.View ArticlePubMedGoogle Scholar
- Hartling L, Pickett W, Brison RJ: Derivation of a clinical decision rule for whiplash associated disorders among individuals involved in rear-end collisions. Accid Anal Prev. 2002, 34: 531-539. 10.1016/S0001-4575(01)00051-3.View ArticlePubMedGoogle Scholar
- Sterling M: Does knowledge of predictors of recovery and nonrecovery assist outcomes after whiplash injury?. Spine. 2011, 36: S257-S262.View ArticlePubMedGoogle Scholar
- Walton DM, Pretty J, Macdermid JC, Teasell RW: Risk factors for persistent problems following whiplash injury: results of a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2009, 39: 334-350.View ArticlePubMedGoogle Scholar
- Carroll LJ: Beliefs and expectations for recovery, coping, and depression in whiplash-associated disorders: lessening the transition to chronicity. Spine. 2011, 36: S250-S256.View ArticlePubMedGoogle Scholar
- Beattie P, Nelson R: Clinical prediction rules: what are they and what do they tell us?. Aust J Physiother. 2006, 52: 157-163. 10.1016/S0004-9514(06)70024-1.View ArticlePubMedGoogle Scholar
- Cote P, Cassidy JD, Carroll LJ: The treatment of neck and low back pain: who seeks care? who goes where?. Med Care. 2001, 39: 956-967. 10.1097/00005650-200109000-00006.View ArticlePubMedGoogle Scholar
- Carroll LJ, Cassidy JD, Cote P: The role of pain coping strategies in prognosis after whiplash injury: passive coping predicts slowed recovery. Pain. 2006, 124: 18-26. 10.1016/j.pain.2006.03.012.View ArticlePubMedGoogle Scholar
- Carroll LJ, Holm LW, Ferrari R, Ozegovic D, Cassidy JD: Recovery in whiplash-associated disorders: Do You Get what You expect?. J Rheumatol. 2009, 36: 1063-1070. 10.3899/jrheum.080680.View ArticlePubMedGoogle Scholar
- Carroll LJ, Jones DC, Ozegovic D, Cassidy JD: How well are you recovering? The association between a simple question about recovery and patient reports of pain intensity and pain disability in whiplash-associated disorders. Disabil Rehabil. 2012, 34: 45-52. 10.3109/09638288.2011.587085.View ArticlePubMedGoogle Scholar
- Cassidy JD, Carroll LJ, Cote P, Frank J: Does multidisciplinary rehabilitation benefit whiplash recovery?: results of a population-based incidence cohort study. Spine. 2007, 32: 126-131. 10.1097/01.brs.0000249526.76788.e8.View ArticlePubMedGoogle Scholar
- Kasch H, Qerama E, Kongsted A, Bendix T, Jensen TS, Bach FW: Clinical assessment of prognostic factors for long-term pain and handicap after whiplash injury: a 1-year prospective study. Eur J Neurol. 2008, 15: 1222-1230. 10.1111/j.1468-1331.2008.02301.x.View ArticlePubMedGoogle Scholar
- Von Korff M, Jensen MP, Karoly P: Assessing global pain severity by self-report in clinical and health services research. Spine. 2000, 25: 3140-3151. 10.1097/00007632-200012150-00009.View ArticlePubMedGoogle Scholar
- Jensen MP, Karoly P: Self-reported scales and procedures for assessing pain in adults. Handbook of pain assessment. Edited by: Turk DC, Melzack R. 2011, New York; London: Guilford, 19-44. 3Google Scholar
- Fejer R, Jordan A, Hartvigsen J: Categorising the severity of neck pain: establishment of cut-points for use in clinical and epidemiological research. Pain. 2005, 119: 176-182. 10.1016/j.pain.2005.09.033.View ArticlePubMedGoogle Scholar
- Zelman DC, Hoffman DL, Seifeldin R, Dukes EM: Development of a metric for a day of manageable pain control: derivation of pain severity cut-points for low back pain and osteoarthritis. Pain. 2003, 106: 35-42. 10.1016/S0304-3959(03)00274-4.View ArticlePubMedGoogle Scholar
- Jensen MP, Smith DG, Ehde DM, Robinsin LR: Pain site and the effects of amputation pain: further clarification of the meaning of mild, moderate, and severe pain. Pain. 2001, 91: 317-322. 10.1016/S0304-3959(00)00459-0.View ArticlePubMedGoogle Scholar
- Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30: 473-483. 10.1097/00005650-199206000-00002.View ArticlePubMedGoogle Scholar
- Boyd JH, Weissman MM, Thompson WD, Myers JK: Screening for depression in a community sample. Understanding the discrepancies between depression symptom and diagnostic scales. Arch Gen Psychiatry. 1982, 39: 1195-1200. 10.1001/archpsyc.1982.04290100059010.View ArticlePubMedGoogle Scholar
- Devins GM, Orme CM, Costello CG, Binik YM, Frizzell B, Stam HJ, Pullin WM: Measuring depressive symptoms in illness populations: psychometric properties of the center for epidemiologic studies depression (CES-D) scale. Psychol Health. 1988, 2: 139-156. 10.1080/08870448808400349.View ArticleGoogle Scholar
- Radloff LS: The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977, 1: 385-401. 10.1177/014662167700100306.View ArticleGoogle Scholar
- Ngo T, Stupar M, Cote P, Boyle E, Shearer H: A study of the test-retest reliability of the self-perceived general recovery and self-perceived change in neck pain questions in patients with recent whiplash-associated disorders. Eur Spine J. 2010, 19: 957-962. 10.1007/s00586-010-1289-x.View ArticlePubMedPubMed CentralGoogle Scholar
- Hosmer DW, Lemeshow S, May S: Applied survival analysis: regression modeling of time-to-event data. 2008, Hoboken, New Jersey: John Wiley & Sons, 2View ArticleGoogle Scholar
- Vittinghoff E, Glidden DV, Shiboski SC, McCulloch CE: Regression methods in biostatistics: linear, logistic, survival, and repeated measures models. 2005, New York: Springer, 133-156.Google Scholar
- Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, New Jersey: L. Erlbaum Associates, 77-81. 2Google Scholar
- Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.View ArticlePubMedGoogle Scholar
- Collett D: Modelling survival data in medical research. 2003, London: Chapman & Hall/CRC, 55-169. 2Google Scholar
- Kerr KF, McClelland RL, Brown ER, Lumley T: Evaluating the incremental value of new biomarkers with integrated discrimination improvement. Am J Epidemiol. 2011, 174: 364-374. 10.1093/aje/kwr086.View ArticlePubMedPubMed CentralGoogle Scholar
- Altman DG, Royston P: What do we mean by validating a prognostic model?. Stat Med. 2000, 19: 453-473. 10.1002/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5.View ArticlePubMedGoogle Scholar
- Hosmer DW, Lemeshow S: Applied logistic regression. 2000, New York: John Wiley & Sons, 160-164. 2View ArticleGoogle Scholar
- Beneciuk JM, Bishop MD, George SZ: Clinical prediction rules for physical therapy interventions: a systematic review. Phys Ther. 2009, 89: 114-124. 10.2522/ptj.20080239.View ArticlePubMedPubMed CentralGoogle Scholar
- Kamper SJ, Hancock MJ, Maher CG: Optimal designs for prediction studies of whiplash. Spine. 2011, 36: S268-S274.View ArticlePubMedGoogle Scholar
- Carragee EJ: Validity of self-reported history in patients with acute back or neck pain after motor vehicle accidents. Spine J. 2008, 8: 311-319. 10.1016/j.spinee.2007.04.008.View ArticlePubMedGoogle Scholar
- Childs JD, Cleland JA: Development and application of clinical prediction rules to improve decision making in physical therapist practice. Phys Ther. 2006, 86: 122-131.PubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/13/264/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.