Sleep quality, the neglected outcome variable in clinical studies focusing on locomotor system; a construct validation study
© Aghayev et al; licensee BioMed Central Ltd. 2010
Received: 8 March 2010
Accepted: 28 September 2010
Published: 28 September 2010
In addition to general health and pain, sleep is highly relevant to judging the well-being of an individual. Of these three important outcome variables, however, sleep is neglected in most outcome studies.
Sleep is a very important resource for recovery from daily stresses and strains, and any alteration of sleep will likely affect mental and physical health, especially during disease. Sleep assessment therefore should be standard in all population-based or clinical studies focusing on the locomotor system. Yet current sleep assessment tools are either too long or too specific for general use.
Based on a literature review and subsequent patient-based rating of items, an expert panel designed a four-item questionnaire about sleep. Construct validation of the questionnaire in a random sample of the German-speaking Swiss population was performed in 2003. Reliability, correlation, and tests for internal consistency and validity were analyzed.
Overall, 16,634 (70%) out of 23,763 eligible individuals participated in the study. Test-retest reliability coefficients ranged from 0.72 to 0.87, and a Cronbach's alpha of 0.83 indicates good internal consistency. Results show a moderate to good correlation between sleep disturbances and health perception, and between sleep disturbances and overall pain.
The Sleep Standard Evaluation Questionnaire (SEQ-Sleep) is a reliable and short tool with confirmed construct validity for sleep assessment in population-based observational studies. It is easy to administer and therefore suitable for postal surveys of the general population. Criterion validity remains to be determined.
Just as general health and pain are very relevant outcome variables in judging an individual's well-being, so too is sleep. Yet of these three important variables, sleep is often neglected in outcome studies.
Sleep is a very important resource for recovery from daily stresses and strains, and its alteration can affect both mental and physical health [1–6]. Sleep is even more important during disease. Sleep alterations increase the pathological significance of any disease and reduce general well-being [7–10]. Individuals with altered sleep frequently require pain killers or sleep medication to get decent sleep. Therapeutic sleep restoration is often an important condition for the well-being of patients. Unfortunately, sleep is neglected in most of the frequently used general quality of life (QoL) questionnaires such as the SF36 [11, 12], EuroQol 5 D , WHODAS II, Health Assessment Questionnaire , McMaster Health Index , and WHO-5  or assessment instruments focusing on the locomotor system such as the WOMAC , Arthritis Impact Measurement Scales , Oswestry Disability Index , and many others. Among frequently used QoL assessment instruments, the Sickness Impact Profile , the WHOQol-100, the Duke Health Profile  and the Nottingham Health Profile  include one or more questions on sleep characteristics, but they are not meant to be analyzed as an independent dimension of general health.
A number of patient-reported sleep measures have already been published . Measures involving laboratory visits, sleep diaries, or actigraphy consume time and money in clinical trials or population-based studies . Some questionnaires developed for sleep assessment are quite comprehensive [25–28] and too long to be used as population-based questionnaires or in clinical trials where sleep quality is one of many dimensions to be assessed. The Epworth Sleepiness Scale is a short instrument focusing on only one dimension of the sleep problem, daytime sleepiness, which therefore makes it useful only in specific circumstances . The four-item scale of Jenkins et al. , although brief, contains no questions about either sleep medication or patient-reported reasons for sleep problems. Such questions are important in patients with disease of the locomotor system because sleep medication is an indicator of the severity of a sleep problem, and patient-reported reasons for sleep problems are needed to discriminate between locomotor, psychological, or other sources of sleep problems.
The need for a very brief, patient-reported sleep measure designed for population-based studies or clinical trials in which sleep is one of several dimensions to be assessed is clear. Such an instrument will encourage inclusion of valid sleep items in clinical epidemiological research. Here we report on the development and construct validation of a Sleep Standard Evaluation Questionnaire (SEQ-Sleep) using a population-based sample. SEQ-Sleep can be combined with the previously published Pain Standard Evaluation Questionnaire (SEQ-Pain)  or any other questionnaire.
The Standard Evaluation Questionnaire
The "Standard Evaluation Questionnaire" (SEQ) was developed in 2003 as part of a nationwide, population-based survey in the German-speaking area of Switzerland . SEQ consists of 43 items relating to different ICF (International Classification of Functioning, Disability, and Health) dimensions  such as demographic variables, pain, activities of daily living (ADL), medications, need of help, sports, work, smoking and drinking, social conditions, mental health, and sleep.
Development of the sleep items within the SEQ (SEQ-Sleep)
As part of the complete SEQ booklet, the four sleep items were tested in a pilot study on a mixed sample of 637 individuals (out of 1100 individuals approached) from 17 institutions (response rate = 58%). 125 of these participants were enrolled in advanced training courses at three sport schools (response rate within this subgroup = 72%), 171 were employees of four commercial companies (response rate = 67%), 69 lived at homes for the elderly (response rate = 53%), 161 came from a tertiary care emergency department (response rate = 44%), and 111 were patients from six orthopedic or rheumatology tertiary care centers (response rate = 64%). The mean age of participants (53% women) was 47.2 ± 20 and mean body mass index was 23.8 kg/m2 ± 4. Musculoskeletal complaints were reported by 56%, and 9% were dependent on help for daily living. The first 48 responders were asked to take part in a structured interview aimed at identifying ambiguities in wording and adapting the relevant items (45, or 94%, participated).
A computer generated random sample of 250 participants was included in a test-retest study (n = 249; 99%). The time lag between the two questionnaires was seven days on average (range 4-11). The intraclass correlation coefficient (ICC, calculated using bootstrap method for two-way mixed-effects ANOVA ICC) for the two items in the sleep sections was 0.84, and weighted kappa coefficients ranged from 0.71 to 0.79 (median 0.78) and were independent of age, gender, and section.
Participants and mailing procedures during the main construct validation study
Testing and validation
The stepwise approach described by Streiner & Norman  and Veenhof et al.  was used to select and evaluate items. More precisely, item selection for the definitive questionnaire was a three-step procedure relying upon 1) test-retest reliability (intra-item reliability), 2) inter-item correlations or redundancy, and 3) Pearson product-moment correlation between sleep items, pain intensity (relevancy), and general health. The first question of the SF-12 questionnaire was used as the general health measure ("In general, would you say your health is?"). All steps were performed in all samples, with a subsequent sensitivity analysis restricted to individuals reporting pain in any location on the numeric rating scales in the original Standard Evaluation Questionnaire.
The test-retest reliability was assessed by sending a second questionnaire to the first 170 responders within a scheduled interval of 7 to 14 days as described by Müller et al. ; ICCs and weighted kappa statistics were used. Values larger than 0.60 were considered to be substantial  and items were discarded if the estimated ICCs or kappa values were below 0.60 .
Potential redundancy between items extracted from the same domain was identified by assessing the correlation between items. If Pearson product-moment correlation between any two items was larger than 0.75, one of the items was discarded.
Cronbach's alpha was determined for the scale as a measure of overall consistency of the two items, and the item total correlation between each item and the total score was calculated.
Association with intensity of pain and general health perception (relevancy)
We aimed to show the relevancy of musculoskeletal pain problems to sleep. Measurement of overall pain in different body regions was conducted by using the same distinction described by Müller et al.  and the maximum reported value was used. For example, if an individual reported a pain rating of six in the right leg and three in the back, a rating of 6 was assigned. The Pearson product-moment correlation coefficient was used to determine correlations between ratings of the higher pain reported in body regions (head and face, upper extremity, neck and back, chest and stomach, lower extremity) and the ratings of other, remaining items to determine the relevancy of the items for pain. Items were discarded if the correlation coefficient was below 0.25. Additionally, some descriptive statistics will be reported to support the relevancy of measuring sleep perception.
The relationship between musculoskeletal pain and sleep problems was analyzed. Comparison of patients with pure musculoskeletal pain with and without sleep problems was performed using a Chi-square test.
For assessment of the sincerity and accuracy of the participants in answering question 3, their answers were compared to reported pain intensity.
Responses were digitized by an independent institution using optical character recognition and all analyses were performed in Stata 10.0.
Characteristics of participants
Characteristics of participants.
Participants included in analyses
(n = 16'191)
Participants reporting sleep problems
(n = 8297)
Participants reporting pain
(n = 10'610)
Age band (n[%])
18 to 34 years
35 to 44 years
45 to 54 years
55 to 64 years
65 to 74 years
75 to 84 years
85 years and above
Body mass index
Less than 25 kg/m2
25 to 30 kg/m2
30 kg/m2 and above
Highest educational level (n[%])
Compulsory schooling/vocational training
High school graduation
Technical college/university degree
Living independently (n[%])
Rural residence* (n[%])
Reported sleep problems (n[%])
Reported reason for sleep problems (n[%])
Because of bodily pain
Because of other bodily problems
Because of psychological problems
Because of other problems
Reported complaint or condition (n[%])
Visual or hearing
Respiratory system and allergies
Currently smoking (n[%])
No sleeping problems
The second test-retest study questionnaire was by returned by 118 (69%) of the first 170 responders within 5 to 13 days (median 11); 77 (65%) of these were women with a mean age of 52.2 ± 16.0 years. The ICC between the original and retest ratings for item one was 0.87 and 0.85 for item two. The median kappa value between the original and the retest item was 0.78 for question three and 0.72 for question four, exceeding the lower limit for inclusion of 0.60.
For the subsample of patients with sleep problems due to musculoskeletal pain, the ICC between the original and retest ratings for item one was 0.83 and 0.84 for item two. The median weighted kappa value between the original and the retest item was 0.77 for question three and 0.74 for question four.
Inter-item correlation: Redundancy
Inter-item correlations of questions 3 and 4 were moderate both for the overall sample (0.71) and those reporting pain (0.70). All values were below the upper bound for inclusion of 0.75.
Internal consistency regarding to the overall sample and the subsample reporting bodily pain (Internal consistency: Cronbach's alpha of the first two items building the total score).
Consistency: Modalities and characteristics of the sleep items
(n = 16'191)
(n = 10'610)
Participants with sleep
problems only because
of bodily pain
(n = 899)
Effects of sleep problems on fatigue
Association with intensity of pain and general health perception: relevancy
Relevance: How does the sleep score correlate with overall pain and general health?
Relevancy: Pearson product-moment correlation coefficients
(n = 16'191)
(n = 10'610)
Participants with sleep
problems only because
of bodily pain
(n = 899)
Effects of sleep problems on fatigue
Relationship between sleep problems and musculoskeletal pain.
N of patients with pain (%)
N of patients without pain (%)
Proportion of patients with pure musculoskeletal pain
Pain intensity (scale: between 1-strong and 7-none)
- No sleep problems
- Sleep problems not because of pain
- Sleep problems because of pain
- Sleep problems because of pain (ex. confounding causes*)
The brief Sleep Standard Evaluation Questionnaire, which includes four items to assess sleep in population-based observational studies, was developed and validated. The questionnaire accounts for sleep and its influence on daytime activity (mandatory questions), reasons for sleep problems and frequency of sleep medication (facultative questions). These were shown to be reliable and valid in a large, representative sample of the general Swiss population.
Strengths and weaknesses
Items selected for inclusion in the questionnaire were extracted from scales previously developed for sleep assessment in clinical trials [25, 28]. We did not include items from sleep-assessment scales used in other medical specialties (e.g. neurology or oncology), nor did we develop any new items. According to the guidelines for assessing the quality of scales, a set of patients was involved in the selection of items to be included in the questionnaire [37, 39]. A pool of items was proposed by a group of experts from a literature review based on two frequently used sleep questionnaires. Patients' pre-evaluation of the subjectively important sleep items allowed for subsequent reduction of the number of items to a minimum set of four questions. The subsequent study drew a large number of participants from the general population and was not restricted to individuals experiencing disturbed sleep. The validation study also included a sizeable subsample used for calculating test-retest reliability 15% of the participants reporting sleep problems cited bodily pain as the reason for their sleep problems, while 11% of those reporting pain cited pain as the origin of sleep disturbance (Table 1). These figures draw upon a population-based sample in which the majority of persons report only low-level pain and patients with severe pain are rare . It is expected that patients with severe pain will report a higher percentage of sleep disturbances due to bodily pain.
The median duration of 11 days between the completion of the first and second questionnaires in the test-retest study may be too long for assessing the reliability of sleep assessments since acute sleep disturbance episodes could have occurred or sleep quality may have changed during this period. However, test-retest reliability was high for all items. Our questionnaire covers participant experience during the previous four weeks. Acute episodes of increased sleep disturbances and variations in sleep medications might therefore have been unlikely to be detected.
Concurrent validity criterion with respect to other sleep questionnaires was not assessed in our study set up. Our validation study has therefore preliminary character.
As in other surveys, women and individuals with higher education were overrepresented in our study . Other demographic characteristics differed only slightly between our sample and the general Swiss population. The overall response rate in this sample of the general population was 70%, which is higher than other studies [41, 42]. The proportion of fully completed questionnaires also was high, indicating that participants carefully responded to the questions. Both of these facts confirm the quality of the data and the suitability of our questionnaire for population-based observational studies. Although the development of the SEQ-Sleep was based on a large population-based sample, it is from only one country with one language. Its transferability to other countries and languages remains unclear.
Other sleep assessment tools cited above were developed specifically for clinical trials and are not particularly recommended for population-based observational studies . The MOS Sleep Scale, for example, may be used for sleep assessment in restless leg syndrome , diabetic peripheral neuropathy , neuropathic pain , or cancer pain [28, 45] where specific sleep assessment is required. Some questionnaires, e.g., the MOS Sleep scale, can be definitively applied for an unspecific sleep assessment. But to our knowledge there is no other short and easy to administer sleep assessment instrument available for the assessment of sleep regardless of the underlying pathology that can provide patient-reported reasons for the sleep problems (e.g., locomotor system pain).
The relationship between general health perception and sleep is expectedly high . Empirically, the restoration of healthy sleep conditions in patients has a high impact on their general health and quality of life perception. This relationship is supported by our results, but needs further investigation.
The patients with sleep problems because of pain have significantly more pure musculoskeletal pain in comparison with the other patients. This underlines important relationship between disturbed sleep and musculoskeletal pain and reasons the use of sleep as an outcome variable in clinical studies on the locomotor system.
Implications for future studies
For the concluding validation, concurrent validity criterion needs to be determined. Our questionnaire was developed for population-based cross-sectional studies of sleep assessment, but it also could be used in clinical trials and other longitudinal studies. This questionnaire might also be useful in evaluating patients in routine clinical practice and in computer-assisted telephone surveys. Additional study would be required to evaluate the usefulness and psychometric properties of the questionnaire in these settings, even if they might differ only slightly. Our study being restricted to Switzerland and its German-speaking population, the transferability of the questionnaire to other countries and languages needs to be examined. While a validation of the French version is currently underway, future studies also should include validations of English and Spanish translations. Finally, the association between measures derived from our questionnaire and physical or mental conditions merits further study.
The Sleep Standard Evaluation Questionnaire is a reliable and short tool with confirmed construct validity for sleep assessment in population-based observational studies. It is easy to administer and therefore suitable for postal surveys of the general population. The performed validation has preliminary character as the concurrent validity criterion with respect to other sleep questionnaires is not yet determined.
Standard Evaluation Questionnaire
Quality of Life
a questionnaire on health-related quality of life
- EuroQol 5 D:
European Quality of Life questionnaire
- WHODAS II:
World Health Organization Disability Assessment Schedule II
Well Being Index
standardized questionnaire to evaluate the condition of osteoarthritis patients developed at Western Ontario and McMaster Universities
World Health Organization Quality of Life
Activities of Daily Living
- MOS sleep scale:
sleep scale from the Medical Outcomes Study
National Research Program
This project was supported by the National Research Program NRP 53 "Musculoskeletal Health-Chronic Pain" of the Swiss National Science Foundation (Project 405340-104826). The study also received peer-reviewed research grants from two independent research funders in Zurich, Switzerland, the Gottfried and Julia Bangerter-Rhyner, and the Georg von Hevesy foundations.
- Baldwin CM, Griffith KA, Nieto FJ, O'Connor GT, Walsleben JA, Redline S: The association of sleep-disordered breathing and sleep symptoms with quality of life in the Sleep Heart Health Study. Sleep. 2001, 24 (1): 96-105.PubMedGoogle Scholar
- Hoch CC, Dew MA, Reynolds CF, Monk TH, Buysse DJ, Houck PR, Machen MA, Kupfer DJ: A longitudinal study of laboratory- and diary-based sleep measures in healthy "old old" and "young old" volunteers. Sleep. 1994, 17 (6): 489-496.PubMedGoogle Scholar
- Katz DA, McHorney CA: The relationship between insomnia and health-related quality of life in patients with chronic illness. J Fam Pract. 2002, 51 (3): 229-235.PubMedGoogle Scholar
- Kuppermann M, Lubeck DP, Mazonson PD, Patrick DL, Stewart AL, Buesching DP, Fifer SK: Sleep problems and their correlates in a working population. J Gen Intern Med. 1995, 10 (1): 25-32. 10.1007/BF02599573.View ArticlePubMedGoogle Scholar
- Reid KJ, Martinovich Z, Finkel S, Statsinger J, Golden R, Harter K, Zee PC: Sleep: a marker of physical and mental health in the elderly. Am J Geriatr Psychiatry. 2006, 14 (10): 860-866. 10.1097/01.JGP.0000206164.56404.ba.View ArticlePubMedGoogle Scholar
- Hamilton NA, Gallagher MW, Preacher KJ, Stevens N, Nelson CA, Karlson C, McCurdy D: Insomnia and well-being. J Consult Clin Psychol. 2007, 75 (6): 939-946. 10.1037/0022-006X.75.6.939.View ArticlePubMedGoogle Scholar
- Berger AM, Mitchell SA: Modifying cancer-related fatigue by optimizing sleep quality. J Natl Compr Canc Netw. 2008, 6 (1): 3-13.PubMedGoogle Scholar
- Menefee LA, Frank ED, Doghramji K, Picarello K, Park JJ, Jalali S, Perez-Schwartz L: Self-reported sleep quality and quality of life for individuals with chronic pain conditions. Clin J Pain. 2000, 16 (4): 290-297. 10.1097/00002508-200012000-00003.View ArticlePubMedGoogle Scholar
- Simpson N, Dinges DF: Sleep and inflammation. Nutr Rev. 2007, 65 (12 Pt 2): S244-252. 10.1301/nr.2007.dec.S244-S252.View ArticlePubMedGoogle Scholar
- Long AC, Krishnamurthy V, Palermo TM: Sleep Disturbances in School-age Children with Chronic Pain. J Pediatr Psychol. 2008, 33 (3): 258-268. 10.1093/jpepsy/jsm129.View ArticlePubMedGoogle Scholar
- Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30 (6): 473-483. 10.1097/00005650-199206000-00002.View ArticlePubMedGoogle Scholar
- Ware JJ, Kosinski M, Keller SD: A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996, 34 (3): 220-233. 10.1097/00005650-199603000-00003.View ArticlePubMedGoogle Scholar
- Euroquol-Group: Euroquol--a new facility for the measurement of health-related quality of life. Health Pol. 1990, 16: 199-208. 10.1016/0168-8510(90)90421-9.View ArticleGoogle Scholar
- Bruce B, Fries JF: The Health Assessment Questionnaire (HAQ). Clin Exp Rheumatol. 2005, 23 (5 Suppl 39): S14-18.PubMedGoogle Scholar
- Chambers LW, Macdonald LA, Tugwell P, Buchanan WW, Kraag G: The McMaster Health Index Questionnaire as a measure of quality of life for patients with rheumatoid disease. J Rheumatol. 1982, 9 (5): 780-784.PubMedGoogle Scholar
- Heun R, Burkart M, Maier W, Bech P: Internal and external validity of the WHO Well-Being Scale in the elderly general population. Acta Psychiatr Scand. 1999, 99 (3): 171-178. 10.1111/j.1600-0447.1999.tb00973.x.View ArticlePubMedGoogle Scholar
- Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15 (12): 1833-1840.PubMedGoogle Scholar
- Hill J, Bird HA, Lawton CW, Wright V: The arthritis impact measurement scales: an anglicized version to assess the outcome of British patients with rheumatoid arthritis. Br J Rheumatol. 1990, 29 (3): 193-196. 10.1093/rheumatology/29.3.193.View ArticlePubMedGoogle Scholar
- Fairbank JC, Couper J, Davies JB, O'Brien JP: The Oswestry low back pain disability questionnaire. Physiotherapy. 1980, 66 (8): 271-273.PubMedGoogle Scholar
- Bergner M, Bobbitt RA, Carter WB, Gilson BS: The Sickness Impact Profile: development and final revision of a health status measure. Med Care. 1981, 19 (8): 787-805. 10.1097/00005650-198108000-00001.View ArticlePubMedGoogle Scholar
- Parkerson GR, Broadhead WE, Tse CK: The Duke Health Profile. A 17-item measure of health and dysfunction. Med Care. 1990, 28 (11): 1056-1072. 10.1097/00005650-199011000-00007.View ArticlePubMedGoogle Scholar
- Hunt SM, McKenna SP, McEwen J, Williams J, Papp E: The Nottingham Health Profile: subjective health status and medical consultations. Soc Sci Med. 1981, 15 (3 Pt 1): 221-229.Google Scholar
- Cole JC, Dubois D, Kosinski M: Use of patient-reported sleep measures in clinical trials of pain treatment: a literature review and synthesis of current sleep measures and a conceptual model of sleep disturbance in pain. Clin Ther. 2007, 29 (Suppl): 2580-2588. 10.1016/j.clinthera.2007.12.005.View ArticlePubMedGoogle Scholar
- Buysse DJ, Ancoli-Israel S, Edinger JD, Lichstein KL, Morin CM: Recommendations for a standard research assessment of insomnia. Sleep. 2006, 29 (9): 1155-1173.PubMedGoogle Scholar
- Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ: The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res. 1989, 28 (2): 193-213. 10.1016/0165-1781(89)90047-4.View ArticlePubMedGoogle Scholar
- Weaver TE, Laizner AM, Evans LK, Maislin G, Chugh DK, Lyon K, Smith PL, Schwartz AR, Redline S, Pack AI: An instrument to measure functional status outcomes for disorders of excessive sleepiness. Sleep. 1997, 20 (10): 835-843.PubMedGoogle Scholar
- Carpenter JS, Andrykowski MA: Psychometric evaluation of the Pittsburgh Sleep Quality Index. J Psychosom Res. 1998, 45 (1 Spec No): 5-13. 10.1016/S0022-3999(97)00298-5.View ArticlePubMedGoogle Scholar
- Hays RD, Martin SA, Sesti AM, Spritzer KL: Psychometric properties of the Medical Outcomes Study Sleep measure. Sleep Med. 2005, 6 (1): 41-44. 10.1016/j.sleep.2004.07.006.View ArticlePubMedGoogle Scholar
- Johns MW: A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep. 1991, 14 (6): 540-545.PubMedGoogle Scholar
- Jenkins CD, Stanton BA, Niemcryk SJ, Rose RM: A scale for the estimation of sleep problems in clinical research. J Clin Epidemiol. 1988, 41 (4): 313-321. 10.1016/0895-4356(88)90138-2.View ArticlePubMedGoogle Scholar
- Muller U, Tanzler K, Burger A, Staub L, Tamcan O, Roeder C, Juni P, Trelle S: A pain assessment scale for population-based studies: Development and validation of the Pain Module of the Standard Evaluation Questionnaire. Pain. 2007, 136 (1-2): 62-74. 10.1016/j.pain.2007.06.014.PubMedGoogle Scholar
- WHO: The International Classification of Functionning, disability and Health - ICF. 2001, Geneva: WHOGoogle Scholar
- Harbour R, Miller J: A new system for grading recommendations in evidence based guidelines. Bmj. 2001, 323 (7308): 334-336. 10.1136/bmj.323.7308.334.View ArticlePubMedPubMed CentralGoogle Scholar
- Backhaus J, Junghanns K, Broocks A, Riemann D, Hohagen F: Test-retest reliability and validity of the Pittsburgh Sleep Quality Index in primary insomnia. J Psychosom Res. 2002, 53 (3): 737-740. 10.1016/S0022-3999(02)00330-6.View ArticlePubMedGoogle Scholar
- Salmon C, Nichols J: The Next-Birthday Method of respondent selection. Public Opin Q. 1983, 47 (2): 270-276. 10.1086/268785.View ArticleGoogle Scholar
- Streiner D, Normann G: Health Measurement Scales. A Practical Guide to their Developement and Use. 1995, Oxford: Oxford Medical Publications, 2Google Scholar
- Veenhof C, Bijlsma JW, van den Ende CH, van Dijk GM, Pisters MF, Dekker J: Psychometric evaluation of osteoarthritis questionnaires: a systematic review of the literature. Arthritis Rheum. 2006, 55 (3): 480-492. 10.1002/art.22001.View ArticlePubMedGoogle Scholar
- Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.View ArticlePubMedGoogle Scholar
- Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, Roberts JS: Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996, 18 (5): 979-992. 10.1016/S0149-2918(96)80054-3.View ArticlePubMedGoogle Scholar
- Angus VC, Entwistle VA, Emslie MJ, Walker KA, Andrew JE: The requirement for prior consent to participate on survey response rates: a population-based survey in Grampian. BMC Health Serv Res. 2003, 3 (1): 21-10.1186/1472-6963-3-21.View ArticlePubMedPubMed CentralGoogle Scholar
- Daltroy LH, Cats_Baril WL, Katz JN, Fossel AH, Liang MH: The North American spine society lumbar spine outcome assessment Instrument: reliability and validity tests. Spine. 1996, 21 (6): 741-749. 10.1097/00007632-199603150-00017.View ArticlePubMedGoogle Scholar
- Greenough CG, Fraser RD: Assessment of outcome in patients with low-back pain. Spine. 1992, 17 (1): 36-41. 10.1097/00007632-199201000-00006.View ArticlePubMedGoogle Scholar
- Allen R, Becker PM, Bogan R, Schmidt M, Kushida CA, Fry JM, Poceta JS, Winslow D: Ropinirole decreases periodic leg movements and improves sleep parameters in patients with restless legs syndrome. Sleep. 2004, 27 (5): 907-914.PubMedGoogle Scholar
- Gore M, Brandenburg NA, Dukes E, Hoffman DL, Tai KS, Stacey B: Pain severity in diabetic peripheral neuropathy is associated with patient functioning, symptom levels of anxiety and depression, and sleep. J Pain Symptom Manage. 2005, 30 (4): 374-385. 10.1016/j.jpainsymman.2005.04.009.View ArticlePubMedGoogle Scholar
- Payne R, Mathias SD, Pasta DJ, Wanke LA, Williams R, Mahmoud R: Quality of life and cancer pain: satisfaction and side effects with transdermal fentanyl versus oral morphine. J Clin Oncol. 1998, 16 (4): 1588-1593.PubMedGoogle Scholar
- Morin CM, Gibson D, Wade J: Self-reported sleep and mood disturbance in chronic pain patients. Clin J Pain. 1998, 14 (4): 311-314. 10.1097/00002508-199812000-00007.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/11/224/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.