Detecting insomnia in patients with low back pain: accuracy of four self-report sleep measures
© Alsaadi et al.; licensee BioMed Central Ltd. 2013
Received: 9 November 2012
Accepted: 13 June 2013
Published: 27 June 2013
Skip to main content
© Alsaadi et al.; licensee BioMed Central Ltd. 2013
Received: 9 November 2012
Accepted: 13 June 2013
Published: 27 June 2013
Although insomnia is common in patients with low back pain (LBP), it is unknown whether commonly used self-report sleep measures are sufficiently accurate to screen for insomnia in the LBP population. This study investigated the discriminatory properties of the Pittsburgh Sleep Quality Index (Pittsburgh questionnaire), Insomnia Severity Index (Insomnia index), Epworth Sleepiness Scale (Epworth scale) and the sleep item of the Roland and Morris Disability Questionnaire (Roland item) to detect insomnia in patients with LBP by comparing their accuracy to detect insomnia to a sleep diary. The study also aimed to determine the clinical optimal cut-off scores of the questionnaires to detect insomnia in the LBP population.
Seventy nine patients with LBP completed the four self-reported questionnaires and a sleep diary for 7 consecutive nights. The accuracy of the questionnaires was evaluated using Receiver Operator Characteristic (ROC) curves with the Area Under the Curve (AUC) used to examine each test’s accuracy to discriminate participants with insomnia from those without insomnia.
The Pittsburgh questionnaire and Insomnia index had moderate accuracy to detect insomnia (AUC = 0.79, 95% CI = 0.68 to 0.87 and AUC = 0.78, 95% CI = 0.67 to 0.86 respectively), whereas the Epworth scale and the Roland item were not found to be accurate discriminators (AUC = 0.53, 95% CI = 0. 41 to 0.64 and AUC = 0.64, 95% CI = 0.53 to 0.75 respectively). The cut-off score of > 6 for the Pittsburgh questionnaire and the cut-off point of > 14 for the Insomnia index provided optimal sensitivity and specificity for the detection of insomnia.
The Pittsburgh questionnaire and Insomnia index had similar ability to screen for insomnia in patients with low back pain.
The International Classification of Sleep Disorders, second edition (ICSD-2), defines insomnia as the complaint of one or more of the following: difficulty in initiating sleep; difficulty in maintaining sleep; waking up too early and unable to resume sleep or nonrestorative sleep, despite adequate preparation for sleep. These symptoms are to be associated with at least one or more forms of day-time functional impairment related to nocturnal sleep difficulty, such as fatigue; mood disturbance; or sleep dissatisfaction [1, 2].
Insomnia is considered to be the most frequently occurring sleep disorder . It is often associated with medical conditions such as depression, anxiety and respiratory disorders . Insomnia is also common in painful conditions; recent studies have reported that at least 50% of patients with low back pain (LBP) also report symptoms of insomnia [5, 6]. Insomnia is often associated with fatigue, cognitive impairment and mood disturbance, leading to functional impairment . In addition, there is substantial evidence that insomnia can adversely influence an individual’s experience of pain through increasing perception of pain and decreasing pain tolerance and pain threshold . Recent studies have found insomnia symptoms in patients with LBP are significantly associated with pain intensity, day-time functional impairment and psychological distress [5, 6, 9]. These findings imply that insomnia is likely to adversely affect LBP management. Despite this, there is little published information on which is the most accurate and practical method for assessing insomnia in the LBP population. Clinicians and researchers need accurate, brief and cost-effective measures to screen for insomnia and evaluate treatment outcome.
Self-reported questionnaires are a common method used to assess insomnia as sleep data can be collected from multiple nights, they are brief, easy to administer and cost-effective. Several self-reported questionnaires have been developed to assess aspects of sleep quality and are commonly used to assess insomnia symptoms. These include the Pittsburgh Sleep Quality Index (Pittsburgh questionnaire) , Insomnia Severity Index (Insomnia index)  and the Epworth Sleepiness Scale (Epworth scale) . Specifically for LBP populations, researchers and clinicians use sleep item(s) of LBP functional questionnaires to assess their patients’ sleep quality. For example, the sleep item of the Roland and Morris Disability Questionnaire (Roland item) . Some of these questionnaires have been translated to different languages and validated for use in several medical conditions such as cancer [14, 15] and traumatic brain injury .
These questionnaires are potentially useful tools to detect insomnia in patients with LBP. However, their capacity to detect insomnia in this population is currently unknown. It has been suggested that questionnaire’s accuracy to detect insomnia and the optimal cut-off score may differ based on the studied population . In fact, previous clinometric testing of these instruments showed inconsistency for the optimal cut-off scores between different medical conditions as well as community samples [17–20]. Therefore, evaluation of the capacity of these questionnaires to detect insomnia in patients with LBP is necessary before their employment in clinical and research practice.
The subjectivity of the insomnia definition and the absence of a gold standard to diagnose insomnia make it difficult to examine the criterion-related validity of self-reported questionnaires . A solution may be obtained by investigating the sensitivity and specificity of the questionnaire to detect insomnia . Sleep diaries are daily subjective reports of sleep that are widely used to study sleep disturbance [11, 21]. They are completed immediately after arising to provide an evaluation of the previous night’s sleep quantity and sleep disturbance, which minimizes recall bias . Although diaries may not be an optimal method for diagnosing certain insomnia subtypes, they are considered to be useful measures to detect general insomnia disorder [1, 3, 7].
In the current study, we aimed to investigate the properties of four self-reported sleep questionnaires to detect insomnia disorder in patients with LBP by comparing their accuracy to detect insomnia to a reference standard, the Sleep Diary . The study also aimed to determine the optimal cut-off scores of the questionnaires to detect insomnia in the LBP population. We expected that a measure which assesses symptoms of general insomnia, sleep difficulties and day-time impairment (ICSD-2)  would accurately detect insomnia and therefore is a suitable reference standard.
This was a cross-sectional study conducted between March 2010 and June 2012. The study protocol was approved by the University of Sydney Human Research Ethics Committee, Australia (09-2009/12100). All participants signed an informed consent form before participating in the study. Participants were compensated for their time and transportation expenses.
Participants were recruited from physiotherapy clinics in the Sydney metropolitan area, through advertising using flyers and posters in physiotherapy clinics and community centers and by advertising on local social media web sites. The inclusion criteria were: patients with non-specific low back pain (i.e. low back pain with no specific pathology) , aged between 18 and 79 years and possessing sufficient fluency in the English language to answer self-completed questionnaires. Exclusion criteria were: sciatica (i.e. pain radiating below the knee with definite neurological signs); spinal surgery within the preceding 6 months; previously diagnosed with a sleep disorder for which they were receiving care; receiving care for a mental health condition; and rotating night shift workers. There was no restriction on duration of LBP.
Recruiting physiotherapists informed patients about the study and passed their contact details to the study researcher. Potential participants from the community were provided with information about the study through the post or email. Volunteers who showed an interest in participating were then contacted and screened for inclusion by the study researcher.
Demographic questions regarding a participant’s age, gender, weight, height, educational level, employment status, smoking status, and whether the participant was seeking care for LBP or taking medication.
Self-reported measures of sleep quality, including the Pittsburgh questionnaire, Insomnia index, and Epworth scale.
The Brief Pain Inventory, which measures pain intensity ; the Depression, Anxiety and Stress Scale (DASS-21) , which measures depression, anxiety and stress; the Roland and Morris Disability Questionnaire , which measures disability due to LBP; and the Fatigue Severity Scale , which measures fatigue.
Participants also completed the Pittsburgh sleep diary , over 7 consecutive days. Participants were followed up, at least once, either via phone calls or through SMS text messages to ensure that the sleep diary was being completed.
The sleep diary  consists of two sections. Although both sections were completed, only the second section was used in this study. The section collects information about the previous night’s sleep and is completed immediately after awaking. It contains the following items: (1) time went to bed, (2) lights out time, (3) sleep onset latency (SOL) calculated as the minutes from lights out until falling asleep, (4) time of final waking, (5) method/ reason of final waking, (6) number of times the participant woke during the night, wake after sleep onset (WASO), (7) duration of WASO in minutes calculated as the total number of minutes of awake that occurred after sleep onset and before the final awaking, (8) reason(s) for WASO, (9) sleep quality, (10) mood on final awaking, and (11) alertness on final waking. Items 9 to 11 were completed on a 0–10 Numerical Rating Scale (NRS).
The Pittsburgh questionnaire is a self-report instrument designed to evaluate sleep quality over the last month. It consists of 19 items to produce 7 aspects of sleep quality (sleep onset latency, sleep duration, efficiency, quality, disturbances, medication, and day-time dysfunction). The sum of these 7 aspects (0–3) yields a global score of sleep quality (0–21); a high sore is an indication of poor sleep quality. The cut-off score of > 5 has been found to be an accurate cut-off score to distinguish between patients with primary insomnia and those without insomnia .
The Insomnia index is a 7-item scale, with each item rated on a 5-point Likert-scale. It assesses insomnia severity, sleep satisfaction, sleep interference with day-time functioning, noticeability of sleep impairment, and distress caused by insomnia over the last 2 weeks. Summation of the 7-items provides a score ranging from 0 to 28, where 0–7 indicates no significant insomnia, 8 to 14 indicates sub-threshold insomnia, 15 to 21 indicates moderate insomnia, and 22 to 28 indicates severe insomnia. The cut-off score of > 14 has been reported to be the most accurate point to detect patients with primary insomnia .
The Epworth scale is an 8-item self-report questionnaire used to assess excessive day-time sleepiness over the last week. Participants indicate on a 4-point Likert- type scale (0 = never, 3 = high chance) the likelihood that they will “doze off or fall asleep” in eight different situations. Summation of the 8 responses produces a total score ranging from 0 to 24; with higher scores reflecting greater sleepiness. The cut off score of > 10 has been found to accurately determine excessive day-time sleepiness .
The Roland and Morris Disability questionnaire  is a 24-item self-administered questionnaire designed to measure the effect of LBP on a patient’s normal activities of daily living. The sleep item (Roland item) examines sleep quality in relation to the effect of pain: “I sleep less well because of my back”. The response format of the item is dichotomous (yes/no). The item has been reported to be easy to understand and answer by patients with LBP .
The four self-reported sleep questionnaires, the Pittsburgh questionnaire; Insomnia index; Epworth scale and the Roland item were selected for several reasons. Both the Pittsburgh questionnaire and the Insomnia index assess several aspects of insomnia, including sleep difficulty and day-time impairments related to night’s sleep, and have been widely used in the assessment of sleep quality in patients with LBP . On the other hand, a questionnaire with a single item may potentially be easier to complete, less time consuming and easier to score and interpret than a measure with multiple insomnia items . We, therefore, attempted to evaluate the discriminatory properties of the Roland item and the Epworth scale to detect insomnia in patients with LBP. The Roland item assesses sleep difficulty and is commonly employed by clinicians and researchers in the domain of LBP  and the Epworth scale is also a common measure that has been translated into 52 languages to assess individual’s day-time sleepiness .
We adopted the general criteria of the International Classification of Sleep Disorder, second edition (ICSD-2) to classify insomnia . Participants were classified as having insomnia if they reported in the sleep diary, for at least 3 of the 7 nights, either (i) wake after sleep onset (WASO) > 30 minutes or (ii) sleep onset latency (SOL) > 30 minutes. These symptoms should be associated with either poor sleep quality or low mood. Poor sleep quality was defined as < 5 on a 0–10 scale where 0 = very bad sleep quality and 10 = very good sleep quality. Low mood was defined as < 5 on final waking on 0–10 scale where 0 = very tense and 10 = very calm. We chose the frequency of ≥ 3 nights and duration of SOL and WASO of > 30 minutes as these are the most commonly recommended criteria [1, 3, 32].
Statistical analyses were conducted as described below using SPSS version 19 (SPSS Inc., Chicago, IL), MedCalc for Windows, version 188.8.131.52 (MedCalc Software, Mariakerke, Belgium) and Meta-DiSc data analysis software .
Discriminatory properties of self-report questionnaires were tested using the sleep diary as the reference test and each questionnaire as the index test.
1. The scores from the index tests were used to construct Receiver Operator Characteristic (ROC) curves using non-parametric methods , with the Area Under the Curve (AUC) used to examine each test’s accuracy to discriminate participants with insomnia from those without insomnia. The AUC ranges from 0 to 1.0 with a value of 0.5 representing discrimination no better than chance. Using DeLong’s method ROC curves were compared to test for statistically significantly differences between AUCs . AUC values were interpreted using guidelines provided by Swets (1988) : (0.5 to 0.7 = low accuracy, 0.7 to 0.9 = moderate accuracy, >0.9 = high accuracy).
2. Index test scores were dichotomised using both the ROC technique and scores based on the literature: for the Pittsburgh questionnaire we used cut-off points of > 5  and > 10 , a cut-off > 14 for the Insomnia index , and for the Epworth scale we used a cut-off point of >10 . A 2 x 2 table was created to calculate sensitivity, specificity, positive likelihood ratio and negative likelihood ratio. Sensitivity was defined as the proportion of people with insomnia who tested positive, while specificity was defined as the proportion of people without insomnia who tested negative.
Sample’s demographic and clinical characteristics
(0 – 21)
(0 – 28)
(0 – 24)
Body mass index
Taking pain medication
Level of education
Married or defacto
Area under the curve of the four measures
0.68 to 0.87
0.67 to 0.86
0.53 to 0.75
0.41 to 0.64
Pairwise comparison between areas under the ROC curve
Difference between areas
(95% CI) *
Pittsburgh questionnairea vs Insomnia indexb
0.01 (−0.07 to 0.09)
Pittsburgh questionnairea vs Roland itemc
0.14 (0.01 to 0.28)
Pittsburgh questionnairea vs Epworth scale d
0.26 (0.09 to 0.41)
Insomnia indexb vs Roland itemc
0.13 (0.003 to 0.27)
Insomnia indexb vs Epworth scaled
0.25 (0.09 to 0.41)
Epworth scaled vs Roland itemc
0.11 (−0.05 to 0.28)
Prevalence of insomnia, sensitivity, specificity, positive likelihood ratio and negative likelihood ratio values at reported cut-off points and optimal discriminatory cut-off point for each measure
LR + a
LR - b
1.8 (1.3 - 2.4)
100 (83 – 100)
49 (36 – 63)
1.9 (1.5 – 2.5)
3.28 (2.1 - 5.1)
0.59 (0.3 - 1.2)
4.43 (3.1 - 6.4)
0.46 (0.2 - 1.1)
49 (36 – 63)
80 (56 – 94)
2.46 (0.99 – 6.13)
0.64 (0.46 – 0.89)
76 (63 – 86)
20 (6 – 44)
0.95 (0.73 – 1.24)
1.19 (0.44 – 3.19)
Insomnia is prevalent in patients with LBP [5, 9]. Identifying a measure to detect insomnia that is accurate, brief and easy to administer in this population is essential so that clinicians and researchers can gain a more complete understanding of these common co-morbidities. We evaluated the discriminatory properties of four self-report sleep measures (the Pittsburgh questionnaire, Insomnia index, Epworth scale and the Roland item). These measures were selected because they are widely employed to assess sleep quality and they assess some insomnia symptoms such as sleep disturbance and day-time sleepiness. Our findings suggest that the Pittsburgh questionnaire and the Insomnia index are accurate instruments for screening insomnia in patients with LBP, while the Epworth and the Roland have unacceptably low accuracy.
The Epworth scale and Roland item showed poor accuracy to distinguish between patients with insomnia and those without. This may be because each of these questionnaires only assesses a single criterion of insomnia. The Roland item measures sleep quality (the impact of LBP on a patient’s sleep), while the Epworth scale measures day-time sleepiness. Although sleep disturbance and day-time sleepiness are considered to be important traits of insomnia diagnosis, they are inadequate for an insomnia diagnosis.
Although the Pittsburgh questionnaire is designed to assess sleep quality and sleep disturbance, it additionally includes the assessment of day-time impairment related to disturbed sleep: day-time sleepiness and the influence of disturbed sleep on a patient’s social activity. Likewise the Insomnia index measures the severity of insomnia and its effect on a patient’s day-time functioning. The ROC analysis indicated that both the Pittsburgh questionnaire and Insomnia index were able to accurately distinguish patients with insomnia from those without. These findings suggest that when the goal is to diagnose insomnia a measure that combines several insomnia criteria is more accurate than a single criterion measure. This is supported by the work of Sanford et al.  who evaluated the accuracy of the Epworth scale to diagnose insomnia in a community sample. They found that although participants with insomnia reported statistically significantly higher scores of sleepiness than those without insomnia, the ROC curve analysis demonstrated that the scale had poor accuracy to diagnose insomnia. The authors concluded that a measure that combines several insomnia criteria is likely to provide a more accurate diagnosis.
Identifying the optimal cut-off score of a questionnaire is essential to identify patients who require further sleep evaluation and those who may require intervention. Our analysis of sensitivity and specificity for the Pittsburgh questionnaire using the recommended global score of > 5 showed that although the questionnaire yielded a high sensitivity of 100%, the specificity was low at 44%. The optimal cut-off score of > 6, identified from the ROC curve, resulted in a slightly higher specificity of 49% with 100% sensitivity. This finding concurs with the finding of Backhaus et al.  who examined the psychometric properties of the Pittsburgh questionnaire for patients with primary insomnia. The authors reported that the cut-off score of > 6 increased the questionnaire’s capacity to rule out patients without clinical insomnia. Although both scores yielded a high sensitivity (100%), which indicated that all of the patients with insomnia have been detected, both cut-off scores had low specificity suggesting that half of the patients had been incorrectly identified as having insomnia. Higher sensitivity is an important characteristic of a screening tool in the primary care setting as it is often more important not to miss any patients with the condition than to incorrectly identify some without it. On the other hand, for research purposes high specificity may be required to rule out people without the condition and therefore provide homogenous sample of individuals with a high probably of having the condition. It has been suggested that cut-off score of > 10 for the Pittsburgh questionnaire would increase the questionnaire’s accuracy to detect people who have difficulty in initiating and maintaining sleep, which is an important trait of insomnia [17, 36]. Our data showed the cut-off score > 10 resulted in a specificity of 85% with a sensitivity of 50%. The rate of insomnia accordingly declined to 24%, which was closer to the estimate reported by the sleep diary (25%).
The cut-off score of > 14 for the Insomnia index produced optimal discrimination between patients with insomnia and those without (sensitivity 60% and specificity 86%). This result is similar to that of Smith and Trinder  who found that a cut-off score of > 14 provided optimal discrimination between people with primary insomnia and the control group. Although this score maximized both sensitivity and specificity to 94%, with an AUC value of 0.97, the study was a case–control design which might have led to overestimation of test accuracy . Savard et al.  who examined the discriminatory properties of the Insomnia index in a sample of 1670 patients with cancer, similarly reported that the cut-off score of >14 provided optimal discrimination between patients with insomnia and those without insomnia (sensitivity 51% and specificity 91%).
In clinical practice, likelihood ratios are more useful than sensitivity and specificity for characterising test accuracy . Likelihood ratios indicate likely the test result is in people with the disease compared to those without the disease . The likelihood ratio analysis (Table 4) suggests that the Insomnia index was marginally more accurate than the Pittsburgh questionnaire for detecting patients with insomnia. The analysis demonstrated that a score of 15 points or more on the Insomnia index is 4.43 times more likely in someone with insomnia than someone without insomnia. In addition to its accuracy, the Insomnia index is briefer, easier to administer and to score than the Pittsburgh questionnaire. The Insomnia index therefore appears to be most useful for insomnia assessment of patients with LBP.
This study had limitations that should be addressed. First, although the sleep diary is considered to be a useful tool to diagnose insomnia, its subjective nature is a disadvantage. It has been suggested that patients with sleep problems have the tendency to misperceive their sleep. These patients tend to underestimate their sleep duration and overestimate sleep latency and duration of waking after sleep onset . This limitation potentially influenced sleep variables derived from the sleep diary and therefore the study findings. Second, the study did not investigate sleep-related disorders that may occur along with insomnia, for example sleep apnea and periodic limb movement, which might confound the insomnia assessment. A strength of this study is however that we followed the guidelines for assessing insomnia  and the recommendations for designing studies for a diagnostic testing . Additionally, it is the first study to provide guidelines for the optimal assessment of insomnia in patients with LBP using self-reported questionnaires. Finally, the inclusion of patients with LBP who were seeking health care for their LBP, as well as those who were not, increases the representativeness of the sample.
This is the first study to provide guidelines for the optimal assessment of insomnia in patients with LBP using self-reported questionnaires. The study findings showed that the Pittsburgh questionnaire and the Insomnia index are useful instruments for screening insomnia in patients with LBP. The cut-off score of > 6 for the Pittsburgh questionnaire and cut-off score of > 14 for the Insomnia index provided optimal sensitivity and specificity for the detection of insomnia. The Insomnia index is the briefer, easier to administer and to score, therefore, appears the most appropriate instrument to identify insomnia in the LBP population.
This research was supported by a grant from the University of Sydney, Sydney Medical School, Sydney, Australia. The authors are indebted to all patients who participated in the study. We would also like to gratefully acknowledge the assistance of physiotherapists who participated in patient recruitment. Mr. Alsaadi is a PhD student who is supported by the University of Dammam, Kingdom of Saudi Arabia. Prof. Maher’s fellowship is funded by the Australian Research Council.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.