This article has Open Peer Review reports available.
Acupuncture for chronic neck pain: a pilot for a randomised controlled trial
© Salter et al; licensee BioMed Central Ltd. 2006
Received: 09 June 2006
Accepted: 09 December 2006
Published: 09 December 2006
Acupuncture is increasingly being used for many conditions including chronic neck pain. However the evidence remains inconclusive, indicating the need for further well-designed research. The aim of this study was to conduct a pilot randomised controlled parallel arm trial, to establish key features required for the design and implementation of a large-scale trial on acupuncture for chronic neck pain.
Patients whose GPs had diagnosed neck pain were recruited from one general practice, and randomised to receive usual GP care only, or acupuncture (up to 10 treatments over 3 months) as an adjunctive treatment to usual GP care. The primary outcome measure was the Northwick Park Neck Pain Questionnaire (NPQ) at 3 months. The primary analysis was to determine the sample size for the full scale study.
Of the 227 patients with neck pain identified from the GP database, 28 (12.3%) consenting patients were eligible to participate in the pilot and 24 (10.5%) were recruited to the trial. Ten patients were randomised to acupuncture, receiving an average of eight treatments from one of four acupuncturists, and 14 were randomised to usual GP care alone. The sample size for the full scale trial was calculated from a clinically meaningful difference of 5% on the NPQ and, from this pilot, an adjusted standard deviation of 15.3%. Assuming 90% power at the 5% significance level, a sample size of 229 would be required in each arm in a large-scale trial when allowing for a loss to follow-up rate of 14%. In order to achieve this sample, one would need to identify patients from databases of GP practices with a total population of 230,000 patients, or approximately 15 GP practices roughly equal in size to the one involved in this study (i.e. 15,694 patients).
This pilot study has allowed a number of recommendations to be made to facilitate the design of a large-scale trial, which in turn will help to clarify the existing evidence base on acupuncture for neck pain.
It is estimated that during the course of a year, approximately 34% of adults experience neck pain, of which a significant proportion is chronic, with about 14% experiencing neck pain for at least six months duration . As well as the impact it has on individuals at a personal level, there are also significant financial costs associated with neck pain . In general, evidence is lacking to support many standard treatments for chronic neck pain , and increasingly people are using alternative treatments such as acupuncture [4, 5].
A systematic review on the effectiveness of acupuncture treatment for neck pain found the evidence to be inconclusive , with some studies producing positive results in favour of acupuncture and others producing negative or equivocal findings. In their systematic review, White and Ernst  documented the poor quality of the reviewed trials, none of which scored full points on the quality assessment used in the review. These findings are reinforced by White et al , who discouraged further reviews on the subject, and argued instead that "the focus must be on actually conducting more clinical trials" of good quality, a view echoed by others in the field [6, 8–10].
Since White and Ernst's review , a number of trials have been conducted. Although they vary considerably in terms of their design, the findings remain inconsistent, with most studies showing some positive results in favour of acupuncture [4, 11–15], some showing negative results [16, 17], and others showing neutral/equivocal findings [18, 19]. An examination of these more recent studies reveals the continued existence of many of the methodological difficulties referred to in previous reviews [6, 7].
In this pilot study, we have focused on establishing the key design features required for a full scale randomised controlled trial of the effectiveness of acupuncture for chronic neck pain, where acupuncture is provided as an adjunct to usual GP care. In particular we aimed to establish: the potential recruitment rate; the level of attendance for, and acceptability of, acupuncture to patients; the variability in the primary clinical outcome measure; and the loss to follow-up. A key outcome of this pilot is the sample size calculation for the full-scale trial. As part of this pilot, we interviewed patients, acupuncturists and GPs to facilitate a fuller understanding of patient and practitioner perspectives, however this qualitative data is not reported here.
Participants were recruited to the study from one general practice in York, North Yorkshire, using a retrospective method of recruitment, similar to that used by McCarney et al . The general practice conducted a search of its database to identify patients over 18 years of age who had consulted the practice with neck pain in the previous 12 months. Patients were excluded if they were known to have cancer, rheumatoid arthritis or ankylosing spondylitis. All of the identified patients were sent an information pack about the study. Consenting patients were included in the study if they had experienced neck pain in the previous four weeks. Patients were excluded if they: a) had their main pain below the elbow or in some other part of the body (other than the neck); b) had received surgery on the neck; c) had haemophilia; d) were currently receiving acupuncture; e) were awaiting legal action related to their neck pain; or f) were unable or unwilling to provide informed consent. York Local Research Ethics Committee approved the study.
Participants were registered to the study by the authors, but random allocation was performed by the York Trials Unit, using computer generated random numbers. This allocation was conducted independently of the study researchers and the clinicians involved in the treatment of the patients, although it was not possible to remain blind to allocation once randomisation had been completed. Due to resource constraints and the initial costs associated with acupuncture, unequal randomisation was used, so 10 patients were randomised to receive acupuncture plus usual GP care, and 14 to usual GP care only. For randomisation, participants were stratified according to whether they had a higher or lower neck pain score on the NPQ.
The acupuncture intervention consisted of up to 10 sessions, with a treatment protocol based on a standardised framework, with both fixed and variable components (see Additional file 1 for further details). The variable components were driven by the theoretical underpinnings of traditional Chinese medicine, including the Five Element approach. The protocol incorporated active management techniques (such as devising a treatment plan with patients, providing relevant explanations, etc.), theoretical frameworks that underpinned diagnosis and treatment, auxiliary techniques (such as acupuncture-related massage), and other aspects of patient care (such as offering lifestyle and dietary advice). Usual GP care was available to both groups, and at three months patients were asked to record all treatments they had received.
The primary clinical outcome was the Northwick Park Neck Pain Questionnaire (NPQ) measured at three months , which is scored out of 36, or 32 for non car drivers, and is presented as a percentage. Medication use at baseline and three months was also collected. Further data, not reported here, was collected regarding quality of life (SF-36) and health utility (EQ-5D). At three months, satisfaction with treatment was measured in both groups, using questions relating to satisfaction with information provided, the treatment received, and the overall care received. Adverse events were also monitored in the acupuncture group.
The outcome data was analysed using SPSS Windows, version 12. Analysis of the primary outcome data was on an intention to treat basis and carried out using ANCOVA with the treatment group as the independent variable, and the baseline score as a covariate. The sample size calculation was based on the minimum clinically meaningful change to the NPQ. The residual variance was estimated from regression on baseline and treatment allocation, a method equivalent to that proposed by Frison & Pocock . This variance was inflated by the method of Browne , using an upper one-sided 90% confidence interval.
Recruitment rate and baseline characteristics
Baseline characteristics of patients by allocation group
GP care only
Female: n (%)
Age: years (SD)
Neck pain duration in years (SD)
% with other health problems
NPQ score as a % (SD)
Number (%) using medication
Attendance and acceptability of acupuncture to patients
Patient satisfaction with treatment at 3 months
Acupuncture (n = 10) %
GP care only (n = 14) %
Neither satisfied or dissatisfied
Neither satisfied or dissatisfied
Overall care received
Neither satisfied or dissatisfied
Usual GP care in both groups
Variability in the primary clinical outcome measure and loss to follow up
Unadjusted scores for the Northwick Park Questionnaire (NPQ) and percentage of patients using medication at baseline and at three months
GP care only group (n = 14)
Acupuncture group (n = 10)
At baseline: % (SD)
3 months: % (SD)
Use of medication:
At baseline: %
3 months: %
Sample size calculation and recruitment strategy for a full-scale trial
A clinically meaningful change on the Northwick Park Questionnaire is 5 percentage points . In a regression model that included all participants and adjustment for baseline NPQ scores, the residual standard deviation of the NPQ was estimated at 12.7 with 18 degrees of freedom. Taking into account potential sampling bias  using an upper one-sided 90% confidence interval for the variance, we estimated a corrected standard deviation of 15.3. Using this estimate in the sample size calculation gives 197 in each arm of the trial, assuming 90% power at the 5% significance level. Allowing for a loss to follow-up of 14%, the actual sample required would be 229 per arm, i.e. a total of 458 patients.
To calculate the total list size of GP practices needed for patient recruitment, we base our estimate on a response rate 12.3% of 1.4% of eligible patients, i.e. 0.172% of the total list. Given our GP practice size of 15,694, we allowed for sampling variation by calculating the upper 80% one sided confidence interval of this response rate to be 0.20%. Hence to recruit 458 patients, we estimate that the total list size would need to be 230,000, roughly 15 practices of an equivalent size to the one used in this pilot.
The pilot study reported here has provided much useful data for the design of a full-scale trial of acupuncture for chronic neck pain. A key finding is that 12.3% of eligible patients on the GP database consented to participate in the trial, a remarkably similar percentage to the 12% found by McCarney et al  in a trial of acupuncture for migraine. Based on the experience of our study, this method will enable a large sample to be recruited to a trial relatively quickly, in comparison with prospective recruitment of incident cases. We also found that a sample size of 458 patients and a GP practice population base of 230,000 would be required in a full-scale trial if GP databases are to be used as a source of identification and recruitment of patients. The evidence from our pilot study suggests that this recruitment strategy is feasible.
We found a trend towards higher levels of satisfaction among those patients referred to acupuncture, compared to those receiving usual GP care alone. All of the patients receiving acupuncture treatment reported high levels of acceptability (with one exception). However, there were some concerns about the safety of acupuncture, specifically the negative reactions to treatment. These included a temporary worsening of symptoms, dizziness, and tiredness, with two patients withdrawing from treatment as a result. Although there were no serious adverse events, defined as "events requiring hospital admission, leading to permanent disability, or resulting in death" , safety is clearly an important issue that should be carefully considered when developing the design of a full-scale trial. We recommend the provision of adequate monitoring of adverse events and clinical supervision for acupuncturists.
The pragmatic design of the trial was also considered appropriate given the widespread use of acupuncture and the fact that this design facilitates economic evaluations . Trials embedded in real world practice tend to have strong external validity, though often at the expense of weaker internal validity than explanatory trials. Due to the difficulties of blinding in acupuncture research generally, Birch  has highlighted the added importance of ensuring that all stages of analysis are blinded, from data-entry to evaluation of the results. Although impractical for the purposes of this pilot, blinding should be implemented in a large-scale trial, to help avoid the potential for bias .
The recruitment processes used in this pilot were successful as patients were identified and recruited relatively simply and quickly. One limitation of our screening procedures was that one patient with cancer inadvertently entered the trial. This indicated a potential flaw with the search strategy, and a future large-scale trial should consider including a cancer question as part of the screening questionnaire given to patients, if the intention remains to exclude patients with cancer.
This study did not set out to establish whether there were components of acupuncture that had specific efficacy. Instead our design was a pragmatic one, where we are working towards an evaluation of the impact of the overall package of acupuncture care. A different research question could have been used to determine the relative contributions of components of the treatment. To do this, a 'placebo' or sham acupuncture control would be used, to control for the components of treatment that are not specific to acupuncture, such as time and attention. Sham approaches are not suitable within pragmatic trials, since they are artificial controls that do not model usual practice , making it difficult to meaningfully interpret their results . Sham acupuncture approaches are generally problematic since there is evidence that they can produce a physiological effect that may be therapeutic [28, 29].
Although the main outcome measure used in this pilot is a validated scale, such self-report measures are subjective. Therefore for a large-scale trial it might be useful to consider including an objective outcome as a secondary measure . Also, given that there is evidence to suggest that preference and belief might influence outcome [31, 32], it is recommended that a large-scale trial establishes preference and belief prior to randomisation, so that their potential influence on outcome can be explored in the analysis [31, 33].
Overall, in terms of generalisability of the trial, the broad inclusion criteria for recruiting patients made it more likely that the patients in the trial were fairly representative of those typically presenting with chronic neck pain. The acupuncture treatment protocol was also fairly broad, though sufficiently standardised to assist replication. Acupuncturists found it sufficiently flexible to allow them to use an individualised approach, reflecting traditional acupuncture as it is usually practiced. The generalisability of acupuncture treatment was further improved by using more than one acupuncturist in the trial.
The results of this pilot have provided useful data on key features of a full-scale trial of acupuncture for chronic neck pain. A sample size has been calculated and a feasible recruitment strategy outlined.
Acknowledgements are due to the patients, the acupuncturists, the GPs, the GP practice staff, Professor David Torgerson, Dr Jeremy Miles and all the others who have participated in this trial and helped bring the study to fruition. Gemma Salter was funded by a Medical Research Council Studentship and Hugh MacPherson is supported by a Department of Health post-doctoral fellowship in complementary and alternative medicine.
- Bovim G, Schrader H, Sand T: Neck pain in the general population. Spine. 1994, 19 (12): 1307-1309.View ArticlePubMedGoogle Scholar
- Borghouts JA, Koes BW, Vondeling H, Bouter LM: Cost-of-illness of neck pain in The Netherlands in 1996. Pain. 1999, 80 (3): 629-636. 10.1016/S0304-3959(98)00268-1.View ArticlePubMedGoogle Scholar
- Aker PD, Gross AR, Goldsmith CH, Peloso P: Conservative management of mechanical neck pain: systematic overview and meta-analysis. BMJ. 1996, 313 (7068): 1291-1296.View ArticlePubMedPubMed CentralGoogle Scholar
- Irnich D, Behrens N, Molzen H, Konig A, Gleditsch J, Krauss M: Randomised trial of acupuncture compared with conventional massage and "sham" laser acupuncture for treatment of chronic neck pain. BMJ. 2001, 322 (7302): 1574-1578. 10.1136/bmj.322.7302.1574.View ArticlePubMedPubMed CentralGoogle Scholar
- Thomas K, Coleman P: Use of complementary or alternative medicine in a general population in Great Britain. Results from the National Omnibus survey. J Public Health (Oxf). 2004, 26 (2): 152-157. 10.1093/pubmed/fdh139.View ArticleGoogle Scholar
- White AR, Ernst E: A systematic review of randomized controlled trials of acupuncture for neck pain. Rheumatology (Oxford). 1999, 38 (2): 143-147. 10.1093/rheumatology/38.2.143.View ArticleGoogle Scholar
- White P, Lewith G, Berman B, Birch S: Reviews of acupuncture for chronic neck pain: pitfalls in conducting systematic reviews. Rheumatology (Oxford). 2002, 41 (11): 1224-1231. 10.1093/rheumatology/41.11.1224.View ArticleGoogle Scholar
- Birch S: Systematic reviews of acupuncture – are there problems with these?. Clinical Acupuncture and Oriental Medicine. 2001, 2: 17-22. 10.1054/caom.2001.0073.View ArticleGoogle Scholar
- Birch S, Hesselink JK, Jonkman FA, Hekker TA, Bos A: Clinical research on acupuncture. Part 1. What have reviews of the efficacy and safety of acupuncture told us so far?. J Altern Complement Med. 2004, 10 (3): 468-480. 10.1089/1075553041323894.View ArticlePubMedGoogle Scholar
- Birch S: Clinical research on acupuncture. Part 2. Controlled clinical trials, an overview of their methods. J Altern Complement Med. 2004, 10 (3): 481-498. 10.1089/1075553041323911.View ArticlePubMedGoogle Scholar
- Birch S, Jamison RN: Controlled trial of Japanese acupuncture for chronic myofascial neck pain: assessment of specific and nonspecific effects of treatment. Clin J Pain. 1998, 14 (3): 248-255. 10.1097/00002508-199809000-00012.View ArticlePubMedGoogle Scholar
- Nabeta T, Kawakita K: Relief of chronic neck and shoulder pain by manual acupuncture to tender points–a sham-controlled randomized trial. Complement Ther Med. 2002, 10 (4): 217-222. 10.1016/S0965-2299(02)00082-1.View ArticlePubMedGoogle Scholar
- Becker-Witt C, Jena S, Brinkhaus B, Selim D, Liecker B, Willich S: Effectiveness of acupuncture treatment for chronic neck pain: the acupuncture in routine care (ARC) study. J Epidemiol Community Health. 2004, 58 (Supplement 1):Google Scholar
- He D, Veiersted KB, Hostmark AT, Medbo JI: Effect of acupuncture treatment on chronic neck and shoulder pain in sedentary female workers: a 6-month and 3-year follow-up study. Pain. 2004, 109 (3): 299-307. 10.1016/j.pain.2004.01.018.View ArticlePubMedGoogle Scholar
- White P, Lewith G, Prescott P, Conway J: Acupuncture versus placebo for the treatment of chronic mechanical neck pain: a randomized, controlled trial. Ann Intern Med. 2004, 141 (12): 911-919.View ArticlePubMedGoogle Scholar
- Giles LG, Muller R: Chronic spinal pain syndromes: a clinical pilot trial comparing acupuncture, a nonsteroidal anti-inflammatory drug, and spinal manipulation. J Manipulative Physiol Ther. 1999, 22 (6): 376-381. 10.1016/S0161-4754(99)70082-5.View ArticlePubMedGoogle Scholar
- Giles LG, Muller R: Chronic spinal pain: a randomized clinical trial comparing medication, acupuncture, and spinal manipulation. Spine. 2003, 28 (14): 1490-1502. 10.1097/00007632-200307150-00003.PubMedGoogle Scholar
- Lu DP, Lu GP, Kleinman L: Acupuncture and clinical hypnosis for facial and head and neck pain: a single crossover comparison. Am J Clin Hypn. 2001, 44 (2): 141-148.View ArticlePubMedGoogle Scholar
- Zhu XM, Polus B: A controlled trial on acupuncture for chronic neck pain. Am J Chin Med. 2002, 30 (1): 13-28. 10.1142/S0192415X02000028.View ArticlePubMedGoogle Scholar
- McCarney R, Fisher P, Van Haselen R: Accruing large numbers of patients in primary care trials by retrospective recruitment methods. Complement Ther Med. 2002, 10 (2): 63-69. 10.1054/ctim.2002.0516.View ArticlePubMedGoogle Scholar
- Leak AM, Cooper J, Dyer S, Williams KA, Turner-Stokes L, Frank AO: The Northwick Park Neck Pain Questionnaire, devised to measure neck pain and disability. Br J Rheumatol. 1994, 33 (5): 469-474.View ArticlePubMedGoogle Scholar
- Frison L, Pocock SJ: Repeated measures in clinical trials: analysis using mean summary statistics and its implications for design. Stat Med. 11 (13): 1685-704. 1992 Sep 30Google Scholar
- Browne RH: On the use of a pilot sample for sample size determination. Stat Med. 14 (17): 1933-40. 1995 Sep 15Google Scholar
- Dziedzic K, Hill J, Lewis M, Sim J, Daniels J, Hay EM: Effectiveness of manual therapy or pulsed shortwave diathermy in addition to advice and exercise for neck disorders: a pragmatic randomized controlled trial in physical therapy clinics. Arthritis Rheum. 53 (2): 214-22. 10.1002/art.21087. 2005 Apr 15Google Scholar
- MacPherson H, Thomas K, Walters S, Fitter M: The York acupuncture safety study: prospective survey of 34 000 treatments by traditional acupuncturists. BMJ. 2001, 323: 486-487. 10.1136/bmj.323.7311.486.View ArticlePubMedPubMed CentralGoogle Scholar
- MacPherson H: Pragmatic clinical trials. Complement Ther Med. 2004, 12 (2–3): 136-140. 10.1016/j.ctim.2004.07.043.View ArticlePubMedGoogle Scholar
- Mason S, Tovey P, Long AF: Evaluating complementary medicine: methodological challenges of randomised controlled trials. BMJ. 2002, 325: 832-4. 10.1136/bmj.325.7368.832.View ArticlePubMedPubMed CentralGoogle Scholar
- Weiner DK, Ernst E: Complementary and alternative approaches to the treatment of persistent musculoskeletal pain. Clinical Journal of Pain. 2004, 20: 244-255. 10.1097/00002508-200407000-00006.View ArticlePubMedGoogle Scholar
- Birch S, Hammerschlag R, Trinh K, Zaslawski C: The non-specific effects of acupuncture treatment: when and how to control for them. Clinical Acupuncture and Oriental Medicine. 2002, 3: 20-25. 10.1054/caom.2001.0118.View ArticleGoogle Scholar
- Ritenbaugh C, Verhoef M, Fleishman S, Boon H, Leis A: Whole systems research: a discipline for studying complementary and alternative medicine. Alternative Therapies in Health and Medicine. 2003, 9: 32-36.PubMedGoogle Scholar
- Klaber Moffett JA, Jackson DA, Richmond S, Hahn S, Coulton S, Farrin A: Randomised trial of a brief physiotherapy intervention compared with usual physiotherapy for neck pain patients: outcomes and patients' preference. BMJ. 2005, 330 (7482): 75-10.1136/bmj.38286.493206.82.View ArticlePubMedPubMed CentralGoogle Scholar
- Dennehy EB, Webb A, Suppes T: Assessment of beliefs in the effectiveness of acupuncture for treatment of psychiatric symptoms. The Journal of Alternative and Complementary Medicine. 2002, 8: 421-425. 10.1089/107555302760253612.View ArticlePubMedGoogle Scholar
- Klaber Moffet J, Torgerson D, Bell-Syer S, Jackson D, Llewlyn-Phillips H, Farrin A, Barber J: Randomised controlled trial of exercise for low back pain: clinical outcomes, costs, and preferences. BMJ. 1999, 319: 279-283.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/7/99/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.