Skip to main content
  • Research article
  • Open access
  • Published:

Concurrent validity and reliability of measuring range of motion during the cervical flexion rotation test with a novel digital goniometer

A Correction to this article was published on 21 September 2020

This article has been updated



Headache is a common and costly health problem. Although the pathogenesis of headache is heterogeneous, reported contributing factors are dysfunctions of the upper cervical spine. The flexion rotation test (FRT) is a commonly used diagnostic test to detect upper cervical movement impairment. A digital goniometer may support precise measurement of movement impairment in the upper cervical spine. However, its reliability and validity is not assessed, yet. The aim of this study was to investigate the reliability and validity of the digital goniometer compared to an ultrasound-based movement analysis system.


Two separate cross-sectional studies were conducted using the digital goniometer EasyAngle (Meloq AB, Stockholm, Sweden) for a) investigating the concurrent validity of upper cervical range of motion (ROM) during the FRT and b) determining the inter- and intra-rater reliability in the target population of patients with head and neck pain. Sixty-two participants, 39 with and 23 without head and neck pain, were recruited for the concurrent validity study. For the reliability study, a total of 50 participants were recruited. Intraclass correlation coefficients (ICC) and Bland Altmann plots were used to assess validity and ICC values, Bland Altmann plots as well as Kappa coefficients were used for estimating intra-rater and inter-rater reliability.


Concurrent validity was strong with an ICC (2,1) of 0.97 for ROM to either side (95%CI = 0.95–0.98). Bland Altman Plots revealed a mean difference between measurement systems of 0.5° for the left and 0.11° for the right side.

The inter-rater ICC (2,1) was 0.66 (95%CI 0.47–0.79, p <  0.001, SEM 6.6°), indicating good reliability. The limits of agreement were between 10.25° and − 11.89°, the mean difference between both raters was − 0.82°. Intra-rater reliability for the measurement of ROM during the FRT was between 0.96 (ICC 3,1) for rater 1 and 0.94 (ICC 3,1) for rater 2.


The digital goniometer demonstrated strong concurrent validity and good to strong reliability and can be used in clinical practice to accurately determine movement impairment in the upper cervical spine.

Trial registration

German Registry of Clinical Trials DRKS00013051.

Peer Review reports


Neck pain and headache are frequent symptoms occurring as separate entities or inter-dependently [1]. Combined symptoms occur in cervicogenic headache (CGH) where a dysfunction of the cervical spine is by definition the source of the headaches. In contrast, in primary headaches such as migraine, neck pain is commonly observed as an associated symptom. It is the topic of an ongoing scientific debate whether cervical nociceptive input might also influence primary headaches [2, 3]. In both cases, the assessment of the upper cervical spine, as a potential contributing factor to either neck pain or headaches is recommended. One of the best evaluated tests for this purpose is the flexion-rotation-test (FRT), which investigates primarily the range of motion (ROM) between the C1 and C2 vertebrae [4,5,6,7,8,9]. Typically, in standard physiotherapy settings, an eyeballed estimate of ROM is sufficient for clinical purposes [10]. However, this level of measurement may not comply with scientific standards.

One precise method to measure cervical ROM is an ultrasound-based movement analysis system (Zebris GmbH, Isny, Germany) [11, 12]. Although this system offers accurate data, difficulties arise as the system is expensive and requires two physiotherapists for operation, thereby limiting its practicability.

A more practical solution is the cervical ROM device (C-ROM, Platismo Airguide Inc., Buffalo Groove, IL). A systematic review attests that the FRT has a high level of reliability and diagnostic accuracy when this device is used for patients with CGH [13]. Inter-rater reliability has been established in only one previous study: Hall et al. (2008) found that experienced physiotherapists (ICC 0.93 (95%CI 0.87–0.96)) as well as less experienced physiotherapists (ICC 0.84 (95CI% 0.67–0.93)) achieved excellent inter-rater reliability for patients with headache with and without upper cervical dysfunction as well as for headache free controls [8].

A disadvantage of the C-ROM is that patients have to maintain a static posture while the examiner is documenting the values obtained [14]. Clinical experience with the C-ROM further shows that the two inclinometers and the compass system (for the measurement of rotation) do not always offer precise data, since the scale is not always easy to read in certain head positions and the needle of the compass may not always move freely in combined head positions.

A new digital device (EasyAngle, Meloq AB, Stockholm, Sweden) might be a practicable and precise alternative to the C-ROM since it is portable, small, easy to handle, not expensive, and stores up to 5 measurements. Its precision is reported by the manufacturing company as +/− 1°. A major advantage over digital goniometers used in previous studies [15, 16] is, that movement can be measured in any one of the three planes without having to realign its position.

The aim of this study was therefore to evaluate the validity as well as intra- and inter-rater reliability of the EasyAngle goniometer during the FRT, in healthy participants as well as patients with headache and/or neck pain.


Study design

Two separate cross sectional studies were conducted to determine the concurrent validity as well as inter- and intra-rater reliability of the EasyAngle goniometer during the FRT.


For the reliability study, a minimum sample size of 50 was required to provide statistically significant information expecting an ICC of 0.75 with a 95% confidence interval of 0.2 and 3 repeated measurements. For the validity study, we recruited participants with and without symptoms to be able to measure a wide variability of range of motion. The calculated sample size was 62 (31 for each group) expecting an ICC of 0.85 with 2 replications and a 95% CI of 0.2.

Participants for the reliability study were recruited from physiotherapy clinics and a dentist clinic in Austria. Participants for the validity study came from the university campus and social media advertising in Bremen/Germany. An information sheet was provided to potential participants explaining general information, procedure, inclusion and exclusion criteria prior to the initial appointment. Inclusion criteria required participants to be aged between 18 and 80 years. Participants for the validity part of the study were either asymptomatic or suffered from headache or neck pain.

For the reliability part of the study, only patients above the age of 18 years suffering from neck pain, headache and/or temporomandibular dysfunction were included, who had been referred for physiotherapy assessment and treatment.

Participants with and without symptoms in both parts of the study were excluded if they had experienced a headache within the 48 h prior to testing, cranial or cervical injury within the last 3 months, a diagnosis of cervical radiculopathy, were pregnant, suffered from osteoporosis, rheumatoid arthritis, or neurological disease. In all aspects of this study, the principles of the „Declaration of Helsinki “[17] was followed at all times. For both parts of the study individual participant populations were recruited. None of the participants received monetary rewards or financial compensation.


After participants provided signed informed consent, a set of questionnaires was completed to characterise the study participants and standardised pre-test screening was conducted to exclude participants with vertebral artery dysfunction or upper cervical instability.

Two physiotherapists with 8 years of clinical experience in treating patients with neck pain were involved in the experiment to evaluate the intra- and inter-rater reliability. For the validity part of the study, one physiotherapist with a clinical experience of 20 years in treating patients with headache and neck pain performed the FRT measurements, a second physiotherapists with 2 years of clinical experience recorded the data. All examiners attended a 45-min training session on the FRT prior to the data collection as well as familiarisation with the different measurement systems.

For the FRT, participants were positioned in supine. The examiner moved the cervical spine into maximum flexion. From this position, the head was rotated to each side. Rotation occurred around an imaginary axis from the vertex of the skull to the central point of the upper cervical spine. The end of range was determined when moderate resistance or pain was noted [4]. The test was aborted in the presence of signs of dizziness and/or nausea.

Digital goniometer

The base of the EasyAngle goniometer was positioned on the axis of rotation of the head and fixed with elastic straps (Figs. 1 and 2).

Fig. 1
figure 1

a and b Reliability of the FRT measured with the easyangle. The digital goniometer was fixed via a selfmade elastic band

Fig. 2
figure 2

Validity of the FRT. Fixation of FRT and easyangle

Concurrent validity

For the evaluation of validity, the test was simultaneously recorded by an ultrasound based measurement system (Zebris GmbH, Isny, Germany) which includes a helmet with three ultrasonic transmitters. The transmitters were placed in a parallel position on the head of the participant (Fig. 2). The signals from the helmet are detected in real time (50 ms interval with a frequency of 20 Hz) by a sensor positioned at 80 cm distance from the participant. The data is recorded by the WinSpine 2.2 Software for Windows and exported as an ASCII data file. The EasyAngle goniometer was attached to the head of the participant using elastic straps.

During the measurements communication between examiner, subjects and operator of the Zebris system followed standardised procedures. In a pilot phase, five participants were tested to standardise the simultaneous recording with the Zebris- and Easyangle-systems. These data were not included in the final data set.

Numerous studies have investigated the reliability and validity of the Zebris system to measure cervical range of motion. Dvir et al. [18] found a high correlation (r > 0.99) and an average absolute difference between 0.31° and 0.89° in comparison to a digital inclinometer for all primary movements. Strimpakos et al. [19] compared Zebris measurements with x-ray and showed ICC values of 0.88 for flexion and 0.95 for extension, however the sample was small with n = 10. The accuracy of the Zebris system for detecting atlanto-occipital movement has also been investigated in an in vitro study indicating an error of less than 0.2° with each of the three motion components [20].

In a previous study [21] the SEM for rotation ROM during the FRT was 2.3 (left) and 3.1 (right) corresponding to a SDD of 6.3° (left) and 8.5° (right), which is lower than the SEM of 7.88 and SDD of 21.83 reported by Cagnie et al. [21] for active rotation. Mannion et al. [11] found substantial differences between measurements of the Zebris system compared to a CA6000 Spine Motion Analyser in measuring cervical rotation in flexion. However, it has to be taken into account that the flexion rotation test in their study was performed actively in sitting position. Mannion et al. [11] state that performing the test was difficult for the participants, possibly leading to a less reliable performance for this test. This is in contrast to our study where the test was carried out passively in supine lying, which may result in a more stable and reliable performance.

Intra- and inter-rater reliability

Each participant was assessed using the EasyAngle goniometer by two examiners in a randomised order at two occasions. On each occasion, three consecutive measurements were taken with a 10-min time interval between each trial. The measurements from the consecutive three measurements were used to assess intra-rater reliability. For inter-rater reliability we calculated the mean values of the three measurements on each occasion. For the inter-rater reliability, the examiner was blinded towards the result of the second examiner. For the intra-rater reliability, the examiner was blinded towards the results of the previous measurement. This was achieved by covering the display of the EasyAngle goniometer during the measurement. Measurement data were extracted by a second therapist. An independent examiner documented ROM, the limiting criterion (pain or resistance), and the location if any of the pain response (neck, head, face) during the test. This person was otherwise not involved in any other study procedures.

Questionnaires and assessments

Additional information about the participants was collected using questionnaires. These included demographic data (age and sex) and a checklist confirming inclusion- and exclusion criteria. Symptomatic subjects were requested to fill out the neck disability index (NDI) [22] and the Migraine Disability Assessment (MIDAS) to determine disease specific disability levels [23]. If patients reported temporomandibular symptoms, the Conti Anamnestic Questionnaire CMD was used [24].

To screen for upper cervical instability we performed the sharp purser test [25], test of the transverse ligament [26] and a stress test of the alar ligament [27]. Additionally, all subjects performed the FRT actively in sitting before testing. Screening for vertebral artery dysfunction was performed in sitting, according to APA recommendations [28].

Statistical analysis

Mean, standard deviation, minimum and maximum values from the three repetitions were calculated for each examiner and for each participant as well as for each measurement system.

Intra-rater and inter-rater reliability as well as concurrent validity were determined by calculating the ICC with their 95% confidence intervals (CI). A two-way random-effect model based on a single rating and absolute agreement was used to assess inter-rater reliability and concurrent validity (ICC 2,1) [29]. A two-way mixed effect-model based on consitency and single rating assessed the intra-rater reliability for either rater (ICC 3,1) [30]. Furthermore the standard error of measurement (SEM) and the smallest detectable difference (SDD) were given. The SEM was estimated using the formula SEMagreement = √(σ2 error + σ2 residual). The SDD as calculated using the formula SDD = 1.96 × √2 × SEM. To estimate the inter-rater reliability for the limiting factors of the FRT (pain vs resistance) Fleiss‘Kappa (κ) was used.

The comparability between the zebris system and the easyangle and between the two raters was visualised by Bland-Altman-plots [31] and scatter plots.

For the interpretation of the ICC, < 0.40 was regarded as insufficient and > 0.75 as almost perfect agreement [32]. The results from Fleiss’ Kappa were interpreted using the recommendations by Landis & Koch with 1–0.81 indicating excellent agreement [33]. All statistical analyses were carried out using STATA 15.1 [34]..


Table 1 shows the demographic details, presence of neck pain and headache and disability levels for both the validity and reliability study.

Table 1 Characteristics of the participants (n = number of participants; f = female; m = mean; SD = standard deviation)

Concurrent validity

Data for mean values and standard deviations for the ultrasound based system and the goniometer measurements are presented in Table 2.

Table 2 Mean and standard deviation of individual and average ultrasound based (Zebris) and digital goniometer (easyangle) measurements. (n = number of participants; SD = standard deviation)

ICC-values and 95% CIs are presented in Table 3 indicating the concurrent validity between the goniometer and the ultrasound based measurement system. For visualisation of the relationship, scatterplots are provided (Fig. 3).

Table 3 ICC (2,1) of digital goniometer and Zebris for the left and right rotation. (ICC (2,1) = Intraclass Correlation Coefficient; CI = Confidence Interval)
Fig. 3
figure 3

Scatterplot showing the mean values measured with easyangle and zebris

The limits of agreement for the left rotation were between − 4.80° to 5.85°. The mean difference was 0.53° (95%CI -0.15 - 1.29). The limits of agreement for the right rotation were between − 6.39° to 6.17°. The mean difference was − 0.11° (95%CI -0.91 - 0.69) (Figs. 4 and 5).

Fig. 4
figure 4

Bland Altman Plot for left rotation

Fig. 5
figure 5

Bland Altman Plot for right rotation


Intra-rater reliability data for the measurement of ROM during the FRT determined by the EasyAngle goniometer are displayed in Table 4.

Table 4 Intra-rater reliability. (ICC Type (3,1) = two way mixed-effects model, absolute agreement, individual; Number of targets 50; number of ratings 3; all ICC values are significant with p < 0.0001)

In terms of inter-rater reliability, examiner 1 showed a smaller range between average minimum and maximum values compared to examiner 2 (Table 5). The total FRT maximum right to maximum left showed an agreement of 0.66 (95%CI 0.47–0.79; p <  0.001; SEM 6.6°) (Table 5).

Table 5 Inter-rater reliability. (MW = mean, SD = Standard deviation, ICC intraclass correlation Type (2,1) absolute agreement. SEM measurement error)

The limits of agreement for rotation to the left are between + 9.8° and − 9.02° The mean difference is 0.39°. The limits of agreement for rotation to the right are between + 11.52° and − 12.39°. The mean difference is 0.43°.

Evaluation of the limiting factor (stiffness or pain) showed that during FRT to the right, examiner 1 reported stiffness 36 times (72%) and pain 14 times (28%), 13 of which were in the neck and once headache. Examiner 2 reported stiffness 37 times and pain 13 pain (12 times neck pain and once headache). Temporomandibular pain was not reported during the assessments. The Kappa value for the limiting factor for FRT to the right was κ = 0.85 (p < 0.001). Results are shown in Table 6.

Table 6 Agreement on limiting factor between examiners

FRT to the left was limited 39 times by stiffness (examiner 1) and 11 times by pain (10 of which were in the neck, 1 in the jaw). Examiner 2 reported stiffness 37 and pain 13 times (12 neck of which were in the neck, 1 in the jaw). Headache was not reported as a limiting symptom on any occasion. The kappa value for the limiting factor during FRT to the left was κ = 0.89 (p < 0.001) (Table 6).

No adverse events (e.g. dizziness or nausea) were reported during any of the tests.


Concurrent validity for the novel EasyAngle goniometer, when measuring ROM during the FRT, was very good with an ICC (2,1) of 0.97 for movement to the left or the right, suggesting that this goniometer is a valid instrument to measure ROM during the FRT. The Bland Altman Plots (Figs. 4 and 5) support this result indicating a mean difference between both measurement systems of only 0.5° for the left side and 0.11° for the right side. Based on this finding, measurements taken by this EasyAngle goniometer can be regarded as accurate.

Our results are based on a sufficient sample size of participants with a wide age distribution (19–76 years), mix of genders (female 61%), asymptomatic and symptomatic (62.90%) participants and subjects with a diverse ROM during the FRT (20.33–65.08°). Average values identified for the FRT in both, symptomatic and asymptomatic subjects, reflects those reported in the literature [9]. In a previous study [10] the SEM for rotation ROM during the FRT was 2.3 (left) and 3.1 (right) corresponding to an SDD of 6.3° (left) and 8.5° (right), which is much lower than the SEM and SDD reported by Cagnie et al. [21] for active rotation. Hence, these results can be applied confidently to a wide range of clinical presentations.

The inter-rater reliability was good and is comparable to reliability data reported by Hall et al., who measured the FRT with a C-ROM device [8]. Interestingly, in the present study the ICC value (2,1) for the FRT was greater for range to the left 0.72 (95%CI 0.56–0.83) than to the right 0.60 (95%CI 0.39–0.75). The ICC value for range to the right is just above the cut off value of 0.60 which is regarded as fair agreement [35]. The corresponding SDD were 11.64° for FRT to the left and 9.42° for FRT to the right, indicating that differences between measurements should exceed these values in order to differentiate real change from measurement error, when two examiners measure at different time points.

The intra-rater reliability was very good, with ICC (3,1) values exceeding 0.92. Furthermore, corresponding SDD values for measurements of the FRT to the left and right were < 5.0°, indicating more precise measurements when only one examiner took the measurement. However, in the interpretation of these results, SDD measures of the concurrent standard Zebris need to be considered. SDDs for rotation ROM during the FRT was 6.3° (left) and 8.5° (right) [2]. We recognise that the Zebris system, although used as a reference standard, is not free from measurement error. To mitigate against this we performed the measurement of the FRT with both systems simultaneously, to reduce handling and other errors. Furthermore, in the analysis we used Bland Altmann plots to chart the difference between both measurements and the mean of both values. The Bland Altmann plot shows that the limits of agreement varies between 6.2° and − 6.4° and the mean difference is 0.5° and − 0.1° for the FRT to the left and right respectively.

Although eyeballed estimation has been shown to be a valid form of measurement to determine a positive or negative FRT [2], measuring the exact range of motion may be useful to distinguish different types of headache. For example, Hall et al. [5] identified a cut-off point for a positive FRT to be 30° of rotation or less, when attempting to distinguish a patient with CGH from migraine without aura or mixed headache forms. This is less than the cut-off value of 32° reported by Ogince et al. [9]. In that study the groups were more diverse and included patients with CGH or migraine with aura, as well as asymptomatic controls. Hence a larger reduction of rotation was required to differentiate migraine from cervicogenic headache, or both from asymptomatic controls. Confirmation of this finding is shown in the study by Oliveira Souza et al. (2019). In that study patients with episodic migraine had a mean range of 33° for the FRT to the right and 32° for the FRT to the left [36]. A further example when an accurate measurement of ROM during the FRT is needed, is when the test is used as an outcome measure. A previous study identified that limited rotation during the FRT is strongly correlated with an index of CGH symptoms. This index is comprised of a combination of headache frequency, intensity and duration, with approximately 50% of the variance in range of motion explained by the headache index [5]. Using a simple but accurate tool is a helpful addition to the clinical physiotherapy setting, as the EasyAngle goniometer is small, portable and easy to use. Future research should aim to determine the sensitivity to change and clinically meaningful differences in ROM determined by the FRT in longitudinal studies.


The following limitations need to be taken into account. First of all, the validity and accuracy of the concurrent standard Zebris, especially in detecting upper cervical rotation needs to be considered. While inter- and intra-rater reliability appear to be very good, with acceptable SDD values for upper cervical ROM during the FRT, so far a robust comparison against gold standard radiology has not been conducted for upper cervical ROM during the FRT in vivo.

Secondly, repeated measurements may increase pain sensitivity during the FRT, potentially leading to a greater within-subject variation of upper cervical ROM for those occasions where pain was the criteria to stop the FRT. Furthermore, multiple test-stop criteria (pain, firm resistance) add to the complexity of the FRT test, potentially limiting reproducibility. However, interrater reliability for test-stop criteria was good with kappa values between 0.85 and 0.89. Nevertheless, increased pain sensitivity and multiple test-stop criteria may have potentially deflated ICC values for reliability.


The EasyAngle digital goniometer has been shown to have very good concurrent validity and good reliability and may aid clinicians to accurately determine movement restriction in the upper cervical spine during the FRT.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Change history

  • 21 September 2020

    An amendment to this paper has been published and can be accessed via the original article.



Cervicogenic headache


Confidence interval


Cervical range of motion


Flexion-rotation test


Intraclass correlation coefficient


Migraine disability assessment scale


Neck disability index


Range of motion


Standard deviation


Smallest detectable difference


Standard error of measurement


  1. Ashina S, Bendtsen L, Lyngberg AC, Lipton RB, Hajiyeva N, Jensen R. Prevalence of neck pain in migraine and tension-type headache: a population study. Cephalalgia Int J Headache. 2015;35:211–9.

    Article  Google Scholar 

  2. Luedtke K, Starke W, May A. Musculoskeletal dysfunction in migraine patients. Cephalalgia Int J Headache. 2017.

  3. Fernández-de-Las-Peñas C, Cuadrado ML, Pareja JA. Myofascial trigger points, neck mobility and forward head posture in unilateral migraine. Cephalalgia Int J Headache. 2006;26:1061–70.

    Article  Google Scholar 

  4. Hall T, Robinson K. The flexion-rotation test and active cervical mobility--a comparative measurement study in cervicogenic headache. Man Ther. 2004;9:197–202.

    Article  CAS  Google Scholar 

  5. Hall T, Briffa K, Hopper D. The influence of lower cervical joint pain on range of motion and interpretation of the flexion-rotation test. J Man Manip Ther. 2010;18:126–31.

    Article  Google Scholar 

  6. Hall TM, Briffa K, Hopper D, Robinson K. Comparative analysis and diagnostic accuracy of the cervical flexion-rotation test. J Headache Pain. 2010;11:391–7.

    Article  Google Scholar 

  7. Hall TM, Briffa K, Hopper D, Robinson KW. The relationship between cervicogenic headache and impairment determined by the flexion-rotation test. J Manip Physiol Ther. 2010;33:666–71.

    Article  Google Scholar 

  8. Hall TM, Robinson KW, Fujinawa O, Akasaka K, Pyne EA. Intertester reliability and diagnostic validity of the cervical flexion-rotation test. J Manip Physiol Ther. 2008;31:293–300.

    Article  Google Scholar 

  9. Ogince M, Hall T, Robinson K, Blackmore AM. The diagnostic validity of the cervical flexion-rotation test in C1/2-related cervicogenic headache. Man Ther. 2007;12:256–62.

    Article  Google Scholar 

  10. Schäfer A, Lüdtke K, Breuel F, Gerloff N, Knust M, Kollitsch C, et al. Validity of eyeball estimation for range of motion during the cervical flexion rotation test compared to an ultrasound-based movement analysis system. Physiother Theory Pract. 2018;34:622–8.

    Article  Google Scholar 

  11. Mannion AF, Klein GN, Dvorak J, Lanz C. Range of global motion of the cervical spine: intraindividual reliability and the influence of measurement device. Eur Spine J Off Publ Eur Spine Soc Eur Spinal Deform Soc Eur Sect Cerv Spine Res Soc. 2000;9:379–85.

    Article  CAS  Google Scholar 

  12. Malmström E-M, Karlberg M, Melander A, Magnusson M. Zebris versus Myrin: a comparative study between a three-dimensional ultrasound movement analysis and an inclinometer/compass method: intradevice reliability, concurrent validity, intertester comparison, intratester reliability, and intraindividual variability. Spine. 2003;28:E433–40.

    Article  Google Scholar 

  13. Rubio-Ochoa J, Benítez-Martínez J, Lluch E, Santacruz-Zaragozá S, Gómez-Contreras P, Cook CE. Physical examination tests for screening and diagnosis of cervicogenic headache: a systematic review. Man Ther. 2016;21:35–40.

    Article  CAS  Google Scholar 

  14. Raya R, Garcia-Carmona R, Sanchez C, Urendes E, Ramirez O, Martin A, et al. An inexpensive and easy to use cervical range of motion measurement solution using inertial sensors. Sensors. 2018;18:2582.

    Article  Google Scholar 

  15. Carey MA, Laird DE, Murray KA, Stevenson JR. Reliability, validity, and clinical usability of a digital goniometer. Work Read Mass. 2010;36:55–66.

    Google Scholar 

  16. Swanson BT, Craven AB, Jordan J, Martin R. Comparison of range of motion during the cervical flexion rotation versus the side-bending rotation test in individuals with and without hyperlaxity. J Man Manip Ther. 2019;27:24–32.

    Article  Google Scholar 

  17. WMA. Declaration of Helsinki. 2008. Available from: [Accessed on 17 Sept 2013].

    Google Scholar 

  18. Dvir Z, Prushansky T. Reproducibility and instrument validity of a new ultrasonography-based system for measuring cervical spine kinematics. Clin Biomech Bristol Avon. 2000;15:658–64.

    Article  CAS  Google Scholar 

  19. Strimpakos N, Sakellari V, Gioftsos G, Papathanasiou M, Brountzos E, Kelekis D, et al. Cervical spine ROM measurements: optimizing the testing protocol by using a 3D ultrasound-based motion analysis system. Cephalalgia Int J Headache. 2005;25:1133–45.

    Article  CAS  Google Scholar 

  20. Cattrysse E, Provyn S, Kool P, Gagey O, Clarys JP, Van Roy P. Reproducibility of kinematic motion coupling parameters during manual upper cervical axial rotation mobilization: a 3-dimensional in vitro study of the atlanto-axial joint. J Electromyogr Kinesiol Off J Int Soc Electrophysiol Kinesiol. 2009;19:93–104.

    Article  CAS  Google Scholar 

  21. Cagnie B, Cools A, De Loose V, Cambier D, Danneels L. Reliability and normative database of the Zebris cervical range-of-motion system in healthy controls with preliminary validation in a group of patients with neck pain. J Manip Physiol Ther. 2007;30:450–5.

    Article  Google Scholar 

  22. Swanenburg J, Humphreys K, Langenfeld A, Brunner F, Wirth B. Validity and reliability of a German version of the neck disability index (NDI-G). Man Ther. 2014;19:52–8.

    Article  Google Scholar 

  23. Benz T, Lehmann S, Gantenbein AR, Sandor PS, Stewart WF, Elfering A, et al. Translation, cross-cultural adaptation and reliability of the German version of the migraine disability assessment (MIDAS) questionnaire. Health Qual Life Outcomes. 2018;16:42.

    Article  Google Scholar 

  24. Valle-Corotti K, Pinzan A, do Valle CVM, Nahás ACR, Corotti MV. Assessment of temporomandibular disorder and occlusion in treated class III malocclusion patients. J Appl Oral Sci Rev FOB. 2007;15:110–4.

    Article  Google Scholar 

  25. Mansfield CJ, Domnisch C, Iglar L, Boucher L, Onate J, Briggs M. Systematic review of the diagnostic accuracy, reliability, and safety of the sharp-purser test. J Man Manip Ther. 2020;28:72–81.

    Article  Google Scholar 

  26. Mintken PE, Metrick L, Flynn TW. Upper cervical ligament testing in a patient with os odontoideum presenting with headaches. J Orthop Sports Phys Ther. 2008;38:465–75.

    Article  Google Scholar 

  27. Von Piekartz H, Maloul R, Hoffmann M, Hall T, Ruch MM, Ballenberger N. Diagnostic accuracy and validity of three manual examination tests to identify alar ligament lesions: results of a blinded case-control study. J Man Manip Ther. 2019;27:83–91.

    Article  Google Scholar 

  28. Magarey ME, Rebbeck T, Coughlan B, Grimmer K, Rivett DA, Refshauge K. Pre-manipulative testing of the cervical spine review, revision and new clinical guidelines. Man Ther. 2004;9:95–108.

    Article  Google Scholar 

  29. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.

    Article  CAS  Google Scholar 

  30. Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63.

    Article  Google Scholar 

  31. Carkeet A, Goh YT. Confidence and coverage for bland-Altman limits of agreement and their approximate confidence intervals. Stat Methods Med Res. 2018;27:1559–74.

    Article  Google Scholar 

  32. de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. 1st ed. Cambridge: Cambridge University Press; 2011.

    Book  Google Scholar 

  33. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  Google Scholar 

  34. StataCorp. Stata Statistical Software: Release 14. College Station: StataCorp LP; 2015.

    Google Scholar 

  35. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology; 1994.

    Book  Google Scholar 

  36. Oliveira-Souza AIS, Florencio LL, Carvalho GF, Fernández-De-Las-Peñas C, Dach F, Bevilaqua-Grossi D. Reduced flexion rotation test in women with chronic and episodic migraine. Braz J Phys Ther. 2019;23:387–94.

    Article  Google Scholar 

Download references


Rui Chen from EasyAngle, Meloq AB, Stockholm, Sweden for providing the digital goniometer.


This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. Open access funding provided by Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations



KL, AS, TSK designed the work; TSK and AS analysed the data, PHS, MG, MO, PP, CN, CR were responsible for the data acquisition and the initial interpretation of the data, TH is the expert for the flexion-rotation-test, supervised the examiner training and supported the design. PP and CN prepared the first draft of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kerstin Luedtke.

Ethics declarations

Ethics approval and consent to participate

Was granted by the ethics committee of the University of Applied Science and Art (Hildesheim) dated 06/12/2017. Participants gave written informed consent before data collection began.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: the authors noticed that one of the co-authors’ name is incorrect.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luedtke, K., Schoettker-Königer, T., Hall, T. et al. Concurrent validity and reliability of measuring range of motion during the cervical flexion rotation test with a novel digital goniometer. BMC Musculoskelet Disord 21, 535 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: