Skip to main content
Download PDF

Measurement properties of smartphone applications for the measurement of neck range of motion: a systematic review and meta analyses

BMC Musculoskeletal Disorders volume 23, Article number: 138 (2022) Cite this article

Abstract

Background

Smartphone applications offer an accessible and practical option to measure neck range of motion (ROM) and are becoming more commonly used in clinical practice. We assessed the validity, reliability, and responsiveness of smartphone applications (apps) to measure neck ROM in people with and without neck pain.

Methods

A comprehensive electronic search strategy of the main electronic databases was conducted from inception until June 2021. The identified studies investigated apps which measured neck ROM, and evaluated their validity, reliability, or responsiveness, in adult participants with neck pain or asymptomatic individuals. Two independent reviewers determined eligibility and risk of bias following COSMIN guidelines. The quality of evidence was assessed according to the GRADE approach.

Results

Eleven studies, with a total of 376 participants were included. Three types of apps were identified: clinometer apps, compass apps, and other apps of ‘adequate’ to ‘doubtful’ risk of bias. A meta-analysis revealed ‘good’ to ‘excellent’ intra-rater and inter-rater reliability across the three types of apps. The overall validity was rated from ‘moderate’ to ‘very high’ across all apps. The level of evidence was rated as ‘low’ to ‘very low’.

Conclusion

Smartphone applications showed sufficient intra-rater reliability, inter-rater reliability, and validity to measure neck ROM in people with and without neck pain. However, the quality of evidence and the confidence in the findings are low. High-quality research with large sample sizes is needed to further provide evidence to support the measurement properties of smartphone applications for the assessment of neck ROM.

Study registration

Following indications of Prisma-P guidelines, this protocol was registered in PROSPERO on 1/05/2021 with the number CRD42021239501.

Peer Review reports

Background

One third of the world current population is estimated to need rehabilitation, with musculoskeletal conditions being the leading cause [1–3]. Spinal pain alone is reported to be the largest contributor of global disability [1] and neck pain specifically is the fourth highest cause of years lived with disability [1, 4]; a condition associated with substantial costs [2].

The measurement of neck range of motion (ROM) is a common clinical assessment used to evaluate people with neck pain to determine the presence of functional limitations [3]. This objective measurement can be used to help identify movement impairment and can provide relevant prognostic data [4]. Additionally, ROM measures are often utilised throughout a patient’s clinical journey as objective markers to help determine progress and the effectiveness of an intervention(s) [5]. Further, measures of neck ROM are used in classification systems [3, 6, 7] and may assist in differential diagnosis [8].

There are various performance-based outcome measures (PBOM) available to measure neck ROM including measuring tapes, goniometers, the cervical range-of-motion (CROM) device or visual estimates [9]. Smartphone applications (apps), offer an accessible, low cost and practical option to measure neck ROM in clinical environments. For instance, apps such as the “compass” [10–12] and “clinometer” [10, 13] have been reported to have good reliability and validity for the measurement of frontal and sagittal cervical ROM when compared with gravitational inclinometers.

Previous systematic reviews have synthesised available evidence to determine the measurement properties of PBOM to evaluate ROM in general joint angles [14] or more specifically, for the measurement of spinal movements [15]. The main conclusions of these reviews are that there is low quality evidence supporting the measurement properties of apps to assess joint angles due to their heterogeneous nature [14] and no research has explored the responsiveness of different mobile apps. Specifically for spinal movements, available apps showed good levels of reliability and validity for neck ROM in the sagittal and frontal plane but highlighted the lack of evidence to support measurements in the horizontal plane [15].

The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) initiative established a taxonomy of measurement properties which covers the following domains: reliability, validity, and responsiveness [16]. As per the current evidence, it remains unclear if smartphone apps offer an optimal PBOM for clinicians to use in practice to evaluate neck ROM. This highlights a need for a systematic review of the measurement properties of smartphone apps and therefore the purpose of this systematic review is to assess the measurement properties (validity, reliability, and responsiveness) of apps to measure neck ROM in people with and without neck pain.

Methods

This systematic review was designed using COSMIN guidelines [17] and is reported in line with The Preferred Reporting Items for the Systematic Reviews and Meta-Analysis guidelines (PRISMA) checklist [18]. The review was prospectively registered with PROSPERO (Registration CRD42021239501) on the 1st of March 2021. Ethical approval was not required since no new original data were collected given that this is a systematic review.

Eligibility criteria

Inclusion criteria

Studies included in this systematic review investigated at least one measurement property of a smartphone app to measure neck ROM. The target population were adults aged 18 years or over, who were either asymptomatic or presented with neck pain as defined by International Classification of Diseasses [19]. The studies were required to have evaluated at least one of the three main domains of the COSMIN Taxonomy of measurement properties, namely, validity, reliability, and/or responsiveness [16]. Only studies written in English were included.

Exclusion criteria

Studies which solely investigated neck ROM using special devices such as a Cervical Range of Motion (CROM) device, goniometers or inclinometers were excluded. Conference abstracts, systematic reviews and articles without full text availability were excluded.

Information sources

Multiple subject-specific electronic databases were systematically searched in line with Cochrane collaboration recommendations. These databases were CINAHL Plus (EBSCO interface), MEDLINE (OVID interface), SPORTDiscus (EBSCO interface) and EMBASE (OVID interface). The literature search was conducted from inception to 25th June 2021.

Search strategy

A search strategy was formed for MEDLINE and adapted to other databases. Search terms were generated for a total of four concepts: ‘Range of motion’, ‘Neck’, ‘Measurement properties’, and ‘Smartphone application’. MESH terms were used to form more search terms so that all relevant literature was found. The search was online only, and references were found manually if needed. See Supplementary File 1 for the full MEDLINE (Ovid) search strategy. Grey literature and conference papers were searched to reduce potential publication biases.

Study selection

Data was managed in Clarivate Analytics Endnote Version 20 Software. This allowed ease of access, duplicates to be found and removed, and the storing of full texts and abstracts. Two reviewers (KR and DA) screened the titles and abstracts of the studies using the eligibility criteria. The articles were categorized as eligible/unsure/ineligible [20]. When a study was classified as eligible the full text was screened to ensure eligibility. Studies classified as “unsure” were discussed between the two reviewers. In the event of a disagreement between the two reviewers, a third reviewer (DF) adjudicated the eligibility of the text. The number of included/excluded studies is presented with the PRISMA flow diagram with reasons for exclusions [18].

Data extraction

A data extraction form was piloted with two articles to assess its practicality and any necessary changes were made. The form was used by the reviewers (KR and DA) independently to extract information from the eligible studies [21]. Any discrepancies were discussed and mediated by the third reviewer (DF).

Risk of Bias

Two reviewers (KR and DA) independently assessed the risk of bias within each study using the COSMIN risk of bias checklist; this checklist was chosen due to its good level of inter-rater reliability [16]. The checklist was originally designed for use with patient reported outcome measures, but the COSMIN group have stated that the tool can be used with other types of measures including Performance-based Outcome Measures (PBOM) [17]. For instance, in the current study the factor “Internal structure” was not considered as it is not applicable to our outcome of interest. The outcome measures were scored either ‘very good’, ‘adequate’, ‘doubtful’ or ‘inadequate’ and any dispute was settled by the third reviewer (DF) [17]. The measurement properties for all of the outcomes measurements identified in the articles was assessed and summarised in table, as sufficient (+), insufficient (−), inconsistent (±), or indeterminate (?).

Confidence in cumulative evidence

To assess the quality of pooled evidence, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach were adopted considering each measurement property for each type of application [22]. Four factors were examined following the COSMIN recommendation: (1) risk of bias (methodological quality of the studies), (2) inconsistency (unexplained inconsistency of results across studies), (3) imprecision (sample size of the available studies), and (4) indirectness (evidence from different populations than the population of interest in the review). ‘Publication bias’ was not examined due to the lack of registries for studies on measurement properties. The evidence was graded as either high, moderate, low or very low evidence [22].

Data synthesis

Following the COSMIN guideline for systematic reviews [17], either a meta-analysis or narrative synthesis was conducted, based on the heterogeneity of the included studies. For a meta-analysis to be indicated, an adequate number of studies that contained similar study demographics, design and low/moderate heterogeneity were needed to be included. The I2 statistical analysis was used to evaluate the variation between studies that was due to heterogeneity rather than chance [23]. Heterogeneity was considered ‘substantial’ if the I2 scores were > 50% [23].

The meta-analysis was performed in R (version 1.4.1106). Due to the expected variability between the studies, the standard generic inverse variance random effects model was used. The correlation coefficients were converted to Fisher’s z scores and then pooled. Fisher z scores were then converted back into weighted Interclass correlation coefficients (ICCs). To summarise the results, forest plots with 95% confidence intervals were generated. For the outcomes where there was a lack of homogeneity, a narrative synthesis was conducted in line with the narrative synthesis in systematic reviews recommendation [24].

The following outcomes were included in the meta-analysis: intra-rater reliability of inclinometer apps in asymptomatic participants, intra-rater and inter-rater reliability of inclinometer apps in people with chronic neck pain, intra-rater reliability of the other apps in people with chronic neck pain. ICC indices were interpreted as follow: ICC < 0.40 was considered poor reliability, ICC = 0.40-0.58 was classed as fair reliability, ICC = 0.59-0.74 was classed as good reliability, and ICC = 0.75-1.00 was classed as excellent reliability. Pourahmadi, et al. [25] present a framework of interpreting Pearson’s correlation coefficients when they are describing validity, where a coefficient of anything < 0.3 was considered negligible, 0.3-0.5 was considered low, 0.5-0.7 as moderate, 0.7-0.9 as high, and 0.9-1 as very high.

Results

Study selection

The original search identified 467 studies. After the removal of duplicates and screening of the titles and abstracts, the remaining 20 studies were subject to full-text review. Finally, 12 studies remained and were included in this systematic review. The PRISMA flow diagram is presented in Fig. 1 [18].

Fig. 1
figure 1

A PRISMA flow diagram

Full size image

Study characteristics

The 12 included studies were conducted across nine countries and had an accumulative population of 404 participants. The mean age of the participants across all the studies was 31.1 years (standard deviation 4.7 years, range 18-53 years). There were 236 females studied which is 58% of the total population. Four of the twelve studies had participants who had varied levels and durations of neck pain [10, 11, 26, 27], and eight studies had participants with no pain [12, 13, 28–33].

The smartphone apps were grouped in three types of apps, namely clinometer apps, compass apps, and other types of apps. Eleven studies assessed reliability, 7 studies assessed validity, 9 studies assessed measurement error, but no studies assessed responsiveness. A summary of the study characteristics can be found in Table 1, and further information regarding the studies including the results from each study can be found in Supplementary File 2.

Table 1 Study characteristics
Full size table

Risk of Bias and GRADE assessment

Out of the 7 studies with participants who were asymptomatic, 3 studies scored ‘adequate’, 3 studies scored ‘doubtful’, and 1 study scored ‘very good’. Comparatively, out of the 4 studies which tested participants with neck pain, 1 study scored ‘inadequate’ and 3 scored ‘adequate’. The most common reason for the potential of risk of bias was the lack of control of the participants behaviour and the environment between repeated recordings.

For the data synthesis, results were divided by group; asymptomatic and those with neck pain. Each type of app and each measurement property (inter-rater reliability, intra-rater reliability, measurement error, criterion (concurrent) validity, and construct validity) was then considered and a summary is presented in Table 2. The overall quality of evidence (GRADE) is shown in Table 3. There was no indirectness reported in any of the measurement properties due to the subgrouping of the population into neck pain and asymptomatic groups. The characteristic of the GRADE assessments which most frequently downgraded the results was impreciseness which is based on the accumulative population for each subgroup.

Table 2 Summary of characteristics of the measurement properties
Full size table
Table 3 Summary of the GRADE assessment
Full size table

Data synthesis

Variables that were rated as inconsistent were not graded following COSMIN guideline recommendations. No studies which assessed measurement error reported the Maximal Information Coefficient. Therefore, the measurement error was not graded.

Clinometer apps: asymptomatic participants

The rotation ROM assessment of two studies [29, 33] were pooled for intra-rater reliability meta-analyses (see Fig. 2). The weighted mean showed ICC of 0.94 (CI 95% 0.88, 0.97) for left rotation and 0.94 (CI 95% 0.82, 0.98) for right rotation, indicating excellent intra-rater reliability. The heterogeneity was deemed substantial for both movements with I2 scores of 72 and 89%. Ullucci et al. (2019) [33] had a risk of bias score of ‘doubtful’ and Monreal et al. (2021) [29] was rated as ‘adequate’.

Fig. 2
figure 2

Forest plot presenting the pooled correlation coefficients for intra-rater reliability of clinometer apps for the measurement of neck range of motion in asymptomatic people. * ICC – intraclass correlation coefficient, CI – confidence interval

Full size image

Two studies assessed inter-rater reliability for clinometer apps for the measurement of neck ROM for asymptomatic participants [32, 33]. Ullucci et al. (2019) [33] reported one rater used an iPhone device and one used an Android device, meaning the ICC scores may also be influenced by these methodological differences. The inter-rater reliability of the mean total ROM produced an ICC of 0.82 (CI 95% 0.56, 0.91) and the mean peak ROM, an ICC of 0.87 (CI 95% 0.79, 0.93) which was considered ‘excellent’. While, Tousignant-Laflamme et al. (2013) [32] identified inter-rater reliability rated as ‘fair’ when measured in the sagittal and frontal planes with values that ranging from ICC = 0.40 to 0.54. The COSMIN criteria for good measurement properties indicated that clinometer apps were ‘sufficient’ for Ullucci et al. (2019) [33] and having a ‘doubtful’ risk of bias score, while Tousignant-Laflamme et al. (2013) [32] was ‘insufficient’ with an adequate risk of bias. The GRADE assessment revealed that the certainty of evidence was ‘very low’. This quality of evidence rating was downgraded by serious risk of bias, inconsistency and impreciseness due to the small population (> 50).

Two studies assessed the concurrent validity of clinometer apps in the measurement of neck ROM [29, 32] but meta- analyses could not be performed due to the heterogeneous statistical methods used. Monreal et al. (2021) [29] used Pearson’s correlation coefficient in all three planes of movement. The scores were ranged between 0.74 and 0.93, demonstrating high to very high concurrent validity. Tousignant-Laflamme et al. (2013) [32] assessed ICC revealing ‘excellent’ validity for flexion (ICC = 0.76) and right lateral flexion (ICC = 0.85), ‘good’ validity for left lateral flexion (ICC = 0.70) and ‘fair validity for extension (ICC=0.58). The GRADE assessment could not be rated given that these studies were deemed as inconsistent due to having an ‘indeterminate’ score for the COSMIN criteria for good measurement properties.

Clinometer apps: participants with neck pain

Three studies assessed intra-rater reliability: Ghorbani et al. (2020) [10], Pourahmadi et al. (2018) [26], and Rodriguez-Sanz et al.(2019) [11]. However, the meta-analysis calculated weighted mean ICCs ranging between 0.61 (CI 95% 0.63, 0.78) and 0.84 (CI 95% 0.73, 0.91) for the six different movements that were measured, indicating good to excellent intra-rater reliability. Forest plots representing this data can be seen in Fig. 3. Four out of the six movements’ had substantial heterogeneity and there was a large range with I2 scores sitting between 0 and 66%. All studies in this subgroup were assessed as having ‘adequate’ risk of bias and the overall quality of evidence was ‘low’. This was mainly downgraded due to imprecision and inconsistency. The GRADE assessment revealed that there was ‘insufficient’ intra-rater reliability.

Fig. 3
figure 3

Forest plot presenting the pooled correlation coefficients for intra-rater reliability of clinometer apps for the measurement of neck range of motion in people with neck pain

Full size image

Three studies evaluated inter-rater reliability [10, 11, 26]. The certainty of the evidence was graded as low quality with ‘insufficient’ inter-rater reliability for this population. Weighted mean ICCs were calculated, and the results ranged between 0.63 (CI 95% 0.23, 0.78) and 0.89 (CI 95% 0.69, 0.86) for the six different movements that were measured, indicating good to excellent intra-rater reliability. Forest plots representing this data can be seen in Fig. 4. Four out of the six measures had substantial heterogeneity and there was a large range with I2 scores sitting between 38 and 73%. Rodriguez-Sanz et al. (2019) [11] only used clinometer apps for movements in the sagittal and frontal plane, so this study was not included in the meta-analysis for movements in the transverse plane. All studies in this subgroup were assessed as having ‘adequate’ risk of bias and the overall quality of evidence was ‘low’. This was downgraded due to imprecision.

Fig. 4
figure 4

Forest plot presenting the pooled correlation coefficients for inter-rater reliability of clinometer apps for the measurement of neck range of motion in people with neck pain

Full size image

Two studies assessed the criterion validity of clinometer apps measuring neck ROM in people in neck pain [10, 11]. A meta-analysis could not be conducted due to the heterogeneity of the statistical methods used to measure criterion validity (ICC and Pearson’s Correlation Coefficient). Both sets of data were compared against the same “gold standard”, a Cervical Range of Motion (CROM) device. Ghorbani et al. (2020) [10] reported two sets of Pearson’s correlation coefficients from two different devices for the three planes of movement at the neck with values ranging between 0.53 and 0.94. Thus, the criterion validity was found to be moderate to very high. However, if the transverse plane movements are excluded, then the values increased to 0.72 to 0.94. Rodriguez-Sanz et al. (2019) [11] reported ICCs of between 0.92-0.98 for the measurement of neck ROM in the frontal and sagittal planes. There was ‘sufficient’ evidence to fulfil the COSMIN criteria for good measurement properties. The study by Ghorbani et al. (2020) [10] was rated as ‘adequate’ whereas the study by Rodriguez-Sanz et al. (2019) [11] was rated ‘inadequate’ for risk of bias. The overall GRADE quality of evidence for this subgroup was ‘very low’. This rating was downgraded by the inconsistency due to differences in results between the studies.

Compass apps: asymptomatic participants

Three studies assessed the intra-rater and inter-rater reliability of compass apps for the measurement of neck ROM in asymptomatic participants [12, 13, 32]. Satpute et al. (2019) [12] used the flexion rotation test (FRT) and upper cervical rotation (UCR) test to assess upper cervical ROM, while Guidetti et al. (2017) [13] assessed full cervical ROM in all three planes of movement and Tousignant-Laflamme, et al. (2013) [32] assessed neck ROM only in the horizontal plane of movement. It is due to these methodological differences that a meta-analysis was not indicated. Two studies reported excellent intra-rater reliability with ICC values ranging between 0.88 (CI 95%: 0.77, 0.94) [12] and 0.97 (CI 95%: 0.94, 0.99) [13] whereas Tousignant-Laflamme, et al. (2013) [32] reported ‘good’ intra-rater reliability for a first rater and ‘poor’ reliability for a second, with values of 0.74 to 0.17 respectively for measurements right and left rotation. Excellent inter-rater reliability were reported by Satpute et al. (2019) [12]   and Guidetti et al. (2017) [13] with ICC values ranging between 0.88 (CI 95%: 0.77, 0.94) and 0.99 (CI 95%: 0.98, 1.0) respectively. Tousignant-Laflamme, et al. (2013) [32] reported ‘poor’ inter-rater reliability with values ranging from 0.09 to 0.07 for right to left rotation respectively. The criteria for good measurement properties reports ‘sufficient’ intra-rater and inter-rater reliability for Satpute et al. (2019) [12] and Guidetti et al. (2017) [13]  whereas Tousignant-Laflamme, et al. (2013) [32] was ‘insufficient’. The risk of bias was rated as ‘adequate’ for Guidetti et al. (2017) [13]  and Tousignant-Laflamme, et al. (2013) [32], while Satpute et al. (2019) [12] was ‘doubtful’. The overall quality of evidence was downgraded to ‘low’ due to the risk of bias and impreciseness [12, 13].

]Criterion validity of compass apps was assessed Guidetti, et al [13]  and Tousignant-Laflamme, et al. (2013) [32]. Guidetti et al. (2017) [13]  reported ICC and Pearson’s correlation coefficient for measurements in all three planes of movement with scores ranging between 0.99 and 1 indicating ‘very high’ criterion validity. This measurement property was graded as having ‘sufficient’ criteria for good measurement properties and ‘adequate’ risk of bias. Tousignant-Laflamme, et al (2013) [32] found ‘fair’ criterion validity using for the measurement of right and left rotation (ICC: 0.55 and 0.43, respectively), ‘insufficient’ criteria for good measurement properties and ‘adequate’ risk of bias. The certainty of the evidence was downgraded to ‘low’ due to impreciseness and inconsistency.

Compass apps: participants with neck pain

Only one study assessed inter-rater and intra-rater reliability of compass apps in participants with neck pain [11]. The ICC value for intra-rater reliability was 0.96 (CI 95%: 0.84, 0.99) for left rotation, and 0.89 (CI 95%: 0.57, 0.97) for right rotation. The ICC values for inter-rater reliability were 0.94 (CI 95%: 0.77, 0.99) for left rotation and 0.86 (CI 95%: 0.41, 0.97) for right rotation. These scores indicate ‘excellent’ intra-rater and inter-rater reliability and were rated as being ‘sufficient’ according to the COSMIN criteria for good measurement properties. Intra and inter–rater reliability presented adequate risk of bias but the quality of the evidence was downgraded to ‘very low’ due to the small sample size which was 10 participants.

Rodriguez-Sanz et al. (2019) [11] also assessed criterion validity of a compass app for measuring neck ROM in the transverse plane. The Pearson’s correlation coefficients were 0.96 (CI 95%: 0.90, 0.99) for left rotation and 0.93 (CI 95%: 0.84, 0.97) for right rotation, suggesting that the criterion validity is ‘very high’. However, the risk of bias was ‘inadequate’, and the GRADE assessment could not rate the overall quality due to ‘indeterminate’ criteria for good measurement properties.

Other apps: asymptomatic participants

Chang, et al. (2019) [28] and Quek, et al. (2014) [31] evaluated intra-rater reliability of custom made apps. The criteria for good measurement properties reported ‘sufficient’ intra-rater reliability for these apps. Weighted mean ICCs ranged between 0.70 (CI 95%: − 0.61, 0.99) and 0.92 (CI 95%: 0.86, 0.95) for the six different movements that were measured, indicating ‘excellent’ intra-rater reliability. The overall quality of evidence was downgraded to ‘very low’ due to imprecision from small sample sizes and very serious risk of bias.

Chang et al. (2019) [28] assessed inter-rater reliability and the ICCs ranged between 0.88 (CI 95%: 0.78, 0.93) and 0.97 (CI 95%: 0.96, 0.98) ‘indicating excellent’ inter-rater reliability and the COSMIN criteria for good measurement properties was surpassed. The risk of bias checklist scored this study as ‘doubtful’ and the GRADE assessment rated the overall quality of evidence for this study as ‘very low’ due to the ‘very serious’ risk of bias and impreciseness.

Palsson, et al. (2019) [30] assessed criterion validity for the measurement of neck ROM in the sagittal and transverse planes. The Pearson’s correlation coefficient scores ranged between 0.82 and 0.96 which is classed as ‘high’ to ‘very high’ and so was rated as being ‘sufficient’ according to the COSMIN criteria for good measurement properties. The measurement property was graded as having ‘adequate’ risk of bias and ‘very low’ overall quality of data, downgraded due to the small sample size which was 30 participants.

Chang, et al. (2019) [28] assessed concurrent validity for the measurement of neck ROM in all planes of movement and the Pearson’s correlation coefficient ranged between 0.91 and 0.96 indicating ‘very high’ concurrent validity. This measurement property presented ‘very good’ in relation to the risk of bias with ‘low’ overall quality of evidence due to the small sample size.

Other apps: participants with neck pain

Stenneberg, et al. (2018) [27] assessed the inter-rater reliability of the ‘3D range of motion app’ for the measurement of neck ROM in all three planes of movement. The ICC results for intra-rater reliability were between 0.90 (CI 95%: 0.78, 0.95) and 0.96 (CI 95%: 0.09, 0.98), indicating excellent intra-rater reliability. These results were rated as being ‘sufficient’ according to the COSMIN criteria for good measurement properties. The overall quality of data according to the GRADE assessment was downgraded to ‘very low’ due to serious risk of bias and the small sample size (very serious impreciseness).

Criterion validity was assessed by Stenneberg, et al. (2018) [27] and was determined to be ‘excellent’ with ICC ranging from 0.91 (CI 95%: − 0.01, 0.98) to 0.99 (CI 95%: 0.97, 0.99). Additionally, Pourahmadi, et al. (2018) [26] demonstrated showed good to excellent concurrent validity for the measurement of the six movements assessed. Although both studies showed very low risk of bias, the certainty of the evidence was downgraded to very low due to the very serious impreciseness (small sample < 50).

Discussion

This study systematically reviewed and synthesised the available literature that evaluated inter-rater reliability, intra-rater reliability, validity, or responsiveness of using smartphone apps to measure neck ROM in people with and without neck pain. Three types of smartphone apps were identified, namely clinometer apps, compass apps, and a group of other type of apps (e.g., costume made). From the 12 studies included in this review, no studies evaluated responsiveness, clearly indicating the need for future research to examine this measurement property of smartphone apps for the assessment of neck ROM. Overall, the three groups of apps exhibited good reliability and validity. ‘Moderate’ quality of evidence of the reliability to assess ROM in asymptomatic adults was found only for ‘Clinometer’ apps. The relative high risk of bias and small accumulative populations of the included studies, lead to ‘low’ or ‘very low’ certainty of the recommendation(s) for the other two groups of apps.

Specifically, this review found that the intra-rater and inter-rater reliability of measuring neck ROM using clinometer apps in asymptomatic people is excellent [29, 32, 33] for rotation, flexion, extension and lateral flexion, whilst when assessing people with neck pain, good to excellent intra-rater and inter-rater reliability exists [10, 11, 34]. These results support the use of clinometer apps as a reliable method for measuring neck ROM, including testing of people with neck pain. Although previous work has grouped different types of apps and did not differentiate between people with and without symptoms, similar results supporting the reliability of smartphone apps have been reported for the measurement spinal movements in the sagittal plane (flexion-extension) and frontal plane (lateral-flexion) [18]. A potential reason for the slight difference in reliability scores between those with and without neck pain is potentially due to the influence of pain on movement and a change in symptoms between assessments [35]. The studies failed to control this variable by not recording the changes in the participants’ pain between assessments. For example, one study which did not control for this was Pourahmadi, et al. (2018) [26] which, in turn, caused an increase in this study’s risk of bias score.

Intra-rater and inter-rater reliability was found to be good to excellent for the ‘other apps’. The compass apps demonstrated excellent reliability, but one [32] of the two studies only measured movement in the transverse plane. Of all movement directions, the reliability of mearing rotation was the most variable regardless of the app used or the population studies. For instance, the intra-rater reliability recorded by Quek, et al. (2014) [31] in asymptomatic participants using a custom-made app (other apps group), and by Ghorbani, et al. (2020) [10] in participants with neck pain using clinometer apps showed the lowest weighted mean ICC scores for rotation ROM. In addition, Tousignant-Laflamme, et al. (2013) [32] described poor intra-rater reliability for one of the examiners and this impacted on the inter-rater reliability described for ‘compass apps’. This may be due methodological (e.g., examiners’ experience) and technical factors (type of sensors). Specifically, magnetometers are required to measure rotation in antigravity positions, such as sitting. Magnetometers are more sensitive to signal distortion from environmental magnetic fields, therefore potentially making the measurement of rotation in these circumstances less accurate [26]. This concurs with a recent systematic review that evaluated measurement properties of apps to assess the range of spinal movement [15].

From the included studies which evaluated criterion validity, three used goniometers, one used a fluid inclinometer, three used a Cervical Range of Motion (CROM) device, two used an image-based motion capture system and one an electromagnetic tracking device. Keogh et al [36] argues that the most appropriate gold standard to use would be radiographic image-based system such as x-ray or motion capture. However, due to the financial and or ethical constraints of clinical practise, this would not always be feasible and instead, a CROM device may be the most appropriate tool for a gold standard, due to its extensively studied measurement properties [37–39]. Clinometer apps scored the least in terms of criterion validity while the ‘other apps’ group recorded the highest scores for criterion and concurrent validity.

The evidence from this review suggests that smartphone apps are a reliable and valid method of measuring neck ROM in symptomatic and asymptomatic people. This indication is in line with other research on this topic [15, 36] that shows relatively strong evidence to support the intra-rater reliability, inter-rater reliability, and validity of smartphone apps for measuring ROM in a variety of joints including the trunk. However, due to the low quality of evidence identified in this review, one specific app cannot be recommended over another for use. Future studies are required to assess responsiveness which can be achieved by evaluating changes in ROM using different apps pre and post an intervention which is known to enhance neck ROM.

Limitations

The largest influencing factor in the low-quality ratings for risk of bias and the overall quality of evidence was the small sample size of each sub-group, especially those that examined people with neck pain. This potentially means that there is low confidence that the results represent the true measurement properties. Furthermore, fifteen out of the twenty datasets used for the meta-analyses were found to have substantial heterogeneity. This indicates a large volume of variance within the collected data which could have come from sources such as systematic errors or sampling errors. The COSMIN criteria for good measurement properties may be too simplified as if only one of the ICC scores for a study was < 0.7, then the overall result is categorised as ‘insufficient’, disregarding the other results. One specific limitation of this review is the exclusion of non-English articles.

Conclusion

This systematic review revealed that smartphone apps may have sufficient intra-rater reliability, inter-rater reliability, and validity for the assessment of neck ROM in people with and without neck pain. Moderate quality of evidence supports the reliability of clinometer apps to assess ROM in an asymptomatic population. However, the quality of evidence of different apps when measuring people with neck pain is low, and thus there is low confidence in the findings. More high-quality research with large samples is needed to further provide evidence to support the reliability, validity, and responsiveness of smartphone apps for the assessment of neck ROM.

Availability of data and materials

All data generated or analyzed data in study are included in this article. The data utilized for this article can be found individually through the articles assessed.

References

  1. Cieza A, Causey K, Kamenov K, et al. Global estimates of the need for rehabilitation based on the global burden of disease study 2019: a systematic analysis for the global burden of disease study 2019. Lancet. 2020;396(10267):2006–17. https://doi.org/10.1016/S0140-6736(20)32340-0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Martin BI, Deyo RA, Mirza SK, et al. Expenditures and health status among adults with Back and neck problems. JAMA. 2008;299(6):656–64. https://doi.org/10.1001/jama.299.6.656.

    Article  CAS  PubMed  Google Scholar 

  3. Cleland JA, Mintken PE, Carpenter K, et al. Examination of a clinical prediction rule to identify patients with neck pain likely to benefit from thoracic spine thrust manipulation and a general cervical range of motion exercise: multi-center randomized clinical trial. Phys Ther. 2010;90(9):1239–50. https://doi.org/10.2522/ptj.20100123.

    Article  PubMed  Google Scholar 

  4. Hagen KB, Harms-Ringdahl K, Enger NO, et al. Relationship between subjective neck disorders and cervical spine mobility and motion-related pain in male machine operators. Spine. 1997;22(13):1501–7.

    Article  CAS  PubMed  Google Scholar 

  5. Demoulin C, Grosdent S, Smeets R, et al. Muscular Performance Assessment of Trunk Extensors: A Critical Appraisal of the Literature, Low Back Pain, Dr. Ali Asghar Norasteh (Ed.), ISBN: 978-953-51-0599-2, InTech. 2012. Available from: http://www.intechopen.com/books/low-back-pain/muscularperformance-assessment-of-trunk-extensors-a-critical-appraisal-of-the-literature.

  6. Ernst MJ, Crawford RJ, Schelldorfer S, et al. Extension and flexion in the upper cervical spine in neck pain patients. Man Ther. 2015;20(4):547–52. https://doi.org/10.1016/j.math.2014.12.005.

    Article  PubMed  Google Scholar 

  7. Jahre H, Grotle M, Smedbråten K, et al. Risk factors for non-specific neck pain in young adults. A systematic review. BMC Musculoskelet Disord. 2020;21(1):366. https://doi.org/10.1186/s12891-020-03379-y.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Dall’Alba PT, Sterling MM, Treleaven JM, et al. Cervical range of motion discriminates between asymptomatic persons and those with whiplash. Spine. 2001;26(19).

  9. Whitcroft KL, Massouh L, Amirfeyz R, et al. Comparison of methods of measuring active cervical range of motion. Spine. 2010;35(19).

  10. Ghorbani F, Kamyab M, Azadinia F. Smartphone applications as a suitable alternative to CROM device and inclinometers in assessing the cervical range of motion in patients with nonspecific neck pain. J Chiropr Med. 2020;19(1):38–48. https://doi.org/10.1016/j.jcm.2019.10.004.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Rodríguez-Sanz J, Carrasco-Uribarren A, Cabanillas-Barea S, et al. Validity and reliability of two smartphone applications to measure the lower and upper cervical spine range of motion in subjects with chronic cervical pain. J Back Musculoskelet Rehabil. 2019;32:619–27. https://doi.org/10.3233/BMR-181260.

    Article  PubMed  Google Scholar 

  12. Satpute K, Nalband S, Hall T. The C0-C2 axial rotation test: normal values, intra- and inter-rater reliability and correlation with the flexion rotation test in normal subjects. J Man Manipulative Ther. 2019;27(2):92–8. https://doi.org/10.1080/10669817.2018.1533195.

    Article  Google Scholar 

  13. Guidetti L, Placentino U, Baldari C. Reliability and criterion validity of the smartphone inclinometer application to quantify cervical spine mobility. Clin Spine Surg. 2017;30(10):E1359–E66. https://doi.org/10.1097/BSD.0000000000000364.

    Article  PubMed  Google Scholar 

  14. Longoni L, Brunati R, Sale P, et al. Smartphone applications validated for joint angle measurement: a systematic review. Int J Rehabil Res. 2019;42(1):11–9. https://doi.org/10.1097/mrr.0000000000000332 [published Online First: 2019/01/15].

    Article  PubMed  Google Scholar 

  15. Sedrez JA, Furlanetto TS, Gelain GM, et al. Validity and reliability of smartphones in assessing spinal kinematics: a systematic review and Meta-analysis. J Manip Physiol Ther. 2020;43(6):635–45. https://doi.org/10.1016/j.jmpt.2019.10.012 [published Online First: 2020/09/10].

    Article  Google Scholar 

  16. Mokkink LB, Boers M, van der Vleuten CPM, et al. COSMIN risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study. BMC Med Res Methodol. 2020;20(1):293. https://doi.org/10.1186/s12874-020-01179-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–57. https://doi.org/10.1007/s11136-018-1798-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8(5):336–41. https://doi.org/10.1016/j.ijsu.2010.02.007.

    Article  PubMed  Google Scholar 

  19. Campbell LC. Musculoskeletal Disorders. Addressing Disparities Prevalence Severity Treat. 2017;78(5):315–7. https://doi.org/10.18043/ncm.78.5.315.

    Article  Google Scholar 

  20. McKenzie JE, Brennan SE, Ryan RE, et al. Defining the criteria for including studies and how they will be grouped for the synthesis. In: Cochrane Handbook for Systematic Reviews of Interventions; 2019. p. 33–65.

    Chapter  Google Scholar 

  21. Li T, Vedula SS, Hadar N, et al. Innovations in data collection, management, and archiving for systematic reviews. Ann Intern Med. 2015;162(4):287–94. https://doi.org/10.7326/M14-1603.

    Article  PubMed  Google Scholar 

  22. Mokkink LB, de Vet HCW, Prinsen CAC, et al. COSMIN risk of Bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1171–9. https://doi.org/10.1007/s11136-017-1765-4.

    Article  CAS  PubMed  Google Scholar 

  23. Higgins JPT, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. https://doi.org/10.1136/bmj.327.7414.557.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Popay J, Roberts H, Sowden A, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme Version, vol. 1; 2006. p. b92.

    Google Scholar 

  25. Pourahmadi MR, Ebrahimi Takamjani I, Sarrafzadeh J, et al. Reliability and concurrent validity of a new iPhone® goniometric application for measuring active wrist range of motion: a cross-sectional study in asymptomatic subjects. J Anat. 2017;230(3):484–95. https://doi.org/10.1111/joa.12568.

    Article  PubMed  Google Scholar 

  26. Pourahmadi MR, Bagheri R, Taghipour M, et al. A new iPhone application for measuring active craniocervical range of motion in patients with non-specific neck pain: a reliability and validity study. Spine J. 2018;18(3):447–57. https://doi.org/10.1016/j.spinee.2017.08.229.

    Article  PubMed  Google Scholar 

  27. Stenneberg MS, Busstra H, Eskes M, et al. Concurrent validity and interrater reliability of a new smartphone application to assess 3D active cervical range of motion in patients with neck pain. Musculoskelet Sci Pract. 2018;34:59–65. https://doi.org/10.1016/j.msksp.2017.12.006.

    Article  PubMed  Google Scholar 

  28. Chang KV, Wu WT, Chen MC, et al. Smartphone Application with Virtual Reality Goggles for the Reliable and Valid Measurement of Active Craniocervical Range of Motion. Diagnostics (Basel). 2019;9(3). https://doi.org/10.3390/diagnostics9030071 [published Online First: 2019/07/13].

  29. Monreal C, Luinstra L, Larkins L, et al. Validity and Intrarater reliability using a smartphone clinometer application to measure active cervical range of motion including rotation measurements in supine. J Sport Rehabil. 2021;30(4):680–4. https://doi.org/10.1123/jsr.2019-0422.

    Article  Google Scholar 

  30. Palsson TS, Christensen SW, Thomsen MH, et al. Assessment of range and quality of neck movement using a smartphone-based application. Musculoskelet Sci Pract. 2019;41:64–9. https://doi.org/10.1016/j.msksp.2019.01.002.

    Article  CAS  PubMed  Google Scholar 

  31. Quek J, Brauer SG, Treleaven J, et al. Validity and intra-rater reliability of an android phone application to measure cervical range-of-motion. J Neuroeng Rehabil. 2014;11(1):65. https://doi.org/10.1186/1743-0003-11-65.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Tousignant-Laflamme Y, Boutin N, Dion AM, et al. Reliability and criterion validity of two applications of the iPhone™ to measure cervical range of motion in healthy participants. J Neuroeng Rehabil. 2013;10(1):69. https://doi.org/10.1186/1743-0003-10-69.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Ullucci P, Tudini F, Moran M. Reliability of Smartphone Inclinometry to Measure Upper Cervical Range of Motion. J Sport Rehabil. 2019;28(1). https://doi.org/10.1123/jsr.2018-0048.

  34. Mohammadreza P, Hamid H, Ali G, et al. Psychometric properties of the iHandy level smartphone application for measuring lumbar spine range of motion and Lordosis: a systematic review of the literature. J Sport Rehabil. 2020;29(3):352–9. https://doi.org/10.1123/jsr.2018-0354.

    Article  Google Scholar 

  35. Hodges PW, Tucker K. Moving differently in pain: a new theory to explain the adaptation to pain. Pain 2011;152(S):S90-S98. doi: papers2://publication/doi/10.1016/j.pain.2010.10.020.

  36. Keogh JWL, Cox A, Anderson S, et al. Reliability and validity of clinically accessible smartphone applications to measure joint range of motion: a systematic review. PLoS One. 2019;14(5):e0215806. https://doi.org/10.1371/journal.pone.0215806.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Audette I, Dumas J-P, Côté JN, et al. Validity and between-day reliability of the cervical range of motion (CROM) device. J Orthop Sports Phys Ther. 2010;40(5):318–23. https://doi.org/10.2519/jospt.2010.3180.

    Article  PubMed  Google Scholar 

  38. Love S, Gringmuth RH, Kazemi M, et al. Interexaminer and intraexaminer reliability of cervical passive range of motion using the CROM and Cybex 320 EDI. J Can Chiropr Assoc. 1998;42(4):222–8.

    PubMed Central  Google Scholar 

  39. Tousignant M, Smeesters C, Breton A-M, et al. Criterion validity study of the cervical range of motion (CROM) device for rotational range of motion on healthy adults. J Orthop Sports Phys Ther. 2006;36(4):242–8. https://doi.org/10.2519/jospt.2006.36.4.242.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

None.

Funding

No specific funding was received from any bodies in the public, commercial or not-for-profit sectors to carry out the work described in this article.

Author information

Authors and Affiliations

  1. Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, B15 2TT, UK

    E. Elgueta-Cancino, K. Rice & D. Falla

  2. Division of Physiotherapy, Institute of Health and Social Care, London South Bank University, London, UK

    D. Abichandani

Authors
  1. E. Elgueta-Cancino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. Rice
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D. Abichandani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. D. Falla
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DF and KR formulated the focus of the systematic review. KR and DA performed the search strategy and data extraction, while DF served as a judge in case of disagreement. KR and DA assessed the risk of bias, while DF was consulted in case of disagreement. KR and EEC drafted the initial version of the manuscript. All authors reviewed and commented on each draft of the manuscript. All authors have approved the final manuscript.

Corresponding author

Correspondence to D. Falla.

Ethics declarations

Ethics approval and consent to participate

This systematic literature review was conducted using ethical standards. Given the type of manuscript, no specific ethics approval or consent was required. All methods were developed and performed in accordance with the relevant guidelines and regulations.

Consent for publication

NA.

Competing interests

There are no competing interests to report from any of the authors.

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Elgueta-Cancino, E., Rice, K., Abichandani, D. et al. Measurement properties of smartphone applications for the measurement of neck range of motion: a systematic review and meta analyses. BMC Musculoskelet Disord 23, 138 (2022). https://doi.org/10.1186/s12891-022-05066-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-022-05066-6

Keywords

BMC Musculoskeletal Disorders

ISSN: 1471-2474

Contact us