Skip to main content

15-item Roland-Morris Disability Questionnaire (RMDQ-15): structural and criterion validity on patients with chronic low back pain

Abstract

Background

The Roland-Morris Disability Questionnaire (RMDQ) is one of the most used instruments to measure self-reported disability in patients with low back pain, however, the uncertainty on which version to use may lead to inadequate disability measurement and consequently, improper management of patients with chronic low back pain.

Objective

To propose a short version of the RMDQ, compare it with the other short versions presented by the specialized literature, and identify the best internal structure of the RMDQ for the Brazilian population.

Methods

This is a cross-sectional study in which we used confirmatory factor analysis to identify the best structure of the RMDQ. We assessed 545 participants, most of which were women, aged ≥ 30 years old, single, with mean low back pain intensity ~ 5 points, and mean pain chronicity ~ 72 months. We used lavaan and semPlot packages, with implementation of a tetrachoric matrix and the robust diagonally weighted least squares extraction method. We also used fit indices chi-square/degree of freedom, comparative fit index, Tucker-Lewis index, root mean square error of approximation, and standardized root mean squared residual. For the comparison between models, we considered the structure with the lowest values of the Akaike information criterion and Bayesian information criterion. In addition, we assessed criterion validity via Spearman’s correlation coefficient to correlate the long and short versions. In this study, the 15-item structure was created through the use of modification indices to identify redundant items (9 items were excluded).

Results

RMDQ structure with one domain and 15 items and the structure with two domains and 16 items showed all fit indices with adequate values, but the one-dimensional version showed the lowest Akaike information criterion and Bayesian information criterion values. Regarding criterion validity, correlation between the RMDQ with 24 items and 15 items is adequate (rho = 0.954, p < 0.001).

Conclusion

The RMDQ-15 is a short version of the RMDQ instrument with the most adequate internal structure and satisfactorily correlated with the long version of the instrument.

Peer Review reports

Introduction

The Roland-Morris Disability Questionnaire (RMDQ) is one of the most used instruments to measure self-reported disability in patients with low back pain [1]. The questionnaire was developed in the United Kingdom in 1983 and has been cross-culturally adapted for more than 30 countries, including Germany [2], Turkey [3], India [4], and Nigeria [5], but most of the adaptations failed to analyze its internal structure [6]. The Brazilian version of the RMDQ identified a valid construct through correlation with the Numerical Pain Rating Scale (NPRS) and adequate reliability [7].

The cross-cultural adaptation of the Brazilian RMDQ was conducted according to the procedures recommended by Beaton et al. [8], in which there was the translation by different translators, a consensus on the translated version, the backtranslation performed by other translators, the consensual version and the comparison between the original and the backtranslated versions [7].

Recently, a study identified a valid structure of the RMDQ with 1 domain and 24 items [9]. However, the RMDQ has a relatively high number of items to investigate disability, and item redundancy is common in long questionnaires [10]. In contrast, short questionnaires optimize clinical and scientific applicability, as they reduce the number of errors and the filling time, maintaining the same quality in the information obtained [11, 12]. Therefore, some reductions for the RMDQ have been published [13].

Study conducted by Davidson [13] evaluated three possibilities of internal structure of the RMDQ: structure with 18 items by Stratford and Binkley [14], structure also with 18 items by Williams and Myers [15], and structure with 11 items by Stroud et al. [16]. The three possibilities of internal structure showed adequate fit in the Rasch analysis. Stratford and Binkley [14] and Williams and Myers [15] used a classic test theory approach with decision rules for item reduction based on response frequency, item–item and item–total correlation, and Cronbach’s alpha; Stroud et al. [16] used an item response theory approach in developing their short version of the RMDQ.

In Brazil, there is only one short version of the RMDQ, with 16 items, validated for community-dwelling older adults with low back pain [17]. The study presented a structure with two domains: functional capacity domain, composed of items 1, 4, 6, 7, 8, 19, and 20; and mobility domain, consisting of items 3, 5, 9, 11, 14, 16, 17, 21, and 23. The items were excluded for presenting cross-loading, inadequate loading factors, and commonalities, or did not report to the latent construct. The authors used factor analysis to support this two-dimensional structure.

However, despite important scientific initiatives, no study compared the different versions of the RMDQ for the Brazilian population based on factor analysis. The uncertainty on which version to use may lead to inadequate disability measurement and consequently, improper management of patients with chronic low back pain. Thus, the present study aimed to propose a short version of the RMDQ, compare it with the short versions presented by the specialized literature, and identify the best internal structure of the RMDQ for the Brazilian population.

Our hypothesis was that there would be a more adequate RMDQ short version, and that this short version would be positively correlated with the original RMDQ. Considering the importance of assessing self-report disability in the clinical context, and that using short versions of the most used disability instruments make it easier for clinicians to apply and interpret their results in a faster way, there is a need to establish the best short-version structure of the RMDQ.

Methods

Study design and recruitment

This was a cross-sectional study to investigate the structural validity of the RMDQ. The methodology of this study followed the guidelines of the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) [18]. The study was approved by the Research Ethics Committee of the institution (protocol number 3,408,949). We recruited the study sample on physiotherapy clinics in the city of Buriticupu e São Luis simultaneously (from August 2020 to July 2022). In addition, we disclosed the research via social media and messaging application (Instagram®, Facebook®, and WhatsApp®), and those who were willing to take part of the study were contacted and received a link for the Google Forms® (Mountain View, CA, USA) data collection form.

Sample

On factor analysis, it is recommended that the sample size represents 7 times the number of items in the questionnaire [18]. As the RMDQ has 24 items, the minimum sample size was 168 participants [18]. We included native speakers of Brazilian Portuguese, of both sexes, aged ≥ 18 years, with low back pain for at least 3 months (chronic), with score ≥ 3 points on the 11-point NPRS [19]. Exclusion criteria were: tumor history, acute infections or trauma in the lumbar and pelvic region; systemic degenerative diseases; diagnosed neurological and cognitive problems; other previously diagnosed chronic pains; pregnancy.

Evaluation tools

We used two scales in the present study: 11-points NPRS to measure pain intensity and 24-items RMDQ to measure disability. The NPRS is a scale used to quantify the pain intensity using a sequence of 11 numbers, in which 0 represents “no pain” and 10 “the worst pain imaginable” (higher the score, the greater the pain intensity), validated for Portuguese by Ferreira-Valente et al. [19]. The RMDQ was adapted and validated for the Brazilian population by Nusbaum et al. [7] and measure the disability in individuals with low back pain (reliability and construct validity tested). It consists of 24 items that describe situations experienced by people with low back pain and its score ranges from 0 to 24 points (higher the score, the greater the disability). In the face-to-face collection (cities of Buriticupu e São Luis), paper and pen were used in which the participants filled in the instruments through self-report; in the online stage, we used the Google Forms® (Mountain View, CA, USA) and extracted the database, which was controlled, making duplicate responses impossible.

Statistical analysis

We performed descriptive analysis to present the personal and clinical variables. Quantitative variables were presented as mean and standard deviation, while qualitative variables were presented as relative and absolute frequencies.

We used confirmatory factor analysis (CFA) to identify the best structure of the RMDQ via software R Studio (Boston, MA, USA), using lavaan and semPlot packages, and with implementation of a tetrachoric matrix and the robust diagonally weighted least squares (RDWLS) extraction method [20, 21]. We considered adequate values on fit indices for the following cut-off: chi-square/degree of freedom (DF) < 3; comparative fit index (CFI) and Tucker-Lewis index (TLI) > 0.90; root mean square error of approximation (RMSEA) and standardized root mean squared residual (SRMR) < 0.08 [22, 23].

For the comparison between models, the structure with the lowest values of the Akaike information criterion (AIC) and Bayesian information criterion (BIC) was considered the most appropriate [24]. Factor loadings were considered adequate when greater than 0.40 [25].

The method of reducing the number of items of the RMDQ considered the modification indices and factor loadings (modification indices indicate redundant items in pairs). We considered redundant items to be those with a modification index value higher than 10 [26]. In each paired analysis the redundant item with the lowest factor loading was excluded, and at the end of the item exclusions, the researchers of this study approved the short version of the RMDQ.

We assessed criterion validity and considered the 24-item long version of the RMDQ as the gold standard. Thus, we used Spearman’s correlation coefficient (rho) to correlate the long and short versions, given that the data did not present a normal distribution when analyzed using the Kolmogorov–Smirnov test. Correlation magnitude > 0.70 was considered the appropriate cut-off point for criterion validity [18].

Results

The study sample consisted of 545 participants: 428 individuals (78.5%) participated in the study by completing the online form and 117 participants (21.5%) participated face-to-face. During the face-to-face collection, an independent researcher gave the instruments to the participants to record their self-report, whose answers were obtained through individual reading and completion similar to the format of the online collection (i.e., there was no influence from the evaluator). Most participants were women, aged ≥ 30 years old, single, and physically active (Table 1). Mean low back pain intensity was ~ 5 points on NPRS and mean pain chronicity was greater than 72 months. Participants in the face-to-face data collection showed higher levels of disability in the RMDQ. However, despite the higher levels of disability, the mean RMDQ scores for both groups did not reach the RMDQ cutoff scores [27].

Table 1 Characteristics of patients with chronic low back pain – values presented as Mean (standard deviation) or n (%)

Table 2 describes the RMDQ structures that we tested, and Table 3 displays that the original 24-item RMDQ structure and the 18-item structure presented by Stratford and Binkley [14] showed two inadequate fit indices in the CFA (chi-square/DF > 3 and SRMR > 0.08). The structures suggested by Williams and Myers [15] with 18 items and by Stroud et al. [16] with 11 items showed chi-square/DF > 3.

Table 2 Versions of the Roland-Morris Disability Questionnaire tested in the present study
Table 3 Reduction of the Roland-Morris Disability Questionnaire items based on modification indices (MI) and factor loadings from confirmatory factor analysis

The 15-item structure proposed in the present study was created through the use of modification indices to identify redundant items. Thus, 9 items were excluded, as shown in Table 3 and Fig. 1. The RMDQ structure with one domain and 15 items and the structure with two domains and 16 items showed all fit indices with adequate values, but the one-dimensional version showed the lowest AIC and BIC values (Table 4). All of the authors of this study analyzed the RMDQ-15 and agreed with the remaining items. The Brazilian Portuguese version of the RMDQ-15 is available in Supplementary file 1.

Fig. 1
figure 1

Path diagram of the 15-item Roland-Morris Disability Questionnaire. All factor loadings above 0.40. The dotted line indicates the first factor item. The thicker the line, the greater the factor loading. D: Disability

Table 4 Confirmatory factor analysis of the five versions of the Roland-Morris Disability Questionnaire tested in the present study (n = 545)

Regarding criterion validity, the correlation between the RMDQ with 24 items and 15 items is adequate (rho = 0.954, p < 0.001).

Discussion

Our study identified that the Brazilian version of the RMDQ with one domain and 15 items has the best fit indices, which supports this structure as the most adequate RMDQ short version. The only study that showed a reduced version of the RMDQ in Brazil (two domains and 16 items) was carried out with participants aged 60 years or older. [17]. As in our study, the research conducted by Tanaka et al. [17] used factor analysis with correlation matrix and extraction method adequate for categorical variables. In the comparison between our structure and the structure by Tanaka et al. [17], we identified good fit indices for both, but our structure was more adequate as it presented lower AIC and BIC values.

The reduced structures of the RMDQ in English by Stratford and Binkley [14], Williams and Myers [15], and Stroud et al. [16] showed some inadequate fit indices. Several methodologies were used to reduce an instrument [14,15,16,17]. We used modification rates, factor analysis, and approval of the short version by the study authors. Considering all the proposed structures, only the following items are present in all five structures tested here: items 3, 5, 8, 9 and 16.

Regarding criterion validity, the RMDQ-15 showed a correlation magnitude above 0.95 with the long version of the instrument. This finding indicates that, even with the exclusion of 9 items, the measurement capacity of the RMDQ-15 remained very close to the original version. COSMIN indicates that correlations above 0.70 are sufficient for criterion validity. Although our study presents adequate values in the properties of measurements verified, we agree with Chiarotto et al. [1] regarding the need to evaluate other measurement properties, such as reliability, internal consistency, responsiveness, minimal clinically important difference/change, and standard error of measurement.

Disability resulting from low back pain is the main complaint of patients. This motivates them to seek professional help, and that is why the RMDQ is the most used instrument in the clinical evaluation of these patients. As such, our study will help patients, clinicians, and scientists to assess the disability of low back pain patients using less time (online or face-to-face) and with more certainty and accuracy regarding the construct that the instrument purports to measure (disability). Besides, reducing the number of items (from 24 to 15 items) also reduces the redundancy of this instrument, which will facilitate, consequently, the understanding of patients with low education, favoring the inclusion in research on low back pain and facilitating specific treatments for them (because the specificity of a treatment depends on the accuracy of the assessment).

The study has limitations that must be considered. Most of the sample in our study had mild disability related to low back pain, despite the inclusion criterion of a minimum NPRS score of three points. Therefore, we recommend further studies to test RMDQ-15 in patients undergoing clinical treatment with higher degrees of disability, as well as other RMDQ-15 measurement properties, e.g., construct validity, reliability, internal consistency, responsiveness, minimal clinically important difference/change, and standard error.

Conclusion

The RMDQ-15 is a short version of the RMDQ instrument with the most adequate internal structure and satisfactorily correlated with the long version of the instrument.

Availability of data and materials

The data and materials in this paper are available from the corresponding author on request.

Abbreviations

AIC:

Akaike Information Criterion

BIC:

Bayesian Information Criterion

CFA:

Confirmatory Factor Analysis

CFI:

Comparative fit index

COSMIN:

COnsensus-based Standards for the selection of health Measurement INstruments

DF:

Degree of freedom

NPRS:

11-Item Numeric Pain Rating Scale

RDWLS:

Robust Diagonally Weighted Least Squares

RHO:

Spearman’s Correlation Coefficient

RMSEA:

Root Mean Square Error of Approximation

RMDQ:

Roland-Morris Disability Questionnaire

RMDQ-15:

15-Item Roland-Morris Disability Questionnaire

SRMR:

Standardized Root Mean Squared Residual

TLI:

Tucker-Lewis index

References

  1. Chiarotto A, Maxwell LJ, Terwee CB, Wells GA, Tugwell P, Ostelo RW. Roland-Morris Disability Questionnaire and Oswestry Disability Index: Which Has Better Measurement Properties for Measuring Physical Functioning in Nonspecific Low Back Pain? Systematic Review and Meta-Analysis. Phys Ther. 2016;96:1620–37.

    Article  PubMed  Google Scholar 

  2. Exner V, Keel P. Measuring disability of patients with low-back pain–validation of a German version of the Roland & Morris disability questionnaire. Schmerz. 2000;14:392–400.

    Article  CAS  PubMed  Google Scholar 

  3. Küçükdeveci AA, Tennant A, Elhan AH, Niyazoglu H. Validation of the Turkish version of the Roland-Morris Disability Questionnaire for use in low back pain. Spine (Phila Pa 1976). 2001;26:2738–43.

    Article  Google Scholar 

  4. Nambi SG. Reliability, validity, sensitivity and specificity of Guajarati version of the Roland-Morris Disability Questionnaire. J Back Musculoskelet Rehabil. 2013;26:149–53.

    Article  PubMed  Google Scholar 

  5. Igwesi-Chidobe CN, Obiekwe C, Sorinola IO, Godfrey EL. Assessing self-reported disability in a low-literate population with chronic low back pain: cross-cultural adaptation and psychometric testing of Igbo Roland Morris disability questionnaire. https://doi.org/10.1080/0963828820171416185. 2017;41:948–57.

  6. Costa LOP, Maher CG, Latimer J, Ferreira PH, Pozzi GC, Ribeiro RN. Psychometric characteristics of the Brazilian-Portuguese versions of the Functional Rating Index and the Roland Morris Disability Questionnaire. Spine (Phila Pa 1976). 2007;32:1902–7.

    Article  Google Scholar 

  7. Nusbaum L, Natour J, Ferraz MB, Goldenberg J. Translation, adaptation and validation of the Roland-Morris questionnaire - Brazil Roland-Morris. Braz J Med Biol Res. 2001;34:203–10.

    Article  CAS  PubMed  Google Scholar 

  8. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.

    Article  CAS  Google Scholar 

  9. Pontes-Silva A, Avila MA, Penha TFC, Gomes CAF de P, Dibai-Filho AV. The internal structure of Brazilian versions of disability questionnaires in patients with chronic low back pain: a cross-sectional study. Musculoskelet Sci Pract. 2022;60:102587.

  10. Staffini A, Fujita K, Svensson AK, Chung U-I, Svensson T. Statistical Methods for Item Reduction in a Representative Lifestyle Questionnaire: Pilot Questionnaire Study. Interact J Med Res. 2022;11:e28692.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Sharma H. How short or long should be a questionnaire for any research? Researchers dilemma in deciding the appropriate questionnaire length. Saudi J Anaesth. 2022;16:65.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sahlqvist S, Song Y, Bull F, Adams E, Preston J, Ogilvie D. Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial. BMC Med Res Methodol. 2011;11:62.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Davidson M. Rasch analysis of 24-, 18- and 11-item versions of the Roland-Morris Disability Questionnaire. Qual Life Res. 2009;18:473–81.

    Article  PubMed  Google Scholar 

  14. Stratford PW, Binkley JM. Measurement properties of the RM-18. A modified version of the Roland-Morris Disability Scale. Spine (Phila Pa 1976). 1997;22:2416–21.

    Article  CAS  Google Scholar 

  15. Williams RM, Myers AM. Support for a shortened Roland-Morris Disability Questionnaire for patients with acute low back pain. Physiother Can. 2001;53:60–6.

    Google Scholar 

  16. Stroud MW, McKnight PE, Jensen MP. Assessment of self-reported physical activity in patients with chronic pain: development of an abbreviated Roland-Morris disability scale. J Pain. 2004;5:257–63.

    Article  PubMed  Google Scholar 

  17. Takara KS, Alamino Pereira de Viveiro L, Moura PA, Marques Pasqual A, Pompeu JE. Roland-Morris disability questionnaire is bidimensional and has 16 items when applied to community-dwelling older adults with low back pain. Disabil Rehabil. 2022. https://doi.org/10.1080/09638288.2022.2096127. Ahead of print.

  18. Prinsen CAC, Mokkink LB, Bouter LM, Alonso J, Patrick DL, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1147–57.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Ferreira-Valente MA, Pais-Ribeiro JL, Jensen MP. Validity of four pain intensity rating scales. Pain. 2011;152:2399–404.

    Article  PubMed  Google Scholar 

  20. Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48:936–49.

    Article  PubMed  Google Scholar 

  21. Ullman J. Structural Equation Modeling: Reviewing the Basics and Moving Forward. J Pers Assess. 2006;87:35–50.

    Article  PubMed  Google Scholar 

  22. Brown T. Confirmatory Factor Analysis for Applied Research. New York: Guilford Publications; 2006.

    Google Scholar 

  23. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. MPR-online. 2003;8 May:23–74.

  24. Araujo GGC, Fidelis-de-Paula-Gomes CA, Pontes-Silva A, et al. Brazilian version of the Neck Bournemouth Questionnaire does not have a well-defined internal structure in patients with chronic neck pain. Clin Rehabil. 2021;35(12):1773–80. https://doi.org/10.1177/02692155211024034.

    Article  PubMed  Google Scholar 

  25. Barreto FS, Avila MA, Pinheiro JS, Almeida MQG, Ferreira C de SB, Fidelis-de-Paula-Gomes CA, et al. Less is More: Five-item Neck Disability Index to Assess Chronic Neck Pain Patients in Brazil. Spine (Phila Pa 1976). 2021;46:E688–93.

  26. Whittaker TA. Using the modification index and standardized expected parameter change for model modification. J Exp Educ. 2012;80:26–44.

    Article  Google Scholar 

  27. Stratford PW, Binkley J, Solomon P, Finch E, Gill C, Moreland J. Defining the minimum level of detectable change for the Roland-Morris questionnaire. Phys Ther. 1996;76:358–9.

    Article  Google Scholar 

Download references

Acknowledgements

We thank Dr. Fabíola Almeida and Nonato Alves, who kindly provided access to the clinic to evaluate the participants (in Buriticupu). We also thank all the participants who kindly volunteered for this research.

Funding

This work was partially supported by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), finance code 001. The funding source had no involvement in the study design, collection, analysis, interpretation of data, writing of the report, nor in the decision to submit the article for publication.

Author information

Authors and Affiliations

Authors

Contributions

NTF, CAFPG, CSS, MAA and AVDF designed the study; APS, JSP, SFCJ and GHSA collected the data; NTF, CAFPG, CSS, MAA and AVDF analyzed and interpreted of the data; All authors wrote the initial draft; All authors read and approved the final manuscript.

Corresponding author

Correspondence to Mariana Arias Avila.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Research Ethics Committee of the Universidade Federal do Maranhão (protocol number 3,408,949). All respondents participated in this study freely and signed an informed consent form.

Consent for publication

Not applicable.

Competing interests

AVDF and CAFPG are Associate Editors of the BMC Musculoskeletal Disorders. The other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Frota, N.T., Fidelis-de-Paula-Gomes, C.A., Pontes-Silva, A. et al. 15-item Roland-Morris Disability Questionnaire (RMDQ-15): structural and criterion validity on patients with chronic low back pain. BMC Musculoskelet Disord 23, 978 (2022). https://doi.org/10.1186/s12891-022-05953-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-022-05953-y

Keywords