Skip to main content

Reliability and validity of simplified Chinese version of the Italian spine youth quality of life questionnaire in adolescents with idiopathic scoliosis

Abstract

Background

The Italian Spine Youth Quality of Life (ISYQOL) questionnaire is used to evaluate health-related quality of life in adolescents with Idiopathic Scoliosis. The study aimed to undertake the process of cultural adaptation of the ISYQOL questionnaire into Simplified Chinese.

Methods

Translate from Italian into Simplified Chinese. It involved 138 adolescents whose Cobb angle ranged between 20 and 40 degrees, 50 wearing the brace and 88 not wearing the brace. Statistical analysis calculated the reliability, floor effects, and ceiling effects of the ISYQOL. After that, construct validity was measured by analyzing the ISYQOL relationship Scoliosis Research Society-22 patient Questionnaire (SRS-22).

Results

There were no floor or ceiling effects in the ISYQOL questionnaire. Cronbach’s alpha coefficient evaluated for Internal consistency was 0.75 in the no-treated group and 0.88 in the brace-treated group. Intraclass correlation coefficients assessed with the use of the test-retest method were 0.72 in the no-treated group and 0.80 in the brace-treated group. A strong relationship exists between the ISYQOL measure and SRS-22 scores (rho = 0.62; p < 0.01), reflecting the high validity of the questionnaires. Both ISYQOL and SRS-22 scores showed no statistical difference between groups wearing and not wearing the brace (p > 0.05).

Conclusions

Trans-cultural validation in Chinses language showed the reliability and validity of the ISYQOL.

Peer Review reports

Background

Adolescent Idiopathic Scoliosis (AIS) is a frequent pathology among adolescents, the prevalence of which is 1–2 % [1]. Scoliosis itself and its treatment, including bracing and surgery, may have a severe impact on the patient’s health-related quality of life (HRQOL) [2]. The need for a specific HRQOL measure in AIS has been recognized for a long time, which seems as essential as radiologic measurements in evaluating treatment effect [3]. As a way of measuring HRQOL, self-administered questionnaires have become the most commonly used means to assess the patients’ perspective of health. In 2017 Caronni et al. [4] proposed the ISYQOL questionnaire, which showed high measurement properties in Rasch analysis. Previously, several questionnaires such as Scoliosis Research Society-24 (SRS-24) and Scoliosis Research Society-22 (SRS-22) have been developed to evaluate HRQOL in spinal deformities, but have poor measurement properties. In previous work, the Rasch analysis has used to test SRS-22, a refinement of the SRS-24, in the item response theory (IRT) framework showing disordered thresholds, overall misfit, and ceiling effect [4, 5]. So ISYQOL questionnaire was developed as a new HRQOL measure. The original version was in Italian. The English version of the ISYQOL is simply the forward translation of the Italian one, and the subsequent stages of the forward- and back-translation process remain to be developed. Several research groups worldwide are already working on a proper translation of ISYQOL. Further research has found this questionnaire of adolescents with spinal deformities better than the SRS-22 questionnaire. ISYQOL showed high validity when used to measure HRQOL in adolescents with spinal deformities. Moreover, ISYQOL performs better than SRS22, having better known-groups validity and (contrary to SRS22) detecting the impact of disease severity on HRQOL [6], which seems to be the most widely used as a reference standard in the past [7]. ISYQOL was developed and validated in the Italian language. To be used in a different language-speaking population, it has to be subject to a process called trans-cultural validation [8]. The reliability and validity of self-administered questionnaires need to evaluate to make them suitable for research and clinical practice [9]. Simplified Chinese is the contemporary Chinese primarily used in mainland China, Singapore, and Malaysia. The study aimed to evaluate the reliability and validity of the Simplified Chinese version of the ISYQOL (SC-ISYQOL) in adolescents with idiopathic scoliosis.

Methods

Questionnaire

ISYQOL Questionnaire is a 20 Likert scale questionnaire and consisted of two domains (13 items of the spine health and 7 of the brace domains). Items in the spine health domain are about the condition of scoliosis, while items in the brace domain are about the impact of wearing a brace. The first version was designed to be administered to patients wearing the brace and consisted of both the spine health and brace domains (20 items). The second version designed to be distributed to patients not wearing the brace and consisted of the spine health domain only (13 items). Scoring of the ISYQOL planned as follows: Items investigating the presence of spine-related problems coded 0, 1, or 2 (0, never; 1, sometimes; 2, often). Items investigating the presence of positive thoughts coded 2, 1, or 0 (2, never; 1, sometimes; 0, often). The ISYQOL total score was obtained by adding up all single items, 40 in the brace-treated version, and 26 in the no-treated version. The ordinal ISYQOL total score could be converted to an interval measure (i.e., ISYQOL measure), which is expressed on a 0–100 % scale (with 100 % indicating the excellent quality of life). ISYQOL measure was a percentage making patients not wearing or wearing the brace comparable who filled in different versions of the questionnaire. SRS-22 comprises 5 domains (function, pain, self-image, mental health, and satisfaction/dissatisfaction) up to a total of 22 items. The score ranges from 1 to 5 points for each item, with a summary score between 22 and 110 [7]. Higher scores indicated better quality of life. In our study, we used Simplified Chinese validated version of SRS-22 (SC-SRS-22) [10, 11].

Translation

We followed widely accepted guidelines described by Guillemin for translation and cross-cultural adaptation of ISYQOL questionnaires [7, 8]. In the first stage, two independent translators converted the original Italian text into Simplified Chinese, whose native language is Italian. One of the translators, who had a medical background, was instructed on the whole process of adaptation. The other translator had no medical background and received no information on the project. The second stage consisted of a comparison of the original and two translated versions. During that stage, the two translators and the authors identified differences in translations and produced a combined version. In the third stage—the so-called reversed translation—two independent translators, who were native in Italy, translated the Simplified Chinese version into the language of the original document (Italian). The translators were not familiar with the original version. The objective of this stage was to assure the equivalence of the two versions and identify possible mistranslations. At the last fourth stage, a commission composed of a specialist in orthopedics, translators, a statistician, and a psychologist reviewed the translations without commitment to modify. As a result of consensus, the final version of the SC-ISYQOL was drafted.

Sample

The study took place from February 2019 to November 2019 with the approval of the local Hospital Ethics Committee. The patients’ sample split as follows: 1. with idiopathic scoliosis; 2. aged 10–18 years; 3. Cobb (the angle of curvature of the spine) 20–40 degrees; 4 without a history of spine surgery; 5.no-treated or brace-treated more than 3 months. At the end of the clinical visit, a dedicated research assistant administered the SC-ISYQOL questionnaire, which is the same version as the “final version SC-ISYQOL” mentioned above, and the SC-SRS-22 questionnaire to patients separately after obtaining patients and their guardians‘ consent. The research assistant was responsible for ascertaining the on-site completion of all questionnaire items by the participants during their office visits. Then they collected the questionnaire and entered it into the database. The study included 138 consecutive patients. To reduce the cost of the experiment, we invite part of the patients passing a random number to interview again after two weeks and fill out the questionnaire again. So that 70 patients had the test-retest using the same method. We set two weeks as the interval between the assessments based on previous research [12], which also mentioned the clinical status is unlikely to change appreciably in the absence of intervention during this time.

Statistical analysis

Statistical analysis performed using Statistics 26.0 software. Descriptive statistics used to calculate mean scores and standard deviations for a given question and a domain. The independent-sample t test used to compare the differences in QOL scores between the subgroups based on brace using. The two most important properties of reliability are consistency and stability. Internal consistency assessed using Cronbach’s alpha coefficient. A test-retest design was used to measure the temporal stability of the questionnaire with intraclass correlation coefficient (ICC). Construct validity was assessed by comparing the ISYQOL measure with SRS-22 through Spearman rank correlation coefficient (r) in total and the subgroups based on gender, age, and brace using.

For all tests, statistical significance was set at p < 0.05.

Results

The sample included 113 girls and 25 boys, whose mean age at the time of questionnaire administration was 13.7 years (± 2.3 years). The Cobb angle ranged between 21.1 and 38.5 degrees, and for demographic and clinical characteristics details, see Table 1.

Table 1 Participants’ demographics and clinical data

There are only 16 (0.6 %) missing items in all patients’ questionnaires, and we use mean to fill in missing values in this study. A dedicated research assistant ensures better questionnaire quality. The mean and standard deviation of ISYQOL and SRS-22 scores are presented in Table 2. Patients not wearing the brace only filled out the spine health domain. The mean score for ISYQOL was 9.4 (ranged between 1 and 20) in the no-treated group, while 14.2 (ranged between 2 and 33) in the brace-treated group. Both ISYQOL and SRS-22 scores showed no statistical difference between subgroups wearing and not wearing the brace (p > 0.05). There are no floor and ceiling effects in the ISYQOL questionnaire in both versions.

Table 2 Mean and standard deviation of ISYQOL and SRS-22 scores

The value of Cronbach’s alpha is presented in Table 3. In the no-treated group, Cronbach’s α coefficient was 0.75 in the spine health domain. In the brace-treated group, Cronbach’s α coefficient was 0.88, 0.85 in the spine health domain and 0.86 in the brace domain. All of them indicated good internal consistency reliability.

Table 3 The value of Cronbach’s alpha and Intraclass correlation coefficients (ICC)

Seventy (50.7 %) patients had the test-retested, including 61 girls and 9 boys, whose mean age was 13.7 years (± 2.1 years). There is no difference in demographic characteristics between these patients and overall. ICC assessed was 0.72 in the no-treated group and 0.80 in the brace-treated group. Both versions indicated good temporal stability [13].

ISYQOL measure (with 100 % indicating the excellent quality of life) converted by ISYQOL total score is possible to compare patients not wearing the brace (who fill 13 out of 20 items only) with wearing the brace (who fill the full questionnaire). The mean and standard deviation for the ISYQOL measure and SRS22 scores are presented in Table 4. The Spearman rho between ISYQOL measure and SRS-22 scores was 0.62 with a highly significant value (p < 0.01). The Spearman rho of subgroups were all with highly significative value, and see details in Table 4.

Table 4 The Spearman rho between ISYQOL measure and SRS-22 scores

Discussion

HRQOL in patients with a spine deformity decreased for several reasons, especially in adolescents [14, 15]. For example, AIS can lead to physical, psychological, and social impairments that eventually impact HRQOL [14]. Besides, conservative treatment of scoliosis with a rigid brace can be harmful to affect their QOL [16].

In this study, patients in the brace-treated group took X-rays both with and without the brace. We measured Cobb angle from X-rays without the brace, and strictly chose patients with Cobb angle ranging between 20 and 40 degrees, making the sample included in the study fitted the indications for braces for AIS. When evaluating the effect of brace treatment, the changes in the radiologic measurements and in the QOL must be considered [16]. In turn, QOL is closely related to patients’ compliance with brace treatment and depends on the conservative treatment effect [17, 18].

ISYQOL questionnaire designed to evaluate the HRQOL of adolescents with idiopathic scoliosis. Some papers perceived the need to use a disease-specific questionnaire Instead of a generic questionnaire [19,20,21]. From the total questionnaire score, 0 % of patients scored at the floor and 0 % scored at the ceiling, showing no floor and ceiling effects.

Cronbach’s alpha is the most commonly applied statistical parameter for showing the internal consistency of an instrument [22]. The SC-ISYQOL had a high value of Cronbach’s alpha coefficient (0.88 and 0.75), both the brace-treated and the no-treated groups, exceeding the minimum recommended value of 0.70 and indicating satisfactory internal consistency as a factor of acceptable reliability of the SC-ISYQOL.

Intraclass correlation coefficients(ICC)of the SC-ISYQOL assessed using of the test–retest method was 0.72 in the no-treated group and 0.80 in the brace-treated group, showing good temporal stability.

There are some questions designed for wearing the brace in the ISYQOL questionnaire. ISYQOL measure can convert scores to standard measurement, which is used to compare the total score of the no-treated and the brace-treated groups. It is suitable for evaluating the changes of HRQOL before and after brace treatment.

Criterion validity is the correlation of a scale with a valid, accepted universally acknowledged measure of the trait or disorder under study. The outcome measures for construct validity adopted the SRS-22, most widely used as a reference standard in the past, to evaluate the relationship with another patient-oriented questionnaire not focused on brace therapy. The results of the current study showed that a strong relationship existed between the ISYQOL measure and SRS-22 scores (rho = 0.62; p < 0.01), reflecting the high validity of the questionnaires. And get the same strong relationship in every subgroup (p < 0.01). This relationship was also found in the study by Caronni al. [6], with rho = 0.71 and p < 0 0.01.

There is no difference in HRQOL between the brace-treated group and the no-treated group, whether through the ISYQOL or the SRS-22. Earlier reports reported that braces affecting HRQOL may occur due to factors such as stiffness of brace [16], but it did not appear in this study. That may be related to the new-design brace applied in the hospital. The brace is light and custom-made by 3D printing, having good fit and comfort. No difference may also due to part-time brave wearing (16 h per day on average). Although the impact of the brace on HRQOL is dose-independent, other influencing factors (such as avoiding school wearing) mixed, so the conclusion cannot be drawn. Caution in the interpretation is needed. That is a cross-sectional study with a different sample of the 2 groups. This view needs to be followed up and compared by the same person’s QOL score before and after brace treatment. Perhaps the daily wear time is long enough, and the patient’s adaptation and acceptance of the brace will increase. It also needs to be confirmed by further research. There was also no statistical difference in gender and age, which may be related to the consistent disease situation.

The advantage to using the ISYQOL instead of SRS-22 or other questionnaires is that it included specific questions targeting patients who were using the brace [6]. In that way, the questionnaire is more targeted and individual. Thanks to the Rasch analysis, it is possible to compare the ISYQOL measure with other questionnaire scores even if they are different [4]. ISYQOL measure also used to compare the HRQOL of patients before and after using the brace, which is not in other questionnaires targeted to patients wearing the brace [4].

The weakness of ISYQOL is that it is not as widespread as the former questionnaires. There are limited versions in different languages and has not confirmed in a wide range of population [6].

In our study, there are limitations, such as the single clinical center available in the cross-cultural adaptation process. Further test will evaluate the reliability, construct validity, and responsiveness in the Rasch framework. The ISYQOL questionnaire needs to be promoted and applied in clinical and research, and multi-center cooperation has been obtained for further confirmation.

Conclusions

The culturally adapted Chinese version of the ISYQOL showed good reliability, high internal consistency, and satisfactory concurrent validity. This instrument is therefore useful as a clinical evaluation tool for Chinese scoliosis patients.

Availability of data and materials

Data can be shared upon contact with the correspondence author.

Abbreviations

ISYQOL:

Italian Spine Youth Quality of Life

SRS-22:

Scoliosis Research Society-22 patient Questionnaire

AIS:

Adolescent Idiopathic Scoliosis

HRQOL:

Health-related quality of life

SC-ISYQOL:

Simplified Chinese version of the ISYQOL

SC-SRS-22:

Simplified Chinese validated version of SRS-22

ICC:

Intraclass correlation coefficient

References

  1. 1.

    Willner S, Uden A. A prospective prevalence study of scoliosis in Southern Sweden. Acta Orthop Scand. 1982;53(2):233–7.

    CAS  Article  Google Scholar 

  2. 2.

    Tones M, Moss N, Polly DW. Jr. A review of quality of life and psychosocial issues in scoliosis. Spine (Phila Pa 1976). 2006;31(26):3027–38.

    Article  Google Scholar 

  3. 3.

    Haher TR, Gorup JM, Shin TM, Homel P, Merola AA, Grogan DP, et al. Results of the Scoliosis Research Society instrument for evaluation of surgical outcome in adolescent idiopathic scoliosis. A multicenter study of 244 patients. Spine (Phila Pa 1976). 1999;24(14):1435–40.

    CAS  Article  Google Scholar 

  4. 4.

    Caronni A, Sciume L, Donzelli S, Zaina F, Negrini S. ISYQOL: a Rasch-consistent questionnaire for measuring health-related quality of life in adolescents with spinal deformities. Spine J. 2017;17(9):1364–72.

    Article  Google Scholar 

  5. 5.

    Caronni A, Zaina F, Negrini S. Improving the measurement of health-related quality of life in adolescent with idiopathic scoliosis: the SRS-7, a Rasch-developed short form of the SRS-22 questionnaire. Res Dev Disabil. 2014;35(4):784–99.

    Article  Google Scholar 

  6. 6.

    Caronni A, Donzelli S, Zaina F, Negrini S. The Italian Spine Youth Quality of Life questionnaire measures health-related quality of life of adolescents with spinal deformities better than the reference standard, the Scoliosis Research Society 22 questionnaire. Clin Rehabil. 2019;33(8):1404–15.

    Article  Google Scholar 

  7. 7.

    Asher M, Min Lai S, Burton D, Manna B. The reliability and concurrent validity of the scoliosis research society-22 patient questionnaire for idiopathic scoliosis. Spine (Phila Pa 1976). 2003;28(1):63–9.

    Article  Google Scholar 

  8. 8.

    Guillemin F. Cross-cultural adaptation and validation of health status measures. Scand J Rheumatol. 1995;24(2):61–3.

    CAS  Article  Google Scholar 

  9. 9.

    Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–83.

    Article  Google Scholar 

  10. 10.

    Li M, Wang CF, Gu SX, He SS, Zhu XD, Zhao YC, et al. Adapted simplified Chinese (mainland) version of Scoliosis Research Society-22 questionnaire. Spine (Phila Pa 1976). 2009;34(12):1321–4.

    Article  Google Scholar 

  11. 11.

    Qiu G, Qiu Y, Zhu Z, Liu Z, Song Y, Hai Y, et al. Re-evaluation of reliability and validity of simplified Chinese version of SRS-22 patient questionnaire: a multicenter study of 333 cases. Spine (Phila Pa 1976). 2011;36(8):E545-50.

    Article  Google Scholar 

  12. 12.

    Lim JM, Goh TS, Shin JK, Kim DS, Lee CS, Lee JS. Validation of the Korean version of the Brace Questionnaire. Br J Neurosurg. 2018;32(6):678–81.

    Article  Google Scholar 

  13. 13.

    Mehta S, Bastero-Caballero RF, Sun Y, Zhu R, Murphy DK, Hardas B, et al. Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies. Stat Med. 2018;37(18):2734–52.

    Article  Google Scholar 

  14. 14.

    Freidel K, Petermann F, Reichel D, Steiner A, Warschburger P, Weiss HR. Quality of life in women with idiopathic scoliosis. Spine (Phila Pa 1976). 2002;27(4):E87–91.

    Article  Google Scholar 

  15. 15.

    Freidel K, Reichel D, Steiner A, Warschburger P, Petermann F, Weiss HR. Idiopathic scoliosis and quality of life. Stud Health Technol Inform. 2002;88:24–9.

    PubMed  Google Scholar 

  16. 16.

    Aulisa AG, Guzzanti V, Perisano C, Marzetti E, Specchia A, Galli M, et al. Determination of quality of life in adolescents with idiopathic scoliosis subjected to conservative treatment. Scoliosis. 2010;5:21.

    Article  Google Scholar 

  17. 17.

    Bunge EM, Habbema JD, de Koning HJ. A randomised controlled trial on the effectiveness of bracing patients with idiopathic scoliosis: failure to include patients and lessons to be learnt. Eur Spine J. 2010;19(5):747–53.

    Article  Google Scholar 

  18. 18.

    Landauer F, Wimmer C, Behensky H. Estimating the final outcome of brace treatment for idiopathic thoracic scoliosis at 6-month follow-up. Pediatr Rehabil. 2003;6(3–4):201–7.

    Article  Google Scholar 

  19. 19.

    Aprile I, Ruggeri AE, Savi Scarponi F, Illiano S, Foschini M, Vergili G, et al. Health-related quality of life in patients with adolescent idiopathic scoliosis after treatment: short-term effects after brace or surgical treatment, a comment. Eur Spine J. 2007;16(11):1962–3. author reply 4.

    CAS  Article  Google Scholar 

  20. 20.

    Padua R, Ceccarelli E, Aulisa AG, Pitta L, Aulisa L. Outcome of Harrington surgery for idiopathic scoliosis. SF-36 and Roland questionnaires assessment. Stud Health Technol Inform. 2002;88:404.

    CAS  PubMed  Google Scholar 

  21. 21.

    Padua R, Padua S, Aulisa L, Ceccarelli E, Padua L, Romanini E, et al. Patient outcomes after Harrington instrumentation for idiopathic scoliosis: a 15- to 28-year evaluation. Spine (Phila Pa 1976). 2001;26(11):1268–73.

    CAS  Article  Google Scholar 

  22. 22.

    Feise RJ, Donaldson S, Crowther ER, Menke JM, Wright JG. Construction and validation of the scoliosis quality of life index in adolescent idiopathic scoliosis. Spine (Phila Pa 1976). 2005;30(11):1310–5.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the patients who provided their time to participate in the study.

Funding

This work was supported by grants from the Young Scientists Fund of the National Natural Science Foundation of China (CN) (No. 2019NSFC81901822), Peking University Fund of Fostering Young Scholars’ Scientific & Technological Innovation (No. BMU2018PYB016) and Capital’s Fund for Health Development and Research (No. 2018-4-4097).

Author information

Affiliations

Authors

Contributions

SL, JL, NX, MY, YZ and ZL participated in the conception and design of the study. NX, SM, QW, CD and YD participated in the acquisition of data. SL, JL, NX and LZ participated in the analysis and interpretation of data. SL and JL wrote and revise the draft of the manuscript. All authors critically revised the manuscript for important intellectual content and approved the final version to be published.

Authors’ information

Not applicable.

Corresponding author

Correspondence to Nanfang Xu.

Ethics declarations

Ethics approval and consent to participate

Permission to perform the study was obtained from the Clinical Research Ethics Committee of the Peking University Third Hosiptal.

Consent for publication

Not applicable.

Comepting interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Liang, J., Xu, N. et al. Reliability and validity of simplified Chinese version of the Italian spine youth quality of life questionnaire in adolescents with idiopathic scoliosis. BMC Musculoskelet Disord 22, 568 (2021). https://doi.org/10.1186/s12891-021-04462-8

Download citation

Keywords

  • Quality of life
  • Adolescent idiopathic scoliosis
  • Cultural adaptation
  • Italian Spine Youth Quality of Life