- Research article
- Open Access
- Open Peer Review
Reliability and screening ability of the StarT Back screening tool in patients with low back pain in physiotherapy practice, a cohort study
BMC Musculoskeletal Disordersvolume 18, Article number: 232 (2017)
Low back pain (LBP) is the most common reported musculoskeletal disorder, with large prevalence numbers and high costs. Focus on early identification of patients at risk of developing chronic LBP has increased. The Keele Start Back Tool (SBT) is a questionnaire aiming at screening prognostic indicators in LBP patients, categorizing patients into risk-groups and guide treatment. The aim of this study was to explore the Norwegian version of the SBT with regard to reliability of the SBT-scoring and the screening ability in LBP patients in primary care physiotherapy.
LBP patients answered a package of questionnaires twice, with 1-3 days in between, containing SBT, Hannover functional ability questionnaire, pain intensity questions and demographics. The relative and absolute reliability of SBT was calculated using intraclass correlation coefficient (ICC) and the smallest detectable change respectively. Independent sample t-tests were used for group comparisons.
Fifty-two patients with LBP. Mean age (SD) was 45 (12) years and 62% were female. The ICC (95% CI) for SBT total score and psychosocial subscore was 0.89 (0.82, 0.94) and 0.82 (0.70, 0.90) respectively. None of the participants were allocated to the high risk group. The medium risk group reported significantly more pain last week and more activity limitations than the low risk group at both test and retest (0.001 ≤ p ≤ 0.003), whereas no significant difference between the groups was found on pain now (0.05 ≤ p ≤ 0.16).
The Norwegian version of the SBT was reliable and the screening ability was good as the subgrouping of patients into risk-groups reflected the severity of their back problems. The SBT may be an applicable and useful tool in physiotherapy practice.
Low back pain (LBP) is reported to be the most common musculoskeletal disorder, with large costs for patients and society . Life-time prevalence for LBP has been reported to be between 60 and 85% [2,3,4,5] and 34% of the participants in a large population study in Norway reported to have had LBP last week . Diagnosing LBP is challenging and the cause is often unclear. Due to the lack of diagnostic tests that can identify objective signs of the condition, most of the patients are characterized as having “non-specific LBP” [7, 8]. Most patients with acute LBP are reported to recover within 6 weeks, but symptoms remain in about 5 to10%, and this proportion is at risk for developing chronic LBP .
Several factors are shown to be associated with the risk of non-recovery from LBP, such as personal factors (age, gender, general health), work-related factors, radiating or widespread pain and psychosocial factors [5, 9,10,11,12,13,14,15]. Psychosocial factors are shown to be important indicators for chronicity and development of disability due to musculoskeletal pain . In the last decade, there has been an increased focus on early identification of patients at risk for developing persistent LBP. Different screening tools have been launched to facilitate identification of prognostic psychosocial factors, so-called “yellow flags”. An example is the Keele Start Back Tool (SBT) which is a brief questionnaire for screening prognostic indicators (both physical and psychosocial risk factors) for persistent, disabling back pain. Based on the SBT-scores, patients can be categorized into three subgroups: patients with low, medium or high risk for developing persistent LBP and activity limitations [17,18,19]. According to current treatment recommendations, the low risk group should receive minor attention from health professionals, and self-management strategies are recommended for these patients. The medium risk group should be offered physiotherapy, and for the high risk group more psychologically informed interventions are recommended [17, 18, 20].
The SBT subgroups may provide useful information for optimal allocation of patients to appropriate treatment. To be useful as a screening tool in physiotherapy practice, it is important that the SBT-scoring is reliable and that the allocation to risk groups reflects the severity of the patients’ back problems. We hypothesized that patients categorized as low risk should have less pain and less perceived activity limitations than patients categorized in the moderate or high risk groups. Further, we expected that few of the patients seeing physiotherapists in primary health care would be categorized into the high risk group. Thus, the aim of this study was to explore the Norwegian version of the SBT with regard to reliability and screening ability in LBP patients in primary care physiotherapy.
This paper is based on data from a larger study also examining clinical tests for LBP patients . Patients with LBP, treated by physiotherapists (PT) in Oslo (capital) and Hedmark (county), Norway, were invited to participate in the study by their PT. The only inclusion criterion was, besides seeking physiotherapy for LBP, age between 18 and 70 years old. Two PTs were responsible for the administration of the questionnaires and the clinical examinations, and 52 patients were consecutively recruited during 1 year (2014).
Each participant filled in the package of questionnaires and was examined clinically twice with 1 – 3 days in between. The present study is based only on data from the questionnaires. The questionnaires included demographic variables (gender, age, height, weight, work situation, daily activity level), pain intensity, now and last week (VAS, 0–10, where 10 is worst pain), as well as the SBT and the Hannover functional ability questionnaire (Hannover), which captures the patients’ perceived capability to perform daily activities . At retest, the patients were also asked if their back pain had changed since the last examination (answer alternatives: much better, better, the same, worse, much worse).
The SBT consists of 9 items; referred leg pain, comorbid pain, disability (2 items), bothersomeness, catastrophizing, fear, anxiety, and depression. All questions are answered by agree (1) or disagree (0), except the question regarding bothersomeness “Overall, how bothersome has your back been the last two weeks?” which is answered on a 5 point Likert scale with response alternatives: not at all (0), slightly (0), moderately (0), very much (1) and extremely (1) (bothersome). Hence, the total score range from 0 to 9, with 9 indicating worst prognosis. The last 5 items are summarized into a psychosocial subscale with 5 as the maximal score, indicating high risk for development of chronic LBP . Patients with total score between 0–3 are classified as low risk (minimal treatment, e.g. self-management strategies), those scoring a minimum of 4 points on total score of which a maximum of 3 items from the psychosocial risk factors are classified as medium risk (appropriate for physiotherapy management) and those scoring 4 or 5 on the psychosocial subscale are classified as high risk of poor prognosis regarding persistent disability (suitable for management with psychologically informed interventions) .
The Hannover questionnaire contains 12 questions about the ability to perform daily activities such as washing and drying one self, putting on socks, lifting objects, running, long time standing and longtime sitting . Each item is scored on a 3-point ordinal scale (0 = yes, can perform the task without difficulties, 1 = yes, can perform task with difficulties, 2 = no, can perform task only with help from others). A sum score of all items is made, reaching from 0 to 24, with 0 representing the ability to perform the tasks without difficulties and 24 representing not having the ability to perform the tasks without getting help. Magnussen and co-workers (2010) reported satisfactory psychometric properties of the Norwegian version of the Hannover questionnaire 
The study procedures were carried out according to the Helsinki Declaration and were approved by the Regional Committee for Medical Research Ethics, Norway (2013/2030). All participants gave written informed consents.
Descriptive data were used to characterize the study sample and presented as frequencies, percentages, or means with standard deviations (SD). The distribution of pain and activity limitations was presented for each SBT subgroup. Independent sample t-tests were used for group comparisons, and the results were presented with mean difference and 95% confidence interval (CI).
The relative reliability between the SBT scores at test and retest was calculated using intraclass correlation coefficient (ICC3,1) with 95% CI. We categorized the results as follows: ICC < 0.40 as poor reliability, 0.40 ≤ ICC < 0.75 as good reliability and ICC ≥ 0.75 as excellent reliability . Furthermore, Bland and Altman plots were used to evaluate limits of agreement between test and retest . The absolute reliability  was presented as the smallest detectable change (SDC) using the standard error of measurement SEM = SDdiff/√2 and the SDC = 1,96*√2 *SEM. SDC reflects the smallest change in score that can be interpreted as change above measurement error in an individual.
Patients were excluded from the test-retest analyses if they reported their back pain to be much better or much worse at retest.
Floor and ceiling effects for the SBT total score were measured by calculating the proportion of participants with scores within the measurement error from worst score (worst score - SDC) and best score (best score + SDC). A fraction of 15% or more was considered as floor or ceiling effect .
Internal consistency was measured by Cronbach’s alpha (α) for the total score and the psychosocial subscore. Poor internal consistency was defined as α < 0.7, item redundancy was defined as α < 0.9.
Data analysis was performed using SPSS version 22.0 (IBM Corp., New York, NY) and a 5% level of significance was used.
A total of 52 participants were included, 45 (SD 12) years old and 32 (62%) were women. Eleven percent with LBP in 12 weeks or less and 64% with LBP in more than 12 months, 48% worked full time (Table 1). Mean (SD) total score on the SBT was 2.9 (1.7) and 2.9 (1.8) on test and retest respectively, and similarly 0.9 (1.1) and 0.8 (1.1) for the psychosocial subscore. The patients were allocated into risk-groups based on the SBT-scores at the first test as follows: 31 (60%) low risk, 21 (40%) medium risk and none (0%) high risk.
Allocation into risk groups
The medium risk group reported significantly more pain last week and more activity limitations than the patients in the low risk group at both test and retest (0.001 ≤ p ≤ 0.003), whereas no significant difference between the groups was found on pain now at both test and retest (0.05 ≤ p ≤ 0.16) (Table 2). Since none of the participants were allocated to the high risk group, no comparison with this group could be made. The mean differences (95% CI) between the medium and low risk group for pain now, pain last week and function (Hannover) at the first test was 1.2 (0.0, 2.3), 1.9 (0.7, 3.1) and 4.8 (2.5, 7.0) respectively (Table 2).
Five participants (9.6%) reported their back pain to be much better or much worse on retest and were excluded from the reliability analyses.
The ICC3,1 (95% CI) for the SBT total score and psychosocial subscore was 0.89 (0.82, 0.94) and 0.82 (0.70, 0.90) respectively, showing that the relative test-retest reliability was excellent. Absolute reliability measured by SDC was 1.60 and 1.35 for the total score and the psychosocial subscore respectively. The Bland Altman plots revealed no systematic bias (Fig. 1).
Nineteen percent of the participants scored below 1.60 (0 + SDC) on total score, hence the measurement of their improvement could be hampered . None scored above 7.4 (9-SDC) on total score (i.e scoring of worsening could be hampered ). For the psychosocial subscore no floor or ceiling effects were found. Three (6.4%) and four (8.5%) participants scored 0 (lowest) on the SBT total score at test and retest respectively and none scored highest (9) (Fig. 2).
Chronbach’s alpha, (95% CI) for the total score and the psychosocial subscore was 0.51 (0.28 – 0.69) and 0.58 (0.37 – 0.74) respectively, hence the internal consistency was poor. We also performed if-item-deleted analyses, and found that for total score the removal of question 2 increased alpha to 0.61. No other question influenced the alpha. Furthermore, for the psychosocial subscore removal of question 5 increased alpha to 0.61. However, the corrected-item-total was low for both questions, -0.14 and 0.13 respectively.
In this study of patients with LBP in primary care physiotherapy practice, patients categorized as having medium risk for developing persistent LBP reported significantly more pain and activity limitations than patients categorized as having low risk. None of the participants were categorized as having high risk for developing persistent LBP and activity limitations. Further, the Norwegian version of the SBT was reliable.
The aims of treatment of LBP patients often include actions to reduce pain and to improve activities and participation . The difference in pain and activity limitations between the low and the medium risk groups supports the suggestions that the groups should be offered different treatment. No participants were allocated into the high risk group in this study, in contrast to what has been reported previously [19, 28, 29]. The reason for this may be that our participants were recruited from patients treated by physiotherapists (PT) in primary health care, while others have recruited patients from general practices (GP)  and from both GP and PT . According to Hill and Co-workers (2008), the high-risk group should be offered more psychologically informed interventions . Thus, a reason for the few high-risk patients included in this study can be that they have been referred to other health professionals or treatment alternatives than physiotherapy. It could also be that the physiotherapists failed or avoided to recruit the high risk patients. Unfortunately, we have no information to support this and we have no information regarding patients invited and declining to participate in the present study. Thus, the selection of participants may have been biased of reasons unknown to the researchers.
Previous studies have compared the SBT with the results from the original study  and the frequently used Roland Morris disability questionnaire , a validated instrument measuring performance of activities. It has been discussed whether it is most important to reveal the patients’ performance of a task, or his capability of performing the task or activity . The capability is considered to be influenced by the patients’ perceived self-efficacy or the belief that he really can perform the task. The Hannover questionnaire asks for the patients’ perceived ability to perform daily activities, which is useful information to physiotherapists for the screening of risk factors for persistent problems.
In contrast to previous studies [17, 28, 29], we found that in 19% of the participants in our study, the measurement of their improvement on the SBT total score could be hampered, since they already scored so close to the best score. However, our criterion on floor and ceiling effects was stricter than the criteria used in the mentioned studies. When using the same criteria (i.e. that 15% scoring the actual worst or best value)  we found that only 6.4% scored best (0) and none scored worst (9) on the SBT total score on test, indicating no floor or ceiling effects according to this criteria. Consequently, the SBT may have potential to measure both improvement and deterioration in this population. Cronbach’s alpha indicated poor internal consistency, and was lower than reported in the original SBT study . It is, however, not unusual that measurement tools perform better in the developmental study than in the following studies  and our results are in accordance with results from other studies [29, 34]. The if-item-deleted analysis showed only small effects on alpha, we found an increase from 0.51 (total score) and 0.58 (psychological subscore) to 0.61 on both scores. It has previously been suggested that due to low internal consistency, the psychosocial subscore could better be seen as an index of different psychosocial constructs than as one overall distress factor . However, this suggestion was not based on results from if-item-deleted analyses. Our findings appear to support this suggestion.
The total group of patients with LBP is heterogeneous and classification into subgroups is complicated. In a recent study exploring trajectories in LBP, the authors underline that LBP typically is characterized by episodic course, and reporting the duration of symptoms may therefore be difficult . In the present study, most of the participants (29, 62%) have had LBP for more than 1 year, and only 5 (11%) for less than 3 months. However, all participants were included when visiting physiotherapists for a new episode of back pain, and screening for yellow flags may be relevant also when patients have experienced episodes of LBP previously. Even though our sample included more patients with long-term LBP than previous studies of the SBT [17, 29, 30] the patients in our study are representative of the LBP patients treated by physiotherapists in primary care in Norway [36, 37]. This suggests that the SBT can be used on LBP patients in different phases of the condition.
Our study is hampered with some limitations. The number of participants can be seen as relatively low, and the statistical power is therefore limited. By including only the stable participants in the reliability analyses, the number was just below the recommendations of 50 participants for this type of methodological studies . However, previous studies on the SBT have larger numbers included in their study sample, but yet lower numbers in the test-retest analyses [29, 34]. Furthermore, the recruitment of patients from different geographical outpatient clinics as well as the wide inclusion criteria contributes to increase the external validity of the study. The heterogeneity among the patients concerning pain intensity, pain duration, pain distribution and sick leave makes them representative for LBP patients treated by physiotherapists in primary health care.
The short interval between test and retest increases the possibility of recall bias in the present study. However, as the study protocol included a diversity of clinical tests and questionnaires, the risk for recall bias have probably been moderate. On the other side, the short interval increased the chance that the patients’ condition was stable, which is crucial for the assessment of the reliability of an instrument. Furthermore, it was important to minimize the delay of the treatment startup for the participants.
The findings in this study indicate that the SBT is reliable and the screening ability was good as the subgrouping of patients into the different risk-groups reflected the severity of their back problems. Hence, the SBT may be an applicable and useful tool in physiotherapy practice both as a screening tool for yellow flags and also as tool to guide and assist the level of treatment for LBP patients.
Hannover functional ability questionnaire
Intraclass correlation coefficient
Low back pain
Keele start back tool
Smallest detectable change
Standard error of measurement
Visual analogue scale
Krismer M, van Tulder M. Strategies for prevention and management of musculoskeletal conditions. Low back pain (non-specific). Best Pract Res Clin Rheumatol. 2007;21(1):77–91. doi:10.1016/j.berh.2006.08.004.
Walker BF, Muller R, Grant WD. Low back pain in Australian adults: prevalence and associated disability. J Manipulative Physiol Ther. 2004;27(4):238–44. doi:10.1016/j.jmpt.2004.02.002.
Gross DP, Ferrari R, Russell AS, Battie MC, Schopflocher D, Hu RW, et al. A population-based survey of back pain beliefs in Canada. Spine (Phila Pa 1976). 2006;31(18):2142–5. doi:10.1097/01.brs.0000231771.14965.e4.
Hoy D, Brooks P, Blyth F, Buchbinder R. The Epidemiology of low back pain. Best Pract Res Clin Rheumatol. 2010;24(6):769–81. doi:10.1016/j.berh.2010.10.002.
Hoy D, March L, Brooks P, Blyth F, Woolf A, Bain C, et al. The global burden of low back pain: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73(6):968–74. doi:10.1136/annrheumdis-2013-204428.
Kamaleri Y, Natvig B, Ihlebaek CM, Bruusgaard D. Localized or widespread musculoskeletal pain: does it matter? Pain. 2008;138(1):41–6.
Deyo RA, Weinstein JN. Low back pain. N Engl J Med. 2001;344(5):363–70. doi:10.1056/nejm200102013440508.
Glenton C. Chronic back pain sufferers--striving for the sick role. Soc Sci Med. 2003;57(11):2243–52.
Grotle M, Brox JI, Veierod MB, Glomsrod B, Lonn JH, Vollestad NK. Clinical course and prognostic factors in acute low back pain: patients consulting primary care for the first time. Spine. 2005;30(8):976–82.
Hayden JA, Chou R, Hogg-Johnson S, Bombardier C. Systematic reviews of low back pain prognosis had variable methods and results: guidance for future prognosis reviews. J Clin Epidemiol. 2009;62(8):781–96.e1. doi:10.1016/j.jclinepi.2008.09.004.
Kamaleri Y, Natvig B, Ihlebaek CM, Benth JS, Bruusgaard D. Change in the number of musculoskeletal pain sites: A 14-year prospective study. Pain. 2009;141(1-2):25–30.
Kamaleri Y, Natvig B, Ihlebaek CM, Bruusgaard D. Does the number of musculoskeletal pain sites predict work disability? A 14-year prospective study. Eur J Pain. 2009;13(4):426–30.
Chou R, Shekelle P. Will this patient develop persistent disabling low back pain? JAMA. 2010;303(13):1295–302. doi:10.1001/jama.2010.344.
Grotle M, Foster NE, Dunn KM, Croft P. Are prognostic indicators for poor outcome different for acute and chronic low back pain consulters in primary care? Pain. 2010;151(3):790–7. doi:10.1016/j.pain.2010.09.014.
Hayden JA, Dunn KM, van der Windt DA, Shaw WS. What is the prognosis of back pain? Best Pract Res Clin Rheumatol. 2010;24(2):167–79. doi:10.1016/j.berh.2009.12.005.
Nicholas MK, Linton SJ, Watson PJ, Main CJ. Early identification and management of psychological risk factors ("yellow flags") in patients with low back pain: a reappraisal. Phys Ther. 2011;91(5):737–53. doi:10.2522/ptj.20100224.
Hill JC, Dunn KM, Lewis M, Mullis R, Main CJ, Foster NE, et al. A primary care back pain screening tool: identifying patient subgroups for initial treatment. Arthritis Rheum. 2008;59(5):632–41.
Hill JC, Dunn KM, Main CJ, Hay EM. Subgrouping low back pain: a comparison of the STarT Back Tool with the Orebro Musculoskeletal Pain Screening Questionnaire. Eur J Pain. 2010;14(1):83–9.
Betten C, Sandell C, Hill JC, Gutke A. Cross-cultural adaptation and validation of the Swedish STarT Back Screening Tool. Eur J Physiother. 2015;17(1):29–36. doi:10.3109/21679169.2014.1003962.
Magnussen LH, Lygren H, Anderson B, Breivik K, Strand LI. Validation of the Norwegian version of Hannover Functional Ability Questionnaire. Spine (Phila Pa 1976). 2010;35(14):E646–E53.
Engh L, Strand LI, Robinson HS, Tveter AT, Moseng T, Dagfinrud H. Back Performance Scale (BPS): Funksjonsvurdering av pasienter med ryggplager i primærhelsetjenesten. (Back Performance Scale: Assessment of patients with back problems in primary health care) Fysioterapeuten. 2015;82(9):22–7.
Hill JC, Whitehurst DG, Lewis M, Bryan S, Dunn KM, Foster NE, et al. Comparison of stratified primary care management for low back pain with current best practice (STarT Back): a randomised controlled trial. Lancet. 2011;378(9802):1560–71.
Fleiss JL. The design and analysis of clinical experiments. New York: John Wiley and Sons; 1986.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.
Overend T, Anderson C, Sawant A, Perryman B, Locking-Cusolito H. Relative and absolute reliability of physical function measures in people with end-stage renal disease. Physiother Can. 2010;62(2):122–8.
Davidson M, Keating JL. A comparison of five low back disability questionnaires: reliability and responsiveness. Phys Ther. 2002;82(1):8–24.
Waddell G. The Back Pain Revolution. 2nd ed. Edinburgh: Churchill Livingstone; 2004.
Luan S, Min Y, Li G, Lin C, Li X, Wu S, et al. Cross-cultural adaptation, reliability, and validity of the Chinese version of the STarT Back Screening Tool in patients with low back pain. Spine (Phila Pa 1976). 2014;39(16):E974–9. doi:10.1097/brs.0000000000000413.
Karstens S, Krug K, Hill JC, Stock C, Steinhaeuser J, Szecsenyi J, et al. Validation of the German version of the STarT-Back Tool (STarT-G): a cohort study with patients from primary care practices. BMC Musculoskelet Disord. 2015;16:346. doi:10.1186/s12891-015-0806-9.
Morso L, Kent P, Albert HB, Hill JC, Kongsted A, Manniche C. The predictive and external validity of the STarT Back Tool in Danish primary care. Eur Spine J. 2013;22(8):1859–67. doi:10.1007/s00586-013-2690-z.
Grotle M, Brox JI, Vollestad NK. Functional status and disability questionnaires: what do they assess? A systematic review of back-specific outcome questionnaires. Spine (Phila Pa 1976). 2005;30(1):130–40.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42. doi:10.1016/j.jclinepi.2006.03.012.
van der Windt D, Hay E, Jellema P, Main C. Psychosocial interventions for low back pain in primary care: lessons learned from recent trials. Spine (Phila Pa 1976). 2008;33(1):81–9. doi:10.1097/BRS.0b013e31815e39f9.
Piironen S, Paananen M, Haapea M, Hupli M, Zitting P, Ryynanen K et al. Transcultural adaption and psychometric properties of the STarT Back Screening Tool among Finnish low back pain patients. Eur Spine J. 2015. doi:10.1007/s00586-015-3804-6.
Kongsted A, Kent P, Axen I, Downie AS, Dunn KM. What have we learned from ten years of trajectory research in low back pain? BMC Musculoskelet Disord. 2016;17:220. doi:10.1186/s12891-016-1071-2.
Aure OF, Nilsen JH, Vasseljen O. Manual therapy and exercise therapy in patients with chronic low back pain: a randomized, controlled trial with 1-year follow-up. Spine (Phila Pa 1976). 2003;28(6):525–31. doi:10.1097/01.brs.0000049921.04200.a6. discussion 31-2.
Unsgaard-Tondel M, Fladmark AM, Salvesen O, Vasseljen O. Motor control exercises, sling exercises, and general exercises for patients with chronic low back pain: a randomized controlled trial with 1-year follow-up. Phys Ther. 2010;90(10):1426–40. doi:10.2522/ptj.20090421.
De Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in Medicine. New York: Cambridge University Press; 2011.
Gratitude is expressed to all physiotherapists that contributed to the recruitment of patients. We especially thank the physiotherapists Lisette Engh and Margrethe Kvia for handling the data collection.
The authors would like to thank the Norwegian Fund for Post-graduate Training in Physiotherapy for financial support through the FYSIOPRIM (Physiotherapy in Primary Health Care) project.
Both authors (HSR and HD) contributed in all parts of the process, from planning the study, assisting the data collection, analyses of data as well as writing up the paper. Both HSR and HD discussed the results and approved the final version of the manuscript.
The authors declare that they have no competing interests.
Availability of data and materials
Participating patients were not, at the time of recruitment, asked to sign a consent form regarding data availability, nor was an application for same made to the Regional Committee for Medical Research Ethics. Therefore, datasets generated and analyzed for this study are not publicly available. However, raw data is available from the corresponding author upon reasonable request.
Consent for publication
Ethics approval and consent to participate
The study procedures were carried out according to the Helsinki Declaration and were approved by the Regional Committee for Medical Research Ethics, Norway (2013/2030). All participants gave written informed consents.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.