Study protocol | Open | Open Peer Review | Published:
A risk assessment model for chronic ankle instability: indications for early surgical treatment? An observational prospective cohort – study protocol
BMC Musculoskeletal Disordersvolume 19, Article number: 225 (2018)
Chronic ankle instability (CAI) is a common result of an ankle sprain. Even though early surgical treatment yields the best results, overall only professional athletes are eligible for acute surgical stabilization. Treating all patients with early surgical stabilization leads to a high amount of unnecessary invasive interventions, as not all patients progress to CAI. If patients at risk of developing CAI can be identified, treatment policies may be applied more effectively and efficiently. The purpose of this study is to develop a risk assessment model to identify patients at risk for CAI that should receive early surgical treatment.
In this observational prospective cohort, all patients aged sixteen years and older, reporting at the emergency department of one of the participating hospitals after sustaining a lateral ankle sprain, and filled out 1 out of 3 follow-up questionnaires and the 1 year follow-up are included. A lateral and anteroposterior radiograph is made. Patients are excluded if a fracture or other pathology is present. The included patients receive four questionnaires, including questions focusing on the sprain, treatment and complaints, the Foot and Ankle Outcome Score and the Cumberland Ankle Instability Tool. A total of eleven radiographic variables are assessed for inter- and intra-observer reliability. Additionally, four factors extracted from the questionnaires, will be evaluated for correlation with CAI. Significantly correlating factors (e.a. risk factors) will be implemented in a risk assessment model. For the final model, based on sixteen variables with a minimum of 20 events per variable and a prevalence of 30–40% after an initial sprain, a sample size of 2370 patients is needed to perform both internal and external model validation.
This study will develop the first large scale model for the risk at CAI after an ankle sprain combining radiographic and patient characteristics. With this risk assessment model, patients at risk for CAI may be identified and properly informed on the treatment options. Patients identified as being at risk, may receive more adequate follow-up and become eligible for early surgical stabilization. This prevents patients from experiencing unnecessary long-lasting complaints, increasing the success rate of conservative and surgical treatment.
NCT02955485 [Registration date: 3–11-2016].
NTR6139 [Registration date: 3–1-2017].
Chronic ankle instability (CAI) is a worldwide common sports orthopaedic problem. It mainly results from a lateral ankle sprain, progressing in up to 30–40% of patients to CAI despite adequate initial treatment [1, 2]. It is mainly defined as persisting complaints of giving way, pain and recurrent ankle sprains for at least 12 months . Patients with CAI are generally eligible for surgery, whereas in the Netherlands in case of acute ankle instability mainly only professional athletes qualify for surgical stabilization [4, 5].
Repeatedly spraining the ankle, as occurs in patients with CAI, can have serious consequences such as damage to the ankle joint and osteoarthritis on the long term . When early surgical treatment is performed, it leads to better results compared to late surgical repair after both ruptures and ligament laxity . However, currently it cannot be adequately assessed which patients will not respond to conservative treatment and will develop CAI directly after an ankle sprain.
To determine who is eligible for early surgical treatment the contributing risk of prognostic factors should be determined. Many prognostic and risk factors for ankle sprains and ankle instability have been studied. Kobayashi et al.  wrote a critical review in 2014 outlining the many neuromuscular factors that have been studied and whether they are correlated to ankle instability. They concluded it was difficult to compare the findings as there was a lack of standardization for inclusion. Other factors that have been studied on their potential contribution to ankle instability are factors such as patient characteristics [9, 10], foot and ankle configuration [11,12,13,14,15], joint pathology [16,17,18] and treatment [19,20,21,22,23].
A large amount of factors associated with ankle sprains are of neuromuscular origin. An adequate rehabilitation program may help prevent progression to chronicity . Other factors, for example patient characteristics, foot and ankle configuration and joint pathology, are already present at time of the initial sprain. These factors will not be positively influenced by a functional training program in contrast to neuromuscular associated factors. A risk assessment model based on factors that cannot be changed by rehabilitation programs, using standardized inclusion criteria, may therefore provide a reliable risk analysis on the development of chronic complaints.
Aim of the study
To identify which patient characteristics and joint geometric factors are associated with development of CAI after an ankle sprain and subsequently develop and validate a risk assessment model to indicate which patients are at risk for developing CAI.
This level II observational prospective cohort study, executed in 4 different Dutch hospitals, will include all subsequent patients visiting the Emergency Department (ER) reporting for a first-time sustained ankle inversion injury. These patients will be asked to fill out a questionnaire at 2 weeks, 3-, 6- and 12 months after their ankle sprain of which only the 12 month follow-up questionnaire is mandatory to diagnose CAI.
The study design (Fig. 1) is in accordance to the principles of the Declaration of Helsinki (version 10, October 2013 by 64th WMA General Assembly, Fortaleza, Brazil) and in accordance with the Medical Research Involving Human Subjects Act of the Netherlands. The study is approved by the local institutional review board (IRB) of the Academic Medical Center (AMC) and Flevoziekenhuis (W16_258 # 16.303), the Slotervaart Medical Center (U/16.130/P1654) and the VU Medical Center (VUmc) (2016.541).
Study centres and participants
This study will be conducted at the ER of four Dutch hospitals: the AMC Amsterdam, Flevoziekenhuis Almere, Slotervaart Medical Center Amsterdam, VUmc Amsterdam. All subsequent patients that present themselves at the ER of one of the participating hospitals after an initial lateral ankle sprain will be treated according to standard protocol, including anamnesis, physical examination and (in case of positive Ottawa Ankle Rules (OAR)*) a radiograph . When a mortise view and lateral radiograph is made and negative for ankle fractures or other joint pathology, patients are screened for eligibility according to the in -and exclusion criteria (Table 1).
*The OAR are a requirement at the ER according to Dutch protocols to conclude whether there is an indication for a radiograph. However, in cases of severe LAS patients there is a high risk at false positive OAR despite the absence of a fracture (due to a painful lateral malleolus with or without the ability to bear weight).
Chronic ankle instability is defined as: The perception of ‘giving-way’, in combination with a history of recurrent ankle sprains, the sensation of ankle instability and persistent disabilisty (pain, swelling etc.) that has not resolved in the time-frame from the first initial sprain up to the 12-months follow-up [3, 25, 26].
All patients that sustained an (initial or recurrent) ankle sprain and of whom a mortise view and lateral radiograph is made, will be identified per ER of each participating hospital. These patients will be screened according to the in- and exclusion criteria (Table 1). All patients eligible for inclusion were approached for verbal informed consent. Patients are selected based on presentation at the ER. As these patients, out of the many patients who sustain an initial ankle sprain, experience severe enough complaints to actively reach out for help, these sprains may be regarded as ‘severe’ and therefore these patients may be more prone to persistent complaints. Also these patients can be monitored in case of a high risk of CAI in case of an initial sprain, as they have already been identified by the medical healthcare system, and radiographs have been made (according to standard protocol avoiding extra medical costs) which may be used to identify the size of the risk at CAI. All patients that were included and already suffered from recurrent ankle sprains, or CAI even, received the same follow-up as the patients who suffered from an initial sprain and were included in the sub-group analysis.
A legally required waiting period of two weeks is observed prior to asking consent and sending the questionnaires to the patient’s home address or email address. Patients are asked to fill out the first questionnaire immediately which gives a T0 (baseline measure at approximately two weeks after the initial sprain). The subsequent evaluation time points are T1 interim evaluation after three months, T2 after six months, and T3 at twelve months. The questionnaires contain questions about patient characteristics, previous ankle sprains, treatment, restrictions and complaints. Additionally the questionnaires contains the Foot and Ankle Outcome Score (FAOS) and the Cumberland Ankle Instability Tool (CAIT) to evaluate recovery. To ensure all patients with CAI are identified, one year after their ER visit they will be contacted, inquiring on persisting complaints and ankle instability. Patients that indicate on the first questionnaire they sustained ankle sprains prior to their ER visit will not receive further follow-up questionnaires, as these patients are considered to have CAI and therefore need no extra monitoring to identify whether they develop CAI or not. They will not be included in the primary analysis as this may lead to overfitting of the current model. Concomitant neuromuscular adaptations and additionally may follow a different rehabilitation route due to familiarity with the complaints.
In case of persisting complaints six months after the ER visit, patients will be eligible for surgical treatment according to Dutch standards. This is to avoid unnecessary invasive treatment on patients as a large proportion recover by means of conservative treatment .
Clinical outcome measures
The first outcome measure is the radiograph made at the ER. This radiograph will be assessed for nine bone geometric characteristics. These characteristics will be implemented in the model in case they show a correlation with developing CAI: ankle alignment using the medial distal tibial angle (MDTA) measured as (1) the absolute angle and whether this angle was considered a (2) varus (<87o), normal (87-91o) or valgus (>91o) position , fibular position in relation to the tibia measured as (3) projected distance and (4) relative distance , and tibiotalar contact ratio assessing the (5) talar height, (6) radius and (7) angle between the talus and tibia, (8) the angle representing the height of the medial malleolus and (9) the talar curvature (Figs. 2, 3 and 4) . Additionally (10) the Medial Malleolar Height Angle (MMHA) and (11) the Talar Convexity Angle (TCA)  (Figs. 5 and 6).
Secondly, (12) age, (13) sex, (14) height, (15) BMI and (16) sports intensity (by means of the Ankle Activity Index (AAI)) will be implemented in the model as important patient characteristics, in case of a significant correlation. All these variables have shown a (prospective or retrospective) correlation with ankle instability in previous research apart from MDTA, MMHA and TCA. These three, however, have shown a relation with other pathologies that also concern an inversion-plantarflexion trauma mechanism and will therefore be explored on a potential correlation with CAI [14, 16, 30].
To assess overall recovery and CAI at 12 months, a questionnaire including patient reported outcome measures (PROMs) will be used. This questionnaire includes the FAOS and CAIT. The FAOS is a Dutch validated questionnaire assessing pain, other symptoms (swelling, locking, mobility, stiffness), function (activities of daily living) and sports and foot- and ankle related quality of life divided over 5 subscales, with scores ranging from 0 to 100 [31, 32]. The CAIT is scale consisting of 9-items measuring the severity of functional ankle instability per ankle individually. The total score ranges from 0 to 30 with a cut-off value discriminating between a functionally stable and instable ankle of 11.5 points (as calculated for the Dutch population) [33, 34].
Inter- and intra-observer reliability
Two radiology residents, an orthopedic resident and an emergency physician of the AMC will be included in the inter- and intra-observer reliability assessment. These professionals are selected because the orthopedic surgeon eventually treats the patient with CAI, and the emergency physician is the first to see a patient at the ER after a severe ankle sprain and the radiologists assess the radiographs. Radiologists are most experienced in radiographic assessment and are therefore be considered as reference standard, i.e. to assess inter-observer reliability the measurements by the orthopedic resident and emergency physician are compared to the measurements performed by the radiology residents. To assess intra-observer reliability 39 radiographs are assessed twice by each observer with a minimum of 2 weeks in between. In order to prepare the reliability assessment a calibration session will be held with all observers. If this proves the measurements can be performed reliably they will be implemented in the other participating hospitals after a calibration meeting and practice session.
Prognostic value of variables
To determine whether the variables, selected from current literature, can be implemented in our model, it has to be determined whether they are of prognostic value on the progression of an ankle sprain to CAI. This will be done by determining whether they have an individual correlation with instability 12 months after an ankle sprain and whether this correlation is influenced using a multivariate analysis. In case of no existing correlation, factors are left out of the model and the sample size is recalculated accordingly.
The main objective of this study is to assemble the required data and subsequently construct a risk assessment model for the development of CAI after a first initial ankle sprain based on patient characteristics and the ankle joint geometric characteristics. This model is based on fourteen factors that are assessed using a mortise view and lateral radiographs and a questionnaire. The patient characteristics that are implemented in the model are age, sex, height, BMI and sports intensity. Even though BMI and sports intensity may be considered as modifiable, BMI reflects the current situation and sports intensity is the level a patient wishes to return to, additionally reflecting the risk at ankle sprain exposure. Additionally nine bone geometric characteristics are implemented in the model (See clinical outcome measures).
By comparing PROM scores over time, overall recovery will be assessed. In addition, the different treatments and symptoms during physical examination will be assessed for their relation to the functional outcome, as measured by the FAOS and CAIT and persisting complaints of instability. The final sub-analysis differentiates between the amount of recurrent ankle sprains prior to the initial ER visit to check whether the model is also applicable on patients that already suffer from CAI, as identified by the first questionnaire.
Sample size calculation
For the inter- and intra-observer reliability with an expected agreement of 80% with a relative error of 20%, a sample size of 39 patients is calculated. This sample of 39 will be a subsample from the cohort of the risk assessment model .
Assessment of agreement
Assessment of the prognostic value of the fourteen variables will be performed on the sample size of the internal validation . To avoid overfitting, the prognostic value of these 16 variables will be assessed when 10 events per variable (EPV) is reached . With a maximum of sixteen variables with a minimum of 10 events per variable, a prevalence of 30–40% after an initial sprain, including a 10% loss-to-follow-up, a sample size of 593 patients is needed to assess their prognostic value (Table 2).
PREDICT sample size
For a prognostic model at least 20 EPV is needed to optimize reliability and to avoid bias in regression coefficients [37,38,39]. Based on having maximally 16 variables with a minimum of 20 events per variable, a prevalence of 30–40% after an initial sprain, including a 10% loss-to-follow-up, a sample size of 1185 patients is needed to perform the internal and 1185 patients is needed to perform the external model validation, resulting in a total of 2370 patients (Table 2).
During the study the required sample size may change and will be recalculated accordingly in case one of the following scenarios occur:
In case one or more radiographic factors have a low inter- or intra-observer reliability (ICC ≤0.70), they will be excluded from the risk assessment model and the sample size will be recalculated using the new number of prognostic factors. If radiographic assessments cannot be performed in more than 2 cases (> 5%) a candidate predictor will be excluded, as the problem is likely to recur and therefore cannot be adequately assessed, now and during future assessment (e.g. up to 5% missing data is accepted) [40, 41].
In case of multicollinearity between (ICC > 0.70) between prognostic variables one will be excluded;
If a variable lacks agreement (ICC ≤0.70) with CAI it will be excluded;
In case the prevalence of CAI during the study differs from the estimated 30%. In case the percentage of patients progressing to CAI exceeds the 50%, the sample size calculation will be based on the number of non-events. The prevalence will be recalculated when 500, 750, 1000, 1250, 1500, 1750,2000 and 2250 patients have returned the last questionnaire to minimize patient burden, as inclusion will stop as soon as the minimal required sample size is reached.
Data analysis and statistics
Demographics of the study population will be analyzed using the descriptive statistics. All statistics will be performed with SPSS version 23.0 (SPSS Inc., Chicago, IL, USA) and R package ‘Stats’ version 3.3.3 (University of Auckland, Auckland, New Zealand). A p-value of < 0.05 is considered significant. Normality of data will be assessed using the Shapiro-Wilks test.
Inter- and intra-observer reliability
The inter- and intra-observer reliability will be analyzed using the Intraclass Correlation Coefficient (ICC) Two-Way Mixed model on absolute agreement in case of normally distributed data. Reliability is considered poor if the ICC is ≤0.40, moderate between 0.40 and 0.70, good between 0.70 and 0.90, and excellent > 0.90 . In case of skewed data the Cronbach’s alpha will be calculated. In case of an ICC of > 0.70 a Bland and Altman plot will be drawn to visualize the measurements and their relation to the limits of agreement.
Additionally the Standard Error of Measurement (SEM: SD x √(1-ICC)) and Minimum Detectable Change (MDC95%: 1.96 x √2 x SEM) \ will be calculated to objectify the ICC.
Prognostic value of variables
Depending on normality of data the Pearson or Spearman correlation coefficients will be used to assess correlations. A scatterplot for numerical data and Odds Ratio (OR) for binary data will be used to provide additional information on possible correlations in the data between prognostic factors. In case of correlations (p < 0.10 to avoid overfitting ) shown by an univariate analysis, a multivariate logistic regression will be performed to assess dependency between variables. The R2 will be used to visualize model fitness for the contribution of a factor to the progression to CAI and for the full model.
For internal validation a maximal amount of data is required to increase the reliability, therefore apparent validation will be used, including the full sample size of 1026 patients. To increase reliability the bootstrapping procedure will be used in the development of the model. A sample of 1000 bootstraps will be used to assess bias in the regression coefficients. Additionally the sensitivity, specificity and ROC curve will be used to assess the predictive value of the model.
To define generalizability of the created model, temporal validation is chosen to decide whether patients will be included in the internal or external validation database. After determining the prognostic value of the included variables, the full required sample size is calculated. Additionally the duration until this sample size will be reached, is estimated. Subsequently the time stamp for the temporal validation is decided. This ensures both sample sizes will be sufficient and reached. Again the sensitivity, specificity and ROC curve will be used to assess the suitability of the model .
Variables with a significant correlation with CAI (age, sex, height, BMI, sports intensity, varus/valgus alignment, fibular position, tibiotalar contact ratio, height medial malleolus and talar convexity), in addition to a continuous model, will be categorized to provide a binary model that can be easily implemented in daily practice by simply answering question by ‘yes’ or ‘no’. For this the Youden index and a ROC curve will be used . For both models the final objective is to create a model with cut-off values that advises surgery, watchful waiting or no surgical treatment by combining the scores with the patients expectations in the shared decision making process.
The cut-off values will be reflected to the MDC, SEM and MCID to ensure minimal measurement bias.
To assess overall recovery, mean and Standard Deviation (SD) of the functional outcome scores are calculated using the paired T-test. In case of skewed data the Wilcoxon signed rank test will be used instead, reporting the median and range.
To assess whether the received treatment affects functional outcome and/or the progression to CAI will be assessed. Depending on normality of data the Pearson’s or Spearman’s rho will be used.
Finally based on the amount of ankle sprains experienced prior to participation in this study, patients will be defined as suffering from an acute lateral ankle sprain (LAS) or CAI. The correlation coefficient of acute LAS and bone geometric factors, and CAI and bone geometric factors will be calculated using the Pearson’s or Spearman’s rho (depending on normality or skewed data). These correlation coefficients will be compared to see whether there is a difference in bone geometry between acute LAS or CAI patients.
A per protocol analysis is applied based on patients filling out at least one questionnaire and having an available AP and lateral radiograph for radiographic assessment. In case the last questionnaire is missing, on which the diagnosis of CAI will be based, and the question concerning persisting complaints at six or twelve months is not answered, differentiation between full recovery or progression to chronicity cannot be made. For this reason these patients and patients with a missing radiograph will be excluded.
No study-related adverse events are expected as the study contains an observational cohort with 1 set of radiographs made according to standard protocol.
Currently patients with CAI suffer for an unnecessary long period of time as they are unaware of treatment option and often are not eligible for direct surgical stabilization. By developing a risk assessment model tested for its validity, patients at risk may be identified and receive appropriate treatment. The current model is the first to address the progression to CAI on a large scale including both internal and external validation. Focusing on bone geometry, sex and height means focusing on factors patients cannot control despite their potential role in progressing to chronicity . As patients will want to return to their old level of sports, the additional inclusion of sports intensity reflects the risk of exposure to loading events that cause recurrent sprains. BMI and height, despite their strong correlation, are included as they both have been extensively described as a prognostic factor and should be included. However, as the inclusion of both factors will create bias, the factor with the strongest correlation with CAI will be included in the model.
In case of CAI, patients become eligible for surgical stabilization after 6 months of failed conservative treatment [4, 5]. Normally after an ankle sprain, it is assumed that the complaints will automatically resolve, and physicians lose track of the patients and thus do not have a proper follow-up. Patients that progress to CAI, unaware of treatment options, often experience complaints for unnecessary long period of time.
With a risk assessment model that has the potential to identify patients at risk for CAI, patients can be properly informed on treatment options prior to becoming chronic. Patients pre-identified as being at risk, may receive adequate follow-up . Additionally knowing about the potential course of complaints and treatment options, patients that still experience complaints after 6 months, and therefore progressed to chronic instability, can ensure they are seen by a physician on time. This way they can become eligible for relatively early surgical stabilization, not experiencing complaints for an unnecessary long period of time, in turn increasing the success rate of surgery .
By including only patients that visit the ER and of whom a radiograph is made due to positive OAR, only the ‘severe’ ankle sprains are included. For these patients persisting complaints are most expected. Additionally, these patients remain in the picture by the treating physicians and can therefore receive proper follow-up. However, the strictness of following the OAR per ER is unknown and this creates a selection bias because not all sprains, of which a radiograph is made, score positive on the OAR. Also patients that were already experiencing chronic complaints may be included. For this reason an extra analysis will be performed to assess how many patients already experience recurrent sprains and whether the model is also fitting for these patients. However, it can be argued that, if the prognostic model fits the patients that develop CAI, it should also fit the patients that have already progressed to CAI. Another possible limitation of this study is the unknown adequacy of the specific set of selected radiographic factors that will be implemented in this model. By means of a literature search multiple radiographic characteristics that may be correlated to CAI were identified. However, most were validated using weight-bearing radiographs, which cannot be made after sustaining a severe ankle sprain. For this reason, the subtalar and talar tilt angle are excluded from this study as these are dependent on a weight-bearing condition.
There is a rising demand for prognostic models that aid in risk analysis [43,44,45,46] and choice of treatment [44, 47,48,49]. Most models reflect the need of large study cohorts and multiple measurements over time [43, 47, 49]. However, sample size calculation and power analysis are often absent [44, 46, 49,50,51] or studies include a convenience sample based on the amount of retrospective data available [43, 45, 47]. This often leads to an imbalance between the number of studied predictive factors and the number of patients with the studied condition. Despite the claim of (internal and/or external) validity of the model, methods for validation are not described  or are absent . To ensure we would not encounter these problems, our sample size and methods are developed following state-of-the-art directions . Doing so, with a relatively heterogenic population, we anticipate to create a valid risk assessment model, based on easily identifiable factors and well suited for severe ankle sprain patients in clinical settings outside the current study settings. A valid risk assessment model may facilitate clinical decision making when a low or high risk at a certain disorder has been identified. This article may function as State-of-the-Art support for other researchers, interested in prognostic factors and in developing their own model to improve clinical practice.
Ankle activity index
Academic Medical Center
Body Mass Index
Chronic ankle instability
Cumberland ankle instability tool
Events per variable
Foot and ankle outcome score
Intraclass correlation coefficient
Institutional review board
Lateral ankle sprain
Medial distal tibial angle
Ottawa ankle rules
Patient reported outcome measure
Smallest detectable change
Smallest detectable change
First questionnaire two weeks after consent is received
Second questionnaire after 3 months
Third questionnaire after 6 months
VU Medisch Centrum
Pijnenburg A, Van Dijk C, Bossuyt P, Marti R. Treatment of ruptures of the lateral ankle ligaments: a meta-analysis. J Bone Joint Surg. 2000;82(6):761.
van Rijn RM, van Os AG, Bernsen RMD, Luijsterburg PA, Koes BW, Bierma-Zeinstra SM. What is the clinical course of acute ankle sprains? A systematic literature review. Am J Med. 2008;121:324–31.
Gribble PA, Bleakley CM, Caulfield BM, Docherty CL, Fourchet F, Fong DT, Hertel J, Hiller CE, Kaminski TW, McKeon PO, Refshauge KM, Verhagen EA, Vicenzino BT, Wikstrom EA, Delahunt E. 2016 consensus statement of the international ankle consortium: prevalence, impact and long-term consequences of lateral ankle sprains. Br J Sports Med. 2016.
Ferran NA, Oliva F, Maffulli N. Ankle instability. Sports Med Arthrosc. 2009;17(2):139–45.
Maffulli N, Ferran NA. Management of acute and chronic ankle instability. J Am Acad Orthop Surg. 2008;16(10):608–15.
Pihlajamaki H, Hietaniemi K, Paavola M, Visuri T, Mattila VM. Surgical versus functional treatment for acute ruptures of the lateral ligament complex of the ankle in young men: a randomized controlled trial. J Bone Joint Surg Am. 2010;92(14):2367–74.
Struijs PA, Kerkhoffs GM. Ankle sprain. BMJ Clin Evid. 2010;2010:1115–33.
Kobayashi T, Gamada K. Lateral ankle sprain and chronic ankle instability: a critical review. Foot Ankle Spec. 2014;7(4):298–326.
Hershkovich O, Tenenbaum S, Gordon B, Bruck N, Thein R, Derazne E, Tzur D, Shamiss A, Afek A. A large-scale study on epidemiology and risk factors for chronic ankle instability in young adults. J Foot Ankle Surg. 2015;54(2):183–7.
Linde F, Hvass I, Jurgensen U, Madsen F. Early mobilizing treatment in lateral ankle sprains. Course and risk factors for chronic painful or function-limiting ankle. Scand J Rehabil Med. 1986;18(1):17–21.
Milgrom C, Shlamkovitch N, Finestone A, Eldad A, Laor A, Danon YL, Lavie O, Wosk J, Simkin A. Risk factors for lateral ankle sprain: a prospective study among military recruits. Foot Ankle. 1991;12(1):26–30.
Mei-Dan O, Kahn G, Zeev A, Rubin A, Constantini N, Even A, Nyska M, Mann G. The medial longitudinal arch as a possible risk factor for ankle sprains: a prospective study in 83 female infantry recruits. Foot Ankle Int. 2005;26(2):180–3.
Yamamoto H, Yagishita K, Ogiuchi T, Sakai H, Shinomiya K, Muneta T. Subtalar instability following lateral ligament injuries of the ankle. Injury. 1998;29(4):265–8.
Van Bergeyk AB, Younger A, Carson B. CT analysis of hindfoot alignment in chronic lateral ankle instability. Foot Ankle Int. 2002;23(1):37–42.
Larsen E, Angermann P. Association of ankle instability and foot deformity. Acta Orthop Scand. 1990;61(2):136–9.
Hubbard TJ, Kramer LC, Denegar CR, Hertel J. Contributing factors to chronic ankle instability. Foot Ankle Int. 2007;28(3):343–54.
Choi WJ, Lee JW, Han SH, Kim BS, Lee SK. Chronic lateral ankle instability: the effect of intra-articular lesions on clinical outcome. Am J Sports Med. 2008;36(11):2167–72.
Hatch GF, Labib SA, Rolf RH, Hutton WC. Role of the peroneal tendons and superior peroneal retinaculum as static stabilizers of the ankle. J Surg Orthop Adv. 2007;16(4):187–91.
McKay GD, Goldie PA, Payne WR, Oakes BW. Ankle injuries in basketball: injury rate and risk factors. Br J Sports Med. 2001;35(2):103–8.
Konradsen L, Bech L, Ehrenbjerg M, Nickelsen T. Seven years follow-up after ankle inversion trauma. Scand J Med Sci Sports. 2002;12(3):129–35.
Evans GA, Hardcastle P, Frenyo AD. Acute rupture of the lateral ligament of the ankle. To suture or not to suture? J Bone Joint Surg Br. 1984;66(2):209–12.
Moller-Larsen F, Wethelund JO, Jurik AG, de Carvalho A, Lucht U. Comparison of three different treatments for ruptured lateral ankle ligaments. Acta Orthop Scand. 1988;59(5):564–6.
Guillodo Y, Simon T, Le Goff A, Saraux A. Interest of rehabilitation in healing and preventing recurrence of ankle sprains. Ann Phys Rehabil Med. 2013;56(7–8):503–14.
van Dijk CN, Lim LS, Bossuyt PM, Marti RK. Physical examination is sufficient for the diagnosis of sprained ankles. J Bone Joint Surg Br. 1996;78(6):958–62.
Karlsson J, Lansinger O. Lateral instability of the ankle joint. Clin Orthop Relat Res. 1992;276:253–61.
Delahunt E, Coughlan GF, Caulfield B, Nightingale EJ, Lin CWC, Hiller CE. Inclusion criteria when investigating insufficiencies in chronic ankle instability. Med Sci Sports Exerc. 2010;42(11):2106–21.
Stufkens SA, Barg A, Bolliger L, Stucinskas J, Knupp M, Hintermann B. Measurement of the medial distal tibial angle. Foot Ankle Int. 2011;32(3):288–93.
Berkowitz MJ, Kim DH. Fibular position in relation to lateral ankle instability. Foot Ankle Int. 2004;25(5):318–21.
Frigg A, Frigg R, Hintermann B, Barg A, Valderrabano V. The biomechanical influence of tibio-talar containment on stability of the ankle joint. Knee Surg Sports Traumatol Arthrosc. 2007;15(11):1355–62.
Tümer N, Blankevoort L, van de Giessen M, Terra MP, de Jong PA, Weinans H, Tuijthof GJ, Zadpoor AA. Bone shape difference between control and osteochondral defect groups of the ankle joint. Osteoarthr Cartil. 2016;24(12):2108-15.
Sierevelt IN, Beimers L, van Bergen CJ, Haverkamp D, Terwee CB, Kerkhoffs GM. Validation of the Dutch language version of the foot and ankle outcome score. Knee Surg Sports Traumatol Arthrosc. 2014;23(8):2413-9.
van den Akker-Scheek I, Seldentuis A, Reininga IH, Stevens M. Reliability and validity of the Dutch version of the foot and ankle outcome score (FAOS). BMC Musculoskelet Disord. 2013;14:183.
Hiller CE, Refshauge KM, Bundy AC, Herbert RD, Kilbreath SL. The Cumberland ankle instability tool: a report of validity and reliability testing. Arch Phys Med Rehabil. 2006;87(9):1235–41.
Vuurberg G, Kluit L, van Dijk CN. The Cumberland ankle instability tool (CAIT) in the Dutch population with and without complaints of ankle instability. Knee Surg Sports Traumatol Arthrosc. 2016;26(3):882-91.
Gwet KL. Handbook of inter-rater reliability. 4th ed. Gaithersburg: Advanced Analytics; 2012.
Steyerberg EW. Clinical Prediction Models. In: Gail M, et al., editors. Statistics for Biology and Health. New York: Springer; 2009. p. 508.
Pavlou M, Ambler G, Seaman SR, Guttmann O, Elliott P, King M, Omar RZ. How to develop a more accurate risk prediction model when there are few events. BMJ. 2015;351:h3868.
Ogundimu EO, Altman DG, Collins GS. Adequate sample size for developing prediction models is not simply related to events per variable. J Clin Epidemiol. 2016;76:175-82.
Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–9.
Royston P, Moons KG, Altman DG, Vergouwe Y. Prognosis and prognostic research: developing a prognostic model. BMJ. 2009;338:b604.
de Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59(10):1033–9.
Hertel J. Functional anatomy, Pathomechanics, and pathophysiology of lateral ankle instability. J Athl Train. 2002;37(4):364–75.
Lammers RJ, Hendriks JC, Rodriguez Faba OR, Witjes WP, Palou J, Witjes JA. Prediction model for recurrence probabilities after intravesical chemotherapy in patients with intermediate-risk non-muscle-invasive bladder cancer, including external validation. World J Urol. 2016;34(2):173–80.
Kerkhof HJ, Bierma-Zeinstra SM, Arden NK, Metrustry S, Castano-Betancourt M, Hart DJ, Hofman A, Rivadeneira F, Oei EH, Spector TD, Uitterlinden AG, Janssens AC, Valdes AM, van Meurs JB. Prediction model for knee osteoarthritis incidence, including clinical, genetic and biochemical risk factors. Ann Rheum Dis. 2014;73(12):2116–21.
Vergeldt TF, van Kuijk SM, Notten KJ, Kluivers KB, Weemhoff M. Anatomical cystocele recurrence: development and internal validation of a prediction model. Obstet Gynecol. 2016;127(2):341–7.
Takahashi H, Nakajima M, Ozaki K, Tanaka T, Kamatani N, Ikegawa S. Prediction model for knee osteoarthritis based on genetic and clinical information. Arthritis Res Ther. 2010;12(5):R187.
de Punder YM, Jansen TL, van Ede AE, den Broeder AA, van Riel PL, Fransen J. Personalizing treatment targets in rheumatoid arthritis by using a simple prediction model. J Rheumatol. 2015;42(3):398–404.
Clarke MG, Kennedy KP, MacDonagh RP. Development of a clinical prediction model to calculate patient life expectancy: the measure of actuarial life expectancy (MALE). Med Decis Mak. 2009;29(2):239–46.
Maempel JF, Clement ND, Brenkel IJ, Walmsley PJ. Range of movement correlates with the Oxford knee score after total knee replacement: a prediction model and validation. Knee. 2016;23(3):511–6.
Wilkerson GB, Colston MA. A refined prediction model for Core and lower extremity sprains and strains among collegiate football players. J Athl Train. 2015;50(6):643–50.
Kim YS, Lim HK, Park MJ, Rhim H, Jung SH, Sohn I, Kim TJ, Keserci B. Screening magnetic resonance imaging-based prediction model for assessing immediate therapeutic response to magnetic resonance imaging-guided high-intensity focused ultrasound ablation of uterine fibroids. Investig Radiol. 2016;51(1):15–24.
First of all special thanks to Gabrielle Tuijthof (Hogeschool Zuyd) and Nazli Sarkalkan (TU Delft) for their help in defining the MMHA and TCA. Furtermore the authors acknowledge the contribution of Prof. R. de Vos, drs. W.M.T. Goddijn and dr. J.J. Stunt (Clinical Epidemiologists AMC), for helping with the methods and improving the set-up of the prognostic model and dr. M.W. Heijmans (Epidemiologist and Biostatician VUmc) and dr. R. Holman (Statistical Advisor Clinical Research Unit AMC).
Availability for data and materials
The datasets used and analysed during the current study will be available from the corresponding author on reasonable request.
Ethics approval and consent to participate
IRB approval has been obtained from the IRB of the AMC for the AMC and Flevoziekenhuis (W16_258 # 16.303), the Slotervaart Medical Center (U/16.130/P1654), the VUmc (2016.541).
The IRB provided a waiver for requesting written informed consent as this study concerns an observational cohort only including questionnaires. For use of the radiographs verbal informed consent was declared sufficient by the local IRB and legal department.
Consent for publication
Dr. Haverkamp is a member of the Editorial Board of BMC Musculoskeletal Disorders.
Dr. ir. L. Blankevoort has (pending) Zimmer-Biomet and Smith&Nephew research grants.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.