Skip to main content

Development of the intelligent knee osteoarthritis lifestyle app: a person-based approach

Abstract

Background

Knee osteoarthritis is one of the most prevalent long term health conditions globally. Exercise and physical activity are now widely recognised to significantly reduce joint pain, improve physical function and quality of life in patients with knee osteoarthritis. However, prescribed exercise without regular contact with a healthcare professional often results in lower adherence and poorer health outcomes. Digital mobile health (mHealth) technologies offer great potential to support people with long-term conditions such as knee osteoarthritis more efficiently and effectively and with relatively lower cost than existing interventions. However, there are currently very few mHealth interventions for the self-management of knee osteoarthritis. The aim of the present study was to describe the development process of a mHealth app to extend the support for physical activity and musculoskeletal health beyond short-term, structured rehabilitation through self-management, personalised physical activity, education, and social support.

Methods

The development of the intelligent knee osteoarthritis lifestyle application intervention involved an iterative and interconnected process comprising intervention ‘planning’ and ‘optimisation’ informed by the person-based approach framework for the development of digital health interventions. The planning phase involved a literature review and collection of qualitative data obtained from focus groups with individuals with knee osteoarthritis (n = 26) and interviews with relevant physiotherapists (n = 5) to generate ‘guiding principles’ for the intervention. The optimisation phase involved usability testing (n = 7) and qualitative ‘think aloud’ sessions (n = 6) with potential beneficiaries to refine the development of the intervention.

Results

Key themes that emerged from the qualitative data included the need for educational material, modifying activities to suit individual abilities and preferences as well as the inclusion of key features such as rehabilitation exercises. Following a user-trial further changes were made to improve the usability of the application.

Conclusions

Using a systematic person-based, development approach, we have developed the intelligent knee osteoarthritis lifestyle application to help people maintain physical activity behaviour. The app extends the support for physical activity and musculoskeletal health beyond short-term, structured rehabilitation through personalised physical activity guidance, education, and social support.

Peer Review reports

Background

It is estimated that more than 240 million people globally are affected by osteoarthritis (OA) [1] which limits people’s daily activities [2] leading to physical disability and impairing quality of life [3]. The condition can affect almost any joint, but OA of the knee and hip are among the most common and debilitating conditions [1, 4]. People with knee osteoarthritis (KOA) suffer with pain, stiffness and joint dysfunction and consequently are more sedentary and have more comorbidities than those without [3, 5]. Because of this, exercise and physical activity (PA) is widely recommended and has been shown to significantly reduce pain, improve physical function and quality of life in those with KOA [5,6,7,8].

Unfortunately, there are numerous barriers to PA amongst people with KOA including pain and functional limitations, a lack of knowledge regarding the effects of exercise and a lack of social/professional support [9]. Whilst prescribed exercise can negate some barriers, the beneficial effects of exercise interventions decline after individuals cease activity [10], which is problematic, as exercise prescription without regular contact with a healthcare professional often results in decreasing adherence and poorer health outcomes [11, 12]. In response to this problem, a range of interventions have been developed to maintain exercise adherence including face to face booster sessions, telephone sessions, community walking and group rehabilitation programmes [13,14,15].

A number of digital interventions using electronic health (eHealth) and mobile health (mHealth) technologies have also been developed for KOA [16, 17] which offer great potential to deliver interventions more efficiently, effectively and with relatively lower costs compared to more traditional face-to-face care [18, 19]. However, it is recognised that to enhance the likelihood of longer-term success, these technologies should be based on empirical behavioural theory [20] and adopt a person-based approach to development to ensure they meet the needs of target users [21, 22].

To date, the majority of mHealth apps for KOA have tended to focus on areas such as mobile assessment (related symptoms and pain), measurement (for joint range) as well as motion monitoring tools (gait and exercises) [23] with only a few focusing on specific elements of lifestyle management [24, 25]. To our knowledge, there are no mHealth apps that combine personalised PA plans, education, and social support in a single application. The aim of the present study was to develop and optimise a novel digital app-based intervention for the self-management of KOA with target users. Accordingly, this paper describes the development process of a theory-, evidence- and person-based mHealth app to extend the support for PA and musculoskeletal health beyond short-term, structured rehabilitation through personalised PA, self-management, education, and social support.

Methods

The development of the intelligent Knee Osteo-Arthritis Lifestyle App (iKOALA) intervention involved an interconnected 2-stage process comprising intervention ‘planning’ and ‘optimisation’ which was informed by the person-based approach (PBA) framework for the development of digital health interventions [22]. Briefly, the PBA is an intervention development framework that places the intended target user at the centre of the research so that their life context and any barriers to engagement with the app or the behaviours it endorses are recognised and addressed in the design of the intervention. The objective of the PBA is to maximise the usability, motivation, and ultimately benefit of the intervention.

In the present study the ‘planning’ phase of the PBA involved collecting data from a range of sources including a literature review and primary qualitative data obtained from focus groups with individuals with KOA and interviews with physiotherapists to generate ‘guiding principles’ for the intervention (Fig. 1). The ‘optimisation’ phase involved usability testing and qualitative ‘think aloud’ sessions with potential beneficiaries to refine the development of the intervention. In reporting this user-centred development process, we also followed the Guidance for Reporting Involvement of Patients and the Public (GRIPP2, see Supplementary file) and associated checklist [26]. Ethical approval for the study was provided by the Department for Health Research Ethics Committee (REACH) at the University of Bath (Ref: EP 18/19 080).

Fig. 1
figure 1

Overview of the iKOALA intervention development process based on the PBA

Intervention planning

Evidence and theory

A scoping review was undertaken to establish the evidence and theory relating to (i) the efficacy and safe implementation of exercise for individuals with KOA and (ii) the current digital interventions available for KOA management in the United Kingdom, to determine any unmet needs in these interventions. A literature search was undertaken using PubMed, Medline and EMBASE up until the 31st of December 2018. Sources consulted included original research articles, reviews, position stands and meta-analyses in the academic literature. The key search terms used were “knee osteoarthritis”, “physical activity” and “management” and “osteoarthritis” and “electronic” and “management” from 2005 to 2018. Only human studies written in English were included in the search. The articles included in this review aimed to identify the key literature on the subject, however this was not a full systematic review.

The theoretical basis for the iKOALA intervention drew from Self-Determination Theory [27]. SDT propagates that conditions that support the needs for autonomy (i.e., the need to feel volitional control over one’s behaviour), competence (i.e., the need to feel mastery over tasks or behaviours) and relatedness (i.e., the need to feel connected to others) will lead to higher quality internalised forms of motivation, better engagement with health behaviours and improved wellbeing [28]. Recent evidence from SDT that informed the iKOALA guiding principles comes from the Motivation, Engagement and Thriving in User Experience (METUX) model that champions the importance to satisfy the basic needs at various spheres of user interaction, namely the decision to sign-up to an app, the set-up process, the interface and the behaviours the app promotes [29]. We also draw from the motivational behaviour change techniques that endorses strategies for supporting the basic needs [30], such as offering choice, provision of meaningful rationale and informational (rather than prescriptive) feedback for autonomy, facilitating positive social support, and using empathetic respective language for relatedness, and using graded-tasks, optimising challenge, and self-monitoring for competence.

A final guiding framework was the COM-B model, which stipulates that behaviour is a product of not only motivation (which we target using SDT) but also the induvial opportunity and capability to undertake the desired behaviours [31]. Accordingly, we recognise the importance of tailoring any advice and motivational support to the individual physical and psychological capabilities of the user by understanding limits to their pain and physical function and providing clear instructions on how to exercise. We also acknowledge the importance of ensuring recommendations of a digital solution account for the physical and social opportunities of users, for example by accounting for time, money and access issues, and the preferences towards social or individual activities.

Focus groups

Four focus group were conducted with individuals diagnosed with KOA to gain a deeper understanding of the impact of living with OA and the needs of those wishing to maintain safe and appropriate exercise and PA. Participants were recruited through the University of the Third Age (https://www.u3a.org.uk/) as well as through social media advertising. All trial participants were deemed eligible if they had a diagnosis of KOA which was not caused by an acute knee injury. Participants included individuals with varying degrees of OA from those who had not engaged in any formal treatment for KOA to those who had undergone knee replacement surgery. All participants provided written informed consent to participate in the study.

Focus groups, led by members of the research team were semi-structured in nature, using digital polling software (https://www.turningsolutions.com) along with pre-determined questions to stimulate group discussion. Focus groups 1a (n = 9) and 1b (n = 7) (led by MW and EC) were conducted at the University of Bath, England in November of 2018 with the aim of gaining a better understanding of the general attitudes to KOA, the approach to, and views of PA and self-management and the views on using digital technologies for KOA management. Focus groups 2a (n = 6) and 2b (n = 4) (led by EC and SJ) were conducted between July and November 2020 at the University of Bath with the aim of focusing on the features that should be included in a self-management app for KOA, including what activities should be incorporated, how the intervention could accommodate a range of physical capabilities, and how the intervention could support motivation to maintain PA. Focus groups were audio or video recorded with prior consent and subsequently transcribed verbatim.

Individual interviews

Individual qualitative interviews with physiotherapists were conducted at several locations in Bath, between February and April 2020. Individuals were recruited through social media advertising. All participants provided written informed consent to participate in the study. To be eligible to participate, individuals were required to be a practicing chartered physiotherapist with experience of treating individuals with KOA. Physiotherapists were from a range of backgrounds, including working within the National Health Service (NHS) as well as in private practice. Interviews were conducted by a member of the research team (EC or SJ) and were semi-structured in nature using a set of pre-determined questions. The interviewer explained to participants that we were interested in developing a smartphone app to support individuals with KOA to enhance and/or maintain PA.

The aim of these interviews was to gain a better understanding of how physiotherapists approached promoting, recommending, and adapting exercises and physical activities for patients with KOA. Through the interview we aimed to determine if there were any guiding principles, common approaches or decision making processes for the management of KOA. This included the physiotherapists being shown 4 broad categories of PA along with a number or exercises associated with those categories. These were: mind/body (yoga, tai chi, gardening), sports (tennis, lawn bowls, golf, walking football), dance (line dancing, Zumba, exergaming) and cardiovascular exercise (Nordic walking, jogging, rowing, cycling, swimming). Participants were asked to select an activity from each category and describe how they would determine if the activity was suitable for the patient whilst at the same time considering any physical (physical function, pain severity, current activity level, contraindications to exercise) and psychosocial (emotional wellbeing, social support, confidence to self-manage, access to resources, understanding of diagnosis/treatment) factors. Finally, participants were asked which features they would want to see in an app to support engagement in PA and what might motivate them to use such an app with patients. Individual interviews were audio or video recorded, with prior consent and transcribed verbatim.

Development of intervention guiding principles

The development of intervention guiding principles is a core component of the PBA [32]. These guiding principles seek to highlight solutions (features or design objectives) that the intervention should incorporate to overcome any challenges to engagement on the part of target users. In this study, the guiding principles were developed iteratively from the theoretical and empirical literature along with qualitative data generated from user focus groups and individual interviews with physiotherapists.

Intervention optimisation

User trial

In January 2021, a 3-week user trial of the iKOALA intervention commenced with the aim of gaining feedback on the most up-to-date version of the iKOALA intervention. Participants were recruited from the previous focus groups where individuals indicated they would be interested in taking part in further research having given their consent to be recontacted. To be eligible participants were required to be aged 45 years or older, have experienced chronic knee pain for a period of three months or longer or been diagnosed radiographically or clinically with knee OA by a clinician, and not had knee pain primarily arising from an acute knee injury. Finally, participants must not have had any other condition, or a treatment related to another condition that prevented them from participation in PA.

Each participant was provided with a PA tracker (Fitbit Inspire HR, Fitbit, USA) and a smartphone (Samsung A10, Samsung, Korea) with version 10 operating system with both the Fitbit and iKOALA applications pre-installed on the device. Participants were asked to create accounts for the Fitbit and iKOALA app and to link the two through the settings function in iKOALA. Participants were then instructed to complete the iKOALA PA questionnaire which consisted of a series of questions with nominal answers relating to their current level of PA and PA preferences:

  1. 1.

    How would you describe your level of PA?

  2. 2.

    Have you experienced any falls or serious difficulties with your balance?

  3. 3.

    Would you like to perform PA by yourself or in a group, at home or away from home, indoors or outdoors?

  4. 4.

    Would you prefer to organise your own group activities or attend instructor led classes?

  5. 5.

    Would you be happy to perform activities that may involve some cost?

  6. 6.

    Would you be happy to buy your own equipment?

  7. 7.

    Would you be interested in gym based, water based, sport or dancing activities?

Based on the answer to question one (current levels of PA), users were assigned varying daily step goals from their answers; not active at all (8,000 steps), I do some activity (10,000 steps) and I am very active (12,000 steps). Participants were asked to wear their PA tracker during waking hours throughout the 3-week trial, which monitored daily activity in steps. This information was automatically displayed on the iKOALA app providing feedback on their PA goals. Based on the answers to questions two to seven (PA preferences), a list of suitable activities were presented to the individual on the iKOALA app. Users were required to select several of the recommended exercises adding them to their personalised PA plan to assist them in safely meeting their PA goals. Following this, participants were asked to familiarise themselves with the app and to log any PA sessions completed in the app. Participants were encouraged to use the iKOALA intervention to monitor their PA and symptoms to help them achieve their PA goals (Fig. 2).

Fig. 2
figure 2

Screenshots of the iKOALA setup process (top) and of the features (bottom)

At the end of each week participants were asked to complete a paper user diary indicating what features were used, what was liked about the app, what was disliked about the app, what issues (crashing, display issues, features not working etc.) were encountered (if any), and what thoughts or questions arose whilst using the app. At the end of weeks 1 and 2, participants were contacted by a researcher (EC) to ensure that there were no major issues with either the smartphone or Fitbit app or the iKOALA functionality. At the end of the 3 weeks, participants were asked to complete a 10-item system usability scale (SUS) Likert questionnaire to evaluate the subjective useableness of the intervention [33]. Finally, following completion of the user trial, participants were also invited to take part in an evaluation interview by video conference to gain their views on the iKOALA intervention. The interview contained a series of open ended questions (such as “can you tell me about anything you thought was particularly good about the app”). The user diaries and interviews were audio or video recorded, with prior consent and transcribed verbatim.

Think-aloud sessions

Six of the seven participants involved in the user trial gave their consent to be contacted and subsequently re-consented to take part in the qualitative think-aloud sessions. These were conducted via videoconference in May 2020. Think-aloud sessions were conducted by members of the research team (EC, SJ and VI) along with the individual participants one at a time. During each think-aloud session, participants were given access to a smartphone with the prototype iKOALA intervention on (containing the same pre-set fictitious data). Participants were asked to navigate in the app to complete a series of specific tasks and to answer several questions directed by the researcher (such as “can you tell me what activities are currently in the activity plan”?). The researcher used prompts where necessary. Throughout the session, participants were asked to ‘think out loud’ and to talk through the process of what they were thinking and doing during each task. In the final 10–15 min of the session, the researcher asked a series of summary questions to gain the views of participants about the app (such as “can you tell me anything you thought was particularly good about the app”? and “is there anything about how the app works in general or navigation that you would like to comment on”?). Think-aloud interviews were audio or video recorded, with prior consent and transcribed verbatim.

Analysis

Descriptive quantitative data are presented as mean, standard deviation (SD) and range unless otherwise stated. Qualitative data were transcribed and analysed thematically based on an inductive approach, guided by the process of Braun and Clarke (2006) that involves (1) becoming familiar with the data, (2) creating initial codes, (3) searching for themes, (4) reviewing the themes, (5) defining and naming the themes and finally (6) interpreting them within the context of the project. NVivo 7 (http://www.qrsinternational.com/) was used to organise and manage then qualitative data for the thematic analysis. All identifiable participant data was anonymised for confidentiality purposes.

Themes interpreted in the qualitative data from the planning phase (focus groups and physiotherapist interview) were presented along with participant quotes. Qualitative data from the optimisation phase (think-aloud interviews and user trial) were analysed using the ‘table of changes’ method (https://www.personbasedapproach.org/table_of_changes.html) of the PBA [32]. After (1) undertaking the think-aloud sessions and user trial feedback interviews, these were (2) transcribed verbatim. These transcriptions were then used to (3) draw out key positive and negative comments about specific elements or features of the intervention and these were (4) discussed with the intervention development team to identify the ways in which these problems may be solved. The (5) MoSCoW (Must do, Should do, Could do, Would like to do) criteria were then used to prioritise changes and (6) the agreed changes that were considered essential and achievable were subsequently implemented into the intervention. These results were presented summarising the feedback and associated changes made to the iKOALA intervention.

Results

Table 1 presents the characteristics of participants that took part in the focus groups, qualitative interviews, user trial and the think-aloud sessions during the study.

Table 1 Participant characteristics in the various phases of the study

Intervention planning

Evidence and theory

In relation to the effective and safe implementation of exercise for individuals with KOA, a total of eighty-four publications were identified from the databases of which thirty-nine were duplicates and forteen deemed unsuitable leaving thirty-one articles [3, 5, 6, 8, 10,11,12, 14, 15, 34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55]. For the KOA digital interventions, a total of forteen publications were identified from the databases of which six were duplicates and three deemed unsuitable leaving five articles [24, 44, 56,57,58].

In terms of evidence, our scoping review did not establish or promote clear superiority of a certain modality over another [5, 42, 53, 59]. The lack of focus on specific exercise modes also tallies with information from OA charities, where information emphasises the role of exercise in maintaining joint health [60]. Versus Arthritis outline the potential suitability of low impact exercises as appropriate for OA but there is strong emphasis on personal suitability [60]. Therefore, it was established that any PA recommendations do not need strong bias towards a specific type of exercise. In terms of the digital technologies to support the management of KOA, four of the five studies used a web-based platform to deliver their digital intervention whereas only one used mHealth technology.

Focus groups

Twenty-six participants were involved in the focus groups. Table 2 presents summaries of the key findings from the thematic analysis along with illustrative quotes from focus groups one and two. Participants identified that they felt PA was important to help manage their OA and overall wellbeing. Individuals also identified that a lack of information led to frustration, whilst the importance of social support was recognised by many. In relation to technology, participants were open to using it and felt that there was a benefit to be able to track PA and symptoms.

Table 2 Key findings and illustrative quotes from the focus groups

Individual interviews

Five qualified physiotherapists agreed to take part in the individual interviews which lasted on average 81 min (range 66–96 min). Table 3 presents summaries of the key findings from the thematic analysis along with illustrative quotes for the individual physiotherapist interviews. The physiotherapists reported that assessing the suitability of exercises, modifying activities and working within pain limits to suit the individual were critical factors when supporting someone with KOA.

Table 3 Key findings and illustrative quotes from physiotherapist interviews

Intervention guiding principles

Data from the focus groups, qualitative interviews and the evidence and theory were used to create the intervention guiding principles which are presented in Table 4. These contain both intervention design objectives and key features of the intervention which were modified throughout the planning and optimisation phases. As an example, participants identified that the app should include rehabilitation exercises that the users could watch whenever needed (design objective). To support this, the key features needed were identified as (i) a bank of rehabilitation exercises, (ii) videos of appropriate techniques and instructions and (iii) resources for monitoring project progress such as an activity timer.

Table 4 Guiding principles of the iKOALA intervention

These guiding principles were used to develop the first iteration of the iKOALA intervention which were incorporated four key focal areas:

  1. a)

    Providing detailed information relating to OA: To overcome the potential lack of education as a barrier to exercise [9], the iKOALA intervention included a comprehensive information section on knee OA using information obtained from the charity Versus Arthritis [60]. This included information on topics such as what is KOA?, how will KOA affect me?, exercise for KOA, weight management, reducing the strain on your knees, coping with low mood and sleep, pharmacological drugs (and other pain relief) for KOA as well as information on surgery.

  2. b)

    Personalised PA recommendations: Feelings of embarrassment and distress at undertaking unsuitable activities and inappropriate PA intensities have been identified as barriers to sustained exercise [9]. Because of this iKOALA was designed to provide personalised PA recommendations. After completing the iKOALA questionnaire to assess their PA preferences (mode and intensity of exercise), users were recommended a range of activities that were specifically suited to their preferences. This allowed users to select only exercises that were suited to them to safely meet their PA goals.

  3. c)

    Self-management support: Behaviour change techniques that have been shown to help with increases in PA behaviour [61, 62], namely goal setting, provision of personal biofeedback, and the prompting of self-monitoring. Additionally, PA tracker integration enabled daily step goals to be displayed in iKOALA with traffic light colours providing visual feedback on whether users were meeting their PA targets (green), almost meeting them (amber) or not close to (red), as well as the use of PA graphs and motivational messages promoting engagement [63].

  4. d)

    Providing opportunities for social support: Because social support has been shown to be advantageous for supporting OA PA programmes [9, 36], the iKOALA included functions to facilitate social support including the identification of local exercise facilities and clubs and an in-app activity specific group chat function where users could post about their experiences and chat with other users.

Intervention optimisation

User trial

Seven participants undertook a 3-week user trial of the iKOALA intervention. All participants completed the user diary and evaluation interview following completion of the trial which lasted 70 min on average (range 62–73 min). Participants gave both positive and negative feedback regarding the iKOALA intervention which following a thematic analysis allowed for key issues to be identified. The feedback and subsequent changes that were agreed to be implemented are presented in Table 5 which included changing the layout of the pages within the app to make the user experience more intuitive and to ensure that only relevant information was shown to the users where personal preferences were applied.

Table 5 Changes made to the iKOALA intervention based on patient feedback

All participants also completed the system usability scale and reported mixed responses to the usability of the iKOALA intervention (Table 6). Whilst the most common response from participants indicated that the app was felt to be complex, cumbersome, and not necessarily easy to use, most participants also reported that they would like to use the app frequently.

Table 6 System usability scores

Think aloud sessions

Six participants took part in one think aloud session which lasted an average of 62 min (range 54–76 min). The overall impressions with the intervention were positive with participants also identifying areas of the app that needed further work to ensure it was clear and logical to the user. Table 5 summarises the key issues identified during the think-aloud sessions and the changes that were implemented. Examples of the overall impressions of the iKOALA intervention were as follows:

“This does have things that are relevant to your condition, so that’s what sets it apart from the others.... the recording of your pain, the information that you had so you can easily access that”(P5, male)

“I really liked the sort of things it records. I like the fact that it’s got the health and the activity summaries, and I thought the health summary was really good….it does make it more specific to a certain type of problem” (P2, female)

“I thought it was good, it would certainly motivate you to do something about your condition I think” (P6, female)

Images depicting the features and final design of the iKOALA intervention are displayed in Fig. 3 showing (a) the profile page, (b) the health summary, (c) information page, (d) information on outdoor walking, (e) users activity plan, and (f) a calf raise exercise.

Fig. 3
figure 3

Screenshots of the features and final design of the iKOALA intervention

Discussion

This paper outlines the development process of a novel mHealth app for the self-management of KOA using the PBA framework [32]. The use of this person-centred approach for this intervention builds on previous studies that have successfully developed eHealth interventions for a range of health issues including promoting PA [64], reducing cognitive decline [65] and self-managing hypertension [66] by combining behaviour change theory with patient involvement. The development of a mHealth app to support PA in KOA patients is needed, not only because of the beneficial effect that PA has been shown to have on KOA [4,5,6]. It has also been established that beyond short-term care, the lack of information and (social and professional) support have been identified as barriers to PA, which often lead to a decline in PA leading to poorer health outcomes [7, 9].

Whilst over twenty mHealth apps have been identified in a recent systematic review to support people with KOA [23], these technologies focused on the development of OA assessment, measurement and motion monitoring tools. A small number of other studies have identified improvement in exercise adherence [25] and mobility [24] from mHealth technologies for OA lifestyle management, however, there is some evidence to suggest that the long-term maintenance of PA in knee KOA patients requires a combination of personalised PA guidance, education, and social support. As such there is an unmet need for a comprehensive mHealth application to extend the support for PA and musculoskeletal health in individuals with KOA.

In this study, the planning phase consisted of collating information from the literature along with feedback obtained from focus groups with potential users and interviews with physiotherapists. By triangulating these sources of data, we were able to gain a comprehensive understanding of the elements needed for a self-management tool and subsequently to identify clear guiding principles for the development of the iKOALA intervention. By seeking the views of physiotherapists working with KOA patients, we broadened the perspective of those with experience in this field, enhancing the feedback provided to the development team which may be a useful approach to those developing other eHealth or mHealth interventions.

Key themes that arose from the planning phase identified that people with KOA recognised the importance of PA for their overall wellbeing. However, a lack of social support and a lack of information/knowledge on how best to manage their condition were identified as barriers to engaging in PA which is consistent with other reports [9, 67]. In relation to technology use, despite the cost wearable technology being a concern to some, there was generally a positive attitude to the use of technology to help them self-manage their condition. This is also seen in other groups of older adults [68] including those with multiple long-term conditions [69].

In the optimisation phase, the short-term user trial provided detailed feedback on the intervention, including what worked well, as well as those aspects that were not clear or did not work as intended, and this is similar to other studies adopting this approach [70]. This feedback gave clear direction to the development team on how to improve subsequent iterations of the iKOALA intervention. These changes were then checked with potential users during the think-aloud sessions to ensure they worked as intended. In the final part of the think-aloud sessions, users reported being impressed by the amount of progress made by the development team and were confident it would be useful for supporting them in self-managing KOA.

There are, however, several challenges that remain to be resolved. Whilst most of the issues identified within the table of changes process based on user feedback were rectified, several ‘would like to do’s’ were unbale to be actioned due to the development costs associated with the modifications. These were related to being able to personalise an ‘activity’ within the library of exercises and further personalisation of how the real-time PA data was displayed. There were also instances where inconsistent feedback from users did not provide a clear direction to the development team as to the most appropriate action to take (to make changes or not). As such further feedback is necessary from a broader range of users to clarify any action required. This is hoped to be addressed during the longer user trial.

The main strength of this study was that it followed a structured best-practise methodology and agile iterative development and optimisation process [32]. Whist this process has not been utilised to develop mHealth applications for OA previously, it has been successfully used to develop other mHealth applications. A potential limitation of this study may be the smaller number of participants in the optimization phase compared to the development phase. A greater number of participants may have provided richer information during the user trial and think-aloud sessions. Unfortunately, the recruitment of volunteers for these studies was particularly challenging due to the ongoing COVID-19 pandemic. The next steps of the intervention will be to assess the most recent version of the iKOALA intervention in a user trial of around 12 weeks. During this trial we will seek to monitor PA data, app usage data as well assessing the effect of the trial on musculoskeletal symptoms. Following this, a randomised controlled trial in collaboration with a physiotherapy provider would allow us to investigate the effectiveness of the iKOALA intervention in a real world setting with minimal bias or confounding factors.

Conclusions

Using a systematic person-based development approach, we have developed the iKOALA to help people with KOA maintain an active lifestyle. Further user testing will refine the intervention to ensure its appropriateness before validating it in a real work setting.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available but are available from the corresponding author on reasonable request.

Abbreviations

eHealth:

Electronic health

iKOALA:

Intelligent knee osteoarthritis lifestyle app

KOA:

Knee osteoarthritis

mHealth:

Mobile health

NHS:

National Health Service

OA:

Osteoarthritis

PA:

Physical activity

PBA:

Person-based approach

REACH:

Department for Health Research Ethics Committee

SDT:

Self-determination theory

SUS:

System usability scale

References

  1. Katz JN, Arant KR, Loeser RF. Diagnosis and treatment of hip and knee osteoarthritis. JAMA. 2021;325(6):568.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Barbour KE, Helmick CG, Boring M, Brady TJ. Vital Signs: Prevalence of Doctor-Diagnosed Arthritis and Arthritis-Attributable Activity Limitation — United States, 2013–2015. MMWR Morb Mortal Wkly Rep. 2014;66(9):246–53.

    Article  Google Scholar 

  3. Martel-Pelletier J, Barr AJ, Cicuttini FM, Conaghan PG, Cooper C, Goldring MB, et al. Osteoarthritis. Nat Rev Dis Prim. 2016;2(1):16072.

    Article  PubMed  Google Scholar 

  4. Damen J, Van Rijn RM, Emans PJ, Hilberdink WKHA, Wesseling J, Oei EHG, et al. Prevalence and development of hip and knee osteoarthritis according to American College of Rheumatology criteria in the CHECK cohort. Arthritis Res Ther. 2019;21(1):4.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Fransen M, Mcconnell S, Harmer AR, Van Der Esch M, Simic M, Bennell KL. Exercise for osteoarthritis of the knee: a Cochrane systematic review. Br J Sports Med. 2015;49(24):1554–7.

    Article  PubMed  Google Scholar 

  6. Conaghan PG, Dickson J, Grant RL. Care and management of osteoarthritis in adults: summary of NICE guidance. BMJ. 2008;336(7642):502–3.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Mikesky AE, Mazzuca SA, Brandt KD, Perkins SM, Damush T, Lane KA. Effects of strength training on the incidence and progression of knee osteoarthritis. Arthritis Rheum. 2006;55(5):690–9.

    Article  PubMed  Google Scholar 

  8. Fernandes L, Hagen KB, Bijlsma JWJ, Andreassen O, Christensen P, Conaghan PG, et al. EULAR recommendations for the non-pharmacological core management of hip and knee osteoarthritis. Ann Rheum Dis. 2013;72(7):1125–35.

    Article  PubMed  Google Scholar 

  9. Kanavaki AM, Rushton A, Efstathiou N, Alrushud A, Klocke R, Abhishek A, et al. Barriers and facilitators of physical activity in knee and hip osteoarthritis: a systematic review of qualitative evidence. BMJ Open. 2017;7(12):e017042.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Bennell K, Hinman RS, Wrigley TV, Creaby MW, Hodges P. Exercise and osteoarthritis: cause and effects. Compr Physiol. 2011;1(4):1943–2008.

    Article  PubMed  Google Scholar 

  11. Bennell KL, Dobson F, Hinman RS. Exercise in osteoarthritis: moving from prescription to adherence. Best Pract Res Clin Rheumatol. 2014;28(1):93–117.

    Article  PubMed  Google Scholar 

  12. Saw MM, Kruger-Jakins T, Edries N, Parker R. Significant improvements in pain after a six-week physiotherapist-led exercise and education intervention, in patients with osteoarthritis awaiting arthroplasty, in South Africa: a randomised controlled trial. BMC Musculoskelet Dis. 2016;17(1):236.

    Article  CAS  Google Scholar 

  13. Cinthuja P, Krishnamoorthy N, Shivapatham G. Effective interventions to improve long-term physiotherapy exercise adherence among patients with lower limb osteoarthritis. A systematic review. BMC Musculoskelet Disord. 2022;23(1):147.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hurley MV, Walsh NE, Mitchell HL, Pimm TJ, Patel A, Williamson E, et al. Clinical effectiveness of a rehabilitation program integrating exercise, self-management, and active coping strategies for chronic knee pain: a cluster randomized trial. Arthritis Rheum. 2007;57(7):1211–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Li LC, Sayre EC, Xie H, Clayton C, Feehan LM. A community-based physical activity counselling program for people with knee osteoarthritis: feasibility and preliminary efficacy of the track-OA study. JMIR Mhealth Uhealth. 2017;5(6):e86.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Patten RK, Tacey A, Pile R, Parker A, De Gori M, Tran P, et al. Digital self-management interventions for osteoarthritis: a systematic scoping review of intervention characteristics, adherence and attrition. Arch Public Health. 2022;80(1):103.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Safari R, Jackson J, Sheffield D. Digital self-management interventions for people with osteoarthritis: systematic review with meta-analysis. J Med Internet Res. 2020;22(7):e15365.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Murray E, Hekler EB, Andersson G, Collins LM, Doherty A, Hollis C, et al. Evaluating digital health interventions. Am J Prev Med. 2016;51(5):843–51.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res. 2013;15(4):e86.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Van Gemert-Pijnen JE, Nijland N, Van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies. J Med Internet Res. 2011;13(4):e111.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res. 2015;17(1):e30.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Choi W, Zheng H, Franklin P, Tulu B. mHealth technologies for osteoarthritis self-management and treatment: a systematic review. Health Informatics J. 2019;25(3):984–1003.

    Article  PubMed  Google Scholar 

  24. Skrepnik N, Spitzer A, Altman R, Hoekstra J, Stewart J, Toselli R. Assessing the impact of a novel smartphone application compared with standard follow-up on mobility of patients with knee osteoarthritis following treatment with Hylan G-F 20: a randomized controlled trial. JMIR Mhealth Uhealth. 2017;5(5):e64.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Alasfour M, Almarwani M. The effect of innovative smartphone application on adherence to a home-based exercise programs for female older adults with knee osteoarthritis in Saudi Arabia: a randomized controlled trial. Disabil Rehabil. 2022;44(11):2420–7.

    Article  PubMed  Google Scholar 

  26. Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ. 2017;358:j3453.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78.

    Article  CAS  PubMed  Google Scholar 

  28. Teixeira PJ, Carraça EV, Markland D, Silva MN, Ryan RM. Exercise, physical activity, and self-determination theory: a systematic review. Int J Behav Nutr Phys Act. 2012;9:78.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Peters D, Calvo RA, Ryan RM. Designing for motivation, engagement and wellbeing in digital experience. Front Psychol. 2018;9:797.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Teixeira PJ, Marques MM, Silva MN, Brunet J, Duda JL, Haerens L, et al. A classification of motivation and behavior change techniques used in self-determination theory-based interventions in health contexts. Motiv Sci. 2020;6(4):438.

    Article  Google Scholar 

  31. Michie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Yardley L, Ainsworth B, Arden-Close E, Muller I. The person-based approach to enhancing the acceptability and feasibility of interventions. Pilot Feasibility Stud. 2015;1(1):37.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Brooke J. A “quick and dirty” usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McLelland IL, editors. Usability in Evaluation in industry. London: Taylor Francis; 1996. p. 189–94.

    Google Scholar 

  34. Jenkinson CM, Doherty M, Avery AJ, Read A, Taylor MA, Sach TH, et al. Effects of dietary intervention and quadriceps strengthening exercises on pain and function in overweight people with knee pain: randomised controlled trial. BMJ. 2009;339(aug18 2):b3170-b.

    Article  Google Scholar 

  35. Hurley MV, Walsh N, Bhavnani V, Britten N, Stevenson F. Health beliefs before and after participation on an exercised-based rehabilitation programme for chronic knee pain: doing is believing. BMC Musculoskelet Disord. 2010;11(1):31.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Petursdottir U, Arnadottir SA, Halldorsdottir S. Facilitators and barriers to exercising among people with osteoarthritis: a phenomenological study. Phys Ther. 2010;90(7):1014–25.

    Article  PubMed  Google Scholar 

  37. Esser S, Bailey A. Effects of exercise and physical activity on knee osteoarthritis. Curr Pain Headache Rep. 2011;15(6):423–30.

    Article  PubMed  Google Scholar 

  38. Adatia A, Rainsford KD, Kean WF. Osteoarthritis of the knee and hip. Part I: aetiology and pathogenesis as a basis for pharmacotherapy. J Pharm Pharmacol. 2012;64(5):617–25.

    Article  CAS  PubMed  Google Scholar 

  39. Bruce-Brand RA, Walls RJ, Ong JC, Emerson BS, O’Byrne JM, Moyna NM. Effects of home-based resistance training and neuromuscular electrical stimulation in knee osteoarthritis: a randomized controlled trial. BMC Musculoskelet Disord. 2012;13(1):118.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Focht BC, Garver MJ, Devor ST, Dials J, Rose M, Lucas AR, et al. Improving maintenance of physical activity in older, knee osteoarthritis patients trial-pilot (IMPACT-P): Design and methods. Contemp Clin Trials. 2012;33(5):976–82.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Manheim LM, Dunlop D, Song J, Semanik P, Lee J, Chang RW. Relationship between physical activity and health-related utility among knee osteoarthritis patients. Arthritis Care Res. 2012;64(7):1094–8.

    Article  Google Scholar 

  42. UK NCGC. Osteoarthritis: care and management in adults. 2014.

    Google Scholar 

  43. Peeler J, Christian M, Cooper J, Leiter J, MacDonald P. Managing knee osteoarthritis: the effects of body weight supported physical activity on joint pain, function, and thigh muscle strength. Clin J Sport Med. 2015;25(6):518–23.

    Article  PubMed  Google Scholar 

  44. Pearson J, Walsh N, Carter D, Koskela S, Hurley M. Developing a web-based version of an exercise-based rehabilitation program for people with chronic knee and hip pain: a mixed methods study. JMIR Res Protoc. 2016;5(2):e67.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Peeler J, Leiter J, MacDonald P. The effects of body weight supported physical activity on joint pain, function and thigh muscle strength in overweight patients with mild-moderate knee osteoarthritis. FASEB J. 2016;30:1039.6-.6.

    Article  Google Scholar 

  46. Bennell KL, Campbell PK, Egerton T, Metcalf B, Kasza J, Forbes A, et al. Telephone coaching to enhance a home-based physical activity program for knee osteoarthritis: a randomized clinical trial. Arthritis Care Res. 2017;69(1):84–94.

    Article  Google Scholar 

  47. Ernstgård A, Pirouzifard M, Thorstensson CA. Health enhancing physical activity in patients with hip or knee osteoarthritis - an observational intervention study. BMC Musculoskelet Disord. 2017;18(1):42.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Fernandopulle S, Perry M, Manlapaz D, Jayakaran P. Effect of land-based generic physical activity interventions on pain, physical function, and physical performance in hip and knee osteoarthritis: a systematic review and meta-analysis. Am J Phys Med Rehabil. 2017;96(11):773–92.

    Article  PubMed  Google Scholar 

  49. Da RodriguesSilva JM, De Rezende MU, Spada TC, Da SilvaFrancisco L, De SabineFarias FE, Da ClementeSilva CA, et al. Educational program promoting regular physical exercise improves functional capacity and daily living physical activity in subjects with knee osteoarthritis. BMC Musculoskeletal Disord. 2017;18(1):546.

    Article  Google Scholar 

  50. White DK, Lee J, Song J, Chang RW, Dunlop D. Potential functional benefit from light intensity physical activity in knee osteoarthritis. Am J Prev Med. 2017;53(5):689–96.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Gay C, Guiguet-Auclair C, Pereira B, Goldstein A, Bareyre L, Coste N, et al. Efficacy of self-management exercise program with spa therapy for behavioral management of knee osteoarthritis: research protocol for a quasi-randomized controlled trial (GEET one). BMC Complement Altern Med. 2018;18(1):1–9.

    Article  Google Scholar 

  52. Knoll N, Hohl DH, Motter S, Keller J, Lange D, Felsenberg D, et al. Facilitating physical activity and reducing symptoms in patients with knee osteoarthritis: study protocol of a randomized controlled trial to test a theory-based PrevOP-psychological adherence program (PrevOP-PAP). BMC Musculoskelet Disord. 2018;19(1):221.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Rausch Osthoff A-K, Niedermann K, Braun J, Adams J, Brodin N, Dagfinrud H, et al. 2018 EULAR recommendations for physical activity in people with inflammatory arthritis and osteoarthritis. Ann Rheum Dis. 2018;77(9):1251–60.

    Article  PubMed  Google Scholar 

  54. Schäfer AGM, Zalpour C, Von Piekartz H, Hall TM, Paelke V. The efficacy of electronic health-supported home exercise interventions for patients with osteoarthritis of the knee: systematic review. J Med Internet Res. 2018;20(4):e152.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Skou ST, Bricca A, Roos EM. The impact of physical activity level on the short- and long-term pain relief from supervised exercise therapy and education: a study of 12,796 Danish patients with knee osteoarthritis. Osteoarthritis Cartilage. 2018;26(11):1474–8.

    Article  CAS  PubMed  Google Scholar 

  56. Nero H, Ranstam J, Kiadaliri AA, Dahlberg LE. Evaluation of a digital platform for osteoarthritis treatment: study protocol for a randomised clinical study. BMJ Open. 2018;8(11):e022925.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Dahlberg LE, Grahn D, Dahlberg JE, Thorstensson CA. A web-based platform for patients with osteoarthritis of the hip and knee: a pilot study. JMIR Res Protoc. 2016;5(2):e5665.

    Article  Google Scholar 

  58. Bossen D, Veenhof C, Van Beek KE, Spreeuwenberg PM, Dekker J, De Bakker DH. Effectiveness of a web-based physical activity intervention in patients with knee and/or hip osteoarthritis: randomized controlled trial. J Med Internet Res. 2013;15(11):e257.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Arden NK, Perry TA, Bannuru RR, Bruyère O, Cooper C, Haugen IK, et al. Non-surgical management of knee osteoarthritis: comparison of ESCEO and OARSI 2019 guidelines. Nat Rev Rheumatol. 2021;17(1):59–66.

    Article  CAS  PubMed  Google Scholar 

  60. Versus Arthritis. Osteoarthritis of the knee. Chesterfield: Versus Arthritis; 2021. https://versusarthritis.org/about-arthritis/conditions/osteoarthritis-of-the-knee/. Accessed Feb 12 2023.

  61. Carraça E, Encantado J, Battista F, Beaulieu K, Blundell J, Busetto L, et al. Effective behavior change techniques to promote physical activity in adults with overweight or obesity: A systematic review and meta‐analysis. Obes Rev. 2021;22(S4):e13256. https://doi.org/10.1111/obr.13256.

  62. Michie S, Abraham C, Whittington C, Mcateer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol. 2009;28(6):690–701.

    Article  PubMed  Google Scholar 

  63. Western MJ, Peacock OJ, Stathi A, Thompson D. The understanding and interpretation of innovative technology-enabled multidimensional physical activity feedback in patients at risk of future chronic disease. PLoS One. 2015;10(5):e0126156.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Pollet S, Denison-Day J, Bradbury K, Essery R, Grey E, Western M, et al. A qualitative exploration of perceptions of a digital intervention to promote physical activity in older adults. J Aging Phys Act. 2021;29(3):442–54.

    Article  PubMed  Google Scholar 

  65. Essery R, Pollet S, Smith KA, Mowbray F, Slodkowska-Barabasz J, Denison-Day J, et al. Planning and optimising a digital intervention to protect older adults’ cognitive health. Pilot Feasibility Stud. 2021;7(1):158.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Band R, Bradbury K, Morton K, May C, Michie S, Mair FS, et al. Intervention planning for a digital intervention for self-management of hypertension: a theory-, evidence- and person-based approach. Implement Sci. 2017;12(1):25.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Baert V, Gorus E, Mets T, Geerts C, Bautmans I. Motivators and barriers for physical activity in the oldest old: a systematic review. Ageing Res Rev. 2011;10(4):464–74.

    Article  PubMed  Google Scholar 

  68. Harris MT, Blocker KA, Rogers WA. Older Adults and Smart Technology: Facilitators and Barriers to Use. Front Comput Sci. 2022;4:835927. https://doi.org/10.3389/fcomp.2022.835927.

  69. Ha J, Park HK. Factors affecting the acceptability of technology in health care among older Korean adults with multiple chronic conditions: a cross-sectional study adopting the senior technology acceptance model. Clin Interv Aging. 2020;15:1873–81.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Essery R, Denison-Day J, Grey E, Priestley E, Bradbury K, Mutrie N, et al. Development of the Digital Assessment of Precise Physical Activity (DAPPA) Tool for Older Adults. Int J Environ Res Public Health. 2020;17(21):7949.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

This work was funded by the EPSRC FAST Healthcare Networks Plus and supported by the Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis.

Author information

Authors and Affiliations

Authors

Contributions

JB: Conceptualisation, Methodology, Funding acquisition, supervision, Writing – Review and Editing. NW: Conceptualisation, Methodology. Chowdhury: Methodology, Investigation, Validation, Resources, Project Administration, Writing – Review and editing. VI: Software, Investigation. SJ: Software, Investigation. RS: Formal analysis, Writing – Original draft preparation, MW: Methodology, investigation, Writing – Original draft, Writing – Review and Editing.

Corresponding author

Correspondence to James L. J. Bilzon.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was provided by the Department for Health Research Ethics Approval Committee for Health (REACH) at the University of Bath (Ref: EP 18/19 080). Participants were recruited through the University of the Third Age (https://www.u3a.org.uk/) as well as through social media advertising. All participants provided written informed consent to participate in the study.

The study was conducted in accordance with the Declaration of Helsinki and all analyses were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stevenson, R.D.M., Chowdhury, E.A., Inza, V.B. et al. Development of the intelligent knee osteoarthritis lifestyle app: a person-based approach. BMC Musculoskelet Disord 25, 189 (2024). https://doi.org/10.1186/s12891-024-07313-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12891-024-07313-4

Keywords