Skip to main content

Preliminary study of the Southampton Hand Assessment Procedure for Children and its reliability

Abstract

Background

The Southampton Hand Assessment Procedure (SHAP) is currently used in the adult population for evaluating the functionality of impaired or prosthetic hands. The SHAP cannot be used for children because of the relatively larger size of the objects used to perform SHAP tasks and unknown clinimetric properties. The aims of this study were to adapt the SHAP for use in children (SHAP-C), to determine norm values for the SHAP-C, and to analyze the reliability of the SHAP-C.

Methods

The SHAP-C was adapted based on the SHAP protocol. Some objects were downsized, and the timing of tasks was performed by the rater instead of the participant. Intra- and inter-rater reliability were assessed in 24 children (5 [0.54] y/o) with unimpaired hands. The repeatability coefficients (RCs) were calculated. An RC ≤ 75% of the mean SHAP-C task values was considered good reliability.

Results

Participants were able to perform all SHAP-C tasks. The means of the SHAP-C tasks ranged from 0.75 to 1.21 seconds for abstract objects and from 0.64-19.13 seconds for activities of daily living. The RCs of a single assessor did not exceed 75% in 17/26 SHAP-C tasks, displaying a relatively good intra-rater reliability, whereas the RCs for the inter-rater reliability exceeded 75% in 22/26 SHAP-C tasks, thus displaying poor reliability.

Conclusion

In this first study that adjusted the SHAP for pediatric use, we found that all SHAP-C objects and tasks could be performed by children. The intra-rater reliability was better than the inter-rater reliability. Although the SHAP-C appears to be a promising instrument, the protocol requires further modifications to provide reliable measurements in children.

Peer Review reports

Background

The Southampton Hand Assessment Procedure (SHAP) is a measurement instrument of the functionality of normal, impaired, and prosthetic hands [1]. Currently, clinicians and researchers prefer to use the SHAP [2–9] because it provides a comprehensive overview of the functionality of prehensile grips (spherical, tripod, power, lateral, tip, and extension) and a general functionality score. SHAP scores are calculated based on the execution times of its tasks. SHAP tasks are designed to evaluate unilateral hand function of adults [1]. Although assessing hand function is equally important for the adult as the pediatric population, currently no version of the SHAP exists for children.

Several instruments are available for evaluating hand functioning of children with different hand impairments, such as spastic hand due to cerebral palsy (CP; 20.8/10.000 births) [10], upper limb reduction deficiencies (ULRD; 5.0 births/10.000) [11], or traumatic injuries of the hand (41% of childhood injuries) [12]. For instance, the Melbourne Assessment of Unilateral Upper Limb Function (Melbourne assessment) and the Quality of Upper Extremity Skills Test (QUEST) [13–15] are used in children with different types of CP. The Assessment of Capacity for Myoelectric Control (ACMC) evaluates functioning with a prosthesis, the University of New Brunswick Test (UNB) focuses on bimanual functioning, and the Assisting Hand Assessment (AHA) evaluates the role of the impaired hand as assisting hand for the unimpaired hand [16–18]. These measurement instruments are recommended for clinical use. However, some measurement instruments require extended training of the assessor (e.g., ACMC), which may limit clinical applicability [19–21]. The instruments focusing on evaluating bilateral functioning [16, 22, 23] cannot assess the capabilities of the affected hand alone (e.g., UNB). Some instruments focus on evaluating the functionality of prosthetic hands (e.g., ACMC and other, see the literature reviews) [19, 20, 24, 25] or of hands subject to the specific effects of conditions such as CP or ULRD (e.g., Melbourne assessment, AHA) [14, 16]. Furthermore, the outcomes of the existing instruments lack description about the functionality of different hand grips. With high incidences and various impairments of the hand, healthcare professionals need an accurate instrument that does not require formal training and can be used for multiple hand impairments. Such a broad-applicability instrument would enable comparison of the functionality scores of different impairments of pediatric hands with regard to unimpaired hand functioning.

The SHAP is an instrument that has web-based training [26, 27] and makes comparisons between scores of unimpaired, impaired, and prosthetic hands possible. The SHAP provides scores for the functionality that are calculated relative to norms [1, 28]. The SHAP reliability and norm values were determined using unimpaired young adults that were considered to have optimal hand functionality [1]. Thus, SHAP functionality scores of any type of hand impairment are relative to optimal hand functionality (of unimpaired young adults). However, the SHAP has not been used in children thus far, and the relevant clinimetric properties have yet not been established in children. To use the SHAP for children (SHAP-C), several steps are required:

  1. a.

    Adjustment of the objects used to perform the tasks and the SHAP protocol for a specific age group and size of the impaired/unimpaired hand or prosthesis, as some of the SHAP objects are relatively heavy and large for a child’s hand or prosthesis [16];

  2. b.

    Testing of the reliability in unimpaired children and determination of the norm values for unimpaired children;

  3. c.

    Testing of SHAP-C validity; and

  4. d.

    Testing of the reliability in children with prosthetic hands and other hand impairments because the SHAP was originally designed to evaluate unimpaired, impaired, and prosthetic hands.

This study focused on the first steps, adjusting the SHAP, providing norm values, and testing reliability in children with unimpaired upper limbs.

The aims of the study were as follows: (1) to modify the objects and protocol of SHAP for children’s hands or prostheses, (2) to provide norm data about the means of SHAP-C tasks for 4- to 6-y/o boys and girls with unimpaired hands, and (3) to assess the inter- and intra-rater reliability of the SHAP-C in these children.

Methods

SHAP-C

The SHAP consists of 26 tasks: 12 tasks with abstract objects and 14 tasks concerning activities of daily living (ADL, Table 1). The time needed to complete each task is recorded in seconds. Using z-score transformations of task-times and the Euclidean distance, six prehensile patterns and a general index of function (IOF) are computed. All six scores of prehensile patterns form the functionality profile (FP). The prehensile patterns and IOF are calculated relative to the predetermined norms and represent the functionality scores of hand grips (Spherical, Tripod, Power, Lateral, Tip, Extension) [1]. The FP and IOF scores range from 1 to 100 (100 is normal functionality). Scores higher than 100 are possible if the assessed person performs better compared with the normative data. The normative data for the tasks in adults range from a mean performance time of 1.58 seconds to 1.84 seconds in abstract objects tasks and from 3.12 seconds to 6.77 seconds in ADL tasks. The normative data for the prehensile patterns and the IOF are not available in the literature because of the intellectual property rights of parties commercializing SHAP. The test-retest reliability of SHAP has been tested in unimpaired young adults using analysis of variance (ANOVA) [1]. The ANOVA F-values of SHAP tasks and the FP and IOF functionality scores do not exceed Fcritical = 3.28, indicating there is no difference between the replicates and demonstrating, thus, good reliability [1, 28].

Table 1 SHAP functionality profiles, tasks and modifications to the tasks for use in the SHAP-C

In the process of establishing the SHAP-C, we focused on keeping the alterations of the original SHAP to a minimum. Therefore, a systematic approach was used for designing the SHAP-C. (1) First, several objects were downsized (Table 1) to allow grasping with both pediatric unimpaired and prosthetic hands, as the SHAP was designed for prosthetic hands as well (maximum opening of the prosthetic hand, distance from thumb to index finger is 5 cm [myoelectric prosthesis, Electrohand 2000]). Object sizes and the original SHAP protocol [27] were tested in a pilot study on eight unimpaired children (4–7 y/o, three girls and five boys). The children were recruited from a local school. They performed with a normal hand or with a myoelectric prosthesis adapted for the use in unimpaired children (a prosthetic simulator, Figure 1). (2) After that pilot study, it was decided that the assessor will time the tasks instead of the child as stated in the standard SHAP protocol because the children often forgot to start and stop the timer. Timing was started at the moment of opening the hand to grasp the object and stopped when the object was released. Furthermore, all of the objects (including the resized objects) and the changed SHAP protocol were tested in three other children (5 y/o), using the myoelectric simulator, to evaluate the feasibility of the SHAP-C protocol in pediatric prosthetic hands as well. (3) Based on the observations from the children using the prosthetic simulator, the starting position of a few objects was slightly changed to facilitate the gripping of the objects in prosthesis users (Table 1).

Figure 1
figure 1

Prosthetic simulator.

Participants’ norm values and reliability study

The children were recruited from two local primary schools on a voluntary basis. Children were unimpaired, right-handed and were included if they were four to six years old (y/o) (primary school starts at 4 y/o in the Netherlands), free of upper limb musculoskeletal or neurologic disorders, had normal/corrected to normal sight and were not familiar with the SHAP. As we would like the SHAP-C also to be available for pediatric prosthesis users in the future, we included 4-to 6-y/o children. This age group was defined according to the size (opening width) and functional abilities of a generally used prosthesis hand (Otto Bock, Electrohand 2000), appropriateness of the SHAP-C tasks in children, and ability to receive and follow tasks instructions.

Study approval was granted by the Medical Ethical Committee (NL35268.042.11). A parent (or guardian) provided written informed consent and filled in a short questionnaire about age, gender, and hand dominance of their child. All of the children received a gift toy (value ± 5 Euro) at the completion of the measurements.

Procedure

A repeated-measures study was set up to evaluate intra- and inter-rater reliability of the SHAP-C. The children were assigned to perform the tasks every session with the same hand, dominant (right hand) or non-dominant hand. Dominant and non-dominant hand performance was needed to obtain a better representation of the tasks means. Measurements were performed in a quiet classroom at the primary school. The child and two assessors were present. First, the child was seated comfortably on a chair, and, when needed, height was adjusted to allow 90° elbow flexion when the hand rested on the table. Each SHAP-C task was first demonstrated by the assessor. The tasks had to be executed as accurate and as fast as possible. Children started to open the hand when near the object. For each object, a start position and an end position were specified with molds on a board (form-board) that was lying on the table in front of the child. Before executing the abstract objects tasks, the corresponding mold on the form-board was aligned to meet the middle line of the participant to standardize testing in both conditions with the dominant or non-dominant hand. No prior practice was allowed and repetition of a task was performed when the child did not complete the task according to the exact requirements (appropriate grip, object location) [27].

Three assessors collected the measurements. The assessors were instructed by a detailed SHAP protocol, which was accompanied by videos demonstrating the tasks and time measurement [26, 27]. They read and understood the modifications of the SHAP-C and practiced SHAP-C during the pilot study. Assessor 1 and assessor 3 had previous experience in applying the SHAP, which was not the case for assessor 2. A verbal signal to start the task was given to the child. The tasks were executed in random order to avoid any sequence effects. In total, four measurement sessions of the SHAP-C were collected during four consecutive days. Children participated in one SHAP-C session per day with approximately 24 h between sessions. The SHAP-C results of the four sessions were used to determine the norm values.

Intra- and inter-rater reliability

Assessor 1 measured the task times of two SHAP-C sessions (day 1 and day 2). Assessor 2 measured the times of one SHAP-C session on day 3. Assessor 3 measured the times of one SHAP-C session on day 4.

Statistical analysis

In this study, the task times, denoting performance times in each SHAP-C task, were used for the analyses.

Norm values

First, the task means of the four sessions were calculated per participant. Second, to determine the norm values, the means and the standard deviations of each SHAP-C task were calculated based on the means of the four sessions. Independent samples t-tests were used to determine differences between boys and girls. The test results of the ‘equal variances not assumed’ row were reported when the homogeneity of variances assumption was violated. In addition, we tested the differences between performance with dominant and non-dominant hands with a t-test.

Intra-rater reliability

The paired samples t-test was used to analyze the differences between the task times of the first and second session of assessor 1. A repeatability coefficient (RC) was determined for each SHAP-C task [29, 30]. The RC is defined as the value in which the differences between repeated measurements are expected to lie with a 95% probability and is calculated as 1.96 × s × (s, within-subject standard deviation) [29, 30]. The relative RCs, the percentage of variance of the RC outcome from the mean, were also calculated and constituted the primary outcome measure.

Inter-rater reliability

Repeated-measures ANOVA was used to analyze the differences between the task times of the second SHAP-C session (assessor 1), the third session (assessor 2), and the fourth session (assessor 3). When sphericity was violated, Greenhouse-Geisser correction for the degrees of freedom was applied. Bonferroni correction was applied for the post-hoc test. For each SHAP-C task, the agreement between the assessors was determined by calculating the RC and the relative RC.

We considered values of ≤ 75% for relative RC as clinically acceptable values for variation of task times from the mean denoting acceptable reliability. Statistical significance for analyses was P ≤ 0.05 (two-sided) and analyses were performed using SPSS Statistics for Windows, version 20.0 (IBM Corp., 2011, Armonk, NY, http://www.spss.com).

Results

In total, 24 children participated, and 54% were boys. The mean age was 5 y/o [SD = 0.54], and the dominant: non-dominant hand ratio was 8:5 for boys and 5:6 for girls.

SHAP-C feasibility and task means

All children were able to grip the resized objects with their hand. The means for the abstract objects varied between 0.75 and 1.21 seconds, and the means for ADL tasks varied per task, with the highest mean of 19.13 seconds for the undo buttons task (Table 2). Girls were slower than boys in five SHAP-C tasks: light extension (P = 0.006), heavy lateral (P = 0.012), heavy extension (P = 0.018), pour water from jug (P = 0.044) and open/close a zipper (P = 0.007, Table 2). Participants performing with the dominant hand were faster in the heavy extension, food cutting and page turning tasks (P-values < 0.01).

Table 2 The norm values of SHAP-C tasks in unimpaired children

Intra-rater reliability

Abstract objects

The mean task times of assessor 1 in session 2 were significantly lower than the times in session 1 for light lateral (P = 0.044) and for heavy power (P = 0.049; Table 3).

Table 3 Inter- and intra-rater reliability

Tasks RCs varied from 0.51 to 0.92 seconds in the abstract objects tasks. Relative to the mean of the first two sessions, values ≤ 75% were observed for the relative RCs in 7/12 abstract objects tasks. Light power, light tip, light extension, heavy tripod, and heavy power displayed relative RCs > 75%.

ADL tasks

The t-test indicated significantly lower means in session 2 compared with session 1 in the tasks: food cutting (P = 0.023), page turning (P < 0.01), pouring water from jug (P < 0.01), pouring water from carton (P < 0.01), and rotating a door handle (P = 0.030, Table 3).

The RCs of 10 out of the 14 ADL tasks were lower than 75% from the tasks means. In the undo buttons, food cutting, rotate a key 90°, and open/close a zipper task, the relative RCs exceeded 75% from the task mean (Table 3).

Inter-rater reliability

Abstract objects tasks

No significant differences in the time means of the three assessors were found, except for the light extension task (P = 0.002) (Table 3). In the post hoc analysis, the mean of assessor 2 was significantly lower than those of assessor 1 and assessor 3 (P = 0.016 and P = 0.010, respectively).

The RC values ranged from 0.58 to 1.20 seconds in the abstract object tasks (Table 3). The relative RC values between the three raters were all > 75%, except for the heavy sphere task (relative RC = 74.3%).

ADL tasks

The assessors differed significantly in the task times in 6 out of 14 ADL tasks: undo buttons (P = 0.044), food cutting (P = 0.005), page turning (P = 0.008), move a full jar (P = 0.021), move a tray (P = 0.026), and rotate a screw 90° (P = 0.003) (Table 3). Post hoc analyses revealed that assessor 2 recorded lower means than both assessor 1 (P = 0.006) and assessor 3 (P = 0.038) for the rotating a screw 90°, than assessor 1 in food cutting (P = 0.014) and in moving a full jar (P = 0.001) and differed from assessor 3 in moving a tray (P = 0.054, meanassessor2 > meanassessor3). Between assessor 1 and assessor 3, significant differences were observed in undoing buttons (P = 0.034) and in page turning (P = 0.003); assessor 3 recorded lower means.

In all ADLs, task times varied within the RC ≤ 6.07 seconds, except for the undo buttons (task in which RC = 24.1 seconds). The relative RCs were > 75% in the majority of ADLs. For four tasks, the relative RCs were ≤ 75%: pick up coins, pour water from jug, pour water from carton, and move a tray.

Discussion

This is the first study to adapt the SHAP for pediatric use and assessed reliability of this adapted version, the SHAP-C. Children were able to perform all SHAP-C tasks using the corresponding objects (including the downsized objects). The task means were significantly different in 7/26 tasks when a single assessor tested twice and in 7/26 tasks when three different assessors tested (P-values < 0.05). The intra-rater reliability of the SHAP-C was relatively better compared with the inter-rater reliability. Variation values within the same assessor, the RCs, had percentages < 75% in 17 out of 26 SHAP-C tasks (7/12 abstract objects tasks and 10/14 ADL tasks), indicating a relatively good repeatability of the procedure within the same assessor, at least in ADL tasks. The time scores per task varied largely between the three assessors. In 22/26 SHAP-C tasks, the RCs were higher than 75% of the task mean, thus revealing, poor SHAP-C repeatability. The small differences in task means on a group level indicate that the SHAP-C can be used for group comparisons. However, in clinical practice on an individual level, the SHAP-C may be used when one assessor is engaged but with considerable within-subject variation (Table 3). The SHAP-C should be used with caution when more assessors are engaged. Further adjustments are required to provide clinicians with a reliable SHAP-C.

In the current study, the mean values for the abstract objects of the SHAP-C tasks are much lower than the means of the SHAP tasks in adults (overall meansSHAP-C < 1.21 seconds vs. meansSHAP > 1.58 seconds) [28]. This discrepancy is most likely because timing of the SHAP-C tasks was differently executed than in the SHAP (timing by the assessor vs. self-timing). Compared with the SHAP, the SHAP-C means do not include the times of two phases: (1) stopwatch activation–reaching-the-object and (2) after-release of the object–stopping the stopwatch. On the other hand, the SHAP-C means in more complex ADL tasks were overall higher than those of SHAP in adults (e.g., pick up coins, undo buttons, or food cutting, meansSHAP-C = 5.64-19.13 seconds vs. meansSHAP = 3.12-6.77 seconds) [28]. This finding of children being slower than adults in executing complex tasks is in line with the reports in literature explaining age-related differences in (neuro) motor development (e.g., maturation of neural cortex gradually over time) [31, 32]. Nevertheless, our means for the SHAP-C tasks represent the first estimations of norm values. Because of the observed variability in task times (Tables 2 and 3), a larger sample is required to determine the norms once the SHAP-C protocol is more definitive.

Bland and Altman recommended the use of RC to determine consistency in outcomes of a measurement instrument [29, 33]. The precision of an RC over the Pearson’s correlation coefficient and intra-class correlation has been highlighted [29, 34]. There are, however, no standardized rules for interpretation of RCs. The suggested approach is that the lower the RCs are, the better the repeatability of the instrument is. The comparison of the RC to the minimum clinically important difference/change (MCID) would indicate good reliability of the instrument if the RC < MCID and vice-versa [34]. In the absence of MCID values for the SHAP or SHAP-C, we chose to represent the RCs in percentages relative to the task means as used by others [35, 36]. The relative RCs quantify the degree of agreement between different or single assessors and facilitate the interpretation of RCs. The cut-off point for the relative RC (75%) was chosen arbitrarily; higher (80%) and lower (50%) cut-off points have been reported previously [35, 36]. Thus, one may shift the cut-off value and interpret the RCs found in this study accordingly. Using a cut-off point of 80% for our relative RCs, for example, would have not changed the current results because all non-reliable tasks had relative RCs higher than 80%.

Intra-rater reliability

The majority of tasks were reliable (relative RCs < 75% in 17/26 tasks) for assessor 1. In comparison with the adult version of the SHAP intra-rater reliability, we found approximately the same amount of less replicable tasks. In the SHAP, seven tasks have been found to be less reliable (light power, light tip, heavy extension, page turning, pour water from carton, rotate a key 90°, rotate a screw 90°), but not to a significant extent [28]. In the SHAP-C, nine tasks were significantly less reliable (light power, light tip, light extension, heavy tripod, heavy power, undo buttons, food cutting, rotate a key 90°, and open/close a zip). The difference in less-reliable tasks between adults and children may be due to age differences in motor abilities with the upper limb [31, 32]. For instance, rotating a screw 90° requires fine-motor skills. In adults, the hand motor skills have been acquired to a different extent, thus the variability when rotating a screw, whereas the tested children did not vary in this task.

Interestingly, five of the SHAP-C tasks with relative RCs > 75% were abstract object tasks. In the context of SHAP-C tasks being timed by the assessor, a possible explanation might be the variation in the assessor’s reaction time, especially in rapidly executed tasks involving abstract objects (< 1.2 seconds). The literature reports a response time of 0.18-0.20 seconds after visual stimuli and that many factors account for reaction response: practice, gender, age, fatigue, distraction, and even breathing cycle [37]. Practice might have had a role. The first measurement of the same assessor most likely served as practice and led to lower scores (faster performance) in the second measurement. We cannot exclude the fact that learning effects of SHAP-C tasks within a child might have occurred, but distinguishing learning effects from the reaction time of the assessor is not possible in this case.

An alternative, more objective method for SHAP-C data collection would be to use a different timing system. Possibly, a system that recognizes a certain opening of the thumb-index finger angle or the lifting of the hand from the table, in combination with sensors able to detect movement of position of the objects, would time the performance more accurately. Solutions for recording performance accurately can be extended to computerized systems able to depict the hand positions and objects’ shapes [38]. The inclusion of kinematic measurements would provide information about the movement time and quality of the movement. Each abstract object task may also be executed repeatedly in a certain amount of time (e.g., 10 seconds) and the number of execution times rated accordingly as in the pegboard hand-dexterity test, for example [39]. However, the mentioned solutions would increase the assessment time, costs, and dimensions of the SHAP-C kit, which is beyond the SHAP/SHAP-C purpose. With the disadvantage of increasing the time needed to determine the functionality scores, the simplest and most inexpensive approach would be to videotape the performance. Afterward, the task times could be accurately evaluated from the recordings, as has been previously accomplished for pediatric functionality tests [22, 23]. Although we avoided introduction of procedures that increase data-collection or analysis time, our results suggest that these types of changes might be necessary after all, as the influence of the assessor would be diminished considerably.

Inter-rater reliability

Clinically, the RCs of 0.58-1.20 seconds observed in abstract object tasks would be a negligible variation, but relative to the task means, this variation was rather large (≥ 75%). In this case, again, the reaction time might have had an influence on the abstract object task times [37]. Moreover, the practice experience was different across our assessors. Two of the assessors had extended experience with applying SHAP. Assessor 2, on the other hand, had no previous experience and taking into account the findings–the means of assessor 2 differed in several tasks (Table 3)–the assessors may require a longer training period prior to applying the SHAP-C. The training might include studying instructional movies centralized on an online database as in the case of the SHAP [26]. Creating a benchmark test to evaluate assessors’ instructional and data-collection skills after the training would ensure a level of proficiency when applying the SHAP-C.

Furthermore, distraction, another risk-factor for variation in performance [37], might have affected our participants. Engaging 5-y/o children in performing tasks requires good motivational techniques. Our assessors used intrinsic motivation by stimulating a playful atmosphere [40] and extrinsic motivation by rewarding performance with positive reinforcement, candy, allowing the child to color, draw or offering an animal sticker. However, the motivation of some children varied during different tasks and sessions, especially in ADLs, causing delays in performance, and thus the variability in task times. One study referred to SHAP tasks as being unattractive for children [16]. If this is the case, then substituting current SHAP-C tasks with tasks simulating activities of child play [16] and using colorful objects may improve motivation and reduce distraction. Furthermore, the necessity of providing clear instructions and using good motivational techniques in children has been emphasized in the literature about other measurement instruments for pediatric hand functionality [41]. The flow theory provides some suggestions on how to stimulate intrinsic motivation in children: use age-appropriate tasks, promote a ‘fun’ environment, provide the possibility for the children to control some of the tasks (e.g., allowing them to choose an object/task that they want to continue with), set clear and achievable goals for the tasks, and avoid negative feedback (oral or non-verbal) [42].

The observed variability of the SHAP-C means may be partly explained by the variability in (neuro) motor development in preschool children up to adolescence [43–45]. Therefore, the scores on functionality assessments have to be interpreted bearing in mind this variability in children [46]. Importantly, the timed performances in children require a standardized test, well-trained assessors, and norms for different age categories [47].

Summarizing the steps to be considered for improving reliability of SHAP-C, future research has to identify an appropriate a data-collection method that will diminish the assessor’s influence. In addition, researchers have to consider providing information to the assessors about techniques to improve motivation of children, either in the form of training or including motivational techniques in the instructions for the SHAP-C protocol.

A limitation of this study would be the relatively small sample size. Although the SHAP reliability was also determined with 24 participants [1], we feel that for pediatric populations, a larger sample size is necessary to determine the SHAP-C norms and reliability. The study design for the inter-rater reliability is limited by the fact that data were collected on separate days. A more adequate design would involve simultaneously timing of the performance of the participant by the three assessors, but the task instructions being performed by one assessor would result in potential bias for the measurements of the other two assessors. In addition, having three assessors in the same room would be overwhelming for a child. Another alternative would be to measure the participants on the same day, three times with different assessors. However, this approach was not possible because of the limited availability of the children during school hours. More importantly, fatigue and disinterest may occur if children are requested to repeat 26 tasks three times in one day. Videotaping the performance might solve this issue of three consecutive sessions and limit measurements to one-time session. In addition, the order of assessors was the same per participant and measurement day. Therefore, the task means might have been affected by the order of the assessors and/or by the measurement day. For practicality reasons, we could not randomize assessors per measurement day, but further studies should consider randomizing the assessors.

A future approach for assessing inter-rater reliability of the SHAP-C in children may consider the following: (1) allowing each child to perform the SHAP-C once with a randomly assigned assessor and (2) live broadcasting the performance of the participants to the other assessors that will measure simultaneously the performance. This way, the children will not be solicited more than once and by more than one assessor, and the possible bias of rating performance of the participants that received instructions from another assessor will be evenly distributed throughout the data.

Another limitation of this study is the inability to estimate the norms for the prehensile patterns of FP and IOF that are of interest to clinicians. Based on the means and standard deviations in our study, the estimates of norms for prehensile patterns of FP and the IOF could have been calculated, but the formulas for such calculations [1, 26, 28, 48] are not clear for us nor to our statistician. Not having the exact procedure for determining the norm values that are needed for the calculation of FP z-scores and IOF z-scores made the calculation of FP and IOF impossible for the SHAP-C data. Explanations regarding the formulas were denied to us because of the holders’ exclusive rights on the SHAP (intellectual property).

The sizes of the objects were not systematically evaluated. Therefore, research is also needed to determine the appropriate size of the objects for the hands of older children (> 6 y/o), for larger prosthetic hands with an opening width > 5 cm or for spastic hands with an opening < 5 cm. In addition, clinimetric properties should be studied in older children because of changes in performance with age [49]. The reliability of the SHAP-C should be evaluated in different impaired hands and in prosthetic users because the SHAP was also designed for use with such patients [1]. The evaluation of learning effects of the SHAP-C in prosthetic users would be valuable for clinicians repeatedly using the SHAP-C.

Conclusions

Adjusting SHAP objects to allow grasping with normal and prosthetic hands in 4- to 6-y/o children was performed successfully. Participants were able to perform all of the SHAP-C tasks with means from 0.64 to 19.13 seconds for the tasks. The intra-rater reliability was relatively good in comparison with the inter-rater reliability. However, more adjustments of the protocol are needed to ensure the reliability of the SHAP-C, to improve the motivation of children, to minimize the assessor influence, and to determine the norms.

Abbreviations

SHAP:

Southampton Hand Assessment Procedure

SHAP-C:

Southampton Hand Assessment Procedure for Children

IOF:

Index of function

FP:

Functionality profile

ADL:

Activities of daily living

y/o:

Years old

RC:

Repeatability coefficient

SD:

Standard deviation.

References

  1. Light CM, Chappell PH, Kyberd PJ: Establishing a standardized clinical assessment tool of pathologic and prosthetic hand function: Normative data, reliability, and validity. Arch Phys Med Rehabil. 2002, 83 (6): 776-783. 10.1053/apmr.2002.32737.

    Article  PubMed  Google Scholar 

  2. Van der Niet O, Reinders-Messelink HA, Bongers RM, Bouwsema H, Van Der Sluis CK: The i-LIMB hand and the DMC plus hand compared: A case report. Prosthet Orthot Int. 2010, 34 (2): 216-220. 10.3109/03093641003767207.

    Article  Google Scholar 

  3. van der Niet O, Bongers RM, van der Sluis CK: Functionality of i-LIMB and i-LIMB Pulse hands: Case report. J Rehabil Res Dev. 2013, 50 (8): 1123-1128. 10.1682/JRRD.2012.08.0140.

    Article  PubMed  Google Scholar 

  4. Metcalf CD, Woodward H, Wright V, Chappell PH, Burridge JH, Yule VT: Changes in hand function with age and normative unimpaired scores when measured with the Southampton Hand Assessment Procedure. Hand Therapy. 2008, 13 (3): 79-83.

    Google Scholar 

  5. Kyberd PJ: The influence of control format and hand design in single axis myoelectric hands: Assessment of functionality of prosthetic hands using the Southampton Hand Assessment Procedure. Prosthet Orthot Int. 2011, 35 (3): 285-293. 10.1177/0309364611418554.

    Article  PubMed  Google Scholar 

  6. Kyberd PJ, Murgia A, Gasson M, Tjerks T, Metcalf C, Chappell PH, Warwick K, Lawson SEM, Barnhill T: Case studies to demonstrate the range of applications of the Southampton Hand Assessment Procedure. Br J Occup Ther. 2009, 72 (5): 212-218.

    Article  Google Scholar 

  7. Bouwsema H, Kyberd PJ, Hill W, van der Sluis CK, Bongers RM: Determining skill level in myoelectric prosthesis use with multiple outcome measures. J Rehabil Res Dev. 2012, 49 (9): 1331-1348. 10.1682/JRRD.2011.09.0179.

    Article  PubMed  Google Scholar 

  8. Ramirez IA, Lusk CP, Dubey R, Highsmith MJ, Maitland ME: Crossed four-bar mechanism for improved prosthetic grasp. J Rehabil Res Dev. 2009, 46 (8): 1011-1020. 10.1682/JRRD.2009.01.0004.

    Article  PubMed  Google Scholar 

  9. Dalley SA, Bennett DA, Goldfarb M: Preliminary functional assessment of a multigrasp myoelectric prosthesis. Conf Proc IEEE Eng Med Biol Soc. 2012, 2012: 4172-4175.

    PubMed  PubMed Central  Google Scholar 

  10. Johnson A: Prevalence and characteristics of children with cerebral palsy in Europe. Dev Med Child Neurol. 2002, 44 (9): 633-640.

    Article  Google Scholar 

  11. Vasluian E, van der Sluis CK, van Essen AJ, Bergman JE, Dijkstra PU, Reinders-Messelink HA, de Walle HE: Birth prevalence for congenital limb defects in the northern Netherlands: A 30-year population-based study. BMC Musculoskelet Disord. 2013, 14 (1): 323-10.1186/1471-2474-14-323.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Lillis KA, Jaffe DM: Playground injuries in children. Pediatr Emerg Care. 1997, 13 (2): 149-153. 10.1097/00006565-199704000-00016.

    Article  CAS  PubMed  Google Scholar 

  13. Bourke-Taylor H: Melbourne Assessment of Unilateral Upper Limb Function: Construct validity and correlation with the Pediatric Evaluation of Disability Inventory. Dev Med Child Neurol. 2003, 45 (2): 92-96.

    Article  PubMed  Google Scholar 

  14. Gilmore R, Sakzewski L, Boyd R: Upper limb activity measures for 5- to 16-year-old children with congenital hemiplegia: A systematic review. Dev Med Child Neurol. 2010, 52 (1): 14-21. 10.1111/j.1469-8749.2009.03369.x.

    Article  PubMed  Google Scholar 

  15. Thorley M, Lannin N, Cusick A, Novak I, Boyd R: Construct validity of the Quality of Upper Extremity Skills Test for children with cerebral palsy. Dev Med Child Neurol. 2012, 54 (11): 1037-1043. 10.1111/j.1469-8749.2012.04368.x.

    Article  PubMed  Google Scholar 

  16. Buffart LM, Roebroeck ME, Pesch-Batenburg JM, Janssen WG, Stam HJ: Assessment of arm/hand functioning in children with a congenital transverse or longitudinal reduction deficiency of the upper limb. Disabil Rehabil. 2006, 28 (2): 85-95. 10.1080/09638280500158406.

    Article  PubMed  Google Scholar 

  17. Hill W, Kyberd P, Hermansson LN, Hubbard S, Stavdahl O, Swanson S: Upper Limb Prosthetic Outcome Measures (ULPOM): A working group and their findings. J Prosthet Orthot. 2009, 21 (Supplement): 69-82. 10.1097/JPO.0b013e3181ae970b.

    Article  Google Scholar 

  18. Hubbard S: Pediatric upper limb outcome measurement. J Prosthet Orthot. 2009, 21 (9): 227-231.

    Google Scholar 

  19. Hermansson LM, Bodin L, Eliasson AC: Intra- and inter-rater reliability of the Assessment of Capacity for Myoelectric Control. J Rehabil Med. 2006, 38 (2): 118-123. 10.1080/16501970500312222.

    Article  PubMed  Google Scholar 

  20. Wright FV: Evidence note: Upper-Limb Prosthetic Outcome Measures. Acad Today Adv Orthotic Prosthet Orthot Int. 2013, 9: 1-

    Google Scholar 

  21. Wagner LV, Davids JR: Assessment tools and classification systems used for the upper extremity in children with cerebral palsy. Clin Orthop Relat Res. 2012, 470 (5): 1257-1271. 10.1007/s11999-011-2065-x.

    Article  PubMed  Google Scholar 

  22. Bagley AM, Molitor F, Wagner LV, Tomhave W, James MA: The Unilateral Below Elbow Test: A function test for children with unilateral congenital below elbow deficiency. Dev Med Child Neurol. 2006, 48 (7): 569-575. 10.1017/S0012162206001204.

    Article  PubMed  Google Scholar 

  23. Krumlinde-Sundholm L, Holmefur M, Kottorp A, Eliasson AC: The Assisting Hand Assessment: Current evidence of validity, reliability, and responsiveness to change. Dev Med Child Neurol. 2007, 49 (4): 259-264. 10.1111/j.1469-8749.2007.00259.x.

    Article  PubMed  Google Scholar 

  24. Wright V: Prosthetic outcome measures for use with upper limb amputees: A systematic review of the peer-reviewed literature, 1970 to 2009. J Prosthet Orthot. 2009, 21 (4S): 3-P63.

    Article  Google Scholar 

  25. Lindner HY, Natterlund BS, Hermansson LM: Upper limb prosthetic outcome measures: Review and content comparison based on International Classification of Functioning, Disability and Health. Prosthet Orthot Int. 2010, 34 (2): 109-128. 10.3109/03093641003776976.

    Article  PubMed  Google Scholar 

  26. Southampton Hand Assessment Procedure. [http://www.shap.ecs.soton.ac.uk]

  27. Assessors’ Protocol: Southampton Hand Assessment Procedure. [http://www.shap.ecs.soton.ac.uk/files/protocol.pdf]

  28. Light CM: An intelligent hand prosthesis and evaluation of pathological and prosthetic hand function. PhD thesis. 2000, UK: University of Southampton

    Google Scholar 

  29. Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.

    Article  CAS  PubMed  Google Scholar 

  30. Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res. 1999, 8 (2): 135-160. 10.1191/096228099673819272.

    Article  CAS  PubMed  Google Scholar 

  31. Piek JP, Hands B, Licari MK: Assessment of motor functioning in the preschool period. Neuropsychol Rev. 2012, 22 (4): 402-413. 10.1007/s11065-012-9211-4.

    Article  PubMed  Google Scholar 

  32. Dotan R, Mitchell C, Cohen R, Klentrou P, Gabriel D, Falk B: Child-adult differences in muscle activation–a review. Pediatr Exerc Sci. 2012, 24 (1): 2-21.

    PubMed  PubMed Central  Google Scholar 

  33. Altman DG, Bland JM: Measurement in medicine: The analysis of method comparison studies. The Statistician. 1983, 32: 307-317. 10.2307/2987937.

    Article  Google Scholar 

  34. Vaz S, Falkmer T, Passmore AE, Parsons R, Andreou P: The case for using the repeatability coefficient when calculating test-retest reliability. PLoS One. 2013, 8 (9): e73990-10.1371/journal.pone.0073990.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Jorritsma W, Dijkstra PU, de Vries GE, Geertzen JH, Reneman MF: Physical dysfunction and nonorganic signs in patients with chronic neck pain: Explorative study into interobserver reliability and construct validity. J Orthop Sports Phys Ther. 2014, 0: 1-32.

    Google Scholar 

  36. Tunset A, Kjaer P, Samir Chreiteh S, Secher Jensen T: A method for quantitative measurement of lumbar intervertebral disc structures: An intra- and inter-rater agreement and reliability study. Chiropr Man Therap. 2013, 21 (1): 26-709X-21-26-

    Article  Google Scholar 

  37. Kosinski RJ: A literature review on reaction time. [http://biae.clemson.edu/bpc/bp/Lab/110/reaction.htm]

  38. Vatavu R, Zaiţi IA: Automatic recognition of object size and shape via user-dependent measurements of the grasping hand. Int J Human-Computer Stud. 2013, 71 (5): 590-607. 10.1016/j.ijhcs.2013.01.002.

    Article  Google Scholar 

  39. Gallus J, Mathiowetz V: Test-retest reliability of the Purdue Pegboard for persons with multiple sclerosis. Am J Occup Ther. 2003, 57 (1): 108-111. 10.5014/ajot.57.1.108.

    Article  PubMed  Google Scholar 

  40. Department for Children, Schools and Families (DCSF): Learning, playing and interacting: Good practice in the early years foundation stage. 2009, Nottingam: DCSF, [http://dera.ioe.ac.uk/id/eprint/2412]

    Google Scholar 

  41. Jongbloed-Pereboom M, Nijhuis-van der Sanden MW, Steenbergen B: Norm scores of the box and block test for children ages 3–10 years. Am J Occup Ther. 2013, 67 (3): 312-318. 10.5014/ajot.2013.006643.

    Article  PubMed  Google Scholar 

  42. Mandigo J, Thompson L: Go with their flow: How Flow Theory can help practitioners to intrinsically motivate children to be physically active. Phys Educ. 1998, 55: 29-November 2013

    Google Scholar 

  43. Darrah J, Senthilselvan A, Magill-Evans J: Trajectories of serial motor scores of typically developing children: Implications for clinical decision making. Infant Behav Develop. 2009, 32 (1): 72-78. 10.1016/j.infbeh.2008.10.001.

    Article  Google Scholar 

  44. Largo RH, Fischer JE, Rousson V: Neuromotor development from kindergarten age to adolescence: Developmental course and variability. Swiss Med Wkly. 2003, 133 (13–14): 193-199.

    CAS  PubMed  Google Scholar 

  45. da Costa CSN, Batistão MV, Rocha NACF: Quality and structure of variability in children during motor development: A systematic review. Res Dev Disabil. 2013, 34 (9): 2810-2830. 10.1016/j.ridd.2013.05.031.

    Article  PubMed  Google Scholar 

  46. Darrah J, Hodge M, Magill-Evans J, Kembhavi G: Stability of serial assessments of motor and communication abilities in typically developing infants—implications for screening. Early Hum Dev. 2003, 72 (2): 97-110. 10.1016/S0378-3782(03)00027-6.

    Article  PubMed  Google Scholar 

  47. Largo RH, Caflisch JA, Hug F, Muggli K, Molnar AA, Molinari L, Sheehy A, Gasser ST: Neuromotor development from 5 to 18 years. Part 1: Timed performance. Dev Med Child Neurol. 2001, 43 (7): 436-443. 10.1017/S0012162201000810.

    Article  CAS  PubMed  Google Scholar 

  48. Metcalf CD: The relationship between movement and function of the wrist and hand: A clinically focused kinematic study. PhD thesis. 2008, UK: University of Southampton

    Google Scholar 

  49. Adolph KE, Berger SA: Motor development. Handbook of child psychology: Cognition, perception, and language. Volume 2. Edited by: Kuhn D, Siegler RS. 2006, New York: Wiley, 161-213. 6

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors thank Juliet Visser (Human Movement Sciences, University of Groningen, The Netherlands), Charissa Jessurun, and Sietske Romkema (Rehabilitation Medicine, UMCG, The Netherlands) for their contribution to data collection and assistance during the measurements. The OIM Orthopedie Haren (The Netherlands, http://www.oim.nl) is thanked for manufacturing/adapting the objects used in the measurements and for making the prosthetic simulator.

The study was financed by grants from ZonMW (number 60-62300-98-119, http://www.zonmw.nl/en), Fonds Nuts Ohra (number 1103–029, http://www.stichtingnutsohra.nl), Revalidatiefonds (number R2011147, http://www.revalidatiefonds.nl), Stichting Beatrixoord (number 210.130, http://www.stichtingbeatrixoord.nl), and OIM Stichting (number 1103, http://www.oim.nl/over-oim/organisatie/oim-stichting). The funding parties had no involvement in the collection, analysis, and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ecaterina Vasluian.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

EV, CvdS, HRM, and RB contributed to the design of the study. EV collected the data. EV, PD, and HRM contributed to the analysis of the data. EV wrote the paper. All authors have revised this manuscript for important intellectual content and have approved it for submission.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vasluian, E., Bongers, R.M., Reinders-Messelink, H.A. et al. Preliminary study of the Southampton Hand Assessment Procedure for Children and its reliability. BMC Musculoskelet Disord 15, 199 (2014). https://doi.org/10.1186/1471-2474-15-199

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2474-15-199

Keywords