EVALUATING COGNITIVE READINESS FOR POWERED
WHEELCHAIR MOBILITY IN THE YOUNG CHILD
DONITA TEFFT, M.A.,CCC-SP; JAN FURUMASU, PT; PAULA GUERETTE, PHD
RERC ON TECHNOLOGY FOR CHILDREN WITH ORTHOPEDIC DISABILITIES
RANCHO LOS AMIGOS MEDICAL CENTER, DOWNEY, CALIFORNIA

 

Previous research in developmental psychology has found that the ability to move about independently is a critical facilitator in a child's development and can impact cognitive, social, and communication skills. Due to limited availability of clinical assessment instruments, it is often difficult to determine when a young child with mobility impairments may be developmentally ready to operate a powered wheelchair functionally. A study is currently being completed that investigates cognitive readiness for powered mobility in young children with orthopedic disabilities. The goals of the study were to develop an assessment battery that evaluates cognitive developmental skills that are influential in powered mobility and to develop an age-appropriate powered mobility program which introduces and evaluates powered mobility skills. The development, components, and preliminary reliability results of the assessment tool are described in this paper. For information on the powered mobility program, refer to Pediatric Powered Mobility: Readiness to Learn in these proceedings.

APPROACH

Participants

Twenty-six children participated in the study, consisting of twenty males and six females. In order to minimize the influence of sensorimotor integration problems on powered mobility, children with diagnoses that impair primarily physical abilities only were included. Table 1 presents the frequency of diagnoses. Diagnoses classified as 'other' include polio, burn/amputee, spinal bifida, femur hyplasis syndrome, osteogenesis imperfecta. The ages of the children ranged from 20 months to 36 months, with the average age of 28.3 months.

TABLE 1. PARTICIPANT DIAGNOSES


 
 
Diagnosis
Frequency
Arthrogryposis
9
Spinal Muscular Atrophy/Congenital Myopathy
9
Quadriplegia
3
Other
 5

Assessment Battery Development

The cognitive assessment battery was a Piagetian-based tool consisting of five scales evaluating the different skill domains of cause/effect, object permanence, problem solving, spatial relations, and symbolic play. This approach was selected as Piaget's theory of sequential stage development within distinctly different skill domains is a well researched, validated theory of early childhood development, and has been found to be appropriate for children with a diverse range of disabilities (1). Another reason for selection of a Piagetian-based tool was that this type of assessment renders scores for each specific domain of development. This would allow a comparison of scores on specific domains to wheelchair performance.

An assessment battery was developed since no single existing assessment tool met the study's requirements (i.e., Piagetian-based, appropriate for ages 18-36 months, does not penalize children with physical limitations). The assessment battery incorporated tasks from several standardized developmental batteries.(1,2,3,4,5) This battery was then pilot-tested on three children and further revisions were made. The final battery included eighty-three tasks (See Table 2 for example items).

TABLE 2. SAMPLE COGNITIVE TEST ITEMS


 
Cognitive Domain
Developmental Age
Test Items
Cause/Effect
21 months
Searches for causal mechanism needed to activate a mechanical toy.
Object Permanence
22 months
Searches for and obtains object hidden invisibly under the last of three screens.
Problem Solving
24 months
Shows foresight by NOT stacking solid ring on pole.
Spatial Relations
26 months
Able to nest 4 cups.
Symbolic Play
30-36 months
Demonstrates sequenced events with familiar toys.

Since the battery was to be administered to children with physical limitation, it was essential that the response requirements not penalize the children. Items were modified to accommodate a child's functional limitations; however, care was taken to insure that the basic task premise always remained the same. For example, the spatial relations task of nesting cups, which evaluated a child's awareness of size differences, required children to lift and nest commercially available plastic cups of various sizes. During the assessment of children too weak or with poor grasp to lift the cups, miniature cups were created and substituted. For a problem solving task that required children to stack large plastic rings on a long plastic stick, small styrofoam rings and a shorter dowel rod were substituted.

Administration

Information from family and professionals was reviewed prior to assessment to determine appropriate positioning supports or requirements and need for modification of toys. Generally, all items on one scale were administered before beginning the next scale. However, the battery allowed deviation from this protocol as necessary to maintain the child's attention. The battery also allowed a variety of toys to be used to maintain a child's interest. Each item was administered one or more times, depending upon the number of correct responses required to score a task as 'successfully completed'. Items were scored on a 3-point scale, ranging from ‘successfully completed’, to ‘emerging’, to ‘not successfully completed’. Final scores in each scale indicated the highest developmental level that a child consistently demonstrated in that scale. The test was administered over one to three sessions, depending upon the child's attention span. All sessions were completed within a two week time period. Sessions were videotaped and later reviewed and scored.

RESULTS

Data from 10 children were scored independently by two raters to establish an index of interrater agreement on the cognitive assessment battery. In addition, the responses made by 9 children were rescored 8 to 12 months later to determine 'drift' in ratings. To assess test-retest reliability, three children were re-evaluated two weeks after the initial testing.

Interrater agreement

The Kappa statistic was used to determine the proportion of agreement between raters.(6) Kappa scores ranged from .64 to .86 across the five scales (see Table 3). Scores were then tested against the hypothesis that the agreement is only that predicted by chance. Scores for all five domains were found to have significant agreement above chance. Kappa scores of .75 and above represent excellent interrater agreement above chance, and scores between .40 and .75 represent fair to good agreement above chance.(7)

TABLE 3. INTERRATER AGREEMENT ACROSS DEVELOPMENTAL DOMAINS
Cognitive domain
Kappa
Z-score
Object permanence
0.64
2.14*
Cause/effect
0.70
3.13**
Problem solving
0.86
2.75**
Spatial relations
0.85
2.86**
Symbolic play
0.84
2.89**

*p<.05, **p <.01

Drift

The Kappa statistic was also used to determine consistency of intraobserver rating over time. Kappa scores for drift ranged from .54 to .86. The consistency of ratings for all the cognitive domains were significantly above chance. The Kappas for object permanence, problem solving and spatial relations fell into the category considered to be excellent agreement above chance and the scores for cause/effect and symbolic play fell in the fair to good consistency range.

Test-retest reliability

The consistency of children's performance on individual items was determined by using the Kappa statistic. While the number of children was small, there was nevertheless significant consistency in responses across the two test administrations for four of the domains, and marginally significant consistency in the fifth domain (i.e., spatial relations). Table 4 shows the Kappa scores for test-retest reliability.

TABLE 4. Test-Retest Reliability.

Cognitive domain
Kappa
Z-score
Object permanence
1
**
Cause/effect
1
**
Problem solving
0.73
2.51**
Spatial relations
0.85
1.36^
Symbolic play
0.90
1.64*
^p<.10, *p<.05, **p <.01

 

Ongoing data analysis

It has been suggested that the Rasch measurement techniques are ideal for applications in early childhood assessments.(8) This technique has recently been used to scale several popular assessment batteries. Currently, the Rasch analysis is being applied to the developmental data in the cognitive assessment domains in order to establish the hierarchical nature of the items and to eliminate misfit items. Items which all children or no children performed correctly will also be eliminated because they provide no discrimination among the children's abilities. Following the Rasch analysis of the developmental assessment battery, the scores on the edited developmental domains will be used in a regression analysis to predict scores in the powered mobility program. This will allow identification of important cognitive skills influential in functional powered wheelchair mobility.

DISCUSSION

A Piagetian-based assessment tool was created to evaluate cognitive developmental skills in children with orthopedic disabilities and to help delineate important cognitive developmental skills influential in readiness to learn powered mobility. Interrater agreement and intraobserver drift were found to have significant agreement above chance for all domains. Test-retest reliability indicated significant consistency across two test administrations for four of the domains, and marginally significant reliability in the fifth domain. At this date, data analysis on the assessment battery continues utilizing the Rasch analysis in order to further improve the battery's reliability. A regression analysis will then be conducted to correlate scores on the edited assessment battery with scores from a powered mobility program.

Independent mobility allows young children with physical disabilities to be more fully integrated into appropriate educational programs and can lead to enhanced psychosocial and cognitive development. Identifying cognitive skills influential in the functional operation of a powered wheelchair will aid clinicians in the decision making process when prescribing a powered wheelchair. Therapists and families can also target and develop important cognitive skills early in the child's developmental program through appropriate developmental play activities. Continued documentation of very young children's abilities to safely operate powered wheelchairs is also important in this time of managed health care. A next step is to conduct research in this area in order to provide appropriate assessment and intervention strategies for those individuals with physical as well as cognitive and/or sensorimotor integration impairments.


ACKNOWLEDGEMENTS

Funding for research was provided by the National Institute on Disability and Rehabilitation Research, U.S. Department of Education, Grant No. H133E00015. Opinions expressed in this paper are those of the authors and should not be construed to represent opinions or policies of NIDRR.


REFERENCES

1. Dunst, C. (1980). A Clinical and Educational Manual for Use with the Uzgiris and Hunt Scales of Infant Psychological Development. Austin, TX: Pro-Ed.

2. Bayley, N. (1969). Bayley Scales of Infant Development. New York: Psych Corporation.

3. Knobloch, H., Stevens, F., Malone, A. (1980). Manual of Developmental Diagnosis. Hagerstown, MA: Harper and Row.

4. Uzgiris, I., Hunt, J. (1975). Assessment in Infancy: Ordinal Scales of Psychological Development. Urbana: University of Illinois Press.

5. Westby, C. (1988). Children's play: Reflections of social competence. Seminars in Speech and Language, 9, 1-14.

6. Fleiss, J.L. (1981). Statistical Methods for Rates and Proportions, 2nd Edition. New York: John Wiley and Sons.

7. Landis, J.R. and Koch, G.G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33, 159-174.

8. Snyder, S. and Sheehan, R. (1992). The Rasch measurement model: An introduction. Journal of Early Intervention, (16)1, 87-95.

Donita Tefft

CART

Rancho Los Amigos Medical Center

7601 E. Imperial Highway

Downey, CA 90242 USA