Professional Documents
Culture Documents
The Importance of Setting Goals - The Effect of Instruction and Training On The Technical and Intrinsic Quality of Goals
The Importance of Setting Goals - The Effect of Instruction and Training On The Technical and Intrinsic Quality of Goals
The Importance of Setting Goals - The Effect of Instruction and Training On The Technical and Intrinsic Quality of Goals
To cite this article: Petra Poppes , Carla Vlaskamp , Karin I. de Geeter & Han
Nakken (2002) The importance of setting goals: the effect of instruction and
training on the technical and intrinsic quality of goals, European Journal of
Special Needs Education, 17:3, 241-250, DOI: 10.1080/08856250210162149
Taylor & Francis makes every effort to ensure the accuracy of all
the information (the “Content”) contained in the publications on our
platform. However, Taylor & Francis, our agents, and our licensors
make no representations or warranties whatsoever as to the accuracy,
completeness, or suitability for any purpose of the Content. Any opinions
and views expressed in this publication are the opinions and views of
the authors, and are not the views of or endorsed by Taylor & Francis.
The accuracy of the Content should not be relied upon and should be
independently verified with primary sources of information. Taylor and
Francis shall not be liable for any losses, actions, claims, proceedings,
demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in
relation to or arising out of the use of the Content.
This article may be used for research, teaching, and private study
purposes. Any substantial or systematic reproduction, redistribution,
reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access
and use can be found at http://www.tandfonline.com/page/terms-and-
conditions
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
Eur. J. of Special Needs Education, Vol. 17, No. 3 (2002), pp. 241–250
HAN NAKKEN
Department of Special Education, University of Groningen, 9712 TJ Groningen,
The Netherlands
ABSTRACT
KEYWORDS
INTRODUCTION
All educational centres for people with intellectual disabilities in The Netherlands are
required to establish Individualized Educational Plans (IEPs) for their students. The
use of the IEP has proved to be a valuable asset for a variety of reasons (Giangreco
et al., 1994; van Gemert and Vlaskamp, 1997; Collins, Mowbray and Bybee, 1999).
IEPs encourage staff to consider their students’ needs more carefully, as well as their
means of meeting them. The use of an IEP is also important in encouraging persons
with intellectual disabilities and their legal representatives to become more involved
in the educational process. Moreover, it makes the process easier to follow and manage
– i.e. there are established guidelines for both staff and persons with disabilities or their
legal representatives on how they should carry out their tasks. Because goals are listed
in the guidelines, it is possible to determine whether efforts have been made to achieve
them and which of the goals have been met. This makes the IEP a useful instrument
for assessing which investments in time and money are worthwhile. Finally, the
literature (Giangreco et al., 1994; van Gemert and Vlaskamp, 1997; Collins et al.,
1999) demonstrates that the use of an IEP helps staff from different elds work together
towards reaching common objectives.
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
(Vlaskamp, 1999). The course emphasized the type of education envisioned for
children with profound multiple disabilities, as well as the formulation and evaluation
of the goals. Our study investigated whether educating and training teachers and
therapists in establishing goals leads to a discernible improvement in the technical and
intrinsic qualities of the goals described in IEPs.
METHOD
Study Group
Eighteen teachers and sixteen therapists were included in the study. All teachers were
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
fully trained in special education, and therapists were considered specialists in their
eld. Both teachers and therapists were responsible for the goals in IEPs of 48 children
with profound multiple disabilities, with a range in age from two to 20 years. The
children had profound intellectual as well as severe or profound motor disabilities. All
children were bound to their wheelchairs and had limited use of their hands and arms.
A considerable percentage of the children had severe (usually cerebral) visual impair-
ments, whereas hearing impairments were much less frequent. Almost half of the
children suffered from epilepsy.
During the day, the children in the study participated in the activities of eight
groups at ve centres for special education throughout The Netherlands. Initially,
seven centres were included in the study. However, two of them deviated from the
programme’s procedures: one reduced the time devoted to instruction by half, while
the other delayed the period between the course and the training (which is supposed
to begin immediately following the course) by more than three months. Data from
these centres were therefore not included in the study. The participating centres
for special education are intended exclusively for children with intellectual disabil-
ities. They do not have separate grades or group programmes, nor do they use a set
curriculum. They only use individualized programmes, based on IEPs. These centres
offer a wide range of activities, such as swimming, the training of various skills and a
variety of therapy (physiotherapy, occupational therapy, speech therapy and musical
therapy). The children benet from the fact that the teachers and therapists at these
centres for special education are professionals in their elds. All of the centres had
comparative standards and a similar array of activities and therapies. Each group had
an average ratio of two teachers for seven students. The number of activities and hours
of therapy per child were also similar. The children attended the centres from 9 a.m.
until 3.30 p.m.
Instruments
The quality of the goals was measured by the degree to which they met technical and
intrinsic criteria. The technical criteria (see Table 1) were those which met the accepted
requirements of goals as generally mentioned in the literature (Goodman and Bond,
1993; Giangreco et al., 1994; Schippers et al., 1998). A goal must be measurable in
terms of meeting xed standards – in other words, there must be a clear description
of what situation or skill should be attained. Goals must be applicable and realistic,
necessitating a clear description of the activities to be carried out to meet the objective.
The goal description should also mention the individual responsible for executing
the activities in order to attain the goal. An evaluation date must also be set. Setting
a date prevents the formulation of goals whose standards are either too low or too
244 European Journal of Special Needs Education, Vol. 17, No. 3 (2002)
demanding. Evaluation criteria are necessary for determining whether the goal has
been achieved.
Intrinsic criteria are of equal importance in contributing towards the quality of the
goals. Intrinsic criteria emphasize the importance of a link between the profile or
personal description, the perspective or long-term goals and the short-term goals. Two
intrinsic criteria have been added which are geared specically towards the group of
individuals in our study. For children with profound multiple disabilities it is of vital
importance that a relation is established between the goals (both intradisciplinary as
well as interdisciplinary) in order to ensure the continuity in the individual care process
(Ware and Healey, 1994; Vlaskamp, 1999). Teachers and therapists must agree with
the goals’ contents. Moreover, in order to prevent the inclusion of goals which either
contradict or exclude one another, it is essential that they be listed according to their
degree of importance or conditionality. The intrinsic criteria are listed in Table 2.
The established goals were judged by two independent observers on the basis of
technical and intrinsic criteria. The observers, all qualied child psychologists, were
familiar with the situation in these centres for special education. They were trained to
pass judgement on the established goals. Training ended after an agreement of over
80 per cent was found three times in succession.
The percentage of agreement of the results for each variable was calculated by
dividing the number of agreements by the total number of agreements and disagree-
ments and multiplying the outcome by 100. The nal rates of reliability varied from
80.7 to 99.6 per cent, with an average rate of 87.3 per cent. All variables met the
generally accepted criterion of 80 per cent.
Procedure
After the children’s parents granted the centres permission to release their children’s
IEPs, the researchers received the IEPs of 48 children. The goals listed in their IEPs,
all set before the training was given, were then evaluated on their technical and intrinsic
qualities.
An intervention in the centres was carried out successively, but all within ten weeks
after the evaluation of the IEPs. The intervention consisted of a two-day course
Goal setting for SEN students in The Netherlands 245
followed by on-the-job training in the formulation of goals. The total length of the
course was six hours, divided into three-hour sessions each day. Approximately three
hours were devoted to theory. During this session, the following topics were discussed:
the necessity of setting goals for children with profound multiple disabilities and the
intrinsic and technical criteria. Every topic was accompanied by exercises ; for example,
participants were given a list of goals and asked to determine whether the goals met
the technical criteria. Another three hours of the course were devoted to practising in
real-life situations. The participants brought their own case histories and discussed
with colleagues and the supervisor whether the goals they had set for their students
met the intrinsic and technical criteria. Subsequently, new goals were set for the
students.
The courses were provided to all teachers, therapists, psychologists and managers.
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
The number of participants ranged from ten to 30, depending on the number of groups
at the centre concerned. The courses were followed by on-the-job training where the
participants practised formulating and evaluating goals for each student. With the
supervision of a psychologist, the participants would on a monthly basis evaluate a
goal for each child and discipline and formulate new goals. The psychologist provided
detailed instructions on formulating goals in general, as well as in specic situations.
Twelve months after the intervention, the goals listed in the IEPs were again evaluated
on their technical and intrinsic qualities by the same two independent observers.
The same 18 teachers and 16 therapists participated in both trials. The number of
children was almost the same (48 in the pre-test and 49 in the post-test study
respectively). The study was conducted using a one-group pre-test/post-test design
(Cook and Campbell, 1979).
RESULTS
The results of the pre-test trial provide an analysis of the situation before the
intervention. The data showed that no goals had been determined for 15 IEPs (31 per
cent) in the study. For these 15 children some data concerning age, medical history
and the situation at home were available, but goals were not set. Only the 33 children
for whom an IEP including goals was available were included in the study. A total of
1 47 5 2 35 10
2 55 8 9 35 11
3 82 10 27 49 6
4 146 6 50 56 40
5 95 4 73 19 3
Total 425 33 161 (38%) 194 (46%) 70 (16%)
246 European Journal of Special Needs Education, Vol. 17, No. 3 (2002)
425 goals had been determined for these 33 children, an overall average of 13 goals
per child. The number of goals per child ranged from three to 42.
The 425 goals were evaluated according to the technical criteria for establishing
goals (see Table 3). Only 161 of the 425 goals (38 per cent) could be dened as a result
or effect, as, for example: ‘Karen chooses one of the two kinds of sandwiches available.’
The remaining goals did not meet the criterion ‘describing the desired result or effect’.
A total of 194 of the established goals (46 per cent) could be dened as activities, such
as ‘playing games’ or ‘stimulating the development of the senses’. The other 70 goals
(16 per cent) met the denition of a condition, such as ‘at meals, Richard must sit to
the right of Maria’.
Only the 161 goals which met the denition for result or effect were included in
the further technical analysis. Goals formulated as activities cannot be achieved with
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
activities, and it is also not logical to supply goals described as conditions with
evaluation criteria or evaluation dates.
Activities for attaining goals were provided for 33 (nearly 20 per cent) of the 161
goals. For example, to achieve the goal: ‘Lars drinks from a cup’, the following activity
was described: ‘we’ll put a cup of milk in Lars’s hands and help him to drink from it
by bringing the edge of the cup to his mouth.’ No activities were established for the
remaining 80 per cent of the goals.
Not one of the IEPs that were evaluated provided either evaluation criteria or an
evaluation date. Ten of the goals set an evaluation limit, such as ‘this goal should be
evaluated the next time we discuss the child’, or ‘the effect should be studied a year
from now’. For six of these ten goals an evaluation was expected within six months,
while a limit of 12 months was established for the other four. The names of the teachers
or therapists who were to assist in realizing the goals were listed in 23 per cent of the
cases. When we compared the results obtained in the various centres for special
education (see Table 4), we noticed that one centre had a much higher percentage of
goals formulated as results than the others. A possible explanation is that this centre
for special education worked with the Portage programme (Bluma et al., 1976). In this
programme, lists are provided describing the objectives to be chosen.
All 425 goals were included in the analysis of their intrinsic criteria. We included
goals which are not considered results-oriented in our analysis because it is possible
1 2 2 0 0 2 2 0 0 2
2 9 8 1 0 9 0 9 2 7
3 27 23 4 0 27 8 19 26 1
4 50 0 50 0 50 0 50 1 49
5 73 0 73 0 73 0 73 0 73
Total 161 33 128 0 161 10 151 29 132
Goal setting for SEN students in The Netherlands 247
to establish a relationship between the known needs of the children and goals which
are formulated as activities or conditions.
In order to evaluate whether the goals met the criterion ‘there must be a relationship
between the prole or personal description and the established goals’, we rst had to
determine whether the 33 available IEPs included a prole or personal description.
We found that 22 (67 per cent) of the 33 IEPs contained neither. Moreover, 13 of
these 22 IEPs had not included actual goals for the child. The other nine IEPs had
formulated the child’s needs for assistance or instruction. However, there was no
clear relationship between these needs and the goals described in the IEPs. Although
the remaining IEPs did include a prole or personal description, the proles were much
too condensed and consisted almost exclusively of medical information. This prevented
the researchers from gaining a clear understanding of the relationship between the
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
child’s needs and the perspectives or need for care listed. It was not possible to establish
a connection between prole/personal description, perspective and the established
goals. Since a perspective was lacking in nearly all the IEPs, it was impossible to
establish a relation between the goals.
The last criterion, ‘the goals are listed in order of conditionality or importance’, was
not met in a single instance. Not one of the IEPs established an order of priorities.
The results of the post-test trial describes the situation after intervention and training.
It includes the 486 goals formulated by the same 18 teachers and 16 therapists who
participated in the pre-test trial. The goals were first evaluated according to their
technical aspects, which are listed in Table 5. Ninety-two per cent of the 486 goals met
the criterion ‘described as a result or effect’. The remaining 8 per cent were formulated
as activities, while none was described as a condition.
Only the goals which could be dened as results or effects were included in the
subsequent analysis of technical criteria. All goals described an activity that had to be
performed to meet the desired objective. Nearly all goals (98 per cent) had established
evaluation criteria at the start. In 94 per cent of the cases, an evaluation date was
given. All goals indicated who would be responsible for their execution (see Table 6).
We then evaluated the 49 IEPs to discover whether they met the required intrinsic
qualities. All of the IEPs included a personal description or prole. In accordance with
1 154 14 137 17 –
2 80 8 78 2 –
3 98 14 93 5 –
4 79 7 70 9 –
5 75 8 69 6 –
Total 486 51 447 39 –
248 European Journal of Special Needs Education, Vol. 17, No. 3 (2002)
2 78 78 0 74 4 71 7 78 0
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
3 93 93 0 92 1 89 4 93 0
4 70 70 0 69 1 70 0 70 0
5 69 69 0 69 0 69 0 69 0
the information provided in the personal descriptions, a long-term goal was established
for each child (perspective), on the basis of which short-term goals were set as well.
All goals were derived from these perspectives. Of the 447 goals, 380 (85 per cent) were
found to be related to the perspective. For the remaining 67 goals (15 per cent), no
relationship could be established with the long-term goals. In all IEPs which included
more than one goal, the goals were listed according to their degree of importance or
conditionality.
Pre-test Post-test
Order of importance 0 49
Goal setting for SEN students in The Netherlands 249
The results of the pre-test study demonstrated that not one of the 425 goals which were
described in the IEPs met all of the technical criteria; nor did any of them meet all of
the intrinsic criteria. The pre-test results differ dramatically from those of the post-test
study (see Table 7). In the post-test study, 421 of the 486 goals met all of the technical
requirements. The results of the intrinsic analysis showed that 85 per cent of the
established goals corresponded to the child’s personal description and perspective,
compared to 0 per cent in the pre-test study. Moreover, unlike in the pre-test study,
each IEP listed the established goals in order of importance.
The results clearly demonstrate that providing a short course of approximately six
hours, together with a monthly training session of around an hour per month, is
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014
sufcient to effectuate a dramatic increase in both the technical and intrinsic qualities
of the goals. Since this study analyses the effect of the course in combination with the
training, no conclusions can be drawn concerning the effectiveness of either single
component (course or training).
DISCUSSION
When interpreting the results of this study, some caveats should be made. During the
pre-trial study, there was no information available on the means used to determine
the IEPs, only the text of the nal document was given. Therefore it was not possible
to find out on what grounds these goals were formulated. It is plausible that the
formulation of the goals was incorrect, but not the intentions. Secondly, a relation
between the goals could not be established because, in most cases, a perspective or
personal description was lacking. However, this does not necessarily mean that a
relation did not exist, only that it was not apparent in the IEPs.
Centres for special education are required to establish, as well as work with, IEPs.
It is therefore surprising that this requirement does not provide for an evaluation
of their quality. The effects of this omission are disturbing, particularly in the case
of children with profound multiple disabilities who are to a great extent dependent
on others, and hence on the goals that others have established for their benet. Goals
are an essential element in all IEPs. Clearly formulated goals lead to IEPs of good
quality, which in turn improve the quality of the education or support provided.
Whether clearly formulated goals eventually lead to an improvement of quality of life
is not directly implied, although this connection has been made by several authors
(Borthwick-Duffy, 1990; Goode and Hogg, 1994), especially in relation to individuals
with profound multiple disabilities.
However, it is reasonable to assume that these individuals depend on the quality
of their IEP, and a poor quality of IEP may directly inuence their quality of life. In
this study, a considerable improvement in the correct formulation of goals has been
demonstrated due to a comparatively small investment in training of teachers and
therapists. So far, both centres for special education and the Dutch government have
paid a great deal of attention to the procedures to be followed in drafting IEPs.
Teachers and therapists are provided with courses and information on the steps to be
followed but specic training which emphasizes the importance of setting goals for
children with multiple disabilities, and the manner in which goals should be
formulated, is lacking. Nevertheless, teachers and therapists are expected to determine
well-dened goals on their own. Our study has demonstrated that this has led to the
formulation of goals which do not meet the required standards. Evidently, more must
be done to develop understandable, measurable and attainable goals. Providing
250 European Journal of Special Needs Education, Vol. 17, No. 3 (2002)
teachers and therapists with specic training during which they learn how to formulate
goals is important. This study points out that considerable benets can be obtained
from even a limited amount of instruction and training.
REFERENCES
BLUMA, S., SHEARER, M. S., FROHMAN, A. H. and HILLIARD, J. (1976). The Portage
Guide to Early Education. Revised edn. Portage: Cooperative Educational Service Agency
No. 12.
BROTHWICK-DUFFY, S. A. (1990). ‘Quality of life of person with severe or profound
mental retardation’. In: SCHALOCK, M. J. (Ed.) Quality of Life: Perspective and Issues.
Washington, DC: AAMR.
Downloaded by [University of Saskatchewan Library] at 01:12 27 December 2014