Professional Documents
Culture Documents
Teacher Training: George Sugai
Teacher Training: George Sugai
Teacher Training: George Sugai
by the trainees themselves before the observa- the start of each learning trial, peer observers
tion. Peer observers then used these definitions were instructed to code information related to
to collect data on the target behaviors of con- (a) whether the teacher trainee gave an atten-
cern to the teacher trainee. tion signal, (b) whether the pupils attended to
The second observation instrument was mod- the instructional stimulus, and (c) whether the
ified from an existing observation system teacher’s question was followed by a correct/in-
(CASE) intended for inservice teacher evalua- correct student response. Subsequent teacher-
tion and supervision (Tawney, 1979). The CASE pupil interactions (e.g., prompts, reinforcement)
observation system focused on teachers’ direct involving the same stimulus were coded in a
instruction strategies, as measured by the pres- single learning trial. Peer observers coded
ence or absence of the following teacher/pupil teacher/pupil behavior by slashing, circling, or
behaviors (observational codes indicated in par- inserting the code letters for the respective ob-
entheses) : teacher’s attention signals (at), servational categories. A learning trial ended
pupil’s attending behavior (A), correct/incorrect when the trainee presented information or ques-
academic response from pupil (+ / -), teacher tions related to a new stimulus or when the
reinforcement of correct academic response teacher told pupils the correct answer following
(R), teacher correction or prompting of incorrect an incorrect resconse.
academic response (C), and teacher telling of In contrast tc the experimental group, peer
correct answers following an incorrect re- observers in the -ont:,-’ group not given
sponse (T). The recording sheet containing these well-defined observation systems for the
these direct instruction categories is presented collection of teacher/pupil data. Instead, after
in Figure 2. discussion of desirable teacher strategies and
As indicated on the Direct Instruction record- methods for behaviors management and direct
ing form, each column of the form represented a instruction, con±=o&dquo; peer observers developed
single learning trial involving the presentation their own systems of recording teacher/pupil
of a new stimulus, such as a new sight word, behavior during lessons focusing either on be-
math problem, or comprehension question. At havior management or direct instruction tech-
9
10
Downloaded from tes.sagepub.com at PENNSYLVANIA STATE UNIV on March 5, 2016
niques. Typically, these systems evolved into trial or teacher prompt.
narrative records and anecdotal descriptions of 2. incorrect academic response. Percentage of
the key instructional and behavior management incorrect pupil responses following a learning
behaviors displayed by the teacher trainee and trial or teacher prompt.
pupils. Thus, continuous and systematic obser- 3. Appropriatelinappropriate social behavior.
vation methods were not used by the control Rate at which pupils demonstrated social be-
group of trainees. haviors in compliance or noncompliance with
stated or understood classroom and/or lesson
Dependent Variables rules (e.g., on-task, off-task behavior).
To measure and record low inference teacher 4. Lesson noise. Rate of occurrence of off-task
and pupil behaviors which resuited from the use talk or transition activities which are not inap-
of peer observation systems, the Direct irstruc- propriate, but clearly not related to the lesson
tion Observation System (DIOS) (Englert & content (e.g., &dquo;When can we play the game?&dquo;).
Sugai, 1980) was developed. As shown in Figure
3, DIOS functioned as a narrative record that Observers
provided information on dependent variables re- Three observers trained to code DIOS us-
were
lated to teachertrainees’ behavior management ing audiotapes and videotapes of classrooms
and direct instruction behaviors, as well as similar to those used in the study. Two of the ob-
pupils’ academic and social behaviors. servers had no knowledge of the trainees’ group
The following types of data were collected for membership. Reliability measures were taken
teacher-trainees and pupils in the two study at the start of the study. Mean reliability of the
groups. observers was 93%, with a range from 89 to
95%. lnterobserver agreement scores greater
Teacher Trainee Behaviors. than 80% were judged to be acceptable.
Behaviors.
through teacher prompting.
Pupil Teacher trainees in both the experimental
1. Correct academic response. Percentage of and control groups were required to team up
correct pupil responses following a learning with one of their peers in the same practicum
11
Downloaded from tes.sagepub.com at PENNSYLVANIA STATE UNIV on March 5, 2016
FIGURE 3
Direct instruction observation system (DIOS)
12
Downloaded from tes.sagepub.com at PENNSYLVANIA STATE UNIV on March 5, 2016
section to complete five peer observations. sented to trainees as a measurement tool by
Each trainee served as observer for five lessons which they could evaluate their own teaching ef-
and subject for five lessons. Although the expe- fectiveness. It was explained that by targeting
rimental and control groups used different ob- their own acceleration and deceleration targets,
servation techniques, both groups focused on as well as their strategies for changing student
the same target skill areas, including (a) two ob- behavior, teacher trainees could get direct feed-
servations focusing on the peer’s behavior man- back from peer observers on their success in af-
agement techniques and (b) three observations fecting the target behaviors of concern. Teacher
focusing on the peer’s direct instruction tech- success was measured in terms of changes in
niques. Behavior management and direct in- levels of student behavior over time and in-
struction techniques were observed separately creases in the proportion of student responses
for reasons associated with greater efficiency correctly responded to by the trainee (e.g., a fol-
in teacher training and peer observation. In par- lowed by A, i followed by D). Although it was
ticular, since all subjects were novice teachers, originally intended that teacher trainees would
they did not have the automaticity or knowledge target social behaviors, a majority of the
necessary to selectively attend to and recognize trainees pinpointed academic behaviors for
all categories of behavior management and data collection, including pupil correct
direct instruction simultaneously. By narrowing responses (a), pupil incorrect responses (i),
the observation categories to a subset of teacher praise of correct responses (A), and
teaching skills, it was expected that trainee ob- teacher prompts or correction of errors (D).
servers could develop greater automaticity in For the observation of direction instruction
observing and generating the target behaviors behaviors, experimental trainees were in-
of concern. structed in the use of CASEthrough learning ac-
After the completion of each peer observa- tivities that gave them experience coding video-
tion, peer observers were directed to discuss tapes and audiotapes of teacher trainees from
their observations and comments with the ob- previous semesters. This provided experi-
served peer. Feedback typically focused on spe- mental trainees with direct experience in using
cific behavior management, instructional, or the observation system to code direct instruc-
feedback strategies for teaching a particular tion behaviors. Teacher trainees were told to
skill to the learner. In addition, at the completion use the observational data as a basis for deter-
of the required number of observations for the mining their ability to maintain student atten-
two targeted skill areas (i.e., two for behavior tion, high student accuracy, and correct student
management, three for direct instruction), peer responding through appropriate feedback pro-
observers gave the observed teacher trainee cedures involving reinforcement following cor-
their written comments and observational data. rect responses and correction prompts follow-
This information then was summarized in a brief ing incorrect student responses.
report written by the teacher trainee. The report Only one modification was made in the writ-
described their intructional methods and find- ten report requirement for experimental teacher
ings obtained by the peer observers. To mini- trainees. Instead of writing a detailed report
mize the likelihood of false reporting of trainee describing their strategies and results, greater
performance, grades were not assigned on the emphasis was placed on the summarization of
basis of these observations. Teacher trainees datathrough graphing of teacher-pupil data. Us-
were informed that the peer observations were ing the graph, trainees were encouraged to com-
strictly for their own benefit and would not influ- pare across the several days of observation to
ence their course grade. To ensure that observa- determine whether they effectively had
tion assignments were completed, a standard changed either trainee or pupil behaviors.
point value was assigned to each report.
Control Group. The control group received
Experimental Group. The experimental group similar instruction on the desired teacher and
completed two behavior management observa- pupil behaviors and on general instruction and
tions using the Dollar (1980) recording scheme. behavior management techniques. The same
Prior to its use, teacher trainees were instructed management techniques and categories of in-
in the use of behavior management strategies structional behaviors were discussed with both
to accelerate and decelerate target pupil behav- groups. time, however, was spent in dis-
iors. The observation scheme than was pre- cussion of instructional techniques with control
13
14
Downloaded from tes.sagepub.com at PENNSYLVANIA STATE UNIV on March 5, 2016
ANOVA for correct rates revealed a significant As expected, experimental teacher trainees
main effect for group, F(1,34) = 4.37, p < .05. who were provided with specific teacher/pupil
Experimental teacher trainees maintained a data differed in several respects from control
higher correct rate than control teacher trainees teacher trainees. First, experimental teacher
(3.3 compared to 2.3 per minute). Test for the sig- trainees maintained a higher level of pupil ac-
nificance of time and the interaction of time and curacy during direct instruction. Although both
group were not significant. groups established their own instructional objec-
tives and were involved in the direct instruction
Feedback Strategies of those objectives, only the trainees given spe-
A third aspect of group performance was teach- cific data and feedback achieved higher aca-
ers’ feedback strategies (e.g., prompts, rein- demic accuracy. Thus, teacher trainees who
forcement, telling correct answer) following were provided with specific performance data
either a correct or incorrect pupil response. The were better able to monitor and manage pupils’
results of the ANOVA showed that the groups achievement of stated academic outcomes.
were differentiated by two feedback strategies. The lower pupil performance levels of the
For teacher feedback following correct re- control trainees also suggested that novice
sponses, group differences were statistically teachers may have had difficulty monitoring
significant, F(1,36) = 5.17, p < .05. As shown student accuracy during direct instruction with-
in Table 1, control teacher trainees tended to out specific feedback. For the novice teachers,
prompt correct responses more often than ex- the instructional act itself might have required a
perimental teacher trainees. Moreover, a main great deal of attention, so that less attention
effect for time, F(1,36) = 6.72, p < .05, indi- was available for monitoring student re-
cated that both groups tended to prompt correct sponses. However, given specific feedback and
responses less often over time. Since no inter- data from peer observers, novice teachers were
action was found, these findings suggested better prepared to bridge the gap between the
that group differences remained relatively instructional presentation and the monitoring
stable across time, with both groups decreas- of its outcomes. In this way, specific feedback
ing their prompting at Time 2. allowed novice teachers to become increas-
Analysis of teacher trainees’ feedback strat- ingly accountable for monitoring, managing,
egies following incorrect pupil responses also and evaluating their own instructional effective-
showed differential prompting patterns. While ness.
both groups tended to prompt errors ratherthan A second finding was that experimental
tell correct answers, a significant group by trial teacher trainees maintained a brisker presenta-
interaction, F(1,36) = 5.17, p < .05, was found tion and correct ratethan teachertrainees in the
for telling correct answers. Comparison of the control group. By doing so, experimental teach-
group means at Time 1 and 2 showed that, er trainees not only maintained higher pupil ac-
where experimental trainees maintained a low curacy, they also provided more practice and
level of telling correct answers at both Time 1 rehearsal opportunities for student mastery of
and 2, control trainees initially demonstrated a concepts. In sum, they taught more in less time,
high level of telling correct answers at Time 1, a competence considered essential to direct in-
with a decreasing reliance upon this strategy struction methodology (Becker & Carnine,
across time. 1981).
Two other analyses were conducted for Third,teacher trainees in the experimental
teacher trainees’ reinforcement of correct re- group differed in terms of their feedback strat-
sponses and prompts of errors. However, no sig- egies for correct and incorrect student re-
nificant main effects or interactions were found sponses. Experimental teacher trainees tended
for either variable. to prompt correct responses less often than
control teacher trainees at both trials and were
less likely to tell answers following incorrect re-
DISCUSSION sponses. Since previous research has indicated
that both of these feedback techniques are cor-
Peer observation is one technique to facilitate related positively to student learning in low-
supervision and teacher training. This study ex- achieving populations (Brophy & Evertson,
amined the effects of two peer observation 1977; Medley, 1977), this finding favored the ex-
techniques on teacher trainee performance. perimental teacher trainees.
15
16
Downloaded from tes.sagepub.com at PENNSYLVANIA STATE UNIV on March 5, 2016
Ellis, E.C., Smith, J.T., & Abbott, W.H. Peer observa- Semmel, M.E., & Englert, C.S. A decision-making ori-
tion: A means for supervisory acceptance. Edu- entation applied to student teaching supervi-
cational Leadership
, 1979, , 423-426.
36 sion. Teacher Education and Special Education
,
Englert. C.S. & Sugai, G.M. The direct instruction ob- 1978, 1(2), 28-36.
servation system: DIOS
. Lexington: University of Semmel, M.I., & Thiagarajan, J. Observation systems
Kentucky, 1981. and special education teachers. Focus on Ex-
Medley, D.M. Teacher competence and teacher effec- ceptional Children
, 1973, , 1-12.
5
tiveness : A review of process-product research. Skoog, G. Improving college teaching through peer
Washington, D.C.: American Association of Col- observation. Journal of ,
Teacher Education 1980,
leges for Teacher Education, 1977. , 23-25.
31
Merrill, E.C., & Schuchman, B.J. Professional student Tawney, J.W. C.A.S.E.: Comprehensive analysis of
teaching programs Danville, III.: Interstate special education
. Lexington: University of Ken-
Printers and Publishers, 1973. tucky, May, 1979.
Rosenshine, B. How time is spent in elementary class- Walker, J.A. The practicum supervision inches toward
rooms. In C. Denham & A. Lieberman (Eds.), Time competence: Preliminary thoughts on a process.
to learn
. Washington, D.C.: National Institute of Teacher Education and Special Education 1978,
Education, 1980. (2), 14-27.
1
17