Professional Documents
Culture Documents
(1990) Nevin, Torquato, Tota & Shull (Alternative Reinforcement Increases Resistance To Change - Pavlovian or Operant Contingencies)
(1990) Nevin, Torquato, Tota & Shull (Alternative Reinforcement Increases Resistance To Change - Pavlovian or Operant Contingencies)
Two multiple-schedule experiments with pigeons examined the effect of adding food reinforcement
from an alternative source on the resistance of the reinforced response (target response) to the decre-
mental effects of satiation and extinction. In Experiment 1, key pecks were reinforced by food in two
components according to variable-interval schedules and, in some conditions, food was delivered
according to variable-time schedules in one of the components. The rate of key pecking in a component
was negatively related to the proportion of reinforcers from the alternative (variable-time) source.
Resistance to satiation and extinction, in contrast, was positively related to the overall rate of rein-
forcement in the component. Experiment 2 was conceptually similar except that the alternative
reinforcers were contingent on a specific concurrent response. Again, the rate of the target response
varied as a function of its relative reinforcement, but its resistance to satiation and extinction varied
directly with the overall rate of reinforcement in the component stimulus regardless of its relative
reinforcement. Together the results of the two experiments suggest that the relative reinforcement of
a response (the operant contingency) determines its rate, whereas the stimulus-reinforcement contin-
gency (a Pavlovian contingency) determines its resistance to change.
Key words: alternative reinforcement, response rate, resistance to change, concurrent schedules,
multiple schedules, satiation, extinction, key peck, pigeon
Experimental analysis has distinguished two to be (Nevin, 1974, 1979; Smith, 1974). Con-
aspects of operant behavior: the rate of a re- sequently, it is of some importance to examine
sponse and the resistance of that rate to re- the variables that influence resistance to change
duction by procedures such as satiation and (Fath, Fields, Malott, & Grossett, 1983; Nevin,
extinction. These two aspects of behavior are 1974, 1979, 1984; Nevin, Mandell, & Yar-
of interest because they vary in orderly ways ensky, 1981; Nevin, Smith, & Roberts, 1987).
as functions of rate of reinforcement (Catania The rate of a target response maintained by
& Reynolds, 1968; Nevin, 1974, 1979; Skin- a given rate of reinforcement decreases when
ner, 1938, 1950) and because of their relation reinforcers are added concurrently from an al-
to the theoretical concept of response strength. ternative source. This decrease occurs both
Although response rate has been taken as when reinforcers are added noncontingently
equivalent to response strength (Skinner, 1938, (Rachlin & Baum, 1972) and when they are
1950), a case can be made that resistance to contingent on a different, concurrent response
change corresponds better to our conceptions (Catania, 1963). Adding reinforcers from an
of what a measure of response strength ought alternative source may be viewed as degrading
the operant contingency, in that the correlation
between the occurrence of the target response
I Experiment 1 was conducted by J.A.N. at the Uni- and the reinforcer is thereby weakened. Thus,
versity of New Hampshire with support from UNH in- alternative reinforcement might reduce re-
ternal research funds. Mary Lesch, Heather Cate, and sponse rate by degrading the operant contin-
Sandy Rutter assisted in the conduct of the experiment.
Experiment 2 was conducted by M.E.T., R.D.T., and gency.
R.L.S. at the University of North Carolina at Greensboro If a target response's rate and resistance to
with the support of NSF Grant BNS-8519215 to UNCG. change are correlated manifestations of the ef-
Reprints may be obtained from J. A. Nevin, Department fect of reinforcement on operant behavior (i.e.,
of Psychology, University of New Hampshire, Durham,
New Hampshire 03824, or from R. L. Shull, Department its strength) then one might expect that de-
of Psychology, UNC at Greensboro, Greensboro, North grading the operant contingency would reduce
Carolina 27412. resistance to change as well as response rate.
359
360 JOHN A. NEVIN et al.
Specifically, one would expect its resistance to ponent are chosen so as to give food at the
be reduced if the operant contingency were same overall rate as that arranged by the VI
degraded by adding alternative reinforcement. schedule in the second component, resistance
However, recent data suggest just the opposite: to change may be similar between components
Alternative reinforcement (added successively even though baseline response rates differ. Ex-
rather than concurrently) may actually en- periment 1 explores these possibilities.
hance resistance to change rather than reduce
it (Nevin, 1984; Nevin et al., 1987). METHOD
Although adding concurrent alternative Subjects
reinforcers degrades the operant contingency, Three experimentally naive White Carneau
it increases the rate of reinforcement received pigeons were maintained at 80% of their free-
in the presence of the stimulus in which the feeding weights, ± 15 g, by feedings of Purina
response occurs and thereby enhances the stim- Pigeon Chow® as needed after each experi-
ulus-reinforcer correlation-a Pavlovian con- mental session. Water and grit were available
tingency. Perhaps the stimulus-reinforcer con- continuously in each bird's home cage. By co-
tingency rather than the operant contingency incidence, all 3 birds had identical free-feeding
determines a response's resistance to change, weights of 580 g. The birds were trained to
as suggested by Nevin (1984). peck a key lighted red or green by the method
This paper describes two experiments ex- of successive approximations.
amining the effects of alternative reinforce-
ment on the rate of a target response and the Apparatus
resistance of that response rate to change. In The experiment was conducted in a stan-
both experiments, a target response was rein- dard single-key Lehigh Valley pigeon chamber
forced at particular rates in different, inde- equipped with a stimulus projector behind the
pendent components of multiple schedules sig- key, a houselight centered above the key, and
naled by distinctive stimuli. In one component, a grain feeder filled with wheat centered below
alternative reinforcers were presented either the key. A blower provided ventilation and
noncontingently (Experiment 1) or contingent masking noise. Food schedules were con-
upon a concurrent response (Experiment 2). structed from the progression provided by
In both experiments, target response rate and Fleshler and Hoffman (1962) and arranged
resistance to change were examined in relation by standard tape timers. The experiment was
to the rates of contingent and alternative re- controlled and data were recorded by electro-
inforcement in order to evaluate the possibility mechanical equipment in an adjacent room.
that the relative reinforcement of a response
determines its rate, whereas the overall rate of Procedure
reinforcement correlated with a stimulus de- Baseline. Throughout the experiment, daily
termines the resistance to change of that re- sessions consisted of 12 multiple-schedule com-
sponse rate. ponents, each 3 min in length and separated
by 1-min periods with no food available, sig-
naled by three white dots projected on the key.
EXPERIMENT 1 The food components, signaled by red and
If response-independent food is presented green keylights, were presented in strict alter-
according to a variable-time (VT) schedule in nation; the first component on a given day
one component of a two-component multiple varied irregularly from red to green. The key
variable-interval, variable-interval (VI VI) was darkened during each food presentation,
schedule with equal VI food schedules, re- which was always 4 s except during Condition
sponse rate should be lower in the component 3 (see below), when it was reduced to 2.5 s to
with added VT food (as found by Rachlin & prevent the birds from gaining excessive weight.
Baum, 1972). However, the added VT rein- Sessions always began with a 1-min no-food
forcers may enhance resistance to change in period and ended immediately after the 12th
the concurrent VI VT component relative to schedule component. The houselight was on
the simple VI component because the overall throughout the session. Sessions were con-
reinforcer rate in that component is higher. ducted 7 days a week if the birds were within
Conversely, if the schedules in the first com- 15 g of their 80% weights.
ALTERNATIVE REINFORCEMENT 361
Bird G5
87.4 64.8 0 87.6 66.6 1.00 60.-*
2 (pf) 87.3 73.8 116 98.8 63.6 .88 40
2 (ext) 72.6 73.8 121 91.2 63.6 .80
3 (pf) 65.1 61.2 234 84.3 62.4 .77 20-
3 (ext) 59.8 61.2 233 89.2 64.8 .67 G22
4 92.2 60.4 0 96.4 66.7 .96 0
5 (pf) 81.3 25.2 38.3 91.2 66.8 .89 0 2 4 0 2 4
5 (ext) 79.7 26.0 34.6 98.6 64.4 .81
6 (pf) 74.4 13.0 44.7 85.8 63.1 .87 Obtained Ratio of VT to VI Food
6 (ext) 72.5 13.0 44.7 85.2 65.2 .85 Fig. 1. Responses per minute during baseline in red
7 83.8 59.8 0 91.6 65.2 .91 and green components of the multiple schedule in Exper-
Bird G22 iment 1, as functions of the ratio of food rates obtained
59.4 64.8 0 60.4 63.6 .99 for key pecking (VI) and presented independently of peck-
2 (pf) 46.3 74.4 120 49.8 65.4 .93 ing (VT). In Conditions 2 and 3, the same VI schedule
2 (ext) 45.4 73.8 116 50.1 66.0 .91 was arranged in red and green and the VT schedule in
3 (pf) 35.1 59.4 235 60.3 63.0 .58 red varied (VI same); in Conditions 5 and 6, the total food
3 (ext) 35.1 60.0 235 57.4 63.0 .61 rate arranged by VI and VT schedules in red was the
4 48.9 60.6 0 56.8 63.6 .86 same as that arranged by the VI schedule in green (total
5 (pf) 47.1 26.1 38.4 57.9 63.7 .81 same). In Conditions 1, 4, and 7, all food was contingent
5 (ext) 43.4 21.7 40.4 54.6 67.6 .79 on key pecking on VI 60-s schedules; these data points
6 (pf) 40.2 12.3 47.7 54.6 67.9 .74 appear above 0 on the x axis, with functions drawn from
6 (ext) 36.9 14.5 47.8 57.2 67.7 .65 the median point.
7 49.2 60.6 0 52.0 65.7 .95
suggests that response rate was determined
primarily by the ratio of VT to VI food pre-
consistently by the use of shorter food presen- sentations and not by overall food intake.
tations in Condition 3 relative to the other
conditions. In the red component, response rates Prefeeding
were a decreasing function of the ratio of VT In general, response rates in prefeeding ses-
to VI food rates (with the exception of G8, sions were lower than in baseline, but were
Condition 2). Food rate ratios varied in two not systematically related to amount prefed.
ways. In Conditions 2 and 3, the VI schedule Accordingly, the relative effects of prefeeding
was constant and the ratio was increased by on response rates in red and green components
adding VT food presentations. By contrast, in during each prefeeding session were evaluated
Conditions 5 and 6, the VI and VT schedules by the relation between proportions of baseline
were chosen to give the same ratios with con- response rates in each prefeeding session. For
stant overall food rates. The absence of con- each prefeeding session, response rates in each
sistent differences in these pairs of conditions component were expressed as proportions of
ALTERNATIVE REINFORCEMENT 363
the mean response rates in the three imme- 1.1.0
diately preceding baseline sessions and plotted 0. .8 ~0
against each other. The results are shown in 0. .6 0 .0
Figure 2. If the proportional effects of pre-
feeding were the same in both components, the
0. '4 D G8
0..2 * Cond 2
data should fall along the main diagonal, as is a o Cond 3
generally true for Conditions 5 and 6. How-
ever, if response rates in the red component 1.0
were less reduced relative to baseline than in 0.8 0o
green, the points would fall above the major m 0.6 0
o
diagonal, as is true for Conditions 2 and 3 0
a0
C 0.4 -
0 0
* G5
(except for G5, Condition 2). More specifi- 0 0.20 * Cond 2
cally, Figure 2 shows that the data points are 0.
/2 / o Cond 3
generally farthest above the main diagonal for o- ......
equal in the two components. 0.2 0.4 0.6 0.8 1.0 1.2
2 3 5 6 7
1.0
0 .,.
1.0
i9 * Red
oGreen
I<
0
1.0
o
BL 2 4 BL 2 4 BL 2 4 BL 2 4 BL 2
Two- Session Blocks of Extinction
Fig. 3. Response rates in two-session blocks of extinction at the end of the indicated conditions of Experiment 1,
expressed as proportions of baseline response rates averaged for the preceding five sessions and presented separately
for red and green components. Data are from Birds G8 (top), G5 (middle), and G22 (bottom).
The data are presented in this form in Figure 5 and 6 is evident only for G8 and G5 in
4, with ratios plotted on a logarithmic axis. extinction, and thus is probably due to the color
The plotted points are for blocks of five base- preference identified in Condition 7.
line sessions preceding each resistance test To make summary comparisons across con-
(from Table 2), from individual prefeeding ditions, the extinction data were reexpressed
sessions, and from two-session blocks of ex- as the weighted average proportion of baseline,
tinction. As total responding decreases from p (the rationale for calculation of p is given by
right to left with various prefeedings or during Nevin et al., 1981, 1987). For prefeeding, the
the course of extinction, an upward trend in unweighted average proportion of baseline was
this plot implies smaller relative decreases in calculated because there was no orderly effect
red than in green. Such trends are evident for of amount prefed. The ratio of the values of
Conditions 2 and 3. Note that, in general, the ,p for the red and green components is plotted
points move from below 1.0 (signifying lower in Figure 5 as a function of the scheduled ratio
response rate in red than in green, as in base- of food presentation rates in the red and green
line) to well above 1.0 (signifying higher re- components, separately for prefeeding and ex-
sponse rate in red than in green). The slope tinction (note that obtained ratios closely ap-
is steeper for the data from Condition 3, in proximated the scheduled values). A p ratio of
which the VT food rate in red components was 1.0 signifies that responding is equally resis-
higher. By contrast, a horizontal relation sig- tant to change in the two components, whereas
nifies equal relative changes, and a decreasing ratios above 1.0 signify that it is more resistant
relation signifies smaller relative decreases in in the red component and ratios below 1.0
green than in red, as seen in the data from signify that it is more resistant in the green
Conditions 5 and 6. Note that the downward component. For all subjects, and for both pre-
trend as response totals decrease in Conditions feeding and extinction, the ratio of p values is
ALTERNATIVE REINFORCEMENT 365
10 - 10 -
00 Cond 2 Cond 5
A
0 °_0_ o_we
0 A*
,- I1 1I
O I
Cu 0 0
0 0
0
0
0 C
a: .1 .1
0
o
mg 10
co
0 Cond 3 Cond 6
0
(U
10 I 1' A------K Bt- D w
AOaO
0
.1 O PF EXT
* 0 G8
* G5
A A G22
0 40 80 120 160 200 0 40 80 120 160 200
a positive function of the ratio of food presen- ential resistance to prefeeding or extinction was
tation rates and is above 1.0 when the ratio of unaffected by the proportion of VT food pre-
food presentation rates exceeds 1.0. Although sentations in the red component when the over-
extinction p ratios are below 1.0 for G8 and all rate of food presentation was constant across
G5 when the ratio of food presentation rates components, as in Conditions 5, 6, and 7.
is 1.0, there is no consistent difference across
the conditions at that ratio (Conditions 5, 6,
and 7). EXPERIMENT 2
In summary, resistance to prefeeding or ex- Experiment 1 demonstrated that adding re-
tinction in red was greater than in green when sponse-independent food to a schedule com-
the total rate of food presentation was higher ponent decreases the rate and increases the
in the red component, as in Conditions 2 and resistance of a target response to change. The
3, and differential resistance to change was rate of a target response decreases also when
positively related to the total rate of food pre- food is added for an explicit concurrent re-
sentation in the red component (relative to the sponse (e.g., Catania, 1963). If such a con-
constant green component). Moreover, differ- current food schedule functions analogously to
366 JOHN A. NEVIN et al.
Prefeeding
2.5
E xtinction
A ranged equal VI schedules for key pecking and
2.0'
added VT food presentations in the red-key
--A
1.5'
G8 component.
VT~VI. Cond In the third concurrent schedule pair, food
1.0' 0.7
0.5
/, -0
2,:
2°4:3.6 was scheduled only for the target response, but
the rate of food presentation was the same as
0.0
the sum of the two food rates arranged in the
2.0'
. first component. Thus, the first and third
schedule pairs are analogous to the red-key
1.5- X,, and green-key components in Experiment 1,
1.0' I G5 Conditions 5 and 6, in which the sum of the
0.5' food rates arranged by the VI and VT sched-
0.0 ules in red was equal to the food rate arranged
2.0'
by the VI schedule in green. If food for an
explicit alternative response functions simi-
1.5' larly to response-independent food, the target
1.0' A' response should be more resistant to change in
0.5'
022 the first concurrent schedule pair than in the
second and should be equally resistant to change
0.0 in the first and third schedule pairs. Such an
outcome would provide further evidence that
2.0' -~- the overall food rate in the presence of a stim-
..A I
1.5' I
I
ulus determines a response's resistance to
1.0 -
r______-,411 hban change.
0.5' The use of an explicit response for alter-
native food has the advantage that its resistance
0.0 1 2 3 4 5 0 1 2 3 4 5 to change can also be measured. If the total
Reinforcers in Red / Reinforcers in Grreen reinforcement arranged in a component by a
Fig. 5. Resistance to change in the red component
schedule pair determines the resistance to
relative to that in the green component is expressed as the change of both responses, the target and al-
ratio of average proportions of baseline, ,, in red and green, ternative response should be equally resistant
and related to the ratio of scheduled overall food rein- to change because both responses of the con-
forcement rates in red and green. Data points are coded current pair occur in the same component
for scheduled ratios of VT to VI food presentations in the
red component, and points with equal ratios are connected stimulus. Response rates, however, should dif-
to facilitate comparisons between related conditions. fer according to the relative rate of reinforce-
ment of the two responses.
METHOD
response-independent food, as the effects on
response rate seem to imply, then perhaps Subjects
making food contingent upon an alternative The subjects were 3 White Carneau pigeons,
response will increase the resistance of a target 2 of which had a history of autoshaping; the
response to change just as freely delivered food 3rd was experimentally naive. They were
does. Experiment 2 examines this possibility. maintained at about 80% of their free-feeding
Three different pairs of concurrent sched- weights with supplementary feedings follow-
ules were arranged, each signaled by different ing their experimental sessions as needed.
key colors (i.e., a multiple concurrent sched- Water and grit were continuously available in
ule). Two of the concurrent schedule pairs each bird's home cage.
arranged equal VI food schedules for pecks at
the right key (the target response). In the first Apparatus
pair, food was also scheduled for pecks at the The experiment was conducted in a stan-
left key (the alternative response), whereas in dard two-key pigeon chamber measuring 35
the second, left-key pecks never produced food. cm across the front panel, 30 cm from front to
Thus, these two components are analogous to back, and 35 cm in height. On the front panel
the red-key and green-key components of Ex- were two response keys, a houselight, and an
periment 1, Conditions 2 and 3, which ar- opening giving access to a food hopper. The
ALTERNATIVE REINFORCEMENT 367
two response keys were positioned behind cir- Foods/hr Foods/hr Overall
cular openings 2.5 cm in diameter. They were 45 15 Foods/hr
8 cm apart on centers and 25 cm from the
chamber floor, and each could be transillu- Conditiont
minated with red, green, or white light. The A L
Z GREEN EEN 60
opening to the hopper measured 6 cm wide by
5 cm high, centered on the front panel. Its
bottom was 9.5 cm from the chamber floor. A
blower provided ventilation and masking noise. R
The VI schedules were composed of 13 inter-
vals, the durations of which were obtained by
the tables provided by Fleshler and Hoffman 0 15
(1962). The experiment was controlled and
data were recorded by electromechanical
equipment in a separate room. B FRED I REDH 15
Procedure
Preliminary training. The birds were trained L R
to peck both keys by successive approximations
and were then required to make progressively
more pecks before food was presented. Con- 0 60
current VI VI schedules were then instituted
and varied systematically over blocks of days
to ensure that responding varied with relative C 60
rate of food presentation and that key biases
were not developing. The schedules were con-
current VI 120 s VI 120 s, VI 90 s VI 240 s,
and VI 240 s VI 90 s, and the birds' relative L R
responding shifted in accordance with the rel- Fig. 6. Schematic of the procedure of Experiment 2.
ative food rates. The circles represent the two keys. Components A, B, and
C are the three components of the multiple schedule that
Baseline. Three conditions were arranged alternated quasi-randomly every minute (with a 20-s time-
and presented quasi-randomly as multiple out between components) throughout the session. The
concurrent schedules. The duration of each components consisted of concurrent VI VI schedules
component was 60 s, with the keys lighted (Component A) or concurrent VI extinction (Components
B and C). The reinforcers per hour provided by the con-
continuously except during food presentation. current
Each component was followed by a 20-s time- of the two schedules are shown above the keys, and the color
keys during each component is shown on the
out with the keys darkened. Components were key.
signaled by the color of both keys: green for
Component A, red for Component B, and white
for Component C. In Component A, 15 food Thus, Components A and C had equal overall
presentations per hour were available on a VI food rates, distributed over both keys in Com-
schedule for pecking the right (target) key; 45 ponent A but concentrated on the right (target)
additional food presentations per hour were key in Component C. These arrangements are
available on a different VI schedule for peck- summarized in Figure 6.
ing the left (alternative) key. In Component The food presentation rates and distribu-
B, only 15 food presentations per hour were tions were arranged by the method described
available on the right key; food was never by Stubbs and Pliskoff (1969). A single VI
available for left-key pecks. Thus, Compo- schedule (Fleshler & Hoffman, 1962) oper-
nents A and B had equal food rates for the ated until a food availability occurred. The VI
target response, but Component A also ar- timer stopped until the assigned food presen-
ranged alternative food presentations. In Com- tation was collected. In Component A, the pro-
ponent C, 60 food presentations per hour were portion of food presentations assigned to the
available on a VI schedule for pecks on the left and right keys was .75 and .25, respec-
right (target) key, and, as in Component B, tively. No changeover delay (COD) was used
food was never available for left-key pecks. because the resulting response bursts would
368 JOHN A. NEVIN et al.
three components during each of the baseline rates in Components A and B is a concurrent
sessions before a resistance test, either satiation contrast effect.
or extinction. The first and last points, there- Table 3 presents two samples of baseline
fore, were separated in time by as much as 3 data, each summed over five consecutive ses-
months. This figure shows how response rates sions. One sample came from the five sessions
were controlled by the schedules in the differ- immediately preceding the first test of resis-
ent components and indicates the consistency tance to change; the second sample came from
of baseline responding over the course of the five consecutive sessions near the end of the
experiment. resistance tests. The table shows the absolute
Baseline response rates were ordered in ac- and relative rates of responding and food pre-
cordance with expectations based on the ab- sentation in each of the three multiple-sched-
solute and relative food rates. That is, response ule components. In most cases, relative re-
rates were highest (with two exceptions for sponse rates deviated from relative food rates
Bird 10528) in Condition C, which arranged in the direction of indifference. This deviation
the highest absolute food rate for the target was most pronounced for Bird 2320 in Com-
response (60/hr) and no alternative food; next ponent A; deviations from matching in that
highest in Component B, which arranged 15 component were less extreme for the other
food presentations per hour for the target re- birds, and in one case (Bird 10528, second
sponse and no alternative food; and lowest in sample), relative response rate was more ex-
Component A, which arranged 15 food pre- treme than relative food rate. Thus, the dif-
sentations per hour for the target response and ferences in baseline rates of target-key re-
also arranged alternative food on the left key. sponding among the multiple-schedule
The consistent difference between response components and between keys are consistent
370 JOHN A. NEVIN et al.
Extinction Long Saotiaon Short Sadadon
D00- 100 -
10~~~~~~~~~~~1 O
10~~~~~~~~0
4344
I I-
10
Cor. d A
*
A Cond B
* CondC
1L
EL 1 2 3 EL I1 2 3 4 5 BL 0 20 45 52.5
0)
Y 1W0 100 1000
C
2320
10 " 10W0
E .'A
c
co
10
1 X 10
I
.1.
- 1.
E) 1-
BL 1 2 3 4
L 1 2 3 4 BL 0 30 45 525
A -------- ---.----
0528
10
BL 1 2 3 4 5 BL 1 2 3 4 BL 0 30 45
with what is generally known about the effects relative resistance to the x-axis variable, with
of absolute and relative food schedules. steeper slopes indicating lesser resistance to
change.
Effects on Resistance to Change Consider first the relation between the func-
Target response comparisons. Figure 8 illus- tions for Components A and B. Both had the
trates for each bird (rows) one set of response- same food rate for the target response (1 5/hr),
rate functions from each type of resistance test but the overall food rate was higher and the
(columns). There are three functions in each relative food rate was lower in Component A
panel, one for the target response in each of than in Component B because of the concur-
the multiple-schedule components. The left- rent food schedule (45/hr) on the left key.
most point for each function shows the re- During baseline and at the start of the resis-
sponse rate during the immediately preceding tance tests, the rate of the target response was
baseline session. The response-rate axis is log- higher in Component B than in Component
arithmic, so that vertical distance corresponds A. However, in all cases, the response rate in
to relative change. The initial levels of these Component B dropped below that in Com-
functions characterize baseline response rates, ponent A so that the function for Component
and their slopes provide direct measures of B crossed the function for Component A. This
ALTERNATIVE REINFORCEMENT 371
Cr/Ar Air/Br crossover has theoretical implications that will
Satiation long 0 * be considered later.
Satiation short * Next, consider the relation between the re-
Extinction A A sponse rate functions for Components A and
Cr/Ar Ar/Br C. Both had the same overall food rate (60/
10 i 100 hr), but Component A had the lower relative
food rate and consequently the lower response
a Ao °0 0d% rate. Nevertheless, the slopes of the functions
11- -10-------- __- are quite similar, indicating that the response
rates in both Components A and C were sim-
*0-
ilarly resistant to change.
Another way to examine resistance to change
.1 I
1 *- is to plot the ratio of response rates in two
* 0s components (e.g., A/B) as a function of the
rates of responding summed across all com-
.1
4344 ponents (A + B + C), which indicates the
0 20 40 60 80 10l D 120 overall level of responding. To the extent that
response rates in the two components are
equally resistant to change, their ratio should
0 10 i 100 be independent of the overall level of respond-
._ ing; therefore, the data points should scatter
oA Bo n AO 0 o about a horizontal line. Conversely, if the per-
0
1 _-- O __- formances being compared are differentially
0
co 0
resistant to change, the ratio of the more re-
N%0
A sistant to the less resistant response rate should
0.
0 increase as the overall level of responding de-
.1 I 1.
0 * .4 f dclines (see also Figure 4 of Experiment 1 and
0 accompanying text).
2320 Figure 9 presents the data from all three
40 80 120 160 2010 240 resistance tests in this form for each bird. Each
point represents response ratios either from the
immediately preceding baseline session, from
10 i 100 -. successive 1-hr blocks of the extinction or long-
0(0 satiation tests, or from the daily sessions of the
to ao ooo 00 0
short-satiation tests.
0& a)
A ACO A0(o
1 --10-
The lower panel of each graph shows the
comparison between Components A and B,
with Component A response rate in the nu-
merator. The points scatter about a line with
.1 I 1' A,go A *A
-
__ a rising trend from right to left, indicating that
0 0
right-key response rate was more resistant to
0.
00528* *A* A4*
0
change in Component A than in Component
10528 U.N B. The ratio was below 1.0 when the overall
.1
0 20 40 60 80 19
level of responding was high and became
Sum of Response Rate
[Ar Br Cr] + +
right) to right-key responding in Component B (0 rft/hr
Fig. 9. Ratios of right-key response rates (log scale) left; 15 rft/hr right). Open points show the ratios of right-
plotted as a function of the right-key response rates summed key responding in Component C (0 rft/hr left; 60 rft/hr
over the three components of the multiple schedule of right) to the right-key responding in Component A (45
Experiment 2. Each point shows the response-rate ratio rft/hr left; 15 rft/hr right). Data from all resistance tests
from a different 1-hr block during a resistance test (ex- are included as are the data from the baseline sessions
tinction and long-session satiation) or from the whole short- preceding the resistance tests. The different symbols in-
session satiation test. Solid points show the ratios of right- dicate the type of resistance test. The Cr/Ar ratio points
key responding in Component A (45 rft/hr left; 15 rft/hr are displaced upward by one log cycle.
372 JOHN A. NEVIN et al.
terms constant. An increase in Ra should result sistance of the target response to satiation and
in a decrease in B, consistent with the data extinction depended on the reinforcer rate dur-
and consistent with the more general conten- ing the stimulus regardless of their source. The
tion that degrading the operant contingency first aspect is a well-known implication of
should cause the rate of the operant to decrease. Equation 1; the second implication has not, so
Next consider the effects of the resistance far as we know, been described previously.
tests. To apply Herrnstein's (1970) equation It is worth emphasizing that it is the de-
it is necessary to specify how its right-hand nominator of Equation 1 that determines the
terms might change to represent the effects of target response's resistance to satiation and ex-
increasing satiation or increasing exposure to tinction. Because the denominator of Equation
extinction. One simple assumption is that the 1 specifies the overall rate of reinforcement
values of R and Ra established during baseline during a stimulus, it can be construed as spec-
training carry over into satiation or extinction ifying a Pavlovian contingency. Thus, an in-
tests but are degraded by some function in terpretation based on a Pavlovian process and
proportion to their baseline values as satiation one based on a relative reinforcement principle
or extinction progresses. Such proportional de- may be more alike than might first appear.
creases in the value of scheduled reinforcement There are, however, aspects of our data that
is indistinguishable in the equation from an are inconsistent with Equation 1. Their con-
increase in Re. In other words, increasing sa- sideration, though complicated, is necessary for
tiation or extinction may be represented as an evaluating the relative reinforcement interpre-
increase in Re, and as Re increases, B will tation.
decrease. Particularly challenging is the consistent
The size of the effect that Re has on B de- finding that for a given VI schedule, the higher
pends on the total rate of scheduled reinforce- baseline response rate (in Component 1) not
ment in the presence of a stimulus (i.e., R + only decreased relatively more than the lower
Ra). More specifically, Equation 1 predicts response rate (in Component 2) but actually
that a particular-sized increment in Re will became lower in absolute terms (the crossover
result in a smaller decrease in B, relative to effect). According to Equation 1, this can never
baseline, when the rate of the scheduled rein- happen. The numerators are the same for both
forcer is high than when it is low. This is so components (because of the same VI schedule);
because the relative decrease in response rate the denominator is larger for the component
depends on the relative increase in the denom- providing additional reinforcement. The value
inator (e.g., to halve the response rate, B, the of Re is assumed to increase by the same amount
denominator in Equation 1 must double). And in both components during extinction or sa-
whether a given increment in Re will produce tiation. Thus, as the denominators increase
a relatively large or small increase in the de- indefinitely for both components, the predicted
nominator will depend on the initial size of response rates converge but do not cross.
the denominator. Thus, the higher the baseline Burgess and Wearden (1986) suggested a
rate of all scheduled reinforcers during a stim- modification of Herrnstein's (1970) approach
ulus (i.e., R + Ra), the smaller will be the that avoids this difficulty for Experiment 1,
effect of a given increment in Re. Significantly, which employed a VT schedule of alternative
it should not matter whether the scheduled reinforcement. They modified Equation 1 as
reinforcers in the presence of the stimulus de- follows to incorporate the effects of VT food:
pend on the target response or not. All that
matters is the total (i.e., R + Ra). The im- B=R+ pRa)e(2)
k(R a+ +
plication, then, is that the relative resistance R + Ra + Re
of a target response to the decremental effects
of satiation and extinction should be greater Here, the terms are as in Equation 1, except
the higher the rate of baseline reinforcement that p is the proportion of VT food presen-
from all sources in the presence of the stimulus. tations (Ra) that function as if they were VI
Thus, Equation 1 is consistent with two food presentations, perhaps because they occur
aspects of our data: (a) Response rate in the in close temporal contiguity with the response.
presence of a stimulus was a decreasing func- Now, assume that Equation 1 (with Ra =
tion of the rate of alternative reinforcement 0) describes response rate in the green com-
during that stimulus, and (b) the relative re- ponent of Experiment 1, that Equation 2 de-
376 JOHN A. NEVIN et al.
scribes response rate in the red component, and plaining two aspects of the data from Exper-
that there is no interaction between the food iment 2. First, if some alternative reinforcers
schedules in one component and response rate are in fact reinforcing the target response in
in the other (an empirically reasonable as- Component A, then such misallocated rein-
sumption given the constancy of response rate forcement would result in a higher relative rate
in the green component across experimental of reinforcement for the target response than
conditions with red-component food rates was scheduled, and deviations from matching
ranging from 60 to 300 per hour). For any in the direction of indifference would be ex-
value of p less than 1.0, the equations predict pected. Although such deviations were the rule
that response rate in green will be higher than (see Table 3), the sizes of the deviations do
in red when Re is small, but predict the reverse not suggest that accidental strengthening of
when both response rates decrease as Re be- right-key responding by left-key reinforcers
comes large-the crossover effect that is prob- was playing a large role, with the possible
lematic for Herrnstein's (1970) unmodified exception of Bird 2320. Second, a misalloca-
equations. (This prediction may be verified by tion account must also explain the similar re-
inserting representative numbers into Equa- sistances to change of the target response be-
tions 1 and 2. For example, let k = 100/min tween Components A and C. If misallocation
and R = 60/hr for both equations, with Ra = were the only process responsible for these re-
240/hr andp = .5 in Equation 2. Then, Equa- sults, then all (or nearly all) of the 45 left-key
tion 1 predicts a response rate of 86/min in reinforcers per hour would have to have been
Component 1 vs. 58/min in Component 2 when misallocated to the right key in Component A,
Re = 10/hr, and 6/min in Component 1 vs. with few or no right-key reinforcers misallo-
13/min in Component 2 when Re = 1,000/ cated in the opposite direction. Yet if that had
hr. The ratio of response rate in Component happened, relative response rates in Compo-
2 to that in Component 1 increases from .67 nent A should have been near 1.0 on the right
when Re = 10/hr to 2.17 when Re = 1,000/ key, although the proportion of reinforcers was
hr, with a concomitant decrease in the sum of about 0.25-clearly contrary to the data of
response rates, consistent with the trends for Table 3.
Condition 3 shown in Figure 4.) Thus, the Thus, our efforts to account for our resis-
Burgess-Wearden formulation gives a good tance-to-change data in terms of extensions of
qualitative account of the data of Experi- Herrnstein's (1970) equation have proven only
ment 1. partly successful. The fact that resistance to
A related formulation by Davison and Jen- change depended on the contingency between
kins (1985) could also be applied to Experi- component stimuli and reinforcers (a Pavlov-
ment 2, in which target (right-key) respond- ian contingency) but not on the proportion of
ing, maintained by 15 reinforcers per hour, those reinforcers that were contingent on the
was more resistant to change in Component target response (an operant contingency) was
A, with 45 alternative reinforcers per hour consistent with our extension of Equation 1,
arranged on the left key, than in Component but certain details of the data (e.g., the cross-
B, with no alternative reinforcers. The Dav- over) were dealt with less comfortably.
ison-Jenkins approach suggests that some left- Local reinforcer rates. We now consider an
key reinforcers in Component A may be mis- alternative to the idea that the component-
allocated to the right key and vice versa. (In stimulus-reinforcer-rate contingency deter-
effect, the Burgess-Wearden formulation is a mines resistance to change. This alternative
one-way misallocation account, and hence a considers the local rates of reinforcement for
special case of the Davison-Jenkins ap- each response as the determiners of resistance
proach.) This possibility must be taken seri- to change in Experiment 2. In Component A,
ously because no COD was used. In essence, the proportion of time spent engaged in the
the argument is that the target response had target response may have approximated .25,
a higher effective rate of reinforcement in as suggested by the literature on concurrent
Component A and hence was relatively less performances (e.g., Baum, 1979; Brownstein
affected by a given increase in Re than in Com- & Pliskoff, 1968). If so, the local rate of re-
ponent B. inforcement per unit of time spent engaged in
However, this account has difficulty ex- the target response would be about 60 per
ALTERNATIVE REINFORCEMENT 377
hour, which is greater than the 15 per hour of reinforcement in training. This result is rel-
for target responding in Component B and evant to our data on resistance to change, in
equal to the 60 per hour in Component C. that there is substantial evidence that the de-
Thus, if the local rate of reinforcement deter- terminers of resistance to change and choice
mined resistance to change of the target re- covary (e.g., Mellon & Shull, 1986; for review,
sponse, it should have been more resistant in see Nevin, 1979). Thus, Williams and Roy-
Component A than in Component B and alty's finding that choice depends on overall
equally resistant in Components A and C, as rate of reinforcement is consistent with our
found. An account in terms of local reinforce- suggestion that resistance to change depends
ment rate may therefore be appropriate for on the overall rate of reinforcement correlated
Experiment 2. with a component stimulus. In sum, we doubt
Such an account is more difficult to apply that the local-rate-of-reinforcement approach
to Experiment 1. To apply the account, one can provide a generally satisfactory account of
must assume that the time allocated to re- our data (see also below).
sponding (vs. not responding) follows the same It is interesting, nevertheless, that a local
matching principle as suggested above for Ex- analysis offers a possible explanation for one
periment 2. Thus, the proportions of time spent aspect of the data from Experiment 2 that
responding would be about .39 in Conditions seems especially troublesome for our view that
2 and 5 and about .21 in Conditions 3 and 6, the contingency between component stimuli and
corresponding to the obtained reinforcer pro- overall reinforcer rates determines resistance
portions (these values may be calculated from to change. The problem is that, in Component
Table 2). If this analysis is appropriate, local A, the relation between the component stim-
response rates must have increased from a ulus and obtained overall reinforcer rate is the
baseline average of about 73 per minute in same for pecks at both left and right keys;
Conditions 1, 4, and 7 (where 100% of the accordingly, responding should have been
time was presumably devoted to responding) equally resistant to change on both keys. For
to about 169 per minute in Conditions 2 and at least 2 of the 3 subjects, however, responding
5 (an average of 66 per minute with 39% of to the left key, maintained by the richer sched-
time allocated to responding) and about 252 ule, was less resistant to both satiation and
per minute in Conditions 3 and 6 (an average extinction than was responding on the right
of 53 per minute with 21% of time allocated key.
to responding). These calculations suggest that In terms of time allocation, at the beginning
time-allocation matching would require a rad- of extinction the birds would have been spend-
ical increase in the local rate or tempo of re- ing more time engaged in left-key responding
sponding, contrary to many analyses of free- than in right-key responding. As extinction
operant responding (e.g., Gilbert, 1958; Pear progresses, then, the birds will have had more
& Rector, 1979). If these implications for local extinction exposure to the local stimulus cor-
rate of responding are accepted, a local-rate- related with left-key responding than to the
of-reinforcement account can explain the re- local stimulus correlated with right-key re-
sistance-to-change data of Experiment 1 as sponding. Thus, when measured in overall
well as those of Experiment 2. An analysis of time, left-key responding may extinguish more
interresponse-time distributions for the con- rapidly.
ditions of Experiment 1 might confirm this To extend this logic to the satiation tests, it
analysis; however, it strikes us as implausible. must be assumed that satiation operates in the
A further reason for skepticism about the same manner as extinction. Perhaps as the bird
role of local reinforcer rates in the determi- satiates, it learns that food is no longer rein-
nation of resistance to change derives from re- forcing. Because there is more opportunity for
cent work by Williams and Royalty (1989). this learning on the key with more responding
They trained pigeons on multiple schedules in and more frequent reinforcement, left-key re-
which each component consisted of a pair of sponding may be affected more rapidly by sa-
concurrent schedules that differed in their tiation. However, this argument is applied less
overall and local reinforcer rates. In probe tests readily to the short-satiation tests, in which
with novel pairs, they found that choice was the birds were prefed in their home cages,
determined by the overall but not the local rate because it is implausible that learning that food
378 JOHN A. NEVIN et al.
is less reinforcing is taking place during the et al. (in press) have recently replicated Con-
short session. Thus, the effects produced by dition 2 of Experiment 1 with human subjects
the two types of satiation tests ought to have (residents of a group home) engaged in an
been different, but in fact they were similar. everyday task; further replication and exten-
The effects of satiation and extinction on sion are needed. For the present, however, it
the relative resistance of the concurrent op- appears fruitful to consider the rate of re-
erants in Component A were not entirely con- sponding maintained under constant condi-
sistent across subjects, and a similar inconsis- tions and the resistance of responding to change
tency arises in the literature. Myerson and as separable aspects of behavior. The former
Hale (1988) and Skinner (1950) found that is determined primarily by response-reinfor-
relative responding did not change systemati- cer contingencies and the latter by stimulus-
cally during extinction from that established reinforcer contingencies.
during training on concurrent VI VI sched-
ules. However, the extinction data of a dis-
crete-trial concurrent VI VI experiment by REFERENCES
Nevin (1969), and of a multiple-schedule study
similar to Experiment 2,2 resembled those re- Balsam, P. D., & Tomie, A. (Eds.). (1985). Context and
learning. Hillsdale, NJ: Erlbaum.
ported here in that, during extinction, re- Baum, W. M. (1979). Matching, undermatching, and
sponding decreased relatively faster on the al- overmatching in studies of choice. Journal of the Ex-
ternative that previously had the higher perimental Analysis of Behavior, 32, 269-281.
reinforcer rate. All in all, the inconsistencies Bindra, D. (1972). A unified account of classical con-
in the literature, coupled with the consistency ditioning and operant training. In A. H. Black & W.
F. Prokasy (Eds.), Classical conditioning II: Current re-
of our effects across extinction and satiation search and theory (pp. 453-481). New York: Appleton-
tests, make us skeptical of any single account Century-Crofts.
of concurrent extinction based on time allo- Boakes, R. A., Halliday, M. S., & Poli, M. (1975). Re-
cation and local rates of reinforcement. sponse additivity: Effects of superimposing free rein-
forcement on a variable-interval baseline. Journal of the
Conclusion Experimental Analysis of Behavior, 23, 177-191.
Brownstein, A. J., & Pliskoff, S. S. (1968). Some effects
Further explorations of the determiners of of relative reinforcement rate and changeover delay in
response rate and resistance to change might response-independent concurrent schedules of rein-
forcement. Journal of the Experimental Analysis of Be-
employ procedures in which the alternative havior, 11, 683-688.
reinforcers are introduced in a way that does Burgess, I. S., & Wearden, J. H. (1986). Superimpo-
not affect the allocation of time to the target sition of response-independent reinforcement. Journal
response and that minimizes the chances of of the Experimental Analysis of Behavior, 45, 75-82.
reinforcer misallocation. One way to accom- Catania, A. C. (1963). Concurrent performances: Re-
inforcement interaction and response independence.
plish this is by signaling the alternative rein- Journal of the Experimental Analysis of Behavior, 6, 253-
forcers (e.g., Catania, 1963, 1969). Another 263.
approach might involve presentation of alter- Catania, A. C. (1969). Concurrent performances: In-
native reinforcers during successive and dis- hibition of one response by reinforcement of another.
Journal of the Experimental Analysis of Behavior, 12,
tinctive segments of a common signaled situ- 731-744.
ation. This approach has been used by Nevin Catania, A. C., & Reynolds, G. S. (1968). A quantitative
(1984) and by Nevin et al. (1987), where the analysis of the responding maintained by interval
common situation was defined by key location; schedules of reinforcement. Journal of the Experimental
other methods of defining the situation may Analysis of Behavior, 11, 327-383.
Colwill, R. M., & Rescorla, R. A. (1986). Associative
give even clearer results. Also, these analyses structures in instrumental learning. In G. H. Bower
should be extended to other species, responses, (Ed.), The psychology of learning and motivation (Vol.
and reinforcers because of the well-known ef- 20, pp. 55-104). New York: Academic Press.
fects of keylight-food relations on key pecking Davison, M., & Jenkins, P. E. (1985). Stimulus dis-
criminability, contingency discriminability, and sched-
by pigeons (Schwartz & Gamzu, 1977). Mace ule performance. Animal Learning & Behavior, 13, 77-
84.
Edgar, D., Hall, G., & Pearce, J. M. (1981). Enhance-
2 Fichett, E. A., & Nevin, J. A. (1984, April). Response ment of food-rewarded instrumental responding by an
strength in multiple and concurrent schedules. Paper pre- appetitive conditioned stimulus. Quarterly Journal of
sented at the meetings of the Eastern Psychological As- Experimental Psychology, 33B, 3-19.
sociation, Baltimore, MD. Estes, W. K. (1943). Discriminative conditioning. I. A
ALTERNATIVE REINFORCEMENT 379
discriminative property of conditioned anticipation. Myerson, J., & Hale, S. (1988). Choice in transition:
Journal of Experimental Psychology, 32, 150-155. A comparison of melioration and the kinetic model.
Estes, W. K. (1948). Discriminative conditioning. II. Journal of the Experimental Analysis of Behavior, 49,
Effects of a Pavlovian conditioned stimulus upon a 291-302.
subsequently established operant response. Journal of Nevin, J. A. (1969). Interval reinforcement of choice
Experimental Psychology, 38, 173-177. behavior in discrete trials. Journal of the Experimental
Fath, S. J., Fields, L., Malott, M. K., & Grossett, D. Analysis of Behavior, 12, 875-885.
(1983). Response rate, latency, and resistance to Nevin, J. A. (1974). Response strength in multiple
change. Journal of the Experimental Analysis of Behavior, schedules. Journal of the Experimental Analysis of Be-
39, 267-274. havior, 21, 389-408.
Fleshler, M., & Hoffman, H. S. (1962). A progression Nevin, J. A. (1979). Reinforcement schedules and re-
for generating variable-interval schedules. Journal of sponse strength. In M. D. Zeiler & P. Harzem (Eds.),
the Experimental Analysis of Behavior, 5, 529-530. Advances in analysis of behaviour: Vol. 1. Reinforcement
Gibbon, J., & Balsam, P. (1981). Spreading association and the organization of behaviour (pp. 117-158). Chich-
in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon ester, England: Wiley.
(Eds.), Autoshaping and conditioning theory (pp. 219- Nevin, J. A. (1984). Pavlovian determiners of behavioral
253). New York: Academic Press. momentum. Animal Learning & Behavior, 12, 363-370.
Gibbon, J., Berryman, R., & Thompson, R. L. (1974). Nevin, J. A., Mandell, C., & Yarensky, P. (1981). Re-
Contingency spaces and measures in classical and in- sponse rate and resistance to change in chained sched-
strumental conditioning. Journal of the Experimental ules. Journal of Experimental Psychology: Animal Be-
Analysis of Behavior, 21, 585-605. havior Processes, 7, 278-294.
Gilbert, T. F. (1958). Fundamental dimensional prop- Nevin, J. A., Smith, L. D., & Roberts, J. (1987). Does
erties of the operant. Psychological Review, 65, 272- contingent reinforcement strengthen operant behavior?
282. Journal of the Experimental Analysis of Behavior, 48, 17-
Guilkey, M., Shull, R. L., & Brownstein, A. J. (1975). 33.
Response-rate invariance in concurrent schedules: Ef- Pear, J. J., & Rector, B. L. (1979). Constituents of
fects of different changeover contingencies. Journal of response rate. Journal of the Experimental Analysis of
the Experimental Analysis of Behavior, 24, 43-52. Behavior, 32, 341-362.
Hammond, L. J. (1980). The effect of contingency upon Rachlin, H. (1973). Contrast and matching. Psycholog-
the appetitive conditioning of free-operant behavior. ical Review, 80, 217-234.
Journal of the Experimental Analysis of Behavior, 34, Rachlin, H., & Baum, W. M. (1972). Effects of alter-
297-304. native reinforcement: Does the source matter? Journal
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 18, 231-241.
of the Experimental Analysis of Behavior, 13, 243-266. Rescorla, R. A. (1968). Probability of shock in the pres-
Holland, P. C. (1983). Occasion setting in Pavlovian ence and absence of CS in fear conditioning. Journal of
feature positive discriminations. In M. L. Commons, Comparative and Physiological Psychology, 66, 1-5.
R. J. Herrnstein, & A. R. Wagner (Eds.), Quantitative Rescorla, R. A., & Solomon, R. L. (1967). Two-process
analyses of behavior: Vol. 4. Discrimination processes (pp. learning theory: Relationships between Pavlovian con-
183-206). Cambridge, MA: Ballinger. ditioning and instrumental learning. Psychological Re-
Killeen, P. R. (1979). Arousal: Its genesis, modulation, view, 74, 151-182.
and extinction. In M. D. Zeiler & P. Harzem (Eds.), Schwartz, B., & Gamzu, E. (1977). Pavlovian control
Advances in analysis of behaviour: Vol. 1. Reinforcement of operant behavior. In W. K. Honig & J. E. R. Stad-
of the organization of behaviour (pp. 31-78). Chichester, don (Eds.), Handbook of operant behavior (pp. 53-97).
England: Wiley. Englewood Cliffs, NJ: Prentice-Hall.
Konorski, J. (1967). Integrative activity of the brain. Chi- Silberberg, A., & Fantino, E. (1970). Choice, rate of
cago: University of Chicago Press. reinforcement, and the changeover delay. Journal of the
Krystal, S. (1970). Modulation of operant responding by Experimental Analysis of Behavior, 13, 187-197.
appetitive Pavlovian conditioning. Unpublished doctoral Skinner, B. F. (1938). The behavior of organisms. New
dissertation, Columbia University, New York. York: Appleton-Century.
Lander, D. G. (1968). Stimulus bias in the absence of Skinner, B. F. (1950). Are theories of learning neces-
food reinforcement. Journal of the Experimental Analysis sary? Psychological Review, 57, 193-216.
of Behavior, 11, 711-714. Smith, K. (1974). The continuum of reinforcement and
Mace, F. C., Lalli, J. S., Shea, M. C., Lalli, E. P., West, attenuation. Behaviorism, 2, 124-145.
B. J., & Nevin, J. A. (in press). The momentum of Stubbs, D. A., & Pliskoff, S. S. (1969). Concurrent
human behavior in a natural setting. Journal of the responding with fixed relative rate of reinforcement.
Experimental Analysis of Behavior. Journal of the Experimental Analysis of Behavior, 12,
Mellon, R. C., & Shull, R. L. (1986). Resistance to 887-895.
change produced by access to fixed-delay versus vari- Williams, B. A., & Royalty, P. (1989). A test of the
able-delay terminal links. Journal of the Experimental melioration theory of matching. Journal of Experimental
Analysis of Behavior, 46, 79-92. Psychology: Animal Behavior Processes, 15, 99-113.
Morse, W. H., & Skinner, B. F. (1958). Some factors
involved in the stimulus control of operant behavior.
Journal of the Experimental Analysis of Behavior, 1, 103- Received March 27, 1989
107. Final acceptance January 19, 1990