Download as pdf or txt
Download as pdf or txt
You are on page 1of 22

The Behavior Analyst 2008, 31, 39–60 No.

1 (Spring)

What 50 Years of Research Tell Us About Pausing


Under Ratio Schedules of Reinforcement
Henry D. Schlinger
California State University, Los Angeles
Adam Derenne
University of North Dakota
Alan Baron
University of Wisconsin–Milwaukee
Textbooks in learning and behavior commonly describe performance on fixed-ratio schedules as
‘‘break and run,’’ indicating that after reinforcement subjects typically pause and then respond
quickly to the next reinforcement. Performance on variable-ratio schedules, on the other hand, is
described as steady and fast, with few long pauses. Beginning with Ferster and Skinner’s
magnum opus, Schedules of Reinforcement (1957), the literature on pausing under ratio
schedules has identified the influences on pausing of numerous important variables, in particular
ratio size and reinforcement magnitude. As a result, some previously held assumptions have
been called into question. For example, research has shown that the length of the pause is
controlled not only by the preceding ratio, as Ferster and Skinner and others had assumed (and
as implied by the phrase postreinforcement pause), but by the upcoming ratio as well. Similarly,
despite the commonly held belief that ratio pausing is unique to the fixed-ratio schedule, there is
evidence that pausing also occurs under variable-ratio schedules. If such widely held beliefs are
incorrect, then what about other assumptions? This article selectively examines the literature on
pausing under ratio schedules over the past 50 years and concludes that although there may
indeed be some common patterns, there are also inconsistencies that await future resolution.
Several accounts of pausing under ratio schedules are discussed along with the implications of
the literature for human performances, most notably the behaviors termed procrastination.
Key words: fixed-ratio schedule, variable-ratio schedule, postreinforcement pause, preratio
pause, animal models, procrastination

2007 marked the 50th anniversary ditioning (what was later to become
of the publication of Charles Ferster the fixed-interval [FI] schedule) and
and B. F. Skinner’s magnum opus, fixed-ratio (FR) reinforcement (he
Schedules of Reinforcement (1957), hadn’t yet used the term reinforce-
which reported the results of experi- ment schedule) in The Behavior of
ments carried out under contracts to Organisms (1938), it wasn’t until the
the Office of Naval Research with publication of Schedules of Reinforce-
Harvard University between 1949 ment that he (and Ferster, working as
and 1955. Although Skinner had a research fellow under Skinner’s
previously discussed periodic recon- direction) distinguished several sim-
ple and complex schedules based on
Correspondence concerning this article can be nonhuman (pigeons and rats) perfor-
addressed to Hank Schlinger, Adam Derenne, mances. In addition, they investigat-
or Alan Baron, Department of Psychology, ed the effects of many different types
California State University, Los Angeles, 5151 of those schedules along with a
State University Dr., Los Angeles, California
90032 (e-mail: hschlin@calstatela.edu); Adam variety of other variables (e.g., drugs,
Derenne, Department of Psychology, Box 8380, deprivation level, ablation of brain
University of North Dakota, Grand Forks, tissue, added counters, etc.) that were
North Dakota 58202 (e-mail: adam.derenne@ described in terms of rate of response
und.nodak.edu) or Alan Baron, Department of
Psychology, University of Wisconsin–Milwau-
and depicted on cumulative records.
kee, Milwaukee, Wisconsin 53201 (e-mail: ab@ Their research documented the power
uwm.edu) of schedules of reinforcement to

39
40 HENRY D. SCHLINGER et al.

control behavior and established the ratio schedules reduces overall rein-
study of schedules as a focus within forcement rates. Because reinforce-
the experimental analysis of behavior. ment rates under ratio schedules
Ferster and Skinner’s research paint- depend strictly on response rates,
ed a detailed picture of the perfor- optimal performance would be for
mances of the subjects as seen on a subjects to resume responding imme-
response-by-response basis. Howev- diately. Yet they pause, and the
er, their wide-ranging effort did not resultant loss of reinforcement persists
attempt to provide systematic infor- over extended exposure to the sched-
mation about the effects of paramet- ule without diminution. The critical
ric variations across conditions and question, then, is: Why would an
subjects. It remained for subsequent animal pause when that very action
researchers to fill in the gaps. delays reinforcement and reduces
Fifty years and innumerable exper- overall reinforcement rate? One possi-
iments later, it is common for text- bility is that the animal is fatigued
books on learning to illustrate FR after working so hard. For example,
performances with cumulative records pauses are generally shorter under FR
and to describe the resulting patterns 10 than under FR 100. Because the FR
as ‘‘break and run’’ (see Figure 1). As 100 involves more work, it is possible
explained by Lattal (1991), ‘‘following that subjects rest longer before resum-
a period of nonresponding (a break, ing work. Another possibility is that
more precisely the postreinforcement food consumption creates satiation,
pause) after food delivery, there is a which weakens the motivational oper-
relatively quick transition to a high ation of food deprivation. However,
steady rate of responding (a run) that we will see that neither of these
is maintained until the next food seemingly reasonable explanations
presentation when the pattern re- survive simple tests and that the
peats’’ (p. 95). FR performances are picture is much more complicated.
often contrasted with those under Ratio pausing within the laborato-
variable-ratio (VR) schedules, in ry is also of special interest because it
which the size of the ratios varies resembles the human problem of
within the schedule. Under VR sched- procrastination: In both cases, an
ules, performances are ‘‘characterized action is put off even though the
by high response rates with little resulting delay may be disadvanta-
systematic pausing either after rein- geous. Social commentators have
forcement or at other times’’ (p. 95).1 noted that procrastination is a major
Among the myriad response pat- contributor to behavioral inefficiency
terns observed under various sched- in schools, industry, and our daily
ules of reinforcement, pausing under lives in general (Steel, 2007). Identi-
ratio schedules (especially FR sched- fication of the variables that control
ules) has attracted special attention. the ratio pause in the laboratory may
Unlike the pause that follows rein- help to reveal techniques for the
forcement on interval schedules, the modification of procrastination.
pause that follows reinforcement on Our primary purpose in this article
is to identify the variables that govern
1
A pause is usually defined as the time from pausing under ratio schedules. Re-
the delivery of a reinforcer until emission of search on pausing under ratio sched-
the first response of the subsequent ratio and
has been variously referred to as a postrein- ules has come a long way since
forcement or preratio pause. Although there is Ferster and Skinner’s (1957) pioneer-
evidence that pauses will sometimes occur ing contributions. They set us on our
after the first response (Ferster & Skinner, way, but in the ensuing 50 years
1957; Griffiths & Thompson, 1973; Mazur &
Hyslop, 1982), we use the terms pause and increasingly sophisticated questions
pausing to refer to the postreinforcement or and experimental designs have re-
preratio pause. vealed a more complex picture. A
PAUSING UNDER RATIO SCHEDULES 41

Figure 1. Cumulative records showing performances under FR 90 and VR 50 schedules of


reinforcement (Ferster & Skinner, 1957). Reproduced from Figure 2 (Lattal, 1991) and reprinted
with permission of Elsevier Science Publishers.

fundamental issue in research on ical mechanisms that govern pausing


ratio schedules, then, concerns how under ratio schedules.
pausing should be summarized and
described. In the present article we PAUSING UNDER
review the research on pausing under FR SCHEDULES
ratio schedules of reinforcement in an
Skinner (1938) first described the
attempt to glean an understanding of performances of rats under FR and
why pausing under such schedules FI reinforcement as including a pause
occurs. We first take a look at that was under the stimulus control
research on pausing with simple FR of the previous reinforcer:
schedules, then consider research
with complex (multiple and mixed) In both types of experiment the discrimination
schedules with FR components, and, from the preceding reinforcement is active,
finally, look at pausing under VR since one reinforcement never occurs immedi-
schedules. We then discuss the real- ately after another. A reinforcement therefore
world implications of ratio pausing, acts as an SD in both cases. As the result of this
discrimination the rat stops responding for a
in particular, the bearing of labora- short period just after receiving and ingesting
tory research on the pervasive social a pellet of food. (p. 288)
problem of human procrastination.
Finally, we offer a set of conclusions Thus, from the very beginning of his
that might shed light on the theoret- research on FR schedules, Skinner
42 HENRY D. SCHLINGER et al.

assumed that the pause was a func- Building on Skinner’s (1938) and
tion of the preceding reinforcer. Ferster and Skinner’s (1957) findings,
Consequently, the phrase postrein- subsequent research has identified a
forcement pause came to connote number of variables that affect the
not only the pause after reinforce- length of the FR pause. These include
ment but also the pause controlled by the size of the ratio (e.g., Felton &
reinforcement (Griffiths & Thomp- Lyon, 1966; Powell, 1968), the amount
son, 1973). of response effort (Alling & Poling,
Skinner did acknowledge that 1995; Wade-Galuska, Perone, &
there were ‘‘considerable individual Wirth, 2005), the magnitude of the
differences’’ in the length of pausing reinforcer (e.g., Lowe, Davey, & Har-
produced by FR schedules. For zem, 1974; Perone & Courtney, 1992;
example, in describing performance Powell, 1969), the probability of rein-
under an FR 192, he wrote, forcement (Crossman, 1968; McMil-
lan, 1971), and the level of deprivation
At one extreme the pause after ingestion may be (Malott, 1966; Sidman & Stebbins,
relatively great and the subsequent acceleration 1954). One could say that, in general,
to a maximal or near maximal rate very rapid.
… At the other extreme the pause is brief, but
the duration of the pause increases as a
the rate immediately following it is low and function of variables that weaken
accelerated slowly. (1938, pp. 289–290) responding. These include increases
in ratio size and response effort and
Recognition of such irregularities decreases in reinforcer magnitude,
also can be found in Morse and reinforcement probability, and degree
Dews’ (2002) foreword to the reprint- of deprivation. Although all of these
ing of Schedules of Reinforcement: variables likely interact in complex
ways, for present purposes we restrict
If one leafs through the pages of any chapter, our discussion to the two most re-
there are clearly differences in the uniformity searched: ratio size and reinforcement
and reproducibility of performances under a
particular type of schedule. Some of these magnitude.
differences in performances come from the
continuing technical improvements in the Effects of FR Size on Pausing
design of keys and feeders, others from
differences in the past experiences of subjects In their chapter on FR schedules,
before exposure to the current contingencies Ferster and Skinner (1957) presented
or from the duration of exposure to current cumulative records of pigeons transi-
conditions, and sometimes from differences
between subjects treated alike. (p. 315) tioning from FR 1 or low FR
schedules to higher FR schedules, as
Inspection of the cumulative records well as cumulative records of final
reproduced in Ferster and Skinner’s performances on FR 120 and FR 200
compendium confirms that despite schedules. Although there is some
impressive commonalities in perfor- within-subject and between-subjects
mances, there also are unaccounted- variability, the cumulative records
for differences both within the per- show that performances by pigeons
formances of the same subject and on ratios as high as FR 60 are
between those of different subjects. characterized by brief pauses. The
These two facets of Skinner’s re- final performances of 2 birds on
search—regularities in performance higher FR schedules (FR 120 and
sometimes accompanied by unac- FR 200) reveal some longer pauses
countable variation—are not neces- (although at these ratios the variabil-
sarily at odds. Individual differences ity is even greater), prompting the
should serve as a prod for identifying conclusion that pause length increas-
the variables that control the differ- es with FR size.
ences, thus strengthening conclusions Subsequent experiments provided
about the commonalities. support for the finding that long
PAUSING UNDER RATIO SCHEDULES 43

pauses become more frequent with retrospect, we know can obscure


increases in FR size. In the first important variations in performance
parametric study of FR pausing, and, thus, tell only part of the story
Felton and Lyon (1966) exposed of pausing under FR schedules (Bar-
pigeons to schedules ranging from on & Herpolsheimer, 1999).
FR 25 to FR 150. Their results
showed that the mean pause duration Effects of Reinforcement Magnitude
increased systematically as a function on Pausing
of FR size. A cumulative record from
1 bird reveals consistently brief paus- Ferster and Skinner (1957) did not
es at FR 50 very much like the study the effects of reinforcement
performance of Ferster and Skinner’s magnitude on pausing per se, al-
pigeons at similar FR sizes. By though they did report that pausing
comparison, the record for FR 150 increased when the magazine hopper
shows some longer pauses but many became partially blocked. Subse-
short ones as well. quent studies revealed that variations
Felton and Lyon’s (1966) results in reinforcement magnitude can have
were replicated by Powell (1968) important effects on FR pausing. The
who, beginning with FR 10, moved results, however, have been conflict-
pigeons through small sequential ing. Powell (1969), in what perhaps
changes in FR size up to FR 160 was the first systematic study of
and then back down to FR 10. His magnitude, varied pigeons’ access to
results showed that mean pausing grain using two durations (either 2.5
increased as an accelerating function or 4 s), each correlated with a differ-
of FR size. Powell provided a de- ent colored key light. In different
tailed analysis of this effect by phases, FR values ranged from 40 to
including a frequency distribution of 70. His results showed an inverse
individual pauses that showed that as relation between reinforcement mag-
ratio size increased the dispersion of nitude and pausing. Longer pauses
pauses from shorter to longer also occurred with the shorter food dura-
increased. Nevertheless, his data tion, especially at the higher ratios,
showed a relatively greater number indicating that magnitude and ratio
of shorter pauses, even at FR 160. size interact to determine the extent of
These data supply additional evi- pausing. Interestingly, Powell sug-
dence that as FR size increases, gested that pause durations could be
longer pauses become more frequent. controlled or stabilized at different
But they also demonstrate that short- FR requirements by manipulating
er pauses still predominate, a fact reinforcement magnitudes. In es-
that Ferster and Skinner also noted. sence, Powell’s findings indicated that
Taken together, Felton and Lyon’s increasing the magnitude of reinforce-
and Powell’s results confirm the ment could mitigate the effects of
standard description of performance increased ratio size on pausing.
under ratio schedules as break and Lowe et al. (1974) obtained differ-
run, even though Powell’s distribu- ent results in an experiment in which
tion data and Felton and Lyon’s rats, performing on an FR 30 sched-
cumulative records show that the ule, were exposed to a sweetened
majority of pauses were unaffected condensed milk solution mixed with
by increases in ratio size. water that varied in concentration
One problem with the Felton and from 10% to 70%. Contrary to
Lyon (1966) and Powell (1968) ex- Powell’s (1969) report, Lowe et al.
periments was that the main findings found that the length of the pause
were summarized as functions show- was a direct function of the magni-
ing the relation between ratio size tude of reinforcement, and they
and the mean pause, which, in attributed the results to an uncondi-
44 HENRY D. SCHLINGER et al.

tioned inhibitory aftereffect of rein- sessions). A variant is the progres-


forcement. There are a number of sive-ratio (PR) schedule of reinforce-
procedural differences between the ment, a schedule in which the ratio
studies by Powell (1969) and Lowe et increases in a series of steps during
al. (1974) that might account for the the course of the session until the
opposite results, including the species ratio becomes so high that the subject
of the subject (pigeons vs. rats), the stops responding (the so-called
definition of magnitude (duration of breaking point). The PR schedule
access to grain vs. milk concentra- was originally developed by Hodos
tion), the presence of discriminative (1960) as a way of assessing the value
stimuli (multiple schedule vs. simple of a reinforcer using the breaking-
schedule), and the procedure of point measure. However, the cumu-
varying the concentration from one lative records provided in some re-
delivery to the next within the same ports (see Hodos & Kalman, 1963;
session (within- vs. between-session Thomas, 1974) showed that pauses
procedures). It is also noteworthy increased in duration as the ratio size
that the literature on the effects of increased, a finding that bears obvi-
magnitude on pausing under FR ous similarities to the relation be-
schedules has included carefully done tween FR size and pausing.
studies in which magnitude effects More recently, quantitative analy-
were absent (e.g., Harzem, Lowe, & ses of PR pausing have shown that
Davey, 1975; Perone, Perone, & the rate of increase from ratio to ratio
Baron, 1987). can be described as an exponential
In a discussion of these and other function of ratio size throughout
studies, Perone et al. (1987; see also most of the range of ratios (Baron
Perone & Courtney, 1992) proposed & Derenne, 2000; Baron, Mikorski,
an account that relies on an interac- & Schlund, 1992). A similar relation
tion between both inhibitory and can be discerned in FR pausing as a
excitatory control. Specifically, ratio function of ratio size (e.g., Felton &
performance is assumed to reflect Lyon, 1966). However, unlike FR
unconditioned inhibition from the schedules, the PR function steepens
previous reinforcer and excitation markedly during the last few ratios
from stimuli correlated with the prior to the final breaking point, a
upcoming reinforcer. In Powell’s finding perhaps not unexpected, giv-
(1969) study, in which increased en that PR performances ultimately
magnitude reduced pausing, the ex- result in extinction.
citatory stimuli were dominant be- Along with ratio size, reinforce-
cause the multiple schedule provided ment magnitude plays a parallel role
cues that were correlated with the in PR and FR schedules. Baron et al.
magnitude of the upcoming reinforc- (1992) found that the slope of the PR
er. By comparison, in the Lowe et al. pause-ratio functions decreased with
(1974) study, such stimuli were ab- increases in the concentration of
sent because the concentration level sweetened milk reinforcement, thus
varied in an unpredictable manner, signifying lesser degrees of pausing.
and the dominant influence was from These results show that the PR
the aftereffect of the prior reinforcer. schedule provides a convenient way
to study variables that influence ratio
Pausing Under Progressive-Ratio pausing. A complicating factor, how-
ever, is that the contingencies embed-
Schedules
ded in the progression of increasing
Our discussion of ratio pausing has ratio sizes may also influence per-
centered on simple FR schedules (i.e., formances, particularly at the high-
a procedure in which the schedule est ratios (cf. Baron & Derenne,
parameters are unchanged within 2000).
PAUSING UNDER RATIO SCHEDULES 45

Pausing Within Multiple FR sequences. Mixed schedules (i.e.,


FR Schedules schedules without correlated stimuli)
provided control data. The results
Identifying the variables that con-
showed that prolonged pausing sys-
trol pausing on simple FR schedules
tematically occurred before the high
is difficult because such schedules ratios on the multiple schedules but
hold fixed characteristics of the ratio, not on the mixed schedules.
such as size and reinforcement mag-
Griffiths and Thompson (1973)
nitude. Under such schedules, the noted that in mixed or multiple
obvious place to look for the vari- schedules with unpredictable alterna-
ables that control pausing is the just- tion between two ratio components
completed ratio, as originally sug- of different lengths, there are four
gested by Skinner and subsequent possible occasions for pausing: after
researchers. Perhaps, as mentioned a high ratio and before a high ratio
previously, the subject is pausing to (high-high); after a low ratio and
rest from its labors, or perhaps the before a high ratio (low-high); after a
just-delivered food has reduced its high ratio and before a low ratio
deprivation level. The interpretive (high-low); and after a low ratio and
problem posed by simple-schedule before a low ratio (low-low). The
data is that pausing could just as researchers presented data on the
easily be attributed to the upcoming relative frequency distributions of
ratio as to the preceding ratio. The pause durations for all four possible
solution to this problem is to use ratio combinations. The results showed
multiple schedules with FRs in both that the longest pauses (30 s or greater)
components. occurred most frequently before high
As explained by Ferster and Skin- ratios on the multiple schedules but
ner (1957), multiple schedules are not the mixed schedules. Moreover,
compound schedules in which two in the multiple schedules, the fre-
or more simple schedules of rein- quency of longest pauses was greater
forcement, each correlated with a before the low-high transition than
different stimulus, are alternated. before the high-high transition, sug-
Ferster and Skinner presented data gesting to Griffiths and Thompson
on multiple FR FR schedule perfor- that ‘‘pausing in ratio schedules is
mances (e.g., FR 30 FR 190). How- largely a function of the relative size
ever, these data did not clarify the [italics added] of the upcoming
nature of control over pausing be- ratio’’ (p. 234). The implication is
cause each of the two components that the preceding ratio and stimuli
was in effect for entire sessions, correlated with the upcoming ratio
making it difficult to assess the interacted to determine the length of
contrast between the components. the pause. These results led the
What was needed was a method with researchers to suggest that although
two (or more) FR components so the term postreinforcement pause
that the characteristics of the two could still be used descriptively to
ratios could be varied independently. refer to the pause after reinforce-
This essentially was the strategy ment, a more functionally appropri-
followed by subsequent researchers ate term might be preratio pause, or
(e.g., Baron & Herpolsheimer, 1999; the even more neutral between-ratio
Griffiths & Thompson, 1973). pause.
For example, Griffiths and Thomp- Baron and Herpolsheimer (1999)
son (1973) observed rats responding replicated many features of the study
under several two-component multi- by Griffiths and Thompson (1973),
ple FR schedules (FR 20 FR 40, FR but they also uncovered a critical
30 FR 60, and FR 60 FR 120) that analytic problem. On average, pauses
were programmed in semirandom increased in duration as the ratio
46 HENRY D. SCHLINGER et al.

increased, and pausing was more a As noted earlier, pausing under


function of the upcoming ratio than multiple FR FR schedules depends
the preceding ratio. However, the on the transition from the preceding
authors addressed a feature of the to the upcoming reinforcement. The
results that Griffiths and Thompson research design exemplified by Grif-
had not acknowledged: The distribu- fiths and Thompson (1973) originally
tions of individual pauses were pos- was directed toward pausing as a
itively skewed, and changes in aver- function of consecutive ratios that
age performance were due more to differed in size. Subsequently, Perone
increased skew than to shifts of the and his students investigated transi-
entire distribution. In other words, tions from ratios that varied in terms
more pauses tended to be of relatively of reinforcer magnitude (Galuska,
short duration than relatively long Wade-Galuska, Woods, & Winger,
duration, and this occurred even 2007; Perone, 2003; Perone & Court-
when relatively high ratios (e.g., ney, 1992) and response effort
150) were employed. (Wade-Galuska et al., 2005). As is
Discrepancies between the measure the case when different-sized FR
of central tendencies and the individ- schedules were contrasted, pausing
ual values within the distribution was longest following a transition
raise a fundamental issue in the study from a large to a small reinforcer
of pausing: Should the individual or, in the case of response effort, a
pause serve as the unit of analysis transition from a low to a high
or should the distribution of pauses response-force requirement. By com-
be aggregated into a single value? parison, pauses were relatively short
Behavior analysts have traditionally when the transition was from a small
viewed the practice of aggregating to a large magnitude or from a high
data from different subjects with to a low response force. Taken as a
suspicion because the average from whole, these findings suggest that
a group of individuals may not pausing is affected by the relative
provide a satisfactory picture of any ‘‘favorableness’’ of the situation, with
member of the group (Sidman, 1960). pauses becoming most pronounced
By comparison, methods that char- when the transition is from a more to
acterize an individual’s performance a less favorable contingency (Wade-
through an average of data from that Galuska et al., 2005).
individual are commonly regarded as We noted that pauses tend to be
acceptable. However, the results from longest when the upcoming ratio is
studies on pausing suggest that an higher, requires more effort, or pro-
average based on within-subject ag- duces smaller reinforcement magni-
gregation may not provide a satisfac- tudes, but that pausing may also be
tory picture of individual perfor- influenced by features of the previous
mances either. In particular, the use ratio. Harzem and Harzem (1981)
of the mean may exaggerate the have summarized the view that paus-
degree of pausing and conceal the ing is due to an unconditioned
fact that often the subject pauses very inhibitory aftereffect of reinforce-
little, if at all. These questions about ment. Such an effect should dissipate
ways of aggregating individual re- with the passage of time, depending
sponses underscore an important on the magnitude of the just-com-
issue raised previously: Although pleted reinforcer. One manipulation
mean pausing increases as a function that can clarify the extent of the
of ratio size, a significant number of inhibitory effect is to include a period
ratios are accompanied by brief of time-out between the delivery of
pauses. The origin of this mix be- the reinforcer and the start of the
tween long and short pauses remains next ratio. Several studies have con-
to be discovered. firmed that pausing is indeed reduced
PAUSING UNDER RATIO SCHEDULES 47

when such time-out periods are consistent with simple FR ratios).


interposed on FR schedules (Mazur However, priming emerged with in-
& Hyslop, 1982; Perone et al., 1987) creases in the proportion of high
and PR schedules (Baron et al., ratios. Once again, subjects paused
1992). within the higher ratio after emission
of the approximate number of re-
Pausing Within Mixed FR sponses in the lower ratio. Taken as a
FR Schedules whole, the phenomenon of priming
within mixed schedules points to the
Multiple FR FR schedules provide
subject’s high degree of sensitivity to
insight into the degree to which
the size of the FR. When the
pausing is controlled by upcoming,
upcoming ratio is higher than the
as opposed to preceding, contingen-
preceding one, and this difference is
cies. Because each component is
signaled by correlated stimuli (multi-
correlated with a distinct stimulus,
ple schedule), pausing after reinforce-
the discriminative control exerted by
ment is the rule. When, however,
the upcoming ratio can be manipu-
experimenter-controlled stimuli are
lated within a session. By compari-
not available (mixed schedule), a
son, mixed FR FR schedules, that is,
pause commensurate with the lower
schedules in which the FR contin-
ratio appears within the higher one.
gencies vary within the session, lack
It appears, then, that animals can
discriminative stimuli associated with
discriminate the size of the ratio
upcoming ratios that might exert
based on their own responding
control over responding. Conse-
(Thompson).
quently, control of pausing appears
to be limited to characteristics of the
PAUSING UNDER
previous ratio. When Ferster and
VR SCHEDULES
Skinner (1957) compared mixed FR
FR schedules with markedly different Having completed our review of
ratio sizes (e.g., FR 30 and FR 190), FR schedules (and FR variants), we
they found that pausing occurred now turn to a consideration of their
within the ratio rather than during VR counterparts. Ferster and Skin-
the transition from one ratio size to ner (1957) assumed that pausing
the next. Specifically, during FR 190, under FR schedules occurs because
pausing occurred within the ratio the reinforcer delivered at the end of
after approximately 30 responses one ratio is also an SD for responding
(the size of the lower ratio). Ferster at the beginning of the next ratio.
and Skinner called this within-ratio Because the size of the upcoming
pausing ‘‘priming,’’ stating that, ‘‘the ratio under VR schedules is typically
emission of approximately the num- unpredictable and sometimes quite
ber of responses in the smaller ratio low, the SD effects of the reinforcer
‘primes’ a pause appropriate to the are weak. As a result, pausing under
larger ratio’’ (p. 580). VR schedules should be minimal.
Several subsequent experiments In line with this interpretation,
have provided quantitative analyses most of Ferster and Skinner’s cumu-
of priming (e.g., Crossman & Silver- lative records of VR performances
man, 1973; Thompson, 1964). For reveal uniformly high rates with few
example, Crossman and Silverman irregularities. For example, with typ-
presented detailed data using proce- ical birds, although response rates
dures that varied the proportion of occasionally varied, pausing was
FR 10 to FR 100 components within clearly absent at moderate ratios
a mixed schedule. When most of the (e.g., VR 40 or 50). Even on relatively
ratios were FR 10, pausing occurred high VR schedules (e.g., VR 360),
chiefly after reinforcement (a finding pauses were short. Perhaps cumula-
48 HENRY D. SCHLINGER et al.

tive records such as these, as well as individual subjects) echoes the finding
Ferster and Skinner’s description of described previously by Lowe et al.
VR performance in general, led to the (1974) with mixed FR schedules. The
widespread belief that pauses under implication is not just that marked VR
VR schedules are either very short or pausing is possible but that VR and FR
nonexistent. As we have already seen pausing are controlled by similar vari-
with FR schedules, however, research ables.
has revealed a more complex picture Blakely and Schlinger (1988) also
than that presented by Ferster and examined interactions between mean
Skinner. Likewise, pausing under VR ratio size and reinforcer magnitude
schedules is also more complex than under VR schedules. Pigeons re-
Ferster and Skinner assumed. sponded on multiple VR VR sched-
ules ranging from VR 10 to VR 70 in
Effects of Ratio Size and which access to food was available
Reinforcement Magnitude in for 2 s in one component and 8 s in
VR Schedules the other. Results showed that paus-
ing increased with ratio size at both
Although studies on pausing under magnitudes. However, the effect was
FR schedules are numerous, relative- considerably more marked in the
ly few studies have been concerned component with the smaller of the
with the variables that control paus- two magnitudes, a finding exactly
ing under VR schedules. With regard opposite to those of Priddle-Higson
to the role of ratio size, Crossman, et al. (1976). Applying the analysis of
Bonem, and Phelps (1987) confirmed excitation and inhibition by Perone et
Ferster and Skinner’s findings in a al. (1987), this difference is expected
study in which pigeons responded because the multiple-schedule proce-
under simple FR and VR schedules dure of Blakely and Schlinger exerted
with ratio sizes ranging from 5 to 80. excitatory control by the stimuli
Both schedules yielded brief pauses at correlated with the upcoming magni-
low-to-moderate ratios. However, tude size.
under the FR 80 schedule pausing A remaining issue concerns why
was relatively long, whereas under some experiments have shown little
the VR 80 schedule pausing was or no VR pausing (e.g., Crossman et
relatively short. al., 1987; Ferster & Skinner, 1957),
Other research has opened to whereas others have (e.g., Blakely &
question the view that significant Schlinger, 1988; Priddle-Higson et
pausing is absent under VR sched- al., 1976; Schlinger, Blakely, & Kac-
ules. In a study with rats, Priddle- zor, 1990). Schlinger and colleagues
Higson, Lowe, and Harzem (1976) have shown that the chief cause is
varied the mean ratio size (e.g., VR probably the size of the lowest ratio
10, VR 40, VR 80) across sessions within the distribution of individual
and the magnitude of the reinforcer ratios that comprise the VR schedule.
(concentration of sweetened milk) When Ferster and Skinner studied
within sessions using a mixed sched- VR schedules, the lowest ratio was
ule. Results showed that mean pause ‘‘usually 1’’ (p. 391). For example, on
durations increased as a function of a VR 360 schedule, the actual pro-
VR size. Moreover, the longest paus- gression of ratios ranged from 1 to
es occurred whenever the highest 720. Other researchers who have
concentrations were employed, indi- reported minimal VR pausing have
cating that ratio size and reinforce- followed suit (e.g., Crossman et al.).
ment magnitude interacted. The find- When Schlinger et al. set the lowest
ing of long pauses with a high- ratio to 1 they also found that
concentration reinforcer (means ranged minimal pausing occurred and that
from approximately 18 s to 43 s for other manipulations in the schedule
PAUSING UNDER RATIO SCHEDULES 49

(e.g., mean ratio size and the magni- the simple to the complex; it is constantly
tude of the reinforcer) had little effect concerned with whether the processes and
laws discovered are adequate for the next. It
on performances. However, when the would be rash to assert at this point that there
lowest ratio was higher (additional is no essential difference between human
values were 4, 7, or 10 for the lowest behavior and the behavior of the lower
ratio), longer pausing occurred, and species; but until an attempt has been made
to deal with both in the same terms, it would
other manipulations were observed to be equally rash to assert that there is. A
have an effect that paralleled the discussion of human embryology makes con-
results with FR schedules. Thus, a siderable use of research on the embryos of
procedural artifact—incorporating 1 chicks. Treatises on digestion, respiration,
as the lowest ratio in the VR distri- circulation, endocrine secretion, and other
physiological processes deal with rats, ham-
bution, found in much of the early sters, rabbits, and so on, even though the
research on pausing under VR sched- interest is primarily in human beings. The
ules—is the likely reason why re- study of behavior has much to gain from the
searchers and textbook authors assert same practice. (p. 38)
that pausing is absent under VR
schedules. Skinner’s views, as well as those of
such pioneering figures as Pavlov,
Thorndike, and Watson, were shaped
PAUSING ON THE by the Darwinian assumption of
HUMAN LEVEL biological continuity between species.
Ferster and Skinner’s (1957) re- Behavioral researchers study non-
search, together with the various human animals because they are
experiments that followed, has yield- more suited for experimental re-
ed a wealth of data pertaining to search. Researchers are reluctant to
performances under ratio schedules. expose humans to the extreme forms
This literature has produced a set of of control and the extended study
empirical principles that provides a required for the steady-state method
framework for control by reinforce- needed for experimentation. In addi-
ment schedules. Equally important is tion, the complex histories brought
that the study of schedules has by humans into the laboratory inter-
provided the basis for an understand- act with the conditions under inves-
ing of human affairs as exemplified tigation. Of course, the experimental
by Skinner’s classic book, Science and study of nonhuman subjects does not
Human Behavior (1953). However, a necessarily guarantee correct conclu-
conspicuous feature of the literature sions about human behavior. The
we have reviewed so far is that the development of comprehensive be-
research comes only from the animal havioral principles requires a bal-
laboratory. We now turn to the anced approach. Thus, detailed ex-
question of the applicability of such perimental data from the animal
findings to humans. laboratory, although clearly impor-
Although the value of animal tant, must be combined with knowl-
models is sometimes challenged as a edge from the study of human
way to understand human behavior, behavior. To understand how the
this approach has met with consider- data on pausing with nonhuman
able success within the behavioral and subjects may relate to human behav-
biological sciences. Skinner (1953) ior, we first consider results from
provided a vigorous defense of animal experiments with human subjects;
models in the following terms: this is followed by a discussion of
how a behavioral interpretation of
the human problem of procrastina-
Human behavior is distinguished by its
complexity, its variety, and its greater accom- tion might proceed. We conclude
plishments, but the basic processes are not with a brief consideration of how
necessarily different. Science advances from variables manipulated in experiments
50 HENRY D. SCHLINGER et al.

with nonhuman animals might be tations. Moreover, there are note-


used to reduce human procrastina- worthy instances in which a given
tion. researcher’s conclusions differed from
those reported by other researchers.
Experiments with Human Subjects These difficulties notwithstanding,
the available evidence suggests that
The most direct source of informa-
human subjects do pause under FR
tion about ratio pausing in humans
schedules and pause very little under
comes from experiments with human VR schedules. The exact degree of
subjects. The logic is the same as in pausing varies substantially, depend-
the biomedical sciences, when an ing on idiosyncratic features of the
intermediate step is inserted between experimental procedure. At one ex-
research with animal subjects and treme are studies in which FR
clinical practice. For example, the pausing appears to be entirely absent
effectiveness of a drug developed in (e.g., Sanders, 1969; Weiner, 1964).
the animal laboratory is verified At the other are studies in which the
through systematic experiments with results obtained with humans neatly
human volunteers. Only when the mirror those found in the animal
drug has been found to pass muster laboratory (e.g., R. F. Wallace &
on the human level is it introduced Mulder, 1973; D. C. Williams, Saun-
within medical practice. In similar ders, & Perone, in press). The re-
terms, behavioral questions can be maining studies reveal a range of
addressed in the human laboratory to intermediate performances, depend-
clarify a range of issues. But it is also ing on the degree of regularity in the
the case that experimental research pause–run pattern.
with human subjects, both behavioral We located 13 experiments specif-
and biological, poses ethical and ically concerned with human perfor-
methodological problems. However, mance under simple FR schedules. In
within these boundaries, animal- addition to experiments with normal-
based principles can be examined in ly functioning adults (Holland, 1958;
experiments with humans, and the Sanders, 1969; Weiner, 1964, 1966),
results can both buttress behavioral studies include those with infants
interpretations and inform behavior- (Hillman & Bruner, 1972), young
al interventions. children (Long, Hammack, May, &
Ratio schedules of reinforcement Campbell, 1958; Weisberg & Fink,
appear in several basic and applied 1966; Zeiler & Kelley, 1969), mentally
experiments with humans. Some- retarded persons (Ellis, Barnett, &
times, ratio schedules are used as a Pryer, 1960; Orlando & Bijou, 1960;
tool to study some other process, and R. F. Wallace & Mulder, 1973; D. C.
the particulars of ratio schedule Williams et al., in press), and schizo-
performances are not reported. Even phrenics (Hutchinson & Azrin, 1961).
when ratio schedule performances are Perhaps it is not surprising that
described, response rates or pausing individuals with a wide range of
may be presented in minimal detail. histories and other personal charac-
A further complication pertains to teristics have produced such varied
the results reported in research on outcomes. Aside from subject char-
ratio schedules in humans. Following acteristics, differences include preex-
the lead of Ferster and Skinner, most perimental instructions (usually these
often the data have been in the form are not explicitly specified), the type
of selected cumulative records. In of reinforcer (candy, trinkets, points,
those cases in which the results have etc.), and the characteristics of the
not been analyzed in quantitative manipulandum (e.g., telegraph key,
terms, there often is room for differ- plunger, touch screen, etc.). Un-
ent, sometimes conflicting, interpre- doubtedly, developmental level and
PAUSING UNDER RATIO SCHEDULES 51

verbal capability also play important the counter on the machine indicated
roles. that 100 pieces had been made. At
In light of this variation, it is a this point, the worker would record
formidable task to establish corre- the number completed on a work
spondences between specific charac- card and then take a break’’ (p. 147).
teristics of the experimental proce- In other words, the workers exhibited
dure and the degree of ratio pausing. the familiar break-and-run pattern
The scarcity of human experiments associated with FR schedules. Al-
that have addressed basic schedule though such interpretations of oper-
parameters makes it difficult to draw ant performances have an important
definitive conclusions. Nonetheless, place within science, by the usual
two promising leads are well worth standards they cannot be regarded as
mentioning. In an early study, R. F. definitive. One cannot be certain
Wallace and Mulder (1973) demon- about the role of the observer’s
strated that pause duration increased expectation or whether the behavior
and decreased systematically accord- sample is representative. Also, other
ing to an ascending and descending theoretical systems may generate
series of FR sizes. More recently, D. equally plausible interpretations of
C. Williams et al. (in press), using the same behavior.
multiple FR FR schedules (cf. Perone No doubt, behavioral interpreta-
& Courtney, 1992), found that the tions pose numerous unresolved
extent of pausing was maximal when questions. An essential first step is
a large-magnitude reinforcer was to develop ways of systematically
followed by a small one. Studies such recording human performances as
as these can serve as a model of they occur in the natural environ-
effective research on the human level: ment. A simple, but instructive, study
replication, steady-state methods, and was reported by the famous novelist
systematic variation of the control- Irving Wallace, who kept detailed
ling variables. charts of his own writing output (I.
Wallace, 1977). This information,
Behavioristic Interpretation when expressed in the form of
cumulative records, showed that
In addition to experiments with ‘‘the completion of a chapter always
human subjects, human behavior coincided with the termination of
may be informed by research with writing for the day on which the
nonhumans through behavioral in- chapter was completed’’ (p. 521).
terpretation, that is, correspondences In other words, Wallace’s records,
between naturally occurring human which were based on the writing of
behaviors and contingencies studied several novels, resembled the FR
in the animal laboratory. More sim- break-and-run pattern. More broad-
ply, researchers interpret complex ly, field studies of behaviors in a
human behaviors with principles de- variety of settings (e.g., the factory or
rived from nonhuman laboratory the classroom) can provide detailed
investigations. For example, to illus- information that can interrelate de-
trate FR response patterns, Mazur scriptive observations with the results
(2006) described his own observa- of experimental research (cf. Bijou,
tions when he was a student doing Peterson, & Ault, 1968). The science
summer work in a hinge-making of physics has a long history that
factory. He reported that the workers relates the events of the natural world
were paid on the basis of completion (e.g., the tides of the oceans, the
of 100 hinges (a piecework system), orbits of the planets) to the con-
and that ‘‘once a worker started up trolled conditions of the experimental
the machine, he almost always laboratory. By comparison, behavior
worked steadily and rapidly until analysis continues to fall short of a
52 HENRY D. SCHLINGER et al.

set of agreed-upon procedures that Regardless of whether human behav-


characterize naturally occurring be- ior is homologous to nonhuman (or
haviors (Baron, Perone, & Galizio, even human) performances in the
1991). laboratory, knowledge of the vari-
Notwithstanding these consider- ables that control pausing in the
ations, there are several aspects of animal laboratory has the potential
pausing on ratio schedules that bear to modify the behaviors described as
at least a superficial resemblance to procrastination.
the human problem of procrastina-
tion. In simple terms, to procrastinate Applied Analysis of Behavior
is to delay or postpone an action or
to put off doing something. Such A third way that human behavior
definitions seem to involve something can be approached is through the
akin to the ratio pause in which an direct application of animal-based
individual pauses before completing a procedures in clinical settings. Behav-
ratio. Moreover, the two phenomena iors typical of anxiety disorders and
appear to arise from similar causes, depression as well as socially impor-
in that the schedule parameters that tant behaviors normally deficient
contribute to pausing (e.g., higher among autistic and mentally retarded
ratios, smaller reinforcement magni- individuals can be cast within a
tudes, greater response effort) are research framework. For example,
analogous to the situational variables the clinician can describe problem
that lead to procrastination (e.g., behaviors before the intervention is
greater delay to reward, less reward, introduced, and systematic records
greater task aversiveness; cf. Howell, can be maintained of the outcome of
Watson, Powell, & Buro, 2006; Sené- the therapy. Applied behavior analy-
cal, Lavoie, & Koestner, 1997; Solo- sis has led to notable accomplish-
mon & Rothblum, 1984). The rela- ments in varied settings including
tion between pausing and procras- clinics, institutions, schools, and or-
tination has received some degree of ganizations. Studies have provided
recognition in past publications (De- convincing evidence that behavioral
renne, Richardson, & Baron, 2006; interventions lead to therapeutic
Shull & Lawrence, 1998), but serious changes that would not occur with-
efforts to model procrastination in out the treatment. But application
ratio-schedule terms remain to be also has limitations from the stand-
attempted. point of experimental analysis. In
We must remember, however, that applied research, variables cannot be
the variables that control the use of manipulated solely to advance scien-
the term procrastination may be very tific understanding. Perhaps it goes
different among different speakers. In without saying that the primary
some instances, such variables may concern must be the welfare of the
be homologous with those that con- client. When this value comes into
trol the use of the terms postrein- conflict with scientific understanding,
forcement or preratio pause. In this scientific understanding must give
case, interpreting procrastinative be- way.
haviors in terms of ratio pausing may Because some behaviors that we
be justified. Conversely, when using call procrastination may arise from
the term procrastination with nonhu- causes similar to those characterized
mans (see Mazur, 1996, 1998), per- as ratio pausing, the knowledge
haps we should follow Skinner’s lead gleaned from basic research on paus-
in his article, ‘‘‘Superstition’ in the ing might be used to ameliorate such
Pigeon’’ (1949), by putting ‘‘procras- behavior. To date, however, procras-
tination’’ in quotation marks, imply- tination, as an area of clinical con-
ing that we are speaking analogically. cern within applied behavior analysis,
PAUSING UNDER RATIO SCHEDULES 53

has generated interest mostly among SUMMARY AND CONCLUSIONS


behavioral educators concerned with
Ratio schedules of reinforcement
improving academic behaviors (Brooke
follow a simple rule. Reinforcement
& Ruthven, 1984; Lamwers & Jaz-
is delivered after completion of a
winski, 1989; Wesp, 1986; Ziesat,
given number of responses (the FR
Rosenthal, & White, 1978). Studies
schedule), a value that varies from
have shown that it is possible to reduce
ratio to ratio but averages a ratio size
procrastination, for example, through
self-reward or self-punishment proce- (the VR schedule), or a value that
dures (Green, 1982; Harrison, 2005; progressively increases from ratio to
Ziesat et al.). However, efforts of this ratio (the PR schedule). An essential
kind have not led to widespread adop- feature of all three variants is that the
tion, and little remains known about organism’s work output is equivalent
how procrastination might be most to the reinforcement yield. In other
effectively treated. More important words, response rates are a direct
for the present purpose, it appears that function of reinforcement rates.
there have been no treatments of Although the procedures embodied
procrastination based on the results of in the ratio rule appear straightfor-
research on ratio pausing from the ward, numerous experiments have
animal (or human) laboratory. shown considerable complexity in
Those who desire to reduce pro- the outcomes. In the case of FR and
crastination may, thus, be interested PR schedules, response rates typically
in research showing how normal appear as a break-and-run pattern: A
patterns of pausing on ratio sched- pause follows delivery of the rein-
ules can be reduced. Pause durations forcement followed by a high rate of
will shorten, for example, when responding to the next reinforcer. The
reinforcement is contingent on com- duration of the pause has proven to be
pletion of the whole ratio within a set influenced by a number of variables,
length of time (Zeiler, 1970), when most notably the size of the ratio, the
the pause alone must end before magnitude of the reinforcer, and the
some criterion duration (R. A. Wil- force of the response requirement.
liams & Shull, 1982), or when time- Moreover, even though performances
out punishment is imposed as soon as on VR schedules often are described
the pause exceeds some criterion as indicating little or no pausing,
duration (Derenne & Baron, 2001). research has shown that depending
There is even some evidence that on the distribution of the individual
reductions in pausing can remain ratios, such pausing can and does
long after punishment is withdrawn occur and is influenced by some of the
(Derenne et al., 2006). Results from same variables as the FR pause.
the animal laboratory using time-out We have already considered the
punishment are encouraging insofar possibility that pausing is a conse-
as they show ways to reduce procras- quence of the previous ratio. Howev-
tination-like behavior. However, er, pausing on FR schedules cannot
comparable procedures remain to be be attributed to such factors as time
developed by applied researchers. needed to consume the reinforcer,
There are many unanswered ques- satiation, or fatigue. As a rule,
tions. What reinforcers and punishers subjects typically pause much less
would be used? How would delivery under equivalent-sized VR schedules
of the consequences be programmed? while they consume as many rein-
What role is played by the individual’s forcers and emit as many responses.
history and personal characteristics? Moreover, using multiple FR FR
Efforts to bridge the gap between schedules, researchers have shown
basic and applied research on this that the duration of pausing does
issue are needed. not depend on the size of the previous
54 HENRY D. SCHLINGER et al.

ratio, thus effectively countering the reinforcing stimulus (Harzem & Har-
fatigue hypothesis. Identification of zem, 1981; Lowe et al., 1974; Perone
the variables that control pausing & Courtney, 1992). However, it is
using simple FR schedules is difficult possible that more than one source of
because characteristics of successive inhibition exerts control. We also
ratios, such as the size of the ratio, mentioned Skinner’s (1938) sugges-
are held constant. More informative tion that conditioned inhibition is
are the results of procedures that vary responsible for pausing, in that the
the size of successive ratios using delivery of one reinforcer may serve
multiple FR FR schedules that in- as an SD for subsequent responding.
clude discrete discriminative stimuli Regardless of the origins of inhibi-
that define the components. These tion, there may be several reasons
procedures have shown that pausing why pausing is kept in check. First,
is more a consequence of the upcom- the inhibitory aftereffects of rein-
ing ratio than the preceding one. In forcement dissipate with time. Sec-
both cases, we can say that pausing is ond, the passage of time since the
more pronounced when the transi- start of the ratio is correlated with the
tion is from a more to a less favorable past delivery of reinforcers; thus,
contingency, that is, from a lower to excitation of responding increases
a higher ratio, from a larger to a with time. Third, there is differential
smaller reinforcer magnitude, or reinforcement of responses that occur
from a lesser to a greater response- soon after reinforcement insofar as
force requirement. shorter pauses lessen the delay to the
Beginning with Ferster and Skin- next reinforcer.
ner’s (1957) original studies of ratio Competing reinforcers. The second
schedules, there has been debate account envisions a competition be-
about the appropriate interpretation tween concurrently available sources
of the results that we have described. of reinforcement. On the one hand,
Of these, three interpretations war- subjects can work towards the rein-
rant special attention: (a) Pausing is forcer scheduled by the experimenter.
the result of interacting processes of On the other hand, subjects can
inhibition and excitation; (b) pausing obtain sources of reinforcement with-
is the outcome of a competition in the experimental apparatus that
between reinforcers scheduled by the are not programmed by the experi-
experimenter and reinforcers from menter. According to this view,
other sources; and (c) pausing avoids pausing occurs whenever subjects
the work needed to meet the ratio choose an alternative reinforcer over
requirement. Noteworthy is that such the scheduled one. Alternative rein-
views are primarily concerned with forcers may be added to the operant
what are usually termed molecular chamber, such as the opportunity to
effects; in other words, the models drink water when food pellets are the
represent moment-to-moment effects scheduled reinforcers, but more typ-
on ratio performance, along the lines ical alternatives involve automatic
originally described by Ferster and reinforcers inherent in grooming,
Skinner (cf. Mazur, 1982). resting, and exploring (see Derenne
Inhibitory and excitatory processes. & Baron, 2002; Shull, 1979). Al-
In this view, pausing reflects the joint though the efficacy of such alterna-
effect of the inhibition and the tives may be low by comparison with
excitation of responding (see Leslie, the scheduled one, such reinforcers
1996). We related the well-document- are immediately available. Thus, as a
ed finding, obtained especially with general principle, at the beginning of
mixed FR FR schedules, that inhibi- the ratio, when the probability of
tion originates in the unconditioned responding is lowest, subjects would
effects of the previously delivered be expected to select unscheduled
PAUSING UNDER RATIO SCHEDULES 55

smaller–sooner reinforcers over the pause durations on FR schedules


scheduled larger–later one (cf. Rach- generally exceed those on VR sched-
lin & Green, 1972). ules.
Work avoidance. The third account Consider the finding that pause
focuses on aversive properties of durations increase with ratio size.
responding. A subject confronted According to the inhibition–excita-
with the task of completing a sub- tion model, the delivery of a rein-
stantial ratio of responding can pre- forcer signals the beginning of a
clude an unfavorable situation by period of time during which subse-
pausing, that is, by escaping stimuli quent reinforcement is not immedi-
that signal the response requirement, ately available. The extent to which
thus avoiding having to respond. inhibitory processes depress respond-
Research reported by Azrin (1961) ing is dependent on the delay to
and Thompson (1964) provided evi- reinforcement. An increase in the size
dence that, if given the opportunity, of the ratio necessarily increases the
subjects will avoid high FR require- minimum delay to reinforcement;
ments. In both experiments, subjects therefore, inhibition (and pausing)
were provided with concurrent access increases as a function of ratio size.
to an FR schedule of reinforcement The competing reinforcer model also
and to the opportunity to suspend the points to the delay to reinforcement
FR schedule (i.e., self-imposed time- as a critical variable. In this case, an
out). Time-out responses were fre- increase in the delay to reinforcement
quent at the beginning of the ratio alters the balance of choice between
(the time at which remaining work the delayed scheduled reinforcer and
was greatest and pausing normally immediately available alternative re-
occurred), even though they had the inforcers. With greater delay, the
effect of reducing reinforcement rates. scheduled reinforcer becomes less
More recently, Perone (2003) showed efficacious and subjects therefore will
a similar pattern of escape responding more likely choose alternative sourc-
under multiple FR FR schedules. es of reinforcement early in the ratio.
Subjects not only paused longest The consequence of this shift in
when a large reinforcer on one ratio choice is that pause durations are
was followed by a smaller one on the lengthened.
next, but they were also more likely to For the work-avoidance model, the
make an escape response during critical consideration is that higher
large–small transitions. ratios, of necessity, require increased
These three accounts (the inhibi- work. Insofar as increased work is
tion–excitation model, the competing more aversive (i.e., it increases the
reinforcer model, and the work- reinforcing value of escape or avoid-
avoidance model) rely on different ance behavior; cf. Azrin, 1961; Thomp-
mechanisms to explain why pausing son, 1964), higher ratios should be
occurs. However, it would be incor- accompanied by longer pausing. Re-
rect, or at least premature, to con- search with FR schedules has not been
clude that one view is more accurate able to show that either the time until
than the others. Each model address- the reinforcer or the amount of re-
es a different factor that may con- quired work alone is the critical factor
tribute to pausing, and these factors responsible for pausing. Killeen (1969)
need not be viewed as mutually obtained equivalent pause durations
exclusive. Further, each can be used under FR and FI schedules of rein-
to explain major findings from re- forcement when the average interrein-
search with ratio schedules of rein- forcement interval was held constant
forcement, most notably the well- across schedules. However, others
established findings that pause dura- have found that FR and FI pause
tions increase with ratio size and durations depart, suggesting that other
56 HENRY D. SCHLINGER et al.

aspects of the contingencies, such as cords and frequency distributions of


the relatively aversive work require- pausing suggest that performances on
ment on FR schedules, also have an a typical ratio are minimally affected
important role (Aparicio, Lopez, & by these variables. Subsequent re-
Nevin, 1995; Capehart, Eckerman, search has indicated that aggregated
Guilkey, & Shull, 1980; Lattal, Reilly, data (most notably means) present an
& Kohn, 1998). inaccurate picture because means
In the case of differences in paus- tend to be disproportionately influ-
ing between VR and FR schedules, enced by the extreme scores of
two models once again focus on the skewed distributions (Baron & Her-
time until reinforcement, whereas the polsheimer, 1999). A plausible ac-
third addresses the amount of re- count of ratio-to-ratio variation relies
quired work. A key finding is that on the aforementioned inhibition–
pauses under VR schedules are con- excitation model. Thus, the extent
trolled in part by the size of the to which responding is regarded as
lowest possible ratio (Schlinger et al., inhibited or excited should wax and
1990). When the lowest possible ratio wane over time insofar as sequential
is 1, pausing is almost nonexistent, increases in pausing are counteracted
and when the ratio increases in size, by decreases in pausing. However,
VR pausing begins to resemble FR the expectation of orderly cycles of
pausing in duration. Why should a increasing and decreasing pause du-
low minimum ratio reduce pausing? rations within sessions has not been
According to the inhibition–excita- forthcoming thus far (Derenne &
tion model, occasional reinforcement Baron, 2001).
early in the ratio would reduce Another puzzle pertains to the
inhibition (i.e., under VR schedules finding that the break-and-run pat-
the delivery of one reinforcer does tern persists despite extensive expo-
not clearly predict a period of subse- sure to the FR schedule. The conse-
quent reinforcement unavailability). quence is that overall reinforcement
Under the competing reinforcer mod- rates engendered by responding are
el, the control exerted by the sched- reduced below optimal levels. By
uled reinforcer over behavior early in comparison, extended exposure to
the ratio is increased when reinforcers other schedules (e.g., FI) improves
are sometimes delivered after only response efficiency insofar as re-
one or a few responses. Therefore, sponse rates are reduced without
subjects become less likely to select impairing reinforcement rate (see
alternative reinforcers over respond- Baron & Leinenweber, 1994). How-
ing for the scheduled reinforcer. For ever, an analysis in terms of FR
the work-avoidance model, it is the pausing does not take into account
response requirement that matters. the potential role of alternative rein-
Subjects are less likely to put off forcers. From this standpoint, the net
responding if there is a possibility reinforcing consequence of respond-
that the work requirement is very ing must include reinforcement from
small. both sources. Interestingly, pausing
A problematic feature of all three can be modified by imposing addi-
models is the variation in pausing tional contingencies on the FR sched-
from ratio to ratio. Although re- ule. For example, if the pause must
search on FR pausing shows overall be shorter than some minimum
a direct relation between pause dura- duration for reinforcement to be
tion and ratio size (e.g., Felton & delivered at the end of the ratio, then
Lyon, 1966; Powell, 1968) and an subjects will typically pause no longer
inverse relation between pause dura- than the criterion allows (R. A.
tion and reinforcement magnitude Williams & Shull, 1982). Further-
(e.g., Powell, 1969), cumulative re- more, even after the additional con-
PAUSING UNDER RATIO SCHEDULES 57

tingencies are removed, subjects may vide at best a sketchy picture and no clue as to
continue to pause less than they did interactive processes. (p. 489)
before the procedure started, suggest-
So it is with the variables that in-
ing that forced exposure to a more
fluence pausing under ratio sched-
efficient response pattern may sensi-
ules. They are likely numerous and
tize subjects to overall reinforcement
complex. Nonetheless, our review has
rates (Derenne et al., 2006).
revealed that amid the variability,
Finally, we addressed the issue of
there is a consistent orderliness across
the relevance of animal models for an
myriad experiments over the past
understanding of the impact of ratio
50 years. Zeiler (1984) pessimistically
schedules of reinforcement on the
concluded that any attempt to un-
world of human affairs. We conclud-
derstand schedules of reinforcement
ed that the general principles that
at a more molecular level is doomed
have emerged from our review, al-
to fail ‘‘because of the complexity of
though imperfect, shed light on hu-
the interactions, and also because
man behavior. In particular, pausing
many of the controlling variables
under ratio schedules may illuminate
arise indirectly through the interplay
the human problem of procrastina-
of ongoing behavior and the contin-
tion in the sense that procrastination
gencies’’ (p. 491). But as we have
is influenced by the size of the
discovered, as a result of innovative
upcoming task, the relative difficulty
methods and probing research ques-
in performing it, and perhaps the
tions, researchers are moving closer
magnitude of the expected reinforcer.
In fact, based on the interpretation of to a more fundamental understand-
pausing under ratio schedules as an ing of why pausing under ratio
avoidance response, some behaviors schedules occurs.
we label as procrastination may
occur because they avoid the upcom- REFERENCES
ing task. This might also momentar- Alling, K., & Poling, A. (1995). The effects of
ily increase the effectiveness of alter- differing response-force requirements on
native reinforcers and might explain fixed-ratio responding of rats. Journal of
why, when faced with a large effortful the Experimental Analysis of Behavior, 63,
331–346.
task, we tend to find other things to Aparicio, C. F., Lopez, F., & Nevin, J. A.
do even if those other activities (1995). The relation between postreinforce-
involve consequences that are typi- ment pause and interreinforcement interval
cally not very effective reinforcers in conjunctive and chain fixed-ratio fixed-
(e.g., washing the dishes, etc.). time schedules. The Psychological Record,
45, 105–125.
So, what can we conclude about Azrin, N. H. (1961). Time-out from positive
pausing under ratio schedules after reinforcement. Science, 133, 382–383.
50 years of research? We can begin to Baron, A., & Derenne, A. (2000). Progressive-
answer this question by addressing ratio schedules: Effects of later schedule
schedule effects in general. As Zeiler requirements on earlier performances. Jour-
nal of the Experimental Analysis of Behavior,
(1984) has written, 73, 291–304.
Baron, A., & Herpolsheimer, L. R. (1999).
Suffice it to say that we still lack a coherent Averaging effects in the study of fixed-ratio
explanation of why any particular schedule response patterns. Journal of the Experi-
has its specific effects on behavior. … Whether mental Analysis of Behavior, 71, 145–153.
the explanation has been based on interre- Baron, A., & Leinenweber, A. (1994). Molec-
sponse time, reinforcement, reinforcer fre- ular and molar aspects of fixed-interval
quency, relations between previous and cur- performance. Journal of the Experimental
rent output, direct or indirect effects, or Analysis of Behavior, 61, 11–18.
whatever, no coherent and adequate theoret- Baron, A., Mikorski, J., & Schlund, M.
ical account has emerged. Forty years of (1992). Reinforcement magnitude and paus-
research has shown that a number of variables ing on progressive-ratio schedules. Journal
must be involved—schedule performances of the Experimental Analysis of Behavior, 58,
must be multiply determined—but they pro- 377–388.
58 HENRY D. SCHLINGER et al.

Baron, A., Perone, M., & Galizio, M. (1991). by past and upcoming doses. Behavioural
Analyzing the reinforcement process at the Pharmacology, 18, 171–175.
human level: Can application and behav- Green, L. (1982). Minority students’ self-
ioristic interpretation replace laboratory control of procrastination. Journal of Coun-
research? The Behavior Analyst, 14, 93–105. seling Psychology, 6, 636–644.
Bijou, S. W., Peterson, R. F., & Ault, M. H. Griffiths, R. R., & Thompson, T. (1973). The
(1968). A method to integrate descriptive post-reinforcement pause: A misnomer. The
and experimental field studies at the level of Psychological Record, 23, 229–235.
data and empirical concepts. Journal of Harrison, H. C. (2005). The three-contingency
Applied Behavior Analysis, 1, 175–191. model of self-management Unpublished doc-
Blakely, E., & Schlinger, H. (1988). Determi- toral disseration, Western Michigan Uni-
nants of pausing under variable-ratio sched- versity.
ules: Reinforcer magnitude, ratio size, and Harzem, P., & Harzem, A. L. (1981). Dis-
schedule configuration. Journal of the Ex- crimination, inhibition, and simultaneous
perimental Analysis of Behavior, 50, 65–73. association of stimulus properties. In P.
Brooke, R. R., & Ruthven, A. J. (1984). The Harzem & M. D. Zeiler (Eds.), Predictabil-
effects of contingency contracting on stu- ity, correlation, and contiguity (pp. 81–128).
dent performance in a PSI class. Teaching of Chichester, England: Wiley.
Psychology, 11, 87–89. Harzem, P., Lowe, C. F., & Davey, G. C. L.
Capehart, G. W., Eckerman, D. A., Guilkey, (1975). Aftereffects of reinforcement mag-
M., & Shull, R. L. (1980). A comparison of nitude: Dependence on context. Quarterly
ratio and interval reinforcement schedules Journal of Experimemental Psychology, 27,
with comparable interreinforcement times. 579–584.
Journal of the Experimental Analysis of Hillman, D., & Bruner, J. S. (1972). Infant
Behavior, 34, 61–76. sucking in response to variations in sched-
Crossman, E. K. (1968). Pause relationships in ules of feeding reinforcement. Journal of
multiple and chained fixed-ratio schedules. Experimental Child Psychology, 13, 240–
Journal of the Experimental Analysis of 247.
Behavior, 11, 117–126.
Hodos, W. (1960). Progressive ratio as a
Crossman, E. K., Bonem, E. J., & Phelps, B. J.
measure of reward strength. Science, 34,
(1987). A comparison of response patterns
943–944.
on fixed-, variable-, and random-ratio
schedules. Journal of the Experimental Hodos, W., & Kalman, G. (1963). Effects of
Analysis of Behavior, 48, 395–406. increment size and reinforcer volume on
Crossman, E. K., & Silverman, L. T. (1973). progressive ratio performance. Journal of
Altering the proportion of components in a the Experimental Analysis Behavior, 6, 387–
mixed fixed-ratio schedule. Journal of the 392.
Experimental Analysis of Behavior, 20, Holland, J. G. (1958). Human vigilance: The
273–279. rate of observing an instrument is controlled
Derenne, A., & Baron, A. (2001). Time-out by the schedule of signal detections. Science,
punishment of long pauses on fixed-ratio 128, 61–67.
schedules of reinforcement. The Psycholog- Howell, A. J., Watson, D. C., Powell, R. A., &
ical Record, 51, 39–51. Buro, K. (2006). Academic procrastination:
Derenne, A., & Baron, A. (2002). Preratio The pattern and correlates of behavioural
pausing: Effects of an alternative reinforcer postponement. Personality and Individual
on fixed-and variable-ratio responding. Differences, 40, 1519–1530.
Journal of the Experimental Analysis of Hutchinson, R. R., & Azrin, N. H. (1961).
Behavior, 77, 272–282. Conditioning of mental-hospital patients to
Derenne, A., Richardson, J. V., & Baron, A. fixed-ratio schedules of reinforcement. Jour-
(2006). Long-term effects of suppressing the nal of the Experimental Analysis of Behavior,
preratio pause. Behavioural Processes, 72, 4, 87–95.
32–37. Killeen, P. (1969). Reinforcement frequency
Ellis, N. R., Barnett, C. D., & Pryer, M. W. and contingency as factors in fixed-ratio
(1960). Operant behavior in mental defec- behavior. Journal of the Experimental Anal-
tives: Exploratory studies. Journal of the ysis of Behavior, 12, 391–395.
Experimental Analysis of Behavior, 3, 63–69. Lamwers, L. L., & Jazwinski, C. H. (1989). A
Felton, M., & Lyon, D. O. (1966). The post- comparison of three strategies to reduce
reinforcement pause. Journal of the Exper- student procrastination in PSI. Teaching of
imental Analysis of Behavior, 9, 131–134. Psychology, 16, 8–12.
Ferster, C. B., & Skinner, B. F. (1957). Lattal, K. A. (1991). Scheduling positive
Schedules of reinforcement. New York: reinforcers. In I. H. Iversen & L. A. Lattal
Appleton-Century-Crofts. (Eds.), Experimental analysis of behavior
Galuska, C. M., Wade-Galuska, T., Woods, J. (pp. 87–134). New York: Elsevier.
H., & Winger, G. (2007). Fixed-ratio Lattal, K. A., Reilly, M. P., & Kohn, J. P.
schedules of cocaine self-administration in (1998). Response persistence under ratio
rhesus monkeys: Joint control of responding and interval reinforcement schedules. Jour-
PAUSING UNDER RATIO SCHEDULES 59

nal of the Experimental Analysis of Behavior, fixed ratio pausing. The Psychological Rec-
70, 165–183. ord, 37, 227–238.
Leslie, J. C. (1996). Principles of behaviour Powell, R. W. (1968). The effects of small
analysis. Amsterdam: Harwood Academic sequential changes in fixed-ratio size upon
Publishers. the post-reinforcement pause. Journal of the
Long, E. R., Hammack, J. T., May, F., & Experimental Analysis of Behavior, 11,
Campbell, B. J. (1958). Intermittent rein- 589–593.
forcement of operant behavior in children. Powell, R. W. (1969). The effect of reinforce-
Journal of the Experimental Analysis of ment magnitude upon responding under
Behavior, 1, 315–339. fixed-ratio schedules. Journal of the Exper-
Lowe, C. F., Davey, G. C. L., & Harzem, P. imental Analysis of Behavior, 12, 605–608.
(1974). Effects of reinforcement magnitude Priddle-Higson, P. J., Lowe, C. F., & Harzem,
on interval and ratio schedules. Journal of P. (1976). Aftereffects of reinforcement on
the Experimental Analysis Behavior, 22, variable-ratio schedules. Journal of the Ex-
553–560. perimental Analysis of Behavior, 25, 347–354.
Malott, R. W. (1966). The effects of prefeed- Rachlin, H., & Green, L. (1972). Commit-
ing in plain and chained fixed ratio sched- ment, choice and self-control. Journal of the
ules of reinforcement. Psychonomic Science, Experimental Analysis of Behavior, 17, 15–22.
4, 285–287. Sanders, R. M. (1969). Concurrent fixed-ratio
Mazur, J. E. (1982). A molecular approach to fixed-interval performances in adult human
ratio schedule performance. In M. L. subjects. Journal of the Experimental Anal-
Commons, R. J. Herrnstein, & H. Rachlin ysis of Behavior, 12, 601–604.
(Eds.), Quantitative analyses of behavior: Schlinger, H., Blakely, E., & Kaczor, T.
Vol. 2. Matching and maximizing accounts (1990). Pausing under variable-ratio sched-
(pp. 79–110). Cambridge, MA: Ballinger. ules: Interaction of reinforcer magnitude,
Mazur, J. E. (1996). Procrastination by variable-ratio size, and lowest ratio. Journal
pigeons: Preference for larger, more delayed of the Experimental Analysis of Behavior, 53,
work requirements. Journal of the Experi- 133–139.
mental Analysis of Behavior, 65, 159–171. Senécal, C., Lavoie, K., & Koestner, R.
Mazur, J. E. (1998). Procrastination by (1997). Trait and situational factors in
procrastination: An interactional model.
pigeons with fixed-interval response require-
Journal of Social Behavior and Personality,
ments. Journal of the Experimental Analysis
12, 889–903.
of Behavior, 69, 185–197.
Shull, R. L. (1979). The post-reinforcement
Mazur, J. E. (2006). Learning and behavior. pause: Some implications for the correla-
Upper Saddle River, NJ: Pearson Prentice tional law of effect. In M. D. Zeiler & P.
Hall. Harzem (Eds.), Advances in analysis of
Mazur, J. E., & Hyslop, M. E. (1982). Fixed- behaviour: Vol. 1. Reinforcement and the
ratio performance with and without a organization of behaviour (pp. 193–221).
postreinforcement timeout. Journal of the New York: Wiley.
Experimental Analysis Behavior, 38, 143– Shull, R. L., & Lawrence, P. S. (1998).
155. Reinforcement: Schedule performance. In
McMillan, J. C. (1971). Percentage reinforce- K. A. Lattal & M. Perone (Eds.), Handbook
ment of fixed-ratio and variable-interval of research methods in human operant
performances. Journal of the Experimental behavior (pp. 95–129). New York: Plenum.
Analysis Behavior, 15, 297–302. Sidman, M. (1960). Tactics of scientific
Morse, W. H., & Dews, P. B. (2002). research. New York: Basic Books.
Foreword to Schedules of Reinforcement. Sidman, M., & Stebbins, W. C. (1954).
Journal of the Experimental Analysis of Satiation effects under fixed-ratio schedules
Behavior, 77, 313–317. of reinforcement. Journal of Comparative
Orlando, R., & Bijou, S. W. (1960). Single and and Physiological Psychology, 47, 114–116.
multiple schedules of reinforcement in Skinner, B. F. (1938). The behavior of organ-
developmentally retarded children. Journal isms. Englewood Cliffs, NJ: Prentice Hall.
of the Experimental Analysis of Behavior, 3, Skinner, B. F. (1949). ‘‘Superstition’’ in the
339–348. pigeon. Journal of Experimental Psychology,
Perone, M. (2003). Negative effects of positive 38, 168–172.
reinforcement. The Behavior Analyst, 26, Skinner, B. F. (1953). Science and human
1–14. behavior. New York: Macmillan.
Perone, M., & Courtney, K. (1992). Fixed- Solomon, L. J., & Rothblum, E. D. (1984).
ratio pausing: Joint effects of past reinforcer Academic procrastination: Frequency and
magnitude and stimuli correlated with cognitive-behavioral correlates. Journal of
upcoming magnitude. Journal of the Exper- Counseling Psychology, 31, 503–509.
imental Analysis of Behavior, 57, 33–46. Steel, P. (2007). The nature of procrastination:
Perone, M., Perone, C. L., & Baron, A. A meta-analytic and theoretical review of
(1987). Inhibition by reinforcement: Effects quintessential self-regulatory failure. Psy-
of reinforcer magnitude and timeout on chological Bulletin, 133, 65–94.
60 HENRY D. SCHLINGER et al.

Thomas, J. V. (1974). Changes in progressive- Wesp, R. (1986). Reducing procrastination


ratio performance under increased pressures through required course involvement.
of air. Journal of the Experimental Analysis Teaching of Psychology, 13, 128–130.
of Behavior, 21, 553–562. Williams, D. C., Saunders, K. J., & Perone,
Thompson, D. M. (1964). Escape from SD M. (in press). Extended pausing in human
associated with reinforcement. Journal of the subjects on multiple fixed-ratio schedules
Experimental Analysis of Behavior, 7, 1–8. with varied reinforcer magnitude and re-
Wade-Galuska, T., Perone, M., & Wirth, O. sponse requirements. Journal of the Exper-
(2005). Effects of past and upcoming imental Analysis of Behavior.
response-force requirements on fixed-ratio Williams, R. A., & Shull, R. L. (1982).
pausing. Behavioural Processes, 68, 91–95. Differential reinforcement of short post-
Wallace, I. (1977). Self-control techniques of reinforcement pauses on a fixed-ratio sched-
famous novelists. Journal of Applied Behav- ule. Behaviour Analysis Letters, 2, 171–180.
ior Analysis, 10, 515–525. Zeiler, M. D. (1970). Time limits for complet-
Wallace, R. F., & Mulder, D. W. (1973). Fixed- ing fixed ratios. Journal of the Experimental
ratio responding with human subjects. Bulle- Analysis of Behavior, 14, 275–286.
tin of the Psychonomic Society, 1, 359–362. Zeiler, M. D. (1984). The sleeping giant:
Weiner, H. (1964). Response cost and fixed- Reinforcement schedules. Journal of the
ratio performance. Journal of the Experi- Experimental Analysis of Behavior, 42, 485–
mental Analysis of Behavior, 7, 79–81. 493.
Weiner, H. (1966). Preference and switching Zeiler, M. D., & Kelly, C. A. (1969). Fixed-
under ratio contingencies with humans. ratio and fixed-interval schedules of cartoon
Psychological Reports, 18, 239–246. presentation. Journal of Experimental Child
Weisberg, P., & Fink, E. (1966). Fixed ratio Psychology, 8, 306–313.
and extinction performance of infants in Ziesat, H. A., Rosenthal, T. L., & White, G.
the second year of life. Journal of the Ex- M. (1978). Behavioral self-control in treat-
perimental Analysis of Behavior, 9, 105– ing procrastination of studying. Psycholog-
109. ical Reports, 42, 59–69.

You might also like