Professional Documents
Culture Documents
10.Schlinger, H. D., Derenne, A., _ Baron, A. (2008). What 50 Years of Research Tell Us About Pausing Under Ratio Schedules
10.Schlinger, H. D., Derenne, A., _ Baron, A. (2008). What 50 Years of Research Tell Us About Pausing Under Ratio Schedules
1 (Spring)
2007 marked the 50th anniversary ditioning (what was later to become
of the publication of Charles Ferster the fixed-interval [FI] schedule) and
and B. F. Skinner’s magnum opus, fixed-ratio (FR) reinforcement (he
Schedules of Reinforcement (1957), hadn’t yet used the term reinforce-
which reported the results of experi- ment schedule) in The Behavior of
ments carried out under contracts to Organisms (1938), it wasn’t until the
the Office of Naval Research with publication of Schedules of Reinforce-
Harvard University between 1949 ment that he (and Ferster, working as
and 1955. Although Skinner had a research fellow under Skinner’s
previously discussed periodic recon- direction) distinguished several sim-
ple and complex schedules based on
Correspondence concerning this article can be nonhuman (pigeons and rats) perfor-
addressed to Hank Schlinger, Adam Derenne, mances. In addition, they investigat-
or Alan Baron, Department of Psychology, ed the effects of many different types
California State University, Los Angeles, 5151 of those schedules along with a
State University Dr., Los Angeles, California
90032 (e-mail: hschlin@calstatela.edu); Adam variety of other variables (e.g., drugs,
Derenne, Department of Psychology, Box 8380, deprivation level, ablation of brain
University of North Dakota, Grand Forks, tissue, added counters, etc.) that were
North Dakota 58202 (e-mail: adam.derenne@ described in terms of rate of response
und.nodak.edu) or Alan Baron, Department of
Psychology, University of Wisconsin–Milwau-
and depicted on cumulative records.
kee, Milwaukee, Wisconsin 53201 (e-mail: ab@ Their research documented the power
uwm.edu) of schedules of reinforcement to
39
40 HENRY D. SCHLINGER et al.
control behavior and established the ratio schedules reduces overall rein-
study of schedules as a focus within forcement rates. Because reinforce-
the experimental analysis of behavior. ment rates under ratio schedules
Ferster and Skinner’s research paint- depend strictly on response rates,
ed a detailed picture of the perfor- optimal performance would be for
mances of the subjects as seen on a subjects to resume responding imme-
response-by-response basis. Howev- diately. Yet they pause, and the
er, their wide-ranging effort did not resultant loss of reinforcement persists
attempt to provide systematic infor- over extended exposure to the sched-
mation about the effects of paramet- ule without diminution. The critical
ric variations across conditions and question, then, is: Why would an
subjects. It remained for subsequent animal pause when that very action
researchers to fill in the gaps. delays reinforcement and reduces
Fifty years and innumerable exper- overall reinforcement rate? One possi-
iments later, it is common for text- bility is that the animal is fatigued
books on learning to illustrate FR after working so hard. For example,
performances with cumulative records pauses are generally shorter under FR
and to describe the resulting patterns 10 than under FR 100. Because the FR
as ‘‘break and run’’ (see Figure 1). As 100 involves more work, it is possible
explained by Lattal (1991), ‘‘following that subjects rest longer before resum-
a period of nonresponding (a break, ing work. Another possibility is that
more precisely the postreinforcement food consumption creates satiation,
pause) after food delivery, there is a which weakens the motivational oper-
relatively quick transition to a high ation of food deprivation. However,
steady rate of responding (a run) that we will see that neither of these
is maintained until the next food seemingly reasonable explanations
presentation when the pattern re- survive simple tests and that the
peats’’ (p. 95). FR performances are picture is much more complicated.
often contrasted with those under Ratio pausing within the laborato-
variable-ratio (VR) schedules, in ry is also of special interest because it
which the size of the ratios varies resembles the human problem of
within the schedule. Under VR sched- procrastination: In both cases, an
ules, performances are ‘‘characterized action is put off even though the
by high response rates with little resulting delay may be disadvanta-
systematic pausing either after rein- geous. Social commentators have
forcement or at other times’’ (p. 95).1 noted that procrastination is a major
Among the myriad response pat- contributor to behavioral inefficiency
terns observed under various sched- in schools, industry, and our daily
ules of reinforcement, pausing under lives in general (Steel, 2007). Identi-
ratio schedules (especially FR sched- fication of the variables that control
ules) has attracted special attention. the ratio pause in the laboratory may
Unlike the pause that follows rein- help to reveal techniques for the
forcement on interval schedules, the modification of procrastination.
pause that follows reinforcement on Our primary purpose in this article
is to identify the variables that govern
1
A pause is usually defined as the time from pausing under ratio schedules. Re-
the delivery of a reinforcer until emission of search on pausing under ratio sched-
the first response of the subsequent ratio and
has been variously referred to as a postrein- ules has come a long way since
forcement or preratio pause. Although there is Ferster and Skinner’s (1957) pioneer-
evidence that pauses will sometimes occur ing contributions. They set us on our
after the first response (Ferster & Skinner, way, but in the ensuing 50 years
1957; Griffiths & Thompson, 1973; Mazur &
Hyslop, 1982), we use the terms pause and increasingly sophisticated questions
pausing to refer to the postreinforcement or and experimental designs have re-
preratio pause. vealed a more complex picture. A
PAUSING UNDER RATIO SCHEDULES 41
assumed that the pause was a func- Building on Skinner’s (1938) and
tion of the preceding reinforcer. Ferster and Skinner’s (1957) findings,
Consequently, the phrase postrein- subsequent research has identified a
forcement pause came to connote number of variables that affect the
not only the pause after reinforce- length of the FR pause. These include
ment but also the pause controlled by the size of the ratio (e.g., Felton &
reinforcement (Griffiths & Thomp- Lyon, 1966; Powell, 1968), the amount
son, 1973). of response effort (Alling & Poling,
Skinner did acknowledge that 1995; Wade-Galuska, Perone, &
there were ‘‘considerable individual Wirth, 2005), the magnitude of the
differences’’ in the length of pausing reinforcer (e.g., Lowe, Davey, & Har-
produced by FR schedules. For zem, 1974; Perone & Courtney, 1992;
example, in describing performance Powell, 1969), the probability of rein-
under an FR 192, he wrote, forcement (Crossman, 1968; McMil-
lan, 1971), and the level of deprivation
At one extreme the pause after ingestion may be (Malott, 1966; Sidman & Stebbins,
relatively great and the subsequent acceleration 1954). One could say that, in general,
to a maximal or near maximal rate very rapid.
… At the other extreme the pause is brief, but
the duration of the pause increases as a
the rate immediately following it is low and function of variables that weaken
accelerated slowly. (1938, pp. 289–290) responding. These include increases
in ratio size and response effort and
Recognition of such irregularities decreases in reinforcer magnitude,
also can be found in Morse and reinforcement probability, and degree
Dews’ (2002) foreword to the reprint- of deprivation. Although all of these
ing of Schedules of Reinforcement: variables likely interact in complex
ways, for present purposes we restrict
If one leafs through the pages of any chapter, our discussion to the two most re-
there are clearly differences in the uniformity searched: ratio size and reinforcement
and reproducibility of performances under a
particular type of schedule. Some of these magnitude.
differences in performances come from the
continuing technical improvements in the Effects of FR Size on Pausing
design of keys and feeders, others from
differences in the past experiences of subjects In their chapter on FR schedules,
before exposure to the current contingencies Ferster and Skinner (1957) presented
or from the duration of exposure to current cumulative records of pigeons transi-
conditions, and sometimes from differences
between subjects treated alike. (p. 315) tioning from FR 1 or low FR
schedules to higher FR schedules, as
Inspection of the cumulative records well as cumulative records of final
reproduced in Ferster and Skinner’s performances on FR 120 and FR 200
compendium confirms that despite schedules. Although there is some
impressive commonalities in perfor- within-subject and between-subjects
mances, there also are unaccounted- variability, the cumulative records
for differences both within the per- show that performances by pigeons
formances of the same subject and on ratios as high as FR 60 are
between those of different subjects. characterized by brief pauses. The
These two facets of Skinner’s re- final performances of 2 birds on
search—regularities in performance higher FR schedules (FR 120 and
sometimes accompanied by unac- FR 200) reveal some longer pauses
countable variation—are not neces- (although at these ratios the variabil-
sarily at odds. Individual differences ity is even greater), prompting the
should serve as a prod for identifying conclusion that pause length increas-
the variables that control the differ- es with FR size.
ences, thus strengthening conclusions Subsequent experiments provided
about the commonalities. support for the finding that long
PAUSING UNDER RATIO SCHEDULES 43
tive records such as these, as well as individual subjects) echoes the finding
Ferster and Skinner’s description of described previously by Lowe et al.
VR performance in general, led to the (1974) with mixed FR schedules. The
widespread belief that pauses under implication is not just that marked VR
VR schedules are either very short or pausing is possible but that VR and FR
nonexistent. As we have already seen pausing are controlled by similar vari-
with FR schedules, however, research ables.
has revealed a more complex picture Blakely and Schlinger (1988) also
than that presented by Ferster and examined interactions between mean
Skinner. Likewise, pausing under VR ratio size and reinforcer magnitude
schedules is also more complex than under VR schedules. Pigeons re-
Ferster and Skinner assumed. sponded on multiple VR VR sched-
ules ranging from VR 10 to VR 70 in
Effects of Ratio Size and which access to food was available
Reinforcement Magnitude in for 2 s in one component and 8 s in
VR Schedules the other. Results showed that paus-
ing increased with ratio size at both
Although studies on pausing under magnitudes. However, the effect was
FR schedules are numerous, relative- considerably more marked in the
ly few studies have been concerned component with the smaller of the
with the variables that control paus- two magnitudes, a finding exactly
ing under VR schedules. With regard opposite to those of Priddle-Higson
to the role of ratio size, Crossman, et al. (1976). Applying the analysis of
Bonem, and Phelps (1987) confirmed excitation and inhibition by Perone et
Ferster and Skinner’s findings in a al. (1987), this difference is expected
study in which pigeons responded because the multiple-schedule proce-
under simple FR and VR schedules dure of Blakely and Schlinger exerted
with ratio sizes ranging from 5 to 80. excitatory control by the stimuli
Both schedules yielded brief pauses at correlated with the upcoming magni-
low-to-moderate ratios. However, tude size.
under the FR 80 schedule pausing A remaining issue concerns why
was relatively long, whereas under some experiments have shown little
the VR 80 schedule pausing was or no VR pausing (e.g., Crossman et
relatively short. al., 1987; Ferster & Skinner, 1957),
Other research has opened to whereas others have (e.g., Blakely &
question the view that significant Schlinger, 1988; Priddle-Higson et
pausing is absent under VR sched- al., 1976; Schlinger, Blakely, & Kac-
ules. In a study with rats, Priddle- zor, 1990). Schlinger and colleagues
Higson, Lowe, and Harzem (1976) have shown that the chief cause is
varied the mean ratio size (e.g., VR probably the size of the lowest ratio
10, VR 40, VR 80) across sessions within the distribution of individual
and the magnitude of the reinforcer ratios that comprise the VR schedule.
(concentration of sweetened milk) When Ferster and Skinner studied
within sessions using a mixed sched- VR schedules, the lowest ratio was
ule. Results showed that mean pause ‘‘usually 1’’ (p. 391). For example, on
durations increased as a function of a VR 360 schedule, the actual pro-
VR size. Moreover, the longest paus- gression of ratios ranged from 1 to
es occurred whenever the highest 720. Other researchers who have
concentrations were employed, indi- reported minimal VR pausing have
cating that ratio size and reinforce- followed suit (e.g., Crossman et al.).
ment magnitude interacted. The find- When Schlinger et al. set the lowest
ing of long pauses with a high- ratio to 1 they also found that
concentration reinforcer (means ranged minimal pausing occurred and that
from approximately 18 s to 43 s for other manipulations in the schedule
PAUSING UNDER RATIO SCHEDULES 49
(e.g., mean ratio size and the magni- the simple to the complex; it is constantly
tude of the reinforcer) had little effect concerned with whether the processes and
laws discovered are adequate for the next. It
on performances. However, when the would be rash to assert at this point that there
lowest ratio was higher (additional is no essential difference between human
values were 4, 7, or 10 for the lowest behavior and the behavior of the lower
ratio), longer pausing occurred, and species; but until an attempt has been made
to deal with both in the same terms, it would
other manipulations were observed to be equally rash to assert that there is. A
have an effect that paralleled the discussion of human embryology makes con-
results with FR schedules. Thus, a siderable use of research on the embryos of
procedural artifact—incorporating 1 chicks. Treatises on digestion, respiration,
as the lowest ratio in the VR distri- circulation, endocrine secretion, and other
physiological processes deal with rats, ham-
bution, found in much of the early sters, rabbits, and so on, even though the
research on pausing under VR sched- interest is primarily in human beings. The
ules—is the likely reason why re- study of behavior has much to gain from the
searchers and textbook authors assert same practice. (p. 38)
that pausing is absent under VR
schedules. Skinner’s views, as well as those of
such pioneering figures as Pavlov,
Thorndike, and Watson, were shaped
PAUSING ON THE by the Darwinian assumption of
HUMAN LEVEL biological continuity between species.
Ferster and Skinner’s (1957) re- Behavioral researchers study non-
search, together with the various human animals because they are
experiments that followed, has yield- more suited for experimental re-
ed a wealth of data pertaining to search. Researchers are reluctant to
performances under ratio schedules. expose humans to the extreme forms
This literature has produced a set of of control and the extended study
empirical principles that provides a required for the steady-state method
framework for control by reinforce- needed for experimentation. In addi-
ment schedules. Equally important is tion, the complex histories brought
that the study of schedules has by humans into the laboratory inter-
provided the basis for an understand- act with the conditions under inves-
ing of human affairs as exemplified tigation. Of course, the experimental
by Skinner’s classic book, Science and study of nonhuman subjects does not
Human Behavior (1953). However, a necessarily guarantee correct conclu-
conspicuous feature of the literature sions about human behavior. The
we have reviewed so far is that the development of comprehensive be-
research comes only from the animal havioral principles requires a bal-
laboratory. We now turn to the anced approach. Thus, detailed ex-
question of the applicability of such perimental data from the animal
findings to humans. laboratory, although clearly impor-
Although the value of animal tant, must be combined with knowl-
models is sometimes challenged as a edge from the study of human
way to understand human behavior, behavior. To understand how the
this approach has met with consider- data on pausing with nonhuman
able success within the behavioral and subjects may relate to human behav-
biological sciences. Skinner (1953) ior, we first consider results from
provided a vigorous defense of animal experiments with human subjects;
models in the following terms: this is followed by a discussion of
how a behavioral interpretation of
the human problem of procrastina-
Human behavior is distinguished by its
complexity, its variety, and its greater accom- tion might proceed. We conclude
plishments, but the basic processes are not with a brief consideration of how
necessarily different. Science advances from variables manipulated in experiments
50 HENRY D. SCHLINGER et al.
verbal capability also play important the counter on the machine indicated
roles. that 100 pieces had been made. At
In light of this variation, it is a this point, the worker would record
formidable task to establish corre- the number completed on a work
spondences between specific charac- card and then take a break’’ (p. 147).
teristics of the experimental proce- In other words, the workers exhibited
dure and the degree of ratio pausing. the familiar break-and-run pattern
The scarcity of human experiments associated with FR schedules. Al-
that have addressed basic schedule though such interpretations of oper-
parameters makes it difficult to draw ant performances have an important
definitive conclusions. Nonetheless, place within science, by the usual
two promising leads are well worth standards they cannot be regarded as
mentioning. In an early study, R. F. definitive. One cannot be certain
Wallace and Mulder (1973) demon- about the role of the observer’s
strated that pause duration increased expectation or whether the behavior
and decreased systematically accord- sample is representative. Also, other
ing to an ascending and descending theoretical systems may generate
series of FR sizes. More recently, D. equally plausible interpretations of
C. Williams et al. (in press), using the same behavior.
multiple FR FR schedules (cf. Perone No doubt, behavioral interpreta-
& Courtney, 1992), found that the tions pose numerous unresolved
extent of pausing was maximal when questions. An essential first step is
a large-magnitude reinforcer was to develop ways of systematically
followed by a small one. Studies such recording human performances as
as these can serve as a model of they occur in the natural environ-
effective research on the human level: ment. A simple, but instructive, study
replication, steady-state methods, and was reported by the famous novelist
systematic variation of the control- Irving Wallace, who kept detailed
ling variables. charts of his own writing output (I.
Wallace, 1977). This information,
Behavioristic Interpretation when expressed in the form of
cumulative records, showed that
In addition to experiments with ‘‘the completion of a chapter always
human subjects, human behavior coincided with the termination of
may be informed by research with writing for the day on which the
nonhumans through behavioral in- chapter was completed’’ (p. 521).
terpretation, that is, correspondences In other words, Wallace’s records,
between naturally occurring human which were based on the writing of
behaviors and contingencies studied several novels, resembled the FR
in the animal laboratory. More sim- break-and-run pattern. More broad-
ply, researchers interpret complex ly, field studies of behaviors in a
human behaviors with principles de- variety of settings (e.g., the factory or
rived from nonhuman laboratory the classroom) can provide detailed
investigations. For example, to illus- information that can interrelate de-
trate FR response patterns, Mazur scriptive observations with the results
(2006) described his own observa- of experimental research (cf. Bijou,
tions when he was a student doing Peterson, & Ault, 1968). The science
summer work in a hinge-making of physics has a long history that
factory. He reported that the workers relates the events of the natural world
were paid on the basis of completion (e.g., the tides of the oceans, the
of 100 hinges (a piecework system), orbits of the planets) to the con-
and that ‘‘once a worker started up trolled conditions of the experimental
the machine, he almost always laboratory. By comparison, behavior
worked steadily and rapidly until analysis continues to fall short of a
52 HENRY D. SCHLINGER et al.
ratio, thus effectively countering the reinforcing stimulus (Harzem & Har-
fatigue hypothesis. Identification of zem, 1981; Lowe et al., 1974; Perone
the variables that control pausing & Courtney, 1992). However, it is
using simple FR schedules is difficult possible that more than one source of
because characteristics of successive inhibition exerts control. We also
ratios, such as the size of the ratio, mentioned Skinner’s (1938) sugges-
are held constant. More informative tion that conditioned inhibition is
are the results of procedures that vary responsible for pausing, in that the
the size of successive ratios using delivery of one reinforcer may serve
multiple FR FR schedules that in- as an SD for subsequent responding.
clude discrete discriminative stimuli Regardless of the origins of inhibi-
that define the components. These tion, there may be several reasons
procedures have shown that pausing why pausing is kept in check. First,
is more a consequence of the upcom- the inhibitory aftereffects of rein-
ing ratio than the preceding one. In forcement dissipate with time. Sec-
both cases, we can say that pausing is ond, the passage of time since the
more pronounced when the transi- start of the ratio is correlated with the
tion is from a more to a less favorable past delivery of reinforcers; thus,
contingency, that is, from a lower to excitation of responding increases
a higher ratio, from a larger to a with time. Third, there is differential
smaller reinforcer magnitude, or reinforcement of responses that occur
from a lesser to a greater response- soon after reinforcement insofar as
force requirement. shorter pauses lessen the delay to the
Beginning with Ferster and Skin- next reinforcer.
ner’s (1957) original studies of ratio Competing reinforcers. The second
schedules, there has been debate account envisions a competition be-
about the appropriate interpretation tween concurrently available sources
of the results that we have described. of reinforcement. On the one hand,
Of these, three interpretations war- subjects can work towards the rein-
rant special attention: (a) Pausing is forcer scheduled by the experimenter.
the result of interacting processes of On the other hand, subjects can
inhibition and excitation; (b) pausing obtain sources of reinforcement with-
is the outcome of a competition in the experimental apparatus that
between reinforcers scheduled by the are not programmed by the experi-
experimenter and reinforcers from menter. According to this view,
other sources; and (c) pausing avoids pausing occurs whenever subjects
the work needed to meet the ratio choose an alternative reinforcer over
requirement. Noteworthy is that such the scheduled one. Alternative rein-
views are primarily concerned with forcers may be added to the operant
what are usually termed molecular chamber, such as the opportunity to
effects; in other words, the models drink water when food pellets are the
represent moment-to-moment effects scheduled reinforcers, but more typ-
on ratio performance, along the lines ical alternatives involve automatic
originally described by Ferster and reinforcers inherent in grooming,
Skinner (cf. Mazur, 1982). resting, and exploring (see Derenne
Inhibitory and excitatory processes. & Baron, 2002; Shull, 1979). Al-
In this view, pausing reflects the joint though the efficacy of such alterna-
effect of the inhibition and the tives may be low by comparison with
excitation of responding (see Leslie, the scheduled one, such reinforcers
1996). We related the well-document- are immediately available. Thus, as a
ed finding, obtained especially with general principle, at the beginning of
mixed FR FR schedules, that inhibi- the ratio, when the probability of
tion originates in the unconditioned responding is lowest, subjects would
effects of the previously delivered be expected to select unscheduled
PAUSING UNDER RATIO SCHEDULES 55
tingencies are removed, subjects may vide at best a sketchy picture and no clue as to
continue to pause less than they did interactive processes. (p. 489)
before the procedure started, suggest-
So it is with the variables that in-
ing that forced exposure to a more
fluence pausing under ratio sched-
efficient response pattern may sensi-
ules. They are likely numerous and
tize subjects to overall reinforcement
complex. Nonetheless, our review has
rates (Derenne et al., 2006).
revealed that amid the variability,
Finally, we addressed the issue of
there is a consistent orderliness across
the relevance of animal models for an
myriad experiments over the past
understanding of the impact of ratio
50 years. Zeiler (1984) pessimistically
schedules of reinforcement on the
concluded that any attempt to un-
world of human affairs. We conclud-
derstand schedules of reinforcement
ed that the general principles that
at a more molecular level is doomed
have emerged from our review, al-
to fail ‘‘because of the complexity of
though imperfect, shed light on hu-
the interactions, and also because
man behavior. In particular, pausing
many of the controlling variables
under ratio schedules may illuminate
arise indirectly through the interplay
the human problem of procrastina-
of ongoing behavior and the contin-
tion in the sense that procrastination
gencies’’ (p. 491). But as we have
is influenced by the size of the
discovered, as a result of innovative
upcoming task, the relative difficulty
methods and probing research ques-
in performing it, and perhaps the
tions, researchers are moving closer
magnitude of the expected reinforcer.
In fact, based on the interpretation of to a more fundamental understand-
pausing under ratio schedules as an ing of why pausing under ratio
avoidance response, some behaviors schedules occurs.
we label as procrastination may
occur because they avoid the upcom- REFERENCES
ing task. This might also momentar- Alling, K., & Poling, A. (1995). The effects of
ily increase the effectiveness of alter- differing response-force requirements on
native reinforcers and might explain fixed-ratio responding of rats. Journal of
why, when faced with a large effortful the Experimental Analysis of Behavior, 63,
331–346.
task, we tend to find other things to Aparicio, C. F., Lopez, F., & Nevin, J. A.
do even if those other activities (1995). The relation between postreinforce-
involve consequences that are typi- ment pause and interreinforcement interval
cally not very effective reinforcers in conjunctive and chain fixed-ratio fixed-
(e.g., washing the dishes, etc.). time schedules. The Psychological Record,
45, 105–125.
So, what can we conclude about Azrin, N. H. (1961). Time-out from positive
pausing under ratio schedules after reinforcement. Science, 133, 382–383.
50 years of research? We can begin to Baron, A., & Derenne, A. (2000). Progressive-
answer this question by addressing ratio schedules: Effects of later schedule
schedule effects in general. As Zeiler requirements on earlier performances. Jour-
nal of the Experimental Analysis of Behavior,
(1984) has written, 73, 291–304.
Baron, A., & Herpolsheimer, L. R. (1999).
Suffice it to say that we still lack a coherent Averaging effects in the study of fixed-ratio
explanation of why any particular schedule response patterns. Journal of the Experi-
has its specific effects on behavior. … Whether mental Analysis of Behavior, 71, 145–153.
the explanation has been based on interre- Baron, A., & Leinenweber, A. (1994). Molec-
sponse time, reinforcement, reinforcer fre- ular and molar aspects of fixed-interval
quency, relations between previous and cur- performance. Journal of the Experimental
rent output, direct or indirect effects, or Analysis of Behavior, 61, 11–18.
whatever, no coherent and adequate theoret- Baron, A., Mikorski, J., & Schlund, M.
ical account has emerged. Forty years of (1992). Reinforcement magnitude and paus-
research has shown that a number of variables ing on progressive-ratio schedules. Journal
must be involved—schedule performances of the Experimental Analysis of Behavior, 58,
must be multiply determined—but they pro- 377–388.
58 HENRY D. SCHLINGER et al.
Baron, A., Perone, M., & Galizio, M. (1991). by past and upcoming doses. Behavioural
Analyzing the reinforcement process at the Pharmacology, 18, 171–175.
human level: Can application and behav- Green, L. (1982). Minority students’ self-
ioristic interpretation replace laboratory control of procrastination. Journal of Coun-
research? The Behavior Analyst, 14, 93–105. seling Psychology, 6, 636–644.
Bijou, S. W., Peterson, R. F., & Ault, M. H. Griffiths, R. R., & Thompson, T. (1973). The
(1968). A method to integrate descriptive post-reinforcement pause: A misnomer. The
and experimental field studies at the level of Psychological Record, 23, 229–235.
data and empirical concepts. Journal of Harrison, H. C. (2005). The three-contingency
Applied Behavior Analysis, 1, 175–191. model of self-management Unpublished doc-
Blakely, E., & Schlinger, H. (1988). Determi- toral disseration, Western Michigan Uni-
nants of pausing under variable-ratio sched- versity.
ules: Reinforcer magnitude, ratio size, and Harzem, P., & Harzem, A. L. (1981). Dis-
schedule configuration. Journal of the Ex- crimination, inhibition, and simultaneous
perimental Analysis of Behavior, 50, 65–73. association of stimulus properties. In P.
Brooke, R. R., & Ruthven, A. J. (1984). The Harzem & M. D. Zeiler (Eds.), Predictabil-
effects of contingency contracting on stu- ity, correlation, and contiguity (pp. 81–128).
dent performance in a PSI class. Teaching of Chichester, England: Wiley.
Psychology, 11, 87–89. Harzem, P., Lowe, C. F., & Davey, G. C. L.
Capehart, G. W., Eckerman, D. A., Guilkey, (1975). Aftereffects of reinforcement mag-
M., & Shull, R. L. (1980). A comparison of nitude: Dependence on context. Quarterly
ratio and interval reinforcement schedules Journal of Experimemental Psychology, 27,
with comparable interreinforcement times. 579–584.
Journal of the Experimental Analysis of Hillman, D., & Bruner, J. S. (1972). Infant
Behavior, 34, 61–76. sucking in response to variations in sched-
Crossman, E. K. (1968). Pause relationships in ules of feeding reinforcement. Journal of
multiple and chained fixed-ratio schedules. Experimental Child Psychology, 13, 240–
Journal of the Experimental Analysis of 247.
Behavior, 11, 117–126.
Hodos, W. (1960). Progressive ratio as a
Crossman, E. K., Bonem, E. J., & Phelps, B. J.
measure of reward strength. Science, 34,
(1987). A comparison of response patterns
943–944.
on fixed-, variable-, and random-ratio
schedules. Journal of the Experimental Hodos, W., & Kalman, G. (1963). Effects of
Analysis of Behavior, 48, 395–406. increment size and reinforcer volume on
Crossman, E. K., & Silverman, L. T. (1973). progressive ratio performance. Journal of
Altering the proportion of components in a the Experimental Analysis Behavior, 6, 387–
mixed fixed-ratio schedule. Journal of the 392.
Experimental Analysis of Behavior, 20, Holland, J. G. (1958). Human vigilance: The
273–279. rate of observing an instrument is controlled
Derenne, A., & Baron, A. (2001). Time-out by the schedule of signal detections. Science,
punishment of long pauses on fixed-ratio 128, 61–67.
schedules of reinforcement. The Psycholog- Howell, A. J., Watson, D. C., Powell, R. A., &
ical Record, 51, 39–51. Buro, K. (2006). Academic procrastination:
Derenne, A., & Baron, A. (2002). Preratio The pattern and correlates of behavioural
pausing: Effects of an alternative reinforcer postponement. Personality and Individual
on fixed-and variable-ratio responding. Differences, 40, 1519–1530.
Journal of the Experimental Analysis of Hutchinson, R. R., & Azrin, N. H. (1961).
Behavior, 77, 272–282. Conditioning of mental-hospital patients to
Derenne, A., Richardson, J. V., & Baron, A. fixed-ratio schedules of reinforcement. Jour-
(2006). Long-term effects of suppressing the nal of the Experimental Analysis of Behavior,
preratio pause. Behavioural Processes, 72, 4, 87–95.
32–37. Killeen, P. (1969). Reinforcement frequency
Ellis, N. R., Barnett, C. D., & Pryer, M. W. and contingency as factors in fixed-ratio
(1960). Operant behavior in mental defec- behavior. Journal of the Experimental Anal-
tives: Exploratory studies. Journal of the ysis of Behavior, 12, 391–395.
Experimental Analysis of Behavior, 3, 63–69. Lamwers, L. L., & Jazwinski, C. H. (1989). A
Felton, M., & Lyon, D. O. (1966). The post- comparison of three strategies to reduce
reinforcement pause. Journal of the Exper- student procrastination in PSI. Teaching of
imental Analysis of Behavior, 9, 131–134. Psychology, 16, 8–12.
Ferster, C. B., & Skinner, B. F. (1957). Lattal, K. A. (1991). Scheduling positive
Schedules of reinforcement. New York: reinforcers. In I. H. Iversen & L. A. Lattal
Appleton-Century-Crofts. (Eds.), Experimental analysis of behavior
Galuska, C. M., Wade-Galuska, T., Woods, J. (pp. 87–134). New York: Elsevier.
H., & Winger, G. (2007). Fixed-ratio Lattal, K. A., Reilly, M. P., & Kohn, J. P.
schedules of cocaine self-administration in (1998). Response persistence under ratio
rhesus monkeys: Joint control of responding and interval reinforcement schedules. Jour-
PAUSING UNDER RATIO SCHEDULES 59
nal of the Experimental Analysis of Behavior, fixed ratio pausing. The Psychological Rec-
70, 165–183. ord, 37, 227–238.
Leslie, J. C. (1996). Principles of behaviour Powell, R. W. (1968). The effects of small
analysis. Amsterdam: Harwood Academic sequential changes in fixed-ratio size upon
Publishers. the post-reinforcement pause. Journal of the
Long, E. R., Hammack, J. T., May, F., & Experimental Analysis of Behavior, 11,
Campbell, B. J. (1958). Intermittent rein- 589–593.
forcement of operant behavior in children. Powell, R. W. (1969). The effect of reinforce-
Journal of the Experimental Analysis of ment magnitude upon responding under
Behavior, 1, 315–339. fixed-ratio schedules. Journal of the Exper-
Lowe, C. F., Davey, G. C. L., & Harzem, P. imental Analysis of Behavior, 12, 605–608.
(1974). Effects of reinforcement magnitude Priddle-Higson, P. J., Lowe, C. F., & Harzem,
on interval and ratio schedules. Journal of P. (1976). Aftereffects of reinforcement on
the Experimental Analysis Behavior, 22, variable-ratio schedules. Journal of the Ex-
553–560. perimental Analysis of Behavior, 25, 347–354.
Malott, R. W. (1966). The effects of prefeed- Rachlin, H., & Green, L. (1972). Commit-
ing in plain and chained fixed ratio sched- ment, choice and self-control. Journal of the
ules of reinforcement. Psychonomic Science, Experimental Analysis of Behavior, 17, 15–22.
4, 285–287. Sanders, R. M. (1969). Concurrent fixed-ratio
Mazur, J. E. (1982). A molecular approach to fixed-interval performances in adult human
ratio schedule performance. In M. L. subjects. Journal of the Experimental Anal-
Commons, R. J. Herrnstein, & H. Rachlin ysis of Behavior, 12, 601–604.
(Eds.), Quantitative analyses of behavior: Schlinger, H., Blakely, E., & Kaczor, T.
Vol. 2. Matching and maximizing accounts (1990). Pausing under variable-ratio sched-
(pp. 79–110). Cambridge, MA: Ballinger. ules: Interaction of reinforcer magnitude,
Mazur, J. E. (1996). Procrastination by variable-ratio size, and lowest ratio. Journal
pigeons: Preference for larger, more delayed of the Experimental Analysis of Behavior, 53,
work requirements. Journal of the Experi- 133–139.
mental Analysis of Behavior, 65, 159–171. Senécal, C., Lavoie, K., & Koestner, R.
Mazur, J. E. (1998). Procrastination by (1997). Trait and situational factors in
procrastination: An interactional model.
pigeons with fixed-interval response require-
Journal of Social Behavior and Personality,
ments. Journal of the Experimental Analysis
12, 889–903.
of Behavior, 69, 185–197.
Shull, R. L. (1979). The post-reinforcement
Mazur, J. E. (2006). Learning and behavior. pause: Some implications for the correla-
Upper Saddle River, NJ: Pearson Prentice tional law of effect. In M. D. Zeiler & P.
Hall. Harzem (Eds.), Advances in analysis of
Mazur, J. E., & Hyslop, M. E. (1982). Fixed- behaviour: Vol. 1. Reinforcement and the
ratio performance with and without a organization of behaviour (pp. 193–221).
postreinforcement timeout. Journal of the New York: Wiley.
Experimental Analysis Behavior, 38, 143– Shull, R. L., & Lawrence, P. S. (1998).
155. Reinforcement: Schedule performance. In
McMillan, J. C. (1971). Percentage reinforce- K. A. Lattal & M. Perone (Eds.), Handbook
ment of fixed-ratio and variable-interval of research methods in human operant
performances. Journal of the Experimental behavior (pp. 95–129). New York: Plenum.
Analysis Behavior, 15, 297–302. Sidman, M. (1960). Tactics of scientific
Morse, W. H., & Dews, P. B. (2002). research. New York: Basic Books.
Foreword to Schedules of Reinforcement. Sidman, M., & Stebbins, W. C. (1954).
Journal of the Experimental Analysis of Satiation effects under fixed-ratio schedules
Behavior, 77, 313–317. of reinforcement. Journal of Comparative
Orlando, R., & Bijou, S. W. (1960). Single and and Physiological Psychology, 47, 114–116.
multiple schedules of reinforcement in Skinner, B. F. (1938). The behavior of organ-
developmentally retarded children. Journal isms. Englewood Cliffs, NJ: Prentice Hall.
of the Experimental Analysis of Behavior, 3, Skinner, B. F. (1949). ‘‘Superstition’’ in the
339–348. pigeon. Journal of Experimental Psychology,
Perone, M. (2003). Negative effects of positive 38, 168–172.
reinforcement. The Behavior Analyst, 26, Skinner, B. F. (1953). Science and human
1–14. behavior. New York: Macmillan.
Perone, M., & Courtney, K. (1992). Fixed- Solomon, L. J., & Rothblum, E. D. (1984).
ratio pausing: Joint effects of past reinforcer Academic procrastination: Frequency and
magnitude and stimuli correlated with cognitive-behavioral correlates. Journal of
upcoming magnitude. Journal of the Exper- Counseling Psychology, 31, 503–509.
imental Analysis of Behavior, 57, 33–46. Steel, P. (2007). The nature of procrastination:
Perone, M., Perone, C. L., & Baron, A. A meta-analytic and theoretical review of
(1987). Inhibition by reinforcement: Effects quintessential self-regulatory failure. Psy-
of reinforcer magnitude and timeout on chological Bulletin, 133, 65–94.
60 HENRY D. SCHLINGER et al.