Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

THE OPERANT SIDE OF BEHAVIOR THERAPY

B. F. SKINNER
Department of Psychology. Harvard University. Cambridge. Massachusetts

Summary-For more than twenty-four hundred years, people were seen to behave in given
ways because of what they were feeling or thinking. and feelings and thoughts were therefore
the things to study. However. it has always been difficult to do very much with feelings and
thoughts because of their inaccessibility to outside observers. Further. important distinctions
are obscured when behavior is attributed to a state of mind. As more and more of the vari-
ables of which behavior is a function are identified and their role analysed. less remains to be
explained in mentalistic ways. The operant side of behavior therapy is illustrated by consider-
ing a few characteristic problems. Discussion includes the analysis of contingencies outside
and inside the clinic. and the relationship between behavioral health and medical health.

In 1913 John B. Watson issued his famous havior have appeared. Ethology is one of
manifesto: The subject matter of psychology them. The behavior of animals in a natural
was behavior. It is easy to forget how radical environment is no longer explained by imagin-
that must have seemed. Psychology had always ing what the animals are feeling or thinking
been the science of mental life, and that life about but by the contributions the behavior
was to be studied through introspection, a pro- may have made to the future of their genes. In
cess of self-examination borrowed from the the other science, the experimental analysis of
philosophers, who had used it for more than behavior, animals are observed in the labora-
twenty-four hundred years. People were seen tory, where many of the conditions of which
to behave in given ways because of what they their behavior is a function can be controlled.
were feeling or thinking about, and feelings Most of the behavior is traced to operant re-
and thoughts were therefore the things to inforcement, a different kind of selective
study. If animals sometimes behaved rather consequence acting during the lifetime of the
like people, they probably had feelings and individual.
some kind of mental life, although they might As more and more of the variables of which
not know they had. behavior is a function are identified and their
Seventy-five years have seen a great change. role analysed, less remains to be explained in
Introspection has been returned to the phil- mentalistic ways. There are proportionate
osophers. There are no longer any “trained gains in the application of the analysis. It has
observers” in the Wundtian tradition, and always been difficult to do very much with feel-
cognitive psychologists no longer observe the ings and states of mind because of their in-
mental processes they talk about. The pro- accessibility. The environmental variables are
cesses are hypotheses, to be confirmed either often within reach. Contact between the basic
by inferences from the behavior they are said analysis and its applications is therefore impor-
to explain or by a different kind of observation tant. Although new facts often turn up in the
- namely, of the nervous system. course of applying a science, the science itself
Meanwhile, two flourishing sciences of be- usually moves more rapidly into new territory.

Requests for reprints should be addressed to B. F. Skinner. Department of Psychology. Harvard University, William
James Hall, 33 Kirkland Street, Cambridge, Massachusetts 02138, U.S.A.

171
172 B. F. SKINNER

In what follows I review some well known behavior, for example. is genetic; it has
practices in behavior therapy from the point of evolved because of its contribution to the sur-
view of behavior analysis and discuss a few vival of the species. Variables of that sort are
current theoretical issues. I do so, not to cor- largely out of reach in dealing with the be-
rect or instruct practitioners, but to reassure havior of an individual, although aggressive
them. The experimental analysis of behavior is behavior can often be allowed to adapt out.
developing rapidly, and at every step the Much more can be done when emotional re-
principles of behavior therapy gain auth- sponses result from respondent (Pavlovian)
ority. Troublesome behavior is due to trouble- conditioning. Troublesome behavior can then
some contingencies of reinforcement, not to often be extinguished or other behavior can be
troublesome feelings or states of mind, and to conditioned to replace it. Both adaptation and
correct the trouble we should correct the extinction have fewer unwanted side effects
contingencies. when stimuli are presented with gradually in-
creasing intensities. The process is called, of
course, desensitization.
RESPONDENT BEHAVIOR THERAPY
Psychotherapy has often been concerned
with feelings - with anxiety, fear, anger OPERANT BEHAVIOR THERAPY
and the like. An early step toward behavior Therapists have been as much concerned
therapy was the realization that what was felt with what people do as with what they feel.
was not a “feeling” but a state of the body. The Behavior therapists trace what is done to
point was made before the advent of behavior- two kinds of selective consequences, innate
ism by William James and Carl Lange. Lange behavior to natural selection and learned be-
looked for possibly relevant states, but James havior to operant reinforcement. A given in-
put the argument in its best known form: we do stance is usually a joint product of both. There
not cry because we are sad, we are sad because is an operant side to emotion, for example.
we cry. Fear is not only a response of glands and
A further step was needed, however. We do smooth muscle, it is a reduced probability of
not cry because we are sad or feel sad because moving toward a feared object and a height-
we cry, we cry and feel sad because something ened probability of moving away from it. The
has happened. Perhaps a friend has died. We operant side of anger is a greater probability of
must know something about the earlier event if hurting someone and a lesser probability of
we are to explain either the crying or the state acting to please. Where the bodily state result-
felt. That is the behavioristic position: turn to ing from respondent conditioning is usually
environmental antecedents to explain what one called a feeling, the state resulting from oper-
does and, at the same time, what one feels ant conditioning, observed through introspec-
while doing it. For every state felt and given tion, is called a state of mind.
the name of a feeling there is presumably a Important distinctions are obscured,
prior environmental event of which it is the however, when behavior is attributed to a state
product. Behavior therapy addresses the prior of mind. An operant is strengthened, for ex-
event rather than the feeling. ample, when a response has reinforcing con-
What are felt as emotions are largely the re- sequences, but subsequent responses occur
sponses of glands and smooth muscle. Efforts because of what has happened, not what is
were once made to define a given emotion as a going to happen. When we say that we do
particular pattern of such responses. The vari- something **with the intention of having a given
ables of which the behavior is a function are a effect,” for example, we attribute our behavior
more promising alternative. Some aggressive to something that lies in the future, but both
THE OPERANT SIDE OF BEHAVIOR THERAP’r 173

the behavior and the state introspectively sweet foods, not because large quantities are
observed at the time are due to what has hap- good for us now, but because salty and sweet
pened in the past. “Expectation” misrepresents foods were in short supply in the early history
the facts in the same way. To take an operant of the species. Those who, thanks to genetic
example, when a reinforcing consequence has variations, found them especially reinforcing
followed something we have done, we are said were more likely to eat them and survive. The
to expect that it will follow when we do it increased susceptibility to reinforcement then
again. What is introspectively observed is the led to the discovery and processing of vast
bodily state resulting from the past occurrence. quantities of salty and sweet foods, and
When one stimulus has often followed another, we now eat too much of them and may turn to
regardless of anything we may have done, we therapy for help.
are said to expect the second whenever the first An increased susceptibility to reinforcement
occurs. That expectation is a bodily state by sexual contact would also have had great
resulting from respondent conditioning. survival value in a world subject to famine,
Terms for states of mind have never been pestilence, and predation, and it now raises
very consistently used. The nervous systems problems, not only for individuals but for an
which bring our behavior into contact with already overpopulated world. A strong suscep-
various parts of our own body are not very effi- tibility to reinforcement by signs that one has
cient because they evolved for other reasons, hurt another person could also have evolved
and we cannot observe the bodily states of because such signs shape and maintain skillful
other people at all, at least while they are alive. combat. (The boxer who shows that he has
In any case explanations of that sort must been hurt has taught his opponent how to
themselves be explained. We make no progress hurt.) Hence, the strong reinforcement of
by explaining one state of mind as the effect of aggressive behavior which, like that of sexual
another; we must get back to something that behavior, raises problems both for the indi-
can be directly observed and, if possible, put to vidual and the world.
use. That means, of course, the genetic and Problems also arise from reinforcers which
personal histories responsible both for the have never had any evolutionary advantage.
behavior and, in passing, the states of the body Homo sapiens is not the only species to have
introspectively observed. discovered them. The reinforcing effects of
alcohol, heroin, cocaine and other drugs are
presumably accidental. They are particularly
SOME EXAMPLES troublesome when their use leads to the power-
The operant side of behavior therapy can be ful negative reinforcers we call withdrawal
illustrated by considering a few characteristic symptoms. The craving from which an addict is
problems, in each of which behavior is traced said to suffer is a bodily state which ac-
to a contingency of natural selection or operant companies behavior due to an anomalous re-
reinforcement rather than to a state of mind. inforcer.
Positively reinforced behavior is often accom- A different problem arises when a repertoire
panied by a state which we report by saying of behavior conditioned in one environment
that we are doing “what we want to do”, “like undergoes extinction in another. The relevant
to do”, or “love to do”. There is a special bodily state may be called discouragement, a
reason why such behavior is often trouble- sense of failure, helplessness, a loss of con-
some. The reinforcing effect of a particular fidence, or depression. A different kind of
consequence may have evolved under condi- depression follows when, having acquired a
tions which no longer prevail. For example, large and effective repertoire in one place, one
most of us are strongly reinforced by salty or moves to another in which it cannot be exe-
174 B. F. SKINNER

cuted. The behavior is not extinguished: there is often a matter of destroying the reinforcing
are things one still wants to do, but appropriate effects of adventitious consequences.
occasions are lacking. The student who has Aversive consequences are responsible for
acquired an effective repertoire in college may many kinds of problems. As negative re-
find no place for it in the world to which he inforcers they can have the faults we have just
moves upon graduation. The person who seen in positive reinforcers. As punishment
moves to a new city may suffer the same their side effects may be severe. We learned to
kind of depression when a repertoire appropri- crawl, walk, run and ride a bicycle because
ate to the old city does not work well in the getting around the world reinforced our cor-
new. rectly doing so but also because we were hurt
The addiction due to anomalous reinforcers when we made mistakes. That sort of punish-
is quite different from the addiction due to cer- ment is immediately contingent on behavior
tain schedules of reinforcement. The so-called and may reduce its probability of occurrence,
variable-ratio schedule is especially likely to but it can also suppress behavior in a different
cause trouble. It is a useful schedule because it way through respondent conditioning. The
maintains behavior against extinction when situation in which the behavior occurs or some
reinforcers occur only infrequently. The be- aspect of the behavior itself becomes aversive,
havior of the dedicated artist, writer, business- and it can then negatively reinforce alternative
man, or scientist is sustained by an occasional, forms of behavior. The punished person re-
unpredictable reinforcement. We play games mains as strongly inclined to behave in the
because our behavior is reinforced on a vari- punished way as ever but escapes from the
able ratio schedule, and for the same reason we threat of punishment by doing something else
gamble. In the long run gamblers lose because instead. When punishment is imposed by other
those who maintain the contingencies must people, as it often is, it is seldom immediately
win. As with the behavior due to anomalous contingent on what is done and works via
reinforcers, gambling is an addiction in the respondent conditioning.
sense that there is no ultimate gain, at least for The bodily state resulting from the threat of
most of those who gamble. deferred punishment is named according to its
Many problems calling for therapy arise sources. When punished by one’s peers it is
from a fault in operant conditioning itself. The called shame, when by a government guilt and
process presumably evolved because behavior when by a religious agency a sense of sin. One
was strengthened when it produced important way to escape is to confess and take the punish-
consequences for both individual and species. ment, but when the behavior upon which a
The process could not, however, take into deferred punishment was contingent is not
account the manner in which the consequences clear, escape can be difficult. Merely acci-
were produced. It was enough that conse- dental aversive contingencies generate un-
quences usually followed because they were explained feelings of shame, guilt or sin, and a
produced by what was done. Conditioning person may then turn to a therapist for help in
nevertheless occurs when reinforcing conse- escaping.
quences follow for any reason whatsoever. Here, then, are a few examples of trouble-
Accidental consequences yield the behavior we some contingencies of operant reinforcement,
call superstition. We fall ill, take a pill or per- together with a few “states of mind” to which
form a ritual, and get well; we then are more the behavior is often attributed. Other exam-
iikely to take a pill or perform the ritual when ples could be given (the list seems endless), but
we fall ill again, regardless of whether there these are perhaps enough to show the precision
was any actual effect. The superstition may and potential of the operant analysis. It does
stand in the way of a better measure. Therapy not follow, however, that behavior therapists
THE OPERANT SIDE OF BEHAVIOR THERAPY 175

should never ask their clients what they are about the use of punitive consequences by
feeling or thinking about. From their answers governments or positive reinforcers by busi-
something may be inferred about genetic or ness and industry. If it is not so often asked of
personal histories. Asking such questions is, in psychotherapists, perhaps it is because they
fact, often the only way in which therapists can have not demonstrated any threatening power
learn about a personal history. They lack facili- or because, like Carl Rogers, they insist that
ties for direct investigations, and to investigate they are not exercising control at all. The
without permission is regarded as unethical. question is more likely to be asked of behavior
But asking about feelings and thoughts is only therapists because their practices are more
a convenience - the very convenience, in fact, often effective. Token economies in hospitals
which explains why people have asked about or prisons, for example, have been challenged
them for so many centuries - and we must precisely because they work. Food, even insti-
turn to more accessible variables if we are to tutional food, is a reinforcer and can often be
have a scientific analysis or use it to do some- made contingent on behavior. That can be
thing about personal problems. done to the advantage of those who are re-
The argument for operant behavior therapy inforced, but it is perhaps more often done
is essentially this: What is felt as feelings or to solve problems of management. The ethi-
introspectively observed as states of mind are cal question would seem to be clli bono.
states of the body. and they are the products of who profits? Control is ethical if it is exerted
certain contingencies of reinforcement. The for the sake of the controlled.
contingencies can be much more easily identi- That principle could play a greater part in
fied and analysed than the feelings or states of current demands for legislative action to pro-
mind, and by turning to them as the thing to be hibit the use of aversive measures by thera-
changed, behavior therapy gains a special pists. It is easy to argue for banning the use of
advantage. An important question remains to aversives because they are unpleasant things.
be answered, however. How are contingencies By definition they are things we turn away
to be changed? from, and as punishment they interfere with
things we want to do. But who eventually
profits? The dentist’s drill is aversive, but
CHANGING THE CONTINGENCIES we accept it to escape from a toothache. We
The conditions of which behavior is a func- accept the punitive practices of governments
tion are under control in homes, for example, and religions in return for some measure of
and in schools, workplaces, hospitals and order, security, and peace of mind. When aver-
prisons. Therapists may change them for their sive stimuli are used to stop the bizarre be-
own purposes if they are part of a family or if havior of autistic people long enough to bring
they teach, employ workers, or administer them under the control of nonaversive prac-
hospitals or prisons. Professionally, they advise tices, they would seem to be justified. But only
those who do so. They help parents with their if no other measure can be used. Too ready an
children or spouses with their spouses; they acceptance of aversive measures blocks pro-
advise teachers; they suggest new practices in gress along other lines. It is only recently that
hospitals and prisons. They can do so because strong sanctions have been imposed upon child
some of the conditions under which people live abuse and the battering of spouses, and corp-
can be controlled. oral punishment is only now being strongly
The word control raises a familiar issue. challenged in schools. We are not yet ready to
What right has a therapist to manipulate the replace a police force or close the Pentagon.
conditions of which a person’s behavior is a Applied behavior analysis has contributed to
function? The question is more often asked alternative measures, however, and we may
176 B. F. SKINNER

hope that the problems of the autistic will soon mother. But children also do as they are told
be solved in better ways. because positive reinforcers have followed.
Parents who contrive consequences having that
effect are said to “reward” their children for
THE CLINIC doing as they are told. Teachers contrive simi-
Homes, schools, workplaces, hospitals and lar reinforcing consequences, such as commen-
prisons are environments in which people dation or good grades, to induce their students
spend a great deal of their time. Face-to-face to study. There is no natural connection be-
therapy in the clinic is different. Only a small tween the behavior and its consequence, but
part of the client’s life is spent in the presence the practice is justified on the grounds that
of a therapist. Only a few reinforcers can be geniune consequences will take over in the
used, and most of the time only to reinforce world at large. Very little of that sort of thing is
social, especially verbal, behavior. There is a suitable in therapy. The only reinforcing con-
great deal of mutual shaping of behavior in sequences which induce clients to continue to
face-to-face confrontations; some of it possibly take advice are largely to be found outside the
harmful. clinic.
What the client does in the clinic is not of Therapists who resemble people whose
immediate concern, however. What happens advice has often proved to be worth taking
there is preparation for a world which is not have an advantage. Those who do not must
under the control of the therapist. Instead of work in other ways. In traditional terms, they
arranging current contingencies of reinforce- must build “confidence” or “trust”. That can
ment, as in a home, school, workplace or sometimes be done by giving bits of advice
hospital, therapists give advice. Modelling which are not only easily followed but will al-
behavior to be copied is a kind of advice, but most certainly have reinforcing consequences.
verbal advice has a broader scope. It may take Face-to-face advice may also take the form
the form of an order (“Do this, stop doing of rules for effective action. The proverbs and
that”) or it may describe contingencies of rein- maxims of cultures are rules of that sort. Rules
forcement (“Doing this will probably have a are especially useful because therapists may
reinforcing effect. ” “If you do that the con- not be available to help in solving future prob-
sequences may be punishing.“). lems. Not every problem can be solved by
Traditionally, advice has been thought of as applying a rule, however, and therapists may
communication. Something called knowledge need to take a further step and teach their
of the world is said to pass from speaker to clients how to construct their own rules. That
listener. But a useful distinction has been means teaching them something about the
made between knowing by acquaintance and analysis of behavior. It is usually easier than
knowing by description. Knowing because teaching them how to change their feelings or
something you have done has had reinforcing states of mind.
consequences is very different from knowing
because you have been told what to do. It is the
HEALTH
difference between contingency-shaped and
rule-governed behavior. Psychotherapy is said to promote mental
But why is advice taken? Children often do health in the sense of helping people “feel
as they are told because they have been well” and “think clearly”. Behavior therapy
punished when they have not done so, and promotes behavioral health in the sense that it
something of the sort is suggested in therapy helps people behave well, not in the sense of
when it is said that the therapist should become politely, but successfully. Is there an effect
an authority figure, perhaps that of a father or on physical health?
THE OPERANT SIDE OF BEHAVIOR THERAPY 177

What people do may have obvious medical sequences, especially at the hands of other
consequences - what they eat, how much they people. Assertions of this sort do not imply a
exercise, how carefully they avoid accidents, neglect of genetic factors. Behavior therapy is
whether they smoke, drink or take drugs, how limited to changes which can be made during a
often they expose themselves to infection, person’s lifetime.
what medicines they take, how well they follow A very different relation between behavior
medical advice, and so on. Operant behavior and health is implied when it is said that a criti-
therapists can improve medical health by help- cally ill patient simply “refuses to die” or that
ing people manage themselves in beneficial one with a favorable prognosis loses the “will
ways. But is there an additional, perhaps to live”. Examples of that sort are, of course,
direct, effect? said to show the power of mind over matter.
Something of the sort is suggested when it is They suggest that being healthy is something
said that a given type of personality or neurosis one does. An ancient metaphor of the medical
is associated with a given type of physical profession may be responsible. We “catch” a
health. If psychotherapists can change person- cold or “get” the measles. Engaged in a war
alities or neuroses, they should be able to with disease, we are attacked (we have a “heart
change health. But personality explains attack”) or struck down (we have a “stroke”).
nothing until we have explained personality, When infections invade us, much depends
and as an internal correlate of behavior a upon our “resistance”. But good health is not
neurosis is no more useful here than elsewhere. contingent upon behavior in such a way as to
The “person” in personality once meant the reinforce “being healthy” as a kind of action.
mask worn by an actor in a Greek play. It How contingencies of operant reinforcement
defined him as a persona dramatis. The word affect physiological processes is no doubt an
“neurology” was invented in the early 19th important question. Can immunological reac-
century at about the same time as “phren- tions be conditioned in the Pavlovian manner,
ology”. Phrenologists claimed to locate traits for example? But should the behavior therapist
of character in the gross structure of the skull. try to find out? Physiology has a special appeal
Neurology went further inside to the gross to those who explain behavior in mentalistic
structure of the nervous system. The important terms; it seems to show what is really going on
facts, then as now, were what people did. inside, what one is really talking about. Cogni-
Behavior therapists turn to the contingencies tive psychologists have turned to brain science
of reinforcement responsible for the behavior for that reason. Behavior therapists may also
that personality, neuroses and the like are said turn to physiology if they lack confidence in
to explain. their own methods, but those methods are
To say that physical illness is due to stress, equally objective. One cannot quarrel with the
for example, does not explain the illness or choice of medical science as a professional
point to any way to treat it until stress has been field, or even with philosophers who wish to
explained. If people are under stress because, examine their minds through introspection, but
for example, there are too many things they for every behavior therapist who, upon dis-
must do, the things they must do are the things covering some fact about behavior, then looks
to be changed. To do anything about an illness for a physiological explanation, there is one
due to anxiety we must change the aversive therapist the fewer to make further discoveries
circumstances responsible for what is thus felt. about behavior itself.
Some of the illness said to be due to discour-
agement or despair may be alleviated by re-
storing lost reinforcers, and illness due to FEELING WELL AND FEELING GOOD
hostility or feur by eliminating aversive con- People usually seek both medical and be-
17x B. F. SKINNER

havior therapy because of how they feel. The agencies are replaced by face-to-face personal
physician changes what they feel in medical control. New members begin by following
ways; behavior therapists change the contin- simple rules, with the help of instruction and
gencies of which what is felt is a function. The counseling, and their behavior is soon taken
distinction between medical and behavior over by carefully designed social contingencies.
therapy resembles the distinction between feel- Both operant and respondent conditioning are
ing well and feeling good. One feels well who used in therapy. Children learn to manage
feels a healthy body, free of aches or pains. their emotions, for example, through desensiti-
One feels good who feels a body which has zation. There is little or no negative reinforce-
been positively reinforced. Positive reinforcers ment or punishment. (Curiously enough, many
please. We call them pleasant and the behavior critics complained that the citizens of Walden
they reinforce a pleasure. They please even Two are too happy.)
when they are accidental. (“Happy” first Like all utopias, Walden Two tries to solve
meant “lucky”.) the problems of a culture all at once rather
What is felt in that way is apparently a strong than one by one. We shall probably not move
probability of action and a freedom from aver- very rapidly toward that kind of a better world,
sive stimuli. We are “eager” to do things which but it is, I think, worth considering as a model.
have had reinforcing consequences and “feel Every advance in behavior therapy moves in
better” in a world in which we do not “have” to that direction because it begins by changing the
do unpleasant things. We say that we are en- world in which people live and then, only in-
joying life or that life is good. We have no directly, what they do and feel.
complaints because complaining is negatively For thousands of years philosophers have
reinforced behavior, and there are no negative talked about the behavior of people with whom
reinforcers. Successful therapy builds strong they have had no contact and about whose feel-
behavior by removing unnecessary negative ings or states of mind they could not ask. In-
reinforcers and multiplying positive ones. stead they have disembodied mental events
Whether those whose behavior is thus and discussed them quite apart from anyone in
strengthened live any longer than other peo- whom they occur. They have said that frustra-
ple, they can be said to live well in another tion breeds aggression, that greed overrides
sense. caution, that jealousy destroys affection, and
Finding a world in which one can live well in so on. Statements of that sort are fairly com-
spite of infirmities is the theme of Enjoy Old mon in current discussions of government, re-
Age, a little book written with the collabora- ligion, economics and the other so-called (but
tion of Margaret Vaughan. There are medical in that case miscalled) behavioral sciences. By
imperfections in old age which cannot be rejecting feelings and states of mind as the in-
avoided. Aversive consequences are more itiating causes of behavior, and turning instead
likely to follow whatever one does and rein- to the environmental conditions responsible
forcing consequences less often. But the world both for what people do and feel while doing it,
of old people can often be changed so that, in behavior analysts, and with them behavior
spite of imperfections, one can enjoy more of therapists, can approach the larger problems of
one’s life and perhaps even live a little longer. human behavior in a much more effective way.
Can something of the sort be done for every- A problem of great importance remains to
one? My utopian novel, Walden Two, pub- be solved. Rather than build a world in which
lished forty years ago, was a kind of fictional we shall all live well, we must stop building one
anticipation of what came to be called applied in which it will be impossible to live at all. That
behavior analysis. It described a community in is wholly a problem in human behavior. How
which governmental, religious and capitalistic are people to be induced to consume no more
THE OPERANT SIDE OF BEHAVIOR THERAPY 179

than they need, refrain from doing things ingly incompatible with the future of the world.
which unnecessarily pollute the environment, We need to construct relatively immediate con-
have only enough children to replace them- sequences of human behavior which will act as
selves, and solve international problems with- the remoter ones would act if they were here
out risking a nuclear war? The contingencies now. That will not be easy, but at least we can
under which people now live are maintained by say that we have a science and a technology
governments, religions and economic enter- which are addressing themselves to the basic
prises, but they in turn are controlled by fairly problem.
immediate consequences which are increas-

You might also like