Self Control Howard Rachlin
Self Control Howard Rachlin
Self Control Howard Rachlin
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp
.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact [email protected].
Cambridge Center for Behavioral Studies (CCBS) is collaborating with JSTOR to digitize, preserve and extend
access to Behaviorism.
http://www.jstor.org
Howard Rachlin
State University of New York at Stony Brook
1. Preparation of this paper was supported by a grant from the National Science Foundation.
For helpful comments on a previous draft of this paper I thank G. Ainslie, W. Baum,
E. Erwin, E. Fantino, R. J. Herrnstein, F. Levine, G.H. Whitehurst, and G.T. Wilson.
94
in the present. In this context visiting the dentist is showing self-control and not
visiting him shows lack of self-control. The hedonic picture looks something like
that of Figure 1. The reason for indecision between two alternatives, one
already
assumed to be better than the other, is that the better alternative is only better in
don't visit
dentist
MORE
PAIN visit dentist
LESS
PAIN
Figure 1: Hypothetical diagram of the way pain would vary on visiting the dentist and
without visiting the dentist.
the long run. The worse alternative offers immediate benefit. The difference
between someone who is controlling himself and someone who is not controlling
himself is thus not in the spatial locus of control (from inside versus from out
side his skin) as the term "self-control" seems to in the
imply but temporal locus
?
how far away from the present must we look to find the source of control.
With regard to the establishment of self-control the question to ask is how con
trol is shifted from immediate to distant consequences. Again, this is a temporal
not a one. as Skinner (1955) has
question, spatial However, pointed out, psy
have been hesitant to ascribe to events far apart,
chologists causality temporally,
from each other. They have translated the action of distant events into present
events and events inside the organism. Thus "ego strength," "in
placed the present
ternalization," "resistance to frustration," and other cog
"subjective probability,"
nitive or motivational terms have made their way into discussions of self-control.
These terms refer to mediating mechanisms which represent a past or a future event
in the present. It is my contention that these mediating mechanisms are not
necessary to understand or self-control. have served for the
empirically study They
95
-
shocks
! il
bar presses
I II Mil II I
0
TIME
96
Q and R he might conclude that shocks were causing bar presses, that bar presses
were or that the two were unrelated. an extended
causing shocks Only view of
the temporal properties of bar presses and shocks allows us to see the true relation
a rat in the Herrnstein-Hineline that presses the bar as
ship. Imagine experiment
in Figure 2. We can now ask, "What causes the bar In the
presses?" light of the
above discussion the cause of the bar presses is the relationship between bar press
as it is
ing and shocks experienced by the rat.
Suppose in the Herrnstein-Hineline experiment that each bar press costs the
rat something. We could imagine that the effort of pressing was increased or that
a low In that case the immediate con
intensity shock followed upon each press.
sequences of pressing the bar would be painful (or effortful) but the long-term
consequences of not pressing the bar would be still more painful. The picture
would be something like that shown in Figure 1. "visit dentist"
Replace by "press
bar" and "don't visit dentist" by "don't press bar" and you have a fair picture of
the rat's situation. Will rats press bars under these conditions? In a more recent
experiment, Lambert, Bersh, Hinelineand Smith (1973) arranged contingencies for
a rat so that a press a shock but avoided several
produced single immediately
shocks of equal intensity later on. The rats in the Lambert et al experiment con
the bar. Can we say that the rats were self-control?
sistently pressed exhibiting
If the criterion for an alternative which
exhibiting self-control is choosing involves
a future over a smaller present then these rats were
larger good good exhibiting
a more in the distant future in favor
self-control; they avoided painful experience
of a less painful experience in the immediate future.2 if, on the other hand, we
insist that exertions of "ego-strength," "internalization," or other
"expectancy,"
or motivational events must also go on somewhere within the rat we shall
cognitive
have the difficult task of trying to verify their occurrence. But such
explanatory
efforts are unnecessary. The behavior itself is all the evidence we need that self
control is going on. What would we say ifwe found somehow that the rat had
the appropriate motivational or but did not press the bar?
cognitive apparatus
It would be pointless, then, to claim that the rat was controlling itself. It is the
rat's behavior in relation to the contingencies
imposed that comprises self-control.
Similar arguments apply as well to all human instances of self-control. The way
in which human behavior is more complicated than a rat's behavior is not that
human behavior is controlled from inside while the rat's behavior is controlled
from outside but that the environmental events
controlling human behavior prob
occur over a wider interval than those which control the behavior
ably temporal
of the rat. When we refuse the third martini at a party (ifwe do refuse it) it is not
because of an exercise of some force within us but part of a response to con
out in time before and after we are offered the drink. The
tingencies spread widely
wider contingencies involve events on the way home and the next morning while
the narrow contingencies involve only events at the party itself. Why we should
act in accordance with wide contingencies rather than with the narrow ones which
2. Fantino (1966) showed that pigeons could learn to show self-control in a symmetrical
situation with positive reinforcement. The pigeons in Fantino's experiment could obtain an
immediate reward (followed by a penalty) by pecking a red key or they could wait a few
seconds until the key turned green and obtain a reward with no penalty. The pigeons
initially pecked the red key but with six months of training came eventually to wait for
the green key.
97
dictate acceptance of the drink is another question, which we shall try to deal
with later. It suffices to say now that the question is answered no better by
to internal events or states than it iswithout them.
referring
Let us return to the rats in the Herrnstein-Hineline experiment. These rats
were the bar and few shocks. I
pressing relatively rapidly receiving relatively
that the between the bar presses and the shocks as
argued contingency experienced
rat is the cause of the bar
by the pressing. Traditional psychology would invoke
the cognitive and motivational mediating mechanisms previously discussed. What
is the purpose of those mechanisms? In order to avoid having an event at one
time caused an event at another time the concept of a state of the
by organism
is introduced. Events at one time affect the state, and the state affects the behavior.
The state in question may be motivational or are
cognitive. Past events supposed
to govern present events via the motivational state while future events are
supposed
to govern present events via the cognitive state. Herrnstein (1969), Bolles (1972),
and Seligman and Johnston (1973) have argued against motivational and for
cognitive explanations of the bar pressing of rats, but ifwe grant that events
extended in both are events
temporal directions directly caused by other similarly
extended there is no need to refer to either kind of state. The notion that cog
nitive and motivational states mediate between past and future events and present
behavior is not necessary. It obscures the search for the most direct causes of
behavior because it tends to direct that search into the organism instead of into
the past and future.
This does not imply that a given act can be manipulated by
events which occur
after the act is over. When the environmental event and the behavior are extended
in time it makes no sense to talk of an environmental sub-event at one point in
time causing a sub-act at another in time. Each sub-act is to be seen as
point only
part of the complete act; and it is the causal relation between the complete act
and the complete environmental event which concerns us. In Figure 2 a certain
rate of bar
pressing is caused by the relationship between shocks and bar presses.
At our level of inquiry no individual bar press is "caused" at all. It makes as little
sense to cause of an individual bar press in the
place the past as it does to place
the cause in the future. if I like a
painting, it is
me who likes the
Analogously,
as a whole. One could not
painting say whether my left eye liked the lower
corner of the
right painting.3
With respect to the traditional between classical and instrumental
dichotomy
conditioning, the notion that the cause of behavior extends into both the past
and future removes the usual
? temporal distinction between classical conditioning
the reinforcer the unconditioned ?
(where stimulus precedes the act) and
instrumental conditioning (where the reinforcer follows the act) and concentrates,
as has
recently been suggested (Bloomfield, 1972; Catania, 1971; Gamzu and
Schwartz, 1973; Rachlin, 1970; Staddon, 1973), on correlations between one
environmental event and another and between an environ
(classical conditioning)
mental and a behavior event (instrumental
conditioning).
3. If we were forced to consider individual sub-events as being caused we would have to admit
that an event could be changed by a subsequent event. Modern historians recognize that the
facts of the past are not easily separable from their interpretation (their context). If individual
past events were considered in isolation of their context, a modern theory of history which
revises our interpretation of those events in effect, be them.
would, changing
98
To say that the origin of self-control is not in the self is not to say that the
has no or has been subtracted out of consideration. The
organism properties
biological properties of the organism determine which environmental events
control which behavioral events. What has been subtracted out are those psy
to as memory,
chological (as opposed biological) properties of the organism such
expectancy, response strength, etc. which serve to
only bridge temporal gaps.
The remaining biological are those that serve for reaction
properties of the organism
to immediate as well as If a man is stabbed and he
long-term contingencies.
bleeds, no one will be to talk about memory of the and
tempted stabbing
response strength of the bleeding intervening between stabbing and bleeding,
although the properties of his body determined that he would bleed when
stabbed. But for temporally extended events such as his dissatisfaction with a
bad job, traditional psychological analysis will invoke memory, expectancy
to cause and effect into immediate
and response strength in order bring the
temporal proximity. It is certainly something about the man that reacts to the
long hours, the low pay, the hostile boss, etc., by complaining, on strike
going
or But it is nevertheless these external temporally extended events that
quitting.
cause his behavior and not his immediate memories, and response
expectations,
strengths.
Very often widespread and narrow contingencies
cause the same behavior.
at a rewards now, in the past and in the future.
Working pleasant job provides
The relationship between these rewards and work, more
directly than anything
else, causes the work to be done. But often temporally extended events cause
behavior in conflict with that caused by temporally constricted events. When such
conflict arises a choice has to be made between the constricted and extended
consequences, the choice of extended consequences being self-control. The sub
state to "exertion of self-control" may be no different
jective corresponding
than that corresponding to any difficult choice. whether
qualitatively Deciding
to accept that third cocktail may be more difficult than deciding whether it is to
be a martini or a manhattan but the difference between the two decisions would
be simply that one ismore difficult, not that one is different in kind from the other.
To say that the cause of action can be narrow or widespread in time is not to
that events have effects whenever occur. There is often a
say equal they may
greater weight attached to constricted than to contingencies. The
widespread
and motivational theorists invoke of memory and to
cognitive gradients certainty
the reduction in control by events far in the past or future. But, given
explain
these gradients, not be first to the state of the
they need applied organism and
then to its behavior. can to behavior. Furthermore,
only They apply directly
many actions, and in the case of humans most of our significant actions, are un
related to present causes. We move from one city to another, get married or
or not because of anything that is at the
divorced, get jobs quit them happening
very moment we perform these actions (even when the actions themselves are
It has proved difficult and fruitless, moreover, to trace chains of
brief). secondary
reinforcers back from some
presumably primary reinforcer just in order to bring
the reinforcer in temporal proximity with the acts. If a man moves from
Maine to Florida he does not move because of the weather on the day he moves al
of the weather. The cognitive or motivational
though he may be moving because
theorists will say that the weather in Maine causes a certain state in the man and
the weather in Florida causes another state in the man and that moving is rein
99
forced by a transition from one state to the other. But such states have been
difficult to pin down. They are awkward, unparsimonious and invite freewheeling
which can in their terms. Their one convenience, of
theorizing explain anything
causes and effects into is not worth its price.
bringing temporal proximity, simply
The cause of a man's moving from Maine to Florida is most parsimoniously
described in terms of the weather inMaine and the weather in Florida ? in terms
? occur
of mean temperatures and average snowfall, etc. nothing that could
a brief
within temporal interval.
the on the environment I am not arguing that there are
Despite emphasis above
no individual differences in ability to exercise self-control. Like other abilities,
self-control undoubtedly through
some combination of genetic and en
develops
vironmental conditions. vs. environment is not the main issue here.
Heredity
What is at issue is whether the causes of behavior we label self-control are different
in kind from the causes of behavior we label lack of self-control. Analysis reveals
that the two causes differ in degree of temporal extent, not in their place of origin.
TECHNIQUES OF SELF-CONTROL
The kind of self-control to which we have been referring might be called "brute
force" self-control. When the temptation is offered it is simply refused. The
martini is turned down at the party, the bakery is passed without a purchase, the
dessert is etc. The direct cause of such behavior is the long-term
pushed away,
correlation between the behavior and its consequences.
An objection might be raised that the view espoused here applies well enough to
brute-force self-control but not to more sophisticated techniques of self-control
such as those developed or Alcoholics or the
by Weight Watchers, Anonymous
we are in life to our own
strategies constantly inventing everyday manipulate
behavior. Consider the following ways in which a student might get himself
to
study:
1. He studies despite the temptation to go to the
simply
movies instead.
2. He rewards himself for studying by going to the movies
afterward.
4. Yet, recently self-reinforce ment has emerged as an area of study with humans (Bandura
1971) and even animals (Mahoney and Bandura, 1972).
5. The behavior involved in eating, chewing and swallowing, for instance, can be thought of as
reinforced by the digestion of food. Restricted to such events, self-reinforcement is a valid and
interesting concept. But the more common use of the term is in the sense of example number 2
where the behavior is not consummatory.
6. Bandura and Perloff (1967) had children set their own criterion for a task (turning a crank)
and then reward themselves with tokens for reaching their own criterion. The children who set
their own criterion turned as fast as those childrenwhose criterionwas set for them (the latter
group was also given tokens instead of rewarding themselves). The interesting part of this
experiment is the setting of the criterion, which is a question of commitment (Why didn't the
children set the criterion as low as possible?), not the self-reward. Once the criterion was set
the children would have been disobeying the rules of the "game" (they were told that they
were evaluating a game) had they rewarded themselves without reaching criterion.
101
behavior more than will correlations between weak stimuli. The feedback involved
in self-reinforcement may well be more intense than the normal proprioceptive
and kinesthetic feedback of most behavior. Where this is not the case, self
reinforcement should not work.
102
I TIME I
Figure 3: Flow diagram of commitment to study. Choice at X isbetween studying immediately
and not studying. It is assumed that a student would not study at X. Choice at Y is between
having a choice later (top arm) and being forced to study later (bottom arm). A student who
would not study at X might nevertheless commit himself to study by choosing the lower arm at Y.
103
to not a
food reward (analogous studying in Figure 3) and larger food reward
to in
delayed by several seconds (analogous studying Figure 3). The pigeons in
at X. at
variably chose the small immediate reward But, Y, several seconds before
X, when they could choose to restrict subsequent alternatives, they chose
not to
a ?
have choice they chose the bottom branch of Figure 3 and obtained the larger
(but delayed) reward. The values of the delays and amounts were determined by
Herrnstein's (1970) model for choice which that preference varies
predicts
with amount and with The model further
directly inversely delay.7 predicts that
commitment will be more the the
likely greater temporal separation between the
choices at Y and X. This was also confirmed.
It is necessary to two ?
distinguish between operations the exercise of the com
mitment strategy and the invention of the strategy. While the exercise of commit
ment has to do with
nothing higher mental processes, the invention of commitment
strategies is another matter. The invention may be a higher mental process (how
ever that is
defined) and itmay be performed by the user (the student) or another
or a commitment
person (his friend his therapist) but inventing strategy is not
exercising self-control. Neither does it take ego strength, internalization, etc.
to invent a self-control strategy any more than these were necessary to
qualities
invent the cotton gin. Self-control is done by using the strategy so that one's be
havior will be in accordance with its long-term consequences. And use of the
strategy occurs once an effective is invented.
automatically strategy
To summarize, both self-reinforcement and commitment are related to self
control because they both increase the likelihood that behavior will be controlled
by its long-term consequences. Self-reinforcement makes the relation between
behavior and its consequences more vivid stimuli correlated with
by providing
those consequences. Commitment restricts choice so that behavior will automatic
ally conform to long-term consequences.
TEACHING SELF-CONTROL
we shall have little to
Unfortunately, say in this section. Most of the research
on self-control has been on the personality correlates of people who are good at
controlling themselves. The old, it seems, do it better than the young (Mischel,
the sane better than the
1958), schizophrenic (Klein, 1967), the intelligent better
than the unintelligent (Mischel and Metzner, 1962), the rich better than the poor
(Maitland, 1967), etc.
Obviously, self-control is a good to have. But
thing
environmental events which can generate self-control (i.e., shift the cause of be
havior from short-term to
long-term events) have not been systematically examined.
The to the areas:
preceding analysis would direct investigation following
104
1. Does one
practice with long-term contingencies controlling
increase the likelihood that they will control other activi
activity
ties? The notion that there are "addictive personalities" implies
that some people cannot or do not to
long-term
con
respond
in several behavioral areas. Can be to behave
tingencies they taught
in accordance with these contingencies? a per
generally Perhaps
son who has learned not to overeat will have an easier time learning
not to smoke. This implies that the way to begin in the cure of
harmful habits may be through control of other habits. For instance,
alcoholics might first be trained to keep their weight under control
or to stop
smoking. Control of eating an ice cream sundae by the
next to control of getting drunk
day's consequences might transfer
the next
by day's consequences.
2. The long-term antecedents and consequences of certain
events be isolated from those of other events by techniques
might
to make them more vivid or salient. The subject is in pretty much
the same state with respect to observation of events controlling his
behavior as the observer is. The way that we know better than
anyone else what causes our behavior is not that we have access to
our internal sources of control but we have more
simply that
behavioral data.
and timing of events with mechanical or written
Counting
aids and the techniques of self-reinforcement (and self-punishment)
are, as we have indicated before, ways to increase the salience of
the relationship between behavior and its consequences. Simply
calories has been found to be as effective in short-term
counting
as self-reward, external monetary reward, aversive
weight reduction
imagery in connection with food, and relaxation training
Wilson and 1973). The reason for
(Romanczyk, Tracey, Thorpe,
this may be that the reward for eating less is losing weight regardless
of the subsidiary rewards inserted between the two events. These
rewards do no more than the relation between
subsidiary emphasize
and a function as well
eating losing weight, performed just by
counting calories.
3. commitment strategies may be instituted. Like self
Finally,
reinforcement be in force
strategies they may kept permanently.
Behavior to is guaranteed as
according long-term contingencies
as are in force. If I habitually keep my alarm clock
long they
across the room from my bed, I will have to get out of bed every
morning to turn it off. This technique of getting myself up in the
one that can But often
morning is conveniently be used every day.
commitment involve awkward or expensive apparatus,
strategies
and because are commitments they limit choice. Ironically,
they
in the ultimate term, itmay be better to occasionally behave
long
to short-term contingencies (i.e., to act
according impulsively).
commitment does not allow such behavior and may be
Rigid
undesirable for that reason. Commitment strategies thus might
often be instituted only to bring behavior into conformity
initially
with long term consequences. Once these consequences are ex
105
REFERENCES
Ainslie, G. The learningof an op?rant to limit the subject's own future behavior. Described
in H. Rachlin, Introduction to modern behaviorism San Francisco: W. H. Freeman, 1970.
Bandura, A. Vicarious and self-reinforcement processes. In R. Glaser (Ed.), The nature of
reinforcement. New York: Academic Press, 1971. Pp. 228-278.
Bandura, A. and Perloff, B. Relative efficacy of se If-monitored and externally imposed
reinforcement systems. Journal of Personality and Social Psychology, 1967, 7, 111-116.
Baum, W.M. The correlation based law of effect. Journal of theExperimental Analysis of
Behavior, 1973,20, 137-153.
Bloomfield, T.M. Reinforcement schedules: Contingency or contiguity. In R.M. Gilbert,
and J.R. Millenson (Eds.), Reinforcement: Behavioral Analysis. New York: Academic Press,
1972. Pp. 165-208.
Bolles, R.C. Reinforcement, expectancy, and learning. Psychological Review, 1972,
79, 394-410.
Catania, A.C. Elicitation, reinforcement and stimulus control. In R. Glazer (Ed.), The nature
of reinforcement. New York: Academic Press, 1971. Pp. 196-211.
Fantino, E. Immediate reward followed by extinction vs. later reward without extinction.
Psychonomic Science, 1966, 6t 233-234.
Gamzu, E. and Schwartz, B. The maintenance of key pecking by stimulus-contingent and
response-independent food presentation. Journal of the Experimental Analysis of Behavior,
1973,79, 65-73.
Herrnstein, R.J. Method and theory in the study of avoidance. Psychological Review,
1969, 76, 46-69.
106
107