Effects of Amount and Percentage of Reinforcement and Number of Acquisition Trials On Conditioning and Extinction
Effects of Amount and Percentage of Reinforcement and Number of Acquisition Trials On Conditioning and Extinction
Effects of Amount and Percentage of Reinforcement and Number of Acquisition Trials On Conditioning and Extinction
net/publication/281862637
CITATIONS READS
70 168
1 author:
Allan R Wagner
Yale University
111 PUBLICATIONS 10,952 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Allan R Wagner on 18 September 2015.
interruptions of infrared beams located 7 in. schedule 5s were tested under approximately
and 1 in., respectively, from the end of the 22J-23 hr. food deprivation.
runway. The last beam passed just above the Acquisition.—-Half of the 5s received
front lip of a stationary, J in. deep, metal 16 and the other half 60 acquisition trials,
food cup. 1 trial per day, during which the per-
centage reinforcement and magnitude of
Procedure reward were manipulated. The sequence of
reinforcement and nonreinforcement for the
Experimental design.—The experimental partial reinforcement groups was arranged
design included two levels of three variables: as follows: H h- - + + - - + + -
percentage reinforcement (100% vs. 50%), h+H K It should be noted that
magnitude of reward (.08 gm. vs. 1.0 gm.), this sequence has the following characteristics:
and number of acquisition trials (16 vs. 60). (a) two reinforced and two nonreinforced
The design may be schematized as a 2 X 2 X 2 trials appear in each successive block of four
factorial, 16 5s, 8 males and 8 females, being trials; (b) the first and last trials are rein-
randomly assigned to each of the eight forced; (c) never more than three reinforce-
experimental groups. ments or nonreinforcements occur in a row;
Habituation.—Thirty days prior to the (d) when this 20 trial sequence is repeated
first training day 5s were placed on a 24-hr, the first order sequential probabilities are
food deprivation schedule, with 30-min. counterbalanced, i.e., reinforcement equally
access each day to an ample supply of wet as often follows a reinforcement as it does
mash prepared from ground Wayne Lab Blox. a nonreinforcement.
This maintenance schedule was employed The reward pellets were pressed from wet
throughout the course of the experiment, mash prepared immediately preceding the
while water was continuously available except running of each squad of 5s. Two pellet-
during the experimental sessions. makers were used which were designed to
On the 2 days prior to experimental form pellets of .08 gm. and 1.0 gm. dry weight,
training 5s were allowed to explore the run- when the mash was prepared by mixing .5 ml.
way in groups of three for S-min. periods. distilled water with each gram of ground
After the exploration on each of these days Wayne Lab Blox.
5s were placed in individual grey goalboxes Extinction.—Extinction Trial 0 was ad-
and allowed to eat a number of reward pellets ministered to each group the day following
from a food cup identical to that used in the its last acquisition trial. Extinction Trials
runway. 1 to 32 were then run on consecutive days.
Experimental training.—A training trial On each extinction trial 5 remained in the
was initiated with the introduction of 5 nonreinforced goalbox for 20 sec.
into the entry box. When 5 had entered the
narrow startbox the retrace door was lowered RESULTS
and 3 sec. later the start door was raised.
(The 2-in. width of the startbox discouraged Acquisition
5 from turning so that all 5s remained
oriented toward the start door during the Mean starting, running, and goal-
3-sec. interval.) When 5 had entered the box speeds over blocks of four acquisi-
goalbox the retrace door was closed and 5 tion trials are plotted in Fig. 1 for the
was removed 20 sec. later on nonreinforced treatment groups receiving the four
trials or immediately after eating on reinforced
trials. combinations of percentage reinforce-
The 5s were tested in squads of 8, one 5 ment and magnitude of reward.
from each of the experimental groups. Eight Measures from all ,Ss, i.e., 16- and 60-
such squads of males were tested first on each trial groups combined, are included
experimental day followed by eight squads in the curves over the first four blocks
of females. The 5s were tested in the same
sequence in every experimental session, but of acquisition trials, whereas the
the order of testing was systematically varied subsequent blocks of trials represent
among the squads so that equal numbers of means from only those 5s in the 60-
5s from each group were assigned to each trial groups. Over the first 16 trials,
of the squad positions. Following the testing
of all 8 5s in a squad, they were returned to
in all three response measures, large
their home cages, and 30 min. later 5s were reward produced faster speeds than
given their daily feeding. According to this did small reward, while continuous
236 ALLAN R. WAGNER
STARTING
• • 100% - l.Og
. . so % - i.og
o o 100% -.08g
o o 50o/0
..08g
RUNNING
1.4 r
1.2
1.0
.8
.6
GOAL BOX
,4
4 5 6 7 8 9 10 II I2 13 14 IS
BLOCKS OF FOUR ACQUISITION TRIALS
FIG. 1. Mean acquisition speeds for the treatment groups differing in magnitude of reward
and percentage reinforcement. (The vertical line marks the point at which training is ter-
minated for half the 5s in each group.)
reinforcement produced faster speeds design was computed for the means
than did partial reinforcement. over Trials 1 to 16 for each of the
In order to evaluate the reliability three response measures. Since half
of these observations, as well as the of the 5s in each of the groups were
equivalence of the 16- and 60-trial male and half female, sex was also
acquisition groups, a separate analysis included in these and all subsequent
of variance appropriate for a factorial analyses as a "control" variable.
CONDITIONING AND EXTINCTION 237
The results of these analyses showed that: (a) the effect of magnitude of
that: (a) magnitude of reward was reward attained significance in both
significant beyond the .005 level in the starting and running measure
the starting, running, and goalbox (F = 6.05, P < .025, and F = 9.53,
measures (F = 26.67, F = 23.74, and P < .005, respectively; df = 1/56)
F = 8.20, respectively; df = 1/112); but is associated with a probability
(V) percentage reinforcement was between .10 and .20 in the goalbox
highly significant in the goalbox measure (F = 2.67, df = 1/56); (&)
measure (F = 48.35, df = 1/112, 50% reinforcement led to significantly
P < .001), reached significance in the higher performance levels than did
running measure (7*'=4.05, df= 1/112, 100% reinforcement on both the start-
P < .05), but failed to approach ing and running measure (F = 4.03,
significance in the starting measure P < .05, and F = 5.03, P < .025,
(F < 1); (c) although the starting respectively; rf/=l/56), whereas 50%
and running speed curves suggest reinforcement led to a significantly
an interaction between magnitude of lower performance level than did
reward and percentage reinforcement, 100% reinforcement on the goal-
this tendency was not statistically box measure (F = 8.01, df = 1/56,
reliable in anyfof the response meas- P < .01); and (c) in none of the
ures; and (d) there were no reliable three response measures was there a
differences between the experimental statistically reliable interaction of
groups receiving only these 16 acquisi- percentage reinforcement and magni-
tion trials and those which subse- tude of reward.
quently received 44 additional trials.
With reference again to Fig. 1, it is Extinction
apparent on all three response meas- Since the several experimental
ures that each of the large reward groups began extinction at markedly
groups maintained its advantage over different levels, a comparison of the
the corresponding small reward group obtained extinction speeds appeared
throughout the 60 acquisition trials. to offer only minimal information
Likewise, in the case of the goalbox about the rate of extinction. A
measure the 100% reinforcement preferable index appeared to be ex-
groups maintained their advantage tinction speed expressed as a propor-
over the 50% groups. However, tion of the corresponding terminal
on both the starting and running acquisition speed. Consequently each
measures the performance of each of response speed for each S over Extinc-
the 50% groups may be seen to sur- tion Trials 1-32 was expressed as a
pass that of the corresponding 100% proportion of the mean speed 5 had
group by the end of training. attained on that response measure
In order to evaluate statistically over the last four acquisition trials
the asymptotic performance levels and Extinction Trial 0.
attained under the various experi- Figure 2 presents the mean starting,
mental treatments received by the running, and goalbox proportions over
60-trial 5s, a separate analysis of blocks of four extinction trials for
variance appropriate for a factorial the eight experimental groups. Of
design was computed for the means major concern is the comparison of
over the last 8 acquisition days the resistance to extinction of the 50%
on each of the response measures. and 100% groups following the vari-
The results of these analyses showed ous acquisition conditions. In all
238 ALLAN R. WAGNER
t.OG REWARD
.10
.00
.90
0 .80
.70
K
IO ._. 100% "60 V.
.90 . o- -o 50% ' 16 N a _-
100%-16
.40
I.IO
1.00
.90
<9
Z .80
|.TO
(t .60
.SO
.40 Jr
1.00 •--•
.90
.80
g.70
01
.60
*.»
O
19 .40
.30
.20 i
R e f 1 2 3 4 9 6 7 8 R«f 1 2 3 4 9 6 7 8
BLOCKS OF FOUR EXTINCTION TRIALS
chain that was observed. When the response BEIER, E. M. Effects of trial-to-trial varia-
measure was taken over the early segments tion in magnitude of reward upon an
(first and second 6 in.) of the 5-ft. alley, there instrumental running response. Unpub-
was observed an initial superiority of the lished doctoral dissertation, Yale Univer-
100% 5s but an asymptotic superiority of the sity, 1958.
50% 5s. When the response measure was GOODRICH, K. P. Performance in different
taken over the final 6 in. preceding the goal segments of an instrumental response chain
cup the superiority of the 100% 5s persisted as a function of reinforcement schedule.
over the entire course of acquisition. Large /. exp. Psychol, 1959, 57, 57-63,
as compared to small rewards, in addition HAGGARD, D. F. Acquisition and extinction
to producing higher overall response speeds, of a simple running response as a function
also tended to produce a greater early trials of partial and continuous schedules of rein-
50% decrement and a greater asymptotic forcement. Unpublished doctoral disserta-
50% superiority, although no statistical tion, State University of Iowa, 1956.
support for the latter two tendencies was HULSE, S. H. Schedule of reinforcement,
obtained. amount of reinforcement, and duration of
Of primary interest during extinction were goal confinement as variables in condi-
the effects of size of reward and number of tioning and extinction. Unpublished doc-
acquisition trials on the magnitude of the toral dissertation, Brown University, 1957.
commonly obtained superiority of partially HULSE, S. H. Amount and percentage of
reinforced as compared to continuously rein- reinforcement and duration of goal con-
forced 5s. The extinction results showed finement in conditioning and extinction.
that whereas the "partial reinforcement /. exp. Psychol., 1958, 56, 48-57.
effect" did not vary with number of prior KOEHLER, J., JR. Acquisition and extinction
acquisition trials, it was markedly greater of a running response as a function of the
following 1.0-gm. than following .08-gm. percentage of reinforcement and the num-
rewards. The increased partial reinforcement ber of acquisition trials. Unpublished
effect with larger rewards reflected not only doctoral dissertation, Tulane University,
greater resistance to extinction of partially 1956.
reinforced 5s but also less resistance to ex- LOGAN, F. A. Incentive. New Haven: Yale
tinction of continuously reinforced 5s with Univer. Press, 1960.
large as compared to small rewards.. SPENCE, K. W. Behavior theory and learning:
The acquisition and extinction results Selected papers. Englewood Cliffs, N. J.:
were considered in relation to frustration Prentice-Hall, 1960.
and incentive motivation theory. WEINSTOCK, M. B. A factorial study of some
variables affecting resistance to extinction
REFERENCES under partial reinforcement with spaced
trials. Unpublished doctoral dissertation,
AMSEL, A. The role of frustrative nonreward Indiana University, 1957.
in noncontinuous reward situations. Psy-
chol. Bull, 1958,55, 102-119. (Received June 11, 1960)