LOGAN: BASIC LAWS OF LEARNING 7/1/2000 OPERANT CONDITIONING: Excitation Interdependent Current Contingency Variables Contents Paradigmatic/Natural/Asocial/Emotionally Positive Effect Principle OC-1:00. Operant Conditioning OB****aaa Law OC-1:10. Fixed Interval (FI) Sched(Reinf) OB****aac OC-1:11. Cued Fixed Interval OB****aad OC-1:12. S-effects in Fixed Interval OB****aae OC-1:13. BO/TO-effects in Fixed Interval OB****aaf OC-1:14. PRF in Fixed Interval OB****aag OC-1:15. Modified Fixed Interval OB****aah Systematic Analyses of Fixed Interval Schedules of Reinforcement OB****aai Law OC-1:20. Variable Interval (VI) Sched(Reinf) OB****aam Systematic Analyses of Variable Interval Sched(Reinf) OB****aao Law OC-1:30. Fixed Ratio (FR) Sched(Reinf) OB****aar Systematic Analyses of Fixed Ratio Schedules of Reinforcement OB****aat Law OC-1:40. Variable Ratio (VR) Sched(Reinf) OB****aav Systematic Analyses of Variable Ratio Schedules of Reinforcement OB****aax Systematic Analyses of Operant Conditioning OB****aaZ OC-2:00. Control Procedures for Opcond OB****acc OC-3:00. Miscellaneous Opcond Phenomena OB****axa Miscellaneous Analyses of Operant Conditioning OB****axz OC-4:00. Mixed Schedules of Reinforcement OB****asm OC-5:00. Chain Schedules of Reinforcement OB****asc OC-6:00. Tandem Schedules of Reinforcement OB****ast OC-7:00. Discriminated Operant OB****asd Law OC-8:00. Rate(OpR) as-f N/reinf OB****ana OC-8:01. Effect of extended trng on Rate(OpR) OB****ann OC-8:10. Within-session effects OB****anw Systematic Analyses of Acquisition Function OB****anz OC-9:00, S order in Opcond OB****aiB Paradiamtic/Natural/Asocial/Emotionally Negative Effect OC-10:00. Effect of Punishment in Opcond OB****cap OC-10:10. Punishment Intensity OB****clp OC-10:20. Delay of Punishment OB****cjp Systematic Analyses of Punishment in Operant Conditioning OB****czp Paradigmatic/Natural/Asocial/Emotionally Positive Effect Principle OC-12:00. Unconscious Opcond OB****aVo Systematic Analyses of Awareness in Operant Conditioning OB****aVz OS-2:00. Nature of the Reinforcement in Opcond OB****aau OS-2:10. Relative effectiveness of Reinforcers OB****aaw OS-2:20. Opcond w/ESB reinf OB****aNc OS-2:30. Reinforcement w/lite-on/off OB****aCl Systematic Analyses of Reinforcement in OpCond OB****aaz Principle OC-1:00. Operant Conditioning OB****aaa . Reinf conting w/freely available R-->Incr Rate(OpR) . Term: Positive Reinforcement . Note: Reinf not nec =f(OpR) . Issue: Identify reinforcer independent of reinf function XULX Operant: Beh emitted spontaneously w/out detected S (21) - Ski,BF'38- Opcond: Incr strength of operant if follow by reinf (21) Meas strength of operant re freq (rate) of occurrence (21) Dynamic prop of operant beh may be studied w/single R (46) Record cumulative freq(OpR) w/slope proportnal to rate (59) One reinf of (spon) OpR raises strength to max value (69) AXXH Describe shaping proc w/cond reinf assoc w/food - - - - - - Ski,BF'51- PVPH Acq OpR w/nonconting food after momentary key S - - - - - - Bro,PL'68+ PIP- R/rate lower w/R-independent reinf than R-dependent reinf - Zei,MD'68- R pattern w/R-independent reinf sim to reinf sched Law OC-1:10. Fixed Interval (FI) Sched(Reinf) OB****aac . Reinf next OpR after fixed interval of time after last reinf . Rate(OpR) w/FI sched =incr-f(time since reinf, length FI) . Term: Post-reinf pause, FI scallop RXP- Rate(OpR) decr-f length of FI (120) - - - - - - - - - - - - Ski,BF'38- W/FI, decr in Rate(OpR) after reinf, followed by incr (125) R P- Rate OpR decr-f(1/6-6 min FI) - - - - - - - - - - - - - - - Wil,MP'54- PUP- Wide range of curvatures in cum-rec of FI w/in-O (163) Fer,CB'57+ Often observe knee (R-bursts) in cum-rec early in FI (164) PUP- R/rate sometimes decr immed prior to reinf on FI Cum,WW'58+ RIR- Postreinf pause then neg accel R/rate on FI in wheel - - - Ski,BF'58+ PCPH Def interval sched re T(cycle duration) + P(Reinf 1st R) - Far,J.'63- Re above, FI is P =1.0; random interval if P < 1.0 Rate(OpR) decr-f(T/P) RIB- Incr R/rate early in FI rel to later in FI after 24 days - Gle,H.'63+ HIK- Long pause then steady R/rate on FI 100-sec LH 10-sec - - - Lat,VG'63+ Concur arith task disrupts temporal control variously Lat,VG'63+ PIK- Little diff in beh w/RI (geometric) and VI (arithmetic) - - Mil,JR'63- HIK- R/rate on FI-10 sec hi if prior FR and lo if prior DRL - - Wei,H.'64- PIK- Obtain 3-min FI scallop w/lite S w/in 18-min FI w/food - - DLo,J.'67- HIK- Not all O show postreinf pause and low R/rate on FI - - - - Wei,H.'69- R/rate on FI lower if subtract points for each R R/rate on FI lower if prior DRL history PUP- Very wide variation in number of R/interval in FI w/in S Dew,PB'70- PIP- Median IRT decr w/N/R made w/in interval on FI - - - - - - Shu,RL'70+ Median IRT decr w/time since reinf w/in interval on FI Median IRT constant after 6 R regardless of time in FI PIK- Postreinf pause incr-f duration of reinf on FI, w/in S - - Sta,JE'70- Running rate decr-f duration of reinf on FI, w/in S PIK- Vary position of FI on 1 of 3 color keys--R to reinf color Zei,MD'70- R-indep change position reinf color w/in interval decr rate R-dep change position reinf color w/in interval--FI chain MIU- Record accel in R/rate in indiv intervals of FI 1000-sec - Dew,PB'78- PUPH W/30-1000-sec FI, Rate(bar > treadle OpR) w/sim pattern - - Ric,WK'79+ OC-1:11. Cued Fixed Interval OB****aad PUP- Long pause, rapid change to hi rate w/clock in FI (269) Fer,CB'57+ Reverse external clock on FI, reverse scallop (277) MUP- Visual/auditory clock on FI--lo rate, often 1 R/interval - Fer,CB'63+ Above lo rate obtains even w/LH PIK- Add clock in FI 90-sec, reverse scallop if reverse clock - Cap,HJ'73e PIK- Lat(R) to keylite-on decr-f time since reinf on FI - - - - Hie,RD'74+ RUPH Rate(OpR) w/VI sched decr w/brief cue B4 reward - - - - - - Rob,JE'85e Above not attrib to sign-tracking (inspect site of cue) RVPH Lite signal re reinf incr Rate(OpR) w/VR, decr w/VI sched - Sch,TR'90+ OC-1:12. S-effects in Fixed Interval OB****aae PUP- Change S on FI eliminates or reverses scallop (319) Fer,CB'57+ PUP- Alt HL/no-HL in 500-sec FI, see scallop in reinf HL times - Dew,PB'62- RCPH Present probe S early in FI -->disinhib of OpR - - - - - - Fla,B.'64+ MLPH Maint FI scallop w/mult S- period during FI - - - - - - - - Dew,PB'65- PUP- FI scallop persist w/1-5 long S-delta periods in long FI - Dew,PB'65- PUP- HL-off at reinf on FI, rate w/HL-off =f(postreinf time) - - Dew,PB'66- PUP- Probe w/KL-on in FI--R/rate =f(time of probe from reinf) - Dew,PB'66- Above effect obtains if sometimes omit reinf, but HL-on RI - Novel buzz during FI disrupts scallop beh - - - - - - - - - Sin,D.'68+ RIB- Novel auditory S decr P(R) at all segments of FI - - - - - Wol,AH'69+ PUP- Scallop even if suppress resp w/S-delta periods in FI - - - Dew,PB'70- RUPH Free reinforcer during interval starts a new FI scallop - - Log,FA'70+ PIP- Postreinf pause on FI not affected by free food in pause - Shu,RL'76+ OC-1:13. BO/TO-effects in Fixed Interval OB****aaf PIP- 30-sec postreinf B-out in 90-sec FI decr pause from lite-on Fer,CB'54- 5-min postreinf B-out in 45-min FI incr pause from lite-on PUP- Carry-over effects in FI decr by postreinf TO (193) - - - - Fer,CB'57+ Postreinf TO on short FI eliminates pause/scallop (222) Postreinf TO on long FI stabliizes pause/scallop (222) PUP- KL-off if R in 4-sec trials of FI--P(R)=f(postreinf time) - Sch,BA'72+ Above function shows abrupt transition to hi P(R) PIK- Maintain FI scallop if B-out between intervals Zei,MD'72- OC-1:14. PRF in Fixed Interval OB****aag PUP- W/PRF (food or S) on FI sched, S functions as reinf - - - - Chu,SH'67+ PIP- Mix(reinf,B-out) in FI produces scallop after each - - - - Neu,AJ'67+ XIX- Mix(food,B-out) on FI--short pause/hi rate post B-out - - - Sta,JE'69+ Above post B-out pause shorter the longer the B-out PIK- Mix(reinf+TO) on VI, post-TO pause longer than postreinf - MMi,JC'71- PIK- Mix(S,reinf) on FI--Post-S rate decr-f sim to reinf - - - - Kel,JE'72- PIK- Mix(reinf,T-out) on FI--R/rate incr-f percent reinf - - - - Zei,MD'72- PIK- Mix(reinf,B-out) on FI, pause shorter after B-out - - - - - Sta,BC'74+ RI - Mix(food,tone) on FI, then postreinf pause incr-f amt/reinf Dav,GC'75e Mix(food,tone) on FI, then post-S pause incr-f S inten OC-1:15. Modified Fixed Interval OB****aah PUPH Mod pattern, decr Rate(OpR) if add min FR to FI sched - - - Her,RJ'58+ XIB- Lat(R) of OpR1 to initiate FI not-f FI interval for OpR2 - Mec,F.'63e RIB- OpR/rate decr-f post-FI DRL requirement - - - - - - - - - - Far,J.'64+ Postreinf pause incr-f post-FI DRL requirement Temporal discrim better postreinf than post-resp RUPH Rate(OpR) w/FI sched > w/1 R-->reinf at end of interval - - Mor,MJ'70- PIP- If initiate FI w/1 R, postreinf pause to that R incr-f FI - Shu,RL'70- Hi steady R/rate in FI component of above sched PIP- Require only 1 R in FI produces pause-resp-pause-reinf - - Shu,RL'70- Postreinf pause in above sched incr-f FI duration Above effects same whether or not R changes key color PIP- Higher rate w/FI than if only require 1 R in interval - - - Shu,RL'71- PIP- Make short FR equal 1 R on FI produces bursts of R Shu,RL'72e RUPH Add tandem FR to FI sched incr Rate(OpR) if lo base rate - Bic,WK'88e Systematic Analyses of Fixed Interval Schedules of Reinforcement OB****aai UIU- Average postreinf pause incr-f FI value - - - - - - - - - - She,JG'59- XIX- Meas FI curvature by area under cum-rec - - - - - - - - - - Fry,W.'60e XIX- Derives VI sched w/P(reinf) not-f time since reinf - - - - Fle,M.'62+ PIK- Approx linear incr in N/R/quarter of FI - - - - - - - - - - Seg,EF'62- Scallop on FI greatly enhanced by clock changes in lite S XIB- P(R) incr during FI, w/discontinuous change after 1st R Mec,F.'63e XIX- Hi correl quarter-life + curvature meas of FI perf - - - - Gol,LR'64- Lo correl R/rate + either meas of temporal discrim Meas of temp-discrim sim if average over sessions/intervals RI - P(IRT) on FI is-f(P(reinf)) of that IRT - - - - - - - - - - Wil,DR'68- PUP- Last IRT on FI 180-sec longer than preceding 2 IRTs - - - - Dew,PB'69- FI scallop remain even if remove diff-reinf of long IRT PUP- Postreinf pause equivalent to extn w/lo, steady R/rate - - Sch,BA'69- Running rate equivalent to VI w/hi, steady R/rate Rapid shift from pause-state to R-state 2/3rds thru FI PUP R/rate early in FI same rel to terminal rate for diff FI Dew,PB'70- RIB- Postreinf pause =f(FI length), R/rate =f(reinf IRT) - - - - Els,TF'71- PIP- Average postreinf pause 1/2 duration of FI - - - - - - - - Shu,RL'71- PIP- Postreinf pause incr-f FI length - - - - - - - - - - - - - Shu,RL'72e RIB- Lo correl between postreinf pause + running rate on FI - - Duk,TD'73+ PIK- Rel Freq(IRT) incr-f rel Freq(reinf) of that IRT on VI - - Shi,CP'73- PIP- P of ending postreinf pause incr-f rel time into FI - - - - Shu,RL'75+ PIK- Terminal R/rate faster the later in FI 1st R occurs - - - - Sta,JE'75+ Law OC-1:20. Variable Interval (VI) Sched(Reinf) OB****aam . Reinf next OpR after variable interval of time after last reinf . Rate(OpR) w/VI sched incr-f(length VI), not-f(time) RIB- R/rate incr-f Freq(reinf) on VI w/pacing IRT=8-10 sec - - - Rev,SH'63- PIK- Rate(OpR) incr-f reinf-rate on VI - - - - - - - - - - - - - Cat,AC'68+ PIK- Require R on 2 keys--Same overall perf on VI as 1 key - - - Cat,AC'71- PIK- R/rate diff at 3-min and 30-sec VI w/undeprived O - - - - - Bil,JL'73e Systematic Analyses of Variable Interval Sched(Reinf) OB****aao PPK- VI perf independent of concur sched for another R - - - - - Cat,AC'62- RIB- Successive IRT on VI constant and independent - - - - - - - Kin,W.'65- PIK- P(OpR) w/in VI interval incr-f P(reinf) at that time Cat,AC'68+ PUPH Perf w/VI/VR singly sim to perf when part of mult sched - - Pow,RW'80- Law OC-1:30. Fixed Ratio (FR) Sched(Reinf) OB****aar . Reinf next OpR after fixed N/OpR . Rate(OpR) w/FR sched not-f(length FR), w/post-reinf pause incr-f(FR) UPH Self-imposed TO (extn) incr-f(FR), typically at start of FR Azr,NH'61- RRB- FR-2 produced steady OpR/rate w/2-3-sec modal IRT - - - - - Bee,RS'67+ RUPH Interrupt FR w/TO-->N/OpR post-TO incr-f(location w/in FR) Joh,DM'73+ PUPH W/FR30 + min time limit, FR time incr-f(required duration) DCa,AJ'74+ Re above, complete FR too soon w/long limit, unless add cue xUPH W/rat/pigeon, post-reinf pause incr-power-f(FR) - - - - - - Meu,GF'79e RUCT N/dry-lick OpR decr-f(FR), w/incr in N/licks at H2O reinf - All,J.'92+ Systematic Analyses of Fixed Ratio Schedules of Reinforcement OB****aat PCPH Post-reinf pause in OpR incr-f(FR) - - - - - - - - - - - - Fel,M.'66+ RUPH Post-reinf pause incr-f(FR), Rate(OpR) decr-f(FR) - - - - - Pow,RW'70- PUPH Shorter pause, lower Rate(OpR) w/FR when part of mult sched Pow,RW'80- RCPO Interaction of inten(heat reinf) and FR sched - - - - - - - Vit,WF'87e Law OC-1:40. Variable Ratio (VR) Sched(Reinf) OB****aav . Reinf next OpR after variable N/OpR . Rate(OpR) w/VR sched not-f(length VR), w/post-reinf pause incr-f(VR) RCPH Rate(OpR) w/sucrose reinf > glucose w/= concen - - - - - - Gut,N.'54- MNPO Acq DRL-20 sec w/sugar, not w/ESB reinf - - - - - - - - - - Bra,JV'58- PSPH Pref OpR1-->food > OpR2-->food + exposure to conspecific - Den,R.'78- MSPx Rate(OpR) w/female is-f(male O reinf) re Amt(grooming) - - Mic,RP'78e Rate(OpR) w/some female is-f(male O reinf) re N/ejaculation PVPH W/VR sched, post-reinf pause is-f(ratio size and Amt(Reinf) Bla,E.'88+ Systematic Analyses of Variable Ratio Schedules of Reinforcement OB****aax XXXX Math linear th of VR sched re mean ratio, Rate(Reinf) - - - MDo,JJ'88+ Systematic Analyses of Operant Conditioning OB****aaZ XfX- Chaining: Propriocep/exterocep R-prod S for another R (32) Ski,BF'38- Operant is chain w/R-produced discrim S--Not an 'act' (55) xUPH Anal of aversive prop of TO from pos reinf w/chimp/pigeon - Fer,CB'58- UIU- Rate/topography of R is-f(IRT, R at time of reinf) She,JG'59- RUPH Distrib or IRTs adjusts to sched of diff reinf of IRT - - - Mal,RW'64+ Peakedness of above IRT distrib incr-f(width of reinf IRT) Peakedness of above IRT distrib decr-f(lower bound) XXX- W/FI food sched, 'thinking' of food leads to OpR/salivation She,FD'72- R1xH Favor S set occasion for R-outcome vs S-R or S-outcome lrng Col,RM'90+ Above via diffcond w/R-conting vs indep reinf FAL: Note sim to Tolman's (1938) construct OBO-->expectancy OC-2:00. Control Procedures for Opcond OB****acc . Genz: Any control procedure may produce some change in Rate(OpR) xAOx Cat/rat make OrR re food/H2O, not re shock - - - - - - - - Buz,G.'79e Above OrR-->goal-directed antic beh Interp AuSh/sign-tracking re cond OrR OC-3:00. Miscellaneous Opcond Phenomena OB****axa RNPH No acq if OpR "terminate trial" w/conting ECS - - - - - - - Hav,EJ'58- PIP- Altern extn w/reinf 1 R in LH--R/rate decr-f length of LH - Hea,E.'58- Beh resembles FI w/long LH Beh resembles FR w/short LH PIP- R/rate decr-f propor total time w/intervals that reinf 1 R Cla,R.'59- RARx Interrupt OpR1 w/ESB reinf w/cue for food on OpR2 - - - - - Bee,B.'60+ RSPH W/bar distant from food, paired O maint reciprocal reinf - Bar,A.'61+ Above beh is-f solitary pre-trng, social factors in sit PUP- Reinf 1 R in 30-min cycle--Postreinf bursts w/long LH - - - Cum,WW'61+ RCPH W/progressive ratio, breaking pt, not Rate(OpR) correl w/wt Gil,R.'67- PIK- Fail to learn reg sequence of FI values w/in session - - - Sta,JE'67- PVPH Pause B4 FR100 w/MultFR10-FR100, B4 FR10 w/ChainFR10-FR100 Cro,EK'68- Attrib above to rel rate of reinf in 2 components PCPH Emit OpR2 that resets progressive ratio sched re OpR1 - - - Dar,JF'68- Decr OpR2 w/pun OpR2 that resets progressive ratio re OpR2 PSOH Observe attack-other-pigeon during post-reinf pause on FR - Gen,WD'68- RCPH P(reset progressive ratio) incr-f(size of progressive sched Hur,HM'68+ PUPH Rate(OpR) w/VI incr-f(duration of BO B4 start VI) - - - - - Tau,SE'70+ RIU- Make reinf available every 3 min produce same beh as FI - - Sna,AG'71e PVPH Patterning (FI scallop) in 2nd-order sched - - - - - - - - Coh,SL'73e Above patterning incr-f(.5/2/8-sec post-FI S duration) RUPx Perf on FI-3 min food sched decr w/ARo sessions B4Abrupt term of OpR after priming run Wei,A.'60- PVPH W/Mix(DRL/VI w/matched interreinf times) Rate(OpR) w/DRL flatter FI scallop - - - - - Han,HM'62e RxPH W/chain FR4 on 2 bars, Bar2 rate after Bar 1 nonreinf>reinf Hug,LF'73+ Above FE was incr in Rate(OpR) vs nonreinf control OC-6:00. Tandem Schedules of Reinforcement OB****ast OC-7:00. Discriminated Operant OB****asd PxPH Striatal shock > lite as cue to peck key S for food - - - - Tow,AL'56- RNPH Cortical stim not a good S for OpR, interferes w/lrng - - - Bur,NM'58+ R1PH After trng w/tone S for OpR, no control by added lite S - - Sch,CW'85+ PxPH Estab discrim operant w/cue = offset of 4-sec Ss - - - - - She,R.'88+ R1PT After independent discrim OpR re T/L, rate incr w/compound Wei,SJ'88e Acq independent discrim OpR re dep w/T=food and L=H2O After above, Rate(OpR) incr w/T-L compound PLPH 30-retention of correct location w/9-key display - - - - - Wil,DM'89+ R1PH After diffcond OpR w/TL compound S+, OpR w/L > w/T alone - Wei,SJ'93e After diffcond OpR w/TL compound S-, OpR w/T > w/L alone Law OC-8:00. Rate(OpR) as-f N/reinf OB****ana PUP- Requires 41-60 days to reach stability on temporal sched - Cum,WW'60+ OC-8:01. Effect of extended trng on Rate(OpR) OB****ann . Term: Extended trng is beyond point of steady-state OpR PUP- Long pause then hi steady rate w/extended trng on FI - - - Cum,WW'58+ OC-8:10. Within-session effects OB****anw PUP- In FI--lo N/resp in 1 interval followed by hi rate (159) - Fer,CB'57+ PUP- Number of R/interval cyclical over a session on FI Dew,PB'70- PIP- Tend to alternate short/long postreinf pauses in session Shu,RL'71- Above alternation related to duration of work period Shu,RL'71- RUPH W/in session decr Rate(OpR) w/VI only if feed immed after - Bac,AV'76- Systematic Analyses of Acquisition Function OB****anz RUPH Interactive sched: Ratio/interval on single contin dimensn Ber,LH'88- W/above sched, Rate(OpR) not match P(Reinf) nor max reinf Ber,LH'88- OC-9:00, S order in Opcond OB****aiB OC-10:00. Effect of Punishment in Opcond OB****cap ROPH Compensatory recovery from punish during extn of OpR - - - Est,WK'44- RAP- Suppression of OpR w/punish < w/CER trng - - - - - - - - - Hun,HF'55+ PUPH Effectiveness of punish decr w/in and between sessions - - Azr,NH'60- MUPS Rate(OpR) w/food reinf persistent decr after severe punish App,JB'61- PUPH Punish decr Rate(OpR) w/FI food reinf, but scallop persist Azr,NH'61+ SUP- Pre-shocks decr Rate(nonreinf OpR), incr Rate(shocked OpR) Bar,A.'61+ FCPH Rate(OpR) w/VI reinf decr w/shock pun in goldfish - - - - - Gel,I.'63- PCPS Effect of pun 1 R in FR depends on which R is punished - - Dar,JF'64+ Eg: Pun 1st R-->incr pause; pun middle-R-->lo rate B4 sh PUPS Acq ER to remove punish conting, incr-f(inten punish) - - - Azr,NH'65e Above ER even w/weak punish that-->little suppressn of OpR Above ER even w/decr in Freq(Reinf) w/out punish PCPH Rate(OpR) w/VI food decr w/R-conting S indep paired w/shock Hak,DF'65+ PUPS Rate(OpR) decr B4 timing of shock punish w/in FR - - - - - Arm,D.'66- RVPH OpR w/FR reinf suppressed w/contin pun > pun 1st R - - - - DAr,D.'66- RVPH W/pun 1 OpR in FR, suppress re 1st/mid/last location of pun DAr,D.'66- RCPT Decr in Rate(OpR) w/pun decr-f(Amt(Reinf)) - - - - - - - - Fer,DP'66- RCPH Hi VI-sched shock suppress Rate(OpR) on indep VI food sched Fil,Y.'66+ HCPO R-suppression w/shock B4 reward < during/after reward - - - Har,RD'66- RUPH Incr peak of IRTs w/DRL by punish short IRT + LH on reinf - Bru,A.'67- RUPH Suppression OpR w/conting >nonconting punish, decr-f(delay) Cam,DS'67e SOR1 N/punished R w/fearful < nonfearful strain after reinf trng Car,AB'67- RUPH Amt decr in Rate(OpR) w/punish decr-f rate pos reinf - - - Chu,RM'67+ RCPT Decr in Rate(OpR) incr-f(Freq(pun)) - - - - - - - - - - - - Fer,DP'67- RUPS W/FR80 food-reinf OpR, suppression if punish 40th > 80th R App,JB'68- RUPH TO after every 3rd OpR decr Rate(OpR), decr total reinf - - Bar,A.'69+ RUPH Pre-expose to pun incr/decr effect; re R acq during expose Chu,RM'69- Suppression w/punish decr by discrim S B4 punish W/R chain, decr R B4 punished R, max at 1st R RUPH W/equal VI on 2 bars, pref bar w/out TO conting on OpR - - Car,JG'70+ RAPH After pun OpR w/click-sh, conting click decr OpR w/out sh - Dav,RS'70- PURH Some O obtain TO B4 occur of shock on 25th OpR w/FR 50 - - Ric,RW'70+ OC-10:10. Punishment Intensity OB****clp RUPS Suppression food-reinf OpR exponential incr-f punish inten App,JB'63- RNPH Rate(OpR) w/VI reinf decr-f(inten R-conting thalamic ESB) - Gau,FP'66+ RUPH Suppression OpR w/VI reinf incr-f(inten/duration punish) - Chu,RM'67e MCPH Rate(OpR) w/VI food decr-f(pun inten) - - - - - - - - - - - Hak,DF'67e RUPS Amt/persist suppress food-reinf OpR incr-f(pun inten/freq) App,JB'68- RUPH R suppression incr-f(punish inten) - - - - - - - - - - - - Chu,RM'69- OC-10:20. Delay of Punishment OB****cjp PSPH Immed>delay pun, w/decr Rate(Op) pattern w/FI, uniform w/VI Azr,NH'56- RUPH Rate(OpR) suppression w/VI punish > FI punish - - - - - - - Cam,DS'66e RUPH R suppression decr-f(punish delay) - - - - - - - - - - - - Chu,RM'69- RSA- R-contingent shock > noncontingent, w/delay-of-pun gradient Bar,JC'72- Systematic Analyses of Punishment in Operant Conditioning OB****czp ROPHA Attrib punish to fear cond to context + competing escape R Est,WK'44- Principle OC-12:00. Unconscious Opcond OB****aVo . Opcond in humans does not require awareness . Term: Awareness is verbal report of R-reinf contingency . Note: Principle does not deny possible roles of cog-proc HCxO Opcond various motor R w/reinf = designated S - - - - - - - Ver,WS'56- Above show sched effects, diff-cond, extn sim to animals Note: Above beh sim w/w/out "awareness" HLL- In cond verbal OpR, most O can report reinf and reinf R - - Wil,WC'56+ HLL- Signif experimenter diff in verbal cond w/out awareness - - Bin,A.'57e HLL- Cond pos self-accept R on test w/out aware w/"good" reinf - Nut,AM'57- HLL- Incr Rate(noun OpR) only when and if verbalize contingency DNi,LD'64- HfL- At hi rate, correct errors during shadowing w/out awareness Lac,JR'80- Systematic Analyses of Awareness in Operant Conditioning OB****aVz HULU Reviews pos evidence of verbal cond - - - - - - - - - - - - Kra,L.'58- HCPO Post-reinf pause w/FI only if can verbalize temporal sched Har,P.'78e OS-2:00. Nature of the Reinforcement in Opcond OB****aau MVPO Visual explor reinf is-f(scene) eg another monkey > train - But,RA'54- RWP- Rats learn OpR to enable running in wheel - - - - - - - - - Kag,J.'54+ MVPO OpR sustained for 4-hr of 10-hr day w/visual explor motiv - But,RA'55+ SAOO Maint platform depression w/reinf = intense noise off - - - Bar,GW'57+ MVPO Rate(OpR) w/reinf=visual explor incr-f(dep of visual stim) But,RA'57- MxOO Maint OpR w/reinf = see monkey > empty cage > dog - - - - - But,RA'58- Maint OpR w/reinf = hear monkeys feeding > noise > barking RTPO Maint OpR w/reinf = heat, esp if live in cold environ - - - Car,PL'58+ RVPO Acq OpR1 vs OpR2, w/reversal w/reinf = lite-on - - - - - - For,DG'59+ RSPO Acq OpR w/reinf = rat, contact > visual, not-f(sex) - - - - Ang,WF'60- HIWO Incr N/wheel-turn R above baseline w/1-min rest as reinf - Azr,NH'60- DSPO Acq OpR w/reinf = visual dog, not-f(social dep) - - - - - - Ang,WF'61+ SVPO Rate(OpR) incr-f complexity of visual pattern reinf - - - - Bar,GW'61+ MVPO Maint OpR w/reinf=movie of monkey >slide of monkey >screen But,RA'61- RUPO Maint OpR w/reinf = jugular self-infusion saline - - - - - Cla,R.'61e HUPO Maint OpR w/FR50 w/cigarette/candy reinf w/schizophrenics - Hut,RR'61+ RUUU Observe some reinf value of "neutral" S w/out Pair(S,reinf) And,MP'62+ RSPO Acq OpR w/reinf = visual rat/chick, decr w/added noxious S Ang,WF'62- HCPO Maint OpR w/reinf = instructed S, not other Ss - - - - - - For,DG'62+ PVPH Emit concur R2 to change visual S w/w/out change R1 reinf - App,JB'63- MVPO Maint OpR w/reinf =movie is-f focus/color/speed/orient - - But,RA'63+ FVOO Acq swim-thru-ring OpR w/reinf =mirror w/aggressive display Tho,T.'63- PUPH Fail to maint OpR w/reinf = direct stomach dextrose - - - - Ang,WF'64e SUPO Empty box = visual mouse as reinf re OpR - - - - - - - - - Ant,JJ'64+ RxPO OpR reinf w/novel>familiar S-change if maint in noisy room Ber,DE'66e OpR reinf w/familiar>novel S-change if maint in quite room RCPH Maint OpR w/reinf = non-nutritive saccharin - - - - - - - - Duf,VL'66+ OUPO Maint OpR w/reinf = heat in cold environ - - - - - - - - - Bal,BA'67+ FVOO Beta acq swim-thru-ring OpR w/mirror-image reinf - - - - - Gol,SR'67- FVOO Habituation of reinf w/mirror w/aggressive display - - - - Cla,FL'68+ HUGO Incr spon male GSR w/reinf = slides of nude females - - - - Sch,GE'69+ BUOT Opcond lever-lift-lick OpR w/H2O reinf w/restrained O - - - Swa,HA'70- RUPO Maint OpR w/reinf = vol running of O-controlled duration - Col,GH'71+ Above Rate(OpR) incr-f(FR) but decr N/reinf RUPS Acq OpR w/reinf = change from unsignalled to signal shock - Bad,P.'72+ Above obtain w/both escapable/inescapable shock RVPS Acq OpR w/reinf = change from unsignalled to signal shock - Bad,P.'73e Above obtain w/longer/stronger unsignalled shock RVPS Acq OpR w/reinf = change from unsignalled to signal shock - Bad,P.'73e Above otain w/higher density of unsignalled shock FVOO Maint OpR w/reinf = mirror, even w/free mirror avail - - - Bae,R.'73+ RNPO Maint Op(R) w/reinf = hypothal cooling w/heat stress - - - Cor,JD'73- FTAO Acq swim OpR w/reinf =tactile stim re model of cleaner fish Los,GS'74+ MSPO W/reinf=observe other O, ObR decr-f(observer dominance) - - Hau,RH'76e RUPH No opcond w/reinf = direct intragastric feeding - - - - - - Cyt,J.'77e Re above: Extn if shift from food-by-mouth to stomach MUPS Maint OpR w/reinf = 6-min vs 2-min FI sched of shock - - - Pit,RC'91+ OS-2:10. Relative effectiveness of Reinforcers in Opcond OB****aaw . Note: Reinf effectiveness may depend on nature of R MNPx Reinf value of ESB is-f site of stim, but < food reinf - - Bur,B.'58+ RVPH Can maintain OpR on higher FR w/food than w/lite reinf - - Ste,J.'58+ SAPO Acq OpR w/reinf = auditory S, is-f(freq/inten), < lite-on - Bar,GW'61+ RNPx Pref sucrose > septal ESB reinf, weak sucrose > stong+ESB Asd,D.'62- RUP1 W/food/H2O dep, Rate(OpR) in S w/food > S w/H2O - - - - - - Law,R.'68e Concur w/above, intermed Rate(OpR) in Ss w/food and/or H2O Law,R.'68e RUPH LiCl after 1-sessn trng w/sucrose rf decr later Rate(OpR) - Bal,B.'91+ Above reinf devaluation only w/post-trng expose to sucrose Bal,B.'91+ OS-2:20. Opcond w/ESB reinf OB****aNc RNP- Maint OpR w/reinf = ESB, esp in septal area - - - - - - - - Old,J.'54+ RNxO Acq OpR w/reinf = brief ESB in medial forebrain bundle - - Bow,GH'58+ W/long ESB in same site, acq maze ER but not AR RCPO Cum-record OpR w/ESB reinf sim to food reinf w/sim schedule Bro,DA'60e RNPO Hi indiv diff in reinf w/midbrain arousal system ESB - - - Gli,SE'60- RNP- Identify 2 self-reinf and pun systems in hypothal - - - - - Old,J.'60e RNPO Pref OpR w/ESB reinf vs H2O unless very dehydrated - - - - Fal,JL'61- RNPS Ident both pos and neg reinf ESB w/goldfish - - - - - - - - Boy,ES'62+ RVPO Need to prime w/ESB to maint Op(R) w/ESB reinf - - - - - - Eld,ST'65e Need food-dep/methamph to maint OpR w/hi FR w/ESB reinf RUPO Rate(OpR) w/hypothal > w/septal ESB reinf - - - - - - - - - Dea,G.'66- RNPO Maint OpR w/reinf=self-ESB noradrenergic cells of coeruleus Rit,S.'73+ RNPO OpR perf on various RI/FR sched w/ESB reinf sim to food - - Ben,RJ'78e RNPO Reward ESB decr-f(interpulse interval) attrib to summation Mil,PM'78- RNPO Mag(ESB Reinf) is-f(site stim w/in medial forebrain bundle) Leo,M.'92+ RNPO Mag(ESB Reinf) is-f(train duration/pulse freq) - - - - - - Mar,TA'93+ RNPO Rapid w/in-session adjust to change in Rate(ESB Reinf) - - Mar,TA'94+ RNPO Mag(ESB Reinf) is-f N/action potentials in relevant axons - Sim.JM'94+ OS-2:30. Reinforcement w/lite-on/off OB****aCl RVPO Maint OpR w/reinf = lite offset, incr-f(inten) - - - - - - Kel,FS'41- RVPO Acq OpR to turn lite off, not on (ie not just change illum) Zea,D.'53+ SVPO Acq/extn of OpR w/reinf = lite onset in dark environ - - - Kis,GB'55- RVL- Incr Rate(OpR) w/lite reinf after pretrng w/out reinf - - - Mar,MH'55e RVP- Acq OpR w/onset of lite-flash as only reinf - - - - - - - - Hur,HM'56- RVPO Lite onset is pos reinf of low efficacy for OpR - - - - - - Kli,JW'56e MVP- Incr Rate(OpR) w/reinf = incr or decr in illumination - - - Moo,LE'56+ RVPT Maint OpR in dark w/brief lite reinf, incr w/H2O dep - - - Cla,FL'58- RVPH Rate(OpR) w/lite-on reinf incr-f(food dep) - - - - - - - - Dav,JD'58- RVPH Maint OpR w/reinf = 5-sec lite-on, incr w/food dep - - - - For,DG'58+ RVPH Rate(OpR) w/lite reinf not-f(food dep) - - - - - - - - - - Hur,HM'58+ RVP- OpR w/lite reinf facil w/large lever, past trng w/lever - - Tho,DG'58e RUPO Rate(OpR) w/lite-on reinf greater if pre-expose to box - - App,JB'59+ SVPO Acq OpR w/reinf=lite on, decr-f(inten); no reinf w/lite-off Bar,GW'59e RVPO Acq OpR w/weak-lite reinf, but little retention w/out lite Cro,WF'60- RVPO Rate(OpR) w/weak-lite reinf not-f(lite duration) - - - - - Cro,WF'61+ RVPO Acq OpR w/weak-lite reinf-->1-d retention decr-f(N/reinf) - Cro,WF'61- RCP- Op(R) w/click-lite reinf correl w/maze explor - - - - - - - Ehr,A.'61- RVPO Rate OpR w/reinf = lite-on incr-f(ITI) - - - - - - - - - - For,DG'61+ SUPO Maint OpR w/reinf = lite-on; tone-on decr OpR, esp complex Bar,A.'62+ MVPO Rate(OpR) w/brief lite reinf incr-f prior sensory dep - - - Fox,SS'62- Rate(OpR) w/brief lite reinf incr w/AMPH RVPO Maint OpR w/reinf = lite on = lite off, not-f diurnal cycle Bar,H.'63+ RVPO Acq/maint of OpR w/reinf = lite incr w/distrib trng - - - - Ber,DE'64e RVPO Maint OpR w/reinf = lite incr/decr, not-f(Amt(change)) - - Ber,DE'65+ RVPO P(OpR) w/variable>fixed location of lite-on, is-f(lite dep) Don,JW'65- RCPH Pref OpR -->brief lite-on vs nil - - - - - - - - - - - - - Goo,CL'65- RCPO Maint OpR w/reinf = dim lite on/off is-f(box complexity) - Eac,JN'67- OUO- Maint OpR in chick w/illum change (on/off, incr/decr inten) Eac,JN'67+ SVPO 12-d pre-expose to enriched auditory environ decr lite-rf R Fri,JP'67- RVPO Maint FR2 OpR w/reinf = lite off > lite on - - - - - - - - Glo,PH'70- BVBH Maint OpR w/lite onset/offset reinf, not-f(age/dep) - - - - Goo,CL'70- UUUO Acq OpR w/reinf = lite incr, not w/decr in inten (chicks) - Mey,ME'70e RVPO Acq OpR w/reinf = steady/flicker lite opposite to preexpose Wil,DL'70+ OCPO W/pig, low Rate(OpR) w/reinf=lite-on, not lite-off/tone-on Bal,BA'77+ RVPO Maint OpR w/reinf=lite-on facil by pretrng ARi w/lite >tone Mat,J.'78- Systematic Analyses of Reinforcement in OpCond OB****aaz RUP1 Concl: Reinf value is-f(sensory > metabolic consequences) - Col,GH'64- RVPO W/4 sensory states avail, P(OpR) to enter state not-f(time spent in state) - - - - - - - - - - - - - - Glo,PH'79+