LOGAN: BASIC LAWS OF LEARNING 7/1/2000 OPERANT CONDITIONING: Excitation Independent Current Contingency Variables Contents Paradigmatic/Natural/Asocial/Emotionally Positive Effect OC-20:00. Interaction of Opcond w/Classcond OA****aIa OC-20:10. Autoshaping (AuSh) OA****aIs Systematic Analyses of Autoshaping OA****aIz Behavioral/Natural/Asocial/Emotionally Negative Effect Principle OC-21:00. Conditioned Suppression (CER) OA****oIc OC-21:01. Baseline effects in CER OA****oId OC-21:02. Consolidation in CER OA****oIe OC-21:03. ISI effects in CER OA****oIi OC-21:04. Positive CER OA****oIk OC-21:05. Motivational effects in CER OA****oIm OC-21:06. Effects of Off-baseline Pairing Op OA****oIo OC-21:07. Preexposure effects in CER OA****oIp OC-21:08. Stimulus effects in CER OA****oIs OC-21:09. US effects in CER OA****oIu OC-21:10. Extinction of CER OA****oIx Systematic Analyses of Conditioned Suppression (CER) OA****oIz OC-20:00. Interaction of Opcond w/Classcond OA****aIa DxS- Elicit food-reinf paw-mvmt OpR w/S cond w/food US - - - - - Sol,IG'41- DIS- Pos correl, salivation + lever-R on FI sched - - - - - - - Sha,MM'60- DOO- Substantial parallel between salivation and OpR - - - - - - Kin,W.'62+ RFC- Water reinf for bar-press, lick B4/after press to neg S - - Mil,NE'65+ RVe- Pair(S,shock)--Contingent S decr OpR, not-f(S-duration) - - Dya,JA'66+ RxB- Pair(S,food) facil S-discrim bar-press OpR for food - - - - Tra,MA'67+ Pair(S,no-food) facil extn of S-discrim bar-press OpR Genz of S-discrim OpR from S to S' incr by Pair(S',food) Genz of S-discrim OpR from S to S' decr by Pair(S',no-food) R1B- Diff-classcond facil diff-opcond and retard if reversed - - Mel,RL'69+ MVe- Food-reinf OpR suppressed during brief pre-food key-lite S Bic,AS'78+ Also suppress to prolonged key-lite S w/out food OC-20:10. AutoShaping (AuSh) OA****aIs RAE- Cond goal-orient-R w/temp discrim during 2-min S B4 water - Bau,M.'68+ PUPH Concl pairing lite-reinf nec for maint AuSh OpR - - - - - - Hit,EW'70+ PVK- Peck illum key if differentially assoc w/R-independent food Gam,E.'71+ PVPH P(AuSh R) is-f cue localization (keylite vs context S) - - Was,EA'73- xxx- Acq/maint of AuSh R is inverted-U-f(ITI), 15-960-sec - - - Gri,RW'74- PVPH Diffcond re houselite color facil AuSh w/keylite line tile Hal,G.'74+ PVK- Prior exper w/context w/out food incr later P(AuSh R) - - - Bla,R.'76+ P1x- AuSh pecking w/Pair(lite,food), not w/Pair(tone,food) - - - Boe,RB'79+ RVO- 2nd-order autoshaped peck w/S2 on diff key, better on same Mar,BS'79e PVP- Peck key lited B4 food signal that did not evoke peck - - - Bur,JS'82- No effect on 2nd-order R of de-value food US Decr 2nd-order R by extn of 1st-order assn OVP- AuSh in chick incr-f duration of heat reinf - - - - - - - - Dei,JD'82- 2nd-order AuSh max when duration of CS1 same as 1st - - - - Dei,JD'82- 1st/2nd-order AuSh decr-f(ISI), incr-f(%-reinf) Obtain 2nd-order AuSh w/R to S2 dissim to R to S1 Extn of CS1 after Pair(S2,CS1) decr AuSH R to S2 - - - - - Dei,JD'82- P P- AuSh decr by ITI US-alone, less if signalled - - - - - - - Dur,PJ'82- PVP- AuSh incr-decr-f(N/US-alone magazine trng) B4 Pair(S,US) - Obe,FG'82- AuSh better w/magazine trng in diff context (HL on/off) PVP- Prior random occur of S/food decr AuSh, is-f(acq acty) - - Bra,SE'87+ PVPH Pretrng w/conting food-lite facil AuSh re conting lite-food Hea,E.'89- RVPH Decr freq AuSh bar-press w/pretrng to orient to foodcup - - VHe,A.'89e PxP- Cond inhib/facil of AuSh R to S B4 food genz to sim S' - - Res,RA'91- Above modulatn of AuSh R is-f post-trng reinf/nonreinf of S PVPH Acq AuSh OpR w/PRF < CRF, w/no diff re R/Extn - - - - - - - Pap,MR'92+ Systematic Analyses of Autoshaping . OA****aIz R O- Interp antic head-poke into food tray as either CR or OrR - Far,BJ'79+ Principle OC-21:00. Conditioned Suppression (CER) OA****oIc . Decr Rate(OpR) w/Pair(S,aversive S) on Operant Baseline RAe- Pair(S,shock)-->S suppress Rate(OpR) - - - - - - - - - - - Est,WK'41+ RAe- Good suppression only if S duration short re time S off - - Ste,L.'58e RUxx Rate(OpR) suppressed w/S from shuttle avcond - - - - - - - Bri,CJ'63+ PAe- Suppression immed if S early in FR, after reinf if later - Lyo,DO'64- RAe- CER S decr rate of 2-R chain, but not reinf IRT - - - - - - Mig,B.'64+ MVH- Pair(lite,shock) incr HR while suppress OpR - - - - - - - - Ste,WC'64+ RAe- Recovery of OpR during S over 39 sessions after CER trng - Hen,DP'65+ RAe- Suppression decr-f N/R-left-in-FR100, incr-f(USI) - - - - - Hom,CA'66- RAe- If not complete, suppress less if reinf sched in 30-sec ISI Hug,HB'66- RAe- Suppression incr-f(time) since Pair(S,shock), max at 4-6 hr MMi,JS'66- RDB- CER not affected by autonomic drugs (eg atropine) - - - - - Dev,TL'67- R e- Short noncontingent resp-shock time produces greater CER - Got,P.'67- R e- CER acq slower, greater R/Extn w/PRF at 1-tr/day - - - - - Kol,BP'67- RAe- CER w/Pair(S,shock); CER during no-S w/Pair(S,no-shock) - - Dav,H.'69+ Random correl of S/shock led to suppression w/w/out S RAe- CER w/Pair(S,shock); CER during no-S w/Pair(S,no-shock) - - Dav,H.'69+ Random correl of S/shock led to suppression w/w/out S RNB- No cond suppression of OpR reinf w/ESB w/cond in Op-sit - - Mer,HK'70e RVPH Pair(S,sh) w/Mult VI-extn sched; suppress in VI, not extn - Bla,DE'73+ No effect of above CER on diff OpR re Mult sched RAe- CER incr-f N/Pair(S,shock), w/1 or 2 trial/day and diff USI Jam,JP'73e RAB- S suppresses food-reinf OpR after truly-random (S/shock) - Hyd,TS'76- Above suppression not obtained if R-indep shock in baseline S suppresses food-reinf OpR after Pair(S,shock) Above suppression obtained if R-indep shock in baseline RNB- Complete suppression of OpR reinf w/ESB w/cond in Op-sit - Mer,HK'76- OC-21:01. Baseline effects in CER OA****oId xNPx Cond suppression w/ESB ESB re FR50 Bra,JV'58- xNe- CER w/food/H20 reinf, not w/ESB reinf, w/in O to same CS - Bra,JV'60+ RAe- Suppression not controlled by changes/reinf - - - - - - - - Car,PL'60+ RAe- Slower CER acq w/hunger-milk than w/thirst-water baseline - Gel,I.'60- PIe- More suppression w/VI4-min than VI1, mult sched w/in O - - Lyo,DO,63- MAe- CER on visual exploration reinf baseline - - - - - - - - - Kru,DC'64+ RAe- Complete suppression during CER S on DRL baseline - - - - - Lea,RC'64+ RAe- Suppressn incr-f Rate(OpR) re yoked controls w/=freq reinf Bla,D.'66- PAe- Little suppression w/VR w/mean of 50, 100, or 200 R - - - - Lyo,DO'66+ RRe- Suppression incr-f(FR), w/suppression if S early in long FR Lyo,DO'66+ HAe- Cond suppressn incr-f(task complexity), w/temporal discrim Wyc,JH'66- RUe- Temporal discr w/fixed ISI, less suppressn than w/variable Bar,RJ'67- Above obtained between-O; not replicated w/in-O RAe- Rel suppression incr-f Rate(OpR) w/=freq reinf - - - - - - Bla,D.'67- RAe- CER to noise relatively greater the higher the Rate(OpR) - Bla,D.'68- RAE- Pair(S,shock)-->Cond suppression incr-f(ongoing Rate(OpR)) Bla,D.'68- Pair(S,shock)-->Cond suppression decr-f(ongoing Freq(Reinf) RVE- Pair(lite,shock) suppress OpR reinf w/hypothalamic S - - - Per,TB'68+ RAe- CER S in S+ decr Rate(OpR) in both S+ and S- w/out S - - - Wei,KM'68- HAe- Weak CER of match-sample w/Pair(S,shock), not-f N/S in task Sac,DA'69- HVe- 3/6 O show CER matching-sample suppressn w/temp discrim - - Sac,DA'69+ RAx- Suppression of bar-press > lick OpR w/in subj, w/lo correl DCo,MJ'71+ RNe- Cond suppression w/septal/hypothalamic ESB reinf of OpR - - Haw,JT'71- Above CER obtained w/w/out concur OpR RAe- Less cond suppression of food-reinf OpR w/incr Qual(reinf) Mil,JR'72+ OC-21:02. Consolidation in CER OA****oIe RNe- 21-ECS trtmt decr CER w/4 days B4 test, not 30/60/90 - - - Bra,JV'51- RNe- CER elim by 7-ECS or 21-ECS trtmt - - - - - - - - - - - - - Bra,JV'51+ RAe- Effect of 21-ECS on CER decr-f(30/60/90-d delay) B4 trtmt - Bra,JV'52- RVe- Elim CER if begin 21-ECS trmt (3/day) day after CER trng - Bra,JV'52+ RNe- Decr effect of ECS on CER w/ECS w/anesthesia w/decr seizure Hun,HF'53e RNe- CER acq decr by post-trial local dorsal hippocampal ESB - - Kau,KP'72- Max above effect if ESB immed and produces a seizure OC-21:03. ISI effects in CER OA****oIi PIe- Suppression decr-f(S duration), 100/200/300-sec Lyo,DO'63- RAC- S suppress drinking if forward, not backward Pair(S,shock) Lea,RC'65+ HVe- No CER w/variable ISI using trace proc - - - - - - - - - - Sac,DA'67+ RVe- CER w/varied ISI > constant ISI at mean, w/incr R/Extn - - Zil,N.'67- RUe- Temporal gradient w/max suppression in last of 3-min ISI - Car,JB'68- No evidence of disinhib of delay in CER R e OpR-suppression decr-f(expected time to shock) - - - - - - Lib,ME'75+ RAB- Baseline Rate(OpR) decr more by shock-signal vs sign-shock Dav,H.'76e R e- Some suppressn after small N/Pair(S,shock) simult/backward Het,CD'76- Above suppression decr w/extended pairings, 10 to 160 Extensive backward pairing leads to inhib cond OC-21:04. Positive CER OA****oIk DABX S for salivary CR incr P(OpR) on food-reinf DRL sched - - - Sha,MM'65+ RAPH No effect on Rate(OpR) w/1-min VI of cue for FT30 free food Har,PR'70+ PVK- Pair(S,food)--S incr Rate(food-reinf OpR) - - - - - - - - - LLo,VM'71- MAB- Food-reinf OpR suppressed during short S B4 preferred food Mic,KA'71+ Food-reinf OpR not affected by long S B4 preferred food PxO- Pair(tone+key-lite,food)--Fewer R if prior Pair(tone,food) Bro,DL'73- Pxx- Peck OpR-rate on DRL incr by KL-stim B4 R-indep food - - - LLo,VM'74e Treadle OpR-rate on DRL decr by KL-stim B4 R-indep food Small effect on peck/treadle R-rate by tone B4 R-indep food RAe- Rate(OpR) during 2-min S paired w/free-food incr-f(P(food)) Mel,D.'74+ Change above S to 8-sec, highest Rate(OpR) w/partial pair RVe- Food-reinf Rate(OpR) incr by S preceding R-independent food Mil,L.'75+ Food-reinf Rate(OpR) decr by S simult w/R-independent food Rxe- Pair(S,em+US)--S suppresses OpR only if S or US localized - Kar,JA'76- Interp: Pos CER occurs if S/US assoc w/incompatible R xxPH Suppression of OpR by cue signalling reinf on VR sched - - Mor,RC'79e Above w/auditory cue w/rat, w/visual not auditory w/pigeon R PH Pos cond suppression w/10-sec S, not if pretrnd w/long S - Mel,D.'88- OC-21:05. Motivational effects in CER OA****oIm RUPH After estab CER, suppression decr w/decr food-dep - - - - - Car,JB'70- RAe- Greater cond suppression of food-reinf OpR w/decr hunger - Mil,JR'72+ RDB- CER w/S for AR decr by post-cond injection of vasopressin - Hag,JJ'83- OC-21:06. Effects of Off-baseline Pairing Op on Opcond OA****oIo RAe- Pair(tone,food)--Tone incr Rate(OpR) reinf s/food - - - - - Est,WK'48- RAE- Pair(S,shock)-->S conting on OpR decr Rate(OpR) - - - - - - Bar,A.'59- Equal above suppression after trng w/S-alone or shock-alone D O- OpR disturbed by classcond S - - - - - - - - - - - - - - - Boy,FL'68- MAe- Pair(tone,shock)--Tone decr R/rate w/no decr in oddity perf Kru,DC'68- RAB- Diff-classcond facil diff-opcond only re extn of OpR to S- Tra,MA'68e Above facil if consistent S+/S- w/decr if reverse RAB- Diff-opcond reversal facil by prior reverse diff-classcond Tra,MA'68e ROA- Free food on FT sched facil acq of FI scallop - - - - - - - Zam,E.'69- M e- Obtain suppression w/interference on/off-baseline, w/HR OpR Zei,AR'69e RAe- CER w/1-Pair(tone,strong shock) not-f 0-72-hr delay B4 test Bro,JC'70- R1B- Transfer classical to diff-opcond incr-f(trng) w/same S+/S- Ost,JW'70+ Transfer w/reverse S+/S- decr-f(classical trng) w/ORE RAe- Suppress licking after 1 Pair(S,strong shock) off baseline Bro,JC'71+ RAPS CER w/off-baseline Pair(S,inescapable shock) > escapable sh Des,O.'71+ PAx- Pair(tone,shock)--Tone decr both OpR and collateral acty - Ste,NH'71e RAe- Pair(noise,shock)--Noise suppress OpR + sched-induced drink Bon,NW'73e M1e- Pair(S,food)--S incr Rate(OpR) w/VR, decr Rate(OpR) w/DRL - Kel,DD'73- HPAO Pair(S,sh)-->S decr Rate(OpR) w/visual reinf - - - - - - - DGi,JA'74e R e- Pair(S,shock,food) retards subsequent CER trng w/S - - - - Pea,JM'75+ Above countercond decr-f(shock inten) RAB- S facil OpR w/R-indep shock after Pair(S,no-shock) - - - - Hyd,TS'76- RAe- Greater suppression w/delay B4 test in same/diff sit - - - Kor,LG'76+ RAe- S paired w/shock decr free shuttle R w/sucrose reinf - - - Les,JC'76+ PAe- CER inc-dec-f(time) since Pair(S,shock), 0-60 min w/in O - How,RC'78+ OC-21:07. Preexposure effects in CER OA****oIp RAe- Preexpose to US on baseline decr Rate(acq) of CER - - - - - Bri,CJ'63+ Above effect elim if allow Rate(OpR) to recover B4 CER trng RVE- Expose to shock B4 Pair(lite,sh) decr OpR suppressn w/lite Str,A.'65- R x- Pretrng w/inescapable shock incr cond suppression of OpR Osb,FH'75e OC-21:08. Stimulus effects in CER OA****oIs R1PH Pair(tone,sh)+(lite,no-sh)-->OpR decr w/tone, incr w/lite - Ham,LJ'66- Rxe- Suppression incr-f P(reinf) to diff S w/in-O - - - - - - - Wil,RD'66+ RAe- Suppression incr during 6-min ISI - - - - - - - - - - - - - Zie,K.'66- PSPH OpR suppressn re S B4 shock decr w/conspecific emitting OpR Hak,DF'67+ RAe- Temporal discrim of suppression incr over 300 acq trials - Mil,JR'67+ DAE- S tracecond w/shock decr OpR early, incr late in RSI - - - Res,RA'68- RAe- No decr in CER over 60 sessions w/variable duration S - - - Mil,JR'71+ Suppression uniform w/in S period w/variable duration S OC-21:09. US effects in CER OA****oIu NVP- Cond suppression of VI-reinf OpR to S B4 TO from sched - - Fer,CB'57- RAe- CER incr-f shock USI - - - - - - - - - - - - - - - - - - - Ann,Z.'61+ CER R/Extn incr-f acq shock USI Mxe- CER obtained w/115 db noise US - - - - - - - - - - - - - - Bro,JF'66- PVe- Suppress to S B4 shock, accel to S B4 T-out - - - - - - - - Lei,H.'66- RAe- Incr Rate(OpR) on DRL by Pair(tone,lo shock), suppress w/hi Bla,D.'68- Suppress Rate(OpR) on VI-LH by Pair(tone,lo or hi shock) Rxe- Rate(OR) decr during S preceding T-out from pos reinf - - - Lei,H.'68e R e- Some evidence of suppression during 15-sec signal B4 extn S Kau,A.'69- M e- Less restriction of suppressn to ISI w/<100% Pair(S,shock) Mat,MA'69- Observe temporal gradient of suppression in acq/extn Greater persistence of suppression w/<100% Pair(S,shock) MVPH OpR suppression w/Pair(S,shock) incr-f(USI) w/in O - - - - Hen,WW'70+ Rxe- Suppression incr-f P(shock), w/in O - - - - - - - - - - - - Bri,CJ'71+ RVe- Rate(OpR) incr on FR3 during S preceding signalled extn - - Cal,RS'71e R e- DRL Rate(OpR) incr during pre-TO S, decr during pre-shock S Par,BK'71e H E- CER incr-f(USI), 1 to 5 mA shock, decr-f(ISI), 5 to 60 sec Sac,DA'72+ RVe- More suppressn sugar-reinf OpR w/100% Pair(S,food) vs 50% Lev,M.'77+ OC-21:10. Extinction of CER OA****oIx RAe- Presence of water reinf critical for extn of CER - - - - - Byr,RP'70+ R e- Decr CER by 30, not 20 forced exposures in diff apparatus - Min,S.'79+ Systematic Analyses of Conditioned Suppression (CER) OA****oIz PAK- CER trng w/out OpR--Suppressn not due to punish or other R Hof,HS'71+ XXX- W/autoshaping, attractiveness of S enhanced by CR - - - - - Per,CC'71- XXe- Discusses effect of diff in pre-S R/rate on suppressn ratio Shi,EH'72-