LOGAN: BASIC LAWS OF LEARNING 12/1/99 OPERANT CONDITIONING: Inhibition Interdependent Current Response Variables Contents Principle Or-1:00. Differential Operant Conditioning (Diff-Opcond) OI****Saa Or-1:10. Diff-Opcond as-f(dep) OI****Sad Or-1:20. Diff-Opcond as-f(Pretrng) OI****Sap Or-2:00. Diff-Opcond based on Reinforcement Schedule OI****Sfk Or-2:10. Diff-Opcond based on difference in Amt(Reinf) OI****Smu Or-3:00. Rate(OpR) to S+ as-f(Diff-Opcond) OI****SAU Or-3:10. Rate(OpR) to S- as-f(Diff-Opcond) OI****SAV Or-4:00. Conditional Diff-Opcond OI****SCa Or-5:00. Choice Behavior: General OI****SCA Or-5:10. Choice: Conditions/Schedules of Reinforcement OI****SCC Or-5:20. Choice: Uncertain Outcome OI****SCF Or-5:30. Choice. Conditional Outcome OI****SCI Or-5:40. Choice: Amount/Delay of Reinforcement OI****SCK Or-5:50. Choice: Punishment OI****SCP Systematic Analyses of Choice in Operant Conditioning OI****SCZ Or-6:00. Reversal of Diff-Opcond OI****SSa Or-6:10. Effect of Diff-0pcond on R/Extn OI****SSs Principle Or-1:00. Differential Operant Conditioning (Diff-Opcond) OI****Saa Diff Reinf re Context --> Diff OpR re Context Term: Multiple Schedule of Reinforcement RVP- Diff-cond re lite presence/absence w/FI sched in S+ - - - - Din,JA'51- RVPH Diff-cond w/pun vs no-pun, w/w/out external cue - - - - - - Din,JA'52- PVPH Use diff-opcond to determine psychophysical threshold - - - Blo,DS'58- P PH W/diffcond VI-VI, punish 1 component incr other Rate(OpR) - Bre,DM'62+ DVU- W/moving spot of lite as SD, hard to diffcond speed/directn She,IM'62- R Diffcond decr w/varied S+, no effect of varied S- - - - - - Coa,WB'64+ RUPH Diffcond S1+, S2+, S3- --> OpR w/S1 > compound S1S3 - - - - Cor,JM'65+ Diffcond S1+, S2+, S3- --> OpR w/S1 < compound S1S2 Cor,JM'65+ RVPH Diffcond re brightness facil w/lo-inten shock in S+ or S- - Cur,ER'65+ Diffcond re bright decr w/hi-inten sh in S+, facil in S- Cur,ER'65+ PxPH Diffcond tone-color compound w/both varied-->R to either S+ Blo,DS'69- After above, decr R to S if constant vs varied other cue Blo,DS'69- PJPH Diffcond re brightness decr control by changed tone w/S+ - Mil,CG'70- PVPH Diffcond re presence/absence or direction of apparent mvmt Sie,RK'70- P1K- Little diff-cond re auditory cue added to trnd visual cue - VSa,W.'70+ RxBH Diff-cond w/nonreinf tone/click compound and reinf elements Res,RA'72- Add lite to above compound and elements retards diff-cond Res,RA'72- Re above, faster diffcond w/reinf compound nonreinf element Res,RA'72- Repeat both above diff-cond w/tone/lite compound, same rate Res,RA'72- Above diffcond not based on total inten of compound/element Res,RA'72- Interp: Compound contains unique S w/limit to total assoc E Res,RA'72- RxBH Diff-cond w/nonreinf compound and reinf elements alone - - Res,RA'73- After above, reinf trng w/compound incr R/Extn of elements Res,RA'73- Diff-cond w/reinf compound and nonreinf elements alone Res,RA'73- After above, reinf trng w/elements incr R/Extn to compound Res,RA'73- RAPT Acq OpR w/cued reinf spatially away from bar - - - - - - - Buz,G.'79e After trng w/cue away from bar, decr perf if cue near bar Buz,G.'79e After trng w/cue near bar, maint perf is cue away Buz,G.'79e P PH Low/hi Rate(OpR) w/Mult signaled-unsignaled VI sched - - - Pow,RW'80+ Pos contrast re incr Rate(OpR) in signaled w/extn unsignal Pow,RW'80+ Incr Rate(OpR) and breakdown of discrim w/extn signaled VI Pow,RW'80+ PVP1 W/Mult VI-VI w/food/H2O reinf, Rate(OpR) w/H2OReinf R and T+L-->Reinf w/w/out R-->L inhib effect Bon,C.'88- PVPH Diffcond S+ w/feature vs S- w/out > v/versa, w/ITI feature Hea,E.'88- PVPH W/mult sched, beh contrast decr-f(S-sim) - - - - - - - - - Wil,BA'88- P PH W/Mult-VI-extn, no beh contrast re VI if change w/reinf - - Pee,DB'89+ Attrib beh contrast w/Mult-VI-extn to diff reinf short IRTs Pee,DB'89+ PxPH W/mult VI sched, OpR w/same VI opposite to following sched Wil,BA'90- Above antic contrast max if diff S in following sched Wil,BA'90- Obtain Pavlov conting (sim OpR) w/short component + same S Wil,BA'90- RxP- Obtain hi-order occasion setting re Lat(OpR) to S3 - - - - Arn,HM'91e Ie, R if S1 B4 S2 B4 S3, or if -S1 B4 S2' B4 S3 Arn,HM'91e Vs -R if -S1 B4 S2 B4 S3, or if S1 B4 S2' B4 S3 Arn,HM'91e HVGO Diffcond eyeblink OpR re reinf/nonreinf intervals w/w/out S Pre,JB'92e Or-1:10. Diffcond as-f(dep) OI****Sad Or-1:20. Diffcond as-f(Pretrng) OI****Sap RAB- Diff-classcond tone/click w/H20 facil diff-opcond w/same S+ Bow,GH'64+ RAPH Trng w/hi-diff Ss facil acq w/lo-diff Ss (easy-to-hard) - - Log,FA'66- Above facil w/same S- > w/same S+ or symmetrical Log,FA'66- Derive above result from S/Genz re absolute excit/inhib Log,FA'66- RxO- Diff-clascond facil diff-opcond re Amt(reinf) w/discrete FR Fla,CF'69+ Pxx- Pair(key-S,shock) w/OpR base facil diff-opcond w/tone/noise Wal,D.'73- RALH Pair(S1,food/sh) + (S2,food) facil diffcond w/same conting Car,JG'74- RAPH Noise/tone diffcond facil w/noise-food or R-reinf pretrng - StC.R.'85+ Re above, noise-food facil R to S+, R-reinf inhib R to S- StC.R.'85+ Or-2:00. Diff-Opcond based on Reinforcement Schedule OI****Sfk PPP- Rel Freq(R) = rel Freq(reinf) in concur VI-VI - - - - - - - Her,RJ'61- PUPH Diffcond FI vs FT but sim distrib of OpR in both - - - - - App,JB'62+ BAO- Diffcond w/diff FI (5 vs 2 min) w/switch to diff Ss - - - - Smi,DI'64- RAPH Acq diff Rate(OpR) re single, not double altern PRF - - - - Blo,JM'65+ PVPH W/MULT-VI-EXTN, pos beh contrast incr-decr-f(trng) - - - - Blo,TM'66- Obtain above max beh contrast only if R in S- pospone S+ Blo,TM'66- RGPH Diffcond Mult FR-FI w/cue = type of food reinf - - - - - - Cru,DB'66e PVPH W/MULT-VI-DRL or VI-FR, Rate(OpR) in VI decr-f(DRL/FR reinf Blo,TM'67- PVPH After trng w/MULT-VI-VI, pos beh contrast w/MULT-VI-EXTN - Blo,TM'67- Above pos beh contrast decr during time in VI Blo,TM'67- PVPH Extn Key1 alone incr pref for Key2 w/Concur-VI-VI - - - - - Blo,TM'67- RRB- Beh contrast between session w/Mult-FR-extn sched, not w/in Bee,RS'69- RUPH Beh contrast w/Mix VI-Extn if hi Rate(Reinf) in VI - - - - Pea,JJ'70+ PVxH W/change Mult-VI-Extn, beh contrast w/peck OpR, not treadle Hem,NS'73- Or-2:10. Diff-Opcond based on difference in Amt(Reinf) OI****Smu PVPH W/concur-VI-VI chain, pref incr-f(N/VI-reinf in 2nd link) - Fan,E.'68+ RIB- Discrim (tone,click) as signal for Amt(reinf) on FI - - - - Mel,D.'75+ Or-3:00. Rate(OpR) to S+ as-f(Diff-OpCond) OI****SAU HUPH Rate(OpR) to S+ incr-f(D), w/proportional incr to S- - - - Din,JA'52- PUPH Rate(OpR) decr w/successive S+, recover after S- - - - - - Bon,CA'62+ PVPH W/diffcond above/below mid-S, max Rate(OpR) near mid-S - - Cat,AC'64+ RIP- Diff R/rate to diff S on discrete-trial FI-FI diff-opcond - Mil,L.'70+ R/rate=sum of above rates when compound S Mil,L.'70+ Or-3:10. Rate(OpR) to S- as-f(Diff-Opcond) OI****SAV PVPH Prob(OpR) to S- greater immed after S+ than after S- - - - Bon,CA'65e O PH After diffcond, cond inhib re S- at 1-d age if overtrng - - Zol,JF'76e O PH Note: Cond inhib after diffcond w/out overtrng at 4-d age Zol,JF'76e Or-4:00. Conditional Diff-Opcond OI****SCa RxPO W/lite as rel D, discrim hunger/thirst = or > tones - - - - Bai,CJ'55- COP1 Diff-cond re hunger/thirst, not due to stomach distension - Bai,CJ'55+ DVPH Acq conditnal diffcond re Mult-VI-extn/reverse re HL on/off Tho,DR'88+ Or-5:00. Choice Behavior: General OI****SCA PUPH VI sched pref is-f(time to 1st reinf) + overall Rate(Reinf) MDi,CG'65+ PUPH Ratio(Time spent on one side) = Ratio (rel reinf on side) - Bau,WM'69+ Concl: Interp choice as time allocation as-f(rel N(OpR)) Bau,WM'69+ PVPH W/concur sched on 1 key, effect of (VI) Freq(Rf) > Amt(Rf) Tod,JC'73- PUPH Pref is-f(Delay to 1st rf)+reinf density, not total N/Reinf Moo,J.'79- PUPH DRO w/more-pref reinf if Lat(OpR) > delay interval - - - - Gro,J.'81+ Above perf sim to child re rf-visible/alternative R/exper Gro,J.'81+ PUPH W/concur chain, pref mult-reinf-chain > single reinf - - - Pon,WR'84- Above pref incr-f(Delay to first/only reinf) Pon,WR'84- PCPH W/concur VI, pref many small > few large w/same total - - - She,SJ'85- PUPH W/concur sched, no pref re terminal link FI30/Fixed-delay30 Dav,M.'88e PUPH W/FR chains, pref is-f(1st FR) not-f(N/FRs in chain) - - - Goe,S.'89e RUPH W/mult CRF-extn, acq short IRT (vs eat) to maint CRF sched Col,MR'90- PUPH Pref re unequal concur sched decr w/equal R-conting TO - - Dun,R.'90- PUPH W/chain FR-FR-FR, pref is-f(1st FR) - - - - - - - - - - - - Goe,S.'93e RVPH W/concur VR-VR, Rate(OpR) w/brief S at midpt of VR > w/out Ree,P.'93e Pref VR w/brief S at midpt of VR vs w/out Ree,P.'93e Or-5:10. Choice: Conditions/Schedules of Reinforcement OI****SCC RUPH Pref OpR w/short > long Delay(Reinf) w/5-sec DRO B4 reinf - Cou.G.'71e PPK- Concur FI-FI--rel R/rate re short FI exceed rel reinf rate Dav,MC'73+ PUPH W/concur VI-VI, pref is-f(absolute reinf) w/=relative value Log,AW'87+ Eg above, pref decr-f(absolute amounts/delays/freq) Log,AW'87+ PUPH W/concur sched, pref re Amt(Reinf) decr-f equal VI sched - Dav,M.'88- PUPH W/concur VI, pref re short Delay(Reinf) decr-f(initial VI) Dav,M.'88- Or-5:20. Choice: Uncertain Outcome OI****SCF PPK- Concur R/rate greater for 2-value MI than for mean FI - - - Dav,MC'69- Rel R/rate match rel reinf rate if cubic transform of MI Dav,MC'69- PPK- Concur rel R/rate on MI-FI=f(square of harmonic MI) - - - - Dav,MC'72- Above result not-f N/intervals in MI Dav,MC'72- PUPH Pref MI > FI is-f(rel sum Delay(Reinf) squared) - - - - - - Hur,SR'73+ PUPH Pref OpR w/hi-P(Reinf) incr-f(P-ratio) w/diff constant - - Maz,JE'91+ RUOT W/varied lick FR, choice based on arith mean - - - - - - - All,J.'92+ Or-5:30. Choice. Conditional Outcome OI****SCI PUPH W/concur chain, pref decr-f(length 1st FI in 2-FI chain) - Dav,MC'68- PUPH W/concur VI, no pref re FI vs =Delay(Reinf) w/w/out BO - - Neu,AJ'69- Or-5:40. Amount/Delay of Reinforcement OI****SCK Or-5:50. Choice: Punishment OI****SCP PUPH Lo P(delay OpR-->large reinf) incr w/extn penalty w/immed R Fan,E.'66- Systematic Analyses of Choice in Operant Conditioning OI****SCZ PUPH W/concur VI, rel Rate(OpR) match rel 1/Delay(Reinf) - - - - Chu,SH'67+ PUPH Choice FR vs FI is-f(time-to-reinf) - - - - - - - - - - - - Lea,SE'76- PUPH W/concur sched, pref is-f(link1 + link2 delay to reinf) - - Dun,RL'82+ PCR- Absolute w/in-chain delay(reinf) is-f overall average delay Dun,RL'83- PUPX Model of self-control re local conting of reinf + molar max Log,AW'88- Or-6:00. Reversal of Diff-Opcond OI****SSa PDP Scopolamine temp decr diffcond reversal lrng, w/recovery - Dew,PB'58- PVPH Reversal of diffcond facil w/interpolated nondiff reinf - - Cla,FC'64- PVKH No incr w/repeated reversals w/non-diff reinf B4 reversals Cla,FC'67- Or-6:10. Effect of Diff-0pcond on R/Extn OI****SSs PVK- Diffcond not only decr OpR to S-, incr extn OpR to other S Han,HM'57-