LOGAN: BASIC LAWS OF LEARNING 7/1/2000 SYSTEMATIC ANALYSES: Processes Contents ZA-1:00. Acquisition: Conceptual Propositions, General ZZ****AXc ZA-2:00. Acquisition: Empirical Analyses, Generalizations ZZ****AXe ZA-3:00. Acquisition: Models ZZ****AXm ZA-4:00. Acquisition: Theoretical Analyses ZZ****AXT ZA-5:00. Acquisition: Bibliographies, Collections ZZ****AZb ZA-6.00. Acquisition: Conferences, Symposia, Editions ZZ****AZc ZE-1:00. Extinction: Conceptual Propositions, General ZZ****EXc ZE-2:00. Extinctiom: Empirical Analyses, Generalizations ZZ****EXe ZE-3:00. Extinction: Models ZZ****EXm ZE-4:00. Extinction: Theoretical Analyses ZZ****EXT ZE-5:00. Extinction: Bibliographies, Collections ZZ****EZb ZE-6:00. Extinction: Conferences, Symposia, Editions ZZ****EZc ZG-1:00. Generalization: Conceptual Propositions, General ZZ****GXc ZG-2:00. Generalization: Empirical Analyses, Generalizations ZZ****GXe ZG-3:00. Generalization: Models ZZ****GXm ZG-4:00. Generalization: Theoretical Analyses ZZ****GXT ZG-5:00. Generalization: Bibliographies, Collections ZZ****GZb ZG-6:00. Generalization: Conferences, Symposia, Editions ZZ****GZc ZJ-1:00. Punishment: Conceptual Propositions, General ZZ****JXc ZJ-2:00. Punishment: Empirical Analyses, Generalizations ZZ****JXe ZJ-3:00. Punishment: Models ZZ****JXm ZJ-4:00. Punishment: Theoretical Analyses ZZ****JXT ZJ-5:00. Punishment: Bibliographies, Collections ZZ****JZb ZJ-6:00. Punishment: Conferences, Symposia, Editions ZZ****JZc ZK-1:00. Reinforcement: Conceptual Propositions, General ZZ****KXc ZK-2:00. Reinforcement: Empirical Analyses, Generalizations ZZ****KXe ZK-3:00. Reinforcement: Models ZZ****KXm ZK-4:00. Reinforcement: Theoretical Analyses ZZ****KXT ZK-5:00. Reinforcement: Bibliographies, Collections ZZ****KZb ZK-6:00. Reinforcement: Conferences, Symposia, Editions ZZ****KZc ZL-1:00. Language: Conceptual Propositions, General ZZ****LXc ZL-2:00. Language: Empirical Analyses, Generalizations ZZ****LXe ZL-3:00. Language: Models ZZ****LXm ZL-4:00. Language: Theoretical Analyses ZZ****LXT ZL-5:00. Language: Bibliographies, Collections ZZ****LZb ZL-6:00. Language: Conferences, Symposia, Editions ZZ****LZc ZM-1:00. Motivation: Conceptual Propositions, General ZZ****MXc ZM-2:00. Motivation: Empirical Analyses, Generalizations ZZ****MXe ZM-3:00. Motivation: Model ZZ****MXm ZM-4:00. Motivation: Theoretical Analyses ZZ****MXT ZM-5:00. Motivation: Bibliographies, Collections ZZ****MZb ZM-6:00. Motivation: Conferences, Symposia, Editions ZZ****MZc ZR-1:00. Response: Conceptual Propositions, General ZZ****RXc ZR-2:00. Response: Empirical Analyses, Generalizations ZZ****RXe ZR-3:00. Response: Models ZZ****RXm ZR-4:00. Response: Theoretical Analyses ZZ****RXT ZR-5:00. Response: Bibliographies, Collections ZZ****RZb ZR-6:00. Response: Conferences, Symposia, Editions ZZ****RZc ZS-1:00. Stimulus: Conceptual Propositions, General ZZ****SXc ZS-2:00. Stimulus: Empirical Analyses, Generalizations ZZ****SXe ZS-3:00. Stimulus: Models ZZ****SXm ZS-4:00. Stimulus: Theoretical Analyses ZZ****SXT ZS-5:00. Stimulus: Bibliographies, Collections ZZ****SZb ZS-6:00. Stimulus: Conferences, Symposia, Editions ZZ****SZc ZV-1:00. Variability: Conceptual Propositions, General ZZ****VXc ZV-2:00. Variability: Empirical Analyses, Generalizations ZZ****VXe ZV-3:00. Variability: Models ZZ****VXm ZV-4:00. Variability: Theoretical Analyses ZZ****VXT ZV-5:00. Variability: Bibliographies, Collections ZZ****VZb ZV-6:00. Variability: Conferences, Symposia, Editions ZZ****VZc ZV-1:00. Interactions: Conceptual Propositions, General ZZ****XXc ZV-2:00. Interactions: Empirical Analyses, Generalizations ZZ****XXe ZV-3:00. Interactions: Models ZZ****XXm ZV-4:00. Interactions: Theoretical Analyses ZZ****XXT ZV-5:00. Interactions: Bibliographies, Collections ZZ****XZb ZV-6:00. Interactions: Conferences, Symposia, Editions ZZ****XZc ZA-1:00. Acquisition: Conceptual Propositions, General ZZ****AXc MXXX Lrng based on assn re gen acty, not tuition/imitation - - - Tho,EL'01- XXXX Law of forward direction at synapse precludes backward assn Cas,H.'24- XXXX Lrng th: simult focalized brain acty connected, is-f(vigor) Pyl,WH'24- XXXX Lrng/memory not localized structural (synaptic) changes - - Las,KS'29- XXXX Lrng: S-->R as-f contiguity of R w/S - - - - - - - - - - - Rex,CN'32- XXXX Attrib observed gradual incr w/trng to varied S and R - - - Ski,BF'32- XXXX Conditioning as-f(Pair(S,US)) vs prob-solving as-f(success) Sch,H.'37- Based on avoid < nonavoid in cond, reverse in prob solving XXXX Disting Type-S CR (reinf is-f S) vs Type-R (reinf is-f R) Ski,BF'37- XXXX Define lrng as persisting change in beh as-f(repeated stim) Kel,WN'38- XXXX Define skill as incr fluency/precision after lrng correct R Kel,WN'38- XXXX Argues for functional def of lrng re beh change vs neural Kel,WN'39+ XXXX Relrng not pure meas of retention because of pos transfer - Bun,ME'41- Drive/cue/R/reward essential factors to lrng - - - - - - - Mil,NE'41+ XXX- Theory--hypothetical constructs w/interrelatns to exper var Spe,KW'42- Disting sign-significate (S-S) and stim-resp (S-R) theories RML- Cites need for consistent appl cog hypo re perf not= lrng - Ken,HH'52- RML- Interp latent lrng as sudden improvement re reinf th - - - Mal,IM'52- RML- Rejects reinf acct of latent lrng w/untestable hypo - - - - Thi,DL'52- AXXX Habits formed early in life retained better than later lrng Bea,FA'54+ Early perceptual lrng (esp deprivation) affects adult beh Evidence favors notion of critical period in devel for lrng XXX- Implicit tr in human lrng/prob-solve needs S/R anchors (98) Log,FA'55e Hxx- Classcond best w/out aware; motor assn lrng best w/aware - Raz,GH'55- XXX- Review physiol proc re consolidation of memory trace - - - Gli,SE'61- XXLX Anal of probability of meeting lrng criterion w/out lrng - Bog,RS'65- XXXX Leibniz (1646-1716) intro Law of Assn of Ideas (incl motor) Ver,T.'67- XXXX Buchanan (1785-1829) intro Law of Exercise (frequency) - - Ver,T.'67- XXXX Prob of assn - - - - - - - - - - - - - - - - - - - - - - - Asc,SE'69- hXLX Attrib observational lrng to acq conditional MTS - - - - - Gew,JL'71- Ident imitation as functional R-class, maint w/PRF XXX- Same laws of assn, w/S-US in classcond + S-R in instrucond Kon,J.'73- XXXX Behavioristic anal of complex human choice beh - - - - - - Lac,HM'78+ XXX- Argues that a new (cog) lrng proc emerged during evolution Kli,F.'83- FVXX Attrib lrng in fish to S-substitution re release unlrnd beh Sub,MD'88- ZA-2:00. Acquisition: Empirical Analyses, Generalizations ZZ****AXe XXXX Rejects lrng as decr in synaptic resistance as-f(freq) - - Las,KS'24- Above based on transfer left-right eye, right-left hand OxL- Prob solution varies from reflex/T+E/insight w/22 prob sits Yer,RM'27- XXXX Laws of assn - - - - - - - - - - - - - - - - - - - - - - - Car,HA'31- XXXX Laws of assn: contig/freq/duration/context/assimilation - - Rob,ES'32- Add to above: acquaintance/composition/indiv diff XXXX Essential cond for lrng: temporal gradient re uncond R - - Hun,WS'33- Rxxx Ident speed/fear/insight/transfer factors in 12 lrng sit - Vau,CL'37- Rxxx Factor anal of perf in acty/mazes/prob-box/CR/obstruction - VSt,NJ'39- Rxxx Ident visual percept/fear/adaptable/speed/cognitive/altern VSt,NJ'39- XXXX Lrng set = lrng how to learn a kind of prob w/min errors - Har,HF'49- Lrng set acq over series of prob--from T&E to insight Lrng set not simple S/Genz--Transfer w/in type of prob Attrib perf of educated humans to acq lrng sets in exper XXXX Evidence favoring all-or-none lrng vs continuous strength - Est,WK'60- EG in classcond, P(1st CR) is constant-f(N/trials) ZA-3:00. Acquisition: Models ZZ****AXm XXXX Mechanical model of lrng re law of effect - - - - - - - - - Ste,JM'29- ZA-4:00. Acquisition: Theoretical Analyses ZZ****AXT XXXX Lrng = assn, but man also learns by perceiving relationship Ree,HB'27- Exercise (freq/recency) fundamental but set controls laws XXXX Sensory memory is-f arrangement of molecules of nerve cells MBr,EW'28- XXXX Anal of lrng as physical system that minimizes free energy Ras,N.'31- XXXX Satisfier --> R-->incr assn; annoyer --> R w/no decr assn - Tho,EL'32- XXXX Prin: Ss acting at time of R tend to evoke that R - - - - - Gut,ER'33- No gen law re assn as-f(time interval); is-f(interval beh) XXXX Theory based on hypo that every nerve has excit/inhib prop Ras,N.'33- XXXX Sign-Gestalt: S --> discrim/manip + means-ends expectations Tol,EC'33- XXXX Math lrng th based on counter-cond of errors - - - - - - - Ras,N.'36- XXXX Math th of cond based on spread of excit to brain fibers - Ras,N.'37- RMXX Hypothesis =f(sum OBO) (choice object-->behavior-->object) Tol,EC'38- XXXX Reinf protects previous R from being unlearned - - - - - - Gut,ER'40- Lrnd R is a mvmt; acq acts as-f varied trng XXXX Interp latent lrng re surrogate-R (percept + implicit R) - Sew,JP'47- XXXX Derive latent lrng as special case w/habit strength =f(D) - Dee,J.'50- XXXX Stat th of lrng - - - - - - - - - - - - - - - - - - - - - - Est,WK'50- R-class (act) disting from R-occurrence (mvmt) s = random sample of elements from S = stim population R cond to s as-f contig occurrence (incl break other assn) Eg in classcond, incr in P(CR) = constant-f(1 - (PCR)) XXXX Th of Adaptive Differentiation: Beh decr disequilibrium - - Cal,WE'51- It is the organism, not the R, that is conditioned XXX- What is being noticed becomes S for what is being done (186 Gut ER'59- ZA-5:00. Acquisition: Bibliographies, Collections ZZ****AZb A-6.00. Acquisition: Conferences, Symposia, Editions ZZ****AZc XXXX Issues in lrng - - - - - - - - - - - - - - - - - - - - - - Gol,H.'65e AXXX Issues in animal learning Rey,JH'70- AXX- Animal lrng: Symposium at Dalhousie Univ, 1969, 7 articles Hon,WK'71+ B.W.Agranoff, E.J.Capaldi, H.Gleitman, J.L.McGaugh- R.G.Dawson, S.Revusky, N.E.Spear, E.Winograd XXXX Constraints on lrng - - - - - - - - - - - - - - - - - - - - Hin,RA'73+ XXX- Processes of Animal Memory - - - - - - - - - - - - - - - - Med,DL'76e 1974 Conference at Augustana College, 9 articles R.T.Bartus-T.E.LeVere, R.C.Bolles, M.R.D'Amata-J.K.Cox, R.T.Davis-S.S.Fitts, D.L.Medin, F.T.Ruggiero-S.F.Flagg, W.A.Roberts-D.S.Grant, N.E.Spear-P.J.Parsons, J.W.Whitlow XXX- Animal lrng: Survey and anal - - - - - - - - - - - - - - - Bit,ME'79e XXX- Info-processing in Animals: Memory Spe,NE'81+ XXX- Memory and Brain: Integrate Psych/Neurobiol work - - - - - Squ,LR'87- ZE-1:00. Extinction: Conceptual Propositions, General ZZ****EXc HXXO Genz: Old habit does not vanish w/acq of new reaction to S Bai,JH'03- XXXX Inhib = facil of some other mech, not specific process - - Cha,MN'31- XXXX Disting forgetting (impaired lrnd R) vs extn (no motiv) - - Fin,G.'35+ XXXX S-R reinf th of extn - - - - - - - - - - - - - - - - - - - Gle,H.'54e XXX- Attrib latent extn to mod of rg-sg w/in S-R reinf th - - - Mol,H.'57- XXX- Motiv interp of extn - - - - - - - - - - - - - - - - - - - Bir,D.'61- XXX- Cog interp of PREE - - - - - - - - - - - - - - - - - - - - Ams,A.'64- XXXX Disting assoc/activatn component of beh; extn=decr activatn Mar,MH'66- MxE- Shock/lite/noise B4 extn facil occur of emot R to extn - - Ish,S.'76+ ZE-2:00. Extinctiom: Empirical Analyses, Generalizations ZZ****EXe XXXX Genz: PRF in all lrng sit incr R/Extn re CRF (PREE) - - - - Jen,WO'50+ XXX- R/Extn and transfer - - - - - - - - - - - - - - - - - - - - And,NH'63- XXXX Concl: ORE inconsistent, w/visual > spatial - - - - - - - - Pau,C.'65- XXXX Anal ORE re rate extn old vs rate acq new Pau,C.'65- ZE-3:00. Extinction: Models ZZ****EXm ZE-4:00. Extinction: Theoretical Analyses ZZ****EXT XXX- Extn is instance of inhib cond--Neg adapt (79) - - - - - - Gut,ER'35- XXX- 3-factor th of inhib - - - - - - - - - - - - - - - - - - - Ams,A.'51- XXX- Th: Occur of R-->Reactive inhib (Ir), dissipates w/time (9) Hul,CL'52- Th: Above=neg D, reinf cessatn of R-->Cond inhib (sIr) (10) H - Stat lrng th of nonreinf - - - - - - - - - - - - - - - - - Atk,RC'56- XXXX Extn explainable by Law of Assn by Contiguity (171) - - - - Gut,ER'59- XXXX Sequential hypo: S-value of nonreinf is-f N/successive N tr Cap,EJ'66- Implies R/Extn after PRF is-f genz to 100% nonreinf Above genz is-f max/variance/freq of N-lengths in PRF sched XXX- Th of extn - - - - - - - - - - - - - - - - - - - - - - - - Den,MR'71- XXXX Gen th of persistence - - - - - - - - - - - - - - - - - - - Ams,A.'73- ZE-5:00. Extinction: Bibliographies, Collections ZZ****EZb ZE-6:00. Extinction: Conferences, Symposia, Editions ZZ****EZc ZG-1:00. Generalization: Conceptual Propositions, General ZZ****GXc MXXX Ident S-equivalence re transpositn re weight/vision/auditn Klu,H.'33- XXXX Complete S/Genz early in trng w/gradual devel of gradient - Hul,CL'47- Generalized CR more susceptible to extn Diffcond steepens S/Genz gradient, w/S-inten effect XXXX Asserts that the contention that the S/Genz gradient is generated during testing is operationally meaningless - Gri,GR'51- XXX- Review relevance of spatial/temporal goal gradient concepts Coh,J.'53- XXXX Hypo: Primary S/Genz is-f N/afferent neurones in common - - Wol,J.'53- HOOO Attrib R/Genz gradient to diff R/Extn as-f sim to reinf R - Dun,CP'55- XXX- Re S/Genz, no way to order sim of complex S (eg people)(58) Log,FA'55e XXXX Cannot logically separate S/Genz vs R/Genz - - - - - - - - Daw,RM'63- ZG-2:00. Generalization: Empirical Analyses, Generalizations ZZ****GXe RAPH Weak novel S decr R in acq, incr R in extn - - - - - - - - Gag,RM'41- ZG-3:00. Generalization: Models ZZ****GXm ZG-4:00. Generalization: Theoretical Analyses ZZ****GXT XXX- Th: S/Genz gradient of sHr on qual/inten continua (10) - - Hul,CL'52- Th: Above S/Genz applies to interoceptive (eg sD) stim (ll) Hul,CL'52- ZG-5:00. Generalization: Bibliographies, Collections ZZ****GZb ZG-6:00. Generalization: Conferences, Symposia, Editions ZZ****GZc XXX- S/Genz: Conference at Boston Univ, 1963, 22 articles - - - Mos,DI'65- M.R.Baron, D.S.Blough, J.S.Brown, C.M.Butter-M.Mishkin- H.E.Rosvold, W.W.Cumming-R.Berryman, D.V.Cross, H.Friedman, L.Ganz, N.Guttman, E.Hearst, H.S.Hoffman, W.K.Honig, G.R.Grice, H.M.Jenkins, C.C.Perkins, W.L.Randall, R.N.Shepard, B.F.Skinner, S.S.Stevens, D.R.Thomas, R.F.Thompson, M.Yarczower-M.E.Bitterman ZJ-1:00. Punishment: Conceptual Propositions, General ZZ****JXc HXX- Concl punish fixates R, does not weaken it - - - - - - - - Sto,GR'53- XXX- R-produced cues assoc w/punish become secondarily aversive Din,JA'54- Hence interp decr effect of punish as avoid R-produced cues XXXX Quant of conflict th - - - - - - - - - - - - - - - - - - - And,NH'61- XXX- Punishment Sol,RL'64- RUPS Concl: Decr inhib effect of punish if assoc w/pos reinf - - App,JB'68- ZJ-2:00. Punishment: Empirical Analyses, Generalizations ZZ****JXe XXXX Reviews empirical evidence re avoid interp of punishment - Din,JA'55- XNX- Identify reinf ESB in ant-limbic, pun ESB in post-reticular Old,J.'55- Concludes reward/pun are separate, each w/Drive component HLL Avoid repeating punished words in assoc tasks w/w/out aware Eri,CW'56+ XXX- Punish: Aversive S conting on R; effect > nonconting S - - Chu,RM'63- Effects of punish varied--may lead to facil or suppression Eval fear/UR/ER/reinf anal of punish XXXS OpR suppression exponential incr-f(shock punish inten) - - App,JB'65+ OpR suppression is temporary w/mild, persistent w/inten pun RUPH Major determinants of punish ident to reinf - - - - - - - - Chu,RM'69- ZJ-3:00. Punishment: Models ZZ****JXm ZJ-4:00. Punishment: Theoretical Analyses ZZ****JXT RAAx Stable equilibrium in conflict: R1 occur decr R1 or incr R2 Mil,NE'44- Stable equilibrium: Approach-avoid or avoid-avoid Th: Gradients of approach-avoid decr-f(distance from goal) Th: Avoid gradient steeper than approach gradient Th: Heights of gradients incr-f(relevant D) Describes exper tests of implications of above th Eg paradox effect: Incr app D-->nearer goal + more conflict XXXX Th: punish symmetrical w/reinf, neg vs pos incentive motiv Log,FA'69- ZJ-5:00. Punishment: Bibliographies, Collections ZZ****JZb XXX- Reprints of 23 articles on punishment - - - - - - - - - - - Boe,EE'68+ ZJ-6:00. Punishment: Conferences, Symposia, Editions ZZ****JZc XXX- Punishment and aversive behavior - - - - - - - - - - - - - Cam,BA'69+ Conference at Princeton University, 1967, 15 articles J.S.Brown, B.A.Campbell-F.A.Masterson, R.M.Church W.K.Estes, H.Fowler-G.J.Wischner, E.Hearst, H.S.Hoffman L.J.Kamin, F.A.Logan, S.F.Maier-M.E.P.Seligman-R.L.Solomon N.E.Miller-J.M.Weiss, O.H.Mowrer, H.Rachlin-R.J.Herrnstein J.P.Seward, A.R.Wagner XXX- Aversive cond and lrng - - - - - - - - - - - - - - - - - - Bru,FR'71- Analyses of aversive cond, avoid lrng, punishmt, 9 articles A.H.Black, R.C.Bolles, F.R.Brush, M.R.Denny, H.Fowler, W.R.McAllister-D.E.McAllister, J.S.Myer, J.Theios, M.E.P.Seligman-S.F.Maier-R.L.Solomon ZK-1:00. Reinforcement: Conceptual Propositions, General ZZ****KXc AXXX Proposes recency/frequency/intensity principles vs hedonism Car,H.'14- XXXX Nature/effect of incentive - - - - - - - - - - - - - - - - Leu,CJ'30- XXXX Argues against cond as basis of habit vs mech law of effect Ste,JM'31- XXXX Reject law of effect (pleasure-pain) re retroactive effect Cas,H.'32- XXX- Law of Emphasis (-Effect): Lrng incr by exciting S/US (387) Tol,EC'32- XXXX Interp law of effect re persistent trace vs retroaction - - Bor,EG'33- XXXX Law of Emphasis: Acq of expectation incr-f(emphatic result) Tol,EC'33- XXXX Attrib effect of Delay(Reinf) to intervening activities - - DMo,G.'34- XXXX Disting Law of Effect not Affect; former needs elab re rate Wat,RH'34- XXX- Discussion of Law of Effect - - - - - - - - - - - - - - - - Car,HA'38- All aggree to basic empirical Law (beh is-f consequences) Tolman: Disting lrng/perf (latent lrng/extn/drive discrim) Thorndike: Include spread-of-effect, only min reinf nec Culler: Cond (energy for R in S) vs lrng (energy in effect) Dashiell: Disting Law of Effect from Affect; backward actn Muenzinger: Facil lrng if cause to pause at choice pt XXXX Disting lrng vs perf; rapid incr in perf w/latent/re-lrng - Tol,EC'38- RARH Interp Perf=f(Amt(Reinf)) as motivation (eagerness) vs lrng Cre,LP'44- XXXX Critical of Hull ('43) molecular bias and trtmt of reinf - Rit,BF'44- XXX- Effect-Sec prin of lrng - - - - - - - - - - - - - - - - - - All,GW'46- XXXX Law of effect - - - - - - - - - - - - - - - - - - - - - - - Pos,L.'47- XXXX Favors 1 prin of reinf in classcond vs 2-stage anal - - - - Ken,HH'48+ XXXX Law of Effect reflected associationism/hedonism/evolution - Pos.L.'48- XXXX Concl: Law of Effect not monistic prin to explain all lrng Pos,L.'48- XXXX Def: Reinf is S-->incr R-strength - - - - - - - - - - - - - Mee,PE'50- Weak Law of Effect: Reinf for 1 R = Reinf any learnable R Note: Above trans-situational prop avoids circularity Strong Law: Every incr in R-strength requires reinf XXXX Primary/sec reinf =f(decr in central neural excit (drive)) Wol,J.'50- XXXX Motiv function of reward - - - - - - - - - - - - - - - - - Sew,JP'51- XXX- Lrng is-f temporo-spatial contig S w/elicited R, not D-decr Har,HF'53- XXX- Hypo: Reinf = Any S that elicits characteristic R - - - - - Maa,JL'54- XXX- Disting sec reinf re Pair(S,em+US) vs decr in acq drive - - See,W.'55+ XXXX Anal of disinhib/spon-rec/relrng re role of reinf as S - - Rei,RL'58- XXX- Incentive = hypo construct =lrnd f(conditions of reinf) (4) Log,FA'60- XXX- Incentive value (food) not-f(dep) (113) Log,FA'60- XXXX Dissonance th anal of effects of "insufficient" rewards - - Fes,L.'61- PVPH Concl: Some reinf value assoc w/S-change App,JB'63- XNXO Interp ESB reinf re Deutsch's structural th - - - - - - - - Gal,CR'64- Above re no satiation, rapid extn, primary but no sec reinf XXXX Notes operational identity of sec-reinf and frustration - - Ams,A.'68- XXXX Hypo: Reinf = attractiveness of S re pref - - - - - - - - - Per,CC'68- XXXX Hypo: Beh change=f(transmit attractiveness to antecedent S) Per,CC'68- XXXX On the law of effect - - - - - - - - - - - - - - - - - - - Her,RJ'70- XXXX Interp Law of Effect re correl environ w/beh events - - - - Bau,WM'73- Eg above, fdbk function__Rate(Reinf) correl w/Rate(OpR) Disting molar value of sit or act re Rate(Reinf/Punish) XXXX Interp Pavlov as using homeostatic balance as Law of Effect Kim,HD'76- XXXX Any S can serve a reinf function re parameters - - - - - - Sch,WN'78- XXX- Contends all evidence for nec of conting in lrng defective Gar,RA'88+ Re above, favors ethological feedforward model vs effect XXXX Eval dep + disequilibrium approach to identifying reinf - - Tim,W.'91+ XXXX Interp reinf re contingent-R-dep schedule re baseline - - - All,J.'93- XXXX Beh system w/complex interrelated cause-effect seq of reinf Tim,W.'93- ZK-2:00. Reinforcement: Empirical Analyses, Generalizations ZZ****KXe XXXX One effect of reinf is to inhibit precurrent restless beh - Gut,ER'39- XXXX Durable sec reinf if partial reinf in both acq/test sit - - Zim,DW'57- XXX- Concl sec reinf lit inconsistent re effects of exper var - Mey,JL'58- RXXX Concl: Rate of lrng not-f(Amt(Reinf)) except at zero - - - Pub,BH'60- Concl: Perf incr-f(Amt(Reinf)), not-f amt lrng Concl: R/Extn is-f(Amt(Reinf) re acq perf level, not rate Concl: Effect of Amt(Reinf) is-f amt/rate(consum acty) Concl: Effect of Amt(Reinf) greater w/diff reinf w/in subj XXX- Concl: No sec reinf based on primary neg reinf - - - - - - Bec,RC'61- XNXX Eval research w/ESB (in)consistent w/D-reduction reinf th - Mil,NE'61- XXXX Hypo: Strong/durable sec reinf only w/repeated recond - - - Wik,EL'69- XXXX Attrib decr effect of long ISI to interfering assns - - - - Rev,S.'71- Above incl irrel antecedent or consequent events AXOO Reinf w/opportunity for aggressive beh may be due to Tay,GT'79- concur non-aggressive social interaction - - - - - - - - Tay,GT'79- XXXX Review contradictory effects of Amt(Reinf) on beh - - - - - Bon,M.'88+ XDXX Disting opiates (eg MORPH) vs endogenous neuropeptides - - Bru,FR'89+ XXXO Copulation reinf re acq/extn/discrim w/species/gender diff Cra,LL'93e ZK-3:00. Reinforcement: Models ZZ****KXm ZK-4:00. Reinforcement: Theoretical Analyses ZZ****KXT XXX- Reinf th - - - - - - - - - - - - - - - - - - - - - - - - - Pre,D.'65- XXXX Biol th of reinf re pos/neg effect of ESB re adaptive beh - Gli,SE'67+ XXX- Reinf, expectancy, and lrng - - - - - - - - - - - - - - - - Bol,RC'72- XXXX Th: Food dep incr pos hedonic value of food (vs D-reductn) Cyt,J.'78+ ZK-5:00. Reinforcement: Bibliographies, Collections ZZ****KZb ZK-6:00. Reinforcement: Conferences, Symposia, Editions ZZ****KZc XXXX Conditioned reinf - - - - - - - - - - - - - - - - - - - - - Hen,DP'69- XXX- Reinf and behavior - - - - - - - - - - - - - - - - - - - - Tap,JT'69- Talks at Geo.Peabody/Vanderbilt Univ, 1966-67, 13 articles D.E.Berlyne, P.L.Carlton, K.N.Clayton, W.K.Estes I.Kupfermann-H.Pinsker, C.Pfaffman, D.Premack, L.Stein J.T.Tapp, E.S.Valenstein, E.L.Walker, H.C.Wilcoxin XXXX Nature of reinf - - - - - - - - - - - - - - - - - - - - - - Gla,R.'71- XXXX Reinforcement: Behavioral Analysis - - - - - - - - - - - - Gil,RM'72+ 1970 Symposium at Univ of Toronto, 10 articles A.H.Black-G.A.Young, T.M.Bloomfield, R.M.Gilbert, S.E.Lea- M.J.Morgan, J.R.Millenson-P.A.deVilliers, D.Premack, W.N.Schoenfeld-B.K.Cole, E.F.Segal, J.E.Staddon. R.Stretch ZL-1:00. Language: Conceptual Propositions, General ZZ****LXc XXXX Attrib consciousness to assn of language R to sensory proc Hun,WS'24- XXX- Thinking=implicit reactions incl viscera; language is key - Das,JF'25- HLL- Beh is organized like language in hierarchy of units (106) Car,JB'53- XXX- Same lrng/beh prin for language incl copying w/fdbk (86) - Log,FA'55e ZL-2:00. Language: Empirical Analyses, Generalizations ZZ****LXe hLLO Mod syntactic style (eg passive) w/model + verbal reinf - - Ban,A.'61+ ZL-3:00. Language: Models ZZ****LXm ZL-4:00. Language: Theoretical Analyses ZZ****LXT HfL- Th: Intended utterance in STM + monitoring fdbk from output Fai,G.'54- ZL-5:00. Language: Bibliographies, Collections ZZ****LZb ZL-6:00. Language: Conferences, Symposia, Editions ZZ****LZc HXL- Percep/production of fluent speech - - - - - - - - - - - - Col,RA'80- ZM-1:00. Motivation: Conceptual Propositions, General ZZ****MXc XXXX S-R formula underemphasizes role of indiv drive/motives - - Thu,LL'23- XXXX Treat emotion as R to S (avoid/destroy/entice) - - - - - - Tol,EC'23- HXXX Desire control/creative employment of fear rather than elim Cor,A.'26- XXX- First-order drives (appetites/aversions) re physical cond - Tol,EC'26- 2nd-order-drives (eg curiosity) dependent on 1st-order XXXX Objects explicit; energy (gravity/drive/instinct) implicit All,FH'30- XXXX Anal of motiv - - - - - - - - - - - - - - - - - - - - - - - Gra,L.'32- XXXX Drive: Total of internal changes in O as-f(dep) - - - - - - Ell,MH'35- XXXX Disting hunger from appetite=pref for 1 of several foods - Mas,AH'35- Hypo: Appetite more important as go up phylogenetic scale XXXX Interp emotion and drive re propriocept and sympathetic - - Ell,MH'36+ MSOO 2-drive th of sex beh: Sex drive and dominance - - - - - - Mas,AH'36- XXXX Drive: persistent disequilibrium re internal/external mech Sew,GH'37+ XXXX Ident pos/neg primary/secondary demands w/conflict - - - - Tol,EC'37- XXXH Hunger is-f gastric contraction, psychol appetite, weakness Bas,KW'39- XXEE Frustration and aggression - - - - - - - - - - - - - - - - Dol,J.'39e XXXX Dialectic proc re motiv; hedonism vs react (environ) - - - Seq,GH'39- XXXX Hypo: Internal D (eg hunger) aroused by sit where satisfied And,EE'41- XXXX Disting externalization of drive from antic of reward - - - Sew,JP'42- XXE- Interfere w/goal-->frustration-->variety of reactions - - - Bri,SH'46+ XXXX Emotion in man and animal - - - - - - - - - - - - - - - - - Heb,DO'46- XXXX Postulates react pot is-f S-inten dynamism incr-f(S-inten) Hul,CL'49- XXEE Frustratn is-f interference w/ongoing beh re conflict/inhib Bro,JS'51+ Re above: Frustration has both gen motiv and cue functions XXX- Fear as motiv force--Dilemma re functional autonomy - - - - Egl,A.'52- What motivates the fear R? (FAL: Pos fdbk) XXXX Reject functional autonomy and irrel D for R w/out orig D - Web,WB'52- Attrib R w/out orig D to lrnd D or redintegration XXXX Prop of D: Energize beh, reinf w/decr, punish w/incr - - - Bro,JS'53- Beh directed by S, not by D qua D Apply above to acquired D (affection, eminence, money) XXXO Emphasize drive as-f(external stim) vs internal state - - - Har,HF'53- XXX- Role of drive depends on nature/complexity of R hierarchy - Spe,KW'54- XXXX Drives--Conceptual nervous system - - - - - - - - - - - - - Heb,DO'55- XXX- Proposes concept of optimal stimulation vs cond/reinf - - - Leu,C.'55- R - Sec reinf cond w/1 primary reinf=generalized cond w/several Wik,EL'55+ XXXO Concl need for affective (hedonic) proc in S-R approach - - You,PT'55- XXX- Views primary D as summated state w/threshold - - - - - - - Aus,DP'56- RXXH Concl: Need to specify dep sched re time-of-dep meas of D - Eis,E.'56- XXX- Favors generalized D activates any R - - - - - - - - - - - Cha,RA'57- AXL- Need concep framework for effect of ESB on lrng/motiv - - - Zie,HP'57- XXXX Ident attachment as-f(contact comfort) vs need reduction - Har,HF'58- XXXX Define affective proc (hedonic continuum) max pos + min neg You,PT'59- XXXX Questions need for motiv as source of energy for beh - - - Hin,RA'60- Organism always doing something, w/P(R) mod by int/ext Ss XXXX Brain not passive switchboard; controls sensory input - - - Mil,NE'61- Brain monitors internal environ, senses chem messingers Evidence electrical/chemical coding drive/reward in brain ANXX Must study >1 meas of variable to make construct meaningful Mil,NE'61- XXX- Disting role re nonreward in cond-expect vs cog-expect th - Ams,A.'62- XXXX Motiv in lrng th - - - - - - - - - - - - - - - - - - - - - Hil,ER'63- XXXX Decade of motiv th - - - - - - - - - - - - - - - - - - - - Ber,DE'64- XDX- Review chem coding (eg cholinergic/andrenergic) in brain - Mil,NE'65- XXXX Adapt-level th--Aversive beh - - - - - - - - - - - - - - - Qui,VL'70- XXB- Data support view that motiv affects reaction threshold - - Gri,GR'71- XXXX Motiv is-f constraint on normal pattern of feeding/drinking Col,GH'72e Short-term intake is anticipatory of need, not regulatory Eat/drink pattern is-f ecological niche (carni-/herbivore) ASOS Ident attractivity/proceptivity/receptivity w/estrus female Bea,FA'76- XXXX Opponent-process th and drug addiction Sol,RL'77- XXXH Opponent-process th and eating beh Sol,RL'77- XXX- Opponent-process th of acquired motiv Sol,RL'80- XXX- Opponent-process th of pleasure/pain Sol,RL'80- XXX- Opponent-process th of acquired motiv Sol,RL'80- XXX- Opponent-process th of acquired motiv Sol,RL'82- XXX- Study of Behavior: Behavioral Pharmacology Chu,RM'85- XXXX Reviews frustration construct re cog/behavioristic th - - - Ams.A.'91- XXXX Prefers adjectival form (driven/motivated) vs noun motivatn Bro,JS'91- Defined by prior trtmt, current trtmt, organic or R meas RXXH Concl: Feed dep-->salient interocerptive stim re feeding - Dav,TL'93- ZM-2:00. Motivation: Empirical Analyses, Generalizations ZZ****MXe xCxH Sensation of hunger correl w/periodic stomach contractions Wad,T.'22- Contractions correl w/incr salivatn, bodily mvmt, dreaming Contractions correl w/incr strength of grip, I.Q. scores Concl: W/animals/humans, hunger-->whole-body tension-->acty AXXX Measure drive re overcoming strength of (shock) resistance Mos,FA'24- Drives may combine strength to overcome resistance Mos,FA'24- XXXX Inanition decr spon acty, reproduction, rate of lrng - - - Sto,CP'28- XXXX Re obstruction, hunger incr-decr-f(0/a/2/3/4/6/8-d dep) - - War,LH'28- Max w/females at 1-d = max for males at 4-d War,LH'28- ROPx Review of research w/Columbia obstruction (grid) method - - War,CJ'31- W/male: thirst . hunger > sex > exploratory drives War,CJ'31- W/female: maternal > thirst > hunger > sex > exploratory War,CJ'31- RSRx Rank drive (maternal/thirst/hunger/sex/explor) w/cross grid War,CJ'32- MSOH Re Lat(cross-shock R), hunger incr-f(dep to 24=48 hr) - - - War,CJ'35+ MSRH Drive incr-f(food dep) re cross grid w/rhesus - - - - - - - War,CJ'35+ Rxxx Signif correl re indiv diff in hunger/thirst/sex/explor D - And,EE'37- RSCS Signif but lo inter-correl re diff meas of "sex drive" - - And,EE'38- RTPx Concl: Hunger/sex motiv can co-exist - - - - - - - - - - - Sto,CP'38+ AXEO Concl: Genetic factor in emotionality - - - - - - - - - - - Hal,CS'41- XXXX Drive is-f(maint constant internal environ) incl specific Ric,CP'41- drives re removal of physiol means (eg adrenalectomy) - Ric,CP'41- MXXO Evidence for S-elicited motives (explor/manip/curiosity) - Har,HF'54- HVOO P(noticing a cue) incr-f(novelty) - - - - - - - - - - - - - Ber,DE'57- XNX- Review exper on motiv w/ESB--Hunger/Reward/Thirst/Aggressn Mil,NE'57- XNXO Review research on direct ESB as source of motiv/reward - - Mil,NE'58- XXXH Review motiv (hunger/reward/aversive) effects of ESB - - - Mil,NE'60- Need variety of meas--Most not pure meas of single variable Word in vernacular (eg hunger) may not mean single variable XXXX Motivation =facilitate, vigor, guide, reinf/punish beh (13) Cof,CN'64+ Instinct th--ethology--energy release thru innate act (105) Eg Innate releasing mech of fixed action pattern (67) No evidence against imprinting as special case of lrng (90) Motiv re bodily cond: maternal beh mainly hormonal (201) Motiv re bodily cond: hoarding is-f complex variables (202) Motiv re bodily cond: fatigue aversive, antic/avoid (202) Motiv re bodily cond: sleep is complex restore state (203) Motiv re bodily cond: sex is-f(stim > dep) (203) Motiv re bodily cond: hunger is-f multi_hypothal ctrs (267) Nituv re bodily cond: thirst is-f cell dehydration (268) Motiv re bodily cond: pain R modifiable w/indiv diff (268) Disting restless/running acty, may reflect lrng (301) Status of curiosityexplor/manip as motiv uncertain (301) Homeostasis (equilibrium) nec, not suff re creative R (306) Approach/avoid re cues assoc w/(un)pleasant feelings (410) Beh efficiency incr-decr-f(emotional arousal) (411) Thwart goal beh-->frustration w/drive/cue prop (429) Above frustration-->aggression/regression/fixation Incompatible action tend-->conflict w/app/avoid grad (441) Motiv central to lrng th--biol-oriented re survival (518) Re-establish equilbrium fundamental to all motiv th (811) Hypo: Sensitization- and antic-invigoration mech vs "Drive" RDXH Amylobarbitone sodium incr IR/OpR assoc w/reinf/pun - - - - Mil,NE'64- Above not due to age of habit, S-change, or S-interference Acq OpR for amylobarbitone reinf in fear context Amylobarbitone incr R/Extn of IR Beh effect of amylobarbitone did not genz to non-drug state Interp: Amylobarbitone sodium decr fear/frustration XXX- Anal determinant of stress re lrnd helplessness/irrelevance Ove,JB'88- XXX- Historical background re study of aversively motivated beh Ove,JB'89+ ZM-3:00. Motivation: Model ZZ****MXm XXXX Diagram model of beh re needs, belief-values, beh space - - Tol,EC'52- XXXX Model for determining motiv state re rel food/H2O deficit - Sib,RM'76+ ZM-4:00. Motivation: Theoretical Analyses ZZ****MXT HXE- 4 feelings (pain/pleasure/excitement/depressn) in hypothal Har.HF'32+ HXE- Emotion is cond elementary affective state + aware of S-sit Har,HF'33+ XXXX Ident motiv re id/ego/superego/enlarged ego wants - - - - - Tol,EC'41- Id wants fundamental, source of other wants Enlarged ego wants: identify with, adherence to group Need harmony, reasonable satisfaction of all wants Above Utopia requires educ, new emotional dynamic (religion XXOO Th: Novel S-->Curiosity (a drive-S-producing R) - - - - - - Ber,DE'50- Above curiosity decr-f(time of exposure to S) Above th accounts for facts of exploratory beh w/rats XXX- Learnable drive/reward--Acq by previously ineffective cue - Mil,NE'51- Fear is learnable drive, fear reduction is a reward Learnable drive/reward must produce lrng/perf of new R Fear has innate R-tend, can mediate old/new lrnd R Fear acq by Pair(neutral S, innately fearful S) Principles of lrnd fear same as lrng of other R XXXX Th of motiv in lrng - - - - - - - - - - - - - - - - - - - - Sew,JP'52- HXEO Th of human curiosity - - - - - - - - - - - - - - - - - - - Ber,DE'54- XXX- Th: Nonreward in reward context --> Learnable frustration R Ams,A.'58- Th: Fractional antic frustration rf w/motiv/inhib prob Th: Overt R to rf-sf mod w/trng (eg PRF) XXX- Postulate weights of S classes in S-sampling theory of D - Est,WK'58- Satiation cues decr, dep cues incr w/dep Above S element sets partially overlap w/in satiatn/dep set CS cues constant, extraneous cues random w/constant average Extraneous cues assoc w/incompatible R Implies no relation of D to acty R=f(D) only re incompatible R, w/no effect on choice Lrng curves w/diff D diverge-then-converge Assymmetry when train/test at hi/low D, greater w/incr S/Genz gradient flattened by incr D, steepened by decr D Irrel D affects R only in overlap in S elements HXXX Orienting R (OrR) focus/direct/sensitize receptor re explor Ber.DE'60- Genz: Locomotor explor beh incr-f(novelty/complexity) Investigative R = action re object w/manip Epistemic curiosity = seeking info re conflict/incongruity XXXX Disturb pref equilibrium --> arousal of central motiv state Sta,R.'61- Arouse of c.m.x.--> incr acty; decr in c.m.s.--> reinf Note: Hierarchy of steady states; may incr one to dec other HXXx Applies approach-avoid conflict theory to psychotherapy - - Mil,NE'64- Eg w/weak, unreal fears, incr approach D-->Goal + fear extn Eg w/strong fear, less neg effect if decr fear vs incr app HXXO Hypo: W/complex task, error-->frustration-->competing R - - Sch,RR'70+ XXXX Sensory reinf relative: lite-on is reinf/pun re prior illum Fow,H.'71- Treats "drive" (setting) operations as affecting incentive Treats incentive motivation re classcond antic reinf/punish ZM-5:00. Motivation: Bibliographies, Collections ZZ****MZb ZM-6:00. Motivation: Conferences, Symposia, Editions ZZ****MZc XXX- Symposium at Univ of Nebraska, 1953, 6 articles - - - - - - Jon,MR'53- J.S.Brown, H.F.Harlow, O.H.Mowrer, T.M.Newcomb, V.Nowlis, Jon,MR'53- L.J.Postman XXX- Symposium at Univ of Nebraska, 1955 XXX- Symposium at Univ of Nebraska, 1956, 6 articles - - - - - - Jon,MR'56- F.A.Beach, S.Koch, M.H.Marx, D.R.Miller-G.E.Swanson J.P.Seward, R.L.Solomon-E.S.Brush XXX- Symposium at Univ of Nebraska, 1957 XXX- Symposium at Univ of Nebraska, 1958, 6 articles - - - - - - Jon,MR'58- R.C.Bolles, C.W.Eriksen, W.K.Estes, R.A.Littman, R.B.Malmo K.W.Spence XXX- Symposium at Univ of Nebraska, 1959 Jon,MR'59- XXX- Symposium at Univ of Nebraska, 1961 Jon,MR'61- XXX- Symposium at Univ of Nebraska, 1963 Jon,MR'63- XXX- Symposium at Univ of Nebraska, 1964 Jon,MR'64- XXX- Symposium at Univ of Nebraska, 1964, 6 articles - - - - - - Lev,D.'64- A.L.Edwards, E.R.Hilgard, F.A.Logan, G.Mandler E.L.Walker, S.Schacter-B.Latane XXX- Current research in motivation - - - - - - - - - - - - - - Hab,RN'66- Collection of 76 research papers and theories of motiv Instinct beh, primary/sec drives, punish/frustration/stress Arousal/activation, explor beh, reward/incentive, conflict Anxiety/guilt, fantasy/dreams/unconscious proc XXX- Symposium at Univ of Nebraska, 1968 Jon,MR'68- XXX- Symposium on motiv - - - - - - - - - - - - - - - - - - - - Arn,WJ'69- XXXX Symposium on motiv - - - - - - - - - - - - - - - - - - - - Col,JK'72- XXXX Physiol Mechnaisms of Motiv Pfa,DW'82- ZR-1:00. Response: Conceptual Propositions, General ZZ****RXc XXXX Idea/image need not arouse mvmt; actually, mvmt-->idea - - Tho,EL'13- XXXX Disting adaptive/nonadaptive beh, former maintain self/race Hol,SJ'22- Self: sustentative/protective..race: sexual/parental/social XXXX Re instinct, S releases particular sets of random acts - - Tol,EC'22- XXXX Instinct is cloak for ignorance w/out mechanism of heredity Kuo,ZY'24- Universality of R due to similar structure/environ demand XXXX Pavlovian CR may be simplified habit, but not unit of habit Hum,G.'25- AXXX Re anal of CNS function, tropisms > lrng in mammals - - - - Cro,WJ'26+ XXXX Vol mvmt re motor R assoc by experience w/image of act - - Dum,G.'26- XXXX Denies existence of instincts or inherited indiv diff - - - Wat,JB'27- So-called instincts/indiv diff due to sim/diff environ XXXX Instinct is one of interrelated concepts incl reflex/habit Woo,RS'27- XXX- Beh act--Gob of molar beh re 1 goal/means-object - - - - - Tol,EC'32- AXXX Highest form of animal intel: grasp relations (eg use tool) Bie,JA'33- XXXX All forms of lrng reveal diff aspects of cond reflex - - - Rex,CN'33- XXXX Variability inherent in both S and R on diff occasions - - Ski,BF'35- Define S/R functionally; at level yielding empirical laws Eg: "Bar-press" topography varies but systematic re reinf HLSO Think "saliva"-->salivation; incr-f(familiarity w/language) Raz,GH'36- XXXX Re instinct: Must disting S-prop that arouse beh, vs reflex Las,KS'38- XXXX Cannot define essential prop of R w/out S (9) - - - - - - - Ski,BF'38- Operant: Beh emitted spontaneously w/out detected S (21) RXXX R-differentiatn =f(diff reinf topograph or quant prop (309) Note: W/out diff reinf, R narrowing re freq/difficulty XXXX Instinctive meaningful centrally-coord mvmts released by S Lor,K.'40- XXX- Functional R-def: Any learnable acty of organism - - - - - Mil,NE'41+ Above not circular because it implies R learnable w/any S XXX- Reinf and lrng--Sensory integration - - - - - - - - - - - - Bir,HG'49+ XXXX Anal of Rate(OpR) re P(OpR) and P(IRT) - - - - - - - - - - Mue,CG'50- XfX- Th: Instantaneous cerebral order for temporal mvmt pattern Ruc,TC'51- XXX- Rejects dichotomy that beh is either inherited or acquired Bea,FA'55- XfX- Distinctive fdbk from cue-producing R mediates instru-R - - Gos,AE'55- XXX- Disting 4 types of R definitions in beh sciences (35) - - - Log,FA'55e Above: Mvmt, apparatus, other-organism, internal-state (35) XXX- Molar/molecular R-def--Whether disting qual prop as diff R Log,FA'56- Macro/micro R-def--Whether distinguish quant prop as diff R Treat quant diff beh as diff R, not as meas of same R Def: Interval(Reinf) = Chaining + Nonchaining Delay(Reinf) Implies that diff speed/Amp(R) lrnd as-f correl(reinf) XXX- Two-stages of beh act--Preparatory and consummatory (36) - Woo,RS'58- XXX- Speed is-f(time to complete R), not-f(topography of R) (9) Log,FA'60- XXX- Inst-R inherently inseparable from S; S part of R-def (119) Disting molar/molecular (qual) vs macro/micro (quant) (120) Favors micromolecular R-def--Quant/qual prop are lrnd (121) Instrumental R is chain of mvmts, part of R-def (123) XXXX Inhib: Arrest of a function by action upon it of another - Pil,GW'60+ Re above: Power to execute function is retained HILO Thinking/imaging are covert operants, maint w/self-reinf - Hom,LE'65- XfX- Vol mvmt is complex of leading muscles w/motor bckgnd (147) Lur,AR'66- Skill is a single 'kinetic melody' re internal scheme (148) W/frontal lesion, motor mvmt intact but no correction (156) XXX- Recall of R-representatn requires amplificatn by motiv fdbk Est,WK'69- XXXX Must treat glandular/visceral R exactly like mvmts (viii) - Mil,NE'71- HLXX Soviet psych of volition: Transfer of CR to subvocal S - - Gra,DA'73- Above requires that CR be maint w/changed mode of reinf XXX- Purposeless mvmt as unit of beh a mistake; Act not=sum mvmt Bow,GH'75- XfX- Vol R based on cond image of S-config for act assembly (86) Bin,D.'76- Rf - R definition + number of Rs are parameters of fdbk variable Hal,O.'78+ XfX- Incentive th w/fdbk mech implies micromolecular R-def (176) Log,FA'78+ XXXX Pavlov orienting reflex: Targeting/arousal/percep R to S - Zer,B.'87- Targeting incl mvmt to S, maint fixation, return Percep lrng during arousal if OrR evoked by a new S XXXX Derive beh stereotypy as matching re R-topography/sequence Pea,JJ'88- XXXO Th: Reinf hi effort-->sec reinf re hi-effort fdbk, w/R-genz Eis,R.'92- XXXX Def: Beh momentum = Rate(R) x Resistance-to-change - - - - Nev,JA'92- Rate(R) is-f(R-reinf conting); Resist is-f(S-reinf conting) ZR-2:00. Response: Empirical Analyses, Generalizations ZZ****RXe OCLH Report primacy in pig (persistence of 1st habit lrng) - - - Mye,GC'16- hXXX Disting instincts vs emotions in infancy: fear/rage/love - Wat,JB'19- Infants can form cond emotional reactions to situations Wat,JB'19- XXXX Disting holding still/slow/fast/tension/ballistic mvmt - - Ste,RH'23- Plateau in lrng curve may be due to change in type of mvmt Ste,RH'23- XXBO Disting vol/reflex blink re amp/velocity/duration - - - - - Pea,H.'33- XXBP Disting vol/reflex blink re determinants OXXX Note tendency to repeat beh just completed in insect (wasp) Wey,WK'35- XXXX Speed is-f specific environ factors, not gen factor - - - - Fol,JP'37- XXXX Interrelationships re maze/discrim is-f(scoring measure) - Ghi,EE'37- XXXX Anal preparatory set (expectancy) w/msmt (decr alpha EEG) - Mow,OH'40- XXXX Infer innate predispositions re diff beh chicks/ducks w/H2O Sch,JB'42- XfX- Empirical laws of distal achievement (S & R equivalence) - Bru,E.'52- XXXX Percept lrng nec for recognitn, hence nec for instinct beh Tho,WH'52- XXX- Lrnd qual R-dimensions is-f qual R perf w/reinf (171) - - - Log,FA'60- XFX- Prefrontal cortical area perform fine discrim/timing events Dim,SJ'64- RVCT Diff in antic lick CR is-f diff in operant lick UR to H2O - Boi,R.'68- XXX- Genz: Instrucond of autonomic beh not conclusive - - - - - Kat,ES'68- RXXX 1st-order Markov model fits molar VTE, not mlecular details Sti,AW'76- Xf - R regulation mediated by frontal cortical-limbic system - - Num,R.'78- ZR-3:00. Response: Models ZZ****RXm XXXX Classification of human behavior: - - - - - - - - - - - - - War,HC'19- (1) Reflexes (2) Instincts (nutritive/reproductive) War,HC'19- (3) Instinctive tendencies (imitation/play/curiosity) War,HC'19- (4) Emotions (5) Dispositions (defensive/social) War,HC'19- XXX- Equilibrium model for correl reinf (133ff) - - - - - - - - Log,FA'60- Mutual interdependence: Reinf = f(R) and R = f(Reinf) Former above is terms function, latter is incentive functn W/discontin terms function, P(Reinf)=f(R variability) Predict R at intersection of terms/incentive functions Exper anal of correl reinf not consistent w/above model XXX- 2 models of R on contin scale - - - - - - - - - - - - - - - And,NH'61- XXX- Linear models of continuous R - - - - - - - - - - - - - - - And,NH,64- XXX- Pos correl diff Lat(R) w/choice, rat/pigeon, spatial/visual Cat,J.'68+ Eval math models for above relationship XXXX Models re disutility of effort vs P(success)=incr-f(effort) Tho,EA'83- ZR-4:00. Response: Theoretical Analyses ZZ****RXT XXXX Perf is-f antic preparatory set w/image of expected S - - - Mow,OH'38- XXXX Effort-->R-produced S w/both drive/cue properties - - - - - Sol,RL'48- Incr effort-->incr neg motiv, but may incr cond stim XXXX Elicitation th: Perf is-f(beh elicited by post-R S) - - - - Den,MR'55+ XXX- Many cond of reinf-->Same level of perf - - - - - - - - - - Log,FA'60- Micromolar th: Select R speed to max reinf, min effort Concl: Quant as well as qual features of R always lrnd XXX- Must analyze beh on all levels of complexity simult (13) - Mil,GA'60e XXX- Molar unit are beh strategy; molecular unit are tactic (17) Image--All the accumulated knowledge about self/world (17) Person always executing Plan; choice re value to Image (62) Instinct is an inherited, inflexible, involuntary Plan (74) Regulate/integrate muscular coordinatn w/analogue Plan (92) XfX- 1. Afferent synthesis all ext/internal sit/trigger afferent Ano,PK'61- 2. Acceptor-of-actn integrates afferent results of future R 2a. Acceptor-of-action incl all sources of fdbk, esp effect 2b. Acceptor-of-actn corresponds to idea/intent to perform 3. Integrated effector excitatn coupled w/afferent synthsis 3a. Effectors incl somatic/vegetative components 3b. Effectors incl anticipatory compensatory adjustments 4. Return afferentation (>proprio fdbk) to acceptor-of-actn 5. Error correctn until results coincide w/initial intentn XfX- Info irrel to major motive excluded from afferent synthesis Ano,PK'69- Environ stim prepare subj for R, timed by activating S Afferent synthesis incl retrieval from memory B4 decision Acceptor-of-effect = future afferent results (incl purpose) More delicate afferent synthesis, more precise action prog Divergence--goal/result has emotional element (eg aggressn) If return afferentatn not=acceptor-effect, analytic orient XfX- Intrinsic fdbk received if sensory pathways are functioning Gre,AG'70- Extrinsic fdbk requires added external mechanism Genz re intrinsic fdbk probably apply to extrinsic fdbk Fdbk control of serial beh chain implied by S-R contiguity Serial chaining fdbk mech not nec w/well-lrnd perf Rg-Sg mech: Perf mediated by sensory fdbk from antic R Closed-loop mech: Specific rel R cond to specific error S Interp observational lrng re control of perf by image of R Image of R is central representation of sensory fdbk from R Image represents functional R class, not specific instance Ideo-motor (IM) mech: Image of R initiates perf of R IM implied by contiguity theory w/S-R, S-s, and s-R assns IM not= circular reflex (R fdbk facil repetition of R) Can discrim image of R from actual fdbk, which terminates R Hypo: Initial direct link from image to action unless inhib XfX- In instrucond, cond image of R precedes/selects/initiate R Mow,OH'76- W/long usage, R becomes automatic--Control by lower brain ZR-5:00. Response: Bibliographies, Collections ZZ****RZb XXXX Habituation: 1940-70--Biblio/index - - - - - - - - - - - - Lei,BC'72- ZR-6:00. Response: Conferences, Symposia, Editions ZZ****RZc XfXX Muscular afferents and motor control - - - - - - - - - - - Gra,R.'66- HfZ- Biofdbk and self-control - - - - - - - - - - - - - - - - - Bar,TX'71e HfX- Biofdbk syllabus - - - - - - - - - - - - - - - - - - - - - Bro,BB'75- ZS-1:00. Stimulus: Conceptual Propositions, General ZZ****SXc XXXX W/living organism, "environment" incl internal context - - Ben,M.'27- XXXX Cannot define essential prop of S w/out R (9) - - - - - - - Ski,BF'38- XXXX Afferent neural interaction - - - - - - - - - - - - - - - - Hul,CL'45- XTEX W/diff cues, repeat turn R (ie altern cue) if reverse cues Gla,M.'53- Effect of ITI on altern is-f cues present during delay Interp: Altern based on "S satiation" rather than R inhib R P- S/Genz symmetrical re S-on or S-off as cue - - - - - - - - Per,CC'53- Interp: Effect of CSI is-f diff-cond re context w/w/out S XXXX Defines S re change in qual/quant energy, w/incr = decr - - Log,FA'54- HXX Cue: Any attribute of environ organism can discriminate - - Mil,NE'57- Motion picture superior for relevant/realistic cue for lrng XfX- R-prod S = ext-S as cues or signals (180) - - - - - - - - - Gut,ER'59- XCPO Hypo: ESB has both reinf and motiv prop - - - - - - - - - - Deu,JA'63+ XXXX Functional S is sensory input mod by lrnd implicit condit R Law,DH'63- S-as-coded is-f(correl w/reinf) incl context control Note: If change coding R, assns re init s-a-c remain S-as-coded th affect concepts of S/Genz and transfer XXXX Critical of S-analyzer th re diff in nominal/functional S - Mat,WA'66- XXXX Meaning of S - - - - - - - - - - - - - - - - - - - - - - - Gib,JJ'67- XXXX Skinner concept of S - - - - - - - - - - - - - - - - - - - Hoc,M.'67- XNX Disting simple assn (eg L-US) vs compound assn (eg -US) Sut,RJ'89+ Hypo: Hippocampal formation nec for compound assn Eval above hypo re effect of hippocamp lesions on lrng/mem Above incl neg pattern discrim (L+,T+,LT-), stim selection Above incl spatial place lrng, recog mem (eg delayed -MTS) Above incl context-dep latent inhib, serial compound discr ZS-2:00. Stimulus: Empirical Analyses, Generalizations ZZ****SXe XXXX Anal of lite-off as S re disinhib of dark cells - - - - - - Ken,D.'63- XXXX Concl: CR incr-f(S-inten) re context in acq, not extn - - - Gra,JA'65- XXXX Concl: After Pair(S1,S2,US), S2 is CS in context of S1 - - Keh,EJ'82- Concl: Pair(S1,S2,US) decr cond S1 w/short ISI, incr w/long ZS-3:00. Stimulus: Models ZZ****SXm XXXX Model of quantal S-control w/compound S as-f(R/reinf var) - Wei,SJ'87+ ZS-4:00. Stimulus: Theoretical Analyses ZZ****SXT XXX- Every act is a figure re background of total organism - - - Hel,H.'26- Configuration recognized in absence of identical elements Assoc linkage as-f(repetition) wholly inadequate Whole has autonomy of its own w/definite laws AMLX Perf is-f(knowledge/reward/drive) w/all 3 necessary - - - - Ell,MH'30- ZS-5:00. Stimulus: Bibliographies, Collections ZZ****SZb ZS-6:00. Stimulus: Conferences, Symposia, Editions ZZ****SZc XXXX Context and lrng - - - - - - - - - - - - - - - - - - - - - Bak,PD'85+ ZV-1:00. Variability: Conceptual Propositions, General ZZ****VXc XXXX Beh is result of interdependent action of heredity/environ Car,L.'27- XXXX Indiv diff in th - - - - - - - - - - - - - - - - - - - - - Hul,CL'45- rXXX Discuss var rel to effect of early experience on adult beh Kin,JA'58- ZV-2:00. Variability: Empirical Analyses, Generalizations ZZ****VXe ROOO Average life span = 3-y w/good environ cond - - - - - - - - Don,HH'24- RXXX Review evidence for heritability of lrng ability, traits - Bur,M.'27- FMLH Reliable indiv diff in lrng scores w/mult-T maze - - - - - Sto,CP.28+ RxxH Hi intercorrel w/diff mazes, not correl w/escape/discrim - Com,WD'32e OXXX Ident gen factor (sensory-motor acty) re indiv diff in lrng Dun,JW'33- RxxH Re maze/discrim, no sex diff in acq/reversal/variability - Tom,MI/33+ RxxH Correl = .5 lrng/reversal of maze or visual discrim - - - - Tom,MI'34+ No correl of lrng maze and visual discrim AXX- Phyletic diff in lrng - - - - - - - - - - - - - - - - - - - Bit,ME'65- R O Hippocampal astrocyte clusters in retention-deficient aged Lan,PW'77e NxEO Greater strain diff in fear-motiv beh vs acty - - - - - - - Tru,R.'93+ ZV-3:00. Variability: Models ZZ****VXm ZV-4:00. Variability: Theoretical Analyses ZZ****VXT ZV-5:00. Variability: Bibliographies, Collections ZZ****VZb ZV-6:00. Variability: Conferences, Symposia, Editions ZZ****VZc XXXX Hdbk of aging - - - - - - - - - - - - - - - - - - - - - - - Bir,JE'59- DXXX Pavlov's typology - - - - - - - - - - - - - - - - - - - - - Gra,JA'64- ZV-1:00. Interactions: Conceptual Propositions, General ZZ****XXc XXXX Disting indiv/social/crowd psych re stim range/reactn area Gid,FH'24- XXXX Behaviorism is physical science between physiol/social sc - Wei,AP'24- Incl implicit-R/image/thought and overt beh Wei,AP'24- XXXX Ident ecological niche (functn of diff species in environ) Elt,C.'27- Ident number pyramid, N/indiv decr-f(size of enemies) Elt,C.'27- XXXX Disting psych (self w/introspection) vs psychobiol (beh) - Yer,RM'33- HXOO Neurosis is disorganized beh cond to socially irrel Ss - - Sto,RM'34- HSXX Contend psych is ancillary to both physiol and sociology - Tol,EC'38- XXX- Lrng theory not reductive re neurophysiological proc - - - Spe,KW'42- XXXx After cond fight ER w/rat, fight doll if shock w/out rat - Mil,NE'48- After train IR w/water reinf, IR incr-f(hunger) not thirsty After trng w/food reinf, P(right R) incr by pain/fear sated Genz S/Genz th of displacement to sit w/R inhib by conflict HEC- Hypo: ALC decr fear more than other drives (369) Dol,J.'50+ Implies self-admin ALC if anxious, in conflict (377) Above esp if decr in avoid enables approach reinf goal (377 HXX- Lrng theory concerned w/lo-order laws, not real life sit - Spe,KW'54- Empirical question if lrng theory ever apply to real life XXX- Opcond w/lower P(reinf), greater R/Extn than classcond - - Raz,GH'55- XXX- Classcond inherent part of instrucond (49) - - - - - - - - Spe,KW'56- XXX- Search for common behavioral base for classcond/opcond - - Sch,WN'66- D F- Distinguish classcond/instrucond by Lat(R) w/in-O - - - - - Col,M.'67+ hXLX Attrib acq motives/values/ideals re acq generalized imitatn Gew,JL'68+ HEC- Reinf of smoking is nicotine stim reward mech in brain - - Jar,ME'70- XXXX Hypo: Intrinsic primary motiv to learn as-f(brain biochem) Log,FA'71- Above brain biochem decr w/lrng, incr w/time/REM sleep XXX- Distinguish classcond/instrucond re habituability of reflex Kim,HD'73- HXXX Self-control: decr reinf-R below, incr effort-R above base Lop,D.'76+ Interp self-control as acq of cog rule re beh and conting XXXX Encourage operant research re applied problems/settings - - Neu,A.'84- HXX- Extend anal of classcond to prob-solving/rule-governed beh Tur,JS'89- HXX- Anal complexity of aversive events in natural human environ Sta,TG'91- Relate above to complexity of contexts re cond of fear XDX- Argue cannot separate determinants of memory from lrng/perf Bru,FR'93- ZV-2:00. Interactions: Empirical Analyses, Generalizations ZZ****XXe XXXX Comparative/genetic psych allied to biology and ethics - - Mor,L.'05- XXXX Notes similarity of methods of lrng in animals/infant - - - Las,KS'14- XXXX Prefers "comparative psych" to "animal psych" - - - - - - - Las,KS'14- HXEX Reviews lab studies of aggression and anxiety - - - - - - - Ero,LD'91- XXO- Review of factors affecting cond/stress re immune R - - - - Ade,R.'93+ AXXX Contrast comparative psych/ethology re methods and topics - Tim,W.'93- ZV-3:00. Interactions: Models ZZ****XXm AXX- Evidence re lrned helplessness w/animals and human depressn Ove,JB'88+ AXX- Structure/function animal models of human psychopathology - Ove,JB'88+ ZV-4:00. Interactions: Theoretical Analyses ZZ****XXT hXXX Pattern of parenthood embodies th of lrng; all are wrong - Loe,J.'59- XXX- Initiation of skeletal CR based on autonomic classcond - - Liu,I.'64- Shaping/maint of CR based on instru effect of CR on US Emphasizes cue prop of 2nd lrng proc (rg-sg) in instrucond Tra,MA'72+ Implies instru-diffcond facil w/diff outcomes assoc w/Rs XXX- Theory--Goal image cond to sit, vividness incr by IR-feedbk Kin,DL'74- ZV-5:00. Interactions: Bibliographies, Collections ZZ****XZb XXE- Reviews fear (CER), escape, punishment, avoidance - - - - - Bee,RS'67- AXX- Biblio re animal models of human beh pathology - - - - - - Ove,JB'92+ ZV-6:00. Interactions: Conferences, Symposia, Editions ZZ****XZc XXX- Comparative Psychopath: Animal and human Zub,J.'67+ XXX- Experimental psychopathology - - - - - - - - - - - - - - - Kim,HD'71- Series of lectures at Univ of South Florida, 11 articles A.Amsel, J.V.Brady-J.D.Findley-A.Harris, W.H.Gantt H.F.Harlow-M.K.Harlow, H.D.Kimmel, F.A.Logan, J.H.Masserman K.B.Melvin, W.H.Morse-J.A.Herd-R.T.Kelleher-S.A.Grose J.Sandler-R.S.Davidson, J.B.Sidowski Hf - Applications to trtmt of physically disabled (12 articles) Inc,LP'80- XXX- Animal Models of Psychopathology - - - - - - - - - - - - - Bon,NW'84- D.M.Atrens, J.R.Bassett, P.J.V.Beumont, N.W.Bond K.D.Cairncross, R.W.Russell-D.H.Overstreet, G.Singer- M.Wallace, J.H.Storlien