Operant Instrumental Learning Lecture 4 Whats going to

Operant (Instrumental) Learning Lecture 4

What’s going to happen next? If we know…we can be prepared l Increases our chances for success n Predicting important events critical for survival l food & water l sex l danger ~ n

Associative Learning n n Events become associated l linked Association via l Respondent Learning (AKA: Classical or Pavlovian Conditioning) uinvoluntary l behavior Operant Learning (AKA: Instrumental) umotivated behavior ~

Motivated Behavior Not all behavior reflexive l Involuntary l Respondent / Elicited l Triggered by external events n Motivated behavior l Voluntary l Operant / Emitted l Attempt to change environment ~ n

Motivated Behavior controlled by past experiences n Consequences of past behavior important l NOT goals or intent n Mechanical process l conscious mental effort NOT required l but can facilitate ~ n

Response Selection Analogous to natural selection l Adaptive behaviors “survive” n Hedonism l Seek pleasure l Avoid pain n Benefits survival and well-being ~ n

Response Variation + Environmental Consequences Changes in Behavior Optimal response will be strongest

Learning New Behaviors How is behavior established (acquired)? l familiar responses in new situations l combine familiar responses in new ways n Can produce complex behaviors l Playing piano, repairing car, etc. ~ n

E. L. Thorndike Animal learning l Trial & error learning l Puzzle box n Instrumental learning l Behavior instrumental in producing a specific outcome n Environment changes organism ~ n

Thorndike’s Laws *Law of Effect *Law of Readiness Law of Exercise

Thorndike’s Law of Effect Behavior leads to… n Satisfying outcome behavior repeated l Strengthened l Will act to approach or maintain n Annoying outcome NOT repeated l Weakened l Will act to avoid or discontinue ~ n

Satisfying for Whom? Neurons l Neural connections l b/n sensory events & behavioral responses l Strengthened or weakened n Not necessarily for the individual l Maladaptive behaviors can be strengthened l i. e. , drug abuse ~ n

Law of Readiness Strengthening requires motivation l hunger, thirst, etc. n Physiological state important l also cognitive state n Role of nervous system l Organization l State n ustrength of connection ~

Law of Readiness When you are ready to engage in a behavior l Doing it is satisfying l Not doing it is annoying n When you are not ready to do something l Being forced to act is annoying ~ n

Controlled by Consequences Situational cues important l Outcome of behavior may differ l e. g, stopping at a traffic light n Antecedents = Cues l Signals situation l Likely outcome ~ n

ABCs of Behavior Antecedents l Signals likely outcome n Behavior l Response attempting to produce adaptive outcome n Consequences l Outcome of behavior l Strengthens or weakens behavior ~ n

Operant/Instrumental Notation A SD Antecedent (Signal) : B C B SR Behavior (Response) Consequence (Outcome)

Operant/Instrumental Notation SR (or S*) l biologically important stimulus l Consequence of behavior n. B (or R) l Response or behavior l Acts on environment n B-SR contingency R l Response S ~ n

Operant/Instrumental Notation SD : B SR Discriminative stimulus n SD (or S+) R l Cue that signals S available n SΔ (or S-) R l signals S not available ~ n

Consequences of Behavior Classes of stimuli l Appetitive l Aversive n Consequence R l S occurs n u. Positive l contingency SR prevented/ terminated unegative contingency ~

Strengthening behavior Reinforcement l increases responding l strengthens a response n Reinforcers: biologically important R l S n 2 types of reinforcement ~ n

Operant Conditioning Contingency positive occurs appetitive negative terminate or prevent Positive RFT SR aversive Negative RFT

Reinforcement Depends on type of stimulus & outcome n Positive RFT R l positive contingency appetitive S l Depends on certain response l strengthens behavior ~ n

Reinforcement Negative RFT R l negative contingency with S n avoidance or termination of aversive SR l avoidance = preventing l escape = termination n NOT occurrence of aversive SR n Reinforcement strengthens behavior ~ n

Punishment Weakens behavior l NOT like negative reinforcement n Positive punishment R l B aversive S l positive contingency n Negative punishment R l B terminates appetitive S l or prevents l aka omission training ~ n

Operant Conditioning Contingency positive occurs negative terminate or prevent appetitive Positive RFT Negative Punishment aversive Positive Punishment Negative RFT SR

Extinction of Reinforced Behavior changes relatively permanent l Modifiable if situation changes n B no longer followed by important event D R l S : B No S l B n NOT unlearning, forgetting l Association still intact l Spontaneous recovery, disinhibition, etc. ~ n