Operant Conditioning p Operant conditioning n n n

Operant Conditioning p Operant conditioning n n n p p Association between VOLUNTARY behavior and its consequence Behavior has consequences ABC’s: Antecedents-Behavior. Consequence Thorndike’s Law of effect “Sit, Houston!” n Make millions training dogs! n Dog tricks

Influencing behavior: Not just for dogs p p B. F. Skinner “The major problems of the world today can be solved only if we improve our understanding of human behavior” About Behaviorism (1974) Author of “Beyond Freedom and Dignity” Study rats and pigeons in a “Skinner box”

Classical vs. operant conditioning

Rat in a Skinner Box http: //www. youtube. com/watch? v=PQt. DTd. Dr 8 vs

Effect of Stimulus (Consequence) on Behavior: Positive: If Response Then Stimulus Punishment: Decrease Probability Positive Reinforcement Stimulus: usually appetitive Ex: “Thank you!” “rewards” Stimulus: usually aversive Ex: Spanking, Blessing Out Negative: If Response Then NO Stimulus Type of Contingency Reinforcement: Increase Probability Negative Reinforcement Omission Stimulus: usually aversive Ex: Avoidance, Escape Punishment “Punishment by Addition” “Positive Punishment” “Punishment by Subtraction” “Negative Punishment” Stimulus: usually appetitive Ex: Grounding, DRO, suspended license

Identify the contingency for each: Car buzzer stops after you put on your seat belt. n If I wear that, my friends will think I look like a slut. n Given a ticket by a cop for speeding. n I press cancel on the microwave so I won't hear it beep. n If you buy me that diamond, I'll make you very happy. n I won't eat dessert because I don't want to gain weight. n If you make 3. 5 or higher, you can have a trip for spring break. n

Shaping behaviors p p How do you train a pigeon to turn in a circle? Shaping = differential reinforcement of successive approximations After each response -> stricter criterion for reinforcement http: //www. youtube. com/watch? v=I_ct Jqjlr. HA&feature=related Applications? n n ADHD Autism Sports, music, skills, parenting http: //www. youtube. com/watch? v=re. NVH 1 zd 1 to &feature=related

Rat Basketball http: //www. wofford. edu/psychology/content. aspx? id=4844

Cumulative recorder

Schedules of reinforcement p p p p Continuous (CRF) vs. Partial Reinf. Schedules: Fixed-ratio Fixed-interval Variable-ratio Variable-interval Effect of extinction? PREE!!!! reinforcement http: //www. youtube. com/watch? v=I_ct. Jqjlr. HA&feature=related Spoiled brat

Schedules of reinforcement

Sample cumulative records of 4 simple reinforcement schedules

Identify the reinforcement schedule: p In a ____ schedule, reinforcement is delivered only after some specific number of responses. p In a ____ schedule, reinforcement is delivered only after responding after some specific period of time, not before. p In a ____ schedule, reinforcement is delivered only after a varied number of responses. p In a ____ schedule, reinforcement is delivered only after responding after a varying period of time.

Extinction: Partial v Continuous The PREE! (Blue – Red) Partial reinforcement Continuous reinforcement

Operant conditioning applications p p Animal training n “Don’t shoot the dog: The new art of teaching and training” K. Pryor n http: //www. cesarmillaninc. com/videoplayer/index. php Teaching techniques n p Superstitious behavior n p Quiet the class; Produce good grades Behavior and consequence linked (variable-ratio) Understand disorder and create therapy n n Depression; Anorexia; Drug abuse ADD/ADHD and Autism

Mechanism of Depression: Seligman, 1975 “Learned helplessness” then Training p p p Escape shock by pressing within 10 s after light n Red: can avoid shock n Blue: can’t change outcome Move to shuttle box n Red: learns task n Blue: becomes passive Abused wives stay?

Parenting: You do “behavior modification” every day -- should you know what works? Positive punishment vs. negative punishment p Effect of types of punishments? p Limitations of positive punishment p n n p Doesn’t teach correct response May increase aggression Other forms of punishment n n n Time-out Penalty or fine Correction

Modeling behavior p p p In operant conditioning: organism learns the consequences of its own behavior. Observational learning: organism learns the consequences of another’s behavior. Sports: You are much more likely to perform well if you see how “experts” do it. Arts: learning to paint well, dance well, sing well, nearly all benefit from modeling. Parenting? Did the manual come with the baby? Bandura et al. (1963) – Learning aggression: Bobo doll -- Observe how behavior of others is reinforced or punished

Modeling behavior p Observational learning n p Rather than only trial-error Influenced by presence of significant role model n Imitate, model, behavior of significant others

Modeling behavior p Observational learning p Bandura et al. (1963) – Bobo doll n n n Learn how behavior of others is reinforced or punished? Learn what is fun from others Learn how to do things

Think about your own life: p p What is a behavior you want to increase? What is a behavior you want to decrease? p For each, explain how each of these would influence your target behaviors: Positive reinforcement Negative reinforcement Punishment by addition Punishment by subtraction p What schedules of reinforcement would you use? p p

Extra slides

To review: Operant conditioning p p p What is operant conditioning? What are real examples of consequences of behavior (pos/neg reinforcement/punishment)? What are the schedules of reinforcement? What is the effect of each on learning and extinction?

To review: Classical conditioning p What is classical conditioning? n n p Real examples? n n p Association between stimuli and NATURAL response Stimuli signal outcomes What is US and UR What is CS and CR What variables can you vary? n n n Number of reinforced trials Number of unreinforced trials Order of CS and US Stimulus generalization: test different versions of the CS Second order conditioning – test new CS to cue first CS Test after extinction – present stimulus after long break

Thought paper What is classical conditioning versus operant conditioning? p What is an example of classical conditioning in your every day life p What is an example of operant conditioning in your every day life? p How can you use learning theory in the future? p

Extra slides

Radial-arm maze Place learning

Olton & Samuelson (1976) p p p p Rats explore maze: 15 min/day for 9 days Free choice: one piece of food in each arm (10 days) – could make 16 choices Within 5 days all animals were consistent in choosing an average of 7 arms within the first 8 choices – didn’t repeat choices! Odor: odor added so can’t leave “trail” (3 days) Added odor didn’t influence accuracy Switch: after 3 choices, switched location of two arms Rats continued to choose arm based on spatial location (repeating the arm from first 3 trials) Use cues outside the maze in the room!

Corwill & Rescorla, 1985 p Method: n n n p Results: n n n p Lever press = food pellet Chain pull = sugar water Later add toxin to sugar water Taste aversion to sugar water Continued to press lever, not pull chain Avoidance conditioning (vs. escape conditioning) Conclusion: n n “Act-outcome representation” Use method to see what tastes animals can differentiate