Classical and Instrumental Conditioning Lecture 8 1 Basic - - PowerPoint PPT Presentation

▶
classical and instrumental conditioning
SMART_READER_LITE
LIVE PREVIEW

Classical and Instrumental Conditioning Lecture 8 1 Basic - - PowerPoint PPT Presentation

Mar 28, 2024 5 likes •386 views

Classical and Instrumental Conditioning Lecture 8 1 Basic Procedure for Classical Conditioning CS US (Bell) (Meat Powder) UR CR (Salivation) (Salivation) 2 Major Phenomena of Classical Conditioning Acquisition CR to CS

slide-1
SLIDE 1

1

Classical and Instrumental Conditioning

Lecture 8

slide-2
SLIDE 2

2

Basic Procedure for Classical Conditioning

CS (Bell) US (Meat Powder) UR (Salivation) CR (Salivation)

slide-3
SLIDE 3

3

Major Phenomena of Classical Conditioning

  • Acquisition

– CR to CS Reinforced by US – Response Gains Strength

  • Magnitude of CR
  • Probability of CR
slide-4
SLIDE 4

4

Acquisition: Trial 1

CS US CR Bell Food Drops of Saliva Time

slide-5
SLIDE 5

5

Acquisition: Trial 5

CS US CR Bell Food Drops of Saliva Time

slide-6
SLIDE 6

6

Acquisition: Trial 10

CS US CR Bell Food Drops of Saliva Time

slide-7
SLIDE 7

Acquisition of a Conditioned Response CS ==> US

0.2 0.4 0.6 0.8 1 1 2 3 4 5 6 7 8 9 10 11 12 Probability of CR Trials

Negative Acceleration Positive Acceleration

The “Sigmoidal” (S-Shaped) Learning Curve is Also Known as an Ogive

7

slide-8
SLIDE 8

Two Shapes to the Learning Curve

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Response Strength Trials

Naïve Organism/ Complex Behavior

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Response Strength Trials

Experienced Organism/ Simple Behavior

8

slide-9
SLIDE 9

9

Major Phenomena of Classical Conditioning

  • Acquisition
  • Extinction

– No Reinforcement – Response Loses Strength

slide-10
SLIDE 10

10

Extinction: Trial 1

CS US CR Bell Food Drops of Saliva Time

slide-11
SLIDE 11

11

Extinction: Trial 5

CS US CR Bell Food Drops of Saliva Time

slide-12
SLIDE 12

12

Extinction: Trial 10

CS US CR Bell Food Drops of Saliva Time

slide-13
SLIDE 13

13

Extinction of a Conditioned Response CS ==> No US

0.2 0.4 0.6 0.8 1 1 2 3 4 5 6 7 8 9 10 11 12 Probability of CR Trials

slide-14
SLIDE 14

14

Major Phenomena of Classical Conditioning

  • Acquisition
  • Extinction
  • Spontaneous Recovery

– Rest After Extinction – Retest CS alone

slide-15
SLIDE 15

15

Spontaneous Recovery After Extinction CS ==> No US

0.2 0.4 0.6 0.8 1 Probability of CR Trials Acquisition Extinction Spontaneous Recovery (Rest) Further Extinction

slide-16
SLIDE 16

16

Re-Acquisition of Extinguished Response CS ==> US

0.2 0.4 0.6 0.8 1 Probability of CR Trials Acquisition Extinction Re-Acquisition Spontaneous Recovery Savings in Relearning (Rest)

slide-17
SLIDE 17

17

Extinction Below Zero

  • Extinction Trials Continued After CR

Disappears Entirely

  • Reduced Spontaneous Recovery
  • Less Savings in Relearning

– Slower Reacquisition

slide-18
SLIDE 18

18

Major Phenomena of Classical Conditioning

  • Acquisition
  • Extinction

– Extinction Below Zero

  • Spontaneous Recovery
  • Re-Acquisition

– CS Reinforced by US – Savings in Relearning

slide-19
SLIDE 19

19

Implications of Savings and Spontaneous Recovery

  • Conditioned Response Not “Lost”
  • Rather, Inhibited or Suppressed

– In Line with Changing Circumstances

  • Conditioned Stimulus No Longer Reinforced
  • CR Can be Disinhibited

– In Line with Changing Circumstances

  • CS Reinforced Once Again
slide-20
SLIDE 20

20

Major Phenomena of Classical Conditioning

  • Acquisition
  • Extinction
  • Spontaneous Recovery
  • Re-Acquisition
  • Generalization

– CS0 vs. CS1…CSn – Generalization Gradient

slide-21
SLIDE 21

21

The Generalization Gradient

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

  • 5
  • 4
  • 3
  • 2
  • 1

1 2 3 4 5 Probability of CR Test Stimulus

Original CS Lower Higher 250cps 200cps 300cps 350cps 150cps

slide-22
SLIDE 22

22

Major Phenomena of Classical Conditioning

  • Acquisition
  • Extinction
  • Spontaneous Recovery
  • Re-Acquisition
  • Generalization
  • Discrimination

– CS+ (Reinforced) – CS- (Unreinforced)

slide-23
SLIDE 23

23

Discrimination Learning CS+ ==> US CS- ==> No US

0.2 0.4 0.6 0.8 1 1 2 3 4 5 6 7 8 9 10 11 12 Probability of CR Trials

CS+ CS- 250 cps 200 cps

slide-24
SLIDE 24

24

Review of Classical Conditioning

  • Vocabulary

– Unconditioned Stimulus – Unconditioned Response – Conditioned Stimulus – Conditioned Response

  • Phenomena

– Acquisition

  • Reinforcement

– Extinction – Spontaneous Recovery – Savings in Relearning – Generalization

  • Generalization Gradient

– Discrimination

slide-25
SLIDE 25

25

Sensory Preconditioning

CS2 US CR Bell Food Saliva Light CS2 CS1 Bell Saliva Light CS1 CR 1 2 3

slide-26
SLIDE 26

26

Higher-Order Conditioning

CS1 US CR Bell Food Saliva Light CS1 CS2 Bell Saliva Light CS2 CR 1 2 3

slide-27
SLIDE 27

27

Significance of Classical Conditioning

  • Extends Control of Reflexes to Other

Environmental Events

– Associations between Events

  • Ubiquitous (Nervous System)
  • Pavlov: All Learning is Classical

Conditioning (?)

  • Laws of Classical Conditioning are the

Laws of Emotional Life

slide-28
SLIDE 28

28

Thorndike’s Puzzle Box

slide-29
SLIDE 29

29

Thorndike’s Results

slide-30
SLIDE 30

30

Thorndike’s Laws of Learning

Law of Readiness Law of Effect Law of Exercise

slide-31
SLIDE 31

31

Instrumental Conditioning

(Operant Conditioning)

  • Learn Adaptive Behavior

– Through Experience of Success, Failure

  • Organism Operates on Environment

– Behavior Changes Environment

  • Behavior Instrumental

– Obtains Desired State of Affairs

  • Associations between Behaviors and

Outcomes

slide-32
SLIDE 32

32

B.F. Skinner’s Operant Chamber

slide-33
SLIDE 33

33

Instrumental Conditioning Procedure

  • Phase 1: Baseline Behavior
  • Phase 2: Acquisition Phase
  • Phase 3: Discrimination Learning
  • Phase 4: Extinction
slide-34
SLIDE 34

34

Vocabulary of Instrumental Conditioning

  • Conditioned Response (No URs)
  • Conditioned Stimulus (No USs)
  • Reinforcement

– Positive – Negative (Not Punishment)

  • Acquisition
  • Extinction
  • Generalization
  • Discrimination
slide-35
SLIDE 35

35

Schedules of Reinforcement

  • Continuous
  • Partial
  • Intermittent

– Fixed Ratio (FR) – Variable Ratio (VR) – Fixed Interval (FI) – Variable Interval (VI)

  • Differential Reinforcement

– Of Low Rates (DRL) – Of High Rates (DRH)

slide-36
SLIDE 36

36

Intermittent Reinforcement

slide-37
SLIDE 37

The Matching Law

Herrnstein (1970)

  • Concurrent VI Schedules

– Give Organism a Choice

  • Key A: VI3
  • Key B: VI1
  • Response Rate is Proportional to the

Frequency of Reinforcement

– Also Magnitude, Delay of Reinforcement

  • Basic Principle of Microeconomics

– Supply and Demand

  • Relative Value of Reinforcers

37

slide-38
SLIDE 38

38

Significance of Instrumental Conditioning

  • Voluntary Behaviors Come Under

Control of Environmental Events

– Behavior-Outcome Associations

  • Ubiquitous (Vertebrates)
  • Thorndike, Skinner: All Learning is

Instrumental/Operant Conditioning (?)

  • Laws of Instrumental Conditioning Are

the Laws of Adaptive Behavior

– Habits – Incentives