Iterated learning optimizes for simplicity Jon W. Carr Centre for - - PowerPoint PPT Presentation

iterated learning optimizes for simplicity
SMART_READER_LITE
LIVE PREVIEW

Iterated learning optimizes for simplicity Jon W. Carr Centre for - - PowerPoint PPT Presentation

Iterated learning optimizes for simplicity Jon W. Carr Centre for Language Evolution School of Philosophy, Psychology and Language Sciences University of Edinburgh Pressures shaping language Language Pressures shaping language e l p m i


slide-1
SLIDE 1

Jon W. Carr

Centre for Language Evolution School of Philosophy, Psychology and Language Sciences University of Edinburgh

Iterated learning optimizes for simplicity

slide-2
SLIDE 2

Language

Pressures shaping language

slide-3
SLIDE 3

Language

Learning

Pressures shaping language

S i m p l e

slide-4
SLIDE 4

Language

Communication Learning

Pressures shaping language

S i m p l e I n f

  • r

m a t i v e

slide-5
SLIDE 5 English Northern Paiute

50 100 1 2 3 4

⬅ Informative ⬅ Simple

Kinship terms are simple and informative

Kemp & Regier (2012)

slide-6
SLIDE 6

Lab experiments

Learning-only Learning + Communication

slide-7
SLIDE 7

50 100 1 2 3 4

Learning and communication pressures

⬅ Informative ⬅ Simple

Learning + communication Communication-only Learning-only

newhomo kamone gaku hokako kapa gakho wuwele nepi pihino nemone piga kawake gamenewawu gamenewawa gamenewuwu gamene mega megawawa megawuwu wulagi egewawu egewawa egewuwu ege tuge tuge tuge tuge tuge tuge tuge tuge tuge tupim tupim tupim miniku miniku miniku tupin tupin tupin poi poi poi poi poi poi poi poi poi

Kirby, Cornish, & Smith (2008) Kirby, Tamariz, Cornish, & Smith (2015) Kirby, Tamariz, Cornish, & Smith (2015)

slide-8
SLIDE 8

Iterated learning gives rise to informative spatial terms

Carstensen, Xu, Smith, Regier (2015)

slide-9
SLIDE 9

Experiment 1

slide-10
SLIDE 10

Stimuli

Angle Size

slide-11
SLIDE 11

Stimuli

Angle Size

slide-12
SLIDE 12

Stimuli

Angle Size

slide-13
SLIDE 13

Stimuli

Angle Size

slide-14
SLIDE 14

Conditions

Angle-only Size-only Angle & Size

Easy to learn but low informativeness Informative but hard to learn

slide-15
SLIDE 15

Training phase

slide-16
SLIDE 16

Test phase

slide-17
SLIDE 17

Results

Angle-only

slide-18
SLIDE 18

Results

Size-only

slide-19
SLIDE 19

Results

Angle & Size

slide-20
SLIDE 20

Result: Learnability advantage for the less informative systems

slide-21
SLIDE 21

Experiment 2

slide-22
SLIDE 22

Iterated learning

slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25

1 category 2 categories 4 categories 3 categories

slide-26
SLIDE 26

Measuring simplicity

slide-27
SLIDE 27

Measuring simplicity

3×3 1×1 1×8 1×2 1×4 1×6 1×1 3×4 1×1 2×6 2×3 1×2 4×8 4×8

slide-28
SLIDE 28

Simplicity

slide-29
SLIDE 29

Simplicity Informativeness

slide-30
SLIDE 30

Simplicity Informativeness

slide-31
SLIDE 31

Simplicity Informativeness

slide-32
SLIDE 32

Compactness A system of compact categories is more informative than a system of noncompact categories Dimensionality A system that uses many dimensions is less (?) informative than a system that uses few dimensions

What makes language informative?

Balanced categories A system of equally sized categories is more informative than a system of unequally sized categories Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories Discreteness A system of discrete categories is more informative than a system of fuzzy categories

slide-33
SLIDE 33

What makes language informative?

Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

Learning

Pressure for simplicity

Communication

Pressure for informativeness
slide-34
SLIDE 34

What makes language informative?

Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

Learning

Pressure for simplicity

Communication

Pressure for informativeness
slide-35
SLIDE 35

What makes language informative?

Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

Learning

Pressure for simplicity

Communication

Pressure for informativeness
slide-36
SLIDE 36

What makes language informative?

Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

Learning

Pressure for simplicity

Communication

Pressure for informativeness

Our experiments

slide-37
SLIDE 37

What makes language informative?

Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

Learning

Pressure for simplicity

Communication

Pressure for informativeness

Carstensen et al.

slide-38
SLIDE 38

Conclusions

The pressure from learning yields simple languages, but this can manifest itself through multiple semantic properties: Expressivity Loss of words/categories to aid learning Convexity Reorganization of the meaning space to aid learning The pressure from communication has the same effect on convexity as learning does, making it difficult to identify the causal mechanism. In iterated learning, the pressure for simplicity favours semantic category systems that are convex – informativeness comes along for the ride.

slide-39
SLIDE 39

Thanks!