iterated learning optimizes for simplicity
play

Iterated learning optimizes for simplicity Jon W. Carr Centre for - PowerPoint PPT Presentation

Iterated learning optimizes for simplicity Jon W. Carr Centre for Language Evolution School of Philosophy, Psychology and Language Sciences University of Edinburgh Pressures shaping language Language Pressures shaping language e l p m i


  1. Iterated learning optimizes for simplicity Jon W. Carr Centre for Language Evolution School of Philosophy, Psychology and Language Sciences University of Edinburgh

  2. Pressures shaping language Language

  3. Pressures shaping language e l p m i S Language Learning

  4. Pressures shaping language e l p m i S Language Learning Communication e v i t a m r o f n I

  5. Kinship terms are simple and informative English Northern Paiute 4 3 ⬅ Informative 2 1 0 0 50 100 ⬅ Simple Kemp & Regier (2012)

  6. Lab experiments Learning-only Learning + Communication

  7. Learning and communication pressures 4 tuge tuge tuge tuge tuge tuge Learning-only tuge tuge tuge tupim tupim tupim 3 miniku miniku miniku tupin tupin tupin poi poi poi poi poi poi poi poi poi pihino nemone piga kawake Kirby, Cornish, & Smith (2008) 2 ⬅ Informative kapa gakho wuwele nepi 1 newhomo kamone gaku hokako egewawu egewawa egewuwu ege Learning + Kirby, Tamariz, Cornish, & Smith (2015) Communication-only communication mega megawawa megawuwu wulagi 0 0 50 100 gamenewawu gamenewawa gamenewuwu gamene ⬅ Simple Kirby, Tamariz, Cornish, & Smith (2015)

  8. Iterated learning gives rise to informative spatial terms Carstensen, Xu, Smith, Regier (2015)

  9. Experiment 1

  10. Stimuli Angle Size

  11. Stimuli Angle Size

  12. Stimuli Angle Size

  13. Stimuli Angle Size

  14. Conditions Angle-only Size-only Angle & Size Easy to learn but low informativeness Informative but hard to learn

  15. Training phase

  16. Test phase

  17. Results Angle-only

  18. Results Size-only

  19. Results Angle & Size

  20. Result: Learnability advantage for the less informative systems

  21. Experiment 2

  22. Iterated learning

  23. 1 category 2 categories 3 categories 4 categories

  24. Measuring simplicity

  25. Measuring simplicity 1×1 3×3 1×1 3×4 4×8 1×1 1×8 1×2 2×6 4×8 1×4 1×2 2×3 1×6

  26. Simplicity

  27. Simplicity Informativeness

  28. Simplicity Informativeness

  29. Simplicity Informativeness

  30. What makes language informative? Expressivity A system of many categories is more informative Convexity A system of convex categories is more informative than a system of few categories than a system of nonconvex categories Balanced categories A system of equally sized categories is more Discreteness A system of discrete categories is more informative informative than a system of unequally sized categories than a system of fuzzy categories Dimensionality A system that uses many dimensions is less (?) Compactness A system of compact categories is more informative than a system that uses few dimensions informative than a system of noncompact categories

  31. What makes language informative? Learning Communication Pressure for simplicity Pressure for informativeness Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

  32. What makes language informative? Learning Communication Pressure for simplicity Pressure for informativeness Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

  33. What makes language informative? Learning Communication Pressure for simplicity Pressure for informativeness Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories

  34. What makes language informative? Learning Communication Pressure for simplicity Pressure for informativeness Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories Our experiments

  35. What makes language informative? Learning Communication Pressure for simplicity Pressure for informativeness Expressivity A system of many categories is more informative than a system of few categories Convexity A system of convex categories is more informative than a system of nonconvex categories Carstensen et al.

  36. Conclusions The pressure from learning yields simple languages, but this can manifest itself through multiple semantic properties: Expressivity Loss of words/categories to aid learning Convexity Reorganization of the meaning space to aid learning The pressure from communication has the same effect on convexity as learning does, making it difficult to identify the causal mechanism. In iterated learning, the pressure for simplicity favours semantic category systems that are convex – informativeness comes along for the ride.

  37. Thanks!

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend