Models of Language Evolution Evolutionary game theory & the - - PowerPoint PPT Presentation

models of language evolution
SMART_READER_LITE
LIVE PREVIEW

Models of Language Evolution Evolutionary game theory & the - - PowerPoint PPT Presentation

Models of Language Evolution Evolutionary game theory & the evolution of meaning Michael Franke Topics for today 1 evolutionary stability 2 meaning of signals 3 replicator dynamic Population games Evolutionary Stability Meaning Evolution


slide-1
SLIDE 1

Models of Language Evolution

Evolutionary game theory & the evolution of meaning Michael Franke

slide-2
SLIDE 2
slide-3
SLIDE 3
slide-4
SLIDE 4
slide-5
SLIDE 5

Topics for today

1 evolutionary stability 2 meaning of signals 3 replicator dynamic

slide-6
SLIDE 6

Population games Evolutionary Stability Meaning Evolution

Population games Evolutionary Stability Meaning Evolution

6 / 29

slide-7
SLIDE 7

Population games Evolutionary Stability Meaning Evolution

(One-Population) Symmetric Game

A (one-population) symmetric game is a pair A, U, where:

  • A is a set of acts, and
  • U : A × A → R is a utility function (matrix).

Example (Prisoner’s dilemma) U = ac ad ac 2 ad 3 1

  • Example (Hawk & Dove)

U = ah ad ah 1 7 ad 2 3

  • 7 / 29
slide-8
SLIDE 8

Population games Evolutionary Stability Meaning Evolution

Symmetrizing asymmetric games

Example: signaling game

  • big population of agents
  • every agent might be sender or receiver
  • an agent’s strategy is a pair s, r of pure sender and receiver strategies
  • utilities are defined as the average of sender and receiver role:

U(s, r ,

  • s′, r′) = 1/2(US(s, r′) + UR(s′, r)))

8 / 29

slide-9
SLIDE 9

Population games Evolutionary Stability Meaning Evolution

Example (Symmetrized 2-2-2 Lewis game)

s1 s2 s3 s4 s5 s6 s7 s8 s9 s10 s11 s12 s13 s14 s15 s16 s1 m1, m1, a1, a1 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s2 m1, m1, a1, a2 .5 .5 .5 .5 .75 .75 .75 .75 .25 .25 .25 .25 .5 .5 .5 .5 s3 m1, m1, a2, a1 .5 .5 .5 .5 .25 .25 .25 .25 .75 .75 .75 .75 .5 .5 .5 .5 s4 m1, m1, a2, a2 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s5 m1, m2, a1, a1 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 s6 m1, m2, a1, a2 .5 .75 .25 .5 .75 1 .5 .75 .25 .5 .25 .5 .75 .25 .5 s7 m1, m2, a2, a1 .5 .75 .25 .5 .25 .5 .25 .75 1 .5 .75 .5 .75 .25 .5 s8 m1, m2, a2, a2 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 s9 m2, m1, a1, a1 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 s10 m2, m1, a1, a2 .5 .25 .75 .5 .75 .5 1 .75 .25 .5 .25 .5 .25 .75 .5 s11 m2, m1, a2, a1 .5 .25 .75 .5 .25 .5 .25 .75 .5 1 .75 .5 .25 .75 .5 s12 m2, m1, a2, a2 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 s13 m2, m2, a1, a1 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s14 m2, m2, a1, a2 .5 .5 .5 .5 .75 .75 .75 .75 .25 .25 .25 .5 .5 .5 .5 .5 s15 m2, m2, a2, a1 .5 .5 .5 .5 .25 .25 .25 .25 .75 .75 .75 .75 .5 .5 .5 .5 s16 m2, m2, a2, a2 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5

9 / 29

slide-10
SLIDE 10

Population games Evolutionary Stability Meaning Evolution

Population games Evolutionary Stability Meaning Evolution

10 / 29

slide-11
SLIDE 11

Population games Evolutionary Stability Meaning Evolution

Mean-Field Population

  • (nearly) infinite populations for each distinguishable role
  • each population is entirely homogeneous
  • agents play pure strategies
  • each agent interacts purely at random with other agents
  • strategy updates are rare

11 / 29

slide-12
SLIDE 12

Population games Evolutionary Stability Meaning Evolution

Evolutionary Stability (Intuition)

A strategy s is evolutionarily stable if a population that consists entirely/mostly of s-agents (the incumbents) cannot be invaded by any minority of mutants/invaders playing strategy t.

12 / 29

slide-13
SLIDE 13

Population games Evolutionary Stability Meaning Evolution

Evolutionary Stability (Derivation)

Intuition s cannot be invaded by a minority of mutants t fitness of incumbent > fitness of mutant (1 − ǫ) U(s, s) + ǫ U(s, t) > (1 − ǫ) U(t, s) + ǫ U(t, t)

  • if ǫ is infinitesimal, this holds when U(s, s) > U(t, s)
  • but if U(s, s) = U(t, s), then it also holds when U(s, t) > U(t, t)

13 / 29

slide-14
SLIDE 14

Population games Evolutionary Stability Meaning Evolution

Evolutionarily Stable Strategy (Definition)

A strategy s is evolutionarily stable iff for all t:

(i) U(s, s) > U(t, s), or (ii) U(s, s) = U(t, s) and U(s, t) > U(t, t) .

Connection with ne

  • strict-nes

⊂ esss ⊂ nes

14 / 29

slide-15
SLIDE 15

Population games Evolutionary Stability Meaning Evolution

Example (Symmetrized 2-2-2 Lewis game)

s1 s2 s3 s4 s5 s6 s7 s8 s9 s10 s11 s12 s13 s14 s15 s16 s1 m1, m1, a1, a1 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s2 m1, m1, a1, a2 .5 .5 .5 .5 .75 .75 .75 .75 .25 .25 .25 .25 .5 .5 .5 .5 s3 m1, m1, a2, a1 .5 .5 .5 .5 .25 .25 .25 .25 .75 .75 .75 .75 .5 .5 .5 .5 s4 m1, m1, a2, a2 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s5 m1, m2, a1, a1 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 s6 m1, m2, a1, a2 .5 .75 .25 .5 .75 1 .5 .75 .25 .5 .25 .5 .75 .25 .5 s7 m1, m2, a2, a1 .5 .75 .25 .5 .25 .5 .25 .75 1 .5 .75 .5 .75 .25 .5 s8 m1, m2, a2, a2 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 .5 .75 .25 .5 s9 m2, m1, a1, a1 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 s10 m2, m1, a1, a2 .5 .25 .75 .5 .75 .5 1 .75 .25 .5 .25 .5 .25 .75 .5 s11 m2, m1, a2, a1 .5 .25 .75 .5 .25 .5 .25 .75 .5 1 .75 .5 .25 .75 .5 s12 m2, m1, a2, a2 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 .5 .25 .75 .5 s13 m2, m2, a1, a1 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 s14 m2, m2, a1, a2 .5 .5 .5 .5 .75 .75 .75 .75 .25 .25 .25 .5 .5 .5 .5 .5 s15 m2, m2, a2, a1 .5 .5 .5 .5 .25 .25 .25 .25 .75 .75 .75 .75 .5 .5 .5 .5 s16 m2, m2, a2, a2 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5 .5

15 / 29

non-strict symmetric ne, ESS

slide-16
SLIDE 16

Population games Evolutionary Stability Meaning Evolution

All pairs of sender-receiver pure strategies for the 2-2-2 Lewis game

13 9 5 1 14 10 6 2 15 11 7 3 16 12 8 4

16 / 29

ESSs

slide-17
SLIDE 17

Population games Evolutionary Stability Meaning Evolution

Population games Evolutionary Stability Meaning Evolution

17 / 29

slide-18
SLIDE 18
slide-19
SLIDE 19

Population games Evolutionary Stability Meaning Evolution

Meaning in Lewis games

Signaling systems of the 2-2-2 Lewis game a1 a2 ma mb t1 t2 a1 a2 ma mb t1 t2 Fix an n-n-n Lewis game with SigSys s, r (i.e., ESS), and define: indicative meaning [[m]]T = {t ∈ T | s(t) = m} imperative meaning [[m]]A = {a ∈ A | r(m) = a}

19 / 29

(Lewis, 1969)

slide-20
SLIDE 20

Population games Evolutionary Stability Meaning Evolution

Natural vs. non-natural meaning

Natural meaning E.g.: smoke means fire Non-natural meaning E.g.: this gesture meant that the party is boring Non-natural meaning: Grice’s definition “A meantNN something by x” is roughly equivalent to “A uttered x with the intention of inducing a belief [in his audience] by means of the recognition of this intention.”

20 / 29

(Grice, 1957)

slide-21
SLIDE 21

Population games Evolutionary Stability Meaning Evolution

The Herod examples

(1) Herod presents Salome with the head of St. John

the baptist.

(2) Herod says to Salome “He’s dead.” (3) Herod leaves the head somewhere; Salome

happens to see it.

(4) Herod leaves the head where he knows Salome

will see it, correctly supposing she will not realize he left it for her to see.

(5) Herod leaves the head where Salome will see it,

mistakenly supposing she will not realize he left it for her to see.

21 / 29

(Grice, 1957)

slide-22
SLIDE 22

Population games Evolutionary Stability Meaning Evolution

MeaningNN in signaling systems

Behavior in a SigSys is compatible with common belief in rationality. We can then construct an infinite chain of rational inten- tion recognition based on SigSys-behavior. Meaning in SigSyss can be construed as meaningNN if the ascription of relevant mental states to agents is warranted.

22 / 29

(Lewis, 1969)

slide-23
SLIDE 23

Population games Evolutionary Stability Meaning Evolution

Practical reasoning justification in a SigSys

“Suppose I am the communicator and you are the audience (. . . ) and having observed that t1 holds, I give ma in conformity to our convention. (. . . ) The intention with which I do ma can be established by examining the practical reasoning that justifies me in doing it. I need not actually go through that reasoning to have an intention; actions done without deliberation are often done with definite intentions. (. . . ) My decision to do ma, having observed t1, is premised on my expectation that I can thereby produce a1 and on my desire to produce a1. So I do ma with the intention to produce a1. I expect you to infer t1 upon observing that I do ma. I expect you to recognize my desire to produce a1, conditionally upon t1. I expect you to recognize my expectation that I can produce a1 by doing ma. So I expect you to recognize my intention to produce a1, when you observe that I do ma. (. . . )”

23 / 29

(Lewis, 1969, p.155)

slide-24
SLIDE 24

Population games Evolutionary Stability Meaning Evolution

Informational content of signals

Info-content of m about T difference between: info about T given m & info about T without m Merits

  • applies to out-of-equilibrium behavior as well
  • non-intentional, non-mentalistic
  • applies to information flow between non-cognizing agents

24 / 29

(Skyrms, 2010, Chapter 3)

slide-25
SLIDE 25

Population games Evolutionary Stability Meaning Evolution

Informational content of signals

Info-content of m about T difference between: info about T given m [= P(t | m) posterior after signal reception] info about T without m [= P(t) prior probability of states] Kullback-Leibler divergence Let P, Q ∈ ∆(X) be probability distributions over finite set X, then: KL(P || Q) = ∑

x∈X

P(x) log P(x) Q(x) is the Kullback-Leibler divergence (measuring how many bits of information we would miss if we relied on Q rather than the (true) distribution P).

25 / 29

(Skyrms, 2010, Chapter 3)

slide-26
SLIDE 26

Population games Evolutionary Stability Meaning Evolution

Informational content of signals

Info-content of m about T I(m) = ∑

t∈T

P(t | m) log P(t | m) P(t) Informational content vector of m ICV(m) =

  • log P(t | m)

P(t) | t ∈ T

  • Propositional content of m

Prop(m) =

  • t ∈ T | log P(t | m)

P(t) > −∞

  • 26 / 29

(Skyrms, 2010, Chapter 3)

slide-27
SLIDE 27

Population games Evolutionary Stability Meaning Evolution

Examples

27 / 29

slide-28
SLIDE 28

References

Grice, Paul Herbert (1957). “Meaning”. In: Philosophical Review 66.3, pp. 213–223. Kirby, Simon et al. (2014). “Iterated Learning and the Evolution of Language”. In: Current Opinion in Neurobiology 28, pp. 108–114. Lewis, David (1969). Convention. A Philosophical Study. Cambridge, MA: Harvard University Press. Skyrms, Brian (2010). Signals: Evolution, Learning, and Information. Oxford: Oxford University Press.