signaling networks the word is the shadow of the deed
play

Signaling Networks The word is the shadow of the deed. - Democritus - PowerPoint PPT Presentation

from Democritus to Signaling Networks The word is the shadow of the deed. - Democritus Democritus The Laughing Philosopher 400BC Proclus states that Pythagoras and Epicurus agree with Cratylus, but Democritus and Aristotle agree with


  1. from Democritus to Signaling Networks

  2. The word is the shadow of the deed. - Democritus

  3. Democritus The Laughing Philosopher 400BC Proclus states that Pythagoras and Epicurus agree with Cratylus, but Democritus and Aristotle agree with Hermogenes, the former that names arise by nature, the latter that they arise by chance. Democritus Laughing, by Hendrick ter Brugghen, 1628

  4. � In that gathering of men, at a time when utterance of sound was purely individual, from daily habits they fixed on articulate words just as they happened to come; then, from indicating by name things in common use, the result was that in this chance way they began to talk, and thus originated conversation with one another. � Vitruvius The Ten Books of Architecture Bk2, Ch1 27 BC

  5. 1. Can meaningful communication arise spontaneously?

  6. 1. Can meaningful communication arise spontaneously? 2. Results robust?

  7. 1. Can meaningful communication arise spontaneously? 2. Results robust? 3. Can the Game Evolve?

  8. 1. Can meaningful communication arise spontaneously? 2. Results robust? 3. Can the Game Evolve? 4. Signaling on Networks

  9. 1. Can meaningful communication arise spontaneously? 2. Results robust? 3. Can the Game Evolve? 4. Signaling on Networks 5. Can the Network Evolve?

  10. The Simplest Lewis Signaling Game Nature flips a fair coin to choose state 1 or 2. Sender observes the state & sends signal A or B. Receiver observes the signal and guesses the state. Correct guess pays off 1 to both; otherwise nothing.

  11. 1. EMERGENCE of MEANINGFUL SIGNALS

  12. Meaningful?

  13. Information “In the beginning was information. The word came later.” Fred Dretske Knowledge and the Flow of Information

  14. Emergence? Dynamics

  15. Herrnstein-Roth-Erev Reinforcement Learning Probability of a specific choice is proportional to accumulated rewards from that choice in the past. Herrnstein, R. J. � On the Law of Effect. � Journal of the Experimental Analysis of Behavior 13: 243-266, 1970. Roth and Erev GEB 1995. Erev and Roth AER 1998.

  16. Simulation

  17. Theorem Convergence to a signaling system with probability 1. Argiento, Pemantle, Skyrms and Volkov. Stochastic Proc. Appl. (2009). (Parallel results in Evolutionary Dynamics)

  18. Experiments Subjects in an economics lab learn to signal spontaneously. Blume, DeJong, Kim, Sprinkle (1998) Experimental evidence on the evolution of meaning of messages in sender-receiver games. Am. Econ. Rev. Blume, DeJong, Neumann, Savin (2002) Learning and communication in sender-receiver games: and econometric investigation. J. Appl. Econ.

  19. 2. Robust?

  20. Nature’s die is not fair N states, N signals, N acts N states, M signals, N acts

  21. Nature’s die is not fair - pooling equilibria may be stable N states, N signals, N acts - partial pooling equilibria (some stable) N states, M signals, N acts - signaling systems may not be conventions Donaldson, Lachmann, Bergstrom (2007) Journal of Theoretical Biology

  22. Here Dynamic Analysis is more nuanced Efficient signaling can emerge, but is not guaranteed. Hu, Skyrms, Tarres “Reinforcement Learning in a Signaling Game” Hofbauer and Huttegger “Feasibility of Communication in Binary Signaling Games” JTB (2008) [Also 3by3by3 Games (2015)] Huttegger, Skyrms, Tarres and Wagner “Some Dynamics of Signaling Games” PNAS (2014)

  23. Experiments Track Theory Brunner, O.Connor, Rubin, Huttegger “David Lewis in the Lab – Experimental Results on the Emergence of Meaning” Synthese (2014/2018) Efficient signaling can emerge, but is not guaranteed .

  24. 3. Can the game itself evolve?

  25. Inventing New Signals • Alexander, Skyrms, Zabell (2011) Dynamic Games and Applications.

  26. Previous Urn Model + “Mutator” 1. No New Signal Tried 2. New Signal Tried, but unsuccessful. 3. New signal tried with success.

  27. Learning to Signal with Invention 3 by 3 by 3 states equiprobable 2 by 2by 2 probabilities probability .9

  28. Self-Assembling Games Barrett & Skyrms BJPS 2017

  29. 4. Signaling on Networks

  30. Lattice • Kevin Zollman “Talking to Neighbors” PhilSci (2005)

  31. Regional Meaning on a Lattice Also Pre-play signaling in Stag Hunt Games promotes Coopertion

  32. Small World Networks Elliott Wagner “ Communication and structured correlation.” Erkenntnis (2009)

  33. Signaling Chains 1 “Signalling chains with probe and adjust learning” - Giorgio Gosti Connection Science 2017

  34. Signaling Chains 2 “Broken Telephone: An Analysis of a Reinforcement Process” -Johnathan Kariv PhD Thesis Mathematics Penn

  35. Dynamic Networks

  36. 5. Can the Network Itself Evolve? Reinforcement: Skyrms and Pemantle (2000) “A Dynamic Model of Social Network Formation” PNAS

  37. A RING Bala and Goyal (2000) “A Non-cooperative Model of Network Formation” Econometrica ( Best Response with Inertia) Skyrms and Huttegger (2013) “Emergence of a Signaling Network with Probe and Adjust” in Cooperation and its Evolution. Huttegger , Skyrms and Zollman (2014) “Probe and Adjust in Information Transfer” Erkenntnis

  38. Stars, etc. “ Self-Assembling Networks” Barrett, Skyrms, Mosheni BJPS forth.

  39. There is lots more to do.

  40. Thank you.

  41. Beyond Common Interest

  42. Opposed Interests A1 A2 A3 S1 -1, 1 .5, -.5 1, -1 S2 1,-1 -1, 1 .5, -.5 S3 .5, -.5 1,-1 -1, 1

  43. Chaos (structurally stable) Wagner BJPS 2012, Sato Akiyama, Farmer, PNAS 2002.

  44. Mixed Interests with Differential Signaling Costs Cycles also occur here in a non-trivial way in: Spence Signaling Game - Noldeke &Samuelson J. Econ. Th. (1997) - Wagner Games (2013) Sir Philip Sydney Game - Huttegger & Zollman Proc.Roy.Soc .(2010) - But signaling system Equilibria are also possible.

  45. Information Transfer may emerge spontaneously without common interest in and out of equilibrium

  46. Cycles around Hybrid Equilibrium

  47. Deception Searcy and Nowicki The Evolution of Animal Signals: Reliability and Deception in Signaling Systems Harper and Maynard Smith Animal Signals Skyrms Signals Godfrey-Smith review of Signals Bergstrom “Dealing with Deception in Biology” Fallis "Skyrms on the Possibility of Universal Deception", Philosophical Studies , (forthcoming) McWhirter "Behavioral Deception and Formal Models of Communication" in the British Journal for the Philosophy of Science (forthcoming)

  48. Propositional Content Birch “Propositional Content in Signaling Systems” Philosophical Studies . Godfrey-Smith et.all. Special Journal Issue

  49. Costless Pre-Play Signaling Robson (1990) “Efficiency in Evolutionary Games” Journal of Evolutionary Biology. Skyrms (2002) “Signals, Evolution and the Explanatory Value of Transient Information” Philosophy of Science Santos, Pacheco, Skyrms (2011) “Co-evolution of pre-play signaling and cooperation” Journal of Theoretical Biology

  50. Perturbation: mutation Pooling equilibria collapse to a single point. Is it dynamically unstable, stable, strongly stable? It depends. (Hofbauer and Huttegger JTB 2008). If a sink, otherwise a saddle. (for small mutation rates).

  51. Synonyms and Bottlenecks: Simulations N Partial Pooling 3 9.6 % 4 21.9 % 8 59.4 % Barrett Phil. Sci. 2007

  52. Transient Information in Pre-play Signaling: Stag Hunt -- Skyrms PhiSci 2002

  53. Structural Stability A Dynamics (given by a vector field) is Structurally Unstable if an arbitrarily small change in the vector field yields a qualitatively different dynamics.

  54. Arbitrarily small difference? At each point in the simplex, for each component, there is a numerical difference. Take the maximum. Take the least upper bound of these numbers. This is the distance between the vector fields.

  55. Qualitatively Different? Two vector fields are qualitatively the same , i.e. (topologically equivalent) if there is homeomorphism of the simplex to itself that takes the orbits of one into the orbits of the other (preserving sense of the orbits).

  56. Selection-Mutation Dynamics Hofbauer (1985) J. Math. Bio.

  57. Functional Analysis Aczél, J.; Daróczy, Z. On Measures of Information and Their Characterizations

  58. Complex Signals • Franke (2013) “Compositionality from Reinforcement Learning” Proc. G.I.R.L. • Barrett (2009) “Evolution of Coding in Signaling Games” Th. & Dec. • Steinert-Threlkeld (forth.) “Compositional Signaling in a Complex World” JLLI. • Nowak and Krakauer (1999) “The Evolution of Language” PNAS. • Batali (2002) “Negation and Acquisition of Recursive Grammars…” in Briscoe (ed.) • Barrett, Skyrms & Cochran (2018) “Hierarchinal Models …” ms.

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend