CMU 15-896 Noncooperative games 1: Basic concepts Teacher: Ariel - - PowerPoint PPT Presentation

cmu 15 896
SMART_READER_LITE
LIVE PREVIEW

CMU 15-896 Noncooperative games 1: Basic concepts Teacher: Ariel - - PowerPoint PPT Presentation

CMU 15-896 Noncooperative games 1: Basic concepts Teacher: Ariel Procaccia Normal-Form Game A game in normal form consists of: Set of players o Strategy set o For each , utility function : if o each plays the strategy


slide-1
SLIDE 1

CMU 15-896

Noncooperative games 1: Basic concepts

Teacher: Ariel Procaccia

slide-2
SLIDE 2

15896 Spring 2016: Lecture 17

Normal-Form Game

  • A game in normal form consists of:
  • Set of players
  • Strategy set
  • For each

, utility function

  • : if

each plays the strategy , the utility of player is

  • Next example created by taking

screenshots of http://youtu.be/jILgxeNBK_8

2

slide-3
SLIDE 3

15896 Spring 2016: Lecture 17

3

Selling ice cream at the beach. One day your cousin Ted shows up. His ice cream is identical! You split the beach in half; you set up at 1/4. 50% of the customers buy from you. 50% buy from Teddy. One day Teddy sets up at the 1/2 point! Now you serve only 37.5%!

slide-4
SLIDE 4

15896 Spring 2016: Lecture 17

  • The Ice Cream Wars
  • To be continued…

4

slide-5
SLIDE 5

15896 Spring 2016: Lecture 17

The prisoner’s dilemma

  • Two men are charged with a crime
  • They are told that:
  • If one rats out and the other does not, the

rat will be freed, other jailed for nine years

  • If both rat out, both will be jailed for six

years

  • They also know that if neither rats out,

both will be jailed for one year

5

slide-6
SLIDE 6

15896 Spring 2016: Lecture 17

The prisoner’s dilemma

6

  • 1,-1
  • 9,0

0,-9

  • 6,-6

Cooperate Defect Cooperate Defect

What would you do?

slide-7
SLIDE 7

15896 Spring 2016: Lecture 17

Prisoner’s dilemma on TV

7

http://youtu.be/S0qjK3TWZE8

slide-8
SLIDE 8

15896 Spring 2016: Lecture 17

The professor’s dilemma

8

106,106

  • 10,0

0,-10 0,0

Make effort Slack off Listen Sleep

Dominant strategies?

Professor Class

slide-9
SLIDE 9

15896 Spring 2016: Lecture 17

Nash equilibrium

  • Each player’s strategy

is a best response to strategies of others

  • Formally, a Nash

equilibrium is a vector of strategies

  • such that
  • 9
slide-10
SLIDE 10

15896 Spring 2016: Lecture 17

Nash equilibrium

http://youtu.be/CemLiSI5ox8

10

slide-11
SLIDE 11

15896 Spring 2016: Lecture 17

Russel Crowe was wrong

11

slide-12
SLIDE 12

15896 Spring 2016: Lecture 17

End of the Ice Cream Wars

12

Day 3 of the ice cream wars… Teddy sets up south of you! You go south of Teddy. Eventually…

slide-13
SLIDE 13

15896 Spring 2016: Lecture 17

13

R P S R

0,0

  • 1,1

1,-1

P

1,-1 0,0

  • 1,1

S

  • 1,1

1,-1 0,0

Rock-paper-scissors

Nash equilibrium?

slide-14
SLIDE 14

15896 Spring 2016: Lecture 17

Mixed strategies

  • A mixed strategy is a probability

distribution over (pure) strategies

  • The mixed strategy of player

is , where

  • The utility of player

is

, … ,

  • , … , ⋅
  • ,…,∈

14

slide-15
SLIDE 15

15896 Spring 2016: Lecture 17

Nash’s Theorem

  • Theorem [Nash, 1950]: if everything is

finite then there exists at least one (possibly mixed) Nash equilibrium

  • We’ll talk about computation some other

time

15

slide-16
SLIDE 16

15896 Spring 2016: Lecture 17

Does NE make sense?

  • Two players, strategies are
  • If both choose the same number, that is

what they get

  • If one chooses , the other , and

, the former player gets , and the latter gets

  • Poll 1: what would you choose?

16

100 99 98 97 96 95

slide-17
SLIDE 17

15896 Spring 2016: Lecture 17

Correlated equilibrium

  • Let

for simplicity

  • A mediator chooses a pair of strategies
  • according to a distribution
  • ver
  • Reveals to player

and to player

  • When player

gets , he knows that the distribution over strategies of is

17

slide-18
SLIDE 18

15896 Spring 2016: Lecture 17

Correlated equilibrium

  • Player

is best responding if for all

  • Equivalently,

  • is a correlated equilibrium (CE) if both

players are best responding

18

slide-19
SLIDE 19

15896 Spring 2016: Lecture 17

Game of chicken

19

http://youtu.be/u7hZ9jKrwvo

slide-20
SLIDE 20

15896 Spring 2016: Lecture 17

Game of chicken

  • Social welfare is the sum of

utilities

  • Pure NE: (C,D) and (D,C),

social welfare = 5

  • Mixed NE: both

social welfare = 4

  • Optimal social welfare = 6

20

Dare Chicken Dare

0,0 4,1

Chicken

1,4 3,3

slide-21
SLIDE 21

15896 Spring 2016: Lecture 17

Game of chicken

  • Correlated equilibrium:
  • (D,D):
  • (D,C):
  • (C,D):
  • (C,C):
  • Social welfare of CE =
  • 21

Dare Chicken Dare

0,0 4,1

Chicken

1,4 3,3

slide-22
SLIDE 22

15896 Spring 2016: Lecture 17

Implementation of CE

  • Instead of a mediator, use a hat!
  • Balls in hat are labeled with

“chicken” or “dare”, each blindfolded player takes a ball

22

C D D C C C D C

Which balls implement the distribution of the previous slide?

slide-23
SLIDE 23

15896 Spring 2016: Lecture 17

CE vs. NE

  • Poll 2: What is the relation between CE

and NE?

1.

CE NE

2.

NE CE

3.

NE CE

4.

NE CE

23

slide-24
SLIDE 24

15896 Spring 2016: Lecture 17

CE As LP

  • Can compute CE via linear programming

in polynomial time!

24

find

  • s.t.
  • , 1

,∈

  • , , ,

, ∈ ∈

, , , ,