games
play

Games Miheer Dewaskar Chennai Mathematical Institute April 27, - PowerPoint PPT Presentation

Games Miheer Dewaskar Chennai Mathematical Institute April 27, 2016 1 / 19 Outline Finite Duration Games Win-Lose Games Payoff Games Infinite Duration Games Parity Games Mean Payoff Games Simple Stochastic Games 2 / 19 Outline Finite


  1. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 Stack = 1 5 6 9 / 19

  2. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 5 Stack = 1 5 6 5 9 / 19

  3. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 5 Stack = 1 5 9 / 19

  4. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 5 2 Stack = 1 5 2 9 / 19

  5. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 5 2 3 Stack = 1 5 2 3 9 / 19

  6. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Extension to infinite plays π = 1 2 1 5 6 5 2 3 6 Stack = 1 5 2 3 6 9 / 19

  7. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Every eliminated cycle has Extension to infinite plays max priority even π = 1 2 1 5 6 5 2 3 6 5 Stack = 1 5 2 3 6 5 9 / 19

  8. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Every eliminated cycle has Extension to infinite plays max priority even π = 1 2 1 5 6 5 2 3 6 5 Stack = 1 5 . . . 9 / 19

  9. Parity Games Odd Wins 1 Even Wins Even 3 Odd 5 2 6 5 1 2 6 2 3 3 6 Finite game 6 5 Every loop has max priority even Every eliminated cycle has Extension to infinite plays max priority even π = 1 2 1 5 6 5 2 3 6 5 Hence max Inf priority in π is Even Stack = 1 5 . . . 9 / 19

  10. Parity Games Better Algorithms Marcin Jurdzinski and Jens Vöge. “A discrete strategy improvement algorithm for solving parity games”. In: Computer Aided Verification . Springer, 2000, pp. 202–215 Upper bound 1 : O � ( n / d ) d � 1 see also Friedmann, “Exponential Lower Bounds for Solving Infinitary Payoff Games and Linear Programs”. 10 / 19

  11. Parity Games Better Algorithms Marcin Jurdzinski and Jens Vöge. “A discrete strategy improvement algorithm for solving parity games”. In: Computer Aided Verification . Springer, 2000, pp. 202–215 Upper bound 1 : O � ( n / d ) d � Marcin Jurdzinski, Mike Paterson, and Uri Zwick. “A Deterministic Subexponential Algorithm for Solving Parity Games”. In: SIAM Journal on Computing 38.4 (Jan. 2008), pp. 1519–1532 n O ( √ n ) 1 see also Friedmann, “Exponential Lower Bounds for Solving Infinitary Payoff Games and Linear Programs”. 10 / 19

  12. Outline Finite Duration Games Infinite Duration Games Parity Games Mean Payoff Games Simple Stochastic Games 11 / 19

  13. Mean Payoff Games Payoffs 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  14. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  15. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  16. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  17. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  18. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  19. Mean Payoff Games Payoffs ( ab ) ω 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  20. Mean Payoff Games Payoffs ( ab ) ω a 3 b -2 a 2 -2 -1 Max c Min -1 12 / 19

  21. Mean Payoff Games Payoffs ( ab ) ω a − 2 − − → b − 2 3 b 1 -2 a 2 -2 -1 Max c Min -1 12 / 19

  22. Mean Payoff Games Payoffs ( ab ) ω a − 2 → b +3 − − − − → a − 2 + 3 3 b 2 -2 a 2 -2 -1 Max c Min -1 12 / 19

  23. Mean Payoff Games Payoffs ( ab ) ω a − 2 → b +3 → a − 2 − − − − − − → b − 2 + 3 − 2 3 b 3 -2 a 2 -2 -1 Max c Min -1 12 / 19

  24. Mean Payoff Games Payoffs ( ab ) ω a − 2 → b +3 → a − 2 → b +3 − − − − − − − − → a − 2 + 3 − 2 + 3 3 b 4 -2 a 2 -2 -1 Max c Min -1 12 / 19

  25. Mean Payoff Games Payoffs ( ab ) ω a − 2 → b +3 → a − 2 → b +3 → a − 2 − − − − − − − − − − → b − 2 + 3 − 2 + 3 − 2 3 b 5 -2 a 2 -2 -1 Max c Min -1 12 / 19

  26. Mean Payoff Games Payoffs ( ab ) ω a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a − 2 + 3 − 2 + 3 − 2 + 3 3 b 6 -2 a 2 -2 -1 Max c Min -1 12 / 19

  27. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 -2 -1 Max c Min -1 12 / 19

  28. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  29. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  30. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  31. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  32. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  33. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  34. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  35. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min -1 12 / 19

  36. Mean Payoff Games Payoffs ( ab ) ω Min pays 1 2 units to Max a − 2 → b +3 → a − 2 → b +3 → a − 2 → b +3 − − − − − − − − − − − − → a . . . − 2 + 3 − 2 + 3 − 2 + 3 → 1 3 ∼ n ( − 2+3) b 2 n 6 2 -2 a 2 ( acb ) ω -2 -1 Max c Min a -1 12 / 19

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend