Depth in Strategic Games Frank Lantz NYU Game Center Aaron Isaksen - - PowerPoint PPT Presentation

depth in strategic games
SMART_READER_LITE
LIVE PREVIEW

Depth in Strategic Games Frank Lantz NYU Game Center Aaron Isaksen - - PowerPoint PPT Presentation

Depth in Strategic Games Frank Lantz NYU Game Center Aaron Isaksen NYU Game Innovation Lab Alexander Jaffe Spry Fox Andy Nealen NYU Game Innovation Lab Julian Togelius NYU Game Innovation Lab Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth


slide-1
SLIDE 1

Frank Lantz NYU Game Center Aaron Isaksen NYU Game Innovation Lab Alexander Jaffe Spry Fox Andy Nealen NYU Game Innovation Lab Julian Togelius NYU Game Innovation Lab

Depth in Strategic Games

Frank Lantz NYU Game Center frank.lantz@nyu.edu

slide-2
SLIDE 2

Is there a well-defined property of game systems that corresponds to what designers and players mean when they refer to “strategic depth”?

The Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-3
SLIDE 3

Preliminary Observations

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-4
SLIDE 4
  • game design and computer science

Preliminary Observations

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-5
SLIDE 5
  • game design and computer science
  • tractable, but not currently known

Preliminary Observations

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-6
SLIDE 6
  • game design and computer science
  • tractable, but not currently known
  • existing research

Preliminary Observations

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-7
SLIDE 7
  • game design and computer science
  • tractable, but not currently known
  • existing research
  • laying a foundation

Preliminary Observations

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-8
SLIDE 8

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-9
SLIDE 9
  • “deep” = “good”

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-10
SLIDE 10
  • “deep” = “good”
  • a spectrum, not a binary

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-11
SLIDE 11
  • “deep” = “good”
  • a spectrum, not a binary
  • psychology-independent

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-12
SLIDE 12
  • “deep” = “good”
  • a spectrum, not a binary
  • psychology-independent
  • abstract, simplified strategic games

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-13
SLIDE 13
  • “deep” = “good”
  • a spectrum, not a binary
  • psychology-independent
  • abstract, simplified strategic games
  • “d”

Clarifying the Question

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-14
SLIDE 14

Why Ask the Question?

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-15
SLIDE 15
  • conceptual tool to improve design discussions

Why Ask the Question?

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-16
SLIDE 16
  • conceptual tool to improve design discussions
  • suggest directions for design exploration

Why Ask the Question?

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-17
SLIDE 17
  • conceptual tool to improve design discussions
  • suggest directions for design exploration
  • pure curiosity and knowledge

Why Ask the Question?

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-18
SLIDE 18
  • conceptual tool to improve design discussions
  • suggest directions for design exploration
  • pure curiosity and knowledge
  • general questions about AI and “machine

aesthetics”

Why Ask the Question?

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-19
SLIDE 19

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-20
SLIDE 20
  • strategic games as problem-solving tasks

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-21
SLIDE 21
  • strategic games as problem-solving tasks
  • different “flavors” of hardness

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-22
SLIDE 22
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-23
SLIDE 23
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-24
SLIDE 24
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:
  • state-space

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-25
SLIDE 25
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:
  • state-space
  • branching factor

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-26
SLIDE 26
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:
  • state-space
  • branching factor
  • “traditional” hardness

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-27
SLIDE 27
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:
  • state-space
  • branching factor
  • “traditional” hardness
  • observing characteristics of real-world games

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-28
SLIDE 28
  • strategic games as problem-solving tasks
  • different “flavors” of hardness
  • complexity theory
  • existing properties:
  • state-space
  • branching factor
  • “traditional” hardness
  • observing characteristics of real-world games
  • building a model

Our General Approach

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-29
SLIDE 29

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-30
SLIDE 30
  • Large community of dedicated players

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-31
SLIDE 31
  • Large community of dedicated players
  • Life-long learning with regular improvement

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-32
SLIDE 32
  • Large community of dedicated players
  • Life-long learning with regular improvement
  • Vast body of knowledge and strategic analysis

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-33
SLIDE 33
  • Large community of dedicated players
  • Life-long learning with regular improvement
  • Vast body of knowledge and strategic analysis
  • The Skill Chain (eg, Elo)

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-34
SLIDE 34
  • Large community of dedicated players
  • Life-long learning with regular improvement
  • Vast body of knowledge and strategic analysis
  • The Skill Chain (eg, Elo)
  • The Strategy Ladder

Characteristics of Depth

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-35
SLIDE 35

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

Perfect Play Solution Strength Computational Resources

slide-36
SLIDE 36

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

Perfect Play Solution Strength Computational Resources

The capacity for a game system to allow for a ranked sequence of approximate solutions

slide-37
SLIDE 37

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-38
SLIDE 38

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
slide-39
SLIDE 39

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
slide-40
SLIDE 40

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
slide-41
SLIDE 41

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
slide-42
SLIDE 42

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
slide-43
SLIDE 43

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
slide-44
SLIDE 44

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
slide-45
SLIDE 45

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
slide-46
SLIDE 46

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
  • Strength
slide-47
SLIDE 47

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
  • Strength
  • Win rate
slide-48
SLIDE 48

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
  • Strength
  • Win rate
  • Quality of move selection
slide-49
SLIDE 49

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
  • Strength
  • Win rate
  • Quality of move selection
  • Steps
slide-50
SLIDE 50

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Strategies - complete algorithmic descriptions
  • when & how to search
  • when & how to evaluate
  • when & how to use heuristics
  • Computational Resources
  • Number of operations
  • Working memory
  • K-complexity “footprint”
  • Strength
  • Win rate
  • Quality of move selection
  • Steps
  • What is the model’s output?
slide-51
SLIDE 51

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-52
SLIDE 52

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

Perfect Play Solution Strength Computational Resources

slide-53
SLIDE 53

The Strategy Ladder

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

Perfect Play Solution Strength Computational Resources

The shape of this curve reveals something important about the game’s underlying structure

slide-54
SLIDE 54

Applications of the Model

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-55
SLIDE 55

Applications of the Model

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Conceptual tool for speculation
slide-56
SLIDE 56

Applications of the Model

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Conceptual tool for speculation
  • Direct observation of real games at low CR levels
slide-57
SLIDE 57

Applications of the Model

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Conceptual tool for speculation
  • Direct observation of real games at low CR levels
  • Complete analysis of small games, toy games
slide-58
SLIDE 58

Applications of the Model

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Conceptual tool for speculation
  • Direct observation of real games at low CR levels
  • Complete analysis of small games, toy games
  • Research tool for observing how d changes as you

change aspects of the rule set

slide-59
SLIDE 59

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-60
SLIDE 60

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
slide-61
SLIDE 61

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
slide-62
SLIDE 62

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
slide-63
SLIDE 63

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
slide-64
SLIDE 64

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
slide-65
SLIDE 65

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
slide-66
SLIDE 66

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
slide-67
SLIDE 67

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
slide-68
SLIDE 68

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
  • Complex strategies
slide-69
SLIDE 69

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
  • Complex strategies
  • knowledge
slide-70
SLIDE 70

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
  • Complex strategies
  • knowledge
  • explanation
slide-71
SLIDE 71

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
  • Complex strategies
  • knowledge
  • explanation
  • insight
slide-72
SLIDE 72

Observations: Search vs. Heuristics

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Games of low d fail by having simple best avail strats
  • Simple strategies
  • pure search
  • one weird trick
  • Games of pure search
  • don’t “feel” deep
  • don’t support life-long learning
  • don’t allow for multiple skill levels
  • Complex strategies
  • knowledge
  • explanation
  • insight
  • Semi-ordered game structure allows for heuristics as

a form of search-compression

slide-73
SLIDE 73

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

slide-74
SLIDE 74

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
slide-75
SLIDE 75

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
  • Application to simple games
slide-76
SLIDE 76

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
  • Application to simple games
  • Development and analysis of toy games
slide-77
SLIDE 77

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
  • Application to simple games
  • Development and analysis of toy games
  • Full Analysis of toy versions of real games
slide-78
SLIDE 78

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
  • Application to simple games
  • Development and analysis of toy games
  • Full Analysis of toy versions of real games
  • Partial analysis of real games
slide-79
SLIDE 79

Next Steps

Frank Lantz NYU Game Center frank.lantz@nyu.edu Depth in Strategic Games

  • Further refinement of the model
  • Application to simple games
  • Development and analysis of toy games
  • Full Analysis of toy versions of real games
  • Partial analysis of real games
  • Further exploration of search vs. heuristics