Rapid Development of Human Expertise Zoran Popovi Center for Game - - PowerPoint PPT Presentation

rapid development of human expertise
SMART_READER_LITE
LIVE PREVIEW

Rapid Development of Human Expertise Zoran Popovi Center for Game - - PowerPoint PPT Presentation

Rapid Development of Human Expertise Zoran Popovi Center for Game Science Department of CSE University of Washington The Challenge Solve problems that All expert people all massive computer architectures cannot solve by themselves


slide-1
SLIDE 1

Rapid Development of Human Expertise

Zoran Popović

Center for Game Science Department of CSE University of Washington

slide-2
SLIDE 2

The Challenge

Solve problems that

– All expert people – all massive computer architectures

cannot solve by themselves

slide-3
SLIDE 3

Symbiotic Human-Computer Computing architecture

slide-4
SLIDE 4

Solving Hard Problems with Human-Computer Symbiosis

Coadapta@on (Op@miza@on):

  • 1. People

→ Experts

  • 2. Interac@on → Op@mal problem solving tools

Games are an ideal vehicle of coadapta@on

slide-5
SLIDE 5

People → Experts

  • 1. Infinite Curriculum

– Thought Process Language Analysis

  • 2. Op@mal Ac@ons through Learning Ecosystem

– Learners – Groups – Teachers

  • 3. Op@mize for the Meta and Non-cogni@ve skills

– Persistence – Thinking outside of the box

slide-6
SLIDE 6

Signs of Promise

slide-7
SLIDE 7

Proteins

slide-8
SLIDE 8

Proteins

8

MQIFVKTLTGKTILEVEPSDTIE…

Sequence

slide-9
SLIDE 9

Proteins

9

MQIFVKTLTGKTILEVEPSDTIE…

Sequence 3D Structure

slide-10
SLIDE 10

Proteins

10

MQIFVKTLTGKTILEVEPSDTIE… KPVSLSYRCPCRFFESHVARANV…

… …

MGKYDKQIDLSTVDLKKLRVKEL…

Sequence 3D Structure

slide-11
SLIDE 11

Proteins

11

MKTLYDLPIVLRNLPEDLVLEKP… GPLGSDQYIVVNGAPVIPSAKVP…

… …

? ?

SMSDTAERVKKIVVEHLGVDADK…

?

EASY HARD

Sequence 3D Structure

slide-12
SLIDE 12

Proteins

12

MKTLYDLPIVLRNLPEDLVLEKP…

3D Structure

SMSDTAERVKKIVVEHLGVDADK… GPLGSDQYIVVNGAPVIPSAKVP…

… …

? ? ?

EASY HARD

Sequence

slide-13
SLIDE 13
slide-14
SLIDE 14

Training

refinement

14

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-15
SLIDE 15

Training

refinement

15

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-16
SLIDE 16

Training

refinement

16

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-17
SLIDE 17

Training

refinement

17

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-18
SLIDE 18

Training

refinement

18

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-19
SLIDE 19

Training

refinement

19

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-20
SLIDE 20

Training

refinement

20

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-21
SLIDE 21

Training

refinement

21

10 20 30 40 50 60 70 80 90 100 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Level completion percentage Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only)

slide-22
SLIDE 22

Player solutions Top player path Algorithm solutions

Comparison to Algorithm

Closer to na@ve BeWer energy

slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25

Prior knowledge of biochemistry

None High school / Basic One undergraduate course Majored in biology or similar PhD in chemistry or

  • rganic chemistry

PhD in biochemistry 30 years ago Professionally involved

Very broad appeal

slide-26
SLIDE 26

Social Exper@se

  • Group sharing and collabora@on
  • Peer review and itera@on
  • Mul@ple paths to skill and success
  • Social praise and feedback
  • Self-specializa@on
  • Collec@ve Intelligence
slide-27
SLIDE 27

Crea@vity

slide-28
SLIDE 28

Drug Design

slide-29
SLIDE 29

Small Molecules

slide-30
SLIDE 30

Foldit PlayerDesigns

slide-31
SLIDE 31
slide-32
SLIDE 32
slide-33
SLIDE 33

Accelera@ng Neuroscience

slide-34
SLIDE 34

Neuronal Reconstruc@on

Goal: can we produce high quality reconstruc@ons at scale by developing novices?

slide-35
SLIDE 35
slide-36
SLIDE 36
slide-37
SLIDE 37

Neuron Ontology Reconstruc@on

slide-38
SLIDE 38

Rapid Content Mastery

slide-39
SLIDE 39
slide-40
SLIDE 40
slide-41
SLIDE 41

Algebra Mastery in Elementary School

3 equations without errors with behaviors that indicate 3luency 𝑏𝑦+𝑐=​𝑑+𝑒/𝑓 ​𝑏𝑐𝑦/𝑐+𝑑 +𝑑+0=𝑒+𝑧𝑨 ​𝑐−𝑑/𝑦 =𝑑+𝑒 −𝑑

slide-42
SLIDE 42

Washington Algebra Challenge

slide-43
SLIDE 43
slide-44
SLIDE 44
slide-45
SLIDE 45
slide-46
SLIDE 46

Norway Challenge

  • 8 million equa@ons
  • Almost 10% of school ready kids now have the

concept mastered

  • 42% of all work is done in a`er school hours
slide-47
SLIDE 47
slide-48
SLIDE 48
slide-49
SLIDE 49

Teacher Effects

slide-50
SLIDE 50

3x

slide-51
SLIDE 51

Student Effects

slide-52
SLIDE 52

4.5x

slide-53
SLIDE 53

K-12 Deployment

  • ½ Million students / grade

– Math and ELA

  • 200 million first genera@on learners in India

– basic numeracy and literacy

slide-54
SLIDE 54

Learned Lessons

  • Infinitely adap@ve experience
  • Op@mize the en@re ecosystem
  • Op@mize individuals not outcomes
  • Collec@ve Social Intelligence
  • Coevolu@on
slide-55
SLIDE 55

People → Experts

  • 1. Infinite Curriculum

– Thought Process Language Analysis

  • 2. Op@mal Ac@ons through Learning Ecosystem

– Learners – Groups – Teachers

  • 3. Op@mize for the Meta and Non-cogni@ve skills

– Persistence – Thinking outside of the box