Rapid Development of Human Expertise Zoran Popovi Center for Game - PowerPoint PPT Presentation

Rapid Development of Human Expertise Zoran Popović Center for Game Science Department of CSE University of Washington

The Challenge Solve problems that – All expert people – all massive computer architectures cannot solve by themselves

Symbiotic Human-Computer Computing architecture

Solving Hard Problems with Human-Computer Symbiosis Coadapta@on (Op@miza@on): 1. People → Experts 2. Interac@on → Op@mal problem solving tools Games are an ideal vehicle of coadapta@on

People → Experts 1. Infinite Curriculum Thought Process Language Analysis – 2. Op@mal Ac@ons through Learning Ecosystem – Learners – Groups – Teachers 3. Op@mize for the Meta and Non-cogni@ve skills – Persistence – Thinking outside of the box

Signs of Promise

Proteins

Proteins MQIFVKTLTGKTILEVEPSDTIE… Sequence 8

Proteins MQIFVKTLTGKTILEVEPSDTIE… Sequence 3D Structure 9

Proteins MQIFVKTLTGKTILEVEPSDTIE… MGKYDKQIDLSTVDLKKLRVKEL… KPVSLSYRCPCRFFESHVARANV… … … Sequence 3D Structure 10

Proteins ? MKTLYDLPIVLRNLPEDLVLEKP… ? SMSDTAERVKKIVVEHLGVDADK… ? GPLGSDQYIVVNGAPVIPSAKVP… … … Sequence 3D Structure EASY HARD 11

Proteins ? MKTLYDLPIVLRNLPEDLVLEKP… ? SMSDTAERVKKIVVEHLGVDADK… ? GPLGSDQYIVVNGAPVIPSAKVP… … … Sequence 3D Structure EASY HARD 12

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 14

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 15

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 16

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 17

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 18

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 19

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 20

Training refinement 100 90 Level completion percentage 80 70 60 50 40 30 20 10 0 3/1 3/3 3/5 3/7 3/9 3/11 3/13 3/15 3/17 3/19 3/21 3/23 3/25 3/27 3/29 3/31 4/2 4/4 4/6 4/8 4/10 4/12 4/14 4/16 4/18 4/20 4/22 4/24 4/26 4/28 4/30 Date One Small Clash Twin Pack Lock and Lower Swing It Around Nudge It Along Turn It Down Hide the Hydrophobic Triple Packed The Right Rotation Shake It Off Sheets Together Flippin' Sheets Close the Gap Lonely Sheets Rubber Band Reversal When Backbones Collide Sheets and Ladders Linear trend (R.B.R. only) 21

Comparison to Algorithm BeWer energy Player solutions Top player path Algorithm solutions Closer to na@ve

Very broad appeal Prior knowledge of biochemistry None High school / Basic One undergraduate course Majored in biology or similar PhD in chemistry or organic chemistry PhD in biochemistry 30 years ago Professionally involved

Social Exper@se • Group sharing and collabora@on • Peer review and itera@on • Mul@ple paths to skill and success • Social praise and feedback • Self-specializa@on • Collec@ve Intelligence

Crea@vity

Drug Design

Small Molecules

Foldit PlayerDesigns

Accelera@ng Neuroscience

Neuronal Reconstruc@on Goal: can we produce high quality reconstruc@ons at scale by developing novices?

Neuron Ontology Reconstruc@on

Rapid Content Mastery

Algebra Mastery in Elementary School 3 equations without errors with behaviors that indicate 3luency 𝑏𝑦 + 𝑐 = ​𝑑 + 𝑒/𝑓 ​𝑏𝑐𝑦/𝑐 + 𝑑 + 𝑑 +0= 𝑒 + 𝑧𝑨 ​𝑐 − 𝑑/𝑦 = 𝑑 + 𝑒 − 𝑑

Washington Algebra Challenge

Norway Challenge • 8 million equa@ons • Almost 10% of school ready kids now have the concept mastered • 42% of all work is done in a`er school hours

Teacher Effects

3x

Student Effects

4.5x

K-12 Deployment • ½ Million students / grade – Math and ELA • 200 million first genera@on learners in India – basic numeracy and literacy

Learned Lessons • Infinitely adap@ve experience • Op@mize the en@re ecosystem • Op@mize individuals not outcomes • Collec@ve Social Intelligence • Coevolu@on

People → Experts 1. Infinite Curriculum Thought Process Language Analysis – 2. Op@mal Ac@ons through Learning Ecosystem – Learners – Groups – Teachers 3. Op@mize for the Meta and Non-cogni@ve skills – Persistence – Thinking outside of the box