Digitally-Delivered Diagnostic Assessments Based on Learning - PowerPoint PPT Presentation

Digitally-Delivered Diagnostic Assessments Based on Learning Trajectories Supporting Personalization and Competency-Based Approach in 6 – 8 Mathematics Jere Confrey, Project Director Joseph D. Moore Distinguished University Professor Science, Technology, Engineering and Mathematics (STEM) Department College of Education, North Carolina State University Garron Gianopulos, Psychometrician Science, Technology, Engineering and Mathematics (STEM) Department College of Education, North Carolina State University Charlene Marchese, Mathematics Supervisor Freehold District Brian Gong, Center for Assessment Wednesday, June 22, 2016 Session Time: 10:00 AM, Session Location: Franklin Hall 13 Scaling Up Digital Design Studies | NC State University | College of Education

Project Support The Bill and Melinda Gates Foundation National Science Foundation Scaling Up Digital Design Studies 6/23/201 2 Scaling Up Digital Design Studies | NC State University | College of Education 6

Overview  The SUDDS team  How our DLS can help close the gap  A demonstration of the Digital Learning System (DLS)  A closer look at our assessments  What we have learned  New Research Directions 6/23/201 3 Scaling Up Digital Design Studies | NC State University | College of Education 6

The SUDDS Team Jere Confrey Will McGowan Meetal Shah Garron Gianopulos Project Director Project Coordinator Learning Sciences Psychometrician Yungjae Kim Douglas Ivers Basia Coulter Software Engineer Software Engineer UX/UI Designer Other contributors: Pedro Larios and Seth Jones 6/23/201 4 Scaling Up Digital Design Studies | NC State University | College of Education 6

A Cross-Field Approach Learning Sciences UX/UI Software Partner Design Engineering Schools Psychometrics 6/23/201 5 Scaling Up Digital Design Studies | NC State University | College of Education 6

Research-Derived Design Synthesis of the Literature  Design Studies  Usability Studies  Cognitive Interviews  Field Tests  Agile Methodology  6/23/201 6 Scaling Up Digital Design Studies | NC State University | College of Education 6

Foundational Beliefs  Start with the end-user in mind  Maximize functionality and aesthetics  Design should be theory-driven  Learning theories should be explicit and testable  Improvements should be continuous  Smart machines cannot replace teachers 6/23/2016 7 Scaling Up Digital Design Studies | NC State University | College of Education

Overview  The SUDDS team  How our DLS can help close the gap  A demonstration of the Digital Learning System (DLS)  What we have learned  New research directions and next steps  New Research Directions 6/23/201 8 Scaling Up Digital Design Studies | NC State University | College of Education 6

What do Middle Grade Math Teachers and Students Need to Close the Performance Gap? 6/23/201 9 Scaling Up Digital Design Studies | NC State University | College of Education 6

The Goals of the SUDDS Digital Learning System (DLS)  Increase Coherence of Digital Content  Personalize Learning  Provide Actionable Feedback  Support Flexible Grouping 6/23/201 10 Scaling Up Digital Design Studies | NC State University | College of Education 6

What is a Digital Learning System? Internet Links Confrey, November, 2015 6/23/201 11 Scaling Up Digital Design Studies | NC State University | College of Education 6

The SUDDS DLS Our tool is an innovative digital container, where students and teachers can…  Navigate the content of middle school mathematics around big ideas and research-based learning trajectories  Select and sequence aligned open source curricular resources  Assess, in real time, students’ progress , identifying needs and next steps 6/23/201 12 Scaling Up Digital Design Studies | NC State University | College of Education 6

What is a Learning Trajectory? A learning trajectory connects Different Trajectories what students bring to instruction, to a target concept, and delineates a set of landmarks and obstacles that students are likely to encounter as they move from naïve to sophisticated understandings 6/23/201 13 Scaling Up Digital Design Studies | NC State University | College of Education 6

Overview The SUDDS team  How our DLS can help close the gap  A demonstration of the Digital Learning System (DLS)  A closer look at our assessments  What we have learned  New Research Directions  6/23/201 14 Scaling Up Digital Design Studies | NC State University | College of Education 6

Demo of the SUDDS Learning Map  Production version of the map  Feel free to create an account and explore our DLS! 6/23/201 15 Scaling Up Digital Design Studies | NC State University | College of Education 6

Middle School Mathematics in Nine Big Ideas 6/23/201 16 Scaling Up Digital Design Studies | NC State University | College of Education 6

Apply Grade-Specific Filters 6/23/201 17 Scaling Up Digital Design Studies | NC State University | College of Education 6

Apply Scopes and Sequences to Support Personalization 6/23/201 18 Scaling Up Digital Design Studies | NC State University | College of Education 6

Zoom Into a Field 6/23/201 19 Scaling Up Digital Design Studies | NC State University | College of Education 6

Zoom Into a Region 6/23/201 20 Scaling Up Digital Design Studies | NC State University | College of Education 6

Filter Down to a Grade Range 6/23/201 21 Scaling Up Digital Design Studies | NC State University | College of Education 6

Shapes of Clusters Inform Possible Sequences 1 then 2 then 3 1 then (2,3) or (3,2) (1, 2) or (2,1) then (3,4) or (4,3) (linear path) (Divergent) (Convergent then Divergent) 6/23/201 22 Scaling Up Digital Design Studies | NC State University | College of Education 6

Open a Construct to Reveal its Learning Trajectory 6/23/201 23 Scaling Up Digital Design Studies | NC State University | College of Education 6

Find the Common Core Standards Linked to the Learning Trajectory 6/23/201 24 Scaling Up Digital Design Studies | NC State University | College of Education 6

Find the Common Core Standards In the Big Ideas 6/23/201 25 Scaling Up Digital Design Studies | NC State University | College of Education 6

Move Below or Above Grade 6/23/201 26 Scaling Up Digital Design Studies | NC State University | College of Education 6

Find the Link to Resources 6/23/201 27 Scaling Up Digital Design Studies | NC State University | College of Education 6

Select Aligned External Resources 6/23/201 28 Scaling Up Digital Design Studies | NC State University | College of Education 6

Browse the Library of External Resources 6/23/201 29 Scaling Up Digital Design Studies | NC State University | College of Education 6

The SUDDS Learning Map Our tool is an innovative digital container, where students and teachers can…  Navigate the content of middle school mathematics around big ideas and research-based learning trajectories  Select and sequence aligned open source curricular resources  Assess, in real time, students’ progress , identifying needs and next steps 6/23/201 30 Scaling Up Digital Design Studies | NC State University | College of Education 6

Find the Link to Assessments 6/23/201 31 Scaling Up Digital Design Studies | NC State University | College of Education 6

Take an Assessment 6/23/201 32 Scaling Up Digital Design Studies | NC State University | College of Education 6

Interact with Items and Tasks in Fully Responsive Pages 6/23/201 33 Scaling Up Digital Design Studies | NC State University | College of Education 6

Tasks Designed to Maximize Learning, not Minimize Testing Time 6/23/201 34 Scaling Up Digital Design Studies | NC State University | College of Education 6

Messages Encourage a Growth-Mindset 6/23/201 35 Scaling Up Digital Design Studies | NC State University | College of Education 6

Visualize Score Patterns and See Misconceptions 6/23/201 36 Scaling Up Digital Design Studies | NC State University | College of Education 6

Reveal the Key, Revise, or Defend an Answer 6/23/201 37 Scaling Up Digital Design Studies | NC State University | College of Education 6

Give and Receive Commentary 6/23/201 38 Scaling Up Digital Design Studies | NC State University | College of Education 6

See the Results of Your Revisions 6/23/201 39 Scaling Up Digital Design Studies | NC State University | College of Education 6

Visualize Score Profiles Within the Map 6/23/201 40 Scaling Up Digital Design Studies | NC State University | College of Education 6

Overview The SUDDS team  How our DLS can help close the gap  A demonstration of the Digital Learning System (DLS)  A closer look at our assessments  What we have learned  New research directions and next steps  6/23/201 41 Scaling Up Digital Design Studies | NC State University | College of Education 6

A Learning Map Underlying learning trajectories Elaboration document Diagnostic Assessments 6/23/201 42 Scaling Up Digital Design Studies | NC State University | College of Education 6