It Takes a City It Takes a City to Knock it Out of the PARCC! Making - - PowerPoint PPT Presentation

it takes a city
SMART_READER_LITE
LIVE PREVIEW

It Takes a City It Takes a City to Knock it Out of the PARCC! Making - - PowerPoint PPT Presentation

It Takes a City It Takes a City to Knock it Out of the PARCC! Making the Transition from Pencil and Paper to Computer-based Assessments Welcome! LEA Leadership Institute, January 23, 2015 Gallaudet University Ballroom B Washington, DC


slide-1
SLIDE 1

It Takes a City

It Takes a City to Knock it Out of the PARCC!

slide-2
SLIDE 2

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Making the Transition from Pencil and Paper to Computer-based Assessments

Welcome!

LEA Leadership Institute, January 23, 2015 Gallaudet University Ballroom B Washington, DC Moderator: Dr. Tonya Mead, State Test Integrity Coordinator

slide-3
SLIDE 3

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Making the Transition from Pencil and Paper to Computer-based Assessments

DC Prep

Hilary Dauffenbach- Tabb, M.Ed, Assessment Associate Daniel Englender, B.S, Director of Academic Technology

Meridian Public Charter School- DC

Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator

Third Party Investigators

Ingrid Christian, Director Alvarez & Marsal Forensic Dispute Resolution Lou Woodruff, Senior Security Consultant, Caveon Test Security

Moderator

Tonya Mead, PhD, State Test Integrity Coordinator, Office of the State Superintendent of Education (OSSE)

slide-4
SLIDE 4

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Agenda

I. Introduction

  • II. Case Studies

I. DC Prep II. Meridian

  • III. Independent Investigators’ Perspective
  • IV. Discussion
  • V. Close
slide-5
SLIDE 5

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Introduction

Why make the transition?

  • Obtain student assessment results in almost

real time

  • Reduce requirement for receiving, printing,

storing, packing and shipping secure items

  • Expand test format from multiple choice to

adaptive

slide-6
SLIDE 6

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Introduction

Challenges

  • Resistance to change  Computer difficulties
  • Systems incompatibility  Lack of resources

Solutions Provided by Case Studies

  • DC Prep
  • Meridian

Third Party Investigator Perspective

  • Caveon Test Security
  • A&M Forensic & Dispute Resolution
slide-7
SLIDE 7

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

DC Prep Presentation of Case Study

slide-8
SLIDE 8

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

DC Prep Case Study Review

  • Computer-Based Testing Logistics
  • Preparing Students for Computer-Based

Testing

– Using hardware – Testing platforms – Explaining test problems – Checking for mastery

slide-9
SLIDE 9

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

DC Prep Case Study Review

  • Preparing Staff for Computer-Based Testing

– Reinforce similarities – Develop routines – Train teachers – Process for support – Debrief

slide-10
SLIDE 10

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

DC Prep Case Study Review

Challenges Action Steps

Note-taking Computer based practice Formatting Practice using tools Connectivity Infrastructure testing Technical Difficulties Chromebooks resolution

slide-11
SLIDE 11

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Meridian

slide-12
SLIDE 12

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Meridian Case Study Review

  • Executive Summary

– Communication System and Establishing Clear Roles and Responsibilities – Technology and Scheduling Issues

  • Problem Analysis and Challenges

– Staff full time Testing Coordinator – Manage the Schedule and Track Issues for Resolution

slide-13
SLIDE 13

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Meridian Case Study Review

Challenge Who does what when ? Solutions:

  • Communication through grade level administrators
  • Weekly meetings and professional development activities

held

  • Testing Coordinator trains all staff
  • Testing Coordinator POC, Testing Committee 2nd POC
  • Chief of Accountability and Testing Coordinator manages

reporting, monitoring and investigation

slide-14
SLIDE 14

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Meridian Case Study Review

Challenge Resolution of Technology Issues Solutions:

  • Create Form A and Form B Tracking System

– Form A- technical issues resolved by close of business – Form B- for students who have not arrived for assessments

  • Designate days of the week to test run operating systems
  • Update commuters with programming required
slide-15
SLIDE 15

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Meridian Case Study Review

Challenge Scheduling

Solutions:

  • Create schedule around lunch periods
  • Test and refine the schedule throughout the year

(general and pull out)

  • Schedule is created by the Testing Committee
  • Test Committee Members Representative of All Levels

– Executive Leadership – Student Support, Technical Support and Data

slide-16
SLIDE 16

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Investigator’s Perspective

  • Caveon Test Security
  • Alvarez and Marsal Forensic and Dispute

Resolution

slide-17
SLIDE 17

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Caveon Test Security

Test Security and Data Forensics

slide-18
SLIDE 18

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Caveon Test Security

  • The Test Security Landscape
  • How Computer-based Testing Reduces

Cheating

  • New Technologies offer new Cheating

Opportunities

  • How Computer-based Testing Introduces New

Threats

  • Data Forensics
slide-19
SLIDE 19

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Alvarez & Marsal

Risk Assessment and Control

slide-20
SLIDE 20

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Alvarez & Marsal

  • Transition of Test Security Risks

DC CAS to PARCC

  • Categories of Risks

– Risks that exist for both Paper/Pencil and Computer-Based Testing – Risks unique to Computer-Based Testing

  • Control Updates Required
  • Detection of Potential Test Security Violations
slide-21
SLIDE 21

District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!

Discussion and Close

  • Questions and Answers
  • Thanks

– The Office of the State Superintendent of Education Thanks the Expert Panelists for the Wealth of Information Shared and the Audience and Participants for Your Time and Attention!

Moderator: Dr. Tonya Mead, State Test Integrity Coordinator