Lessons Learned in Test Security CCSSO National Conference on - - PowerPoint PPT Presentation

lessons learned
SMART_READER_LITE
LIVE PREVIEW

Lessons Learned in Test Security CCSSO National Conference on - - PowerPoint PPT Presentation

Lessons Learned in Test Security CCSSO National Conference on Student Assessment Summer 2013 Contact Information James Mason, Director of Student Assessment jmason@mde.k12.ms.us Walt Drane, Assistant Director wdrane@mde.k12.ms.us Post


slide-1
SLIDE 1

Lessons Learned in Test Security

CCSSO National Conference on Student Assessment Summer 2013

slide-2
SLIDE 2

James Mason, Director of Student Assessment jmason@mde.k12.ms.us Walt Drane, Assistant Director wdrane@mde.k12.ms.us

Post Conference Resources Posted Online: www.mde.k12.ms.us/ccsso 601.359.3052

Contact Information

CCSSO NCSA Summer 2013 2

slide-3
SLIDE 3
  • Approximately 500,000 students (K-12)
  • 151 LEAs (from <1,000 to >32,000)
  • Assessment Staff (12, EIR, Security Coord.)
  • Four EOC Tests Required for HS Diploma
  • PARCC State
  • Pearson and Caveon
  • Right to Work (Non-Union) State

Background Info

3 CCSSO NCSA Summer 2013

slide-4
SLIDE 4
  • Walking through the door—there is no

turning back!

  • Being part of a Profession

Decision Points

4 CCSSO NCSA Summer 2013

slide-5
SLIDE 5
  • 2005-2006 Data forensics first used with

H.S. EOC exams (SATP)

  • November 2010-James joined staff at MDE
  • February 2012- Longitudinal erasure

analysis

  • 2011-2012- Data forensics expanded to 3-8

testing program (MCT2)

  • Spring 2012 Volatility analysis introduced
  • June 2012-Walt joined staff at MDE

Security Evolution

5 CCSSO NCSA Summer 2013

slide-6
SLIDE 6
  • Data Forensics (Caveon)
  • 3-Year Longitudinal Erasure Analysis
  • SEA Staff Audits ($ for travel)
  • Exploring partnership with State Auditor’s

Staff

Tools

6 CCSSO NCSA Summer 2013

slide-7
SLIDE 7
  • 3 & 4 SD Thresholds
  • Three years of data (easier to see patterns)
  • Peer data of flagged teachers (context)
  • N-Counts (context)
  • School, District and State Averages (context)

Erasure Report Elements

7 CCSSO NCSA Summer 2013

slide-8
SLIDE 8
  • When We Were Challenged
  • When We Did Not Engage
  • When We Acted Decisively

Recent Case History

8 CCSSO NCSA Summer 2013

slide-9
SLIDE 9
  • Have multiple enforcement options- Accreditation

Standards (Appendix F) as well as Educator Code

  • f Ethics
  • Consistently use the data you have (USED IG

Audit Finding)

  • Play to win - don't pick a fight you are not

reasonably sure you can win

  • Plan for future challenges (more than data)

Lessons Learned

9 CCSSO NCSA Summer 2013