Lessons Learned in Test Security CCSSO National Conference on Student Assessment Summer 2013
Contact Information James Mason, Director of Student Assessment jmason@mde.k12.ms.us Walt Drane, Assistant Director wdrane@mde.k12.ms.us Post Conference Resources Posted Online: www.mde.k12.ms.us/ccsso 601.359.3052 CCSSO NCSA Summer 2013 2
Background Info • Approximately 500,000 students (K-12) • 151 LEAs (from <1,000 to >32,000) • Assessment Staff (12, EIR, Security Coord.) • Four EOC Tests Required for HS Diploma • PARCC State • Pearson and Caveon • Right to Work (Non-Union) State 3 CCSSO NCSA Summer 2013
Decision Points • Walking through the door—there is no turning back! • Being part of a Profession 4 CCSSO NCSA Summer 2013
Security Evolution • 2005-2006 Data forensics first used with H.S. EOC exams (SATP) • November 2010-James joined staff at MDE • February 2012- Longitudinal erasure analysis • 2011-2012- Data forensics expanded to 3-8 testing program (MCT2) • Spring 2012 Volatility analysis introduced • June 2012-Walt joined staff at MDE 5 CCSSO NCSA Summer 2013
Tools • Data Forensics (Caveon) • 3-Year Longitudinal Erasure Analysis • SEA Staff Audits ($ for travel) • Exploring partnership with State Auditor’s Staff 6 CCSSO NCSA Summer 2013
Erasure Report Elements • 3 & 4 SD Thresholds • Three years of data (easier to see patterns) • Peer data of flagged teachers (context) • N-Counts (context) • School, District and State Averages (context) 7 CCSSO NCSA Summer 2013
Recent Case History • When We Were Challenged • When We Did Not Engage • When We Acted Decisively 8 CCSSO NCSA Summer 2013
Lessons Learned • Have multiple enforcement options- Accreditation Standards (Appendix F) as well as Educator Code of Ethics • Consistently use the data you have (USED IG Audit Finding) • Play to win - don't pick a fight you are not reasonably sure you can win • Plan for future challenges (more than data) 9 CCSSO NCSA Summer 2013
Recommend
More recommend
