Lessons Learned in Test Security CCSSO National Conference on - - PowerPoint PPT Presentation

▶
lessons learned
SMART_READER_LITE
LIVE PREVIEW

Lessons Learned in Test Security CCSSO National Conference on - - PowerPoint PPT Presentation

Nov 09, 2022 393 likes •492 views

Lessons Learned in Test Security CCSSO National Conference on Student Assessment Summer 2013 Contact Information James Mason, Director of Student Assessment jmason@mde.k12.ms.us Walt Drane, Assistant Director wdrane@mde.k12.ms.us Post

slide-1
SLIDE 1

Lessons Learned in Test Security

CCSSO National Conference on Student Assessment Summer 2013

slide-2
SLIDE 2

James Mason, Director of Student Assessment jmason@mde.k12.ms.us Walt Drane, Assistant Director wdrane@mde.k12.ms.us

Post Conference Resources Posted Online: www.mde.k12.ms.us/ccsso 601.359.3052

Contact Information

CCSSO NCSA Summer 2013 2

slide-3
SLIDE 3
  • Approximately 500,000 students (K-12)
  • 151 LEAs (from <1,000 to >32,000)
  • Assessment Staff (12, EIR, Security Coord.)
  • Four EOC Tests Required for HS Diploma
  • PARCC State
  • Pearson and Caveon
  • Right to Work (Non-Union) State

Background Info

3 CCSSO NCSA Summer 2013

slide-4
SLIDE 4
  • Walking through the door—there is no

turning back!

  • Being part of a Profession

Decision Points

4 CCSSO NCSA Summer 2013

slide-5
SLIDE 5
  • 2005-2006 Data forensics first used with

H.S. EOC exams (SATP)

  • November 2010-James joined staff at MDE
  • February 2012- Longitudinal erasure

analysis

  • 2011-2012- Data forensics expanded to 3-8

testing program (MCT2)

  • Spring 2012 Volatility analysis introduced
  • June 2012-Walt joined staff at MDE

Security Evolution

5 CCSSO NCSA Summer 2013

slide-6
SLIDE 6
  • Data Forensics (Caveon)
  • 3-Year Longitudinal Erasure Analysis
  • SEA Staff Audits ($ for travel)
  • Exploring partnership with State Auditor’s

Staff

Tools

6 CCSSO NCSA Summer 2013

slide-7
SLIDE 7
  • 3 & 4 SD Thresholds
  • Three years of data (easier to see patterns)
  • Peer data of flagged teachers (context)
  • N-Counts (context)
  • School, District and State Averages (context)

Erasure Report Elements

7 CCSSO NCSA Summer 2013

slide-8
SLIDE 8
  • When We Were Challenged
  • When We Did Not Engage
  • When We Acted Decisively

Recent Case History

8 CCSSO NCSA Summer 2013

slide-9
SLIDE 9
  • Have multiple enforcement options- Accreditation

Standards (Appendix F) as well as Educator Code

  • f Ethics
  • Consistently use the data you have (USED IG

Audit Finding)

  • Play to win - don't pick a fight you are not

reasonably sure you can win

  • Plan for future challenges (more than data)

Lessons Learned

9 CCSSO NCSA Summer 2013