Accountability Standard Setting ANN-MICHELLE NEAL, ED.S - - PowerPoint PPT Presentation
Utah School Accountability Standard Setting ANN-MICHELLE NEAL, ED.S ACCOUNTABILITY SPECIALIST UTAH STATE BOARD OF EDUCATION History of Accountability in Utah School Grading School Grading Accountability Accountability Accountability
ANN-MICHELLE NEAL, ED.S ACCOUNTABILITY SPECIALIST UTAH STATE BOARD OF EDUCATION
Accountability reporting requirement enacted Reporting expanded to school level School Grading Accountability System established School Grading Accountability System implemented Governor’s PACE report cards published
1990 2000 2004 2011 2013 2014
Adequate Yearly Progress reports published
Achievement Growth Graduation The previous accountability system was primarily focused
assessment. ESSA provided an
that by adding additional indicators.
Accountability Design
Increased Focus on Equity
Increased Focus on our Lowest Performing Students
who graduate in 5 years.
UTAH SENATE BILL 220
The board shall engage in a criteria setting process to establish performance thresholds for overall ratings:
based on evaluating the school's performance against specific criteria. (Section 53A-1-1113.5)
ESSA
Normative
school grades could adjust in any given year
Criterion
setting process
Letter grades are still in place (legislative requirement), but score thresholds are fixed
School Letter Grades: No More Moving Targets
Labels for the performance levels are defined in statute:
(Section 53A-1-1105)
However, the statute does not specify what the threshold scores are for each performance level. In other words, what does it mean to be an “A” or “B” school?
Standard setting process to arrive at overall determinations.
The board shall engage in a criteria setting process to establish performance thresholds for overall ratings:
criteria.
Standard Setting Meeting
Legislative Requirements School Performance Level Descriptors School Profiles and Empirical Data Stakeholder Expertise
Threshold Scores That Assign Schools to Performance Levels
Develop policy descriptors for each level Develop school performance level descriptors Convene panel or other group (e.g. task force, advisory group) to:
Evaluate Document Produce material to support interpretation and use
On May 16, a committee of key legislators and state board members and school leaders convened to review and revise the Policy Descriptors (PDs) for Utah’s school accountability system. PDs are high-level statements about each performance level. They should be linked to Utah’s goals and policy priorities and identify the most critical outcomes that are valued and considered non- negotiable. PDs were passed on to School-Level Performance Descriptor Development Group
On May 17, members of the Assessment and Accountability Policy Advisory Committee (AAPAC) convened to work on the school performance level descriptors (SPLDs) for Utah’s school accountability system. SPLDs are more detailed descriptions of the characteristics of schools in each performance level. PDs and SPLDs were passed on to Standard Setting Committee
On May 18, a committee of AAPAC members, policymakers, parents, educators, association representatives, and technical experts met to recommend performance level threshold scores for school ratings in Utah’s school accountability system. The threshold scores were developed to assign overall letter grades to schools based on their performance on various indicators specified in SB 220.
School Performance Expectations
Threshold Scores
F School D School C School B School A School “Top” C School “Just barely” B School
Two key tools used in performance level setting
total points earned on the legislatively-mandated accountability indicators in 2016.
about a given school, including test participation rates, detailed breakdowns
and performance data, for all students and by subgroups.
Finding
the data
2. Judgements
within each probable range
GRADES 3-8 HIGH SCHOOL
5% 4% 15% 13% 49% 36% 24% 34% 7% 13%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Grades 3-8 High School A Schools B Schools C Schools D Schools F Schools
Ann-Michelle Neal ann-michelle.neal@schools.utah.gov