The Nations Report Card and 12 th Grade Academic Preparedness - - PowerPoint PPT Presentation
The Nations Report Card and 12 th Grade Academic Preparedness December 3, 2012 | Charleston, West Virginia An independent, non-partisan board Sets policy for and oversees NAEP The only continuing, nationally representative,
about academic preparedness, as measured by NAEP
representative, state-comparable measure of student achievement
2
3
SUBJECTS GRADES
Reading, Mathematics, Writing, Science, U.S. History, Civics, Geography, Economics, the Arts, Technology and Engineering Literacy, Foreign Language
4, 8, and 12
RESULTS
Student Achievement Data for
4
* Accommodations were not permitted. Source: National Center for Education Statistics, 2011 5
West Virginia: Grade 4 Mathematics Scores
227 229 233 242 247 252 252 253 219 222 224 234 237 239 239 240 215 223 223 231 231 236 233 235 193 187 192 205 211 214 219 222
180 190 200 210 220 230 240 250 260 1992 1996 2000 2003 2005 2007 2009 2011
Scale Score Massachusetts National Public West Virginia D.C.
500
* *
6
West Virginia: Grade 4 Mathematics Scores by Race/Ethnicity
216 224 224 231 231 237 233 235 201 205 205 221 226 223 225 227
180 190 200 210 220 230 240 250 1992 1996 2000 2003 2005 2007 2009 2011
White Black
500
* *
* Accommodations were not permitted. Source: National Center for Education Statistics, 2011
7
8
9
Grade 12 Mathematics Scale Scores and Achievement Levels
Source: National Center for Education Statistics, 2009
10
The panel’s rationale:
Grade 12: transition to postsecondary education and training. The nation needs an indicator of 12th grade student preparedness. NAEP—trusted for quality and integrity. NAEP—uniquely positioned to serve as preparedness indicator.
11
Source: WVHEPC, 2011; NCES, 2004
66% 20% 42% 20%
0% 10% 20% 30% 40% 50% 60% 70% Remediation Rate
Percentage of Freshmen College Students Taking Any Remedial Course
West Virginia
Nation
Public 2‐year Public 4‐year
12
13
Source: U.S. Department of Labor, Bureau of Labor Statistics, 3rd Q 2012
14
12.6% 8.4% 7.5% 4.1% 0.0% 5.0% 10.0% 15.0%
Less Than High School Diploma High School Graduate Some College/Associate Degree Bachelor's Degree or Higher
Unemployment Rate
$464 $648 $736 $1,170
Median Weekly Earnings
Median: $803
– National Academy of Sciences, “Rising Above the Gathering Storm”
15
16
15 17
18
Governing Board program of research: Transform 12th grade NAEP into indicator of preparedness for postsecondary education and training The U.S. has no common definition or measure of 12th grade preparedness
19
20
2002‐04 2006‐08 2009 2006
12th Grade Blue- Ribbon Panel Report Contract with Achieve to review NAEP in terms of preparedness Report of Technical Panel
Research Board Approval
Research Program Research Studies and Development of Preparedness Report
2010‐12 The Governing Board’s approach: rigorous, comprehensive, and methodical in making NAEP a preparedness indicator.
21
22
Is the content of NAEP similar to relevant tests?
How does performance on NAEP compare to performance
What is the point on the NAEP scale that experts judge as just “academically prepared?”
What are the tests and cut‐scores used for placement?
How do selected reference groups perform on NAEP?
23
NAEP content is similar to the ACT, SAT, and ACCUPLACER. ACT, SAT, and ACCUPLACER content is generally covered by NAEP. NAEP is generally broader. NAEP differs in some ways:
– types of test questions – cognitive rigor of test questions – types of reading texts – weighting/coverage of specific content in mathematics
24
Some NAEP content is similar to WorkKeys. WorkKeys measures some content that NAEP does not. NAEP is broader. WorkKeys Applied Mathematics and Reading for Information focus on
the application of foundational skills in workplace situations and NAEP does not.
NAEP does not have workplace situations as its primary focus.
25
NAEP and SAT math = .91 correlation NAEP and SAT reading = .74 correlation Proficient on NAEP = 500 on SAT Reading and Math = College
ACT, SAT, and ACCUPLACER Employment and salary data Course grades in college and job training programs
Florida results are confirming of NAEP/SAT results
26
Job training
Automotive Master Mechanic Computer Support Specialist HVAC Technician Licensed Practical Nurse Pharmacy Technician
Criteria
Significant numbers, stable or growing positions Range of occupations, civilian/military comparability Training beyond high school, not bachelor’s degree Range of reading/math skills Compensation with growth potential Familiar to public
27
Review of course syllabi and textbooks for reading and math demands
Texas postsecondary pilot study Seeking partners for collaboration—job training, military, higher ed., etc.
Tests and cut-scores used to place freshmen
28
29
Content Alignment Studies Benchmarking Studies Higher Education Survey Statistical Linking Studies Judgmental Studies
(Expert Panels)
FL: Did NOT meet ACT Benchmark (138) FL: Did NOT meet SAT Benchmark (143) FL: Met SAT Benchmark (179) FL: Met ACT Benchmark (180) 300 100 110 120 130 140 150 160 170 180 190 200 210 220 230 240 250 50% At or Above SAT ≈ 500 (164) 67% At or Above SAT ≈ 500 (169) 80% At or Above SAT ≈ 500 (175) SAT Concordance ≈ 500 (165)
30
FL: Did NOT meet ACT Benchmark (271) FL: Did NOT meet SAT Benchmark (279) FL: Met ACT Benchmark (308) FL: Met SAT/ Benchmark (311) 500 225 235 245 255 265 275 285 295 305 315 325 335 345 355 365 375 50% At or Above SAT ≈ 500 (301) 67% At or Above SAT ≈ 500 (313) 80% At or Above SAT ≈ 500 (325) SAT Concordance ≈ 500 (303)
31
32
33
34
35
36
37