Using NAEP Survey Data at the State-Level Rene A. Savoie - - PowerPoint PPT Presentation

Using NAEP Survey Data at the State-Level

Renée A. Savoie

Connecticut NAEP State Coordinator renee.savoie@ct.gov NCSA 2018 – San Diego, CA

1

Survey Data Com plem ent Achievem ent Results

• NCSA 2017 Session
• Mathematics Course-taking Information
• NAEP 2009 Grade 12 Student Questionnaires
• Measuring Students’ Computer Access
• NAEP 2015 Teacher and Student Questionnaires
• Science-Related Career Aspirations
• NAEP 2015 Science Student Questionnaires
• NAEP 2017 results released on April 10, 2018
• Big Picture: No overall change for Connecticut
• Reading performance stronger than mathematics
• Many states outperform Connecticut in mathematics

2

Connecticut NAEP 2017 Performance Relative to Other States

Proficient Level (238)

AK NM LA SC DC NV TX MS CA AZ AR HI AL OK WV OR MI TN WI GA IL NP ME DE ND IA SD NY MT MO ID WA KS RI NC KY NE MN CO PA MD UT OH IN VT WY VA FL CT NH NJ DD MA 200 205 210 215 220 225 230 235 240 Average Scale Score

NAEP Reading Grade 4 ─ Overall Average Scale Score: 2017

NOTE: The NAEP grade 4 reading scale ranges from 0 to 500.

Lower average scale score than CT Not significantly different from CT Higher average scale score than CT

LA NM AK DC NV AL CA OR AR SC AZ MS NY MI WV DE GA TN OK RI HI IL NP KY CT MO ME ID WI MD CO MT VT OH TX NC KS SD PA WA UT IA ND NH NE FL IN WY NJ VA DD MN MA 220 225 230 235 240 245 250 255 260 Average Scale Score

NAEP Mathematics Grade 4 ─ Overall Average Scale Score: 2017

Proficient Level (249)

NOTE: The NAEP grade 4 mathematics scale ranges from 0 to 500.

Lower average scale score than CT Not significantly different from CT Higher average scale score than CT

Connecticut NAEP 2017 Performance Relative to Other States

Grade 4 Grade 8 2017 CT Average Scale Score 2017 NP Average Scale Score CT Compared to NP* 2017 CT Average Scale Score 2017 NP Average Scale Score CT Compared to NP* Reading All 228 221 ↑ 273 265 ↑ White 238 231 ↑ 283 274 ↑ Black 210 205 = 249 248 = Hispanic 213 208 = 253 255 = NSLP1 211 208 = 254 253 = Mathematics All 239 239 = 284 282 ↑ White 249 248 = 295 292 ↑ Black 222 223 = 258 260 = Hispanic 223 229 ↓ 263 268 ↓ NSLP1 224 228 ↓ 264 267 ↓

NAEP 2017 Student Group Results: Comparison of Connecticut to the Nation (NP)

NSLP1 - NSLP is the National School Lunch Program. Eligibility is used as a proxy for measuring poverty. * An arrow is used when the difference between the scores is statistically significant.

Providing Context w ith NAEP

• NAEP Questions Tool
• Given our content standards, should

students be able to answer the questions correctly?

• What differences in subgroup

performance do the item-level data reveal?

• What items show large discrepancies in

percent correct when compared to other states and the nation?

Grade 4 Student Questionnaire: Affective Disposition

Year Jurisdiction No effort at all Very little effort Some Effort Quite a bit

• f effort

A lot of effort 2017 National public 1 3 11 27 57 2017 Connecticut 1 3 10 30 56 2017 Massachusetts 1 2 11 31 55

The percentage of Grade 4 students who report…

Grade 4 Teacher Questionnaire: Instructional Content and Practice

Year Jurisdiction < 5 hours 5 to <7 hours 7 or more hours 2017 National public 17 40 44 2017 Connecticut 15 55 30 2017 Massachusetts 12 45 43

The percentage of Grade 4 students with teachers who report…

Grade 4 Teacher Questionnaire: Preparation, Credentials and Experience

Year Jurisdiction College Course: Yes College Course: No Co-teaching/ team teaching: Yes Co-teaching/ team teaching: No 2017 National public 17 83 41 59 2017 CT 14 86 35 65 2017 MA 39 61 47 53

The percentage of Grade 4 students with teachers who report…

During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of mathematics?

College course related to the teaching

• f mathematics taken after your first

certification. Co-teaching or team teaching for math.

NAEP Data Supports a Sense of Urgency

• Use NAEP data to highlight concerns of

mathematics leaders in the coming school year

• Special mathematics-focused edition of

Performance Matters newsletter, June 2018

• Redirect attention to the Report of the

Commissioner’s Council on Mathematics

• Examine policies and practices in other states