Gaining a Deeper Understanding of Student Progress Over Time and - - PowerPoint PPT Presentation

gaining a deeper understanding
SMART_READER_LITE
LIVE PREVIEW

Gaining a Deeper Understanding of Student Progress Over Time and - - PowerPoint PPT Presentation

Gaining a Deeper Understanding of Student Progress Over Time and Achievement Gaps based on the National Assessment of Educational Progress (NAEP) survey questionnaire data Ebony Walton, Jan Alegre, and Renee Savoie June 29, 2018 National


slide-1
SLIDE 1

Gaining a Deeper Understanding

  • f Student Progress Over Time

and Achievement Gaps

based on the National Assessment of Educational Progress (NAEP) survey questionnaire data

Ebony Walton, Jan Alegre, and Renee Savoie

June 29, 2018

slide-2
SLIDE 2

National Center for Education Statistics

✓ The primary federal entity for collecting and analyzing data related to education in the United States and other nations ✓ Provides statistical services for educators and education officials at the federal, State, and local levels; Congress; researchers; students; parents; and the media and the general public

2

slide-3
SLIDE 3

4

National Assessment of Educational Progress (NAEP)

Objective Means Ends

To measure what students know and can do Cognitive questions

  • Scale scores
  • Achievement

level percentages To provide contextual and descriptive information related to academic achievement Survey questionnaires

(student, teacher, school)

  • Percentages
  • Scale scores
  • Achievement

level percentages

slide-4
SLIDE 4

5

Assessment areas and years

Arts 08-16

Every 8 years

Civics 98-18

Every 4 years

Economics 06-12

Every 6 years

Geography 94-18

Every 4 years

US History 94-18

Every 4 years

Mathematics 90-17

Every 2 years

Reading 92-17

Every 2 years

Science 09-15

Every 4 years

Technology and Engineering Literacy 14-18

Every 4 years

Writing 11-17

Every 4-6 years

slide-5
SLIDE 5

6

NAEP Administration

slide-6
SLIDE 6

Presentations today

❖ Ebony Walton, NCES: Changes in academic performance with shifts in educational landscapes and student attitudes from 2009-2015. ❖ Jan Alegre, ETS: A deeper look into achievement gaps based on NAEP survey data ❖ Renee Savoie, CT DeptEd: Potential uses

  • f NAEP survey questionnaire data in

practice for State level educational policy

slide-7
SLIDE 7

What have we learned about student progress since 2009?

8

slide-8
SLIDE 8

9

Grade 4

Changes in NAEP Score and Achievement Level Results: 2009-15

Group Math Reading Science

Overall

↑ ↑ ↑

Lower- performing

(10th/25th percentiles)

↔ ↔ ↔ ↑ ↑ ↑

Higher- performing

(75th/90th percentiles)

↑ ↑ ↑ ↑ ↑ ↑

Below Basic

18%

33-31%

28-24%

At or above Proficient

39-40%

33-36%

34-38%

slide-9
SLIDE 9

11

Grade 8

Changes in NAEP Score and Achievement Level Results: 2009-15

Group Math Reading Science

Overall

↔ ↑ ↑

Lower- performing

(10th/25th percentiles)

↔ ↓ ↔ ↔ ↑ ↑

Higher- performing

(75th/90th percentiles)

↔ ↔ ↑ ↑ ↑ ↑

Below Basic

27-29%

25-24%

37-32%

At or above Proficient

34-33%

32-34%

30-34%

slide-10
SLIDE 10

13

Grade 12

Changes in NAEP Score and Achievement Level Results: 2009-15

Group Math Reading Science

Overall

↔ ↔ ↔

Lower- performing

(10th/25th percentiles)

↓ ↓ ↓ ↓ ↔ ↔

Higher- performing

(75th/90th percentiles)

↔ ↔ ↔ ↔ ↔ ↔

Below Basic

36-38%

26-28%

40%

At or above Proficient

26-25%

38-37%

21-22%

slide-11
SLIDE 11

Summary of national performance changes

✓ Improvement in math, reading, and science

  • verall and for high-performing students at

grade 4 ✓ Improvement in reading and science at grades 4 and 8 ✓ Stagnant performance at grade 12 overall; lower-performing students decline in math and reading

15

slide-12
SLIDE 12

Do shifts in contextual factors mirror changes in student performance?

16

slide-13
SLIDE 13

17

Selected NAEP contextual questions related to positive student views

Mathematics Reading Science G4 How often do you feel math is one of your favorite subjects? G8 I like math. G12 Mathematics is

  • ne of my favorite

subjects. G4 How often do you read for fun on your

  • wn time?

G8 Reading is one of my favorite subjects. G12 Reading is one of my favorite activities. G4 How often do you feel science is one of your favorite subjects? G8 Science is one of my favorite subjects. G12 Science is one of my favorite subjects.

slide-14
SLIDE 14

18

Selected NAEP contextual questions related to student computer use

Mathematics Reading G4; G8 In your mathematics class this year, how often do your students use a computer … to extend mathematics learning with enrichment activities on the computer? G4; G8; G12 In your reading/language arts class this year, how often do your students (or you) use a computer or other technological resources to…access reading-related websites ?

slide-15
SLIDE 15

19

Selected NAEP contextual questions related to classroom instruction

Mathematics Reading Science G4; G8 How much emphasis did you or will you give for algebra and functions? G12 Which courses have you taken from eighth grade to the present? Calculus, Pre- calculus, Trigonometry

  • r Algebra II,

Geometry Algebra I or less G4; G8; G12 When reading a story with your students (in your English/language arts class), how often do you ask your students to (does your teacher ask you to)…interpret the meaning of the passage? G4; G8 To what extent do you…teach scientific methods? G12 Which courses have you taken from eighth grade to the present? Biology, chemistry and/or physics

slide-16
SLIDE 16

20

Grade 4

Changes in NAEP Score and Survey Questionnaire Results: 2009-15

Group Math Reading Science

Overall

↑ ↑ ↑ ↑ ↑ ↓ ↑ ↑ ↑ ↑ ↓

Lower- performing

(10th/25th percentiles)

↔ ↔ ↔ ↑ ↑ ↑ ↔ ↓ ↑

Higher- performing

(75th/90th percentiles)

↑ ↑ ↑ ↑ ↑ ↑ ↑ ↓ ↔

Black arrows indicate score change. Blue arrows indicate positive views percentage

  • change. Red arrows indicate computer use percentage change. Gold arrows indicate

instruction percentage change.

slide-17
SLIDE 17

22

Grade 8

Changes in NAEP Score and Achievement Level Results: 2009-15

Group Math Reading Science

Overall

↔ ↑↑ ↑ ↑ ↔ ↑ ↑ ↑ ↑ ↓

Lower- performing

(10th/25th percentiles)

↔ ↓ ↔ ↔ ↑ ↑ ↔ ↔ ↑

Higher- performing

(75th/90th percentiles)

↔ ↔ ↑ ↑ ↑ ↑ ↑ ↔ ↑

Black arrows indicate score change. Blue arrows indicate positive views percentage

  • change. Red arrows indicate computer use percentage change. Gold arrows indicate

instruction percentage change.

slide-18
SLIDE 18

24

Grade 12

Changes in NAEP Score and Achievement Level Results: 2009-15

Group Math Reading Science

Overall

↔ ↑↑ ↔ ↔ ↑ ↑ ↔ ↑ ↑

Lower- performing

(10th/25th percentiles)

↓ ↓ ↓ ↓ ↔ ↔ ↓ ↓ ↔

Higher- performing

(75th/90th percentiles)

↔ ↔ ↔ ↔ ↔ ↔ ↑ ↔ ↑

Black arrows indicate score change. Blue arrows indicate positive views percentage

  • change. Red arrows indicate computer use percentage change. Gold arrows indicate

instruction percentage change.

slide-19
SLIDE 19

26

Trend in percentage of students who reported they strongly agreed that math is one of their favorite subjects, by students’ performance level Grade 4 Grade 8 Grade 12

slide-20
SLIDE 20

27

Trend in percentage of students whose teachers reported that they never or hardly ever access reading-related websites in reading class Grade 4 Grade 8 Grade 12

slide-21
SLIDE 21

28

Trend in percentage of students by the extent to which teachers emphasize scientific methods in science class Grade 4 Grade 8

slide-22
SLIDE 22

29

Percentage of twelfth-grade students assessed in NAEP science by the frequency with which they design a science experiment by science coursetaking

slide-23
SLIDE 23

30

Summary of student views results

✓ At grade 4, the pattern of scores and student views improving is the same for mathematics and science ✓ At grade 8, the pattern of scores and student views improving is the same in science but not in mathematics and reading ✓ While reading performance improved at grades 4 and 8, less students like reading—particularly lower-performing students at grades 4 and 12

slide-24
SLIDE 24

31

Summary of computer use results

✓ Students are using the computer more in mathematics and reading classes at all three grades ✓ Shifts in computer use appear to be more pronounced at grades 4 and 8—where we see score improvements

slide-25
SLIDE 25

32

Summary of classroom instruction results

✓ There is growth at all three grades in the percentages of students experiencing selected classroom instruction practices; however, mathematics scores improved only at grade 4 and reading scores improved at grades 4 and 8 ✓ Students receive less emphasis on scientific methods at grades 4 and 8; however, science scores have improved ✓ At grade 12, science scores are flat but students are taking more science courses

slide-26
SLIDE 26

33

Please visit

https://www.nationsreportcard. gov/sq_students_views_2015/

to view the first report in the 2015 NAEP Student Questionnaires series.

Ebony Walton, Statistician National Center for Education Statistics Ebony.walton@ed.gov