Over Ov ervi view of of NCE NCES a and U U.S. R Rol ole i e - - PowerPoint PPT Presentation

▶
over ov ervi view of of nce nces a and u u s r rol ole i
SMART_READER_LITE
LIVE PREVIEW

Over Ov ervi view of of NCE NCES a and U U.S. R Rol ole i e - - PowerPoint PPT Presentation

Jan 31, 2024 218 likes •633 views

NATIONAL CENTER FOR EDUCATION STATISTICS Over Ov ervi view of of NCE NCES a and U U.S. R Rol ole i e in In Inter ernaBon onal Assessmen Assessments ts Presenta>on for Thinking Beyond

slide-1
SLIDE 1 NATIONAL CENTER FOR EDUCATION STATISTICS

¡ ¡

¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡

¡ ¡

¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡

Ov Over ervi view of

  • f ¡NCE

¡NCES ¡a ¡and ¡U ¡U.S. ¡R ¡Rol

  • le ¡i

e ¡in ¡In ¡Inter ernaBon

  • nal

Assessmen Assessments ts

Presenta>on for “Thinking Beyond Borders: The Future of Student Assessment”

Pe Peggy G. Carr, Ph.D Ph.D., AcBng Commissioner, NaBonal Center for EducaBon StaBsBcs (NCES) November 17, 2017

slide-2
SLIDE 2 Americans are spectacularly bad at answering even the most basic math questions America's High School Graduates Look Like Other Countries' High School Dropouts American Schools vs. the World: Expensive, Unequal, Bad at Math When It Comes To Tech Skills, We're Not As Good As We Think International Tests Show Rising, But Mixed, Math and Science Performance Math a concern for US teens; science, reading flat on test U.S. Teenagers Lose Ground in International Math Exam, Raising Competitiveness Concerns What America Can Learn From Smart Schools in Other Countries

In the news: U.S. Headlines

NCES.ED.GOV

slide-3
SLIDE 3 Australian schools continue to fall behind in maths and science Enquete PISA: les eleves francais dans la moyenne 'Everything is just going down': US students are getting WORSE at math as science and reading skills stagnate Espana es el tercer pais de la OCDE con mas diferencia de rendimiento en Matematicas entre chicos y chicas How Canada became an education superpower Slovaci su narodom kniznic. Lenze aki su citatelia? In this post-truth world, PISA scores matter more than ever

In the news: InternaJonal Headlines

NCES.ED.GOV

slide-4
SLIDE 4 INSTITUTE OF EDUCATION SCIENCES NATIONAL CENTER FOR EDUCATION STATISTICS

¡ ¡ ¡ Fiv Five th thin ings gs we’ e’ve learned learned

slide-5
SLIDE 5
  • 1. American students tend to

struggle more in mathemaJcs than in reading or science.

slide-6
SLIDE 6

U.S. rankings less favorable in mathemaJcs than other subjects

(Total ¡EducaFon ¡Systems) ¡

Grade ¡

(54)

Grade ¡

(43)

Age 15

(73)

Adults

(22)

Reading

6 — 16 8

Science

8 8 20 —

Math

11 9 38 17

* Rank is the number of educaJon systems with significantly higher average scores than the United States +1. U.S. also performed not ¡measurably different ¡from countries (ranging from 1 to 14). Rankings based on most ¡recent ¡data ¡from PIRLS (grade 4 reading), TIMSS (grades 4 & 8 math and science), PISA (age 15 reading, math, and science), and PIAAC (adults).
slide-7
SLIDE 7
  • 2. We see stronger performance

from our youngest ¡students.

slide-8
SLIDE 8

U.S. rankings more favorable for younger students

(Total ¡EducaFon ¡Systems) ¡

Grade ¡

(54)

Grade ¡

(43)

Age 15

(73)

Adults

(22)

Reading

6 — 16 8

Science

8 8 20 —

Math

11 9 38 17

* Rank is the number of educaJon systems with significantly higher average scores than the United States +1. U.S. also performed not ¡measurably different ¡from countries (ranging from 1 to 14). Rankings based on most ¡recent ¡data ¡from PIRLS (grade 4 reading), TIMSS (grades 4 & 8 math and science), PISA (age 15 reading, math, and science), and PIAAC (adults).
slide-9
SLIDE 9
  • 3. While other countries improve,

the U.S. is losing ground.

slide-10
SLIDE 10

30% ¡ 35% ¡ 40% ¡ 45% ¡ 50% ¡ 55% ¡ 60% ¡ 65% ¡ 70% ¡

4th U.S. grade TIMSS mathemaJcs scores have increased, but ¡not ¡ to the same extent ¡as some of our compeJtors

1995 2015

+21 +58 +99

Singapore Hong Kong-­‑CHN Korea, Republic of Japan Ireland ¡ England-­‑GBR ¡ Portugal UNITED STATES Cyprus ¡ Slovenia ¡ Australia Ontario-­‑CAN Norway ¡(4) New Zealand Iran, Islamic Republic of

350 400 450 500 550 600 650 100

Average Score

NOTE: Countries participating in TIMSS in 1995 and 2015 and with significant increase in average score shown.

NCES.ED.GOV

10

slide-11
SLIDE 11

U.S. 15-­‑year-­‑olds’ performance in mathemaJcs declining over Jme

PISA ¡2015 MathemaFcs Results

U.S. Ranking

28 35

2012 2015

Average score lower

7 that ¡were now ¡

than in 2012

2 that were now

*Rankings are based on the 60 educaJon systems that ¡parJcipated in both PISA 2012 and PISA 2015 and are

NCES.ED.GOV

determined by calculaJng the highest ¡possible rank (number of educaJon systems performing higher plus one). 11

slide-12
SLIDE 12
  • 4. Our top performing states are among

the best ¡educaJon systems in the world, but ¡our lowest ¡performing states struggle to be compeJJve globally.

slide-13
SLIDE 13

MassachuseLs among the top educaJon systems in the world

In 2011, scores on grade 8 TIMSS ranged from 466 in Alabama ¡to 561 in MassachuseLs. Alabama’s peers:

  • Ukraine
  • Dubai and the United

Arab Emirates

  • Norway
  • Armenia ¡
  • Romania ¡
  • Turkey

NCES.ED.GOV

MassachuseLs’s peer:

  • Japan

(MA only scored lower than Republic of Korea, Singapore, Chinese Taipei, and Hong Kong)

13

slide-14
SLIDE 14
  • 5. Millennials, the most ¡highly

educated generaJon in U.S. history, have generally low skills compared with internaJonal peers.

slide-15
SLIDE 15

240 ¡ 310 ¡

U.S. adults ages 16-­‑65 average score on PIAAC 2012 Literacy not different from OECD

Average Score

500 300

Adults’ (16-­‑65) average score

290 280

273 270

270 260 250

NCES.ED.GOV

EducaFon System

1 1 1 15

slide-16
SLIDE 16

240 ¡ 310 ¡

U.S. Millennials lower than internaJonal average in Literacy

1 16

250 260 270 280 290 300

Average Score 274 282

16

Millennials’ average score EducaFon System

1

NCES.ED.GOV

500

slide-17
SLIDE 17

240 ¡ 310 ¡

U.S. adults ages 16-­‑65 average score on PIAAC 2012 Problem Solving lower than internaJonal average

500

Adults’ (16-­‑65) average score

300

1 17

250 260 270 280 290

Average Score EducaFon System 277 283

1

NCES.ED.GOV

slide-18
SLIDE 18

240 ¡ 310 ¡

U.S. Millennials rank near boLom on PIAAC 2012 Problem Solving

1 18

250 260 270 280 290 300

Millennials’ average score Average Score EducaFon System 284 295

1

NCES.ED.GOV

500

slide-19
SLIDE 19

240 ¡ 310 ¡

U.S. adults ages 16-­‑65 average score lower than internaJonal average on PIAAC 2012 Numeracy

500 290 300

Adults’ (16-­‑65) average score

1 19

250 260 270 280

Average Score EducaFon System 253 269

1

NCES.ED.GOV

slide-20
SLIDE 20

240 ¡ 310 ¡

U.S. Millennials Jed for the lowest average score on PIAAC Numeracy 2012

Average Score

500 300

Millennials’ average score

290

27

280 270 260

255

250

EducaFon System

2 2 2 2

NCES.ED.GOV

slide-21
SLIDE 21

¡ ¡ NCE NCES’s ¡r ¡rol

  • le ¡i

e ¡in in intern ernaB aBon

  • nal

al assessmen assessments ts

slide-22
SLIDE 22

InternaJonal Assessments Process

Design

Assessments Administered Data Analyzed and Validated

Data Reported

Reps from InternaFonal parFcipaFng Organizer countries (IEA/OECD) (NCES) InternaFonal Countries’ StaFsFcal Agencies ES (NC Organizer Countries’ (IEA/OECD) InternaFonal StaFsFca Organizer Agencies (IEA/OECD) (NCES)

NCES.ED.GOV

2 22

slide-23
SLIDE 23

NCES administered assessments

InternaJonal Assessments State Assessments

NCES.ED.GOV

23

slide-24
SLIDE 24

The U.S. system of assessments

InternaJonal Assessments State Assessments

NCES.ED.GOV

24

slide-25
SLIDE 25

NAEP DNA in internaJonal assessments

  • PISA, TIMSS, etc. based on “long

test, short ¡booklet” pioneered by NAEP in early 80s

– Group, not ¡individual, scores – NAEP was first ¡large-­‑scale applicaJon

  • f IRT—now used in most ¡large-­‑scale

assessments

  • NAEP and internaJonal

assessments share experts, best ¡ pracJces

NCES.ED.GOV

25

slide-26
SLIDE 26

¡ ¡ ¡ Up Upcomin

  • ming in

intern ernaB aBon

  • nal

al assessmen assessment resu esults lts

slide-27
SLIDE 27

Upcoming internaJonal assessment ¡results

  • December 5, 2017
  • 4th-­‑ grade reading

assessment ¡

  • First ¡ePIRLS administraJon

– Online informaJonal reading – Computer-­‑based extension of PIRLS

NCES.ED.GOV

27

slide-28
SLIDE 28

Upcoming internaJonal assessment ¡results

IELS

2017 2018 2019 2020

NCES.ED.GOV

28

slide-29
SLIDE 29
slide-30
SLIDE 30

¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡

NCES Conducted Assessments Across the Lifespan

Adults High School

  • Lit

Liter eracy acy

Middle

  • Nu

Numer meracy acy

School

Re Reading

  • Ma

Math themaB emaBcs cs

  • Sc

Scie ienc nce

  • Pr

Prob

  • blem ¡Solvin

lem ¡Solving g

Elementary

  • Ma

Math themaB emaBcs cs

Early ¡ Childhood

  • Ou

Outcomes

  • mes in

in emp emplo loymen yment, t,

  • Re

Reading

  • Sc

Scie ienc nce in income,

  • me,
  • Fin

Finan ancial cial lit liter eracy acy ed educaB aBon

  • n, ¡h

¡healt ealth

  • Te

Teachers and

  • Col

Collabor

  • raBve ¡

e ¡

  • Ma

Math themaB emaBcs cs te teaching prob

  • blem ¡solvin

lem ¡solving g

  • Ad

Advanced ced

  • Lit

Liter eracy acy

  • Comp

Computer er an and

  • Sc

Scie ienc nce

  • Nu

Numer meracy acy in informaB

  • rmaBon
  • n
  • On

Online ¡R e ¡Rea eading lit liter erac acy

  • So

Social ¡ ial ¡Skills Skills ma math themaB emaBcs cs an and

  • Ex

ExecuB ecuBve Fu FuncB cBon

  • n

ph physics sics

IELS PIRLS, TIMSS, TIMSS, ICILS, PISA, TIMSS, PIAAC NAEP NAEP NAEP

NCES.ED.GOV

30

slide-31
SLIDE 31

InternaJonal Assessments Process

Design

Assessments Administered Data Analyzed and Validated

Data Reported

Reps from parJcipaJng countries

NCES.ED.GOV

3 31

slide-32
SLIDE 32

Five things we’ve learned

slide-33
SLIDE 33

NCES’s role in internaJonal assessments

slide-34
SLIDE 34

Upcoming internaJonal assessment ¡results

slide-35
SLIDE 35

NCES BACKGROUND

  • Origins: 1867 and establishment ¡
  • f the first ¡federal office of

educaJon

  • NCES reports on the condiJon

and progress of educaJon in the United States

  • InternaJonal assessments are

conducted in U.S. by NCES

NCES.ED.GOV

35

slide-36
SLIDE 36

36 ¡

  • Literacy
  • Numeracy
  • Social ¡Skills
  • Execu>ve ¡Func>on

Early ¡ Childhood ¡ Elementary ¡ Middle ¡ School ¡ High ¡ School ¡ Adults ¡

  • Reading
  • MathemaBcs
  • Science
  • Online ¡Reading
  • MathemaBcs
  • Science
  • Teachers ¡and ¡

teaching

  • Computer ¡and ¡

informa>on ¡ literacy

  • Reading
  • MathemaBcs
  • Science
  • Financial ¡literacy
  • Collabora>ve ¡

problem ¡solving

  • Advanced ¡

mathemaBcs ¡and ¡ physics

  • Literacy
  • Numeracy
  • Problem ¡Solving
  • Outcomes ¡in ¡

employment, ¡ income, ¡ educaBon, ¡health

36 ¡

NCES.ED.GOV

NCES InternaJonal Studies Across the Lifespan

slide-37
SLIDE 37

¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡

NCES InternaJonal Studies Across the Lifespan

NAEP (NaFonal Assessment) Adults High School

  • Lit

Liter eracy acy

Middle

  • Nu

Numer meracy acy

School

Re Reading

  • Ma

Math themaB emaBcs cs

  • Sc

Scie ienc nce

  • Pr

Prob

  • blem ¡Solvin

lem ¡Solving g

  • Ma

Math themaB emaBcs cs

Elementary Early ¡ Childhood

  • Ou

Outcomes

  • mes in

in emp emplo loymen yment, t,

  • Re

Reading

  • Sc

Scie ienc nce in income,

  • me,
  • Fin

Finan ancial cial lit liter eracy acy ed educaB aBon

  • n, ¡h

¡healt ealth

  • Te

Teachers and

  • Col

Collabor

  • ra>ve ¡

e ¡

  • Ma

Math themaB emaBcs cs te teaching prob

  • blem ¡solvin

lem ¡solving g

  • Ad

Advanced ced

  • Lit

Liter eracy acy

  • Comp

Computer er an and

  • Sc

Scie ienc nce

  • Nu

Numer meracy acy in informa>

  • rma>on
  • n
  • On

Online ¡R e ¡Rea eading

  • So

Social ¡ ial ¡Skills Skills

  • Ex

Execu ecu>ve Fu Func> c>on

  • n

lit liter erac acy ma math themaB emaBcs cs an and ph physic sics s

IELS PIRLS, TIMSS TIMSS, ICILS PISA, TIMSS PIAAC

NCES.ED.GOV

37

slide-38
SLIDE 38

U.S. gaps by parental educaJon, reported income, health, PIAAC

3

NCES.ED.GOV

slide-39
SLIDE 39

InternaJonal partners

InternaFonal AssociaFon for the EvaluaFon ¡of EducaFonal ¡ Achievement (IEA)

  • Trends in InternaJonal

MathemaJcs and Science Study (TIMSS)

  • Progress in InternaJonal

Reading Literacy Study (PIRLS)

  • InternaJonal Computer and

InformaJon Literacy Study (ICILS)

OrganizaFon for ¡Economic ¡ CooperaFon and Development (OECD)

  • Program for InternaJonal Student ¡

Assessment ¡(PISA)

  • Program for the InternaJonal

Assessment ¡of Adult ¡Competencies (PIAAC)

  • Teacher and Learning InternaJonal

Study (TALIS)

  • InternaJonal Early Learning and

Child Wellbeing Study (IELS)

NCES.ED.GOV

39

slide-40
SLIDE 40

NCES ¡OrganizaBon ¡Chart

Office of the Commissioner

Peggy Carr (Acting) Staff (2)

Statistical Standards Annual Reports & & Data Information Confidentiality

Tom Snyder (9) Marilyn Seastrom (12)

Assessment Sample Surveys Administrative Division Division Data Division

Peggy Carr (34) Chris Chapman (19) Ross Santy (34) Elementary & School District Longitudinal National Administrative & Reporting & Cross-Sectional State Longitudinal Postsecondary Secondary Demographics Assessment International Surveys Support Services Dissemination Surveys Data Systems (IPEDS) Holly Assessment Chris Chapman Challis System Andrew Zukerberg Nancy Sharkey Richard Reeves Brad Thayer Dan McGrath (Acting) Spurlock Breithaupt Tai Phan Childhood Core of Data PIAAC Early NHES Common High School FRSS/PEQIS PISA EDFacts TIMSS TALIS Middle Grades Postsecondary (NPSAS, B&B & BPS) NTPS/SASS Private School Survey Teacher Compensation Survey PIRLS School Crime (SCS, SSOCS) School Climate