Relationship between EOC Assessments & ACT Subject Tests Karla - - PowerPoint PPT Presentation

▶
relationship between eoc assessments act subject tests
SMART_READER_LITE
LIVE PREVIEW

Relationship between EOC Assessments & ACT Subject Tests Karla - - PowerPoint PPT Presentation

Nov 01, 2023 21 likes •204 views

Relationship between EOC Assessments & ACT Subject Tests Karla L. Egan Center for Assessment NCSA, 2015 Guiding Questions How do the Proficient cut scores compare to the ACT college readiness benchmarks? What score on an EOC best

slide-1
SLIDE 1

Relationship between EOC Assessments & ACT Subject Tests

Karla L. Egan Center for Assessment

NCSA, 2015

slide-2
SLIDE 2

Guiding Questions

  • How do the Proficient cut scores compare to the ACT

college readiness benchmarks?

  • What score on an EOC best predicts students’

reaching the ACT college readiness benchmark?

  • Does the predicted cut score vary by grade level?

Page 2 • Egan• Presentation to NCSA, June 2015

slide-3
SLIDE 3

Assessment Data

  • EOC

– Administered since Fall 2008

  • English II
  • Algebra I
  • Biology

– Administered since Fall 2009

  • English I
  • Algebra II
  • Geometry

Page 3 • Egan• Presentation to NCSA, June 2015

  • American History
  • Government
slide-4
SLIDE 4

Assessment Data: Graduating Cohorts

EOC Subject Test 2014 2013 2012 English I 38808 37308 2101 English II* 61295 60866 61213 Algebra I* 59539 48087 22159 Algebra II 23508 23142 21436 Geometry 28539 26867 21029 American History 35129 33334 21226 Government* 62103 61317 44453 Biology* 60924 60251 50676 ACT 41564 40784 40535

Page 4 • Egan• Presentation to NCSA, June 2015

slide-5
SLIDE 5

EOC to ACT

EOC ACT Subject Area Test English I English II* English Algebra I* Algebra II Geometry Mathematics American History Government* Reading Biology* Physical Science Science

Page 5 • Egan• Presentation to NCSA, June 2015

slide-6
SLIDE 6

Matched Data

Matched Assessments

2014 2013 2012

EOC English I ACT English

25005 24129 661

EOC English II* ACT English

40256 39469 38883

EOC Algebra I* ACT Math

38834 28278 8837

EOC Algebra II ACT Math

19049 18411 16557

EOC Geometry ACT Math

20317 19209 13581

EOC American History ACT Reading

22948 21654 13482

EOC Government* ACT Reading

40808 39863 27442

EOC Biology* ACT Science

40057 39200 30634

Page 6 • Egan• Presentation to NCSA, June 2015

slide-7
SLIDE 7

Study 1: EOC Proficiency and ACT College Readiness

  • Methodology

– Logistic Regression

  • Find EOC cut score that best predicts ACT College Readiness
  • Find ACT score that best predicts ACT proficiency

– Borderline Groups

  • Find mean ACT score of students who are within one SEM of the

EOC cut score

  • Find mean EOC score of students who are within one SEM of the

ACT College Readiness benchmark

Page 7 • Egan• Presentation to NCSA, June 2015

slide-8
SLIDE 8

Choosing Cut Score

  • Accuracy rate: % of students correctly classified

Page 8 • Egan• Presentation to NCSA, June 2015

slide-9
SLIDE 9

Results

  • Similar Cut Scores Predicted in 2013 & 2014
  • Similar Results between Borderline Groups and

Logistic Regression

  • Accuracy rates very similar

– Slightly better for Logistic Regression

Page 9 • Egan• Presentation to NCSA, June 2015

slide-10
SLIDE 10

Accuracy Rates, 2014 Only

EOC Current Cut Scores BG LOG50 English I 80.2 77.7 80.3 English II 79.8 79.0 81.5 Algebra I 66.3 78.7 78.7 Algebra II 75.6 78.8 78.5 Geometry 67.4 77.2 76.5 American History 70.8 72.4 72.2 Government 70.5 74.2 74.2 Biology 62.8 74.4 74.8

Page 10 • Egan• Presentation to NCSA, June 2015

slide-11
SLIDE 11

Results, 2014 Only

EOC Current Cut Score BG LOG50 English I 200 204 197 English II 200 208 202 Algebra I 200 215 215 Algebra II 200 207 207 Geometry 200 210 211 American History 200 204 205 Government 200 209 209 Biology 200 213 216

Page 11 • Egan• Presentation to NCSA, June 2015

slide-12
SLIDE 12

Study 2

  • Does an EOC score that links with the ACT college

readiness benchmark vary based on the grade level in which the student first took the EOC?

  • How do the EOC linking scores in this study compare

with the EOC linking scores from Study 1?

  • Only use logistic regression for these analyses

Page 12 • Egan• Presentation to NCSA, June 2015

slide-13
SLIDE 13

Background

  • Students can take courses at any point in their high

school career

– Algebra I is often taken in Grade 8

  • Course‐taking pattern

– Grade 9: English I, Algebra I, American History – Grade 10: English II, Geometry, Biology – Grade 11: Algebra II, Government, American History

Page 13 • Egan• Presentation to NCSA, June 2015

slide-14
SLIDE 14

Accuracy Rates, 2014 Only

EOC Current Cut Scores LOG50 By Grade English I 80.2 80.3 80.4 English II 79.8 81.5 81.6 Algebra I 66.3 78.7 81.3 Algebra II 75.6 78.5 80.1 Geometry 67.4 76.5 80.5 American History 70.8 72.2 72.6 Government 70.5 74.2 74.6 Biology 62.8 74.8 75.8

Page 14 • Egan• Presentation to NCSA, June 2015

slide-15
SLIDE 15

Results, 2014 Only

EOC LOG50 8 9 10 English I 197 196 206 English II 202 198 202 Algebra I 215 207 217 227 Algebra II 207 194 203 Geometry 211 187 200 213 American History 205 201 205 Government 209 204 206 208 Biology 216 210 216

Page 15 • Egan• Presentation to NCSA, June 2015

slide-16
SLIDE 16

Results

  • Similar results between graduating cohorts
  • Predicted college readiness cut score increases by

grade

  • Accuracy rates are similar to single cut score

Page 16 • Egan• Presentation to NCSA, June 2015

slide-17
SLIDE 17

Final Recommendations

Page 17 • Egan• Presentation to NCSA, June 2015

slide-18
SLIDE 18

For more information: Center for Assessment www.nciea.org

Page 18 • Marion • Presentation to the NH Superintendents Association