Virginias Perspective on Scoring for Technology Enhanced Items - - PowerPoint PPT Presentation

▶

Aug 20, 2022 357 likes •754 views

Image by Mrs. E Teaches Math www.mrseteachesmath.blogspot.com Virginias Perspective on Scoring for Technology Enhanced Items CCSSO National Conference on Student Assessment 22 June 2016 1 Online Testing in Virginia 3000000 2656010

SLIDE 1

Virginia’s Perspective on Scoring for Technology Enhanced Items

CCSSO National Conference on Student Assessment

22 June 2016

Image by Mrs. E Teaches Math www.mrseteachesmath.blogspot.com

SLIDE 2

Online Testing in Virginia

500000 1000000 1500000 2000000 2500000 3000000 Fall 2001 Spr 2003 Spr 2005 Spr 2007 Spr 2009 Spr 2011 Spr 2013 Spr 2015

1700 8500 76000 265000 579000 924050 1333150 1418250 1652680 1908970 2216690 2489170 2656010 2661406 2427599

*

SLIDE 3

Background

Beginning in the Spring of 2011, Virginia began

field testing Technology Enhanced Items (TEIs) as part of the Standards of Learning (SOL) assessments

TEIs now make up 15-20% of the items on all of the

SOL tests

Currently students are awarded either full credit (1

point) or no credit (0 points) for both multiple choice items and TEIs

Recent interest from the SOL Innovation

Committee has encouraged consideration of

ffering partial credit for TEIs

SLIDE 4

Background

The Standards of Learning Innovation Committee

was created by HB 930 in the 2014 legislative session.

Purpose of the Committee is to provide the Board
f Education and General Assembly with

suggestions on changes to the SOL assessments, authentic individual student growth measures, alignment between the Standards of Learning and assessment, and ideas on innovative teaching in the classroom.

SLIDE 5

Background

SOL Committee Recommendation (2015):
“…all assessments should be

scored fairly and accurately, with partial credit being awarded for assessment items that require multiple responses.”

SLIDE 6

Partial Credit Scoring and TEIs

Seems like a logical recommendation

SLIDE 7

Partial Credit Scoring and TEIs

However…implementation is more complex than it

might seem with lots of decisions to be made about how and when to award partial credit

SLIDE 8

Audience Participation Section

SLIDE 9

Example 1: Drag and Drop with 2 Bays

SLIDE 10

Example 1: Drag and Drop with 2 Bays Full Credit

SLIDE 11

Example 1: Drag and Drop with 2 Bays Partial Credit?

SLIDE 12

Example 2: Drag and Drop with 2 Bays

SLIDE 13

Example 2: Drag and Drop with 2 Bays Full Credit

SLIDE 14

Example 3: Drag and Drop with 8 Bays

SLIDE 15

Example 3: Drag and Drop with 8 Bays Full Credit

SLIDE 16

Example 3: Drag and Drop with 8 Bays Partial Credit?

SLIDE 17

Example 4: Drag and Drop with Order

SLIDE 18

Example 4: Drag and Drop with Order Full Credit

SLIDE 19

Example 4: Drag and Drop with Order Partial Credit?

SLIDE 20

Example 4: Drag and Drop with Order Partial Credit?

SLIDE 21

Example 4: Drag and Drop with Order Partial Credit?

SLIDE 22

Example 5: Hot Spot

SLIDE 23

Example 5: Hot Spot Full Credit

SLIDE 24

Example 5: Hot Spot Partial Credit?

SLIDE 25

Example 5: Hot Spot Partial Credit?

SLIDE 26

Example 5: Hot Spot Partial Credit?

SLIDE 27

Example 6: Bar Chart

SLIDE 28

Example 6: Bar Chart Full Credit

SLIDE 29

Example 6: Bar Chart Partial Credit?

SLIDE 30

Example 6: Bar Chart Partial Credit?

SLIDE 31

Example 6: Bar Chart Partial Credit?

SLIDE 32

Example 7: Line Graph

SLIDE 33

Example 7: Line Graph Full Credit

SLIDE 34

Example 7: Line Graph Partial Credit?

SLIDE 35

Example 7: Line Graph Partial Credit?

SLIDE 36

Example 8: Fill-in-the-Blank

SLIDE 37

Example 8: Fill-in-the-Blank Full Credit

SLIDE 38

Take-Aways

1) Are there some items for which partial credit should not be offered even when there are multiple responses? 2) Are there some response patterns which should receive partial credit and others which should not? 3) How many points of partial credit should each response pattern be worth? 4) Does order of responses matter in awarding partial credit?

SLIDE 39