Virginias Perspective on Scoring for Technology Enhanced Items - - PowerPoint PPT Presentation

virginia s perspective on scoring for technology enhanced
SMART_READER_LITE
LIVE PREVIEW

Virginias Perspective on Scoring for Technology Enhanced Items - - PowerPoint PPT Presentation

Image by Mrs. E Teaches Math www.mrseteachesmath.blogspot.com Virginias Perspective on Scoring for Technology Enhanced Items CCSSO National Conference on Student Assessment 22 June 2016 1 Online Testing in Virginia 3000000 2656010


slide-1
SLIDE 1

Virginia’s Perspective on Scoring for Technology Enhanced Items

CCSSO National Conference on Student Assessment

22 June 2016

1

Image by Mrs. E Teaches Math www.mrseteachesmath.blogspot.com

slide-2
SLIDE 2

Online Testing in Virginia

500000 1000000 1500000 2000000 2500000 3000000 Fall 2001 Spr 2003 Spr 2005 Spr 2007 Spr 2009 Spr 2011 Spr 2013 Spr 2015

1700 8500 76000 265000 579000 924050 1333150 1418250 1652680 1908970 2216690 2489170 2656010 2661406 2427599

*

slide-3
SLIDE 3

Background

  • Beginning in the Spring of 2011, Virginia began

field testing Technology Enhanced Items (TEIs) as part of the Standards of Learning (SOL) assessments

  • TEIs now make up 15-20% of the items on all of the

SOL tests

  • Currently students are awarded either full credit (1

point) or no credit (0 points) for both multiple choice items and TEIs

  • Recent interest from the SOL Innovation

Committee has encouraged consideration of

  • ffering partial credit for TEIs

3

slide-4
SLIDE 4

Background

  • The Standards of Learning Innovation Committee

was created by HB 930 in the 2014 legislative session.

  • Purpose of the Committee is to provide the Board
  • f Education and General Assembly with

suggestions on changes to the SOL assessments, authentic individual student growth measures, alignment between the Standards of Learning and assessment, and ideas on innovative teaching in the classroom.

4

slide-5
SLIDE 5

Background

  • SOL Committee Recommendation (2015):
  • “…all assessments should be

scored fairly and accurately, with partial credit being awarded for assessment items that require multiple responses.”

5

slide-6
SLIDE 6

Partial Credit Scoring and TEIs

  • Seems like a logical recommendation

6

slide-7
SLIDE 7

Partial Credit Scoring and TEIs

  • However…implementation is more complex than it

might seem with lots of decisions to be made about how and when to award partial credit

7

slide-8
SLIDE 8

Audience Participation Section

slide-9
SLIDE 9

Example 1: Drag and Drop with 2 Bays

9

slide-10
SLIDE 10

Example 1: Drag and Drop with 2 Bays Full Credit

10

slide-11
SLIDE 11

Example 1: Drag and Drop with 2 Bays Partial Credit?

11

slide-12
SLIDE 12

Example 2: Drag and Drop with 2 Bays

12

slide-13
SLIDE 13

Example 2: Drag and Drop with 2 Bays Full Credit

13

slide-14
SLIDE 14

Example 3: Drag and Drop with 8 Bays

14

slide-15
SLIDE 15

Example 3: Drag and Drop with 8 Bays Full Credit

15

slide-16
SLIDE 16

Example 3: Drag and Drop with 8 Bays Partial Credit?

16

slide-17
SLIDE 17

Example 4: Drag and Drop with Order

17

slide-18
SLIDE 18

Example 4: Drag and Drop with Order Full Credit

18

slide-19
SLIDE 19

Example 4: Drag and Drop with Order Partial Credit?

19

slide-20
SLIDE 20

Example 4: Drag and Drop with Order Partial Credit?

20

slide-21
SLIDE 21

Example 4: Drag and Drop with Order Partial Credit?

21

slide-22
SLIDE 22

Example 5: Hot Spot

22

slide-23
SLIDE 23

Example 5: Hot Spot Full Credit

23

slide-24
SLIDE 24

Example 5: Hot Spot Partial Credit?

24

slide-25
SLIDE 25

Example 5: Hot Spot Partial Credit?

25

slide-26
SLIDE 26

Example 5: Hot Spot Partial Credit?

26

slide-27
SLIDE 27

Example 6: Bar Chart

27

slide-28
SLIDE 28

Example 6: Bar Chart Full Credit

28

slide-29
SLIDE 29

Example 6: Bar Chart Partial Credit?

29

slide-30
SLIDE 30

Example 6: Bar Chart Partial Credit?

30

slide-31
SLIDE 31

Example 6: Bar Chart Partial Credit?

31

slide-32
SLIDE 32

Example 7: Line Graph

32

slide-33
SLIDE 33

Example 7: Line Graph Full Credit

33

slide-34
SLIDE 34

Example 7: Line Graph Partial Credit?

34

slide-35
SLIDE 35

Example 7: Line Graph Partial Credit?

35

slide-36
SLIDE 36

Example 8: Fill-in-the-Blank

36

slide-37
SLIDE 37

Example 8: Fill-in-the-Blank Full Credit

37

slide-38
SLIDE 38

Take-Aways

1) Are there some items for which partial credit should not be offered even when there are multiple responses? 2) Are there some response patterns which should receive partial credit and others which should not? 3) How many points of partial credit should each response pattern be worth? 4) Does order of responses matter in awarding partial credit?

38

slide-39
SLIDE 39