Computer Adaptive Testing Lawrence M. Rudner Consultant Paper - - PowerPoint PPT Presentation

▶
computer adaptive testing
SMART_READER_LITE
LIVE PREVIEW

Computer Adaptive Testing Lawrence M. Rudner Consultant Paper - - PowerPoint PPT Presentation

Apr 06, 2023 11 likes •113 views

Computer Adaptive Testing Lawrence M. Rudner Consultant Paper & Pencil 1.00 0.75 Easiness 0.50 0.25 0.00 0 5 10 15 20 Item Order Hard Ability Wrong Level Wrong Right Wrong Item Difficulty Right Right Right Right Right

slide-1
SLIDE 1

Computer Adaptive Testing

Lawrence M. Rudner Consultant

slide-2
SLIDE 2

0.00 0.25 0.50 0.75 1.00 5 10 15 20 Easiness Item Order

Paper & Pencil

slide-3
SLIDE 3
slide-4
SLIDE 4

From http://www.rasch.org/memo69.pdf

Right Right Right Right Right Right 1 2 3 4 5 6 7 8 9 10 11 12 Wrong Wrong Wrong Ability Level

Item Difficulty

Hard Easy

slide-5
SLIDE 5

0.00 0.25 0.50 0.75 1.00 5 10 15 20 Easiness

slide-6
SLIDE 6

IRT Approach

0.2 0.4 0.6 0.8 1

  • 3
  • 2
  • 1

1 2 3 Ability Prob of a correct response 0.2 0.4 0.6 0.8 1

  • 3
  • 2
  • 1

1 2 3 Ability Prob of a correct response

slide-7
SLIDE 7

Multi-Stage Approach

slide-8
SLIDE 8
  • 3
  • 2
  • 1

1 2 3

slide-9
SLIDE 9

Decision Theory Approach

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 non-master master 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0

1 3 5 7 9 1 3 5 7 9

Probabi

  • babili

lity

Item Response

  • nse Probabilit

abilitie ies

Non-master Master

Test Taker 111

[1,1,1,1,1,1,1,1,0,1]

slide-10
SLIDE 10

Advantages

  • Shorter tests
  • Better precision
  • Security ?
  • Retesting
  • Computer capabilities
  • Examinee experience
  • Motivation

Disadvantages

  • Big bank
  • Pretested items
  • Good item statistics
  • Over exposure - ?
  • Security - ?
  • No review ?
  • Customer Care