What use are band descriptors? Rob Playfair, IFP Course Tutor, ISLI - - PowerPoint PPT Presentation

what use are band descriptors
SMART_READER_LITE
LIVE PREVIEW

What use are band descriptors? Rob Playfair, IFP Course Tutor, ISLI - - PowerPoint PPT Presentation

What use are band descriptors? Rob Playfair, IFP Course Tutor, ISLI Community of Practice 13 th November 2017 Purpose: to create a shared meaning Band descriptors are used to ensure consistency in grading between one student script and the


slide-1
SLIDE 1

What use are band descriptors?

Rob Playfair, IFP Course Tutor, ISLI Community of Practice 13th November 2017

slide-2
SLIDE 2

Purpose: to create a shared meaning

A) formative? B) reliable?

Band descriptors are used to “ensure consistency in grading between one student script and the next, or between different raters.”

(Alexander, Argent & Spenser)

slide-3
SLIDE 3

Assessing writing

Tacit Knowledge: “We can know more than we can tell.”

(Polanyi)

slide-4
SLIDE 4

Formative: Shared meaning with students?

Singapore ‘O’ Level descriptor:

  • C: ‘simple vocabulary and

idioms mainly correct’

  • B: ‘vocabulary wide and

precise enough to convey intended shades of meaning’

  • A: ‘vocabulary wide and

precise’

slide-5
SLIDE 5

Reliable: absolute judgement?

List A

  • 1. Stealing a towel from a

hotel.

  • 2. Keeping a dime you find on

the ground.

  • 3. Poisoning a barking dog.

List B

  • 1. Testifying falsely for pay.
  • 2. Using guns on striking

workers.

  • 3. Poisoning a barking dog.

(Mozer et al.)

slide-6
SLIDE 6

Reliable: comparative judgement

‘First it does not define quality through prose but through exemplars. Second it does not rely on absolute judgment of tasks, but on comparisons’

(Christodoulou)

slide-7
SLIDE 7

No More Marking: Which essay is better?

A B 0.85+ inter-rater reliability scores

(No More Marking)

slide-8
SLIDE 8

So, what use are descriptors?

They can’t…

  • help students analyse how

to improve.

  • produce reliable summative

scores. Could they…

  • provide ceilings for specific

scores?

  • explain broadly what is and

what isn’t assessed?

  • describe the intended end

goal?

slide-9
SLIDE 9

References

Alexander, O., Argent, S., Spencer, J. (2008) EAP Essentials, Reading: Garnet. Christodoulou, D. (2017) Making Good Progress?, Oxford: OUP Mozer, M. C. et al. (2010) Decontaminating Human Judgements by Removing Sequential Dependencies. Advances in Neural Information Processing Systems, 23. Polanyi, M. (1966) The Tacit Dimension, London: Cox & Wyman. Singapore Writing Marking Scheme (2013) No More Marking (Comparative Judgement programme): https://www.nomoremarking.com