common threads of healthy discontent about assessment Library - - PowerPoint PPT Presentation

common threads of healthy discontent about assessment
SMART_READER_LITE
LIVE PREVIEW

common threads of healthy discontent about assessment Library - - PowerPoint PPT Presentation

common threads of healthy discontent about assessment Library Instruction West 2016 LILAC 2017 common threads of healthy discontent about assessment Library Instruction West 2016 LILAC 2017 We Need to Decide What Works and What


slide-1
SLIDE 1

Library Instruction West 2016 LILAC 2017

common threads of healthy discontent about assessment

slide-2
SLIDE 2

Library Instruction West 2016 LILAC 2017

common threads of healthy discontent about assessment

slide-3
SLIDE 3

“We Need to Decide What Works and What Doesn’t Work.”

slide-4
SLIDE 4

Do we?

slide-5
SLIDE 5

Do we need to be so dualistic?

slide-6
SLIDE 6

W

  • r

k s W

  • r

k s

Doesn’t Work

Doesn’t Work

slide-7
SLIDE 7

Doesn’t Work

Doesn’t Work

We have to invest significant energy in making sure nothing we do ever ends up in the wrong box.

slide-8
SLIDE 8

Doesn’t Work

Doesn’t Work

The Box mindset Stifles Creativity, Discourages Risk- Taking, and Increases Imposter Syndrome.

slide-9
SLIDE 9

What’s the alternative?

slide-10
SLIDE 10

#fail4Lib Reframing Failure

slide-11
SLIDE 11

#fail4Lib

slide-12
SLIDE 12

Encouraging Reflective Practice

#lilac17

slide-13
SLIDE 13

Re-Framing Failure + Reflective Practice

getting better all the time getting better all the time

slide-14
SLIDE 14

“We need Data-Driven Decision-Making”

slide-15
SLIDE 15

Do we?

slide-16
SLIDE 16

Data Driven or Data-Informed?

Andreas Orphanides, NCSU Libraries, “It’s made of people: designing systems for humans”

slide-17
SLIDE 17

Data-Informed > Data Driven

but do we want “data” alone driving our decisions? It might be good for Data to drive the enterprise.

slide-18
SLIDE 18

slide from Andreas Orphanides, NCSU Libraries, “It’s made of people: designing systems for humans”

slide-19
SLIDE 19

Are we setting the Right Measures?

“By measuring how long the engine was running, the vehicle’s speeds, and even seemingly esoteric factors, such as the position of the steering wheel and barometric pressure, Volkswagen vehicles could understand they were being tested and so adjusted their engine performance to pass the tests, according to the EPA.”

slide-20
SLIDE 20

Are we setting the Right Measures?

12 one-shot sessions. 24 Students per session

  • - -

Total engagement: 288! 1 train-the-trainer sessions w/ TAs. 12 TA’s in the session

  • - -

Total engagement: 12 :-(

slide-21
SLIDE 21

Are we setting the Right Measures?

12 one-shot sessions. 24 Students per session

  • - -

Total engagement: 288! Total learning: ??? 1 train-the-trainer sessions w/ TAs. 12 TA’s in the session

  • - -

Total engagement: 12 :-(

But wait, each TA taught a section w/ 24 students. And research skills were integrated across 3 class sessions, instead of just one. Total impact: 288 students x 3 sessions? Total learning: ???

slide-22
SLIDE 22

Are we setting the Right Measures?

12 one-shot sessions. 24 Students per session

  • - -

Total engagement: 288! Total learning: ???

“What gets measured gets Improved.”

1 train-the-trainer sessions w/ TAs. 12 TA’s in the session

  • - -

Total engagement: 12 :-(

But wait, each TA taught a section w/ 24 students. And research skills were integrated across 3 class sessions, instead of just one. Total impact: 288 students x 3 sessions? Total learning: ???

slide-23
SLIDE 23

S.M.A.R.T. goals need smart metrics

“Increase engagement with ___ dept. by 30% each academic year.”

“What gets measured gets Improved.”

things that are Easy to Measure aren’t always the best Metrics.

  • Peter Drucker
  • Doug
slide-24
SLIDE 24

What’s the alternative?

slide-25
SLIDE 25

Mixed Methods Approaches.

Can we Make Assessment both Quantitative and Qualitative?

}

slide-26
SLIDE 26

humanize our data and break through the metric wall!

slide-27
SLIDE 27

Focus on Benefits for Learners & Researchers

#liw16

slide-28
SLIDE 28

Strategy-Driven Decision Making? Mission-driven decision making? Yes - our strategy & mission should be informed by data. And - our data can be contextualized and better understood through refmective practice.

Maybe?

slide-29
SLIDE 29

“We need a Culture of Assessment!”

slide-30
SLIDE 30

Do we?

slide-31
SLIDE 31

Doesn’t Work

Doesn’t Work

culture of Assessment

culture of Learning

slide-32
SLIDE 32

Culture of Learning