small
BIG impact
Christina Grimsley, Ph.D.
Monitronics, International
team
business need? improve image courtesy of iStockphoto recurrent - - PowerPoint PPT Presentation
team small BIG impact Christina Grimsley, Ph.D. Monitronics, International business need? improve image courtesy of iStockphoto recurrent image courtesy of Microsoft Clipart image courtesy of Microsoft Clipart image courtesy of
small
Christina Grimsley, Ph.D.
Monitronics, International
team
1
1
rewrote all skills assessments
2
1
rewrote all skills assessments
2
performed Kirkpatrick evaluations
3
c u r r i c u l u m
Lesson Outline A is the LEAST effective lesson plan. Lesson Outline C is a more effective lesson plan for learners with relevant spreadsheet experience. Lesson Outline B is the MOST effective for all learners. All three lessons are effective because they all include the same content.
Lesson Outline A is the LEAST effective lesson plan. Lesson Outline C is a more effective lesson plan for learners with relevant spreadsheet experience. Lesson Outline B is the MOST effective for all learners. All three lessons are effective because they all include the same content.
fe feedba edback ck
Lesson Outline A is the LEAST effective lesson plan. Lesson Outline C is a more effective lesson plan for learners with relevant spreadsheet experience. Lesson Outline B is the MOST effective for all learners. All three lessons are effective because they all include the same content.
Lesson Outline A is the LEAST effective lesson plan. Lesson Outline C is a more effective lesson plan for learners with relevant spreadsheet experience. Lesson Outline B is the MOST effective for all learners. All three lessons are effective because they all include the same content.
avoid trick items
avoid trick items
emphasize important material
avoid trick items keep answer options
emphasize important material
similar lengths
avoid trick items keep answer options
emphasize important material avoid verbatim phrasing
similar lengths
avoid trick items keep answer options
emphasize important material avoid verbatim phrasing use common errors
similar lengths
avoid trick items keep answer options
emphasize important material avoid verbatim phrasing use common errors use plausible distractors
similar lengths
1 2 3 4
get out of the
level
creating evaluating analyzing applying understanding remembering
creating evaluating analyzing applying understanding remembering
hi high ghest leve est level mi midd ddle lev le level el lo lowe west lev st level el
Dawn M. Zimmaro Writing Good Multiple Choice Examslo lowe west lev st level el
Dawn M. Zimmaro Writing Good Multiple Choice ExamsWhich of the following defines X?
Which of the following defines X? Which of the following is an
example of X?
Which of the following defines X? Which of the following is an
example of X?
What is the next step in X?
lo lowe west lev st level el
hi high ghest leve est level mi midd ddle lev le level el lo lowe west lev st level el
Here is a scenario/problem. Which of the following apply?
Here is a scenario/problem. Which of the following apply? Which of the following is an
example of X?
i n t e r p r e t
screenshots & scenarios
Which of the following best defines a Monitronics Lanvac customer? A. B. C. D.
be billed less frequently because he doesn’t like receiving a bill every month. Which of the following actions best represents how to assist him?
multilogical
t h i n k i n g
Which of the following best defines a Monitronics Lanvac customer? A. B. C. D.
be billed less frequently because he doesn’t like receiving a bill every month. Which of the following actions best represents how to assist him?
The billing address is located on which side of the customer banner in MASterMind? A. B. C. D.
the P.O. address we have on
actions best represents how to assist him?
Which of the following services is not included in the lifetime service plan? A. B. C. D.
window unit air conditioner over the weekend that his system will not arm even though he has all of his doors and windows
represents how to assist him?
Donald Kirkpatrick level 1 level 2 level 4 level 3 the levels
The Kirkpatrick Model
level 5
An ASTD Benchmarking Forum study found that while 94 percent
1, only 34% are checked for participant knowledge. The two field-based levels, 3 and 4, fare far
examined on Level 3, and only 3% for Level 4.
Rossett, Allison. “Metrics Matters: Technology Changes the Face of Learning and Development. How Does it Change Analysis and Evaluation?” T&D. March 2010. p. 65.
“ ”
training hours
training hours
# of learners
training hours graduation rates
# of learners
training hours graduation rates
# of learners
training hours graduation rates
# of learners
check average
the training was
will we know
and tell, stair-step, and immersive architectures to the curriculum design.
involve higher orders of thinking, interpretation of scenarios and screenshots, and multilogical thinking.
levels of evaluation to show
In Summary: