SLIDE 1 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
1
Getting Everyone
Practical Strategies for Evaluator-Stakeholder Communication
The webinar will begin at 1 p.m. Eastern.
www.atecentral.net
SLIDE 2 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
2
Webinars ATE Survey Data Resource Library Blog
www.evalu-ate.org ADVANCED TECHNOLOGICAL EDUCATION www.nsf.gov/ate
SLIDE 3 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
3
Slides Recording Handout
Getting Everyone
Practical Strategies for Evaluator-Stakeholder Communication
The webinar will begin at 1 p.m. Eastern.
MATERIALS
Mike Lesiecki Lyssa Wilson Becho Kelly Robertson
INTRODUCTIONS
SLIDE 4 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
4
Emma Perk Janet Pinhorn Shannon Payne Cynthia Williams Lori Wingate
BEHIND THE SCENES
This material is based upon work supported by the National Science Foundation under grant number 1600992. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the presenters and do not necessarily reflect the views of NSF.
SLIDE 5
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
5
WHY FOCUS ON COMMUNICATION?
IF YOU ARE AN …
evaluator
SLIDE 6 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
6
IF YOU ARE A …
principal investigator or
HAVE YOU EVER…
SLIDE 7
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
7
HAVE YOU EVER…
been confused about the purpose of an evaluation activity?
HAVE YOU EVER…
received an piece of evaluation data too late for it to be useful?
SLIDE 8
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
8
HAVE YOU EVER…
found that the final evaluation report didn’t address important project needs?
GOOD COMMUNICATION
SLIDE 9 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
9
Ask important questions Interpret findings Gather evidence Report and use results
EVALUATION CYCLE
Clarity of expectations Stakeholder buy-in Utility of findings
GOOD COMMUNICATION IS ESSENTIAL!
SLIDE 10
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
10
GOOD COMMUNICATION = GOOD EVALUATION
SLIDE 11
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
11
Agenda
BEFORE EVALUATION BEGINS THROUGHOUT THE EVALUATION AT THE END OF THE EVALUATION
Question break! Question break! Question break!
BEFORE EVALUATION BEGINS
Communication
SLIDE 12
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
12
QUESTIONS EVALUATORS ASK
What should evaluators ask clients in the first meeting?
QUESTIONS EVALUATORS ASK
q Why do you want to have an evaluation conducted? q How do you know when the project is successful? q What challenges do you anticipate with implementation of the project? q How would you like the evaluation results communicated?
Go-to questions for first meetings
SLIDE 13
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
13
QUESTIONS CLIENTS ASK
What should clients ask evaluators in a first meeting?
QUESTIONS CLIENTS ASK
q How often will we be in contact? q How will you ensure the evaluation will be designed for my audience or context? q How far in advance will we receive draft reports? q Can I see an example of your reports? q Will you make recommendations in the report?
Go-to questions for first meetings
SLIDE 14
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
14
BUDGET MENU
Create a budget menu
EVALUATION MATRIX
Use a matrix to maximize communication
VS
SLIDE 15 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
15
EVALUATION MATRIX
Evaluation Question Criteria Indicators Standards Method / Source Instrument
(What want to know?) (Dimension of quality) (What will be measured?) (What does success look like?) (How gather data and from where) (Tool used to collect data)
Must have Everyday description Combine
Use a matrix to maximize communication
EVALUATION MATRIX
Example
SLIDE 16 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
16
ACKNOWLEDGE EXPERTISE
Utilize multiple knowledge bases
Evaluation Expertise Project Expertise Quality Evaluation
ACKNOWLEDGE EXPERTISE
Utilize multiple project expertise
SLIDE 17
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
17
COMMUNICATION PLAN
Put it in writing!
q Designate primary contacts q Set up recurring meetings q Agree on deliverable review process q Clarify who is responsible for disseminating reports
SUMMARY
q Prepare questions to ask at first meeting q Present evaluation options in a budget menu q Organize evaluation matrix by questions q Acknowledge evaluation and project expertise q Create a communication plan
Communication before the evaluation begins
SLIDE 18
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
18
THROUGHOUT THE EVALUATION
Communication CHEAT SHEETS
Make your evaluation plan useful
SLIDE 19
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
19
CHEAT SHEETS
Make your evaluation plan useful
Evaluation Plan
CHEAT SHEETS
Attention to details
q Include date on top q Include project and evaluator phone numbers q Make changes obvious q Include ”last updated” date
SLIDE 20 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
20
CHEAT SHEETS
Summary of deliverables
Deliverables Matched with questions
CHEAT SHEETS
Timeline of major milestones
Deadlines
SLIDE 21 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
21
CHEAT SHEETS
Simplified evaluation matrix
Who is responsible When Sample
CHAT QUESTION
What would you find helpful in a cheat sheet?
SLIDE 22
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
22
MONTHLY EMAIL UPDATES
Keep everyone in the loop
Hello!
MONTHLY EMAIL UPDATES
Keep everyone in the loop
SLIDE 23 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
23
MONTHLY EMAIL UPDATES
Keep everyone in the loop Past Month’s Eval Tasks Upcoming Eval Activities Asks from Client Any Project Updates?
SHARE FINDINGS AS AVAILABLE
Avoid surprises at the end of an evaluation
Increase use for program improvement Increase
and buy-in Increase validity of interpretation
SLIDE 24
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
24
SHARE FINDINGS AS AVAILABLE
Avoid surprises at the end of an evaluation
SHARE FINDINGS AS AVAILABLE
Avoid surprises at the end of an evaluation
SLIDE 25
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
25
SHARE FINDINGS AS AVAILABLE
Avoid surprises at the end of an evaluation
SUMMARY
q Summarize evaluation plan in a cheat sheet q Send monthly email updates q Share preliminary results as available q Avoid surprises in final report
Communication throughout the evaluation
SLIDE 26
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
26
AT THE END OF THE EVALUATION
Communication SHARE OUTLINES
When drafting reports
SLIDE 27
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
27
SHARE OUTLINES
When drafting reports
SHARE OUTLINES
When drafting reports
SLIDE 28
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
28
ASK REFLECTIVE QUESTIONS
Report revisions and next steps
ASK REFLECTIVE QUESTIONS
Next steps
q Based on the report, what aspects of the program need improvement? q How can we facilitate your use of this report? q What unanswered questions do you have? q What do you want to see different on the next deliverable?
SLIDE 29
Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
29
POLL QUESTION
Which do you think will result in increased use?
A B LINK TO EVIDENCE
Conclusions and recommendations
Action or Judgement Why
SLIDE 30 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
30
LINK TO EVIDENCE
Recommendations
Action Why
Problem Why Action
EVALUATION RECOMMENDATIONS
Document suggestions for future evaluations
SLIDE 31 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
31
EVALUATION RECOMMENDATIONS
Problem
Document suggestions for future evaluations
Why Action
SUMMARY
q Share report outlines q Ask reflective questions about reports q Link evidence with conclusions & recommendations q Document suggestions for future evaluations
Communication at the end of the evaluation
SLIDE 32 Getting Everyone on the Same Page
Practical Strategies for Evaluator- Stakeholder Communication EvaluATE Webinar Series May 22, 2019 Slides, video, and handout: www.evalu-ate.org/webinars/may19
32
Clarity of expectations Stakeholder buy-in Utility of findings
GOOD COMMUNICATION IS ESSENTIAL!
www.evalu-ate.org/webinars/may19/
Getting Everyone
Practical Strategies for Evaluator-Stakeholder Communication
The webinar will begin at 1 p.m. Eastern.
