Accelerating Evaluation Use through Infographics and Visual Design - - PowerPoint PPT Presentation

▶
accelerating evaluation use
SMART_READER_LITE
LIVE PREVIEW

Accelerating Evaluation Use through Infographics and Visual Design - - PowerPoint PPT Presentation

Nov 02, 2022 417 likes •1.57k views

Accelerating Evaluation Use through Infographics and Visual Design Jessica R. Pomerantz Apr. 2, 2015 What will the next generation of evaluations look like? programnet.usaid.gov 2 What if? Instead of Program Background What if?

slide-1
SLIDE 1

Accelerating Evaluation Use through Infographics and Visual Design

Jessica R. Pomerantz

  • Apr. 2, 2015
slide-2
SLIDE 2

programnet.usaid.gov

What will the next generation of evaluations look like?

2

slide-3
SLIDE 3

Instead of Program Background

What if…?

slide-4
SLIDE 4

Visual Timeline

2000 2015

Instead of Program Background

What if…?

slide-5
SLIDE 5

Visual Timeline

document project milestones

2000 2015

slide-6
SLIDE 6

Visual Timeline

track a key indicator

2000 2015

Δ = zero Δ = -20%

slide-7
SLIDE 7

Visual Timeline

provide context

2000 2015

political event social change tech advance

Δ = zero Δ = -20%

slide-8
SLIDE 8

Visual Timeline

interpret changes

2000 2015

political event

social change

tech advance

Inflection point

Δ = zero Δ = -20%

social change

slide-9
SLIDE 9

Visual Timeline

include visual project details

2000 2015

political event social change tech advance

Δ = zero Δ = -20%

Inflection point

slide-10
SLIDE 10

Evaluation use through visual design

slide-11
SLIDE 11

2000 2015

political event social change tech advance

Δ = zero Δ = -20%

Inflection point

Evaluation use through visual design

slide-12
SLIDE 12

A wealth of information creates a poverty of attention

slide-13
SLIDE 13

What if…?

Instead of 90 pages

slide-14
SLIDE 14

What if…?

One page

slide-15
SLIDE 15

What if…?

Program Title Evaluation Details

One page

slide-16
SLIDE 16

What if…?

Program budget Inputs Outputs Program Title Evaluation Details

One page

slide-17
SLIDE 17

What if…?

Program budget Inputs Outputs Additional evaluation questions Performance Impact Program Title Evaluation Details

One page

slide-18
SLIDE 18

What if…?

Program budget Inputs Outputs Additional evaluation questions Performance Impact Project outcomes Achievements Outcome undetermined Outcomes not yet achieved Externalities Program Title Evaluation Details

One page

slide-19
SLIDE 19

programnet.usaid.gov

What do we want the next generation of evaluations to look like in order to achieve maximum utility?

19

slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22

programnet.usaid.gov

The Basics

22

What are my visual options?

slide-23
SLIDE 23

What are my visualization options?

Statistical graphics

slide-24
SLIDE 24

What are my visualization options?

Tiny things Big thing

Center

Top Right Bottom Left

SmartArt

slide-25
SLIDE 25

What are my visualization options?

Clip art

slide-26
SLIDE 26

What are my visualization options?

Timeline

slide-27
SLIDE 27

What are my visualization options?

By the numbers

slide-28
SLIDE 28

What are my visualization options?

Mapping

slide-29
SLIDE 29

What are my visualization options?

Visual article

slide-30
SLIDE 30

What are my visualization options?

Flowchart

slide-31
SLIDE 31

What are my visualization options?

Useful bait

slide-32
SLIDE 32

Data visualization

What are my visualization options?

slide-33
SLIDE 33

What are my visualization options?

Versus infographic

slide-34
SLIDE 34

What are my visualization options?

Photo infographic

slide-35
SLIDE 35

programnet.usaid.gov

Timing

35

Before the evaluation

slide-36
SLIDE 36

How do I know what visual I need?

slide-37
SLIDE 37

How do I know what visual I need?

Which part of the evaluation?

slide-38
SLIDE 38

How do I know what visual I need?

Which part of the evaluation?

  • 1. Who is your audience?
slide-39
SLIDE 39

How do I know what visual I need?

Which part of the evaluation?

  • 1. Who is your audience?
  • 2. What’s your goal for the

evaluation utilization?

slide-40
SLIDE 40

How do I know what visual I need?

Which part of the evaluation?

  • 1. Who is your audience?
  • 2. What’s your goal for the

evaluation utilization?

 Make an adaptive project decision or inform future project design?  Highlight a specific finding?  Describe a success or failure?  Give an overview?  To communicate results publicly?

slide-41
SLIDE 41

How do I know what visual I need?

Which part of the evaluation?

  • 1. Who is your audience?
  • 2. What’s your goal for the

evaluation utilization?

  • 3. How can you use the

evaluation to tell a compelling story?

 Make an adaptive project decision or inform future project design?  Highlight a specific finding?  Describe a success or failure?  Give an overview?  To communicate results publicly?

slide-42
SLIDE 42

How do I know what visual I need?

What type of visualization?

slide-43
SLIDE 43

Statistical graphics SmartArt Clip art Timeline By the numbers Mapping Photo infographic Visual article Data visualization Useful bait Flowchart Versus infographic

slide-44
SLIDE 44

Statistical graphics……………..Visual data presentation SmartArt…………………………..Pre-designed diagram Clip art……………………………..Free visual elements Timeline……………………………Chronological narrative By the numbers………………….Summarizing data Mapping…………………………..GIS data or geographic content Photo infographic………………The focus is one object Visual article………………………Multiple graphic elements and a story Data visualization……………….Complex data analysis via graphics Useful bait………………………..Seeking web traffic or attention Flowchart.…………………………Describing a process Versus infographic………………Comparing two things

slide-45
SLIDE 45

programnet.usaid.gov

Timing

45

After the evaluation

slide-46
SLIDE 46

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

slide-47
SLIDE 47

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Which part of the evaluation?

slide-48
SLIDE 48

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Which part of the evaluation? Executive summary Purpose & evaluation questions Program background Evaluation method & limitations Looking back (2011-2013) Pre-existing figures & tables

slide-49
SLIDE 49

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Goal: Inform future project design

slide-50
SLIDE 50

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Goal: Inform future project design Audience:

1. USAID 2. Development industrial complex

slide-51
SLIDE 51

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Goal: Inform future project design Audience:

1. USAID 2. Development industrial complex

Focus:

1. Recommendations 2. Background

slide-52
SLIDE 52

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Goal: Inform future project design Audience:

1. USAID 2. Development industrial complex

Focus:

1. Recommendations 2. Background

Which part of the evaluation:

1. Evaluation recommendations 2. Program background

slide-53
SLIDE 53

Mid-Term Performance Evaluation of Asia’s Regional Response to Endangered Species Trafficking Program

Goal: Inform future project design Audience:

1. USAID 2. Development industrial complex

Focus:

1. Recommendations 2. Background

Which part of the evaluation:

1. Evaluation recommendations 2. Program background

Which visual:

1. Visual article 2. Timeline

slide-54
SLIDE 54

Focus:

Recommendations

Which visual:

Visual article

slide-55
SLIDE 55
slide-56
SLIDE 56

Focus:

Program background

Which visual:

Timeline

slide-57
SLIDE 57
slide-58
SLIDE 58
slide-59
SLIDE 59
slide-60
SLIDE 60
slide-61
SLIDE 61
  • 1. Text & icons can be beautiful and

interesting too

  • 2. Change your angle?
  • 3. Bail! Looks like people are going

to have to read the report

No info and no graphic…?

What to do when you’re data-free

slide-62
SLIDE 62

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-63
SLIDE 63

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-64
SLIDE 64

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-65
SLIDE 65

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-66
SLIDE 66

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-67
SLIDE 67

The one-pager

Performance Evaluation of the Education Program of the Community Livelihoods Project (CLP)

slide-68
SLIDE 68

The one (or two)-pager

slide-69
SLIDE 69

Open Data in the Governance of South African Higher Education One-pager example

http://www.opendataresearch.org/sites/default/files/publicatio ns/UCT%20A1%20Poster%20for%20Berlin%20PRINT%20% 281%29.pdf

slide-70
SLIDE 70

Using text and color only example

https://ligtt.org/sites/all/files/page/50BTs-List.pdf

slide-71
SLIDE 71

programnet.usaid.gov

Cautions

71

slide-72
SLIDE 72

Visualize responsibly

http://www.theguardian.com/news/datablog/gallery /2013/aug/01/16-useless-infographics

slide-73
SLIDE 73

Visualize responsibly

http://stephanieevergreen.com/dataviz-checklist/

slide-74
SLIDE 74

Visualize responsibly

slide-75
SLIDE 75

Increase in capacity

Year 1 Year 2 Year 3 Year 4

Visualize responsibly

slide-76
SLIDE 76

Increase in capacity

Year 1 Year 2 Year 3 Year 4

Visualize responsibly

3-D pie charts: Not legible! What does this caption mean? Why have a legend instead of direct labels?

slide-77
SLIDE 77

Visualize responsibly

Crowded line graph: Not legible! Why have a legend instead of direct labels? What does this caption mean? (And why is it so tiny?)

September 2013 European Evaluation Society newsletter, Evaluation Connections, p.7

slide-78
SLIDE 78

Visualize responsibly

Watch out for…

slide-79
SLIDE 79

Visualize responsibly

1 2 3 4 2 4 Bubbles

Watch out for…

slide-80
SLIDE 80

Visualize responsibly

1 2 3 4 2 4 Bubbles Low-resolution photos

Watch out for…

slide-81
SLIDE 81

Visualize responsibly

1 2 3 4 2 4 Bubbles Stretched photos Low-resolution photos

Watch out for…

slide-82
SLIDE 82

Visualize responsibly

1 2 3 4 2 4 Bubbles Stretched photos Low-resolution photos This funnel thing

Watch out for…

slide-83
SLIDE 83

Think about utilization

slide-84
SLIDE 84

programnet.usaid.gov

Accelerating evaluation use through design

84

slide-85
SLIDE 85

Instead of measuring intermediate results

What if…?

slide-86
SLIDE 86

Instead of measuring intermediate results

What if…?

10 people trained

slide-87
SLIDE 87

Instead of measuring intermediate results We evaluated process

What if…?

10 people trained 7 out of 10

  • n the

Equitable Development Index

slide-88
SLIDE 88

Instead of measuring five metrics

What if…?

slide-89
SLIDE 89

Instead of measuring ___ metrics

What if…?

78 % have WatSan access 22% increase in nutrition 118% decrease in _______ from one institution’s perspective

slide-90
SLIDE 90

Instead of measuring ___ metrics

What if…?

78 % have WatSan access 22% increase in nutrition 118% decrease in _______ We had a framework of success measurement from one institution’s perspective from multiple perspectives

slide-91
SLIDE 91

Instead of measuring ___ metrics

What if…?

78 % have WatSan access 22% increase in nutrition 118% decrease in _______ We had a framework of success measurement

Measurement x y z Beneficiary Donor Staff Partner

Rubric from one institution’s perspective from multiple perspectives

slide-92
SLIDE 92

Instead of Recommendations

What if…?

slide-93
SLIDE 93

Instead of Recommendations Recommendations based on parameters

What if…?

slide-94
SLIDE 94

Recommendations

arranged by change focus

slide-95
SLIDE 95

Recommendations

degree of difficulty with time estimates

2 ppl. 40 hr/wk 8 wks 8 inst. 1,920 hr/wk 200 wks

slide-96
SLIDE 96

Recommendations

change management plan

2 ppl. 40 hr/wk 8 wks 8 inst. 1,920 hr/wk 200 wks Cost ($)

Change Timeline

Activity 1 Activity 2 Activity 3

Estimated benefit Impact

slide-97
SLIDE 97

Evaluation use through visual design

slide-98
SLIDE 98

2 ppl. 40 hr/wk 8 wks 8 inst. 1,920 hr/wk 200 wks Cost ($)

Change Timeline

Activity 1 Activity 2 Activity 3

Estimated benefit Impact

Evaluation use through visual design

slide-99
SLIDE 99

What would a useful evaluation look like to you?

slide-100
SLIDE 100

External Resources

Chartsbin [maps] Coursera [courses] Over 100 resources [tools] Alberto Cairo [tips] Stephanie Evergreen [tips] Visual.ly blog [tips]

slide-101
SLIDE 101

Internal Resources

explorer.devtechlab.com [data, maps] USAID geocenter [data, maps] map.usaid.gov [maps] USAID University [courses] usaid.gov/developer [tools] usaid.gov/results-and-data/data-resources [tools]

slide-102
SLIDE 102

programnet.usaid.gov

Pop Quiz

102

How many in-house designers does USAID have?

  • a. 0
  • b. 2.5
  • c. 5
  • d. 10
  • e. 20
slide-103
SLIDE 103

programnet.usaid.gov

Pop Quiz

103

How many in-house designers does USAID have?

  • b. 2.5
slide-104
SLIDE 104

Tips from the experts

From a conversation with USAID in-house designers

  • 1. Create your concept and message first
  • 2. The graphic comes second
  • 3. Think about the shelf life
slide-105
SLIDE 105

programnet.usaid.gov

Three more ways to increase evaluation use

105

slide-106
SLIDE 106

programnet.usaid.gov

  • 1. Incorporate evaluation into your

knowledge value chain.

106

If evaluations aren’t contributing to the entire knowledge value chain, we’re missing out on gains to our

  • rganizational resilience.
slide-107
SLIDE 107

programnet.usaid.gov

  • 1. Incorporate evaluation into your

knowledge value chain.

107

Plan for this in scoping the evaluation.

slide-108
SLIDE 108

programnet.usaid.gov

  • 2. Use evaluation to create adaptive

management and communication tools.

108

slide-109
SLIDE 109

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

109

slide-110
SLIDE 110

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

110

Performance evaluations

slide-111
SLIDE 111

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

111

Performance evaluations Impact evaluation

slide-112
SLIDE 112

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

112

Performance evaluations Impact evaluation

slide-113
SLIDE 113

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

113

Performance evaluations Impact evaluation Process evaluations

slide-114
SLIDE 114

programnet.usaid.gov

  • 3. Distribute evaluations among the

framework to contribute to learning.

114

Performance evaluations Impact evaluation Process evaluations

?