Time Agenda Item 8:00-8:30am Breakfast 8:30-9:00am Introductions - - PowerPoint PPT Presentation

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Collective Impact Funder Community of Practice: In-Person Meeting | September 29, 2016

PREPARED FOR: COLLECTIVE IMPACT FUNDER COMMUNITY OF PRACTICE PARTICIPANTS

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Agenda for Today’s COP Meeting

2

Time Agenda Item

8:00-8:30am Breakfast 8:30-9:00am Introductions and Recap from Last Night 9:00-10:15am Evaluating Collective Impact (part 1) 10:15-10:30am Break 10:30-12:00pm Evaluating Collective Impact (part 2) 12:00-1:15pm Lunch 1:15-2:45pm Peer Assist Workshops 2:45-3:00pm Break 3:00-3:45pm Peer Assist Workshops (continued) 3:45-4:00pm Wrap Up and Next Steps 4:00-4:30pm Meeting Adjourned; Open Time / Networking 4:30-6:00pm Optional Happy Hour: Tavern at the Park, 130 E. Randolph St.

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• I. Introductions and COP Overview
• II. Evaluating Collective Impact
• III. Lunch Peer Discussions
• IV. Peer Assist Workshops
• V. Wrap Up and Next Steps

3

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Warm Up Activity Individually, write down as many types of fish as you can As you introduce yourself, let’s create a list of ALL the types of fish that the group identified

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• Name
• Role
• Organization
• Issue(s) that you are working on in collective impact
• Name a fish that hasn’t been mentioned yet by someone else

Please Introduce Yourself to the Full Group

5

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Goals of the Collective Impact Funder Community of Practice

• Networking and building

relationships with other funders

• f collective impact
• Learning about the strategies

and nuances for funders engaging in collective impact, and how to most effectively engage in and support collective impact

• Improving the practice of

grantmakers as funders and partners in collective impact

6

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Since Mid-2014, the CI Funder COP Has Offered Meetings and Peer Learning Calls on Topics Such as Community Engagement, Equity, Funder Alignment, and Leadership

2014 2015 2016

May 2014: COP launches at first annual CI Funder Convening (Aspen)

• Sept. 2014:

30+ COP participants join first large group learning call

• Jan. 2015:

Small group peer knowledge exchange calls begin

• Nov. 2014:

40 attendees at first in- person COP meeting (Seattle) May 2015: Second annual CI Funder Convening (New Orleans)

• Feb. 2015:

Second in- person COP meeting (DC); 50+

• rgs now in

the COP

• Oct. 2015:

Third in- person COP meeting (Chicago)

• Feb. 2016:

Fourth in- person COP meeting (DC) June 2016: Third annual CI Convening (Seattle)

• Sept. 2016:

Fifth in- person COP meeting (Chicago)

7

An Initiative of FSG and Aspen Institute Forum for Community Solutions

48 Organizations Are Currently Participating in the CI Funder COP

Confirmed Funder COP Participants (as of September 2016)

• Annie E. Casey Foundation
• Aspen Community Foundation
• Bill & Melinda Gates Foundation
• Campbell Soup Company
• Community Memorial Foundation
• First 5 LA
• First 5 Monterey County
• GlaxoSmithKline
• Greater Cincinnati Foundation
• Gulf Coast Community Foundation
• Healthcare Georgia Foundation
• Health Foundation of Central Massachusetts
• Health Foundation of South Florida
• Hunt Alternatives / Demand Abolition
• Institute of Mental Hygiene
• Interact for Health
• Lake Area United Way
• Legacy Foundation
• Lumina Foundation
• Mat-Su Health Foundation
• Michigan College Access Network
• Monterey Peninsula Foundation
• Northside Funders Group
• Ontario Trillium Foundation
• Robert R. McCormick Foundation
• Saint Francis Foundation
• Santa Fe Community Foundation
• SC Ministry Foundation
• Social Venture Partners
• Stuart Foundation
• The Children’s Trust
• The Community Foundation of Herkimer & Oneida

Counties

• The Findlay-Hancock County Community Foundation
• The HCA Foundation
• The Lake County Community Foundation
• The Rider-Pool Foundation
• The Raikes Foundation
• The Seattle Foundation
• The Staten Island Foundation
• The William & Flora Hewlett Foundation
• United Way of Greater Cincinnati
• United Way of Hancock County
• United Way of Northwest Vermont
• United Way of the Greater Lehigh Valley
• United Way of the Greater Triangle
• Venture Philanthropy Partners
• Wisconsin Partnership Program
• Funder COP Organizing Partners: Aspen Forum for

Community Solutions, FSG, GEO, and GFE 8

An Initiative of FSG and Aspen Institute Forum for Community Solutions

COP Participants Are Geographically Diverse, But Also Have Clusters in Places like Chicago, Cincinnati, and Seattle

= Headquarters of CI Funder COP Participant

9

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• I. Introductions and COP Overview
• II. Evaluating Collective Impact
• III. Lunch Peer Discussions
• IV. Peer Assist Workshops
• V. Wrap Up and Next Steps

10

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Evaluating Collective Impact Requires a Mindset Shift for Many Funders and Practitioners

11

Evaluating CI as a Complex Intervention Typical Focus of Program Evaluation Assessing the impact of a specific intervention Evaluating effects and impact according to a predetermined set of outcomes Assessing multiple parts of the system, including its components and connections Evaluating intended and unintended outcomes as they emerge over time Using logic models that imply cause and effect, and linear relationships Evaluating non-linear and non- directional relationships between the intervention and its outcomes Embedding feedback and learning through the evaluation Providing findings at the end of the evaluation

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Evaluating a Collective Impact Effort Involves Looking at Four Aspects of the Work

12

1 2 3

The CI initiative itself The systems targeted by the initiative The initiative’s impact

…the effectiveness of

• The five core elements of collective impact
• The initiative’s capacity
• The initiative’s learning culture

…changes in:

• Individuals’ behavior
• Funding flows
• Cultural norms
• Policies

…changes in:

• Population-level outcomes
• The initiative’s (or community’s)

capacity for problem-solving

4

• Community culture and history
• Demographic and socio-economic conditions
• Political context
• Economic factors

For example…

The initiative’s context

An Initiative of FSG and Aspen Institute Forum for Community Solutions

CI Efforts Should Use Both Shared Measurement and Evaluation to Understand Their Effectiveness and Impact

13

SMS can be both an input to evaluation (by providing data and/or shaping evaluation questions) and an object of evaluation

Evaluation

Shared Measurement Systems (SMS)

Shared measurement systems (SMS) use a common set of indicators to monitor an initiative’s performance and track its progress toward goals Evaluation refers to a range of activities that involve the planned, purposeful, and systematic collection

• f information about the activities,

characteristics, and outcomes of a CI initiative

An Initiative of FSG and Aspen Institute Forum for Community Solutions

The Focus of Evaluation – and the Data Collection Methods Used – Will Evolve Throughout the Life of the Initiative

14

CI partners can use the framework to help focus their evaluation

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Example: Understanding Progress Toward Shifting Funding Flows

15

An assessment of the CI initiative’s Intermediate Outcomes process could focus on changes in systems, such as funding flows or cultural norms

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Example: Understanding Progress Toward Shifting Funding Flows

16

Sample Outcomes Sample Indicators Philanthropic funding in the targeted issue area/system is increasingly aligned with the goals of the CI initiative

 Overall philanthropic funding for the targeted issue

area or system has increased

 New / Existing philanthropic resources are aligned

towards evidence-based strategies in the targeted issue area/system

 Philanthropic funding is increasingly designed to

allow for program innovation and experimentation in the targeted issue area/system Philanthropic and public funders leverage funding for the targeted issue area/system through partnerships and collaborative funding efforts

 Grantmakers participate in funding collaboratives to

leverage resources toward the targeted issue area/system (as relevant)

 Philanthropic and public funders engage in public-

private partnerships to leverage resources toward the targeted issue area/system Learning Question: To what extent, and in what ways are the flows of philanthropic and public funding shifting to support the goals of the CI initiative?

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Embed evaluation in the initiative’s DNA

1

Set reasonable expectations

2

Be thoughtful about your evaluation partners

3

Key Takeaways

17

Evaluating Collective Impact

Collective Impact Funders Community of Practice

Chicago, IL

September 2016

Goals for our time together

19

• 1. Get clear about what we really want to know when we say “evaluating

collective impact.”

• What kind of information are we looking for
• Who is this information important for
• How will we use it
• 2. Understand the methods at our disposal
• Balancing utility, timeliness, and cost
• 3. Preview findings from the Strive Together evaluation and discuss what

these may mean for the Collective Impact movement

How we will accomplish our goals

20

 A bit about Equal Measure and where we are drawing content  Burning questions interactive exercise  Lines of inquiry discussion using case examples  Questions and stages group activity  BREAK  Debrief activity  Evaluation tools overview  Stump the speaker  Strive Together early evidence discussion

21

A bit about Equal Measure

Collective Impact Engagements

22

Instructions for text polling

23

24

What questions do you think would be useful to you at this moment in time?

Who would use this information and how?

Are the five CI conditions present?

27

Is our theory of action real?

28

Is the partnership operating appropriately?

29

What is the value-add of the backbone?

30

Are people working together differently?

31

How is our CI work impacting the community?

32

How are systems shifting to better support…?

33

How are systems shifting to better support OY?

34

How is DEE driving the CI efforts?

35

What is the relationship between our CI efforts and population level outcomes?

37

What questions are you being asked? How do these map to your stage of CI and current information needs?

Right sizing approaches and methods

38

 Be as crystal clear as possible about the LIMITED questions you want to be able to answer  Identify the audiences and timelines for the information  Consider how this information will be used THEN….  Consider level of level sophistication required against budget available  Assess existing evaluation and data collection infrastructure and capacity  Determine the type of evaluation engagement you are willing to support

Tools of the trade

39

• Interviews
• Secondary data collection and codification
• Progress reports
• Partnership management processes
• Self-assessment
• Surveys
• Site visits
• Population level data collection and analysis
• Leading and lagging indicators
• Systems mapping
• Resource flow mapping
• Policy or practice change pre- and post-mortums and implementation tracking

Premium edition evaluation approach

40

Rapid-prototyping + Implementation + Milestones + Systemic/infrastructure + Leading and lagging indicators + Context tracking = ONE HECK OF AN EVALUATION STORY

Paired with built in learning, reflection, and refinement processes that are documented along the way

Aspen OYIF Methods

41

42

Stump the Speaker: What impossible to answer questions do you have for me?

What is the relationship between our CI efforts and population level outcomes?

StriveTogether Evaluation Questions

44

• 1. How, and to what extent, have communities across the

StriveTogether Cradle to Career Network built their civic infrastructure?

• 2. What is the relationship between a community’s civic

infrastructure and community-level outcomes?

• 3. How do partners work together differently to address policy
• r practice changes as a result of their involvement in the

partnership?

• 4. How do changes in civic infrastructure contribute to systemic

changes within a community?

StriveTogether Theory of Action

45

Measuring Civic Infrastructure

46

1 Survey 80 Questions

• Partner Perceptions of Civic Infrastructure
• 5-point scale

16 Communities

• Albany – Albany Promise
• Birmingham – Bold Goals Education
• Bridgeport – Bridgeport StriveTogether

Cradle to Career Collective Impact

• Cincinnati – StrivePartnership
• Dallas – Commit!
• Fresno – Fresno Area Strive
• Milwaukee – Milwaukee Succeeds
• Racine – Higher Expectations
• Red Wing – Every Hand Joined
• Richmond – Bridging Richmond
• Rochester – ROC the Future
• Spartanburg – Spartanburg Academic

Movement

• Tulsa – ImpactTulsa
• Twin Cities – Generation Next
• Washington, D.C. – Raise D.C.
• Winston-Salem – Forsyth Promise

Key Takeaways from the StriveTogether Evaluation

We have a logo and tagline, but no one knows about

• ur work

47

There is an emerging, clear, and consistent sequence of pillar attainment within each Theory of Action gateway. Two years in there is greater development among the earlier stage gateways, aligned with the TOA hypothesis.

Key Takeaways Cont’d

We have a logo and tagline, but no one knows about

• ur work

48

Communities showing increases in later stage gateways, indicate positive shifts in measures of systems change.

Key Takeaways Cont’d

We have a logo and tagline, but no one knows about

• ur work

49

Despite varying developmental stages and partnership maturity, civic infrastructure development appears to follow a similar trajectory. The survey results provide insights into common sticking points and points

• f advancement for sites.

Key Takeaways Cont’d

We have a logo and tagline, but no one knows about

• ur work

50

Despite varying developmental stages and partnership maturity, civic infrastructure development appears to follow a similar trajectory. The survey results provide insights into common sticking points and points

• f advancement for sites.

And the drumroll….

We have a logo and tagline, but no one knows about

• ur work

51

First glance at population level outcome data suggests a connection and momentum between civic infrastructure growth and positive population outcome changes. Communities that saw at least half of the outcome measures trending up year to year also saw an increase in civic infrastructure.

Contact: Meg Long, President mlong@equalmeasure.org 215-732-2200 ext. 222

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• I. Introductions and COP Overview
• II. Evaluating Collective Impact
• III. Lunch Peer Discussions
• IV. Peer Assist Workshops
• V. Wrap Up and Next Steps

54

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Lunch Discussions: There Is No Formal Discussion Agenda; Just an Opportunity for Deeper Peer Relationship Building

55

Select a room for lunch, organized by these issues areas of interest:

We will re-convene as a full group at 1:15pm

Issue Areas of Interest Rooms

• Education & Youth

Lakeview Room (current room)

• Health & Nutrition

Lakeview Room (current room)

• Economic Development

Clubhouse Room

• Other issues (upon request)

Parkview Room

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• I. Introductions and COP Overview
• II. Evaluating Collective Impact
• III. Lunch Peer Discussions
• IV. Peer Assist Workshops
• V. Wrap Up and Next Steps

56

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Peer Assist Workshop: Purpose and Instructions

• Structured process to help participants problem solve, and

assist with, a particular challenge being faced by a colleague Purpose

• Attendees will break into two rooms; each room will hear from

two volunteers (see next slide for discussion topics)

• Peer assist volunteer #1 gives an overview of the problem and

frames the discussion with a specific question (10 min)

• The group asks clarifying questions (5 min)
• The group talks to each other about the dilemma related to the

questions framed by the presenter around the issue. During this time the presenter should listen to the discussion (10 min)

• The presenter responds to what s/he has heard; and the group

discusses it as a whole (15 min)

• Repeat the process a second time, with peer assist volunteer

#2 sharing their question and discussing with their breakout group using the same process (40 min) Instructions

57

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Peer Assist Workshop: Volunteers and Topics

58

Room Volunteer Peer Assist Question / Topic Timing

Lakeview Room (current room)

Ron Dendas, The Rider-Pool Foundation Decision-Making Criteria: As a grant-maker and/or as an active partner, how does a funder go beyond the “Phases of Collective Impact” criteria to determine whether a Collective Impact Initiative is ready for planning and/or implementation grants?

Round 1: 1:20- 2:00pm

Bill Koll and Molly Baltman, McCormick Foundation Community Engagement: How can we support our Chicago CI effort to increase community voice? Should we provide project- specific support for incorporating community voice? If so, what would this look like and does it risk becoming too much of a funder-driven initiative?

Round 2: 2:00- 2:40pm

Board Room

Marc Rittle, United Way of the Greater Lehigh Valley Evaluating the Backbone: How do we best evaluate a backbone function?

Round 1: 1:20- 2:00pm

Caitlin Nossett, The HCA Foundation Capacity Building: How do you build capacity for supporting and aligning collective impact initiatives?

Round 2: 2:00- 2:40pm

Whichever room you choose is the room you stay in for both rounds of peer assists. We will break at 2:45pm and return as a full group at 3pm

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Report Out and Group Discussion on Peer Assist Workshop

• For the peer assist volunteers, what was the experience like

for you? ‒ What were some of the most helpful insights from your funder peers? What are major tips that emerged from your peer assist discussions that you want to share with full group? ‒ What are some unanswered questions that came up in your peer assist discussions that you want to “crowd-source” with the full group?

• For those providing feedback / advice, what are notable

takeaways for you about the conversations?

• What are questions / topics that didn’t come up today that

you’d like to see covered in future COP calls or meetings?

59

An Initiative of FSG and Aspen Institute Forum for Community Solutions

• I. Introductions and COP Overview
• II. Evaluating Collective Impact
• III. Lunch Peer Discussions
• IV. Peer Assist Workshops
• V. Wrap Up and Next Steps

60

An Initiative of FSG and Aspen Institute Forum for Community Solutions

We Will Announce Topics Soon for Upcoming COP Calls and Meetings

November 2016 Large Group Learning Call (Formal COP Call)

• When: November 17, 2016, from 1-2:30pm EST / 10-11:30am PST
• Topic: TBD

February 2017 In-Person Meeting

• When: Feb. 8 (5:30-8:30pm EST, includes dinner) and Feb. 9 (8am-4pm EST,

includes breakfast and lunch, with optional happy hour from 4:30-6pm EST)

• Where: Washington, D.C.

2017 Collective Impact Convening

• When: May 23-25, 2017
• Where: Boston, MA (see next slide for more details)

61

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Hold the Date: 2017 Collective Impact Convening

• n May 23-25 in Boston

62

2017 Collective Impact Convening

Boston | May 23-25, 2017

• Fourth annual national convening for those

who are investing in cross-sector partnerships

• Opportunities for in-depth learning and peer-

exchange with 400+ funders, nonprofit leaders, and other collaborative partners

• One-on-one coaching on building and sustaining

momentum in effective collaboration

• Interactive sessions on community engagement,

equity, evaluation, leadership, and more

Call for session proposals opens in October; registration opens in November

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Collective Impact Research Study

• The Collective Impact Forum will be commissioning a third-party study of the

collective impact approach across the field.

• Purpose: To understand the ways in which collective impact has contributed to

population level outcomes in a sample of mature collective impact efforts across the U.S., working to address a range of issue areas (e.g., education, juvenile justice reform, health, economic development/employment, housing/homelessness, substance abuse, obesity).

• Focus: The study will highlight where and how population level outcomes are being

achieved, challenges and opportunities CI efforts are experiencing, issues of sustainability, and lessons learned regarding the achievement of population level

• utcomes.
• Audiences: 1. Practitioners and supporters engaged in collective impact who seek to

understand lessons that have been learned to date in order to improve their own efforts; 2. Those who are not involved in collective impact but are interested in seeing more evidence that it can be an effective approach to achieving social impact on a variety of social issues.

• Investment Opportunity: We estimate that this robust study will cost $400,000 -

$500,000, and we are in active fundraising mode. If anyone is interested in joining the funding collaborative for the study, please let us know.

An Initiative of FSG and Aspen Institute Forum for Community Solutions

Join Us for an Informal Happy Hour at Tavern at the Park, Which is Two Blocks South of McCormick’s Office

64

Time Agenda Item

8:00-8:30am Breakfast 8:30-9:00am Introductions and Recap from Last Night 9:00-10:15am Evaluating Collective Impact (part 1) 10:15-10:30am Break 10:30-12:00pm Evaluating Collective Impact (part 2) 12:00-1:15pm Lunch 1:15-2:45pm Peer Assist Workshops 2:45-3:00pm Networking Break 3:00-3:45pm Peer Assist Workshops (continued) 3:45-4:00pm Wrap Up and Next Steps 4:00-4:30pm Meeting Adjourned; Open Time / Networking 4:30-6:00pm Optional Happy Hour: Tavern at the Park, 130 E. Randolph St.

An Initiative of FSG and Aspen Institute Forum for Community Solutions

collectiveimpactforum.org

65