Beverly Parsons bparsons@insites.org www.insites.org Basic - - PowerPoint PPT Presentation

▶
beverly parsons bparsons insites org insites org basic
SMART_READER_LITE
LIVE PREVIEW

Beverly Parsons bparsons@insites.org www.insites.org Basic - - PowerPoint PPT Presentation

Oct 11, 2023 47 likes •673 views

Beverly Parsons bparsons@insites.org www.insites.org Basic Definition of a System A system is an interconnected set of elements that is coherently organized in a way that achieves something. Meadows, D. (2008) . Thinking in systems .

slide-1
SLIDE 1

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-2
SLIDE 2

Basic Definition of a System

A system is an interconnected set of elements that is coherently organized in a way that achieves something.

Meadows, D. (2008). Thinking in systems. White River Junction, VT: Chelsea Green Publishing Company.

slide-3
SLIDE 3

3

Key Message

Systems-Oriented Evaluation:

Beverly Parsons • bparsons@insites.org • www.insites.org

From Afterthought to Forethought

slide-4
SLIDE 4

4

Our Changing World Social Systems

Then: Stable, limited connections Now: Complex, connected, dynamic

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-5
SLIDE 5

5

Our Changing World System Interventions

Then: Individual programs, policies Now: Multi-faceted,

  • verlapping, dynamic

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-6
SLIDE 6

6

Our Changing World Evaluation Approach

Then: Formative and Summative Now: Developmental with Nested Formative and Summative

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-7
SLIDE 7

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-8
SLIDE 8

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-9
SLIDE 9

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-10
SLIDE 10

10

Evaluate results

Beverly Parsons • bparsons@insites.org • www.insites.org

Implement plan Develop action plan Establish goals

Traditional Strategy Approach

slide-11
SLIDE 11

Adaptive STRATEGY Developmental EVALUATION

Beverly Parsons • bparsons@insites.org • www.insites.org

Evaluation and Strategy Repositioned and Redesigned

slide-12
SLIDE 12

12

Developing an Evaluation Framework

Step 1. Articulate Fundamental System Change Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with System Change Step 4. Identify Indicators of System Benefit

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-13
SLIDE 13

Points of Systemic Influence

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

_________________________ (initiative)

(Community: formal)

____________________ (Initiative)

Framework for Systems-Oriented Evaluation

(Learning & Capacity Building) (Societal—City, state, national) (Networks/ Partnerships)

Trying Out Interventions

(Community: informal) (Individual/ relationship)

bparsons@insites.org • www.insites.org
slide-14
SLIDE 14

14

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation

Value of the Evaluation Framework

slide-15
SLIDE 15

15

Beverly Parsons • bparsons@insites.org • www.insites.org

See the big picture Link strategy and evaluation

Value of the Evaluation Framework

slide-16
SLIDE 16

16

Beverly Parsons • bparsons@insites.org • www.insites.org

Map actions among partners See the big picture Link strategy and evaluation

Value of the Evaluation Framework

slide-17
SLIDE 17

17

Beverly Parsons • bparsons@insites.org • www.insites.org

Map actions among partners See the big picture Link strategy and evaluation

Value of the Evaluation Framework

Be transparent

slide-18
SLIDE 18

18

Map progress

  • ver time

Beverly Parsons • bparsons@insites.org • www.insites.org

Map actions among partners See the big picture Link strategy and evaluation

Value of the Evaluation Framework

Be transparent

slide-19
SLIDE 19

19

Articulate Desired System Change

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-20
SLIDE 20

Children’s Social/Emotiona l Competence

Concrete Support in Times of Need

Center for the Study of Social Policy (www.cssp.org)

slide-21
SLIDE 21

Adams Arapahoe Jefferson Denver

slide-22
SLIDE 22
slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25

25

Identify Points of Systemic Influence First: Identify Relevant Domains

  • f the Social Ecology

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-26
SLIDE 26

26

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-27
SLIDE 27

27

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-28
SLIDE 28

28

Identify Points of Systemic Influence First: Identify Relevant Domains

  • f the Social Ecology

Beverly Parsons • bparsons@insites.org • www.insites.org

Second: Identify Potential Levers for Change

slide-29
SLIDE 29

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-30
SLIDE 30

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-31
SLIDE 31

Theory of Change in Complex Systems

_________________________ (initiative)

bparsons@insites.org • www.insites.org

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

(Norms, infrastructures, policy)

Caregiver- Child-Family

Strengthening Families Initiative

Framework for Systems-Oriented Evaluation

Neighborhood/ Community Stakeholder Learning & Capacity Building Organizations, Providers

(State & national) (Norms, policies, infrastructures)

Societal Actors Networks/ Partnerships

Trying Out Interventions

Points

  • f Systemic

Influence

slide-32
SLIDE 32

Identify Actors within the Domains of Social Ecology

Syste

slide-33
SLIDE 33

Identify Actors within the Domains of Social Ecology

Syste

slide-34
SLIDE 34

Points of Systemic Influence

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

Theory of Change in Complex Systems

_________________________ (initiative)

(Community: formal)

____________________ (Initiative)

Framework for Systems-Oriented Evaluation

(Learning & Capacity Building) (Networks/ Partnerships)

Trying Out Interventions

(Community: informal) (Individual/ relationship)

bparsons@insites.org • www.insites.org

(Societal—City, state, national)

slide-35
SLIDE 35

35

Developing an Evaluation Framework

Step 1. Articulate Fundamental System Change Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with System Change

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-36
SLIDE 36

Beverly Parsons • bparsons@insites.org • www.insites.org

Weave strategy & evaluation with system change over time

slide-37
SLIDE 37

Beverly Parsons • bparsons@insites.org • www.insites.org

Assessing Where We Are in relation to our vision

slide-38
SLIDE 38

Beverly Parsons • bparsons@insites.org • www.insites.org

Trying Out Interventions within & across system domains, dimensions, and across time

slide-39
SLIDE 39

Beverly Parsons • bparsons@insites.org • www.insites.org

Reaching a Tipping Point: Activities are clearer, scaled up, and crossing more parts of the system

slide-40
SLIDE 40

Beverly Parsons • bparsons@insites.org • www.insites.org

Sustainable Adaptive Balancing: We are here, new things happen, system changes, and we are able to adapt

slide-41
SLIDE 41

Beverly Parsons • bparsons@insites.org • www.insites.org

Eventually the cycle begins again with a new paradigm shift.

slide-42
SLIDE 42

Beverly Parsons • bparsons@insites.org • www.insites.org

Weave strategy & evaluation with system change over time

slide-43
SLIDE 43

Points of Systemic Influence

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

Theory of Change in Complex Systems

_________________________ (initiative)

(Community: formal)

____________________ (Initiative)

Framework for Systems-Oriented Evaluation

(Learning & Capacity Building) (Networks/ Partnerships)

Trying Out Interventions

(Community: informal) (Individual/ relationship)

bparsons@insites.org • www.insites.org

(Societal—City, state, national)

slide-44
SLIDE 44

44

Developing an Evaluation Framework

Step 1. Articulate Fundamental System Change Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with System Change Step 4. Identify Indicators of System Benefit

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-45
SLIDE 45

Theory of Change in Complex Systems

_________________________ (initiative)

bparsons@insites.org • www.insites.org

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

(Norms, infrastructures, policy)

Caregiver- Child-Family

Strengthening Families Initiative

Framework for Systems-Oriented Evaluation

Neighborhood/ Community Stakeholder Learning & Capacity Building Organizations, Providers

(State & national) (Norms, policies, infrastructures)

Societal Actors Networks/ Partnerships

Trying Out Interventions

Points

  • f Systemic

Influence

slide-46
SLIDE 46

46

Beverly Parsons • bparsons@insites.org • www.insites.org

Who: Leadership Team Evaluator Stakeholders

Process for Developing an Evaluation Framework

When: Near beginning Review, revise, adapt

slide-47
SLIDE 47

Theory of Change in Complex Systems

_________________________ (initiative)

  • Baseline Understanding

To what extent:

Caregiver- Child-Family

A r e f a m i l i e s a w a r e

  • f

a n d p r a c t i c i n g p r

  • t

e c t i v e f a c t

  • r

s ? D

  • p

a r e n t s u s e b

  • t

h

  • r

g a n i z e d a n d a d a p t i v e d y n a m i c s ?

Strengthening Families Example

F ramework of Social Innovat ion S t rategy and E

Trying Out Interventions

Families test use of protective factors and determine changes in relationships and boundaries in daily life. Families learn to self- assess use of protective factors. ties pilot

Points

  • f Systemic

Influence

Step 1 S t e p

3

Framework for Social Innovation Evaluation

Strengthening Families Innovation

Framework for Systems-Oriented Evaluation

Initiative

slide-48
SLIDE 48
  • Tipping Point

Sustainable Adaptive Balancing

d E valuat ion in Complex Social Systems

Enough families are habitually using and building protective factors that family norms are shifting in support of protective factors framework for living. Benefits being realized. Caregivers are connected with other caregivers and family members who are skilled at using and build- ing protective factors. Family norms support protec- tive factors. (Evidence of well-being of families and levels of child maltreatment regularly monitored.) mit to use

slide-49
SLIDE 49

49

Identify Indicators of System Benefit

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-50
SLIDE 50

50

Identify Indicators of System Benefit

Immediate:

the benefit of the activities and interactions in the community of practice

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-51
SLIDE 51

51

Identify Indicators of System Benefit

Potential:

knowledge capital that is produced but not necessarily used in the immediate situation

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-52
SLIDE 52

52

Identify Indicators of System Benefit

Applied:

adapting and applying knowledge in different contexts

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-53
SLIDE 53

53

Identify Indicators of System Benefit

Realized:

application that leads to improvement in performance

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-54
SLIDE 54

54

Identify Indicators of System Benefit

Reframing:

reconsideration/redefining of perspectives, processes and/or structures

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-55
SLIDE 55

55

Identify Indicators of System Benefit

Reframing:

reconsideration/redefining of perspectives, processes and/or structures

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-56
SLIDE 56

Theory of Change in Complex Systems

_________________________ (initiative)

bparsons@insites.org • www.insites.org

Baseline Understanding To what extent: Tipping Point Sustainable Adaptive Balancing

(Norms, infrastructures, policy)

Caregiver- Child-Family

Strengthening Families Initiative

Framework for Systems-Oriented Evaluation

Neighborhood/ Community Stakeholder Learning & Capacity Building Organizations, Providers

(State & national) (Norms, policies, infrastructures)

Societal Actors Networks/ Partnerships

Trying Out Interventions

Points

  • f Systemic

Influence

slide-57
SLIDE 57

57

Developing an Evaluation Framework

Step 1. Articulate Fundamental System Change Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with System Change Step 4. Identify Indicators of System Benefit

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-58
SLIDE 58

58

Map progress

  • ver time

Beverly Parsons • bparsons@insites.org • www.insites.org

Map actions among partners See the big picture Link strategy and evaluation

Value of the Evaluation Framework

Be transparent

slide-59
SLIDE 59

59

Questions & Answers

?

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-60
SLIDE 60

60

bparsons@insites.org www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

slide-61
SLIDE 61
slide-62
SLIDE 62