My Experience with Organizational Capacity Building for Evaluation - - PowerPoint PPT Presentation

▶
my experience with organizational capacity building for
SMART_READER_LITE
LIVE PREVIEW

My Experience with Organizational Capacity Building for Evaluation - - PowerPoint PPT Presentation

Nov 19, 2022 114 likes •377 views

My Experience with Organizational Capacity Building for Evaluation Diane Trunk Los Angeles Center for Law & Justice (LACLJ) Ag Agenda Intro and Background General Info re Evaluation Capacity Building Action Steps for Evaluation

slide-1
SLIDE 1

My Experience with Organizational Capacity Building for Evaluation

Diane Trunk Los Angeles Center for Law & Justice (LACLJ)

slide-2
SLIDE 2

Ag Agenda

  • Intro and Background
  • General Info re Evaluation Capacity Building
  • Action Steps for Evaluation and Insights from our Experience
slide-3
SLIDE 3

Where We Started . . .

Me

  • Lawyer – civil litigation
  • Experience in evaluating one

program at another org

  • Presenter at State Bar and Judicial

Council events re Evaluation

  • New managing attorney
  • What’s a logic model?

LACLJ

  • Legal Aid w/ MSW background
  • Committed to Evaluation in

Strategic Plan

  • Shriver Civil Gideon research

subject

  • “Case, client and time

management” database system meant for for-profit law firms

  • New executive director
  • What is an outcome?
slide-4
SLIDE 4

Collect, Analyze and Interpret Data Use Findings for Decision-making and Action Ask Meaningful Questions

slide-5
SLIDE 5

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-6
SLIDE 6

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-7
SLIDE 7

Who are your Organizational Members?

  • Doubters: see little value in evaluation
  • Proctors: feel that evaluation is best done by other people
  • Practitioners: have and use the level of evaluation skills expected and

needed by the organization

  • Specialists: can teach about and coordinate program evaluations
  • Scholars: develop considerable expertise in evaluation and actively

share their expertise outside their organization

slide-8
SLIDE 8

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-9
SLIDE 9

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-10
SLIDE 10
slide-11
SLIDE 11

Logic Model Summary

Legal & Supportive Services Orders Referrals Safety Plans Cognitive Emotional Social Changes Intrapersonal and Interpersonal Changes Well- Being

slide-12
SLIDE 12

EVIDENCE BASED LEGAL SERVICES MODEL FRAMEWORK

slide-13
SLIDE 13

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-14
SLIDE 14

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-15
SLIDE 15

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-16
SLIDE 16

Ne Needs s slide t title

slide-17
SLIDE 17

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-18
SLIDE 18
  • Specific Data Problems
  • Check boxes vs. drop downs
  • Defaults
  • Text fields vs. lookups
  • Outdated answer options

Look at Your Data Integrity

18

Strategic Data Analytics

slide-19
SLIDE 19

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-20
SLIDE 20

Client has related

  • pen matter

19% Client did not reply to our attempts to contact them 26% Exit completed 53%

Closed Extended Services Matters And Exit Interviews

slide-21
SLIDE 21

Ac Action Steps for Evaluation

  • Determine available organizational resources
  • Create an evaluation workgroup
  • Create a program logic model
  • Develop meaningful evaluation questions
  • Write an evaluation plan
  • Choose appropriate data collection instruments
  • Collect credible and reliable data
  • Analyze the data and draw conclusions
  • Communicate the learning
slide-22
SLIDE 22

0.5 1 1.5 2 2.5 3 3.5 4 4.5

My ability to co-parent My housing situation My financial situation My sense of safety My physical well-being My emotional well-being

Clients Report Improved Satisfaction with Specific Areas

Intake Exit +21% +23% +23% +17%

slide-23
SLIDE 23

5 10 15 20 25 30

Safety Life Skills Mental Health Community Inv Social Relations Health Care Transportation Health/Disability Food Housing Income Employment Job Readiness

ASSM: Average Percent Change in Different Populations

All DV Survivors All Immigrants Undoc

slide-24
SLIDE 24

Re Resources I’ve Found Helpful . . .

  • “You are Already an Evaluator” video by Changing River Consulting

https://www.youtube.com/watch?v=lInjrhc45Dw

  • Jones, Sheri Chaney (2014) Impact & Excellence.
  • Evergreen, Stephanie (2018) Presenting Data Effectively 2nd Ed. (and her blog)
  • The work of Dr. Cris M. Sullivan and https://www.dvevidenceproject.org
  • American Evaluation Association: www.eval.org
  • CDC: https://www.cdc.gov/obesity/downloads/cdc-evaluation-workbook-508.pdf
  • The work of Hallie Preskill – evaluation capacity building expert
slide-25
SLIDE 25