The Impacts of a Home Visitation and The Impacts of a Home - - PowerPoint PPT Presentation

▶
the impacts of a home visitation and the impacts of a
SMART_READER_LITE
LIVE PREVIEW

The Impacts of a Home Visitation and The Impacts of a Home - - PowerPoint PPT Presentation

Aug 30, 2023 372 likes •601 views

The Impacts of a Home Visitation and The Impacts of a Home Visitation and Life Skills Education Program for Life Skills Education Program for Hard-to-Employ TANF Recipients Hard-to-Employ TANF Recipients Findings from the Rural Welfare-to-Work

slide-1
SLIDE 1

The Impacts of a Home Visitation and Life Skills Education Program for Hard-to-Employ TANF Recipients

Findings from the Rural Welfare-to-Work Evaluation

The Impacts of a Home Visitation and Life Skills Education Program for Hard-to-Employ TANF Recipients

Findings from the Rural Welfare-to-Work Evaluation

Alicia Meckstroth Andrew Burwick Quinn Moore APPAM Research Conference November 3, 2006 Alicia Meckstroth Andrew Burwick Quinn Moore APPAM Research Conference November 3, 2006

slide-2
SLIDE 2

Rural WtW Evaluation: Purpose and Background Rural WtW Evaluation: Purpose and Background

! Build knowledge base about programs designed

to address challenges in rural areas

! Evaluate programs using random assignment

  • Nebraska – home visitation & life skills education
  • Illinois – employment-focused case management

! Build knowledge base about programs designed

to address challenges in rural areas

! Evaluate programs using random assignment

  • Nebraska – home visitation & life skills education
  • Illinois – employment-focused case management

NOT FOR CITATION 2

slide-3
SLIDE 3

Building Nebraska Families (BNF) Building Nebraska Families (BNF)

! Individualized life skills education and mentoring

via home visits (in addition to regular TANF program)

! Hard-to-employ TANF recipients

(most disadvantaged 1/3 of nonexempt caseload)

! University extension and state welfare agency ! Masters’ level educators with very small caseloads ! 11 service areas throughout Nebraska ! Individualized life skills education and mentoring

via home visits (in addition to regular TANF program)

! Hard-to-employ TANF recipients

(most disadvantaged 1/3 of nonexempt caseload)

! University extension and state welfare agency ! Masters’ level educators with very small caseloads ! 11 service areas throughout Nebraska

3 NOT FOR CITATION

slide-4
SLIDE 4

BNF Curriculum “Survive, Strive, Thrive” BNF Curriculum “Survive, Strive, Thrive”

! Curriculum addresses a range of topics ! Educators work with participants to develop an

individualized learning plan

! Curriculum addresses a range of topics ! Educators work with participants to develop an

individualized learning plan

4 NOT FOR CITATION

  • Goal setting
  • Strong families
  • Making good decisions
  • Building healthy

relationships

  • Building self-esteem
  • Money management
  • Creating a healthy home
  • Communication skills
  • Stress management
  • Time management
  • Developing good character
  • Positive parenting
  • Child development
  • Nutrition skills
  • Anger/conflict management
slide-5
SLIDE 5

Nebraska Policy Context Nebraska Policy Context

! Supportive, work-oriented TANF program ! Targeted education and training ! Two-year time limit ! Various services available in target areas ! Supportive, work-oriented TANF program ! Targeted education and training ! Two-year time limit ! Various services available in target areas

5 NOT FOR CITATION

slide-6
SLIDE 6

Research Questions Research Questions

! Program implementation? ! Effects on employment, earnings, welfare

dependence, and well-being?

! Implications and lessons? ! Program implementation? ! Effects on employment, earnings, welfare

dependence, and well-being?

! Implications and lessons?

6 NOT FOR CITATION

slide-7
SLIDE 7

Evaluation Methods Evaluation Methods

! Experimental design (358 Ts, 242 Cs) ! 18-month follow-up telephone survey

(87 percent completion rate)

! Administrative records ! Program service use and participation data ! Site visits and focus groups ! Experimental design (358 Ts, 242 Cs) ! 18-month follow-up telephone survey

(87 percent completion rate)

! Administrative records ! Program service use and participation data ! Site visits and focus groups

7 NOT FOR CITATION

slide-8
SLIDE 8

Client Experiences in BNF Client Experiences in BNF

! Individualized education focused most on:

– Parenting and relationships – Personal and family management skills – Goal-setting, problem-solving, decision-making

! Participation over 8 months, on average ! 19 teaching contacts, 3 service coordination

contacts, 25 hours total time, on average

! About 8 in 10 clients received 5 or more contacts ! Individualized education focused most on:

– Parenting and relationships – Personal and family management skills – Goal-setting, problem-solving, decision-making

! Participation over 8 months, on average ! 19 teaching contacts, 3 service coordination

contacts, 25 hours total time, on average

! About 8 in 10 clients received 5 or more contacts

8 NOT FOR CITATION

slide-9
SLIDE 9

Well-Implemented Program Well-Implemented Program

! Strong, well-tested partnership ! Effective leadership and ongoing staff

development

! Active use of performance management tools ! Improvements to curriculum and service

delivery

! Strong, well-tested partnership ! Effective leadership and ongoing staff

development

! Active use of performance management tools ! Improvements to curriculum and service

delivery

9 NOT FOR CITATION

slide-10
SLIDE 10

64** 55 48** 39 42** 33 24** 16 14** 8 10 20 30 40 50 60 70 Program Group Control Group

Percentage

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

More Program Group Members Received Skill-Building Services, Mentoring, & Advocacy More Program Group Members Received Skill-Building Services, Mentoring, & Advocacy

Training

  • n Life

Management Skills Formal Education or Vocational Training Any Mentoring or Informal Counseling Help Finding Housing Mediation

10 NOT FOR CITATION

slide-11
SLIDE 11

10 20 30 40 50 60 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Control Group Program Group

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

Some Evidence that BNF Improved Employment Status Some Evidence that BNF Improved Employment Status

** ***

Percentage Who Were Employed in Month

Program Group Control Group

11 NOT FOR CITATION

slide-12
SLIDE 12

$0 $100 $200 $300 $400 $500 $600 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Control Group Program Group

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

Some Evidence that BNF Improved Earnings Some Evidence that BNF Improved Earnings

** **

Average Earnings per Month

Program Group Control Group

12 NOT FOR CITATION

slide-13
SLIDE 13

Number of Hours Worked Explains Earnings Gains Number of Hours Worked Explains Earnings Gains

! No significant difference in wages earned ! Program group members more likely to

work in full-time jobs

! No significant difference in wages earned ! Program group members more likely to

work in full-time jobs

13 NOT FOR CITATION

slide-14
SLIDE 14

No Evidence that BNF Improved Quality of Life No Evidence that BNF Improved Quality of Life

! BNF did not reduce welfare dependence

  • r poverty

! Program group members more likely to

experience some hardships

! BNF did not reduce welfare dependence

  • r poverty

! Program group members more likely to

experience some hardships

slide-15
SLIDE 15

Impacts on Employment and Earnings More Pronounced for Subgroups Impacts on Employment and Earnings More Pronounced for Subgroups

! Sample members during BNF’s 2nd year

(stronger program implementation)

! Sample members who were very

disadvantaged or “very hard-to-employ”

! Sample members during BNF’s 2nd year

(stronger program implementation)

! Sample members who were very

disadvantaged or “very hard-to-employ”

slide-16
SLIDE 16

Definition of “Very Hard-to-Employ” Definition of “Very Hard-to-Employ”

! Met 2 or more of these criteria at baseline:

  • Lack of high school credential
  • Health-limiting condition (self or HH member)
  • Transportation barrier (no driver’s license or

regular access to vehicle)

  • No earnings in prior year
  • Received TANF/AFDC for 2+ years in lifetime

! 43 percent were very hard-to-employ ! Met 2 or more of these criteria at baseline:

  • Lack of high school credential
  • Health-limiting condition (self or HH member)
  • Transportation barrier (no driver’s license or

regular access to vehicle)

  • No earnings in prior year
  • Received TANF/AFDC for 2+ years in lifetime

! 43 percent were very hard-to-employ

slide-17
SLIDE 17

10 20 30 40 50 60 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Control Group Program Group

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

BNF Improved Employment for the Very Hard-to-Employ BNF Improved Employment for the Very Hard-to-Employ

* **

Percentage Who Were Employed in Month

Program Group Control Group

17 NOT FOR CITATION

* ** *

slide-18
SLIDE 18

$0 $100 $200 $300 $400 $500 $600 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Control Group Program Group

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

BNF Substantially Increased Earnings for the Very Hard-to-Employ BNF Substantially Increased Earnings for the Very Hard-to-Employ

** ***

Average Earnings per Month

Program Group Control Group

* * ** * ** ** 18 NOT FOR CITATION

slide-19
SLIDE 19

SOURCE: Rural Welfare-to-Work Evaluation's 18-Month Follow-up Survey of BNF sample members. NOTE: The estimates were adjusted using multivariate regression methods and the data were weighted to account for survey nonresponse and to equalize the size of the program and control groups. */**/***Significantly different from zero at the .10/.05/.01 level, two-tailed test.

BNF Reduced Welfare Dependence Among the Very Hard-to-Employ BNF Reduced Welfare Dependence Among the Very Hard-to-Employ

19 NOT FOR CITATION

43*** 59 77* 85 66 72 20 40 60 80 100

Program Group Control Group

Percentage Received TANF at Any Time During Months 13-18 Received Food Stamps at Any Time During Months 13-18 Living in Poverty at 18-Month Follow-Up

slide-20
SLIDE 20

What Might Explain BNF’s Short-Term Impacts? What Might Explain BNF’s Short-Term Impacts?

! Fills a gap in available services ! Home visitation allows for individualized support ! Well-developed life skills curriculum ! Highly-qualified, professional staff ! Low caseloads ! Fills a gap in available services ! Home visitation allows for individualized support ! Well-developed life skills curriculum ! Highly-qualified, professional staff ! Low caseloads

20 NOT FOR CITATION

slide-21
SLIDE 21

What Are Possible Implications? What Are Possible Implications?

! BNF appears most useful for the most disadvantaged

TANF recipients

! BNF experiences may help inform other states’ plans

for intensive services

! Not tested in urban areas, but may transfer over well ! Unclear whether impacts will persist:

Stay tuned for 30-month findings (Summer 2007)

! BNF appears most useful for the most disadvantaged

TANF recipients

! BNF experiences may help inform other states’ plans

for intensive services

! Not tested in urban areas, but may transfer over well ! Unclear whether impacts will persist:

Stay tuned for 30-month findings (Summer 2007)

21 NOT FOR CITATION

slide-22
SLIDE 22

Rural Welfare-to-Work Strategies Demonstration Evaluation Rural Welfare-to-Work Strategies Demonstration Evaluation

For more information:

! Mathematica Policy Research

Alicia Meckstroth, (609) 275-2338, almeckstroth@mathematica-mpr.com Previous evaluation reports available at www.mathematica-mpr.com

! U.S. DHHS, ACF

Michael Dubinsky, (202) 401-3442, midubinsky@acf.hhs.gov Karl Koerper, (202) 401-4535, kkoerper@acf.hhs.gov

! University of Nebraska Cooperative Extension

Marilyn Fox, (308) 385-5088, mfox@unlnotes.unl.edu

For more information:

! Mathematica Policy Research

Alicia Meckstroth, (609) 275-2338, almeckstroth@mathematica-mpr.com Previous evaluation reports available at www.mathematica-mpr.com

! U.S. DHHS, ACF

Michael Dubinsky, (202) 401-3442, midubinsky@acf.hhs.gov Karl Koerper, (202) 401-4535, kkoerper@acf.hhs.gov

! University of Nebraska Cooperative Extension

Marilyn Fox, (308) 385-5088, mfox@unlnotes.unl.edu

22