Orient ntatio ion W Webina inar Fri riday, No November 1 r 17 - - PowerPoint PPT Presentation

Orient ntatio ion W Webina inar Fri riday, No November 1 r 17 2: 2:00 00-3: 3:30 E 30 EDT

1

2

3

HISTORY OF COLLABORATION

T he issue o f c o o rdina tio n a c ro ss syste ms to se rve disa dva nta g e d yo uth ha s b e e n the fo c us o f b i- pa rtisa n a nd fe de ra l a tte ntio n fo r de c a de s:

• Co o rdina ting Co unc il o n Juve nile Justic e a nd

De linq ue nc y Pre ve ntio n

• White Ho use T

a sk F

• rc e fo r Disa dva nta g e d

Yo uth

• Sha re d Yo uth Visio n
• I

nte ra g e nc y Wo rking Gro up o n Yo uth Pro g ra ms

• My Bro the rs K

e e pe r

4

CONSOLIDATED APPROPRIATIONS ACT OF 2014

Allo ws fo r the de ve lo pme nt o f P3 Pilo t site s using funds re c e ive d fro m multiple F e de ra l stre a ms while me a suring a nd tra c king spe c ific c ro ss-pro g ra m o utc o me s:

• po o ling o f disc re tio na ry funds
• re g ula to ry wa ive rs fo r no n ma nda to ry

pro g ra m rule s

5

• ve rc o me pro g ra m silo s a nd fra g me nte d syste ms

to use e xisting re so urc e s

• to he lp disc o nne c te d yo uth impro ve in the a re a s o f

e duc a tio n, e mplo yme nt, a nd o the r ke y a re a s tha t he lp de ve lo p pro te c tive fa c to rs.

• I

ndividua ls b e twe e n the a g e s o f 14 a nd 24

• Me e t lo w-inc o me e lig ib ility
• E

ithe r ho me le ss, in fo ste r c a re , invo lve d in the juve nile justic e syste m

• Une mplo ye d, o r no t e nro lle d in o r a t risk o f dro pping o ut o f a n

e duc a tio na l institutio n.

6

PROGRAM GOALS

FEDERAL PARTNERS

7

• De pa rtme nt o f E

duc a tio n (L e a d Ag e nc y)

• De pa rtme nts o f L

a b o r

• De pa rtme nt o f He a lth a nd Huma n Se rvic e s
• Co rpo ra tio n fo r Na tio na l a nd Co mmunity

Se rvic e

• De pa rtme nt o f Justic e
• De pa rtme nt o f Ho using a nd Urb a n

De ve lo pme nt

• I

nstitute o f Muse um a nd L ib ra ry Sc ie nc e s

PILOT SITES

• Co ho rt I

L

• s Ang e le s City | Bro wa rd Co unty | Chic a g o

| I ndia na po lis | E a ste rn K e ntuc ky | Ba to n Ro ug e | Okla ho ma | Ysle ta de l Sur Pue b lo | Se a ttle

• Co ho rt I

I Ma ric o pa Co unty

• Co ho rt I

I I Ne w Yo rk Sta te | Sa c ra me nto | L

• s Ang e le s

Co unty | Ne w Yo rk City | Ha rtfo rd | Sa ndo va l Co unty

8

PROGRAM DATA

9

Pa rtic ipa nt da ta a re c a pture d two wa ys:

• E

va lua tio n a nd Da ta Sha ring Ag re e me nts

• Qua rte rly Re po rting E

D 524B - De mo g ra phic Da ta Supple me nt Pa rtic ipa nt da ta a re use d:

• Sha re o ur sto ry with sta ke ho lde rs
• I

de ntify g a ps in se rvic e s o r a re a s o f ne e d

• Hig hlig ht suc c e sse s

DATA AT A GLANCE*

10

45% 53% 0% 2%

Gender

Male Female Other Unknown

*Q1 data. For point of reference only. Not all grantees data included.

DATA AT A GLANCE*

11

12

13

FEDERAL PARTNER AGENCIES

• Lead A

Admini nist stering ng A Agency (U.S. . Department nt o

• f Educ

ucation

• n)
• Manage pilot selection process
• Monitor expenditure of “start-up” grant funds by pilots
• Collect performance reports and disseminate them to Federal agencies
• Coordinate technical assistance contract (Jobs for the Future)
• Lead

ead Agen gency f for E r Eval aluation (U. U.S. De Department o

• f L

Labor)

• Manage the national evaluation of P3
• Provide technical assistance to pilots on evaluation-related issues
• Consul

nsulting ng A Agency

• Lead monitoring of the pilot and serve as principal point of contact
• Seek to resolve implementation challenges
• Pa

Parti ticipatin ating A Agency

• Assist with monitoring pilot performance
• Inform the Consulting Agency of issues and concerns involving its programs

14

P3 ROUND 3 AGENCY ROLES

Pil Pilot Consult lting Agency ncy Partici icipat atin ing Agency ncy Hartford Labor Health & Human Services Los Angeles County Labor

• New York City

Health & Human Services Labor New York State Education Department Education Justice Sacramento Health & Human Services Labor

15

Tara S ara Smit mith Job

• bs for
• r the

he F Fut uture ure ts tsmit mith@jf h@jff.org rg

16

TECHNICAL ASSISTANCE TEAM

17

TECHNICAL ASSISTANCE ACTIVITIES

Targeted, str trategic tech chnical assis istance wil will be de develope

• ped

based d on

• n th

the ne needs and nd pr priorities of

• f th

the P3 3 grantees.

18

As Assigned T TA A Coa

• ach a

and nd regu regula larly ly sc sched heduled led coa coaching ca calls Peer E Exch change Netwo work (PEN) PEN) m mee eetings gs Peer sharing calls with

• ther Round 2/3 P3

grantees Peer learning calls with Round 1 P3 grantees Webinars Affinity Groups and Communities of Practice

TOOLS FOR COMMUNITY-BASED INITIATIVES

19

Resources developed by the TA Team to support community-based initiatives Available at: http://www.jff.org/initiatives/place-based-initiatives-and- performance-partnership-pilots/tools

FISCAL MAPPING FOR COMMUNITY-BASED INITIATIVES

Fis Fiscal al m mapp appin ing t technic ical al assist assistan ance inclu ncludes:

• Fisca

cal l mapp appin ing t tool

• ol an

and g guid ide memo

• (avail

ailable at at: : http:/ ://www www.jff.org/ g/initiati tives/pla lace-based ed- in init itiat iativ ives-an and-per performa mance-par artnershi ship- pil pilots/ s/fisc iscal-ma mappi pping-tool

• ol)
• Webi

bina nar r seri ries a and nd r resource ces for co r communi nities gettin ing st star arted wit ith fisc iscal mapp appin ing

• Subj

bject ct mat atter expert sit site visit isits s (se select com

• mmunit

itie ies) s)

20

RESOURCES TO SUPPORT COMMUNITY-BASED INITIATIVES

• Yout
• uth.

h.Go Gov: https: ps://youth.gov/

• JFF

FF Webpages on the

• n the PBI

PBI & P3 P3 I Initiativ nitiative: http http:// //ww www.jff.org/initiat initiativ ives/p /place-ba based- initiativ initiatives-and and-perform rmanc nce-par artne nership ip-pi pilo lots

• Forum for Y

Youth I Invest estmen ent’s W s Web ebsite: e: http://f /foru rumfyi fyi.org rg/

21

22

NATIONAL EVALUATION CONTACTS

• Christina Yancey, Project Officer
• U.S. Department of Labor, Chief Evaluation Office
• Yancey.Christina.L@dol.gov
• Linda Rosenberg, Project Director
• Mathematica Policy Research
• LRosenberg@mathematica-mpr.com
• Cay Bradley, Evaluation Technical Assistance Lead
• Mathematica Policy Research
• CBradley@mathematica-mpr.com

Study overview: https://www.dol.gov/asp/evaluation/currentstudies/Performance_Partnership_Pilot s_for_Disconnected_Youth_National_Evaluation.htm 23

WHAT IS THE NATIONAL EVALUATION OF P3?

• Overall objective is to fully document the P3 effort. Further, based on the results

from local evaluations at each of the nine cohort 1 pilots, the study will highlight effective and promising practices for achieving employment-related outcomes for youth.

• Four main components
• Implementation and systems study (all pilots)
• Evaluation technical assistance (all pilots with local evaluations)
• Pilot data reporting (cohort 1)
• Synthesis of local P3 pilot evaluations (cohort 1)

24

SOCIAL POLICY RESEARCH ASSOCIATES

IMPLEMENTATION AND SYSTEMS STUDY

• Objectives
• Learn how individual pilots are using their granted flexibilities to improve the
• utcomes of disconnected youth
• Examine how flexibilities enhance community partnerships and systems
• Identify lessons and promising areas for building on the P3 approach
• Data collected through a site visit to each Cohort 2/3 pilot
• Interviews with program administrators and staff
• Interviews with partner administrators and staff
• Short survey of partner administrators
• Group discussions with P3 participants
• In 2018, evaluation team member will contact pilots to discuss plans for the visit

25

EVALUATION TECHNICAL ASSISTANCE: AN IMPORTANT RESOURCE FOR PILOTS

• Objectives of evaluation technical assistance (eval TA)
• To support P3 pilots’ local evaluations
• To develop evidence of successful models that meet research clearinghouse

standards

• For pilots with local evaluations, including:
• Experimental and quasi-experimental studies
• Implementation studies
• Key eval TA staff:
• Cay Bradley, cbradley@mathematica-mpr.com
• Diana McCallum, dmccallum@mathematica-mpr.com

26

EVAL TA: KEY ACTIVITIES FOR PILOTS WITH A LOCAL EVALUATION

• Prepare a logic model
• Summarize the evaluation design in either:
• An implementation evaluation plan (no comparison group)
• An impact evaluation plan (comparison or control group)
• Discuss evaluation plan with eval TA liaison(s) and revise as needed
• Meet with eval TA liaison(s) to discuss evaluation as it begins and as needed
• Raise questions, problems, or concerns with eval TA liaisons

27

EVAL TA: NEXT STEPS FOR PILOTS WITH A LOCAL EVALUATION

• Join an initial call of the pilot project director and local evaluator, consulting agency

staff, eval TA liaison, and JFF programmatic coach

• Purpose: to discuss intervention (program), timing of programming, and

evaluation plans

• Prepare logic model to document the program
• Purpose: to articulate how program is expected to change youths’ outcomes
• Webinar on logic models was presented in October (Recording is available at:

https://youtu.be/celN4uY-PvQ.)

• TA available as part of early calls
• Join Eval TA Webinar on the evaluation plan
• Purpose: to walk through template, expectations, and timing
• Date: TBD but after logic model calls

28

RECAP: P3’S MULTIPLE RESOURCES AND CONTACTS

• Federal team
• Lead administering agency (Education)
• Consulting agency (Education, Health & Human Services, or Labor)
• Participating agency (Health & Human Services, Justice, or Labor)
• Programmatic technical assistance
• Jobs for the Future
• The Forum for Youth Investment
• Performance Excellence Partners
• National evaluation and evaluation technical assistance
• Mathematica Policy Research
• Social Policy Research Associates

29

30