J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive We b - PowerPoint PPT Presentation

J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive We b ina r J-PAL No rth Ame ric a (MIT ) Ja nua ry 23, 2018 p o ve rtya c tio nla b .o rg / sta te a nd lo c a l

Who we a re Julia Cha brie r Me lissa Ke a rne y Corinne We a ve r Se nio r Po lic y Ma na g e r Pro fe sso r o f E c o no mic s Dire c to r o f Re se a rc h & E va lua tio n J-PAL No rth Ame ric a Unive rsity o f Ma ryla nd Ca tho lic Cha ritie s F o rth Wo rth I nitia tive Ma na g e r I nitia tive Co -c ha ir J - PAL | S T 2 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ag e nda I . I ntro duc tio n to J-PAL I I . T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive I I I . Oppo rtunitie s fo r Ra ndo mize d E va lua tio ns I V. Ra ndo mize d E va lua tio n in Pra c tic e V. Ho w to Apply VI . Q&A

Ag e nda I. Intr oduc tion to J- PAL I I . T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive I I I . Oppo rtunitie s fo r Ra ndo mize d E va lua tio ns I V. Ra ndo mize d E va lua tio n in Pra c tic e V. Ho w to Apply VI . Q&A

J-PAL ’ s missio n is to re duc e po ve rty b y e nsuring tha t po lic y is info rme d b y sc ie ntific e vide nc e J - PAL | S T 5 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

J-PAL ’ s ne two rk o f a ffilia te d re se a rc he rs J - PAL | S T 6 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

J-PAL : 870+ o ng o ing a nd c o mple te d pro je c ts in 80 c o untrie s J - PAL | S T 7 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ag e nda I . I ntro duc tio n to J-PAL II. T he J- PAL State and L oc al Innovation Initiative I I I . Oppo rtunitie s fo r Ra ndo mize d E va lua tio ns I V. Ra ndo mize d E va lua tio n in Pra c tic e V. Ho w to Apply VI . Q&A

Go a ls o f the J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive • Build the c a pa c ity o f sta te a nd lo c a l g o ve rnme nts to c re a te a nd use rig o ro us e vide nc e • Sha re this e vide nc e with o the r jurisdic tio ns tha t ma y b e fa c ing simila r c ha lle ng e s • Do c ume nt a nd disse mina te b e st pra c tic e s fo r fe a sib ly imple me nting ra ndo mize d e va lua tio ns a t the sta te a nd lo c a l le ve l J - PAL | S T 9 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Our pa rtne rs K ing Co unty Ro c he ste r Pe nnsylva nia Phila de lphia Ba ltimo re Sa nta Cla ra Co unty So uth Ca ro lina W HA T W E PRO VIDE Ma tc hma king with re se a rc he rs T e c hnic a l a ssista nc e Pue rto Ric o Pro je c t funding J - PAL | S T 10 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ag e nda I . I ntro duc tio n to J-PAL I I . T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive III. Oppor tunitie s for Randomize d E valuations I V. Ra ndo mize d E va lua tio n in Pra c tic e V. Ho w to Apply VI . Q&A

Me tho ds a s to o ls Diffe re nc e - Pre -po st Simple Ra ndo mize d in- Re g re ssio ns Diffe re nc e E va lua tio n Diffe re nc e J - PAL | S T 12 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Wha t is a ra ndo mize d e va lua tio n? Be fo re the pro g ra m sta rts, e lig ib le individua ls a re ra ndo mly a ssig ne d to two g ro ups so tha t the y a re sta tistic a lly ide ntic a l b e fo re the pro g ra m. T he two g ro ups c o ntinue to b e T re a tme nt ide ntic a l, e xc e pt fo r the pro g ra m Any diffe re nc e s in o utc o me s b e twe e n the Co ntro l g ro ups c a n b e a ttrib ute d to the pro g ra m J - PAL | S T 13 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Whe n to c o nside r ra ndo mizing • Whe n yo ur pro g ra m is: – Be ing pilo te d – E xpa nding to a ne w lo c a tio n – Ove rsub sc rib e d – Adding a ne w c o mpo ne nt J - PAL | S T 14 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Whe n do e s a ra ndo mize d e va lua tio n not ma ke se nse ? • T o o sma ll: sa mple size is to o sma ll to de te c t a me a ning ful diffe re nc e s in o utc o me s • T o o e a rly: still iro ning o ut lo g istic s • T o o la te : a lre a dy se rving e ve ryo ne who is e lig ib le , a nd no ra ndo m a ssig nme nt wa s b uilt in • Whe n a po sitive impa c t ha s b e e n pro ve n, a nd we ha ve the re so urc e s to se rve e ve ryo ne J - PAL | S T 15 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ag e nda I . I ntro duc tio n to J-PAL I I . T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive I I I . Oppo rtunitie s fo r Ra ndo mize d E va lua tio ns I V. Ra ndo mize d E va lua tio n in Pra c tic e V. Ho w to Apply VI . Q&A

Sta y the Co urse Me lissa Ke ar ne y Cor inne We ave r Pro fe sso r o f E c o no mic s Dire c to r o f Re se a rc h & E va lua tio n Unive rsity o f Ma ryla nd Ca tho lic Cha ritie s F o rth Wo rth Co -inve stig a to rs: Willia m E va ns, Bre nda n Pe rry, Ja me s X. Sulliva n J - PAL | S T 17 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ne e d fo r re se a rc h a t CCF W • F o c us shifte d fro m se rving tho se in ne e d to e nding po ve rty o ne fa mily a t a time . • Rig o ro us e vide nc e o f wha t wo rks a nd wha t do e sn’ t pro mo te s ste wa rdship. • L e d to b ro a de r fo c us o n q ua lity, e va lua tio n, a nd impa c t. J - PAL | S T 18 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Mo tiva tio n fo r Sta y the Co urse • Co mmunity c o lle g e s o ffe r lo w-inc o me stude nts a c o st-e ffe c tive wa y to a c hie ve hig he r le ve ls o f e duc a tio n a nd pre pa re fo r the de ma nds o f the la b o r ma rke t. • Ho we ve r, the re is a “c o mple tio n c risis” a nd no t c o mple ting a de g re e c a n b e fina nc ia lly c rippling . • Amo ng first time , de g re e -se e king stude nts who e nte re d T a rra nt Co mmunity Co lle g e in 2011, 14.8% e a rne d a de g re e in 4 ye a rs a nd o nly 2.6% g ra dua te d in 2 ye a rs J - PAL | S T 19 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ba rrie rs to g ra dua tio n 1. Co lle g e c o sts 2. Ac a de mic unde r-pre pa ra tio n 3. I nstitutio na l o b sta c le s F e w re so urc e s pe r stude nt • Co mple x syste ms • 4. Pe rso na l, no n-a c a de mic o b sta c le s F ina nc ia l a nd fa mily issue s • Pla nning & time ma na g e me nt • J - PAL | S T 20 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Sta y the Co urse : Co mpre he nsive c a se ma na g e me nt • An inte rve ntio n de sig ne d to pro mo te pe rsiste nc e a nd de g re e c o mple tio n a mo ng lo w-inc o me c o mmunity c o lle g e stude nts • T wo prima ry c o mpo ne nts: – I nte nsive Ca se Ma na g e me nt – E me rg e nc y F ina nc ia l Assista nc e J - PAL | S T 21 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

T he RCT pa rtne rship J - PAL | S T 22 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

E va lua tio n de sig n E nro lle d Sta y the Co urse Did no t e nro ll E lig ib le E nro lle d All T CC T rinity F ina nc ia l Rive r Stude nts Assista nc e No t E lig ib le Did no t e nro ll Co ntro l J - PAL | S T 23 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Administra tive da ta T a rra nt Co mmunity Co lle g e • – E nro llme nt – Co urse c o mple tio n – De g re e s e a rne d (inc luding c e rtific a te s) – De mo g ra phic s – Co urse re sults (e .g ., dro ppe d c la sse s, GPA) Na tio na l Stude nt Cle a ring ho use • – E nro llme nt a nd de g re e s e a rne d a nywhe re J - PAL | S T 24 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Wha t ha ve we le a rne d? Pro mising re sults: • – Pa rtic ipa ting in Sta y the Co urse inc re a se s pe rsiste nc e a nd de g re e c o mple tio n, e spe c ia lly a mo ng wo me n – Ba c k-o f-the -e nve lo pe c a lc ula tio n sug g e sts tha t pro je c te d e a rning s g a ins a re g re a te r tha n pro g ra m c o sts ($5,640 pe r stude nt fo r 3-ye a r pro g ra m) – No e ffe c t o f re c e iving E me rg e nc y F ina nc ia l Assista nc e o nly Ne xt ste ps: • – E xa mine lo ng e r-te rm o utc o me s – Me a sure e ffe c ts o n e a rning s – Sc a le -up a nd re plic a tio n – Apply le a rning s to CCF W’ s wo rk J - PAL | S T 25 AT E AND LO C AL INNO VAT IO N INIT IAT IVE

Ag e nda I . I ntro duc tio n to J-PAL I I . T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive I I I . Oppo rtunitie s fo r Ra ndo mize d E va lua tio ns I V. Ra ndo mize d E va lua tio n in Pra c tic e V. How to Apply VI . Q&A

T he J-PAL Sta te a nd L o c a l I nno va tio n I nitia tive fe a ture s a 2-pha se c o mpe titio n I n Pha se I , sta te a nd lo c a l g o ve rnme nts c a n a pply • fo r: – T e c hnic a l suppo rt – F le xib le pilo t funding o f up to $100,000 – Ma tc hma king with J-PAL ’ s ne two rk o f re se a rc he rs I n Pha se I I , g o ve rnme nts tha t ha ve pa rtne re d with a • re se a rc he r fro m J-PAL ’ s ne two rk c a n a pply fo r a dditio na l funding , in the ra ng e o f $250,000-500,000, to c a rry o ut the e va lua tio ns. J - PAL | S T 27 AT E AND LO C AL INNO VAT IO N INIT IAT IVE