Dashboard Review End of FY 2014 Joe Selby , MD, MPH Executive - PowerPoint PPT Presentation

Dashboard Review End of FY 2014 Joe Selby , MD, MPH Executive Director * As presented during the PCORI Board of Governors meeting on December 8, 2014 Board of Governors Meeting, December 8, 2014 1

Legend *Influencing Research* On Target Working with PCORI influenced Geisinger Health System to incorporate patient Board of Governors Off Target Target engagement into its strategic plan for research and require it for all projects FY2014 Dashboard – Q4 Needs Attention Previous Actual Our Goals: Increase Information, Speed Implementation, and Influence Research (As of 9/30/2014) NA=Not Applicable X Current Actual Success Rates for Broad Awards Composition of Funded Research Portfolio Dissemination and Uptake Indicators % of Applications Awarded 100 40 50 7,000 25 % of Applications that were Resubmissions Other Q1 80 6,000 % of Resubmissions Awarded Percent 40 20 30 Percent Treatment Q2 60 5,000 Number 30 15 Q3 40 4,000 Diagnosis 20 Q4 3,000 20 20 10 Prevention 10 2,000 0 10 5 FY 2013 FY 2014 All All by $ 1,000 NA NA 0 Percent of Projects Meeting All Milestones 0 0 0 Cycle I Cycle II Cycle III August Winter Spring Journal Articles Web Views and Citations 100 2013 2014 2014 Q1 by Awardees (of Methodology Standards) Percent Meeting All 80 Priority Topics to Be Awarded = 5 Q2 Pipeline to Proposal Awards to Be Made = 65 60 Q3 40 5 65 5 Q4 30 20 Q4 Q4 NA NA NA 0 Research P2P PPRNs CDRNs Ambassadors to Be Fully Trained = 100 Funds to Be Committed to Research = $528M Completion of Research Projects 100 82 $528M 350 Number of Projects 4 Q4 Expected Actual Q4 Portion of PCORnet I to Be Completed = 1/3 Funds to Be Expended on Research Awards=$94M 2 1/3 of $94M 113 Q4 Phase I 0 Q4 Q1 Q2 Q3 Q4 Expense Categories External Research Commitments Responsiveness Other Expenditures Planned = $89M 350 100 100 300 Percent of Target Q1 80 80 $89M 45 Program Targeted 250 Q2 Percent 60 60 Q4 Broad 200 $M Program 40 Q3 40 150 PCORnet Support Planned Staffing Level = 164 People 20 100 20 Pilots Q4 NA Admin 0 50 164 153 Award to Contracts Science 0 0 Contract HelpDesk HelpDesk FY 2014 FY 2015 Q4 Actual Budget w/in 90 days 100% Customer Satisfaction FY 2012 FY 2013 FY 2014

New and Noteworthy Items Legend *Influencing Research* On Target Working with PCORI influenced Geisinger Health System to incorporate pa ent Target Board of Governors Off Target engagement into its strategic plan for research and require it for all projects FY2014 Dashboard – Q4 Previous Actual Needs A en on Our Goals: Increase Informa on, Speed Implementa on, and Influence Research (As of 9/30/2014) NA=Not Applicable X Current Actual Success Rates for Broad Awards Composi on of Funded Research Por olio Dissemina on and Uptake Indicators 40 % of Applications Awarded 100 50 7,000 25 % of Applications that were Resubmissions Other 80 Q1 6,000 % of Resubmissions Awarded 40 20 Percent 30 Percent 60 Treatment Q2 5,000 Number 30 15 40 Q3 Diagnosis 4,000 20 20 3,000 Q4 20 10 Prevention 10 0 2,000 10 5 FY 2013 FY 2014 All All by $ 1,000 NA NA 0 Percent of Projects Mee ng All Milestones 0 0 0 Cycle I Cycle II Cycle III August Winter Spring Journal Ar cles and Citations Web Views 100 2013 2014 2014 Q1 by Awardees (of Methodology Standards) Percent Meeting All 80 Q2 Priority Topics to Be Awarded = 5 Pipeline to Proposal Awards to Be Made = 65 60 Q3 40 5 5 65 Q4 30 20 Q4 Q4 NA NA NA 0 Research P2P PPRNs CDRNs Ambassadors to Be Fully Trained = 100 Funds to Be Commi ed to Research = $528M Comple on of Research Projects 100 82 $528M 350 Number of Projects 4 Q4 Expected Actual Q4 Por on of PCORnet I to Be Completed = 1/3 Funds to Be Expended on Research Awards=$94M 2 1/3 of 113 $94M Q4 Phase I 0 Q4 Q1 Q2 Q3 Q4 External Research Commitments Expense Categories Responsiveness Other Expenditures Planned = $89M 350 100 100 Q1 300 Percent of Target 80 80 $89M 45 Program Targeted 250 Q2 60 Percent 60 Q4 Broad 200 $M 40 Program Q3 40 PCORnet 150 Support Planned Staffing Level = 164 People 20 100 Pilots 20 NA Q4 Admin 0 164 153 50 Award to Contracts Science 0 Contract HelpDesk HelpDesk FY 2014 FY 2015 0 Q4 Actual Budget w/in 90 days 100% Customer Satisfaction FY 2012 FY 2013 FY 2014 Board of Governors Meeting, December 8, 2014 3

Goal 3: Influence Research *Influencing Research* Working with PCORI influenced Geisinger Health System to incorporate patient Early Signs engagement into its strategic plan for research and require it for all projects Geisinger Health System (GHS) leadership met to evaluate their progress toward achieving goals in their 10 year research strategic plan. They discussed changes which had occurred in the research environment over those 6 years, to which they needed to adapt. They identified patient engagement in research as key area of emphasis.  GHS had received 2 PCORI awards over that period of time Patient Engagement Work Group was formed to explore the place of patient engagement in GHS research going forward  Key recommendation is that patient engagement be the default at GHS, not the exception  Work Group’s goal is to create an atmosphere conducive to engaging patients in GHS research by raising awareness and making resources available to GHS research community  Several PCORI engagement concepts were central to the work group’s thinking and subsequently appeared in their final report and recommendation to leadership Board of Governors Meeting, December 8, 2014 4

GHS Patient Engagement Framework “.. as we navigate our way toward enhancing patient engagement in research and discovery at Geisinger, PCORI has been and will continue to be both guide and anchor for that effort”* GHS attributes their new focus on patient engagement in research to: • Internal culture that has always valued a patient centered approach (readily adaptable) • External forces, such as PCORI, which have advanced the national conversation around patient engagement and provided invaluable resources (both financial and intellectual) for making it possible PCORI resources have served as a “lead impetus,”* and heavily informed GHS’s conceptualization of their own patient engagement framework Patient Engagement Goals have been built into GHS Strategic Plan and personnel goals of GHS leadership *Dan Davis, PhD, Director, GHS Bioethics and Patient Engagement Work Group Lead Board of Governors Meeting, December 8, 2014 5

Goal 2: Speed Implementation Number of Journal Articles Concerning PCORI 60 56 Q1 50 Q2 40 Q3 Number of Articles Q4 30 23 22 20 12 11 8 10 5 3 3 0 Articles by Awardees Articles by or about PCORI Articles that Cite or Mention PCORI Work Journal Articles Published by Quarter Board of Governors Meeting, December 8, 2014 20

Goal 1: Increase Information Expected Number of Contracts Ending per Quarter (Includes estimates for some contract modifications in process) 60 Pilot 56 CER 50 Methods Number of Projects 40 35 32 30 30 21 20 16 15 13 13 11 10 8 5 6 5 4 3 2 2 1 1 1 1 1 1 0 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 2014 2014 2015 2015 2016 2016 2017 2017 2018 Fiscal Year Board of Governors Meeting, December 8, 2014 21

Goal 1: Increase Information Contracts’Help Desk Response Time 99% 99% 99% 100% 3,500 96% 3200 Tickets 3200 Tickets 3,000 80% 2,500 Percent within target Volume of tickets 60% T arget: 2,000 2100 Tickets 3 1700 Tickets Business Days 1,500 40% 1,000 20% 500 0% 0 Q1 Q2 Q3 Q4 Board of Governors Meeting, December 8, 2014 22

Goal 1: Increase Information Satisfaction with Contracts Help Desk Response Data from software that handles help desk tickets Staff follow-up with all respondents who indicated that they were dissatisfied 100% 800 94% 93% 93% 93% 699 (22%) Rated 700 609 (19%) Rated 80% Number (percent) of tickets rated Percent satisfied with response 600 500 60% 400 40% 284 (17%) Rated 335 (16%) Rated 300 200 20% 100 0% 0 Q1 Q2 Q3 Q4 Industry average = 85% of respondents satisfied Board of Governors Meeting, December 8, 2014 9

Goal 1: Increase Information Science Help Desk Response Time 99% 99% 100% 700 81% 600 80% 599 Tickets 500 Percent within target 63% Volume of tickets 60% T arget: 384 Tickets 400 3 Business Days 300 40% 292 Tickets 273 Tickets 200 20% 100 0% 0 Q1 Q2 Q3 Q4 Board of Governors Meeting, December 8, 2014 10

Goal 1: Increase Information Satisfaction with Science Help Desk Response Data from software that handles help desk tickets Staff follow-up with all respondents who indicate that they were dissatisfied 100% 100 91% 90% 90% 85% 80% 80 Number (percent) of tickets rated Percent satisfied with response 70 (12%) Rated 58 (15%) Rated 60% 60 53 (19%) Rated 40% 40 40 (14%) Rated 20% 20 0% 0 Q1 Q2 Q3 Q4 Industry average = 85% of respondents satisfied Board of Governors Meeting, December 8, 2014 11