Cycle 2 2018 Applicant Town Hall Webinar Washington, DC August 8, - - PowerPoint PPT Presentation

Applicant Town Hall Webinar Washington, DC August 8, 2018 at 12:00pm ET Cycle 2 2018

Psychosocial Interventions with Office-Based Opioid Treatment for Opioid Use Disorder

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

2

Today’s Presenters

Els Houtsmuller Associate Director Healthcare Delivery and Disparities Research Ashton Ferrara Administrator Contracts Management Carolyn Mohan Merit Review Officer Merit Review Andrea Brandau Program Officer Healthcare Delivery and Disparities Research Denese Neu Engagement Officer Public and Patient Engagement

3

Agenda

I. Welcome and Introductions

• II. About PCORI
• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

4

About PCORI Els Houtsmuller

Associate Director, Science Healthcare Delivery and Disparities Research

PCORI

• An independent, non-profit [501-(c)(1)]

research institute authorized by Congress in 2010 and governed by a 21- member Board of Governors representing the entire healthcare community

6

Our Focus

• Compares two or more interventions that are

evidence-based or in widespread use

• Is performed in real-world populations and settings
• Patient-centered:
• Engages patients and key stakeholders

throughout the research process

• Answers questions that matter to patients and
• ther clinical decision makers

Comparative Effectiveness Research

7

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Resources and Q&A

8

Targeted PFA Goal

The goal of this targeted PFA is to generate evidence regarding the comparative effectiveness of psychosocial interventions for patients with

• pioid use disorder (OUD) who receive office-based opioid treatment

(OBOT)

9

PICOTS

Population: Patients who receive office-based opioid treatment with buprenorphine Interventions and Comparators: Studies may compare different levels of intensity (e.g., different frequencies, group vs individual format, combinations of interventions), and different durations of efficacious interventions.

• Proposed studies should compare two or more approaches that include interventions that are

documented to be efficacious or in common use, and that are well characterized to facilitate replication and dissemination efforts.

10

11

PICOTS Continued

Outcomes

• Treatment adherence/retention, patient function, illicit opioid use, other drug use,

emergency department visits, overdose, provider satisfaction, and provider stress Time

• Studies up to 4 years
• Periodic outcome assessments; at least one year of patient follow-up

Setting

• Community-based settings, places where office-based opioid treatment is offered

Study Considerations

• Large randomized controlled trials (RCTs) or well justified observational studies;

sufficient sample size

• Interested in heterogeneity of treatment (HTE) effects among subgroups (e.g.,

addiction severity, low income or disadvantage)

• Urban, low-income, and racial-ethnic minority populations
• Studies should propose interventions that are or can be made available to most

patients

• Stepped-care and needs-based approaches rather than straightforward

comparisons of interventions

12

Research Activities Not Supported

• This PFA will NOT support:
• Pilot studies
• Efficacy trials
• Cost-effectiveness analyses
• Direct comparisons of the costs of care between two or more alternative

approaches

• Development of clinical prediction or prognostication tools
• Evaluation of new or existing decision-support tools
• Studies of the natural history of disease, instrument development,

pharmacodynamics, and fundamental science of biological mechanisms

13

Budget Parameters

• PCORI has allocated a total of up to $25 million for this PFA
• The proposed budget for studies under this initiative may be up to $4 million in

direct costs

• The maximum project period is 4 years (three year studies are also encouraged)
• NOTE: PCORI funding does not cover clinical healthcare costs

14

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

15

Patient and Stakeholder Engagement

Denese Neu

Engagement Officer Public and Patient Engagement

Patients and Other Stakeholders

PCORI Community

Patient/ Consumer

Caregiver/F amily Member of Patient

Clinician

Patient/ Caregiver Advocacy Org

Hospital/ Health System

Training Institution

Policy Maker Industry Payer

Purchaser

17

18

Patient-Centeredness vs. Patient Engagement

• Patient-Centeredness
• Addresses outcomes (both benefits and harms) that important to patients

and caregivers.

• The interventions proposed for comparison are currently available.
• Patient and Stakeholder Engagement
• Demonstrates active engagement between the research staff, patients,

caregivers and other stakeholders.

• Involves relevant organizations, patients, and caregivers through existing

relationships or presents a logical and reasonable plan to establish these partnerships.

Evidence of Appropriate Engagement Patients/Caregivers and Other Stakeholders

• Explain consultation with patients/caregivers and other stakeholders on their

decisional dilemma and evidence needs or reference previously documented decisional dilemmas.

• Identify the patient/caregivers and stakeholders who helped determine that the

proposed study addresses their evidentiary needs for decision-making.

• Demonstrate commitment to actively engaging these partners throughout the

conduct of the study.

Planning for Engagement

Insights and Decision-making

• Formulating the research questions; Selecting outcomes; Defining the characteristics of

study participants, comparators and outcomes; Providing feedback/problem-solving during conduct of the study; Designing plans for dissemination of study results

Roles

• Identifying the partners; Aligning partners with key activities to optimize experience;

Strategy for managing the engagement activity and processes

Structure

• Organizing the activity (e.g., Study Advisory Committee; Patient Advisory Panel);

Addressing national goals as well as local needs; Frequency of meetings; Collaboration between committees and research team

Budgeting Tips

• Financial compensation of partners
• Expenses of partners (transportation, childcare, caregiver)
• Budgeting for program staff dedicated to engagement tasks
• Costs of engagement meetings and events (travel, food, AV)
• Additional time and resource to incorporate partner feedback into various project

process

The rubric is intended to provide guidance to applicants, merit reviewers, awardees, and engagement/program

• fficers (for creating milestones and monitoring projects)

regarding engagement in the conduct of research. It is divided into three segments:

Planning the Study Conducting the Study Disseminating the Study Results

The Engagement Rubric

Engagement Resources

• PCORIs “Engagement Rubric:” http://www.pcori.org/sites/default/files/Engagement-

Rubric.pdf

• Sample Engagement Plans: http://www.pcori.org/sites/default/files/PCORI-Sample-

Engagement-Plans.pdf

• Compensation Framework: http://www.pcori.org/sites/default/files/PCORI-Compensation-

Framework-for-Engaged-Research-Partners.pdf

• Engagement Budgeting: http://www.pcori.org/sites/default/files/PCORI-Budgeting-for-

Engagement-Activities.pdf

• Engagement in Research Webpage: http://www.pcori.org/funding-opportunities/what-we-

mean-engagement

• PCORI’s Methodology Standards PC-1 to PC-4: https://www.pcori.org/research-

results/about-our-research/research-methodology/pcori-methodology-standards

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement

• V. Administrative Overview
• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

24

Administrative Overview

Ashton Ferrara

Administrator Contracts Management

LOI and Application

• Full applications have been invited based on the information

provided in the LOI

• Changes to the following require PCORI’s approval:
• Principal Investigator
• Institution
• Research question(s)
• Specific Aims
• Study Design
• Comparators

26

Research Plan Template

• Research Strategy: Maximum 15 pages in length
• Provide all information requested, as outlined in the template:
• Specific Aims
• Background
• Significance
• Study Design or Approach
• Study Population(s)
• Research Team & Environment: 2 pages
• Describe the research team’s capabilities to accomplish the goals of the

proposed research project and the appropriateness of the research environment to conduct the study

27

28

Research Plan Template Continued

• Dissemination & Implementation Potential: 2 pages
• Describe how you will make study results available to study participants

after you complete the analyses.

• Describe possible barriers to disseminating and implementing the results of

this research in other settings.

• Consortium Contractual Arrangements: 10 pages
• Describe the proposed components of the research project that will be

performed by subcontracted organizations.

• Explain the strengths that these partners bring to the overall project to

ensure successful submission of contract deliverables in accordance with the milestone schedule.

29

Research Plan Template Continued

• Protection of Human Subjects: 5 pages
• References: 10 pages
• Appendices (optional): 10 pages
• Applicants can include additional materials that they believe are useful, but

reviewers are not required to review the appendix materials in evaluating the application.

• Methodology Standards Checklist: (NEW)
• Applicants must complete each column of this checklist, as appropriate, and

include it with the Research Plan PDF upload

People and Places Template

• Leadership Plan Template (Dual PI application): 5 pages
• Describe the governance and organizational structure of the leadership

team and the research project;

• Delineate the administrative, technical, scientific, and engagement

responsibilities for each PI and the rationale for submitting a dual-PI application;

• Discuss communication plans and the process for making decisions on

scientific and engagement direction;

• Describe the procedure for resolving conflicts.
• Note: If this template is applicable, it should be uploaded as

the first section of the People and Places Template

30

31

People and Places Template Continued

• Professional Profile/Biosketch: 5 pages per person
• Required for all key personnel
• Use NIH biosketch or PCORI’s format
• List all partners within the Key Personnel section
• Patient and/or stakeholder biosketches: 5 pages per person
• Project/Performance Site(s) and Resources: 15 pages
• Provide a description of the facilities that will be used during the project,

including capacity, capability, characteristics, proximity, and availability to the project

Letters of Support

• Letters of support should be addressed to the PI to demonstrate the

commitment of key personnel and supporting organizations to the proposed project

• Letters of support should be organized in the following manner:
• Letters of organizational support
• Letters of collaboration
• Letters confirming access to patient populations, data sets, and

additional resources

32

Milestones/Deliverables

• Milestones
• Significant events, deliverables, tasks, and/or outcomes that occur over

the course of the project that mark progress toward the project’s overall aims

• Deliverables
• Measurable and verifiable outcomes or products that a project team must

create and deliver according to the contract terms

• See Appendix 1 of the Application Guidelines for examples of milestones.
• Milestones/Deliverables must be entered into PCORI Online

33

Budget

• In PCORI Online, for the Budget tab complete the following sections:
• Detailed Research Project Budget for Each Year of the Research Project

Period

• Detailed Peer-Review Budget for Peer-Review-Related Costs
• Budget Summary for Entire Project
• In the Templates and Uploads tab, upload the Budget Justification Template for

the prime applicant and each subcontracted organization for the entire Research Project Budget and Peer-Review Budget for all research and peer-review-related

• costs. Include the federally negotiated or independently audited indirect cost rate

letter (prime contractor) and fringe benefit rate policy verification document (prime contractor)

34

Using the PCORI Online System

• Navigate to PCORI Online (https://pcori.force.com/engagement)
• Log into the PCORI system early
• Please only use Chrome, Safari, and Firefox browsers to access the system
• The PI and the AO cannot be the same individual
• PCORI Online Training Slides
• PCORI Online Application Cheat Sheet

35

36

Tips for Success Administrative

• Adhere to the PFA and Application Guidelines for the funding cycle

you are applying to (Cycle 2, 2018)

• Talk to a Program Officer if you have questions
• Start and submit early
• Download PCORI’s Pre-Award Applicant User Guide
• Ensure that all team members can see the application in the

system

• Inform your AO of your intent to submit
• Submit the completed application before September 25, 2018 5:00 PM ET

What Happens to Your Application After You Submit It?

Administrative Screening

• Applicants must follow the administrative requirements stated in PCORI’s

Application Guidelines.

• Applications may be administratively withdrawn for the following reasons:
• Exceeding budget or time limitations
• Not using PCORI’s required templates
• Submitting incomplete sections or applications

38

Programmatic Screening

Applications may be programmatically withdrawn for the following reasons:

• Deviation from the approved LOI
• Inclusion of cost-effectiveness analysis (CEA)
• Inclusion of development and dissemination of clinical practice guidelines (CPG)
• Not responsive to the program-specific PFA

PCORI Mission

39

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

40

Merit Review Carolyn Mohan

Merit Review Officer

An Inclusive Merit Review

• Each review panel includes three reviewer types to bring diverse perspectives.
• Each application is reviewed by three scientists, one patient, and one other

stakeholder. Patients Other Stakeholders Scientists, including methodologists

42

The Merit Review Process

• Overview
• Full applications screened by committee of PCORI merit review staff for

responsiveness to PFA and consistency with LOI

• Preliminary (online) review
• In-Person review
• Post-Panel review (PCORI program staff)
• PCORI guides reviewers to use the bullet points under each merit review criterion

to evaluate their assigned applications (see Merit Review Section in PFA)

43

Merit Review Criteria

Crosswalk of PCORI Merit Review Criteria with NIH Criteria

SIGNIFICANCE

• 1. Potential for the study to fill critical gaps in evidence
• 2. Potential for the study findings to be adopted into

clinical practice and improve delivery of care

APPROACH

• 3. Scientific merit (research design, analysis, and
• utcomes)

NEW 4. Investigator(s) and environment

PCORI-only Merit Review Criteria

PATIENT-CENTEREDNESS/ ENGAGEMENT

• 5. Patient-centeredness
• 6. Patient and stakeholder engagement

44

The Potential for the Study to Fill Critical Gaps In Evidence

• Does the application convincingly describe the clinical burden?
• Does the application identify a critical gap in current knowledge as noted in

systematic reviews, clinical practice guidelines, or previous research prioritizations?

• Does the application identify a critical gap in current knowledge, evidenced by

inconsistency in clinical practice and decision making?

• Would research findings from the study have the potential to fill these gaps?

45

The Potential of the Study Findings to Be Adopted Into Clinical Practice and Improve Delivery of Care

• Does the application identify who will make the decision (i.e., the decision maker) or use (i.e., the

end-user) the study findings (not the intervention) this study produces, such as local and national stakeholders?

• Does the application identify potential end-users of study findings—such as local and national

stakeholders—and describe strategies to engage these end-users?

• Does the application provide information that supports a demand for this kind of a study from

end-users?

• Would this study’s research findings have the potential to inform decision making for key

stakeholders? If so, provide an example. How likely is it that positive findings could be reproduced by others, resulting in improvements in practice and patient outcomes? Identify the potential barriers that could hinder adoption of the intervention by others.

• Does the application describe a plan for how study findings will be disseminated beyond

publication in peer-review journals and at national conferences?

46

Scientific Merit

• A clear research plan with rigorous methods that adhere to PCORI’s Methodology

Standards and accepted best practices

• A clear justification for the study design and outcome measures
• Clearly described and justified comparators
• Sample sizes and power estimates based on careful evaluations of the anticipated

effect size

• Feasibility
• A carefully constructed and realistic timeline that includes specific scientific

and engagement milestones

• Realistic strategies for participant recruitment and retention

47

Investigators and Environment

• Demonstrate the team’s experience, leadership approach, governance and
• rganizational structure, as appropriate to achieving project goals
• Demonstrate resources and institutional support to conduct project as planned,

with budget and on time

• Dual PIs must submit a leadership plan

48

Patient Centeredness

• Does the application include a thorough description about which outcomes (both

benefits and harms) are important to patients? Are those outcomes included in the study plan?

• Does the application provide information that indicates that closing the evidence

gap is important to patients and other stakeholders?

• Are the interventions being compared in the study available to patients now, and

are they the best options for comparison (including whether they would be chosen by patients and their healthcare providers for managing the condition being studied)?

49

Patient and Stakeholder Engagement

• Does the application provide a well-justified description of how the research team

incorporates stakeholder involvement? Does the study include the right individuals to ensure that the projects will be carried out successfully?

• Does the application show evidence of active engagement among scientists,

patients, and other stakeholders throughout the research process? Is the frequency and level of patient and stakeholder involvement sufficient to support the study goals?

• Is the proposed Engagement Plan appropriate and tailored to the study?
• Are the roles and the decision-making authority of all study partners described

clearly?

• Are the organizational structure and resources appropriate to engage patients

and stakeholders throughout the project?

50

Key Dates

Action Date Online System Opens: June 1, 2018 Pre-LOI Applicant Town Hall: June 11, 2018 LOI Deadline: June 28, 2018 LOI Decisions Announced: July 23, 2018 Post-LOI Applicant Town Hall: August 8, 2018 (Today) Application Deadline: September 25, 2018 Merit Review Dates December 2018 Awards Announced: April 2019 Earliest Project Start Date: June 2019

51

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review

VII.Tips for Success and Resources VIII.Q&A

52

Tips for Success and Resources Andrea Brandau

Program Officer Healthcare Delivery and Disparities Research

Tips for Success Preparing Your Application

• Read the funding announcement and review the PCORI Application Guidelines

Document

• Review the PCORI Research Plan Template
• Have a copy of your approved LOI and LOI feedback provided by PCORI staff

readily accessible

54

55

Tips for Success Study Design/Approach

• Document how proposed study will fill the evidence gap.
• Include a clear conceptual framework, theory or model that anchors the

background, significance, and informs the design, key variables, and relationships being tested.

• Clearly describe and justify comparators, including usual care.
• Document efficacy/effectiveness and/or common use of proposed

comparators in clinical practice.

• Provide clear justification for the study design and outcomes.
• Include clear rationale for sample size, power estimates, and effect sizes, and

support rationale with evidence or pilot work.

55

Tips for Success Programmatic

• Clearly demonstrate the feasibility of the study:
• Team and expertise
• Recruitment and retention
• Committed sites
• Realistic timelines
• Clearly describe sustainability and scalability of interventions
• Consider how your project meets PCORI’s unique merit review criteria around

Patient-centeredness and Patient and Stakeholder Engagement

56

Applicant Resources

• MAT Pre-announcement: http://www.pcori.org/funding-
• pportunities/announcement/medication-assisted-treatment-mat-delivery-pregnant-women
• PFA: http://www.pcori.org/funding-opportunities/announcement/medication-assisted-

treatment-mat-delivery-pregnant-women

• FAQs: http://www.pcori.org/funding-opportunities/what-you-need-know-apply/have-

question/medication-assisted-treatment-mat

• Methodology Standards: http://www.pcori.org/research-we-support/research-methodology-

standards/

• Engagement Rubric: http://www.pcori.org/sites/default/files/Engagement-Rubric.pdf

57

Applicant Resources Where Can I Find Help?

• Visit pcori.org/apply
• Application Guidelines
• FAQs
• PCORI Online User Manuals
• Sample Engagement Plans
• Schedule a Call with a Program Officer
• Submit a request at pcori.org/content/research-inquiry
• Call 202-627-1884 (programmatic inquiries)
• E-mail sciencequestions@pcori.org
• Contact our Helpdesk
• E-mail pfa@pcori.org
• Call 202-627-1885 (administrative and technical inquiries)

58

Agenda

I. Welcome and Introductions II. About PCORI

• III. PFA Overview
• IV. Patient and Stakeholder

Engagement V. Administrative Overview

• VI. Merit Review
• VII. Tips for Success and Resources

VIII.Q&A

59

Q&A

Ask a question via the “Questions” function in GoToWebinar control panel

If we are unable to address your question during this time, e-mail the Helpdesk at pfa@pcori.org.

60

Thank You!

Els Houtsmuller Associate Director, Healthcare Delivery and Disparities Research Denese Neu Engagement Officer, Public and Patient Engagement Ashton Ferrara Administrator, Contracts Management Carolyn Mohan Merit Review Officer, Merit Review Andrea Brandau Program Officer, Healthcare Delivery and Disparities Research

61