Learning from Applicants and Reviewers about Engagement Resources - - PowerPoint PPT Presentation

▶

Dec 12, 2022 154 likes •316 views

Learning from Applicants and Reviewers about Engagement Resources Sana N. Vieux, MPH Program Associate, Research Integration and Evaluation Applicant and Reviewer Surveys Spring 2014 Fall 2014 Spring 2014 Pragmatic Trials (May 2014)

SLIDE 1

Learning from Applicants and Reviewers about Engagement Resources

Sana N. Vieux, MPH Program Associate, Research Integration and Evaluation

SLIDE 2

Applicant and Reviewer Surveys

Spring 2014

(May 2014)

Spring 2014 Pragmatic Trials (August 2014) Fall 2014 (November 2014) Applicant Surveys Total N = 791 Response rates = 44 – 74% Reviewer Surveys Total N = 363 Response rates = 86 – 88%

SLIDE 3

Applicant Survey Results

SLIDE 4

Helpfulness of Sample Engagement Plans

11% 14% 5% 9% 0% 10% 9% 5% 10% 71% 82% 75%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spring 2014 Spring 2014 Pragmatic Trials Fall 2014 Did Not Use Unhelpful Neutral Helpful

SLIDE 5

Helpfulness of Engagement Rubric

7% 5% 5% 12% 5% 11% 6% 9% 9% 75% 82% 75%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spring 2014 Spring 2014 Pragmatic Trials Fall 2014 Did Not Use Unhelpful Neutral Helpful

SLIDE 6

Engagement Rubric Helped Identify and Fill Gaps in the Engagement Plan

8% N/A 5% 11% 0% 10% 13% 18% 15% 67% 82% 69%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spring 2014 Spring 2014 Pragmatic Trials Fall 2014 Did Not Use Disagree Neutral Agree

SLIDE 7

“I Understand PCORI’s Requirements for Patient and Other Stakeholder Engagement.”

7% 5% 6% 9% 5% 9% 84% 91% 85%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spring 2014 Spring 2014 Pragmatic Trials Fall 2014 Disagree Neutral Agree

SLIDE 8

Duration of Partnership Prior to Application

42% 53% 29% 21% 16% 37% 25% 26% 24% 12% 5% 10%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spring 2014 Spring 2014 Pragmatic Trials Fall 2014 0-6 Months 7 Months - 1 Year 2-5 Years More than 5 Years Before

>85% of applicants established a partnership before submitting the application.

SLIDE 9

Summary and Discussion: Applicant Survey Findings

Engagement rubric and sample engagement

plans were perceived as helpful and as facilitating plans for engagement.

Most applicants reported understanding PCORI’s

requirements for patient and stakeholder engagement.

Most applicants established a stakeholder

partnership(s) prior to applying to PCORI.

SLIDE 10

Reviewer Survey Results

SLIDE 11

“The Engagement Rubric Helped me Identify Gaps in my Assigned Applications”

9% 8% 8% 16% 19% 35% 75% 72% 57%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Patients Stakeholders Scientists

Spring 2014

Disagree Neutral Agree

SLIDE 12

“The Engagement Rubric Helped me Evaluate Patient and Stakeholder Engagement in my Assigned Applications”

0% 0% 0% 0% 0% 5% 100% 100% 90%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Patients Stakeholders Scientists

Spring Pragmatic Trials

Disagree Neutral Agree

SLIDE 13

“The Engagement Rubric was Helpful in Framing the Discussion about Engagement During the In-person Merit Review Panel”

74% 89% 69% 84% 61% 85%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Spring 2014 Spring 2014 Pragmatic Trials Spring 2014 Spring 2014 Pragmatic Trials Spring 2014 Spring 2014 Pragmatic Trials Patients Stakeholders Scientists

% Agree

SLIDE 14

102

Reviewer Survey Summary

Most reviewers agree that the Engagement

Rubric was helpful for:

– Evaluating assigned applications – Framing the discussion about engagement

SLIDE 15

103