to predict implementation of evidence-based practices in community - - PowerPoint PPT Presentation

to predict implementation of evidence based
SMART_READER_LITE
LIVE PREVIEW

to predict implementation of evidence-based practices in community - - PowerPoint PPT Presentation

Using psychological and organizational theories to predict implementation of evidence-based practices in community settings Rinad S. Beidas, PhD, Emily Becker-Haimes, PhD, & Nathaniel Williams, PhD WWW.UPENN.EDU 1 12/7/2017 1 Agenda 1.


slide-1
SLIDE 1

Using psychological and organizational theories to predict implementation of evidence-based practices in community settings

Rinad S. Beidas, PhD, Emily Becker-Haimes, PhD, & Nathaniel Williams, PhD

1

12/7/2017 1 WWW.UPENN.EDU

slide-2
SLIDE 2

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion and implications

2

12/7/2017 2 WWW.UPENN.EDU

slide-3
SLIDE 3

The research to practice gap

3

12/7/2017 3 WWW.UPENN.EDU

Few youth receive the evidence-based practice for disruptive behavior disorders (i.e., parent management training) in the community (Garland et al., 2010) The most common diagnoses in community mental health are disruptive behavior disorders

(Merikangas et al., 2011; Love et al., 2014)

Systems are mandating or encouraging evidence-based practices including the City of Philadelphia

slide-4
SLIDE 4

The implementation science gap

In our work and others, we have found repeatedly that therapist and organizational factors are related to implementation of evidence-based practices. Now, we must answer how they are related. This presents an opportunity to do so.

Beidas et al., 2015; Wolk et al., 2016

4

12/7/2017 4 WWW.UPENN.EDU

slide-5
SLIDE 5

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion & Implications

5

12/7/2017 5 WWW.UPENN.EDU

slide-6
SLIDE 6

Our Causal Model

Adapted from Azjen (1986, 1991) and Williams and Glisson (2013)

Intentions Self-Efficacy Norms Attitudes Skill Beliefs Behavior Knowledge Agency City State Federal Policy/ Organizational Environment Intentions Self-Efficacy Norms Attitudes Skill Beliefs Knowledge State Federal

12/7/2017 6 WWW.UPENN.EDU

slide-7
SLIDE 7

Our piece of the puzzle

7

12/7/2017 7 WWW.UPENN.EDU

Intentions Self-Efficacy Norms Attitudes Skill Beliefs Behavior Knowledge School District State Federal Policy/ Organizational Environment Use of PMT Organizational (Proficient) Culture Intentions

slide-8
SLIDE 8

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion & Implications

8

12/7/2017 8 WWW.UPENN.EDU

slide-9
SLIDE 9

The City of Philadelphia

9

12/7/2017 9 WWW.UPENN.EDU

slide-10
SLIDE 10

Evidence-Based Practices

10

12/7/2017 10 WWW.UPENN.EDU

2007 2011 2011 2012 2016 2013

slide-11
SLIDE 11

11

12/7/2017 11 WWW.UPENN.EDU

slide-12
SLIDE 12

Timing of Data Collection

12

12/7/2017 12 WWW.UPENN.EDU

Time 1 (2013) Time 2 (2015)

22 agencies 28 sites 247 therapists 19 agencies 23 sites 130 therapists

slide-13
SLIDE 13

For this analysis

  • We focused on sites that were included in the

sample at both time points (k = 20)

  • We included clinicians that reported on treating a

client with an externalizing disorder at T2 (n = 103)

13

12/7/2017 13 WWW.UPENN.EDU

slide-14
SLIDE 14

2-1-1 Mediation Model

14

12/7/2017 14 WWW.UPENN.EDU

Improvement in Proficient Culture (T1 to T2) Intention to use PMT (T2) Use of PMT (T2) Organization Level Clinician Level

Control for: client age, client gender, org size

x M Y

slide-15
SLIDE 15

Measures: Proficient Culture (X)

  • Organizational Social Context (Glisson et al., 2008)

15

12/7/2017 15 WWW.UPENN.EDU

Responsiveness

Members of my unit are expected to improve the well being of each client

Competence

Members of my unit are expected to have up to date knowledge

slide-16
SLIDE 16

Measures: Proficient Culture (X)

Change from T1 to T2

16

Proficient Culture T1 Proficient Culture T2 Change in Proficient Culture Mean 48.6 55.3 6.7 SD 13.1 9.4 13.5 Min-Max 12.5-66.8 26.0-70.1

  • 7.61-43.52
slide-17
SLIDE 17

Measures: Intentions to use PMT (M)

17

12/7/2017 17 WWW.UPENN.EDU

“During at least one of the sessions, I intend to talk to the parent about strategies the parent can use to help manage the child’s behavior , such as natural and logical consequences, positive and negative reinforcement, and time-

  • ut.”

1(Strongly disagree)-7(Agree)

slide-18
SLIDE 18

Measures: Use of PMT (Y)

  • TPC-FR (Weersing et al.,

2002)

  • Mean of 6 items that

capture PMT (alpha = .84)

18

12/7/2017 18 WWW.UPENN.EDU

Using a point or token system to reward the child for good behavior Making up contract for child’s behavior Using time-out from reinforcement Trying to extinguish undesirable behavior by discontinuing rewards for that behavior Parent training in child management techniques Administering rewards to increase positive behavior

slide-19
SLIDE 19

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion & Implications

19

12/7/2017 19 WWW.UPENN.EDU

slide-20
SLIDE 20

2-1-1 Mediation Model

20

12/7/2017 20 WWW.UPENN.EDU

Improvement in Proficient Culture (T1 to T2) Intention to use PMT (T2) Use of PMT (T2) Organization Level Clinician Level

a = .06* b = .31*

a*b = .019 Joint Significance Test = Sig.

c’ = .03

Asymmetric 95% CI = .002 to .044 Pm = .41

slide-21
SLIDE 21

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion & Implications

21

12/7/2017 21 WWW.UPENN.EDU

slide-22
SLIDE 22

Limitations

  • Temporality: would prefer all variables to be at

different time points

  • Measurement
  • Self-reported use
  • Did not test other antecedents of intentions (e.g., self-

efficacy)

22

12/7/2017 22 WWW.UPENN.EDU

slide-23
SLIDE 23

Agenda

  • 1. The research to practice gap
  • 2. Our causal model
  • 3. Study design and measurements
  • 4. Results
  • 5. Limitations
  • 6. Discussion & Implications

23

12/7/2017 23 WWW.UPENN.EDU

slide-24
SLIDE 24

Discussion & Implications

24

12/7/2017 24 WWW.UPENN.EDU

A seemingly distal non-implementation specific organizational factor, improvement in proficient culture, was related to PMT use via a clinician variable (intentions); thus elucidating potential targets for implementation strategies. Future studies should unpack the relationship between proficient culture (and other organizational variables) and antecedents of intention as well as the potential moderating role of organizational factors. Future models should include client factors as potential moderators between intentions and behavior.

slide-25
SLIDE 25

25

12/7/2017 25 WWW.UPENN.EDU

Thank You!

rbeidas@upenn.edu @Rsbeidas www.cmhpsr.org/dr-rinad-beidas K23 MH099179 (Beidas); P50 MH 113840 (Beidas, Mandell, Volpp)