SLIDE 1
1
2
Making our work rapid, relevant, & rigorous: How we do it - - PowerPoint PPT Presentation
Making our work rapid, relevant, & rigorous: How we do it - - PowerPoint PPT Presentation
1 Making our work rapid, relevant, & rigorous: How we do it through common measures Sara J. Landes, PhD Behavioral Health QUERI, Central Arkansas Veterans Healthcare System University of Arkansas for Medical Sciences 2 3 Kathy Dollar
SLIDE 2
SLIDE 3
3
- JoAnn Kirchner
- Mark Bauer
- Chris Miller
- Bo Kim
- Dave Oslin
- Laura Wray
- Richard Goldberg
- Matt Chinman
- Mona Ritchie
- Jeff Smith
- Kathy Dollar
- Jan Lindsay
- Karen Drummond
- Jennifer Sullivan
- Jacob Painter
- Jeff Pitcock
- Kate Iverson
- Samantha Connolly
- Krissi Morris
- James Townsend
- Barbara Johnson
- Susan Jegley
- Nyssa Curtis
- Brandy Smith
- Jack Woods
- Traci Abraham
- Mary Bollinger
- Kate Comtois
- Bridget Matarazzo
- Mark Reger
- John Areno
- Geoff Curran
- Taren Swindle
- Ben Teeter
- Jeremy Thomas
- Eva Woodward
- Sacha McBain
- Sonia Singh
- Cindy Moseley
- Melissa Zielinski
- Rosemary Nabaweesi
SLIDE 4
4
- Operational & clinical partners
- VA Office of Mental Health and Suicide Prevention
- VA Office of Connected Care
- VA VISN 16
- Central Arkansas Veterans Healthcare System
- Funding
- VA HSR&D SDR 16-195 (Landes)
- VA QUERI PII 18-195 (Landes)
- VA QUERI QUE 15-289 (Kirchner)
- NIH NCATS UL1 TR003107 (James)
SLIDE 5
5
Partnered research & measurement across a healthcare system
SLIDE 6
6
Poll: Do you ask your clinical stakeholders what they would like to measure? (aka what keeps you up at night?)
SLIDE 7
7
Measurement needs vs. reporting needs of partners (one size doesn’t fit all)
SLIDE 8
8
SLIDE 9
9
Using measures that already exist in healthcare settings
SLIDE 10
10
Using common measures across projects allows us to synthesize data
SLIDE 11
11
How do we maximize this as a field? Share our tools!
SLIDE 12
12
SLIDE 13
Facilitator Time & Activity Log
Ritchie et al., 2019
SLIDE 14
14
Key Events Template
Personnel Changes
Staff Added/Lost Leadership Turnover (lost/added)
Facilitator Activities
Implementation Planning Event General Education About an Intervention Mentoring of Providers on the Intervention (e.g., coaching and supervision) Data Gathering and Feedback
Clinic Events
Leaders Communicating with Staff (formally or informally) Physical Space Changes (e.g., moving locations, equipment installed) Referral Process Changes (formal or informal)
Broader Context Events
Regional Events (e.g., large initiative roll out) Organizational Events (e.g., new VA secretary) External Events (e.g., political changes, impactful current events)
Woodward et al., 2016
SLIDE 15
15
iPARIHS Codebook
SLIDE 16
16
SIRC Instrument Repository
- Enhanced systematic review and synthesis of D&I instruments (Lewis et al.,
2018)
- Centers on Proctor’s implementation outcomes framework and CFIR constructs
- This work was funded by NIMH R01MH106510 (Lewis)
- Current state of the repository:
- Revisions to the evidence-based assessment criteria & a new name:
Psychometric And Pragmatic Evidence Scale (PAPERS)
SLIDE 17
17
SIRC Instrument Repository
- Rating psychometric properties:
- internal consistency,
- convergent validity,
- discriminant validity,
- known-groups validity,
- predictive validity,
- concurrent validity,
- structural validity,
- responsiveness, and
- norms
- and pragmatic qualities:
- cost,
- accessibility of language,
- assessor burden (training),
- assessor burden (interpretation), and
- length of each measure
SLIDE 18
18
SLIDE 19
19
THANK YOU!
Sara J. Landes, PhD
- Behavioral Health QUERI, Central Arkansas Veterans Healthcare System
- University of Arkansas for Medical Sciences
@SJLandes sara.landes@va.gov & sjlandes@uams.edu @ImplementCollab sircimplementation@gmail.com
Society for Implementation Research Collaboration
- www.societyforimplementationresearchcollaboration.org