transition programs Kathy Nixon Speechley Professor, Paediatrics, - - PowerPoint PPT Presentation

transition programs
SMART_READER_LITE
LIVE PREVIEW

transition programs Kathy Nixon Speechley Professor, Paediatrics, - - PowerPoint PPT Presentation

Measuring outcomes of transition programs Kathy Nixon Speechley Professor, Paediatrics, Epidemiology & Biostatistics, Western University Scientist, Division Chair, Childrens Health Research Institute Assistant Director, Lawson Health


slide-1
SLIDE 1

Measuring outcomes of transition programs

Kathy Nixon Speechley

Professor, Paediatrics, Epidemiology & Biostatistics, Western University Scientist, Division Chair, Children’s Health Research Institute Assistant Director, Lawson Health Research Institute London, Ontario, Canada

slide-2
SLIDE 2

Presenter Disclosure

  • Faculty: Kathy Nixon Speechley
  • Relationships with financial sponsors:

Grants/Research Support: CIHR Children’s Health Research Institute/ Children’s Health Foundation, London. ON

  • Disclosure of Financial Support:

None to report

slide-3
SLIDE 3

Outline

  • Current state of knowledge regarding measuring
  • utcomes of transition programs
  • Describe steps required to measure outcomes of

transition along with resources available to guide this process

slide-4
SLIDE 4

Current Status

  • Considerable literature on issue of transition
  • Limited empirical evidence on outcomes of transition programs
  • Cochrane review (Campbell et al, 2016)

Evaluate effectiveness of interventions designed to improve transition of care

slide-5
SLIDE 5
slide-6
SLIDE 6

AUTHORS’ CONCLUSIONS:

“The available evidence (four small studies; N = 238), covers a limited range of interventions developed to facilitate transition in a limited number of clinical conditions, with only four to 12 months follow-up. These follow-up periods may not be long enough for any changes to become apparent as transition is a lengthy process. Evidence of improvement in patients' knowledge of their condition in one study, and improvements in self-efficacy and confidence in another. However, few studies eligible for review and overall certainty of the body of this evidence is low, no firm conclusions can be drawn about the effectiveness

  • f the evaluated interventions. Further research is very likely to have an

important impact on our confidence in the intervention effect and likely could change our conclusions. Considerable scope for the rigorous evaluation of other models of transitional care, reporting on clinical

  • utcomes with longer term follow-up.”

four small studies a limited range of interventions a limited number of clinical conditions

  • nly four to 12 months follow-up - follow-up periods

may not be long enough for any changes to become apparent Evidence of improvement in patients' knowledge of their condition improvements in self-efficacy and confidence

  • verall certainty of the body of this

evidence is low, no firm conclusions can be drawn “Further research is very likely to have an important impact on

  • ur confidence in the intervention effect and likely could change
  • ur conclusions. Considerable scope for the rigorous evaluation
  • f other models of transitional care, reporting on clinical
  • utcomes with longer term follow-up.”
slide-7
SLIDE 7

2017

slide-8
SLIDE 8

Methodology in comparative studies… a systematic review

  • 39 studies reviewed; 26 with final results published
  • Included quantitative studies that collected data at least in part after

the transfer & compared outcomes either between intervention & control group OR between pre- & post-intervention in single group. Randomized control groups used in 23%

  • Conclusions: few evaluative studies; methodological quality variable
  • Making conclusions on effectiveness of interventions challenging:
  • Complexity of interventions
  • Multiple outcomes
  • Difficulty blinding
  • Small sample sizes
slide-9
SLIDE 9
slide-10
SLIDE 10

“Despite the wealth of literature concerning aspects of transitional care that are key to a successful transition for young people with JIA or epilepsy, there is a paucity of

  • utcomes that define ‘successful’ transition and consequently

a lack of reliable research evaluating the effectiveness of transitional care interventions to support young people moving to adult health services.”

there is a paucity of outcomes that define ‘successful’ transition and consequently a lack of reliable research evaluating the effectiveness of transitional care interventions to support young people moving to adult health services

slide-11
SLIDE 11

Currently…

  • Little empirically derived assessment of outcomes
  • Assessments that have been done limited by methodology

making it difficult to draw conclusions

slide-12
SLIDE 12

What is Required?

  • To develop effective transition services requires accepting

challenge of mounting rigorous evaluations of typically complex interventions designed to improve transition

  • Multiple calls to action to improve quality of research

e.g. Fletcher-Johnston et al (2011); Le Roux et al (2017); Gabriel et al (2017); Burke et al (2018); Prior et al (2018)

  • Sound advice exists re: essential components this challenge

entails (guidelines, recommendations, consensus statements)

  • Opportunity to engage in strategic initiatives based on sound

principles

slide-13
SLIDE 13

Definition & Outcomes to Measure

  • First agree on: WHAT to measure? Then: HOW to measure?
  • What is successful transition?

Answer is necessary to:

  • move research priorities forward
  • facilitate evaluation of transition processes &
  • empirical determination of best practices
slide-14
SLIDE 14
slide-15
SLIDE 15

Delphi Study Details

  • diverse panel of experts engaged to reach consensus on key elements of a

transition program & indicators to use to assess success

  • 3 rounds online surveys. Each 2 parts: key elements of transition program

& indicators (quantifiable chars.) to describe transition as successful

  • Began with list of 34 elements and 32 indicators from lit. review.

Options: remain unchanged; remove; re-formulate; merge with another key element/indicator. Space to add rationale.

  • 2nd round rated on importance from “not at all” to “very”
  • 3rd round: 5-pt Likert-like scale: Essential to unnecessary (should be

removed)

  • Predefined a 70% agreement as minimal consensus as in literature
slide-16
SLIDE 16

6 Key Elements Finally Retained

ESSENTIAL ELEMENTS %

Assuring good coordination between pediatric and adult professionals 97 Starting planning transition at an early age 77 Discussing with patient and Family about self-management 74 Including young person's views and preferences to the planning of transition 74 If developmentally appropriate, seeing the adolescent alone at least for part of the transition 71 Identifying an adult professional willing to take on the young person 71

slide-17
SLIDE 17

8 Indicators finally retained

Essential (%) Essential+ very Important (%) Patient not lost to follow-up 91 Attending scheduled visits in adult care 63 94 Patient building a trusting relationship with adult provider 43 86 Continuing attention for self management 49 86 Patients' first visit in adult care no later than 3-6mo. 60 83 Number of ER visits for regular care in the past year 40 80 Patient and family satisfaction with transfer of care 34 74 Maintenance/ improvement of standard for disease control evaluation 37 71

slide-18
SLIDE 18

Key Themes from process

  • 1. need to consider specific characteristics of different

diseases e.g. indicator of Pt’s first visit in adult care no later than 3-6 mo should likley be different depending on disease

  • 2. respect differences across countries & adapt to local

practices and resources (e.g. “# ER visits for regular care“)

  • 3. several key elements were considered indicators of good

care in general and not specific to transition

  • 4. issue of good coordination between paediatric and adult

services appeared almost constantly (key is collaboration)

  • 5. Surprising result : an important part of transition is helping

youth reach full potential but consensual elements mainly limited to health outcomes and less holistic

slide-19
SLIDE 19

Additional Considerations

  • Strategic to understand how youth & multiple partners

supporting transition define success; what defines successful transition is dependent on stakeholder perspective (Burke et al,

2018

  • Evaluate consensus results within context of patient and

family perspective

slide-20
SLIDE 20

Categorize Outcomes by Time

Process of transition:

  • Transition readiness scores
  • Level of self management
  • Adherence

Short-term Outcomes:

  • Not lost to follow-up

Longer-term Outcomes:

  • Patient- reported outcomes
slide-21
SLIDE 21

Conceptual Frameworks

  • Given that transition is complex & requires multi-faceted

measurement, important to employ a conceptual framework

(Prior et al, 2018; Gorter et al, 2014)

  • Employing framework key foundation for evaluation

(CAPHC Guideline for Transition, 2016)

Two examples:

  • Triple aim Framework (Institute for Health Care Improvement)
  • International Classification of Functioning, Disability & Health

Framework (ICF) (WHO)

slide-22
SLIDE 22

Triple Aim Framework

Patient Experience of Care

Satisfaction Barriers to Care Enablers

Population Health

Adherence to care guidelines Disease-specific outcome Mortality Patient-reported outcomes (QOL & functional status) Self-care skills Process of care

Cost

Gaps in care Cost of no shows Cost per patient Service use-- short-term & longitudinally Accessing outpatient vs. emergency vs. inpatient care

slide-23
SLIDE 23

Value of Conceptual Framework

  • Frame transition measurement in terms of linked goals
  • key when measuring complex concept but rarely done

(Prior et al, 2015) e.g. Triple aim: population health, patient experience & cost

  • conceptualiziing linked goals offers opportunity to align

transition intervention with system-wide improvements in health care

  • Recognize how interconnected, overlapping and contextually

sensitive components such as relationships, opportunity & experience impact outcomes as part of developmental process or trajectory.

slide-24
SLIDE 24

Areas for improvement in methodological quality:

  • Control groups and design
  • Sample size and external validity
  • Blinding
  • Measurement validity
  • Standardized assessment
  • Interpretation of results
  • Reporting
slide-25
SLIDE 25

Conclusions

  • Measuring outcomes of transitions programs should be

viewed as priority

  • The task is challenging but key resources available:
  • Important groundwork: essential elements of transition programs &

indicators of successful outcome have been systematically determined

  • Sound conceptual guidance to follow
  • Sound methodological strategies outlined
  • Well positioned to advance transition care science in epilepsy