How are You Measure Recovery? Current Approaches in Practice and - - PowerPoint PPT Presentation

how are you measure recovery
SMART_READER_LITE
LIVE PREVIEW

How are You Measure Recovery? Current Approaches in Practice and - - PowerPoint PPT Presentation

How are You Measure Recovery? Current Approaches in Practice and Research BC PSR Advanced Practice Webinar Skye Pamela Barbic 1-4 , PhD, OT 1 Department of Psychiatry, University of British Columbia, Vancouver, Canada 2 Department of Occupational


slide-1
SLIDE 1

How are You Measure Recovery? Current Approaches in Practice and Research

BC PSR Advanced Practice Webinar

Skye Pamela Barbic1-4, PhD, OT

1 Department of Psychiatry, University of British Columbia, Vancouver, Canada 2Department of Occupational Science and Occupational Therapy, University of British Columbia, Vancouver, Canada 3St-Paul’s Hospital, Vancouver, Canada 4Social Aetiology of Mental Illness Program, Centre for Addiction and Mental Health, Toronto, Canada

slide-2
SLIDE 2

+

Acknowledgements

 Canadian Institute of Health Research  Centre for Addiction and Mental Health  University of British Columbia  University of Toronto/ McGill/Queen’s/University of Manitoba  Granville Youth Health Clinic/St-Paul’s Hospital  YMCA  CAMH Vancouver-Burnaby Branch  CAMH-TORONTO  Wellington Centre, Douglas Institute-MONTREAL

 Terry Krupa, Bonnie Kirsh, Kwame McKenzie, Stefan Cano, Jeremy Hobart, Jack Stenner, David Andrich,

Zachary Durisko, Sean Kidd, Catherine Backman, William Honer, Bill MacEwan, Chris Richardson, Donald Patrick, Todd Edwards, Michael Anhorn, Regina Casey, Mimi Rennie, Anthony Bailey, Howard Choodos, Stephen Epp, Jeff Massey, William Fisher, & Josh McGrane. Sarah Irving, Marie-eve Letellier, Pasqual Boutin

slide-3
SLIDE 3

+

Mental Illness in Canada

 Affects approximately 6.7 million Canadians1,  Results in reduced workplace productivity and over $50 billion in direct

costs to the healthcare system.1,2

 Living with a serious mental illness may shorten one’s lifespan by

nearly 25 years. 3

 High rates of chronic illnesses as diabetes, obesity, heart ailments and

respiratory diseases

 Vulnerability to homelessness, unemployment and alcohol consumption. 3

slide-4
SLIDE 4

+

Workshop Objectives

1.

Identify current measures of personal recovery available in the literature;

2.

Summarize the current evidence supporting the sensitivity and potential utility of personal recovery scales as outcome measures for research and clinical practice;

3.

Briefly understand how to interpret modern psychometrics methods to select personal recovery scales are fit for purpose to inform important decisions in mental health.

4.

Disseminate knowledge about the optimal use of recovery measures for assessment, planning and evaluation to enhance practice and research.

4

RAS, QPR, IMR, PROM

slide-5
SLIDE 5

5

slide-6
SLIDE 6

Joanne

 38 year old woman diagnosed with schizophrenia at the age of 17.  Referred to OT after 300 bed closer of hospital which she was admitted

to consecutively since age 19.

6

slide-7
SLIDE 7

Recovery

Do they work? What tools do we have to promote recovery? How do we know if they worked?

7

slide-8
SLIDE 8

What do we measure in mental health?

8 Clinical assessment

Hope, Empowerment, Quality of Life, Cognition, Apathy, Depression, Pain, Mastery, Locus of Control, Happiness, Motivation, Readiness for Change………

slide-9
SLIDE 9

9

Hope, Empowerment, Quality of Life, Cognition, Apathy, Depression, Pain, Mastery, Locus of Control, Happiness, Motivation, Readiness for Change………

slide-10
SLIDE 10

10

RECOVERY

slide-11
SLIDE 11

The Recovery Problem

 Single most targeted outcome in mental health

 Individual treatment  Group level  System reform

 Significant gap in the conceptual clarity of recovery and lack of

valid measures that can capture the outcome.

11

slide-12
SLIDE 12

Concepts of interest: Personal Recovery

 Living a satisfying, hopeful, and contributing life, even

with the limitations caused by illness.

William Anthony, 1993

12

slide-13
SLIDE 13

Workshop Objectives

1.

Identify current measures of personal recovery available in the literature;

2.

Summarize the current evidence supporting the sensitivity and potential utility of personal recovery scales as outcome measures for research and clinical practice;

3.

Briefly understand how to interpret modern psychometrics methods to select personal recovery scales are fit for purpose to inform important decisions in mental health.

4.

Disseminate knowledge about the optimal use of recovery measures for assessment, planning and evaluation to enhance practice and research.

13

slide-14
SLIDE 14

How can you measure recovery

14

slide-15
SLIDE 15

15

slide-16
SLIDE 16

+

Measures at our disposal

 See handout

16

slide-17
SLIDE 17

17

slide-18
SLIDE 18

Notes about “measures”

 Need to be fit for purpose for your context of use  Are you “measuring” to develop a recovery profile?  Are you measuring to “measure recovery”

18

slide-19
SLIDE 19

19

slide-20
SLIDE 20

20

Recovery Measures

slide-21
SLIDE 21

Workshop Objectives

1.

Identify current measures of personal recovery available in the literature;

2.

Summarize the current evidence supporting the sensitivity and potential utility of personal recovery scales as outcome measures for research and clinical practice;

3.

Briefly understand how to interpret modern psychometrics methods to select personal recovery scales are fit for purpose to inform important decisions in mental health.

4.

Disseminate knowledge about the optimal use of recovery measures for assessment, planning and evaluation to enhance practice and research.

21

slide-22
SLIDE 22

+

PROM PROJECT: OBJECTIVES

 Global Objective:

 to assess the personal recovery needs of Canadians with severe mental

illness who receive community outpatient mental health services.

 Specific objectives to:

 (i) determine the feasibility of using available personal recovery PROs in a

community outpatient mental health setting;

 (ii) describe the personal recovery profile of a Canadian outpatient sample,

and

 (iii) measure the extent to which the full range of the recovery is covered by

existing rating scales.

22

slide-23
SLIDE 23

The Personal Recovery Outcome Measure (PROM) Project

 Design:

 Cross sectional survey  Single city, Multi-site

 We asked 228 people to fill in 3 commonly used questionnaires

about personal recovery.

23

slide-24
SLIDE 24

Participants

24

slide-25
SLIDE 25

+

25

slide-26
SLIDE 26

26

slide-27
SLIDE 27

+

Results for Objectives i and ii

 Specific objectives to:

 (i) determine the feasibility of using available personal recovery PROs

in a community outpatient mental health setting;

 224/228 people completed ALL of the questions. Questionnaire packs took between 10-30

minutes to complete.  (ii) describe the personal recovery profile of a Canadian outpatient

sample, and

 (iii) measure the extent to which the full range of the recovery is covered by

existing rating scales.

27

slide-28
SLIDE 28

+

Results showed that overall, people in Toronto are highly motivated to succeed, work, and reach their personal goals.

28

slide-29
SLIDE 29

+

Mental health

29

slide-30
SLIDE 30

+

30

slide-31
SLIDE 31

+

31

Progress Towards Personal Goals in the last 3 months

no goal not done anything little way pretty far finished

No GOAL Not done anything Pretty Far A little way Finished

1. Reduce Smoking 2. Clean apartment 3. Build a resume 4. Attend a program

slide-32
SLIDE 32

+

Time in structured roles

32

92 45 43 10 29 <2 3 TO 5 6 TO 15 16-30 30+

Time in structured roles (hours)

80% 40%

slide-33
SLIDE 33

+

REVISIT Mental Illness in Canada

 Affects approximately 6.7 million Canadians1,  Results in reduced workplace productivity and over $50 billion in direct

costs to the healthcare system.1,2

 Living with a serious mental illness may shorten one’s lifespan by

nearly 25 years. 3

 High rates of chronic illnesses as diabetes, obesity, heart ailments and

respiratory diseases

 Vulnerability to homelessness, unemployment and alcohol consumption. 33

slide-34
SLIDE 34

+

So what?

 Specific objectives to:

 (i) determine the feasibility of using available personal recovery PROs in a

community outpatient mental health setting;

 (ii) describe the personal recovery profile of a Canadian outpatient sample,

and

 (iii) measure the extent to which the full range of the recovery is covered

by existing rating scales.

34

Recovery

slide-35
SLIDE 35

Workshop Objectives

1.

Identify current measures of personal recovery available in the literature;

2.

Summarize the current evidence supporting the sensitivity and potential utility of personal recovery scales as outcome measures for research and clinical practice;

3.

Briefly understand how to interpret modern psychometrics methods to select personal recovery scales are fit for purpose to inform important decisions in mental health.

4.

Disseminate knowledge about the optimal use of recovery measures for assessment, planning and evaluation to enhance practice and research.

35

slide-36
SLIDE 36

36

slide-37
SLIDE 37

So what does this tell us:

 “The IMR/RAS/QPR demonstrates excellent psychometric properties”

37

slide-38
SLIDE 38

What is measurement?

38

slide-39
SLIDE 39

The story of measurement

 Rating scales should be developed from clear construct definitions to

ensure that a substantive construct theory determines scale content. a construct theory…. ….is “the story we tell about what it means to move up and down the scale for a variable of interest (eg. Temperature, reading ability, memory). Why is it, for example, that items are ordered as they are on the item map? This story evolves as knowledge increases regarding the construct” (p 308)

Stenner, A., Burdick, H., Sandford, E., and Burdick, D. How accurate are lexile text emasures? J Applied Measurement, 2006; 7: 307-322.

39

slide-40
SLIDE 40

What stories do we try to tell in psychosocial rehabilitation?

Objective Outcomes

 Range of Motion  Speed  Endurance  Weight

Latent Outcomes

 “Functional Ability”  Quality of Life  Depression (e.g. 335 measures)  Pain  Self-efficacy  Recovery

Source: Massof, F. (2010). A clinically meaningful theory of outcome measures in rehabilitation. Journal of Applied Measurement 11(3): 253-70.

40

slide-41
SLIDE 41

How are we measuring outcomes in rehabilitation?

Objective Latent

 i.e., Patient reported outcomes

?

41

slide-42
SLIDE 42

Challenges to measuring outcomes in rehabilitation:

1.

Many constructs not directly observable (latent)

2.

Often measure latent traits using Likert Scales (ordinal)

42

slide-43
SLIDE 43

43

L O W H I G H Depression

slide-44
SLIDE 44

44

slide-45
SLIDE 45

Consequences

45

slide-46
SLIDE 46

Challenges to measuring outcomes in psychosocial rehabilitation:

1.

Many constructs not directly observable (latent)

2.

Often measure latent traits using Likert Scales (ordinal)

3.

Treat ordinal scales like interval scales

46

slide-47
SLIDE 47

How do we report our scores???

47

slide-48
SLIDE 48

Modern Psychometric Methods

Latent trait

Low High

Personal ability Item Difficulty

48

slide-49
SLIDE 49

Natural order to items

 Measurement theory refers to a body of principles, ideas, rules, and

techniques for quantifying some interesting aspect of an object/latent variable. Stand up Walk a few steps Walk a block Walk a mile

Mobility

Item Difficulty Personal ability

49

slide-50
SLIDE 50

Briefly consider…

 You are training me to run a marathon.

50

MARATHON

slide-51
SLIDE 51

Natural order to items

Walk a mile Run 5 miles Run 10 miles Run 20 miles Run marathon Run Boston Marathon

Endurance

Item Difficulty Personal ability

51

slide-52
SLIDE 52

Joanne and Recovery

A B C D E F

Recovery???

Item Difficulty Personal ability (more recovery)

52

slide-53
SLIDE 53

RASCH MODELLING

Person/ Items Less More Recovery QPR

 

2 1 1

     

e e e

 

2 1 1

     

e e e

IMR RAS

slide-54
SLIDE 54

Recovery Assessment Scale

54

slide-55
SLIDE 55

+

Recovery Assessment Scale

55

Recovery Low High

slide-56
SLIDE 56

56

RECOVERY LOW

High

slide-57
SLIDE 57

+

57

slide-58
SLIDE 58

+

58

RECOVERY

slide-59
SLIDE 59

Illness Management Recovery Scale

59

slide-60
SLIDE 60

+

Illness Management and Recovery Scale

60

Low High Recovery

slide-61
SLIDE 61

+

61

RECOVERY

slide-62
SLIDE 62

+

62

slide-63
SLIDE 63

+

Questionnaire Process of Recovery

63

slide-64
SLIDE 64

+

Questionnaire about the process of Recovery (QPR)

64

Recovery

slide-65
SLIDE 65

+

65

RECOVERY

slide-66
SLIDE 66

+

Personal Recovery Outcome Measure

 Conducted focus groups (n=2, total of 19 participants)

 All participants reported a diagnosis of schizophrenia  9 females, 10 males

 What did we do?

66

slide-67
SLIDE 67

+

67

slide-68
SLIDE 68

+

The PROM

 Item bank: 40 item

68

slide-69
SLIDE 69

+

69

slide-70
SLIDE 70

+

70

slide-71
SLIDE 71

PROM

71

Recovery

slide-72
SLIDE 72

72

slide-73
SLIDE 73

So how can I measure recovery?

 Questions to ask

 I have lots of tools out there! Yahoo!!! Which one do I choose?  What story do I want to tell?  How can I tell it?  Is the “best tool” out there fit for purpose for my practice?  How can I use metrics to support the need for psychosocial rehabilitation

services to support people along their entire journey of recovery?

73

slide-74
SLIDE 74

74

Recovery

slide-75
SLIDE 75

+

Vision for the future

75

slide-76
SLIDE 76

+

My vision for psychosocial rehab???

 Gather metrics for:

 time use  participation  recovery

 Advocate for the importance of helping individuals live full and

meaningful lives despite living with a mental illness.

 Advocate for mental health as an outcome for all.

76

slide-77
SLIDE 77

+

Physical health as we know it

77

slide-78
SLIDE 78

+

Mental health?

78

slide-79
SLIDE 79

+

79

slide-80
SLIDE 80

80

slide-81
SLIDE 81

81

slide-82
SLIDE 82

+

Thanks!

For more information of the Personal Recovery

Outcome Measure (PROM) Project, please send me an email: sbarbic@mail.ubc.ca www.skyebarbic.com

82

slide-83
SLIDE 83

+

References

  • 1. Mathers C, Boerma T, Fat DM (2008) The global burden of disease: 2004 update. World Health Organization.

  • 2. Ferrari AJ, Somerville AJ, Baxter AJ, Norman R, Patten SB, et al. (2013) Global variation in the prevalence and incidence of major depressive disorder: a

systematic review of the epidemiological literature. Psychological Medicine 43.

  • 3. Pickett YR, Ghosh SC, Rohs A, Kennedy GJ, Bruce ML, et al. (2014) Healthcare use among older primary care patients with minor depression. American

Journal of Geriatric Psychiatry 22: 207–210.

  • 4. Ciechanowski PS, W.J. K, Russo JE (2000) Depression and diabetes: impact of depressive symptoms on adherence, function, and costs. Archives of

Internal Medicine 160: 3278-3285.

  • 5. Whooley MA, Wong JM Depression and Cardiovascular Disorders. Annual Review of Clinical Psychology 9: 327-354.

  • 6. Freedland KE, Carney RM, Skala JA (2005) Depression and smoking in coronary heart disease. Psychosomatic Medicine 67: S42-46.

  • 7. Alexopoulos GS, Meyers BS, Young RC, Kalayam B, Kakuma T (2000) Executive dysfunction and long-term outcomes of geriatric depression. Archives of

General Psychiatry 57: 285-290.

  • 8. Murray CLJ, Lopez AD (1996) The global burden of disease: a comprehensive assessment of mortality and disability from diseases, injuries, and risk

factors in 1990 and projected to 2020. Boston, MA: Harvard University Press.

  • 9. Andrews PW, Thomson JA, Jr., Amstadter A, Neale MC (2012) Primum non nocere: An evolutionary analysis of whether antidepressants do more harm

than good. Frontiers in Psychology 3: 117.

83