Elevating Lived Experience in Coordinated Entry Evaluation THE ROLE - - PowerPoint PPT Presentation

▶
elevating lived experience in coordinated entry evaluation
SMART_READER_LITE
LIVE PREVIEW

Elevating Lived Experience in Coordinated Entry Evaluation THE ROLE - - PowerPoint PPT Presentation

Jan 09, 2023 153 likes •934 views

Elevating Lived Experience in Coordinated Entry Evaluation THE ROLE OF QUALITATIVE DATA 1 Elevating Lived Experience in CES Evaluation Understand how to Consider tech options to Become familiar with include qualitative data in streamline

slide-1
SLIDE 1

Elevating Lived Experience in Coordinated Entry Evaluation

THE ROLE OF QUALITATIVE DATA

1

slide-2
SLIDE 2

2

Elevating Lived Experience in CES Evaluation

Understand how to include qualitative data in the CE eval framework Become familiar with qualitative data collection & analysis strategies Consider tech options to streamline feedback processes

slide-3
SLIDE 3

3

Elevating Lived Experience in CES Evaluation

slide-4
SLIDE 4

4

Agenda

slide-5
SLIDE 5

5

Rationale

HUD requirements Better & more actionable data Honoring diversity, equity & inclusion

slide-6
SLIDE 6

6

Elevating Lived Experience in CES Evaluation

HUD requirements

Coordinated Entry Notice Section II.B.15

slide-7
SLIDE 7

7

Elevating Lived Experience in CES Evaluation

and HUD Guidance

slide-8
SLIDE 8

8

Elevating Lived Experience in CES Evaluation

Better, more actionable data

“When we consult the experts, service implementations are made more relevant and responsive.”

slide-9
SLIDE 9

9

Elevating Lived Experience in CES Evaluation

Honoring diversity, equity, and inclusion

slide-10
SLIDE 10

10

Let’s Go

slide-11
SLIDE 11

11

slide-12
SLIDE 12

12

Qualitative Data Strategies

slide-13
SLIDE 13

13

Qualitative Data Strategies

slide-14
SLIDE 14

14

Qualitative Data Strategies

slide-15
SLIDE 15

15

Qualitative Data Strategies

slide-16
SLIDE 16

16

Qualitative Data Strategies | Valence

slide-17
SLIDE 17

17

Qualitative Data Strategies | Multipart Qs

slide-18
SLIDE 18

18

Qualitative Data Strategies

slide-19
SLIDE 19

19

Qualitative Data Strategies

Qualitative data Mixed methods HMIS data

slide-20
SLIDE 20

20

slide-21
SLIDE 21

21

Data Collection Considerations

slide-22
SLIDE 22

22

Data Collection Considerations

slide-23
SLIDE 23

23

Data Collection Considerations

slide-24
SLIDE 24

24

Data Collection Considerations|Being Concrete

slide-25
SLIDE 25

25

Data Collection Considerations

slide-26
SLIDE 26

26

Data Collection Considerations

* aka retrospective cued recall

slide-27
SLIDE 27

27

Qualitative Data Strategies

slide-28
SLIDE 28

28

Data Collection Considerations

slide-29
SLIDE 29

29

Notes from the Field

slide-30
SLIDE 30

30

Using Participant, Provider, and Community Leader Focus Groups for CE Evaluation

slide-31
SLIDE 31

31

Perspective Learning

Who are the customers?

  • Still Homeless
  • Formerly Homeless
  • Intake/Case Manager/Outreach staff
  • Program Managers and Executive

Directors

  • Community Champions and Visionaries
slide-32
SLIDE 32

32

Still Homeless Formerly Homeless Intake Workers/ Case Managers/ Outreach Staff Program Managers and Executive Directors Community Champions and Visionaries

slide-33
SLIDE 33

33

Focus Group Design

Previously Housed

  • Organizations to whom referrals

were made for permanent housing resources

  • Each organization identified 1-3

potential participants

  • Used a flyer to standardize

information about focus groups

  • Offered payment for client time, via

gift cards

Still Homeless

  • Names were randomly selected from

by-name list

  • Shelter staff talked with potential

participants to gauge willingness to participate

  • Provided lunch as participation

incentive

  • Offered payment for client time, via

gift cards

slide-34
SLIDE 34

34

Focus Group Design

Intake/Case Manager/ Outreach and Program Manager/ Executive Director

  • Blanket invitation for each organization to

voluntarily participate

  • Organizations chose representatives
  • Organization representatives limited to 1

Visionaries and Champions

  • Completely self-identified and balanced by the community
slide-35
SLIDE 35

35

Implementation: Still Homeless and Formerly Homeless

  • Encourage storytelling to understanding

client involvement in CE process

  • Use language appropriate to the group

participants

  • Always pay for participant time
  • Use a facilitator who is a person the

clients don’t associate with influencing their ability to get housing.

slide-36
SLIDE 36

36

Implementation: Other Focus Groups

  • Ensure a common understanding of CE

process

  • Use information from prior groups to

stimulate discussion and clarify challenges

  • Get participants to articulate their idea
  • f where they fit in the process and

where they provide best value

slide-37
SLIDE 37

37

Conduct focus groups in order: still homeless to champions Use information from prior focus groups to refine questions for following focus groups Use an objective person to take notes and document the discussion

slide-38
SLIDE 38

38

Let still homeless/formerly homeless tell their stories and identify qualitative data through their storytelling Be completely non-judgmental Know the CE system design and participating agencies before conducting the focus groups Community responsibility for recruiting and balancing participants

slide-39
SLIDE 39

39

Do not use a local person to conduct still homeless focus group, to minimize expectations for participation. Make sure you have a really good

  • notetaker. Don’t try to facilitate AND

take notes. Always strive to use good research and eval techniques, such as random selection and participant balancing.

slide-40
SLIDE 40

40

Useful Resources

Guidelines for Conducting a Focus Group https://irep.olemiss.edu/wp- content/uploads/sites/98/2016/05/Trinity_Duke_How_to_Conduct_a_Focu s_Group.pdf Center for Community Health and Development Community Toolbox, Chapter 3, Section 6 https://ctb.ku.edu/en/table-of-contents/assessment/assessing- community-needs-and-resources/conduct-focus-groups/main

slide-41
SLIDE 41

41

?

slide-42
SLIDE 42

42

slide-43
SLIDE 43

43

Qualitative Data Analysis is Content Analysis

slide-44
SLIDE 44

44

Qualitative Data Analysis is linked to…

  • An inductive, bottom-up approach to the

collection and description of the data

  • Results in a qualitative interpretation
  • Often communicated visually, e.g.

through a diagram

slide-45
SLIDE 45

45

Content Analysis Steps

Close reading to develop codes (tags) Group codes into categories… And categories into themes Analyze & interpret

slide-46
SLIDE 46

46

Content Analysis Steps

Close reading to develop codes (tags)

  • Read, read, reread text
  • Label chunks of text with key

words and phrases (codes)

  • Iterate: you can re-read and

apply multiple codes to the same passages

  • Use highlighting, underlines,

comments etc. as needed

slide-47
SLIDE 47

47

Content Analysis Steps

Close reading to develop codes (tags)

example

slide-48
SLIDE 48

48

Content Analysis Steps

  • Group your tags into categories
  • e.g. ‘felt angry at staff’
  • If you’ve color-coded or used

key words, create your themes based on this

  • Move text around, rearrange it,
  • etc. to facilitate the process
  • For rigor, have a partner who

does the same

Organize tagged text into themes

slide-49
SLIDE 49

49

QDA Steps

  • Group your categories into

themes -e.g. ‘feelings about staff’

  • Move text around, rearrange

it, etc. to facilitate the process

  • Iterate until you have a

cohesive set of 4-8 themes

Organize themes into categories

slide-50
SLIDE 50

50

Content Analysis Steps

  • Interpret the data by using

frequency analyses to describe categories and themes and

  • Stratify by positive and

negative sentiment, if useful and

  • Highlight key words/ key

phrases

Analyze and interpret using frequencies

slide-51
SLIDE 51

51

QDA utilizing AI

slide-52
SLIDE 52

52

QDA Using AI

  • Sentiment analysis
  • Emotion detection
  • Keyword extraction
slide-53
SLIDE 53

53

QDA Semantic Analysis with AI

Open source, low cost/no cost option

slide-54
SLIDE 54

54

QDA Sentiment Analysis with AI

pasted text

slide-55
SLIDE 55

55

QDA Sentiment Analysis with AI

slide-56
SLIDE 56

56

Key words

https://www.jasondavies. com/wordcloud/

slide-57
SLIDE 57

57

QDA Tools

Quick Guide

slide-58
SLIDE 58

58

slide-59
SLIDE 59

59

Streamlining Tools and Resources

Lean Data and Listen4Good model Efficiency and automation through tech

slide-60
SLIDE 60

60

Lean Data & Listen4Good Model

  • Emphasize rigorous but efficient

methods for soliciting feedback from a large number of clients

  • The methods are streamlined

through a variety of tech options

  • The emphasis is on listening to,

and acting upon, the voices of those who receive services

slide-61
SLIDE 61

61

Lean Data & Listen4Good Model

5 core survey questions underlie the model

  • 1. How likely is it that you would recommend […] to

a friend or family member?

  • 2. What is […] good at?
  • 3. What could […] do better?
  • 4. Overall, how well has [….] met your needs?
  • 5. How often do staff at […] treat you with respect?
slide-62
SLIDE 62

62

Lean Data & Listen4Good Model

The answers to these questions, especially the question #3: “What could […] do better,” allow clients to suggest ways to promulgate change. Profiling their input and its influence on program delivery and on clients’ own self-advocacy changes the story lens, putting client agency at the center.

slide-63
SLIDE 63

63

Lean Data & Listen4Good Model

Perceptual Feedback: What’s it all about?

slide-64
SLIDE 64

64

Closing the Loop

slide-65
SLIDE 65

65

Tech Options

Tools to implement efficient & effective QDA

  • Internet-based technologies*
  • Mobile Apps
  • Text messaging (SMS)

* Including computer transcription

slide-66
SLIDE 66

66

Tech Options

Lean Data Field Guide

slide-67
SLIDE 67

67

Tech Options

Enhancing evaluation through technology

slide-68
SLIDE 68

68

Tech Options

Quick Guide

slide-69
SLIDE 69

69

Notes from the Field

slide-70
SLIDE 70

The Power of Feedback

A homeless provider in Little Rock, AR closes the loop

vimeo.com/316157380

slide-71
SLIDE 71

The Power of Feedback

A homeless services

  • rganization

in Salt Lake City collects direct feedback daily with kiosks

https://www.youtube.com/w atch?v=F_zlIShnxrI

slide-72
SLIDE 72

72

Privacy, Confidentiality and Informed Consent

slide-73
SLIDE 73

73

?

slide-74
SLIDE 74

Andrea Miller Waypoints Consulting wma.waypoints@gmail.com

74

Contact Us!

Slide deck and resource guides will be available at the NHSDC website https://nhsdc.org/

slide-75
SLIDE 75

75

Please complete the NHSDC evaluation survey

slide-76
SLIDE 76

76

Thank you!