OVERVIEW OF THE GARRETT LEE SMITH (GLS) NATIONAL OUTCOME EVALUATION - - PowerPoint PPT Presentation

▶
overview of the garrett lee
SMART_READER_LITE
LIVE PREVIEW

OVERVIEW OF THE GARRETT LEE SMITH (GLS) NATIONAL OUTCOME EVALUATION - - PowerPoint PPT Presentation

Sep 29, 2022 133 likes •753 views

OVERVIEW OF THE GARRETT LEE SMITH (GLS) NATIONAL OUTCOME EVALUATION AND IRB PROCESSES FOR CAMPUS GRANTEES Jessica Wolff, MPH Jessie Rouder, MA Hope Sommerfeldt, MA November 19, 2015 WEBINAR VIDEO AND HANDOUTS Todays Webinar is being

slide-1
SLIDE 1

OVERVIEW OF THE GARRETT LEE SMITH (GLS) NATIONAL OUTCOME EVALUATION AND IRB PROCESSES FOR CAMPUS GRANTEES

Jessica Wolff, MPH Jessie Rouder, MA Hope Sommerfeldt, MA

November 19, 2015

slide-2
SLIDE 2

2

WEBINAR VIDEO AND HANDOUTS

  • Today’s Webinar is being recorded
  • The slides were e-mailed to you prior to the webinar
  • If you did not receive the message, check your spam e-mail

folder

  • The video will be made available on the Suicide

Prevention Resource Center website and the Suicide Prevention Data Center (SPDC)

slide-3
SLIDE 3

3

NEED ASSISTANCE?

  • For technical support
  • Contact us via the Questions pane
  • E-mail Betty.Treschitta@icfi.com
slide-4
SLIDE 4

4

  • GLS National Outcomes Evaluation
  • Prior Evaluation Findings
  • Evaluation Design
  • Data Collection for the National Outcomes Evaluation
  • Institutional Review Board (IRB) Processes
  • Suicide Prevention Data Center (SPDC)
  • Evaluation Training and Technical Assistance

ON TODAY’S AGENDA

slide-5
SLIDE 5

5

  • ICF has conducted the National Suicide Prevention

Evaluation since 2005

  • ICF has worked with over 200 Campus grantees and
  • ver 190 State/Tribal grantees
  • ICF houses the largest repository of youth suicide

prevention data in the United States

ICF AND THE NATIONAL OUTCOMES EVALUATION

slide-6
SLIDE 6

6

WHY IS THE EVALUATION IMPORTANT ?

The National Outcomes Evaluation can contribute to:

  • Program improvement
  • Local evaluation
  • Sustainability
  • The overall evidence base for suicide prevention programming
  • Impact assessments of GLS program activities

SAMHSA Evaluation Goal “The goal of the GLS Youth Suicide Prevention programs and the NSPL is the reduction of suicide and suicide attempts across America. In

  • rder to accomplish this critical, lifesaving work,

it is essential that the effectiveness of these programs be evaluated on an ongoing basis, with implementation of suicide prevention programs continually informed by evaluation results”

slide-7
SLIDE 7

7

GLS SUICIDE PREVENTION PRIOR EVALUATION FINDINGS

slide-8
SLIDE 8

8

CAMPUS PREVENTION STRATEGIES

0% 10% 20% 30% 40%

Means restriction Hotlines and helplines Assessment & referral training Screening programs Policies and protocols Other strategies Life skills development Coalitions and partnerships Gatekeeper training Outreach and awareness

Percentage of budget expenditures on prevention strategies

Data Source: Prevention Strategies Inventory; GLS Cross-site Evaluation Annual Report September 2014

slide-9
SLIDE 9

9

PERCENTAGES OF STATE, TRIBAL AND CAMPUS GRANTEES WHO HAVE IDENTIFIED OUTREACH AND AWARENESS STRATEGIES FOCUSING ON EACH PRIORITY POPULATION

slide-10
SLIDE 10

10

PRIOR EVALUATION FINDINGS

  • Campus grantees have

conducted almost 9,000 trainings and trained

  • ver 270,000

individuals in suicide prevention.

Source: Training Activity Summary Page, October 2006–July 2015; State/Tribal Cohorts 1–9 and Campus Cohorts 1–8.

slide-11
SLIDE 11

11

slide-12
SLIDE 12

12

GLS SUICIDE PREVENTION NATIONAL OUTCOMES EVALUATION DESIGN

slide-13
SLIDE 13

13

NOE DESIGN OVERVIEW

slide-14
SLIDE 14

14

EVALUATION QUESTIONS

Evaluation Questions Study EQ 1: Are certain training approaches effective in building capacity to increase youth identification (when compared with more basic trainings)? Training Study EQ 2: Are GLS prevention activities effective in developing continuity of care from identification, to referral of youth at risk for suicide, to the provision of needed services? Continuity of Care Study EQ 3: To what extent are grantees and associated providers implementing suicide safer environment/Zero Suicide frameworks? Does this framework implementation lead to decreases in suicide attempts and completions? Suicide Safer Environment Study

slide-15
SLIDE 15

15

QUESTIONS?

slide-16
SLIDE 16

16

DATA COLLECTION FOR THE NATIONAL OUTCOMES EVALUATION

slide-17
SLIDE 17

17

PREVENTION STRATEGIES INVENTORY

slide-18
SLIDE 18

18

PREVENTION STRATEGIES INVENTORY (PSI) Purpose

  • Inventory of all prevention strategies and

products that are a part of grantee GLS funded programs

  • Expenditures: Total amount of GLS funds

(including in-kind) expended to date, and the percent of funds expended to date by strategy

slide-19
SLIDE 19

19

SUICIDE PREVENTION STRATEGIES

PREVENTION STRATEGIES INVENTORY (PSI)

COALITIONS/ PARTNERSHIPS

POLICIES/ PROTOCOLS OTHER PREVENTION STRATEGIES OUTREACH & AWARENESS GATEKEEPER TRAINING ASSESSMENT, CLINICAL & REFERRAL TRAINING LIFE SKILLS & WELLNESS DEV. SCREENING PROGRAMS HOTLINES/ HELPLINES MEANS RESTRICTION

slide-20
SLIDE 20

20

PREVENTION STRATEGIES INVENTORY (PSI)

  • Strategies Budget Expenditure
  • Direct costs that you can map to each category
  • Aim to account for 75%-80% of your expenditures
slide-21
SLIDE 21

21

PREVENTION STRATEGIES INVENTORY (PSI)

Who is responsible for data collection for the PSI? Grantee Program Staff How is the PSI administered/entered? Web-based form entered into SPDC When will the PSI be administered? Once per quarter, throughout the grant period When will the PSI begin? January 2015

slide-22
SLIDE 22

22

TRAINING ACTIVITY SUMMARY PAGE

slide-23
SLIDE 23

23

TRAINING ACTIVITY SUMMARY PAGE (TASP) Purpose

  • Gathers aggregate training information for

training activities implemented

  • Collects trainee role, setting, intended outcome

and booster training information

slide-24
SLIDE 24

24

TRAINING ACTIVITY SUMMARY PAGE (TASP)

Who is responsible for TASP data collection/entry? Grantee Program Staff How is the TASP administered/entered? Information submitted via the SPDC using web-based form or excel spreadsheet upload When is the TASP administered? Within 2 weeks of training activity,

  • ngoing throughout the grant

period When will the TASP begin? As soon as training activities begin

slide-25
SLIDE 25

25

STUDENT BEHAVIORAL HEALTH FORM

slide-26
SLIDE 26

26

STUDENT BEHAVIORAL HEALTH FORM (SBHF)

  • A proposed SBHF is currently under OMB review
  • Additional information/resources about the SBHF

will be sent to all grantees following the webinar– these are intended to serve as a resource for preparing to compile upcoming information

slide-27
SLIDE 27

27

STUDENT BEHAVIORAL HEALTH FORM (SBHF)

…Will be completed a total of three times by all campus grantees over the course of their grant period …Will be completed during late spring/early summer (Date TBD) …Will include questions regarding the most recent academic year and the four prior academic years.

slide-28
SLIDE 28

28

STUDENT BEHAVIORAL HEALTH FORM (SBHF)

The SBHF gathers information about:

  • Behavioral health services on campus
  • Screenings and assessments of suicide risk
  • Services for students at risk of suicide
  • Suicide attempts and completions

The instrument includes a mix of quantitative questions (e.g., how many suicide attempts occurred on campus?) and policy related questions (e.g., after a suicide attempt, what happens?).

slide-29
SLIDE 29

29

STUDENT BEHAVIORAL HEALTH FORM (SBHF)

Who is responsible for data collection for the SBHF? Grantee Program Staff How is the SBHF administered/entered? Web-based form entered into SPDC When will the SBHF be administered? Annually, during the late spring/early summer When will the SBHF begin? Pending OMB approval

slide-30
SLIDE 30

30

Youth Exploratory Services Interview

slide-31
SLIDE 31

31

YOUTH EXPLORATORY SERVICES INTERVIEW (YESI)

  • Newly developed activity to learn about the service

experience of youth who are identified at risk and receive a referral to mental health provider ― Demographics ― Setting and source of early identification ― Status of treatment ― Identification experience ― Service experience

  • Students that were identified by a campus gatekeeper and

referred for mental health services

slide-32
SLIDE 32

32

YESI INCLUSION PATHWAY

Participant engages with Grantee Under 18: Participant obtains parental consent for screening/survey 18+: Participant consents for screening/survey Consented participant is screened for suicide risk Participant receives positive screen Participant receives follow up assessment for suicide risk Participant identified as at risk for suicide Participant is referred for care to study partner provider ICF received frame of consented, screened, referred participants from grantee ICF contacts participants to participate in YESI

slide-33
SLIDE 33

33

YOUTH EXPLORATORY SERVICES INTERVIEW (YESI)

Who is responsible for data collection for the YESI?

Grantee program staff will obtain consent from parents and youth who have been referred for services and send to ICF. ICF will follow-up with youth within 3 months of referral to conduct interview

Who are the YESI respondents?

Youth identified at risk that were referred for services including those who followed up

  • n referral and those who did not

How is the YESI administered/entered?

Phone interview completed by NOE team

When will the YESI be administered?

Beginning Fall 2016

Will participants receive an incentive? Yes, a $20 money order

slide-34
SLIDE 34

34

QUESTIONS?

slide-35
SLIDE 35

35

INSTITUTIONAL REVIEW BOARD (IRB) PROCESSES

slide-36
SLIDE 36

36

ROLE OF THE IRB

Protect the rights and welfare of individual research subjects and ensure:

  • Risk to subjects are minimized and reasonable in relation to

anticipated benefits

  • Selection of subjects is fair
  • Informed consent is appropriately documented
  • When appropriate, the research plan makes provisions for

monitoring data collection

  • Privacy and confidentiality of research subjects is

appropriately protected

slide-37
SLIDE 37

37

ROLES AND RESPONSIBILITIES

  • ICF’s IRB reviews the National Outcomes Evaluation

protocol and provides approval for ICF to conduct the State/Tribal and Campus evaluations

  • Grantee IRB (or appropriate entity) reviews relevant

National Outcomes Evaluation data collection activities before grantee can participate/submit data and either

– Provides IRB approval – Determines monitoring is not required by the grantee IRB (i.e., determines data collection is exempt from IRB approval)

slide-38
SLIDE 38

38

IRB PROCESSES

IRB Submission Submit local IRB application, which may require:

  • Objective of

the study and instruments used

  • Respondents

(how many, who)

  • Risk to human

subjects

  • Data collection

methods Update ICF Once the review is complete, grantees must submit documentation of the determination (e.g., IRB approval

  • r exempt from IRB

approval) to ICF

  • Forward to GLS-

IRB@icfi.com Keep IRB Status Current

  • Update your

local IRB about data collection revisions (via amendments)

  • Know your

local IRB requirements for renewal

  • Submit

renewals to ICF Determine what approval(s) are needed to participate in the NOE:

  • Campus IRB
  • Tribal Council

ICF will provide materials and technical assistance to help with your local application IRB Preparation

IRB Questions? Contact Gina Sgro at GLS-IRB@icfi.com

slide-39
SLIDE 39

39

NEXT STEPS

  • Revised and new instruments are under review at OMB
  • Submit current instrument versions for approval NOW
  • Submit an amendment for revised and new instruments

AFTER OMB clearance is obtained

Now After OMB Approval

  • PSI
  • TASP
  • Updated PSI
  • Updated TASP
  • SBHF
  • YESI
slide-40
SLIDE 40

40

QUESTIONS?

slide-41
SLIDE 41

SUICIDE PREVENTION DATA CENTER (SPDC)

slide-42
SLIDE 42

WHAT CAN GRANTEES DO ON THE SPDC?

Download evaluation

Monitor data collection View evaluation Enter, download, modify data instruments Access reports Find links to helpful resources announcements

slide-43
SLIDE 43

HOW DO I ACCESS THE SPDC?

Grantee SPDC users provided with username and password

slide-44
SLIDE 44

44

SPDC USERS

  • No public access - Access requires a user

name and password

  • Who are appropriate users of the SPDC in

your community?

  • Are there any concerns about who to

include/exclude?

  • SPDC has various levels of security for users
slide-45
SLIDE 45

45

SPDC USERS (CONT.)

Project Director Trainers Evaluator Program Staff Sub grantee Staff National Evaluation Team GLS Program Partners SAMHSA GPOs SPRC PSs

slide-46
SLIDE 46

46

SECURITY AND USER LEVELS

Security level for each individual should be determined by the primary functions they serve

User Security Levels

  • Site Administrator—highest level of access
  • Site User—medium level of access
  • Contact User—lowest level of access

No identifying information collected

  • No information reported with <10 cases
slide-47
SLIDE 47

47

ASSIGNING USER LEVELS

  • ICF will create one site administrator account for each

grantee

  • Site admins register new users
  • Site administrators can also…
  • Designate users
  • Assign user security level (e.g., site user or contact user)
  • Provide username and password
  • Edit or delete users
slide-48
SLIDE 48

48

ASSIGNING USER LEVELS

Working with Partners – Direct Entry

Project Director: Admin Evaluator: Admin Trainer: Contact Trainer: Contact Trainer: Contact

SPDC

slide-49
SLIDE 49

49

ASSIGNING USER LEVELS

Working with Partners – Admin Entry

SPDC

Project Director: Admin Program Director: Admin Trainer Trainer Trainer

slide-50
SLIDE 50

50

LOG IN SCREEN

WWW.SUICIDEPREVENTION-DATACENTER.COM

slide-51
SLIDE 51

51

HOME SCREEN

slide-52
SLIDE 52

52

NAVIGATION

slide-53
SLIDE 53

53

SPDC Problems OR Questions Hope.Sommerfeldt@icfi.com OR Spdc-help@icfi.com

slide-54
SLIDE 54

54

EVALUATION TRAINING AND TECHNICAL ASSISTANCE

slide-55
SLIDE 55

55

EVALUATION TRAINING AND TECHNICAL ASSISTANCE

  • Support data collection and

submission

  • Send monthly email to grantees
  • Overall NOE guidance

T echnical Assistance Liaison (TAL)

  • Support data collection and

submission

  • NOE instrument specific

guidance

Data Collection Liaison (DCL) Evaluation and Reporting

slide-56
SLIDE 56

56

TECHNICAL ASSISTANCE LIAISON CONTACT

Campus TAL: Jessica Wolff 404-592-2229 (Eastern Time Zone) Jessica.Wolff@icfi.com

slide-57
SLIDE 57

57

DATA COLLECTION LIAISON CONTACTS

NOE Instrument Data Collection Liaisons (DCLs) Prevention Strategies Inventory (PSI) Erin Maher gls-psi@icfi.com 617-250-4289 (Eastern Time Zone) Student Behavioral Health Form (SBHF) Jessie Rouder Jessie.Rouder@icfi.com or gls-mis@icfi.com 646-695-8138 (Eastern Time Zone) Training Activity Summary Page (TASP) Bhuvana Sukumar Gls-tasp@icfi.com 404-592-2122 (Eastern Time Zone)

slide-58
SLIDE 58

58

GRANTEE ROLES AND RESPONSIBILITIES

 Obtain appropriate local approvals including IRB approval  Participate in training and technical assistance activities  Participate in data collection and submission activities  Send monthly call agenda/updates to your TAL

slide-59
SLIDE 59

59

MARK YOUR CALENDAR!

National Outcomes Evaluation Data Collection Instruments and Data Submission Processes

December 10, 2015 3:00-4:30pm ET

slide-60
SLIDE 60

60

QUESTIONS?

slide-61
SLIDE 61

61