Tier 2 Fidelity Data: Strengthening your Tier 2 PBIS Implementation: - - PowerPoint PPT Presentation

▶
tier 2 fidelity data
SMART_READER_LITE
LIVE PREVIEW

Tier 2 Fidelity Data: Strengthening your Tier 2 PBIS Implementation: - - PowerPoint PPT Presentation

Sep 19, 2023 305 likes •872 views

Tier 2 Fidelity Data: Strengthening your Tier 2 PBIS Implementation: Using Fidelity Measures to Promote Growth in Tier 2 Implementation March 2020 Celeste Rossetto Dickey, M.Ed. University of Oregon Introductions and Welcome School Staff

slide-1
SLIDE 1

Tier 2 Fidelity Data:

Strengthening your Tier 2 PBIS Implementation:

Using Fidelity Measures to Promote Growth in Tier 2 Implementation

March 2020

Celeste Rossetto Dickey, M.Ed. University of Oregon

slide-2
SLIDE 2

Introductions and Welcome

  • School Staff Member
  • PBIS Coach
  • Family Member
  • Tier 2 Team Facilitator
  • Tier 2 Team Member
  • Other?
slide-3
SLIDE 3

Objectives for today:

  • Understand the importance of fidelity data
  • Tier 2 Systems
  • Tier 2 Interventions
  • Understand how to use the TFI Tier 2 data for

action planning

  • Become knowledgeable about various Tier 2

Interventions fidelity assessments

slide-4
SLIDE 4

Multi-Tiered System of Supports (MTSS)

All spec ecialized i inter erven entions a are m e more e effec ective e and m more e durable e with unive vers rsal, s sch chool-wide b behavioral e expecta tations a as a foundation Tertiar iary—intensive, individualized supports 5% of student population at high risk Secondary—targeted, group-based supports 5% - 15% of student population at risk Un Universal al—primary prevention provided to all students, effective for approximately 80%

slide-5
SLIDE 5

Overarching Goals at Tier 2 (across interventions)

Provide s students w with:

  • More time a

and instruction f for s skill d development

  • More s

structure a and p predictability

(during a routine/subject or across the day)

  • Struct

ctured p performance f feedback ck

  • Sel

elf-man anag agement s skills

(self-monitoring, self-instruction, self-correction)

slide-6
SLIDE 6

Critical Components of Tier 2

1.

  • 1. Standardized r

routines a and procedures

  • Aligned with school-wide expectations
  • All school staff trained

2.

  • 2. Continuously available w

with r rapid s student a acce ccess

  • Standard is within 3 days of identification

3.

  • 3. Low t

teach cher/staff e effort

  • Typically, less than 10 minutes per teacher per day

4.

  • 4. Home/school lin

l linkage

slide-7
SLIDE 7

Types of Information (Data)

7

Outcome Data Fidelity Data

Is the plan resulting in progress toward our goals? Did we implement the systems and strategies we agreed upon?

slide-8
SLIDE 8

Connecting Fidelity & Outcome Data

Lucky Sustaining

Positive outcomes, low understanding of how they were achieved Replication of success is unlikely Positive outcomes, high understanding of how they were achieved Replication of success likely

Losing Ground Learning

Undesired outcomes, low understanding of how they were achieved Replication of failure likely Undesired outcomes, high understanding of how they were achieved Replication of mistakes unlikely

Outcomes Fidelity

8

slide-9
SLIDE 9

Fidelity Data at Tier 2 Examples

Fidelity ty to to S SWP WPBIS F S Framework

  • rk

at t Tie ier 2 r 2 Fidelit lity to s

  • specif

cific ic T Tier 2 inter erven entions Quick “ ck “Mi Micr cro” C

  • ” Check

cks

  • Tiered Fidelity Inventory (TFI) –

Tier 2 section

  • Benchmark of Advanced Tiers (BAT)
  • CICO Self-Assessment
  • Group Assessments
  • Counseling Group Lesson Plan
  • Observations, interviews, surveys
slide-10
SLIDE 10

How often should we collect & analyze fidelity?

It depends….

  • Initial implementation
  • Restarting or indications of low fidelity
  • Recent student and staff turn-over

The l long-term g goal i is to to move ve to to annual fidel delity c chec hecks f s for bi big pi g picture a e and nd week eekly/monthly o

  • r qua

quarterly c chec hecks i s in- bet etween. en.

slide-11
SLIDE 11

Fidelity Assessment of the Tier 2 System

slide-12
SLIDE 12

How do you currently assess the fidelity of your Tier 2 system?

  • Tiered Fidelity Inventory (TFI)
  • Benchmarks of Advanced Tiers (BAT)
  • We use a different assessment
  • We aren’t currently assessing Tier 2
  • I don’t know

Poll

www.menti.com

slide-13
SLIDE 13

SWPBIS Tiered Fidelity Inventory (TFI)

TFI is available FREE at pbisapps.org (Applications > PBIS Assessment)

slide-14
SLIDE 14
  • The TFI was developed to provide one assessment across all

three tiers that could be used for progress monitoring and annual evaluation.

  • Three separate studies show
  • Reliability: Consistent results among raters
  • Validity: Significant correlation with other measures (BoQ, TIC, SAS,

and BAT)

  • Usability: Teams reported the TFI as efficient & useful for decision

making

Why use the TFI?

slide-15
SLIDE 15

Time & Place

  • Schedule a time and place to complete the TFI
  • Allow approximately 30 minutes per tier

Team Members & Coach

  • Be sure the correct team members are present and the coach is

available

Complete Interventions Reference Map

  • Appendix B
  • Complete before the meeting

Preparing to Complete the TFI

slide-16
SLIDE 16

Tier II: Targeted Interventions Reference Map (Appendix B)

Targeted Interventions Reference Map Description Complete the Reference Map as a team

  • List the targeted interventions across the

top row

  • Check off each of the functions provided

by the intervention in the columns below

  • Allow 15-30 minutes to complete
  • Use the information to complete items

2.5 and 2.7 of the TFI

slide-17
SLIDE 17

Targeted Interventions Reference Guide

slide-18
SLIDE 18

Tier 2 Section

Tier 2: TFI

Feature: 13 Items Possible Data Sources Scoring Criteria: 0-2

slide-19
SLIDE 19

Possible Data Sources for the TFI

slide-20
SLIDE 20

▲Tier 2 team meeting minutes (last two) ▲Rubric for selecting students for Tier 2 support ▲Tier 2 strategy handbooks, or procedures (i.e., CICO) ▲Available Tier 2 data summaries (if possible for 2 months) ▲Family communication systems ▲Most recent fidelity measures for Tier 2 strategies ▲Intervention Tracking Tool*

Pos

  • ssible

le Data Sources for Tier 2

slide-21
SLIDE 21

Intervention Tracking Tool Examples

slide-22
SLIDE 22

TFI Total Score Report

Total Score Report: Overall implementation percentage for Tiers 1-3 This is most helpful when the team is implementing all three tiers.

slide-23
SLIDE 23

TFI Reports – Overall by Tiers

  • 1. Is Tier 1 SWPBIS being

implemented with high fidelity (at least 70%)?

  • 2. If yes, is Tier 2 SWPBIS being

implemented with high fidelity (at least 70%)?

  • 3. If yes to both, is Tier 3 SWPBIS

being implemented with high fidelity (at least 70%)?

slide-24
SLIDE 24

TFI: S Subscale Report rt

slide-25
SLIDE 25

TFI Tier 2 Team Subscales

Team Composition Team Operating Procedures Screening Request for Assistance

slide-26
SLIDE 26

TFI Reports: Interventions Subscale

Options for Tier 2 Interventions Tier 2 Critical Features Practices Matched to Student Need Access to Tier I Supports Professional Development

slide-27
SLIDE 27

TFI Reports: Evaluation Subscales:

Level of Use Student Performance Data Fidelity Data Annual Evaluation

slide-28
SLIDE 28

TFI Reports – Individual Items

Use for team action planning

slide-29
SLIDE 29

Action Planning Meeting

  • Provide I

e Item ems s Repo eport f for all pa participants t s to review

  • On paper or electronically
  • Cel

eleb ebrate a e all t the he 2’ 2’s! s!

  • Develop way to share results with staff & stakeholders
  • Choos
  • ose 1

1-3 3 Items f for Action P n Plann nning ng

  • < 2
  • Priority for the team
  • Easier items first can be helpful
slide-30
SLIDE 30

TFI Evaluation Brief (Kittleman, et.al. 2017) What Tier 2 subscales and items on the TFI have the highest and lowest scores?

slide-31
SLIDE 31

Tier 2 Items

Tier 2: Highest: Team Composition Tier 2: Lowest: Fidelity Data

slide-32
SLIDE 32

TFI Fidelity 2:12

slide-33
SLIDE 33

Our TFI Tier 2 Total Score was below 70%

  • Which subscale(

e(s)?

  • Which items

ms?

  • Which i

item tem(s) d ) do y you w want to t to f focus on? “Our Tier 2 r 2 Scale score is below 70%. The subscale of Eval aluation ion is the area we need to focus on, specifically with Item tem 2 2:12 o

  • n f

fidel elity data f for o

  • ur T

Tier 2 2 inter terven

  • entions. W

We aren’t d t doing t g the f e fidel elity chec ecks for o

  • ur T

Tier 2 2 inter terven entions consisten entl

  • tly. The staff are reporting that

t the fidel elity c chec ecks t take e to too m much time to e to c complete. e.”

Item Analysis for Action Planning

Step 1 Step 2

slide-34
SLIDE 34

Action Planning Next Steps

Items Actions Who When Evaluation Item 2:12 (fidelity data for our Tier 2 interventions scored 1.0). We aren’t doing the weekly Tier 2 fidelity checks

  • consistently. The staff

are reporting that the fidelity checks take too much time to complete. Group to revise fidelity check; put in teacher’s boxes each Friday Susan, Michael & Rachelle Friday Put the current checks in teacher’s boxes quarterly Paloma Quarterly

Step 3

slide-35
SLIDE 35

TFI Activity

Review the TFI Items & Information Choose up to 3 items (0 or 1) for action planning Look at the information sheet for additional resources Develop an Action Plan with specific information Be ready to share

  • ut your action

plan items

10 minutes

slide-36
SLIDE 36

Fidelity Assessments for Tier 2 Interventions

slide-37
SLIDE 37

How do you mainly assess fidelity of Tier 2 interventions?

  • Assessment Tool
  • Observation
  • Survey
  • Feedback
  • We don’t have Tier 2 interventions
  • We don’t assess fidelity
  • Other
slide-38
SLIDE 38

Which ch T Tier 2 2 Interventio ions d doe

  • es y

your sch choo

  • ol u

l use? e?

List the Tier 2 interventions at your school

slide-39
SLIDE 39

Fidelity Check Examples

slide-40
SLIDE 40

CICO Intervention Fidelity

Available on www.pbisapps.org

slide-41
SLIDE 41

BEP/CICO Fidelity Measure

  • Formal evaluation of the

critical features of CICO

(formerly known as the BEP)

  • There are 13 items scored

from 0-2 based on review

  • f permanent products,

interviews, and

  • bservations

Free Online Download Search term: BEP-FIM

slide-42
SLIDE 42

CICO Self Assessment & Action Plan

Available on www.pbisapps.org

slide-43
SLIDE 43

Quick “Micro” Checks of CICO fidelity

  • Observations
  • Morning & Afternoon Checks
  • Teacher Checks
  • Team Meetings
  • Review permanent products (e.g., point cards)
  • Quick surveys or interviews
slide-44
SLIDE 44

CICO Weekly Checks

slide-45
SLIDE 45

CICO Weekly Fidelity Check

slide-46
SLIDE 46

Other Tier 2 Intervention Fidelity Examples

slide-47
SLIDE 47

ASCA Lesson Plan

slide-48
SLIDE 48

Counseling Group Fidelity Checklist

slide-49
SLIDE 49

Mentor Program Fidelity Checklist

slide-50
SLIDE 50

Fidelity Checks: Social Skills Groups

slide-51
SLIDE 51

Social Skills Fidelity Checklists – Missouri SWPBS

slide-52
SLIDE 52

Developing Assessments

  • You can use common free and

low-cost technologies to create informal and quick assessments for interventions

slide-53
SLIDE 53

Intervention Fidelity Activity

List the Tier 2 interventions at your school List any fidelity measures used for the interventions List any fidelity measures to consider adding at your school:

slide-54
SLIDE 54

Continuous Quality Improvement

Identify problems with precision Establish goal(s) Develop solution(s) Implement solution(s) with integrity and fidelity Monitor

  • utcomes and

compare to goal(s) Reassess and revise solution(s) as needed

slide-55
SLIDE 55

Questions & Comments?

Celeste Rossetto Dickey University of Oregon training@pbisapps.org