Tiered Fidelity Inventory Us Using t g the he TFI f for r Beha - - PowerPoint PPT Presentation

Us Using t g the he TFI f for r Beha ehavio vioral Da Data-Based Deci d Decision n Making

Tiered Fidelity Inventory

• Dr. Bert Eliason, University of Oregon

Celeste Rossetto Dickey, University of Oregon

Session Objectives

• Understand why the TFI was developed and be informed

about the reliability and validity

• How to prepare teams to be ready for the assessment at

each tier completing the TFI

• How to view reports and use the reports for data-based

decision making

• Learn about one school & district’s action planning

Purpose of the TFI

The purpose of the School- wide PBIS Tiered Fidelity Inventory is to provide an efficient and valid index of the extent to which PBIS core features are in place within a school.

PBIS Applications Website: www.pbisapps.org

Free Fidelity and Outcome Assessments are available for schools and districts!

• The TFI w

was d developed t to provide one a assessment acr cross a all three t tiers t that could b be used for progress m monitoring and annual e evaluation

• Three separate s

studies s show

• Relia

iabilit ility: Consistent results among raters

• Valid

lidit ity: Significant correlation with other measures (BoQ, TIC, SAS, and BAT)

• Usability

ty: Teams reported the TFI as efficient & useful for decision making

Why Use the TFI?

Why another fidelity measure?

SET TIC BoQ SAS ISSET BAT MATT Phases of Implementation (POI) Tiered Fidelity Inventory (TFI)

TFI Assesses All Three Tiers

SWPBIS Tiers:

1.Universal (Tier 1) 2.Targeted (Tier 2) 3.Intensive (Tier 3)

ALL Tiers TFI – Tier 1 TFI – Tier II TFI-Tier III

Assessing All Tiers

T ie r III: Inte nsive SWPBIS F e atur e s

• inte nsive , individua lize d suppo rts
• 1-5% o f stude nt po pula tio n

T ie r II: T ar ge te d SWPBIS F e atur e s

• ta rg e te d , sma ll g ro up suppo rts
• 5 -15% o f stude nt po pula tio n

T ie r I: Unive r sal SWPBIS F e atur e s

• prima ry pre ve ntio n
• 80% o f stude nt po pula tio n

SWPBIS Tiered Fidelity Inventory (TFI)

Resources on www.p .pbisapps.o .org

• SWPBIS Tiered Fidelity Inventory 2.1
• TFI Action Plan Template
• TFI Videos
• Preparation
• Completing and Recording
• Reviewing and Analyzing the Reports
• Action Planning

Resources on www.pbis.org

Tiered Fidelity Inventory

• SWPBIS Tiered Fidelity Inventory V2.1

(revised on Feb 16, 2017)

• SWPBIS Tiered Fidelity Inventory

Walkthrough Tool

• SWPBIS TFI Tier III Support Plan

Worksheet

• Tiered Fidelity Inventory

Training Power Point

PBIS Cultural Responsiveness Field Guide

Available at:

http://www.pbis.org/school/equity-pbis Section II: TFI Cultural Responsiveness Companion

Prep epar aration

• n

for the T e TFI

Preparing to Complete the TFI

Comp mplete t the T TFI C Comp mpanion Tools befo fore the me meeting

• Tier I: TFI Walkthrough (Appendix A)
• Tier II: Targeted Interventions Reference Map (Appendix B)
• Tier III Support Plan Worksheet (Appendix C)
• Us

Use e the r he res esults t s to ans nswer t the s he spec pecified ques questions o s of the T he TFI FI

• Be

Be ab able t to access do ess docum umentation t to assi ssist w with c compl pleting the he TFI FI

• Electronically
• Hard copy

Can be completed by small sub- group

TFI Team Meeting

Time & Place

• Schedule a time and place to complete the TFI without interruptions
• Allow approximately 30 minutes per tier

Team Members & Coach

• Be sure the correct team members are present and the coach is available
• Considerations:
• How are the teams organized?
• One team for all tiers?
• A Tier I and Tier II-III team?
• Separate Tier I, Tier II, and Tier III teams?

TFI Companion Tools

Complete the TFI Companion Tools before the meeting.

• Tier I: TFI Walkthrough
• Appendix A
• Tier II: Targeted Interventions Reference Map
• Appendix B
• Tier III: Support Plan Worksheet
• Appendix C

TFI Walkthrough: Appendix A (pages 27-28)

Appendix A: p. 27 Walkthrough Overview

Use this form to interview a random selection of staff (at least 10%

• f staff or at least 5 for smaller schools) and students (minimum 10).

Staff Interview Questions:

• 1. What are the _________________(school

rules/expectations/“bees,” etc.)?

• 2. Have you taught the school rules/expectations this year?
• 3. Have you given out any ________________ (rewards,

acknowledgements) in the past two months? Student Interview Questions:

• 1. What are the _________________(school

rules/expectations/“bees,” etc.)?

• 2. Have you received any ________________ (rewards,

acknowledgements) in the past two months?

Who completes the Walkthrough?

It is recommended that a person external to the school complete the Walkthrough Tool.

Appendix A: p. 28 Walkthrough Tool

Use this form to write the information about the expectations and acknowledgement system. Use the chart at the bottom to keep track of the answers. Calculate the number of responses.

Tier II: Targeted Interventions Reference Guide

Appendix B

Pages 29-30

Targeted Interventions Reference Guide

The targeted interventions used at the example school are listed across the top. In each column, either a “yes” or “x” is added if the intervention meets the criteria. Appendix B

Tier III: Support Plan Worksheet: Appendix C

Page 31

Preparation

• Complete Appendices A, B, and/or C

before the meeting.

• Use the results to answer the

specified questions of the TFI.

• Be able to access documentation to

assist with completing the TFI.

Possible Data Sources for the TFI: Tier I

The Tiered Fidelity Inventory

Completing & Recording the TFI Items

Completing the TFI

Have the Team Members & Coach present. Allow at least 30 minutes to complete each tier. Complete the TFI as a team

Reminder: * Not an extensive discussion *Save Action Planning for later

2 Fully Implemented 1 Partially Implemented Not Implemented

Coach-guided, Team-based Self-assessment

Recording the TFI Scores

Enter the scores into PBIS Assessment

• This can be done as the team completes the TFI, or
• The scores can be entered at a later time

The scores are entered by a PBIS Assessment Coordinator or a designated Team Member.

• Go to www.pbisapps.org

Accessing & Reporting Results

The Tiered Fidelity Inventory (TFI)

Four Reports Available for the TFI

Tot

• tal S

Scor

• re: Overall implementation percentage for Tiers I-III
• Most helpful when the team is implementing all three tiers

Sc Scale le: Overall implementation percentage for each tier

• 70% is the benchmark for implementation with fidelity

Su Subscale le: Overall implementation percentage for each subscale of each tier

• Tier I subscales: Teams, Implementation, and Evaluation
• Tier II subscales: Teams, Intervention, and Evaluation
• Tier III subscales: Teams, Resources, Support Plans, and Evaluation

Items ms: Each item is listed with the score

• Very helpful for prioritizing and action planning

TFI Total Score Report

Total Score Report: Overall implementation percentage for Tiers I-III This is most helpful when the team is implementing all three tiers.

TFI: Scale Report

Scale Report: Overall implementation percentage for each tier 70% is the benchmark for implementation with fidelity.

TFI: Subscale Report

TFI: Individual Items Report: Tiers I & II

TFI: Individual Items Report: Tier III

Next Steps

• Have team members review the reports
• Schedule a team meeting
• Use the reports to prioritize and develop your Action Plan

Example Action Plan

Celebrate the 2’s! Choose up to three 1’s or 0’s to focus upon.

Sharing the Results & Action Plan for the TFI

• Develop an action plan with the team
• Share the action plan with staff
• Give monthly updates of progress to staff
• Provide an Annual Summary to share with families, staff,

the district, and other stakeholders

Evaluation Summary Example

Annual Summary for Stakeholders Guides PBIS implementation

• Professional development

needs

• Coaching supports
• Re-teaching
• Feedback and

communication with stakeholders

Action Planning with the TFI

• District L

Level: The Items report from PBIS Evaluation assists with planning professional development for the District, and also to evaluate the implementation of Tiers I-III

• Individual S

Schools: The Items Report assists schools in developing their PBIS Action Plan

PBIS Assessments Used Over the Years

• Self Assessment Survey (SAS)
• School Safety Survey (SSS)
• School-wide Evaluation Tool (SET)
• Team Implementation Checklist (TIC)
• Benchmarks of Quality (BoQ)

Too many surveys and difficulty with creating action plans with multiple sources of data. District decision to move to the

Tiered Fidelity Inventory

Current Evaluation Plan

2017 017-18 T TFI C Calendar ar

• August – October : Complete full TFI; First district-wide

PBIS in-service

• January: Assess target tier with TFI and update action

planning

• February: Second district-wide PBIS in-service
• May: Assess target tier with TFI and update action

The Tiered Fidelity Inventory

Exam ample o e of School

• l

Team am A Action

• n P

Planning

One elementary school’s story:

School’s Subscale Report

School’s Items Report

The team noticed that some of the Tier I items had moved from a 2 to a 1.

School Team’s Action Plan

Celebrate the 2’s! Choose up to three 1’s or 0’s to focus upon.

Tier 1 Implementation & Action Plan

Acti tion Plan I Included:

• Provide teachers with booster lesson plans for areas of school as

indicated by data

• Review and re-teach the problem behavior definitions to build

consistency among staff

• Review the classroom versus office managed behavior flowchart

at a staff meeting

The Tiered Fidelity Inventory

Example of

• f District

Team am A Action

• n P

Planning

Distr trict t TFI FI Administr trati tion

All schools have completed the TFI.

TFI by Grade Level/Implementation Level

TFI Report by Tiers

As the District moved to Tier 2 and 3 training, they noticed that the Tier 1 score lowered for some of the schools.

TFI Report by Subscales

In Tier I, there was a decrease in all three subscales

District Action Planning: Tier I (2016-17)

Behavioral Expectations & Problem Behavior Definitions: 50% Annual Evaluation: 30% Celebrate all the items > 70% ! Prioritize items<70% for District Action Planning

District Action Planning: Tier II (2016-17)

Fidelity Data: 28% Level of Use of Tier II Supports: 56%

Celebrate all the items > 70% ! Prioritize items<70% for District Action Planning

District Action Planning: Tier III (2016-17)

Data System: 44% Data Based Decision Making: 44%

Celebrate all the items > 70% ! Prioritize items<70% for District Action Planning

Sharing the Results & Action Plan for the TFI

• Develop an action plan with the School & District teams
• Share the action plan with staff & stakeholders
• Provide updates of progress
• Provide an Annual Summary to share with families, staff,

the district, and other stakeholders

TFI Wrap Up

How often do we complete the TFI?

Annu nnual a assess ssessment of all t thr hree t e tier ers Qua uarter erly for progress monitoring for focused Tier(s)

• May vary depending on school schedule and the action

planning progress completed Annu nnually, after 70% is reached on that particular tier

• The recommendation is once annually
• Depends on your school & context
• Where are you in implementation?
• If you are just starting, do you want a baseline for all three

Tiers? OR

• Do you want to focus only on Tier I

Do we have to complete all three Tiers of the TFI?

Continued Action Planning

Review the action plan progress at each meeting. Celebrate completions & choose other items from the action plan in priority order. PBI BIS = S = Continuous Q Quality Imp mprov

• vement

Questions about District & School Use of the TFI

Contact Information:

• Dr. Bert Eliason

beliason@uoregon.edu Celeste Rossetto Dickey, cdickey@uoregon.edu

Contact Information:

• Dr. Erin Chaparro, echaparro@uoregon.edu

Celeste Rossetto Dickey, cdickey@uoregon.edu