Universal Screeners Academic Achievement Committee November 14, - - PowerPoint PPT Presentation

Universal Screeners

Academic Achievement Committee

November 14, 2016

Strategic Plan: Teaching and Learning Goals Assessment

Long Term Goal  Implement a balanced range of national, state, and local assessments to monitor student learning and use results to guide instruction Short Team Goals  Research alternative universal screeners Integration  Ensure high quality instruction that allows staff/teachers to meet the readiness of different students happening across teachers in all classrooms and  Extend learning for students who already mastered content and provide re-teaching/support for students struggling with content

Three Big Ideas of Assessment

 Assessment of achievement and growth provide a complete picture of student learning.  Assessments are given for different reasons.  Assessments measure depth of knowledge.

Assessment Instruction

Curriculum

Uses of Universal Screeners

Universal screeners are standardized achievement tests that are given to all students to determine for all students:  Instruction and interventions needed now  Progress in learning over time  Placement decisions next year

Multi-Tiered System of Universal Screeners

Given to some students more frequently to monitor progress Given to a few students most frequently to monitor progress Given to all students to assess achievement, make instructional decisions, determine the need for additional testing, monitor progress, and make placement decisions

District Goals for Universal Screeners

Identify effective universal screeners that demonstrate:  TIME: the least amount spent testing that gives the most robust results (efficient and effective)  STRETCH: a wide range in the level of questions asked that gives achievement information for all students  UTILITY: results useful in making instructional decisions for all students

Current Universal Screeners Tier 1: ELA

SCREENER TIME STRETCHUTILITY ____________________________________________________________

AIMSweb G K-3 (3 x year) S: 10 minutes grade level MTSS for students group and 1:1 test T: 10 minutes per at risk student; 60 minutes for scoring G 4-6 (3 x year) S: 20 minutes grade level MTSS for students group and 1:1 test T: 20 minutes per at risk student; 90 minutes for scoring ____________________________________________________________________________ Fountas and Pinnell G K-3 (3 x year) S: 20 minutes per various levels guided reading 1:1 test reading level groups for all T: 11 subs over students 4 weeks of testing G 4-6 (2 x year) S: 30-60 minutes various levels guided reading 1:1 test per reading level groups for all T: 43 subs over students 8 days of testing ____________________________________________________________________________ Gates-MacGinnities G 3-5 (1 x year) S: 60 minutes grade level placement for group test T: 60 minutes all students ____________________________________________________________________________ G = Grade S = Student T= Teacher

Current Use of Universal Screeners Tier 1: Math

SCREENER TIME STRETCH UTLITY ____________________________________________________________

AIMSweb G 2-3 (1 x year) S: 20 minutes grade level placement for all group test T: 20 minutes; 120 students minutes for scoring G 4-6 (3 x year) S: 20 minutes grade level MTSS for students group test T: 20 minutes; 120 at risk; placement minutes for scoring for all students ___________________________________________________________________________ CDT G 3-6 (3 x year) S: 90 minutes adaptive MTSS for all group test T: 90 minutes students ___________________________________________________________________________ Orleans-Hanna G 6 (1 x year) S: 75 minutes grade level placement for all group test T: 75 minutes students ___________________________________________________________________________ SAT-10 G 4-5 (1 x year) S: 70 minutes grade level placement for all group test T: 70 minutes students ___________________________________________________________________________ G = Grade S = Student T = Teacher

Need for More Effective Universal Screeners

Concerns about Current Test Administration

• Length of time spent testing
• Teachers often out of class
• Delays in getting results
• Questions on grade level only
• Students become familiar with

questions

• Manual scoring and data entry

can lead to errors

• Results best used for students

who struggle

• Redundancies and gaps found in

administration of tests

• Delays in implementing

interventions

Preferences for Future Test Administration

• Less time spent testing
• Teachers less often out of class
• Results immediately available
• Questions adaptive
• Vast question bank lessens

chance for question familiarity

• Computerized scoring lessens

chance for error

• Results best used with all

students

• Overlapping tests consolidated

and gaps in testing filled

• Interventions implemented

immediately TIME STRETCH UTILITY

Process for Finding New Universal Screeners

TIMELINE March, 2016 Presentations to whole Assessment Committee from vendors of NWEA/MAP and STAR 360 July, 2016 Decision to explore STAR 360 and CDT as possible replacements universal screeners K-6 Parameters of exploration

Adaptive questions Connected to standards and curriculum ELA and Math assessments both Given in fall at Richland and Eden Hall

Exploration Teachers and Committee Members

 Richland Teachers

 (K) Becky Fickes  (1) John Hackworth  (2) Alison Monk  (3) Elizabeth Grover, Jen Fulford

 Eden Hall Teachers

 (4) Janet Bock, Kristen Kiser, Tom Belchick, Christina Strine

• (5) Chris Turner, Lindsey Hobaugh, Silvio Andreassi, Erin Clark
• (6) Nate Goheen, Dana Lestitian, Robyn Wenzel, Laura Gray

 Universal Screener Committee

 Gene Nicastro, Steve Smith, Noel Hustwit, Maura Paczan, Missy Ramirez, Laura Davis

Exploration Timeline

October, 2016

• Communication about the exploration to Board, teachers, and

parents

• Digital accounts created for CDT ELA; STAR 360 ELA and Math
• Teacher feedback form created in google apps
• Other districts using STAR 360 identified and interviewed

November, 2016

• Tests administered October 31-November 2
• Teacher feedback collected through November 7
• Results presented to Board November 14

STAR 360 Experience at Richland

Demonstration of Test Student Experience Review of Reports

STAR 360 Experience at Eden Hall

Demonstration of Test Student Experience Review of Reports

CDT Experience

Description of Test Student Experience Review of Reports

AIMSweb Reports

Concerns with AIMSweb reports:

Complex Critical feedback from parents Modified to be more user friendly

Comparisons to STAR 360 and CDT

Comparison of Universal Screeners ELA

AIMSweb Fountas and Pinnell STAR 360 CDT

Time Given to groups

• f students; 10-

20 minutes; 2 or 3 times a year Given individually to students; 15-60 minutes; 2 or 3 times a year Given to groups

• f students; 20-

30 minutes; 3 times a year Given to groups

• f students; 90

minutes, 3 times a year Stretch All questions on grade level; results useful for students below grade level Wide range of reading levels tested; results useful for all students Adaptive questions asked; results useful for all students Adaptive questions asked; results useful for all students Utility Used for MTSS for students at risk Used for MTSS and flexible grouping for all students Used for MTSS and flexible grouping for all students Strong PSSA predictor; useful with MTSS for all students Cost $15,000 annually (ELA and Math combined cost) Financial cost of substitutes about $25,000;

• pportunity cost
• f lost teacher

time in class $75,000 in first year; $42,000 from second year on (ELA and Math combined cost) No use fee

Comparison of Universal Screeners MATH

AIMSweb STAR 360 CDT

Time

Given to groups of students; 20 minutes; 1 or 3 times a year Given to groups of students; 30 minutes; 3 times a year

Given to groups of students; 75-90 minutes, 3 times a year Stretch

All questions on grade level; results useful for students below grade level Adaptive questions asked; results useful for all students

Adaptive questions asked; results useful for all students Utility

Used for MTSS for students at risk Used for MTSS for all students

Strong predictor of PSSA performance; useful with MTSS for all students Cost

$15,000 annually (ELA and Math combined cost) $75,000 in first year; $42,000 from second year

• n (ELA and Math

combined cost)

No user fee

Feedback from Districts Using STAR 360

Quaker Valley

• Give STAR 360 ELA and Math in

grades 3-8; DIBELS K-2 (paper and pencil); Easy CBM Math K-2 (online)

• Test takes 20-30 minutes; whole

group

• Easy for students once logged on;

easy to administer; 1 year of implementation

• Use results for MTSS to set

achievement goals and provide growth measures for all students

• Very pleased with results and reports
• May use in K-2 in future; CDTs take

too long

Fox Chapel

• Give STAR 360 ELA and Math in

grades K-8; AIMSweb for special education students; F & P for very high and very low ability students

• Test takes 20-30 minutes; whole

group

• Easy for students to take; easy to

administer; 10 years of implementation

• Use results to set learning goals and

demonstrate growth for all students, even for advanced

• Very pleased with results and reports
• Use CDTs only for Biology

TIME and ADMINISTRATION STRETCH and UTILITY

Universal Screeners of Cognitive Abilities

Universal screeners of cognitive abilities are given to all students in a grade level for the purposes of:  Testing general intellectual and reasoning ability, including verbal and non-verbal ability and quantitative reasoning  Providing information about discrepancies between predicted achievement levels and observed achievement levels for all students  Identifying students for additional testing

Review of the CogAT (Cognitive Abilities Test)

Research of the CogAT universal screener found the following benefits:  Computerized; takes 30 minutes  Scores available within 48 hours after testing  Tests verbal and non-verbal ability and quantitative reasoning  Age-based results; use national norms  High ceilings of test questions reduces need for out of grade level testing  Cost of universal screener: $8.75 per student

Emerging Recommen- dations

 For SY 2017-2018 replace all universal screeners with STAR 360 ELA and Math, grades K-6  Discontinue use in grades K-6 of: AIMSweb Literacy and Math CDT Math Fountas and Pinnell Reading SAT-10 Math Gates-MacGinnities Reading Orleans-Hanna Math  Continue use of CDT Math, CDT Algebra 1,CDT Literature, and CDT Biology, grades 7-11  Add CDT ELA and CDT Science to the middle school  Add CogAT, grades 2 and 5  Use STAR 360 ELA and Math to monitor progress of students in Tier 2 and Tier 3 interventions, grades K-12