to Meet the CCRPI Challenge Bobby Smith bobbysmith2020@outlook.com - - PowerPoint PPT Presentation

Bobby Smith bobbysmith2020@outlook.com 229-221-7164

Developing a Game Plan to Meet the CCRPI Challenge

http://www.ciclt.net/sn/clt/cpresa/default.aspx?Cli entCode=cpresa

http://www.ciclt.net/sn/clt/cpresa/default.aspx?ClientCode=cpresa Show Files

• 1. Redeliver this presentation -- in small chunks --

to your leadership team.

• 2. Make connections to TKES (and LKES).
• 3. Push understanding of the categories,

indicators, and scoring to the teacher level.

• 4. Engage them with the spreadsheets.
• 5. Charge SLT members with redelivering the

presentation and spreadsheets to the staff.

• 6. Use your staff as ambassadors of information to

the outside stakeholders.

Achievement Points (50 pts)

Progress Points

(SGPs ≥ 35)

40 pts

Achievement GAP

(Lowest Quartile)

10 pts Challenge Points (10 pts)

Content Mastery

(Wt. GMAS)

20 pts

Post School Readiness

15 pts

Graduation Predictor

15 pts

ED/EL/SWD Performance Flags

(Wt. GMAS)

Exceeding the Bar Indicators

CCRPI Performance Categories

Achievement Points (50 pts)

Progress Points

(SGPs ≥ 35)

40 pts

Achievement GAP

(Lowest Quartile)

10 pts Challenge Points (10 pts)

Content Mastery

(Wt. GMAS)

20 pts

Post School Readiness

15 pts

Graduation Predictor

15 pts

ED/EL/SWD Performance Flags

(Wt. GMAS)

Exceeding the Bar Indicators

CCRPI Performance Categories

A 90 Second Overview

What actions, strategies, practices, initiatives, programs, or interventions are we using to impact each category?

The CCRPI Over Time

2017?

20 15 15

5 2.5 15

2016 Elementary School College & Career Ready Performance Index

(40% of 50 Points) (30% of 50 Points) (30% of 50 Points)

20 15 15

5 3 15

2016 Middle School College & Career Ready Performance Index

20 15 15

2.5 2.14 10 5

2016 High School College & Career Ready Performance Index

Achievement Points (50 pts)

Progress Points (SGPs) (40 pts)

Achievement

Gap (10 pts)

Challenge Points (10 pts)

Content Mastery (Tests) (21 pts) Readiness (15 pts) Graduation (15 pts) ED/EL/SWD Performance (Flags) Exceeding the Bar Indicators

CCRPI Performance Categories

FAY FAY FAY FAY FAY 3-5 6-8 3-5 6-8 9-12 4-5 6-8 3-5 6-8 9-12 3-5 6-8 9-12 9-12

CCRPI Changes

High School Indicator Changes

Year Indicators ETBs 2015 18 10 2016 17* 10 2017 18** 9**

*Writing Assessment Indicator removed. **Work-based learning/Capstone/IB Project moved from ETB Section to “Face” indicators.

Middle School Indicator Changes

Year Indicators ETBs 2015 10 6 2016* 10 6 2017 10 6

*Top students taking Algebra and Physical Science EOCs count in 2016.

Elementary Indicator Changes

Year Indicators ETBs 2015 11 7 2016 11 7 2017 12* 6*

*Indicator on 5th Grade Career Portfolios moved from ETB Section to the “Face” Indicators.

Progress Points based only

• n ELA & Math (SGPs 35 and higher)

Achievement Gap Points based only

• n ELA & Math

HS/MS/ES

20 Content Mastery Points

• 15 points for ELA & Math
• 5 points for Science and SS

ES/MS

Proposed 2017 Content Mastery Scoring for Elementary and Middle.

(Effect of Senate Bill 364)

7.5 7.5 2.5 2.5

http://www.gadoe.org/Curriculum-Instruction-and- Assessment/Accountability/Pages/default.aspx

http://gosa.georgia.gov

Indicator Scoring Details Indicator Scoring with benchmark at 100% Indicator Scoring with benchmark <100% Attendance Indicator Scoring

Lexile Calculations and Improvement

Category Comparison and Improvement

Indicator Comparison and Improvement

Data Analysis: A fact finding event Not a fault finding event

Not everything that counts can be counted, and not everything that can be counted counts.

Power Strategies for Milestones and CCRPI

• Good readers and writers will rule the earth.
• Perform data analysis to identify greatest areas of need

(low hanging fruit).

• Review strategies in your current SIP to see if the greatest

areas of need are addressed.

• Design new strategies to address greatest areas of need.
• Code CCRPI Indicators into your SIP.
• Remember that the big problems require K-12 solutions.
• Progress monitor key CCRPI metrics.
• Celebrate whenever possible.

Drilling for the WHO and the WHAT

26

WHO? WHAT?

Student Groups Content Domains

Domains % of Test History 50% Geography 15% Government/Civics 20% Economics 15%

Domain Performance Fifth Grade Social Studies

Domains % of Test Colonization through the Constitution 20% New Republic through Reconstruction 20% Industrialization, Reform, and Imperialism 15% Establishment as a World Power 20% Modern Era 25%

• U. S. History

Domain Performance

• Some investigators stop at symptoms rather than going on to

deeper level root causes.

• The current knowledge of investigators may limit results because

they cannot find causes that they do not already know.

• A facilitator may be needed to ask the right questions.
• Different investigators may come up with different causes for the

same problem.

• Some investigators tend to focus on a single root cause -- whereas

each question could elicit several different root causes.

• In most cases processes, rather than people, are the problem.

Root Cause Analysis Issues

Leadership Team work at a Mid-Year Data Retreat

• 1. Review current SIP strategies using Green light, Yellow light, & Red

light to assess effectiveness.

• 2. Analyze 2015 CCRPI data, down to the component & indicator

levels.

• 3. Analyze 2016 CCRPI data, down to the component & indicator

levels.

• 4. Benchmark the 2016 CCRPI results to an average or “A” school.
• 5. Analyze the 2015 Milestones Content Area Summaries down to the

domain level.

• 6. Analyze the 2016 Milestones Content Area Summaries down to the

domain level.

Leadership Team work at a Mid-Year Data Retreat

• 7. Analyze the writing scores of the 2015 & 2016 ELA Milestones
• 8. Analyze 2016 Climate Star data and compare to 2015.
• 9. Analyze Median SGP data from SLDS for 2015 and 2016.
• 10. Review other data from local assessments for 2016.
• 11. Check 2017 data that counts in CCRPI for accuracy (Grad Rate,

Work-based learning, attendance, discipline, etc.)

• 12. Engage SLTs to answer Key Questions.

If all teachers are effective, what accounts for poor domain performance and the lack

• f growth?

 Is lack of time spend on the domain a factor?  Are the tested standards being taught?  Do local tests “match” state tests in rigor?  What is the quality of lessons/units?  Do teachers have access to quality resources?  Are students familiar with the test format?

2015-16 Content Area Summaries 2015-16 CCRPI Reports Data Details Spreadsheets Median SGPs from Ga SG Model GOSA Tool Local Assessment Results Other Data/GaDOE Resources

Needed for Mid-Year Data Retreat

• Perform data analysis to identify greatest areas
• f need (low hanging fruit).
• Review strategies in your current SIP to see if

the greatest areas of need are addressed.

• Begin to design new strategies to address

greatest areas of need.

• Remember that the big problems require K-12

solutions.

• Establish leading indicators for monitoring.
• Celebrate whenever possible.

Improving CCRPI Performance

• Attack weak domains.
• Tweak pacing guides.
• Improve instructional resources.
• Analyze local assessments.
• Familiarize students with the format.
• Use GaDOE/RESA Resources.
• Encourage healthy competition.
• Be positive with students.

Improving CCRPI Performance

What is your school’s strongest performance category on the CCRPI? What is your school’s weakest performance category on the CCRPI?

Content Mastery Post School Readiness Predictor for Graduation Progress Achievement Gap

What are your school’s strongest indicators

• n the CCRPI?

What are your school’s weakest indicators

• n the CCRPI?

What is your school’s strongest content area in the Progress Category? What are your school’s weakest content area in the Progress Category?

What is your school’s strongest content area in the Achievement Gap Category? What are your school’s weakest content area in the Achievement Gap Category?

What is your school’s strongest content area in the Flag section? What are your school’s weakest content area in the Flag section? What is your school’s highest performing subgroup in the Flag section? What is your school’s lowest performing subgroup in the Flag section?

What is your school’s strongest Area in the Climate Stars? What is your school’s weakest Area in the Climate Stars? What do the results of the student, staff, and parent surveys say about your school?

Do all of your instructional staff members know the answers to all of the previous questions?

Background on Student Growth Percentiles

Students obtain growth percentiles, ranging from 1 to 99, which indicate how their current achievement compares with that of their statewide academic peers who had similar score histories.

Student Test Scores Converted to Student Growth Percentiles Test Scores SGPs 525 50

SGPs SLDS

Median (Middle)

SGPs CCRPI

% 35 and Above

SGPs TEM & LEM Mean (Average)

http://gastudentgrowth.gadoe.org

Three Different SGPs

Levels of Growth for Students

SGP Ranges Type of Growth

1-34 Low Growth 35-65 Typical Growth 66-99 High Growth

Drilling into SGPs

SGPs 35 or Higher By Content Area

56% 49% 38% 49%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ELA Math Science SS

Percent of SGPs 35 or Higher

Higher Achievement Lower Achievement Lower Growth Higher Achievement Higher Growth Lower Achievement Higher Growth Lower Growth % Meets & Exceeds Median Student Growth Percentile

100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% http://gastudentgrowth.gadoe.org

Achievement Gap (10 Points)

• Compares the average of a school’s lowest

quartile to the state average.

• Compares how much the students in the

lowest quartile have grown in the last year.

• Schools get credit for the higher of the two

calculations.

Two Ways Points Are Calculated:

SMART Goal: Increase graduation rates for subgroups by designated percentages shown in Appendix A. Actions, Strategies, Interventions

• 1. Implement extra learning time for struggling seniors (CCRPI 16-17)

a) Zero Block -- Before school tutoring b) Fifth Block -- After school tutoring c) SOS Program (Save Our Seniors) – Tutoring during lunch

• 2. Implement differentiation/UDL (TAPS #4)

CCRPI Needs Built into SIP

SMART Goal: Increase by 5% the number of students who miss fewer than 6 days per year. (CCRPI #10; Climate Stars-Attendance) Actions, Strategies, Interventions

• Individual classroom incentives
• School-wide recognition
• Parent communication
• Counselor phone calls after 3 absences
• Consistent procedures and use of district attendance protocol
• Student recognition for perfect attendance in a grading period
• Perfect attendance group photos hung in a visible location
• Grade level competition displayed on lunchroom wall

CCRPI Needs Built into SIP

SMART Goal: Increase by 5% the percentage of students achieving Lexile targets. (CCRPI #7 and #8) Actions, Strategies, Interventions

• Establish personal Lexile goals
• Implementation and utilization of PLCs to study Lexiles/Reading
• Increase opportunities with reading software as needed
• Set goals with students and monitor the goals
• Monitor progress of student goals through student conferencing
• Align the taught and tested curriculum with grade level standards
• Utilize Achievement Level Descriptors in PLCs
• Celebrate individual student, classroom, and grade level success.

CCRPI Needs Built into SIP

Challenge and Support ALL Quartiles with high quality instruction.

Climate Stars

Surveys Discipline Safe & Substance Free Environment Attendance

School Climate Star Rating Student Discipline

Suspension Weights:

• Any # of ISS:

0.5 pts.

• 1 – 2 OSS:

1.0 pts.

• 3 – 4 OSS:

3.0 pts.

• 5 – 9 OSS:

5.0 pts.

• 10 or More OSS

7.0 pts.

• Alternative School Assignment 6.0 pts.

(for disruptive students only)

• Expulsion

7.0 pts.

Second Order Changes for Students

• New Curriculum
• More Rigorous Assessments
• More than Multiple Choice
• Stronger Focus on Writing Skills
• Stronger Focus on Critical Reading Skills
• Testing on Computers
• Four New Achievement Levels Reported
• New Scoring Scales

The Impact of a Single Teacher

Student Growth Percentiles Achievement GAP Lexile Levels Content Mastery Proficient Distinguished Percentages

What Works Best With the Media?

“These results come as no surprise to us.” “We had already analyzed the data and predicted the

• utcome in all of the content areas.”

“We are already developing plans – grade level by grade level and in all subject areas – to address any weaknesses that we have -- just as we have done in the past.”

What Works Best with Low Climate Stars?

“These results come as no surprise to us.” “We had already analyzed the data and knew how we were performing in all domains of the Climate Stars. “We have developed a plan for improving our performance in discipline and student attendance.” “We have dealt appropriately with a few students who had behavior issues.” “We are committed to protecting the learning environment for all students.” “Good behavior and great attendance are non-negotiables.”

What I have learned:

• We must engage the staff.
• We must “torture the data until it confesses.”
• We must build key metrics into our plans.
• We must periodically monitor the key metrics.
• We must make mid-course corrections.
• We must keep up with CCRPI Changes.

http://ccrpi.gadoe.org/2016/

Regression Analysis

Fall 2013 Newton Math Spring 2014 Math CRCT 77 804 76 802 75 800 74 799 73 797 72 795 71 794 70 792

Predictor Score

Descending Order

Dealing with Teacher Unrest “I wish all of this mess would go away so I could just teach!”

Pass Rates

• n State Tests

Miscellaneous Indicators

Grad Rates or Readiness for Next School

Student Growth Year to Year

Scores of Weakest Students

College and Career Readiness Performance Index 2016 C C R P I

Climate Stars

1 to 5 Stars based on:

• Surveys of Students, Staff, Parents
• Discipline Data
• School-Wide Attendance
• Safe and Substance Free School

Challenge Points

Up to 10 additional points added for:

• Flags for Performance of SWD, EL, &
• Econ. Disadvantaged Students
• Exceeding the Bar Indicators for

staff/student/school performance

3-Year Average for Focus Schools 3-Year Average for Priority Schools

http://ccrpi.gadoe.org/2016 http://ccrpi.gadoe.org/2015 http://www.gadoe.org/Curriculum-Instruction-and- Assessment/Accountability/Pages/default.aspx http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Georgia- Milestones-Assessment-System.aspx http://gastudentgrowth.gadoe.org http://gosa.georgia.gov http://gosa.georgia.gov/interactive-education-data-map https://www.gadoe.org/External-Affairs-and-Policy/Policy/Pages/School-Climate.aspx

Links to Key Websites