SPECIALIZED PROFESSIONAL ASSOCIATION (SPA) | ELCC 2017 Fall CAEP - - PowerPoint PPT Presentation
CAEPCON 2017 SPECIALIZED PROFESSIONAL ASSOCIATION (SPA) | ELCC 2017 Fall CAEP Conference Presented by Joan Auchter, NPBEA SPA Program Administrator Washington Hilton Hotel September 24, 2017 ELCC Discussion CAEPCON 2017 Guidelines for
ELCC CAEPCON 2017
SPECIALIZED PROFESSIONAL ASSOCIATION (SPA) | ELCC
2017 Fall CAEP Conference
Presented by Joan Auchter, NPBEA SPA Program Administrator
Washington Hilton Hotel September 24, 2017
Preparation (NELP) Standards
ELCC CAEPCON 2017
CAEP NPBEA ELCC/ NELP SPA
Rela lationship ips and Responsibil ilities Among the Organizations
Council for Accreditation of Educator Preparation (CAEP)
Umbrella organization that sets the Specialty Professional Associations (SPA)s
process.
The e Nati tional l Polic
Board for
l Admin inis istration (NP (NPBEA)
The National Policy Board for Educational Administration is a national alliance of major membership organizations committed to the advancement of school and school-system
creates educational leadership standards, and owns the ELCC/NELP SPA. NPBEA members include AACTE, AASA, CCSSO, ICPEL, NAESP NASSP, and UCEA.
The e Nati tional l Educational l Lea Leadership Prep eparation (NE (NELP) SPA
Deals with all building and district level educational leadership program reviews which provides evidence that program candidates have a strong foundation of content and pedagogical knowledge in the educational leadership program area. Program review is part of the overall accreditation process and occurs prior to the self- study and on-site accreditation visit. Educator Preparation Provider (EPPs) then use the results of program review as evidence to meet applicable CAEP standards.
http://npbea.org/
ELCC CAEPCON 2017
Licensure
in Each School
Placement/ Mentors
Pipeline
Institutions
Education/ CAEP School District Level State Level
National Organizations
WHO BENEFITS FROM NPBEA STANDARDS AND SPA REVIEWS?
ELCC CAEPCON 2017
CAEP’S ANNUAL CALENDAR OF ACTIVITIES
September 15
Oct 15 – Nov 15
Nov 15 – Jan 1
Jan 1 – Feb 1
February 1
March 15
April 15 – May 15
May 15 – July 1
July 1 – August 1
August 1
ELCC CAEPCON 2017
ELCC CAEPCON 2017
for the preparation of superintendents, principals, curriculum directors or supervisors at the master’s degree, post-master’s, specialist, or doctorate levels should respond to these guidelines.
keep profile updated in AIMS.
ELCC CAEPCON 2017
7 STANDARDS & ELEMENTS ARE THE FOUNDATION
ELCC CAEPCON 2017
CRITICAL RECOGNITION ELEMENTS
STANDARDS- AND EVIDENCE-BASED DESIGN
ELCC CAEPCON 2017
SIX ASSESSMENTS - DISTRICT
ELCC CAEPCON 2017
ELCC CAEPCON 2017
Program must include a one-page description to inform reviewers how the internship/clinical experience(s) have been designed to meet ELCC Standards 7.1 and 7.3 Assessment 4 evaluates candidate skills (ELCC 7.2)
Section I. Context
Specifies general program information
the AIMS Manage Faculty Information view
into each program report
to narrative questions
ELCC CAEPCON 2017
Section II. List of Assessments Section III. Relationship of Assessments to
Standards
Section IV. Evidence for Meeting Standards
For each assessment, attach one document that
includes the assessment, scoring guide/criteria, data tables and a 2-page maximum narrative
Section V. Use of Assessment Results to
Improve the Program
Describe how faculty are using the data from
assessments to improve candidate performance and the program, as it relates to content knowledge, pedagogical and professional knowledge, skills and dispositions, and student learning.
ELCC CAEPCON 2017
ELCC CAEPCON 2017
CRITICAL RECOGNITION ELEMENTS
SECTION IV: EVIDENCE FOR MEETING STANDARDS
A brief description of the assessment and its use in
the program (one sentence may be sufficient);
A description of how this assessment specifically
aligns with the standards it is cited for in Section III. Cite SPA standards by number, title, and/or standard wording.
A brief analysis of the data findings; An interpretation of how that data provides evidence
for meeting standards, indicating the specific SPA standards by number, title, and/or standard wording;
ELCC CAEPCON 2017
ELCC CAEPCON 2017
ELCC CAEPCON 2017
Section IV. Evidence for Meeting Standards
For each assessment, attach one document that
includes the assessment, scoring guide/criteria, data tables and a 2-page maximum narrative
ELCC CAEPCON 2017
Assessments
Assessment Directions Scoring Rubric
Evaluative Criteria Data Charts
ELCC CAEPCON 2017
Definition of Alignment
The concepts addressed in the ELCC standard elements
are visible in the assessment and scoring guide to the same degree of depth, breadth, and specificity.
Does not require exact wording of the standard
element in the description of the assessment or the scoring guide. However, same concepts must be there.
STANDARDS ASSESSMENT SCORING GUIDE/CRITERIA DATA TABLES
ELCC CAEPCON 2017
ELCC CAEPCON 2017
explicitly aligned to the standards that “ask” learners (directions) to demonstrate their knowledge and skills
If you don’t ask for it, you can’t measure it.
ELCC CAEPCON 2017
Can be the assessment tool itself or a rich description of
the assessment (often the directions given to candidates for completing the assignment)
Where possible, indicate standard alignment to
assessment tasks (e.g. ELCC 3.1 or ELCC 3.2) so reviewers can easily find your evidence
ELCC CAEPCON 2017
ELCC CAEPCON 2017
to review.
elements you identified?
standard element. Are the assessment directions clearly aligned with the identified standard element? If not, how can you better align the standard element with the assessment?
ELCC CAEPCON 2017
ELCC CAEPCON 2017
scales explicitly aligned to the standards and assessment to reliably measure the learner’s evidence
You can only measure WHAT you “asked” for in the assessment directions
SECTION IV: ALIGNING THE SCORING GUIDE/CRITERIA
Design a scoring guide or a likert scale
instrument that explicitly defines the criteria you will use to evaluate the degree of candidate mastery of the essential ELCC Standards concepts required in the assessment.
The scoring guide instrument must evaluate a preponderance of the standard
elements
align to the assessment description and
directions
ELCC CAEPCON 2017
ELCC CAEPCON 2017
2011 ELCC SCORING GUIDE (RUBRIC) STARTER CHARTS
2011 ELCC DISTRICT STANDARDS, PAGE 15
ELCC CAEPCON 2017
first assignment. Review the assessment scoring rubric.
you identified in the assessment?
performance using descriptions of what a reviewer would expect to see at each level? (does not rely on subjective use of qualifiers)?
element indicators to describe what the candidate must demonstrate for each standard element?
ELCC CAEPCON 2017
Data tables should relate back to what is
measured in the scoring guide instrument.
Report data at the standard level, not element
standard quality as a whole.
Initial reports must include TWO applications
ELCC CAEPCON 2017
ELCC CAEPCON 2017
Review the data table you provided for your selected assessment.
Does you data table relate back to what is measured in
the scoring guide instrument?
Does you data table report data at the standard level,
not element level?
Did you separate the data tables by year and include the
N?
ELCC CAEPCON 2017
Use of Assessment Results to Improve Program (Section V)
Educational Leadership Preparation Program Assessment Results Self-Analysis Semester Reviewers Names/Titles Data Reviewed Findings Suggested Modifications to Strengthen Program Fall Spring Summer
ELCC CAEPCON 2017
In this section of the program report, the program is asked to describe how it is using the data from assessments to improve candidate performance and the program as it relates to content knowledge, pedagogical and professional knowledge, skills and dispositions and student learning. This description should not link improvements to individual assessments but, rather, it should summarize principal findings from the evidence, the faculty's interpretation of those findings, and changes made in (or planned for) the program as a result. Developing an Improvement Process It is important to include your process for evaluating data to inform program improvement, including those involved in the evaluation and the frequency and types of meetings in the process flow. Additionally, the report should indicate how specific assessment data is used as evidence for change/modifications and validation of quality. Faculty should develop a timeline for periodic review and provide findings for change/modifications. Identify and include faculty and practitioner experts as reviewers. The following template can be used. Below are some reflection questions concerning the information you are providing in this section of the report:
candidate performance and the program?
revising courses or other elements of the program?
Only 20 attachments
Each attachment is 17 pages or fewer
Only ONE file for each assessment that includes Two-page maximum narrative Assessment Rubric Data charts
Label for each assessment section that includes Assessment name Assessment number District or Building designation Degree level designation
ELCC CAEPCON 2017
It’s time to submit your Program Report. Below are guidelines to follow to ensure you meet CAEP requirements and facilitate a smooth reading for your reviewer. General
Section IV: Evidence for Meeting Standards
charts for each assessment
number and name and district or building level designation. Submission Checklist
ELCC STANDARDS Assessment #1 (State
Licensure Exam
Measure of Leadership Knowledge)
Assessment #2 (Measure of Leadership Knowledge) Assessment #3 (Leadership that coaches teachers towards better instruction, better curriculum Assessment #4 (Leadership that measures professional skills during Internship/Clin ical Practicum Experience) Assessment #6 (Leadership in Organizational Management/ Community Relations) Assessment #5 (Leadership that Creates a Supportive Learning Environment)
CONTENT ASSESSMENTS PROFESSIONAL SKILLS ASSESSMENTS SKILL EFFECTS
ELCC 1.0 1.1 1.2 1.3 1.4 ELCC 2.0 2.1 2.2 2.3 2.4 ELCC 3.0 3.1 3.2 3.3 3.4 3.5 ELCC 4.0 4.1 4.2 4.3 4.4
ELCC 5.0 5.1 5.2 5.3 5.4 5.5 ELCC 6.0 6.1 6.2 6.3 ELCC 7.0 7.1
ELCC CAEPCON 2017
ELCC CAEPCON 2017
NATIONAL RECOGNITION REPORTS
ELCC CAEPCON 2017
NATIONAL RECOGNITION
NATIONAL RECOGNITION WITH CONDITIONS FURTHER DEVELOPMENT REQUIRED
OR NATIONALLY RECOGNIZED WITH PROBATION OR NOT NATIONALLY RECOGNIZED
ELCC CAEPCON 2017
candidate data with ELCC standard elements (e.g., 2.1, 3.2, etc.).
relation to each ELCC standard (1.0-7.0).
personal bias.
conscientious and discrete.
program aligns to the ELCC standards/elements.
Committee.
ELCC CAEPCON 2017
ELCC CAEPCON 2017
The program substantially meets
(preponderance of evidence) all ELCC standards 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, and 7.0;
No further submission required; program will
receive full National Recognition when the unit receives accreditation.
Program will be listed on the NCATE website as
Nationally Recognized if the unit is already
accredited
Nationally Recognized pending unit accreditation if
the unit is not accredited
ELCC CAEPCON 2017
PROGRAM REPORT DECISION IS NATIONAL RECOGNITION WITH CONDITIONS
Substantially meets some but not all ELCC
standards
Response to Conditions Report must be
submitted within 18 months
Has two opportunities within 18 months after
the decision to remove conditions.
If unsuccessful after two attempts, program
status changes to Not Recognized and the program will be removed from the list on the CAEP website.
ELCC CAEPCON 2017
PROGRAM REPORT DECISION IS NATIONAL RECOGNITION WITH CONDITIONS
Conditions could include one or more of the following
standards are met
assessments or scoring guides or data (see ELCC Standard Evaluation Rubric)
pass rate on state licensure tests
ELCC CAEPCON 2017
PROGRAM REPORT DECISION IS NATIONAL RECOGNITION WITH CONDITIONS
What are your next steps?
G of your report. No other conditions can be added at a later date
to address them
Auchter auchterj@nassp.org
review staff Banhi Bhattacharya Banhi.Bhattacharya@caepnet.org
ELCC CAEPCON 2017
PROGRAM REPORT DECISION IS NATIONAL RECOGNITION WITH CONDITIONS (continued)
What are your next steps?
Conditions report is at the endo of the report
to fully remediate the conditions and you believe the program is ready to be recognized
Report on the CAEP website
ELCC CAEPCON 2017
The program does not substantially meet all ELCC
standards and the ELCC standards that are not met are critical to a high-quality program and more than a few in number, or are few in number but so fundamentally important that recognition is not appropriate;
The program will have two opportunities within 12 to 14
months after the first decision to attain National Recognition or National Recognition with Conditions.
If the program is unsuccessful after two attempts, program
status will be changed to Not Recognized and the program will be removed from the list on the CAEP website.
ELCC CAEPCON 2017
What are our next steps? Read the report carefully and pay special attention to
the comments
Address the items listed with your faculty and
determine how best to address them
If unclear on how to address comments, contact SPA
coordinator Joan Auchter auchterj@nassp.org
If questions about format or timelines, contact CAEP
program review staff Banhi Bhattacharya Banhi.Bhattacharya@caepnet.org
ELCC CAEPCON 2017
PROGRAM REPORT DECISION IS FURTHER DEVELOPMENT REQUIRED (continued)
What are your next steps?
at the endo of the report
to fully remediate the conditions and you believe the program is ready to be recognized
ELCC CAEPCON 2017
What does this mean? The program has exhausted opportunities to resubmit and did not reach minimal SPA expectations for Recognition with Conditions. What are our next steps?
Read the report carefully and pay special attention to the
comments
Address the items listed with your faculty and determine how best
to address them
If unclear on how to address comments, contact SPA coordinator Joan
Auchter auchterj@nassp.org
If questions about format or timelines, contact CAEP program review
staff Banhi Bhattacharya Banhi.Bhattacharya@caepnet.org
The program can continue to submit in subsequent semesters, but the next submission will be a completely new report.
SPRING 2017 PROGRAM CYCLE SPA REVIEW RESULTS
NELP SPA ELCC CAEPCON 2017
ELCC CAEPCON 2017
86 87 84 61 75 77 64
55 52 50 43 45 53 37
10 20 30 40 50 60 70 80 90 100
S2014 F2014 S2015 F2015 S2016 F2016 S2017
NUMBER
CYCLE/YEAR
NUMBER OF SCHOOLS AND REVIEWS PER CYCLE/YEAR, S2014-S2017
# Reviews # Schools
ELCC CAEPCON 2017
Initial Review 35 Second Review 27 Third Review 10
Preliminary F17 Numbers 40 Schools 70 Reports
Initial Review 37 Second Review 23 Third Review 4
S17 Numbers 38 Schools 64 Reports
ELCC CAEPCON 2017
10 20 30 40 50 60 70 80 90
S2014 F2014 S2015 F2015 S2016 F2016 S2017
36 34 27 27 28 35 37 29 30 34 19 23 22 23 11 23 23 15 24 20 4
Number Cycle/Year
Number of First, Second and Third Submissions by Cycle/Year, S2014- S2017
1st Time to submit 2nd Time to submit 3rd Time to submit
10 20 30 40 50 60 70 80
S2014 F2014 S2015 F2015 S2016 F2016 S2017 18 28 29 18 23 17 22 24 12 13 6 8 20 24 2 1 5 3 11 2 5 11 15 5 5 12 16 1 8 13
NUMBER # Recognized # Recognized with Conditions # Recognized with Probation #Further Development Required # Not Recognized
ELCC CAEPCON 2017
National Recognition 22 Recognized with Conditions 24
Further Development Required
18 Not Recognized
ELCC CAEPCON 2017
S2017 TOP 7 REASONS FOR CONDITIONS AND FURTHER DEVELOPMENT
ELCC CAEPCON 2017
for a different program type.)
evidence to the standard components in the assessments— assessment description/directions, rubric, and data charts.
categories.
unclear.
sufficient information, e.g., the number of hours on-site, qualifications and training of mentors.
ELCC CAEPCON 2017
ELCC CAEPCON 2017
ELCC CAEPCON 2017
1. Must align to CAEP Principles 2. May have only 7 standards and 28 elements 3. Must be written so that each concept in an element appears in the language of the standard 4. Must include supporting explanations, research support, and describe appropriate performance assessments 5. Must include rubrics or criteria to guide reviews (must be measurable) 6. An 8th standard on the clinical experience can be requested
NELP CAEPCON 2016
voluntary accreditation standards that guide the preparation of building and district leaders
the assessment of candidate learning and program quality
criteria and guidance for assessing the effectiveness of leadership programs
preparation standards
ELCC CAEPCON 2017
ISLLC 2008 & PSEL 2015 CROSSWALK
ISLLC Standards 2008 (ELCC 2011) PSEL 2015 (NELP 2018)
S1 Vision S1 Mission, Vision, Core Values S10 School Improvement S2 Culture of Support and Instructional Program S4 Curriculum, Instruction, and Assessment S5 Community of Care and Support for Students S6 Professional Capacity of School Personnel S7 Professional Community for Teachers and Staff S3 Operations, Management, and Resources S9 Operations and Management S4 Collaboration with Faculty and Community S8 Meaningful Engagement of Families and Communities S5 Ethics S2 Ethics and Professional Norms S3 Equity and Cultural Responsiveness S6 Political, Social, Legal, Cultural Context S3 Equity and Cultural Responsiveness S8 Meaningful Engagement of Families and Communities ELCC CAEPCON 2017
NELP FOCUS: BEGINNING LEVEL
National Educational Leader Preparation (NELP) Standards Professional Standards for Educational Leaders (PSEL) Standards
Education for preparation, CAEP accreditation and state licensure
to prepare two specific types of leaders – building level and district level
– CAEP requirement
practitioners in the field
emerging, developing and distinguished educational leaders
ELCC CAEPCON 2017
PSEL Identifying “Beginner” Level
Gaining Input from the Field & CAEP Refinement, Research Mapping & Comparisons NELP
The Process:
ELCC CAEPCON 2017
ELCC
NAESP
Bothell, Principal Supervisors
Hofstra (ELL)
Dean, Deans for Impact
(SPED), UT-ElPaso
Education Agency, Missouri
Pipeline
Gwinnet County, Wallace Pipeline
(superintendent)
(Evaluation Expertise)
UCEA, ELCC
ELCC CAEPCON 2017
ELCC
and Improvement Science)
Vanderbilt University (Evaluation Expertise – Val Ed)
(Evaluation Expertise)
Education Agency, Missouri
University of Denver, Wallace Pipeline
University of Virginia (Evaluation Expertise)
Chair, UCEA, ELCC
ELCC CAEPCON 2017
Building Leader Standards 1. Mission, Vision, and Core Values 2. Ethics and Professional Norms 3. Equity, Inclusiveness and Cultural Responsiveness 4. Learning and Instruction 5. Community and External Leadership 6. Operations and Management 7. Building Professional Capacity 8. (The Internship) District Leader Standards
1. Mission, Vision, and Core Values 2. Ethics and Professionalism 3. Equity and Cultural Leadership 4. Instructional Leadership 5. Community and External Leadership 6. Management of People, Data, and Processes 7. Policy, Advocacy and Governance 8. (The Internship)
ELCC CAEPCON 2017
Educational Leaders
content standards
implementing, evaluating, collaborating, communicating, modeling, reflecting, advocating and cultivating
ELCC CAEPCON 2017
ELCC CAEPCON 2017
NELP standards? Our SPA reports are due in 2019. University of Connecticut
months of data (each class is offered once a year at most). Having 18 months won’t be enough time to collect data, to say nothing of the required modifications to the rubrics. What is your recommendation for how we handle this? Should we start developing rubrics/tools based on the draft standards? Kent State
school leaders, we are convinced that the use of the NELP standards would be most beneficial to us and to our program both now and in the long run. Clearly, we are devoting a great deal of time and energy to our accreditation work. That said, it makes sense to follow standards that go into effect in January, 2018 which is only three months after our submission is due. Can you offer some guidance
a copy to us. Penn State
are indeed using the correct standards. We should be using the District Level NELP Standards found here in draft? http://www.npbea.org/ I did not see updated information on the CAEP SPA website, so we are trying to confirm their approval or endorsement before proceeding to far. Winthrop University
not change too much, we would like to submit our reports as soon as you are ready to receive
rubrics and our new data and receive a decision of "Further Development Required" so that we do not appear in any way to be "Not Recognized" which can be problematic for us with New York
standards? Would it likely be fall 2018? Buffalo State College
Email magdaa@nassp.org
ELCC CAEPCON 2017 NPBEA.ORG
Program Report Templates: (ELCC Standards & Report
Templates):
http://www.ncate.org/Standards/ProgramStandardsandReportFor
ms/tabid/676/Default.aspx#ELCC ELCC Standards
http://www.npbea.org/ncateelcc/
Questions about ELCC Program Report Design Joan
Auchter auchterj@nassp.org
703-860-7280
Questions about AIMS systems and technical submission
problems
Banhi Bhattacharya Banhi.Bhattacharya@caepnet.org
ELCC CAEPCON 2016
ELCC CAEPCON 2017