Mission, Markets, & Measuring what Matters: Challenging and - - PowerPoint PPT Presentation

mission markets measuring what matters challenging and
SMART_READER_LITE
LIVE PREVIEW

Mission, Markets, & Measuring what Matters: Challenging and - - PowerPoint PPT Presentation

Mission, Markets, & Measuring what Matters: Challenging and Supporting Schools in Data-Rich Continuous Improvement NCPSA Winter Meeting January 28, 2020 Nice to Meet You! Dr. Jennifer de Forest Center for Effective Philanthropy,


slide-1
SLIDE 1

Mission, Markets, & Measuring what Matters: Challenging and Supporting Schools in Data-Rich Continuous Improvement

NCPSA Winter Meeting January 28, 2020 Nice to Meet You!

  • Dr. Jennifer de Forest

Center for Effective Philanthropy, YouthTruth Team jend@youthtruthsurvey.org

slide-2
SLIDE 2
slide-3
SLIDE 3

NCPSA Winter Meeting Agenda

I. Tune Up Q1: Listening to Students II. Why Listen to Students? Why Measure the Student Experience? III. Tune In Q2: Data in the Accreditation Self Study IV. Associations and Data V. How Can We Reliably Measure the Student Experience? VI. American High School: Cohorts and Disaggregation VII. The Power of Feedback Loops!

  • VIII. Tune In Q3: Accreditation – Change over time & Feedback Loops

IX. If we have time! Reflecting on National Trends X. Final friendly provocations

slide-4
SLIDE 4

Good Morning! Reflection Tune-Up Why Listen to Students?

Share one way that your accreditation process challenges your member schools to listen to students about their experience in school. Why is student feedback a part (or not a part) of your accreditation process?

Share out thoughts!

slide-5
SLIDE 5

ASPEN Institute’s Integrating Social, Emotional, and Academic Development “Developing student agency is an important factor in students’ long-term success, which is facilitated by students exercising … voice in their learning.”

ACADEMIC ACHIEVEMENT STUDENT WELL-BEING EQUITY

STUDENT PERCEPTIONS

Why Listen to Students? Why Student Perception Surveys? The Good Thing + The Smart Thing

slide-6
SLIDE 6

Stanford’s Gardner Center “Students’ relationships with their teachers and their motivation are linked with their academic achievement.” National School Climate Center School climate reform is “a data-driven strategy that promotes healthy relationships, school connectedness and dropout prevention.”

ACADEMIC ACHIEVEMENT STUDENT WELL-BEING EQUITY

STUDENT PERCEPTIONS

Why Listen to Students? Why Student Perception Surveys? The Good Thing + The Smart Thing

slide-7
SLIDE 7

DRIVE STUDENT SUCCESS & WELL-BEING

Listening to Students is Strategic!

Teaching & Learning Culture Building Strategic Planning, Accountability Reporting

ACCREDITATION

slide-8
SLIDE 8

What is one way that you challenge/support your members to conduct data-rich/data- informed accreditation self-studies? What are the challenges for you in this work?

Share out thoughts!

slide-9
SLIDE 9

250 Schools Statistical Reports

(Enrollment, salaries, tuition, financial aid by school type, size, county, race/ethnicity, gender)

Benchmarking Data

Associations & Data How are Associations Challenging & Supporting Member Schools? 1) Benchmarking

slide-10
SLIDE 10

Market Dynamic Studies Benchmarking Data

Three Metropolitan Areas 56 Schools (Religious & Not) 1850 Respondents

(Parents’ price sensitivity + Parents’ perceptions of schools and “fit”)

Show-Me Parents

Associations & Data How are Associations Challenging & Supporting Member Schools? 2) Beyond Benchmarking! Model Building & Significance Testing

slide-11
SLIDE 11

Market Dynamic Studies Benchmarking Data

Survey Pilot: Supports in the Environment …

Associations & Data How are Associations Challenging & Supporting Member Schools? 3) Missions Measures: What Exactly is Your Value-Add? Are you Meeting your Mission?

78 Schools 8 Shared Measures 20,000+ Participants 3 Metropolitan Areas 8, 20, 28 Schools 1850 Respondents 250 Schools 5 Statistical Reports

slide-12
SLIDE 12

Building Robust & Meaningful Networks to Measure the Student Experience: If not Associations, who?

78 Schools 8 Shared Measures 20,000+ Participants 3 Metropolitan Areas 8, 20, 28 Schools 1850 Respondents 250 Schools 5 Statistical Reports

slide-13
SLIDE 13

ESSA States are Challenging and Supporting Schools! If not Associations, who?

slide-14
SLIDE 14

How can we Measure the Student Experience in a way that is Valid, Reliable, and Actionable?

Elementary Students 2019 YouthTruth Student Voice Workshop

slide-15
SLIDE 15

student engagement academic rigor/challenge relationships with teachers school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

belonging & peer collaboration college & career readiness Instructional methods

+ PBL + STEM + emotional & mental health + motivation & grit + drugs & alcohol + student voice & leadership + Safety

slide-16
SLIDE 16

Culture First Student Anonymity + Privacy

slide-17
SLIDE 17

C

“ … a tool and a … process to develop evidence-based awareness of … inequities … to create learning and change.”

Estela Mara Bensimon, USC

slide-18
SLIDE 18

American High School: Reliable, Valid, and with Context

slide-19
SLIDE 19

Relationships – Percent Positives

American High School: Research-Based and Actionable

slide-20
SLIDE 20

Relationships – Percent Positives

American High School: Research-Based and Actionable

slide-21
SLIDE 21

American High School: Disaggregation for Actionability and Equity

slide-22
SLIDE 22

C

“Equity Mindedness” “ … a tool and a … process to develop evidence- based awareness of … inequities … to create learning and change.”

Estela Mara Bensimon, USC

slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26

Synthesize

“Those collecting perceptual feedback have the responsibility to share with constituents the results of feedback and the

  • rganization’s response to

it.” Fund for Shared Insight

slide-27
SLIDE 27

In what ways does your Accreditation Process support and challenge your members to track their change over time? In what ways does your Accreditation Process support and challenge your members to engage stakeholder feedback loops? What are the challenges for you in this work?

Share out thoughts!

slide-28
SLIDE 28

Affirmation v. Information The Kool Aid factor No Bad News

Listening as Leadership!

slide-29
SLIDE 29

Do we Have Time? What have over 1 million students said about the culture and climate of their schools?

slide-30
SLIDE 30

*student engagement *academic rigor *relationships with teachers *school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

*belonging & peer collaboration What do you think the 6-12 grade-level averages are? How do you think that they trend? What do you think students tend to score highest?

slide-31
SLIDE 31

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4

6th 7th 8th 9th 10th 11th 12th

Grade Level

Key Measure Average Ratings by Grade Level 1-5 Scale Academic Rigor

slide-32
SLIDE 32

*student engagement *academic rigor *relationships with teachers *school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

*belonging & peer collaboration What do you think the 6-12 grade-level averages are? How do you think that they trend? What do you think students tend to score Lowest?

slide-33
SLIDE 33

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4

6th 7th 8th 9th 10th 11th 12th

Grade Level

Key Measure Average Ratings by Grade Level 1-5 Scale Academic Rigor Culture

slide-34
SLIDE 34

*student engagement *academic rigor *relationships with teachers *school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

*belonging & peer collaboration What do you think the 6-12 grade-level averages are? How do you think that they trend? What factor do you think changes the least?

slide-35
SLIDE 35

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4

6th 7th 8th 9th 10th 11th 12th

Grade Level

Key Measure Average Ratings by Grade Level 1-5 Scale Academic Rigor Belonging/ Peer Culture Culture

slide-36
SLIDE 36

*student engagement *academic rigor *relationships with teachers *school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

*belonging & peer collaboration What do you think the 6-12 grade-level averages are? How do you think that they trend? How will relationships with teachers trend?

slide-37
SLIDE 37

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4

6th 7th 8th 9th 10th 11th 12th

Grade Level

Key Measure Average Ratings by Grade Level 1-5 Scale Academic Rigor Relationships Belonging/ Peer Culture Culture

slide-38
SLIDE 38

*student engagement *academic rigor *relationships with teachers *school culture (respect & fairness)

YOUTH TRUTH’S STUDENT EXPERIENCE SURVEY

*belonging & peer collaboration What do you think the 6-12 grade-level averages are? How do you think that they trend? What about engagement?

slide-39
SLIDE 39

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4

6th 7th 8th 9th 10th 11th 12th

Grade Level

Key Measure Average Ratings by Grade Level 1-5 Scale Academic Rigor Engagement Relationships Belonging/ Peer Culture Culture

What are the patterns in your association? How do you know?

slide-40
SLIDE 40

Imagine that this is your school(s)? What would you want to know?

Amplify Learning through Networks! Imagine, e.g., a Cohort of Catholic Schools, Lutheran Schools, Montessori Schools, or Girls Schools

slide-41
SLIDE 41

Associations

slide-42
SLIDE 42

Final Friendly Provocations! Thoughts?

  • Accrediting Associations should challenge and support members to continuously

improve – to get better at getting better!

  • Listening to students is a good, smart, and strategic way to improve
  • Research tells us that student voice is a critical ingredient in school improvement
  • Student voice should be a key ingredient in the Accreditation Process
  • Also: Markets are demanding more than a “secret sauce” description of a school’s valued

add.

  • Serving as a network improvement hub is good, smart, and strategic for Associations!
  • 21st Century Schools Need 21st Century Associations
slide-43
SLIDE 43

Thank you!

  • Dr. Jennifer de Forest

Partnership Lead YouthTruth jend@youthtruthsurvey.org

Next Steps? Questions? ✓ Spread the word! Invite us to speak at an in-person meeting of academic leaders

  • r on a webinar

✓ Make your association a hub

  • f continuous improvement:

Build a data-rich network of schools to do the work together!

slide-44
SLIDE 44

Pricing

Other Possible Offerings ✓ A custom comparison group ✓ Group-Specific set of custom questions ✓ Webinar or in-person data inquiry trainings for participants ✓ Student voice workshops ✓ Research and presentation on aggregate findings