Palm Beach State College 1 Institutional Research & - - PDF document

▶
palm beach state college
SMART_READER_LITE
LIVE PREVIEW

Palm Beach State College 1 Institutional Research & - - PDF document

Oct 27, 2022 269 likes •547 views

10/23/2019 Palm Beach State College 1 Institutional Research & Effectiveness 1 Overview Benchmarks Satisfaction with services Other student characteristics Strengths and opportunities Other considerations Institutional

slide-1
SLIDE 1

10/23/2019 1

1

Institutional Research & Effectiveness

Palm Beach State College

Institutional Research & Effectiveness

  • Overview
  • Benchmarks
  • Satisfaction with services
  • Other student characteristics
  • Strengths and opportunities
  • Other considerations

1 2

slide-2
SLIDE 2

10/23/2019 2

Institutional Research & Effectiveness Institutional Research & Effectiveness

CCSSE defines student engagement as “the amount of time and energy that students invest in meaningful educational practices.”

3 4

slide-3
SLIDE 3

10/23/2019 3

Institutional Research & Effectiveness Institutional Research & Effectiveness

  • 616 total institutions
  • ~350,000 students during the cohort period
  • 200 Achieving the Dream colleges
  • 49 “extra large” colleges (> 15,000 students)
  • 22 Florida colleges
  • 1,487 students from 100 lower‐division and developmental

education classes at Palm Beach State

  • Classes conducted entirely online are not included

5 6

slide-4
SLIDE 4

10/23/2019 4

Institutional Research & Effectiveness

Survey participants Credit students age 18+, Spring 2019 Survey participants Credit students age 18+, Spring 2019

Race/ethnicity American Indian Asian Black/African American Hispanic/Latino Hawaiian/Pacific Islander White Other More than one race No response/not reported 0.5% 2.3% 24.5% 34.0% 0.1% 26.7% 2.9% 3.1% 5.9% 0.2% 2.8% 27.4% 31.7% 0.2% 30.9% ‐ 2.6% 4.2% Gender Female Male Other No response/not reported Age 18‐19 20‐21 22‐24 25‐29 30‐39 40+ 56.4% 40.0% 0.4% 1.0% 31.8% 24.5% 15.6% 12.4% 7.7% 6.1% 58.3% 39.9% ‐ 1.7% 25.6% 22.7% 17.7% 15.3% 11.4% 7.4%

Institutional Research & Effectiveness

Palm Beach State College CCSSE 2019 7 8

slide-5
SLIDE 5

10/23/2019 5

Institutional Research & Effectiveness Institutional Research & Effectiveness

  • Active and Collaborative Learning
  • Student Effort
  • Academic Challenge
  • Student‐Faculty Interaction
  • Support for Learners

9 10

slide-6
SLIDE 6

10/23/2019 6

Institutional Research & Effectiveness

Measures the extent to which students are involved in their

  • wn education.

Institutional Research & Effectiveness

10 20 30 40 50 60

All students Part‐time Full‐time 48.0 45.8 54.0 50.4 48.2 56.0 49.7 47.2 55.0 50.6 47.2 55.7 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19 Top 10% XL 54.4 53.8

11 12

slide-7
SLIDE 7

10/23/2019 7

Institutional Research & Effectiveness

20 40 60 80 100

  • 4a. Asked questions in class or

contributed to class discussions

  • 4b. Made a class presentation
  • 4f. Worked with other students
  • n projects during class
  • 4g. Worked with classmates
  • utside of class to prepare class

assignments

59.9 39.0 45.3 21.4 62.9 43.2 49.1 28.7 61.8 36.9 52.1 27.0 64.7 35.1 52.1 27.0 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% often/very often

PBSC 2019 mean score significantly higher than national cohort

(p<.001, effect size >=.2)

Institutional Research & Effectiveness

20 40 60 80 100

  • 4h. Tutored or taught other

students (paid or voluntary)

  • 4i. Participated in a community‐

based project (service‐learning activity) as part of a regular course

  • 4q. Discussed ideas from your

readings or classes with others

  • utside of class (students, family

members, co‐workers, etc.)

7.6 6.4 46.1 8.6 8.3 46.2 8.4 8.4 48.3 8.7 9.2 48.9 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% often/very often

14 15

slide-8
SLIDE 8

10/23/2019 8

Institutional Research & Effectiveness

Measures students’ behaviors and attitudes toward their coursework.

Institutional Research & Effectiveness

10 20 30 40 50 60

All students Part‐time Full‐time 50.1 48.0 55.9 53.7 51.3 59.9 49.8 47.1 55.6 51.1 47.5 56.3 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Top 20%

Among extra large colleges

Top 10% XL 53.4 54.3

16 17

slide-9
SLIDE 9

10/23/2019 9

Institutional Research & Effectiveness

20 40 60 80 100

  • 4c. Prepared two or more

drafts of a paper or assignment before turning it in

  • 4d. Worked on a paper or

project that required integrating ideas or information from various sources

  • 4e. Come to class without

completing readings or assignments

  • 4e. Come to class without

completing readings or assignments

  • 6b. Number of books read
  • n your own (not

assigned) for personal enjoyment or academic enrichment

52.1 70.1 12.1 33.9 20.1 59.4 72.0 14.7 36.1 21.2 52.2 68.4 15.4 31.6 20.2 51.7 67.2 14.5 34.1 20.2 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% often/very often % never % 5 or more

Institutional Research & Effectiveness

20 40 60 80 100

  • 10a. Hours spent preparing for

class (studying, reading, writing, rehearsing, doing homework, etc.) 12.1d. Peer or other tutoring 12.1e. Skill labs (writing, math, etc.) 12.1h. Computer lab

22.1 20.6 48.5 54.8 61.7 27.6 40.0 43.7 60.6 29.0 38.8 44.3 63.6 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% who used at least once during year % 11 or more

PBSC 2019 mean score significantly higher than XL college and national cohorts

(p<.001, effect size >=.2)

PBSC 2019 mean score significantly higher than ATD and national cohorts

(p<.001, effect size >=.2)

19 20

slide-10
SLIDE 10

10/23/2019 10

Institutional Research & Effectiveness

Measures the level of intellectual and creative challenge provided by the coursework.

Institutional Research & Effectiveness

10 20 30 40 50 60

All students Part‐time Full‐time 48.7 46.9 53.7 49.7 47.8 54.7 49.6 47.0 55.2 50.2 47.0 55.0 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19 Top 10% XL 53.5 52.5

21 22

slide-11
SLIDE 11

10/23/2019 11

Institutional Research & Effectiveness

20 40 60 80 100

  • 5b. Work emphasizes

analyzing the basic elements of an idea, experience, or theory

  • 5c. Work emphasizes

forming a new idea or understanding from various pieces of information

  • 5d. Work emphasizes

making judgements about the value or soundness of information, arguments,

  • r methods
  • 5e. Work emphasizes

applying theories or concepts to practical problems or in new situations

  • 5f. Work emphasizes using

information you have read

  • r heard to perform a new

skill

71.1 64.8 58.1 59.2 63.7 69.1 68.3 60.1 60.7 65.2 71.6 68.5 57.7 60.4 64.6 70.4 68.0 56.4 60.3 65.6 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% quite a bit/very much

Institutional Research & Effectiveness

20 40 60 80 100

  • 4o. Worked harder than

you thought you could to meet an instructor's standards or expectations

  • 6a. Number of assigned

textbooks, manuals, books, or packets of course readings

  • 6c. Number of written

papers or reports of any length

  • 7. The extent to which

your examinations during the current academic year have challenged you to do your best work

  • 9a. Encouraging you to

spend significant amounts

  • f time studying

54.2 51.6 61.9 25.0 74.6 54.9 58.5 59.5 22.1 73.0 52.8 59.2 58.2 27.5 74.9 54.3 60.3 57.8 29.5 75.6 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19 % often/very often % 6+ (on 7‐pt scale)

% 5 or more

% quite a bit/ very much Mean

4.76 4.66 4.84 4.89

24 25

slide-12
SLIDE 12

10/23/2019 12

Institutional Research & Effectiveness

Measures the level of personal contact students have with their instructors.

Institutional Research & Effectiveness

10 20 30 40 50 60

All students Part‐time Full‐time 49.7 48.0 54.5 49.5 47.8 53.7 47.5 45.2 52.4 50.9 47.8 55.6 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Top 20%

Among extra large colleges

Top 10% XL 51.1 50.0

26 27

slide-13
SLIDE 13

10/23/2019 13

Institutional Research & Effectiveness

20 40 60 80 100

  • 4j. Used e‐mail to communicate

with an instructor

  • 4k. Discussed grades or

assignments with an instructor

  • 4l. Talked about career plans with

an instructor or advisor

68.7 51.1 32.0 67.0 53.4 34.6 65.3 49.7 30.8 68.0 52.4 34.0 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% often/very often

Institutional Research & Effectiveness

20 40 60 80 100

  • 4m. Discussed ideas from your

readings or classes with instructors

  • utside of class
  • 4n. Received prompt feedback

(written or oral) from instructors

  • n your performance
  • 4p. Worked with instructors on

activities other than coursework

18.8 58.9 10.0 18.1 62.0 11.1 18.4 61.3 10.4 19.8 62.3 11.7 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% often/very often

29 30

slide-14
SLIDE 14

10/23/2019 14

Institutional Research & Effectiveness

Measures the level of positive working and social relationship students have with the college, as well as the services targeted to assist them.

Institutional Research & Effectiveness

10 20 30 40 50 60

All students Part‐time Full‐time 48.0 47.1 50.2 51.0 49.8 54.2 49.1 47.4 52.8 51.5 49.1 54.9 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19 Top 10% XL 53.9 54.5

31 32

slide-15
SLIDE 15

10/23/2019 15

Institutional Research & Effectiveness

20 40 60 80 100

  • 9b. College emphasizes

providing the support you need to help you succeed at this college

  • 9c. College emphasizes

encouraging contact among students from different economic, social, and racial or ethnic backgrounds

  • 9d. College emphasizes

helping you cope with your non‐academic responsibilities (work, family, etc.)

  • 9e. College emphasizes

providing the support you need to thrive socially

  • 9f. College emphasizes

providing the financial support you need to afford your education

74.2 58.1 26.9 35.9 44.7 74.3 58.8 31.4 37.5 54.4 73.9 57.4 29.4 36.1 49.9 75.3 57.6 31.2 38.1 52.4 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% quite a bit/very much

Institutional Research & Effectiveness

20 40 60 80 100

12.1a. Used academic advising/planning during current academic year 12.1b. Used career counseling during current academic year

59.9 37.8 57.4 40.1 60.3 38.2 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% at least once % at least twice

34 35

slide-16
SLIDE 16

10/23/2019 16

Institutional Research & Effectiveness

2 4 6 8 10

Active and Collaborative Learning Student Effort Academic Challenge Student‐Faculty Interaction Support for Learners

4 6 3 8 5 8 9 6 9 7 4 6 4 5 4 6 8 5 4 5 Among XL colleges 2016 Among XL colleges 2019 Column1 Among national cohort 2019

Institutional Research & Effectiveness

Palm Beach State College CCSSE 2019 36 37

slide-17
SLIDE 17

10/23/2019 17

Institutional Research & Effectiveness

20 40 60 80 100

12.2a. Academic advising/planning 12.2b. Career counseling 12.2c. Job placement assistance 12.2d. Peer or other tutoring 12.2e. Skill labs (writing, math, etc.)

39.9 32.5 22.5 43.3 46.5 43.1 37.2 30.3 54.4 58.9 41.5 37.9 25.3 47.5 48.1 45.0 39.7 27.9 49.3 49.3 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% rate very important

71% 54% 36% 46% 46%

Institutional Research & Effectiveness

20 40 60 80 100

12.2f. Child care 12.2g. Financial aid advising 12.2h. Computer lab 12.2i. Student

  • rganizations

12.2j. Transfer advising/planning

17.4 39.8 58.7 26.9 30.0 54.5 59.6 36.2 40.8 28.4 46.1 60.7 34.8 41.6 30.4 49.6 61.5 37.0 42.1 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% rate very important

35% 70% 54% 33% 57%

38 39

slide-18
SLIDE 18

10/23/2019 18

Institutional Research & Effectiveness

20 40 60 80 100

12.2k. Library resources and services 12.2l. Services for students with disabilities 12.2m. Services for active military and veterans

37.6 64.6 45.3 39.3 63.5 43.9 38.7 62.9 43.1 39.5 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% rate very important

66% 48% 43%

Institutional Research & Effectiveness

Satisfaction Importance

  • Perf. gap

12.2a. Academic advising/planning 1.33 1.70 ‐0.37 12.2b. Career counseling 1.16 1.35 ‐0.19 12.2c. Job placement assistance 0.89 1.06 ‐0.17 12.2d. Peer or other tutoring 1.43 1.36 +0.07 12.2e. Skill labs (writing, math, etc.) 1.49 1.44 +0.05 12.2f. Child care 0.85 0.85 0.00 12.2g. Financial aid advising 1.41 1.55 ‐0.14 12.2h. Computer lab 1.54 1.36 +0.18 12.2i. Student organizations 1.17 0.97 +0.20 12.2j. Transfer advising/planning 1.24 1.35 ‐0.11 12.2k. Library resources and services 1.59 1.54 +0.05 12.2l. Services for students with disabilities 1.16 1.10 +0.06 12.2m. Services for active military and veterans 1.04 1.00 +0.04

Scale: 0=not at all satisfied/important 1=somewhat satisfied/important 2=very satisfied/important

40 41

slide-19
SLIDE 19

10/23/2019 19

Institutional Research & Effectiveness

‐0.4 ‐0.2 0.0 +0.2 +0.4

12.2a. Academic advising/planning 12.2b. Career counseling 12.2c. Job placement assistance 12.2d. Peer or other tutoring 12.2e. Skill labs (writing, math, etc.)

‐0.35 ‐0.21 ‐0.22 ‐0.03 ‐0.06 ‐0.37 ‐0.19 ‐0.17 +0.07 +0.05 ‐0.33 ‐0.13 ‐0.12 +0.15 +0.16 ‐0.27 ‐0.07 ‐0.07 +0.17 +0.18 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Scale: 0=not at all satisfied/important 1=somewhat satisfied/important 2=very satisfied/important Institutional Research & Effectiveness

‐0.4 ‐0.2 0.0 0.2 0.4

12.2f. Child care 12.2g. Financial aid advising 12.2h. Computer lab 12.2i. Student

  • rganizations

12.2j. Transfer advising/planning

‐0.03 ‐0.29 +0.12 +0.06 0.00 ‐0.14 +0.18 +0.20 ‐0.11 +0.11 ‐0.13 +0.22 +0.25 ‐0.07 +0.13 ‐0.10 +0.19 +0.29 0.00 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Scale: 0=not at all satisfied/important 1=somewhat satisfied/important 2=very satisfied/important

42 43

slide-20
SLIDE 20

10/23/2019 20

Institutional Research & Effectiveness

‐0.4 ‐0.2 0.0 0.2 0.4

12.2k. Library resources and services 12.2l. Services for students with disabilities 12.2m. Services for active military and veterans

‐0.06 +0.05 +0.06 +0.04 +0.09 +0.13 +0.11 +0.10 +0.11 +0.10 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Scale: 0=not at all satisfied/important 1=somewhat satisfied/important 2=very satisfied/important Institutional Research & Effectiveness

Palm Beach State College CCSSE 2019 44 45

slide-21
SLIDE 21

10/23/2019 21

Institutional Research & Effectiveness

20 40 60 80 100

Married Dependent children living with you English native (first) language Primarily evening/weekend student Working more than 30 hours/week

11.3 74.3 30.9 39.7 11.2 16.3 66.7 29.0 37.3 13.5 16.5 70.3 22.8 29.6 16.1 21.6 77.8 21.8 30.2 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Institutional Research & Effectiveness

20 40 60 80 100

Complete a certificate program Obtain an associate degree Transfer to a 4‐year college or university

37.3 87.6 77.9 39.9 75.8 75.9 41.8 78.6 69.5 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

46 47

slide-22
SLIDE 22

10/23/2019 22

Institutional Research & Effectiveness

20 40 60 80 100

My own income/savings Income/savings from family Grants Scholarships Student loans

40.4 30.6 11.6 32.3 29.6 33.9 17.6 10.9 38.7 31.0 29.3 11.1 12.9 35.7 26.7 33.2 17.2 16.2 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Institutional Research & Effectiveness

20 40 60 80 100

Working full‐time Caring for dependents Academically unprepared Lack of finances

42.2 28.7 25.0 49.9 42.3 28.5 24.7 49.1 41.9 28.4 22.4 45.5 39.7 28.1 20.7 46.0 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

% likely/very likely

48 49

slide-23
SLIDE 23

10/23/2019 23

Institutional Research & Effectiveness

% yes % excellent/good

20 40 60 80 100

Would you recommend this college to a friend or family member How would you evaluate your

  • verall educational experience at

this college?

95.2 80.7 94.0 82.4 94.7 85.4 94.2 85.9 PBSC 2016 PBSC 2019 Extra large colleges 2017‐19 ATD cohort 2017‐19

Institutional Research & Effectiveness

Palm Beach State College CCSSE 2019 50 51

slide-24
SLIDE 24

10/23/2019 24

Institutional Research & Effectiveness

  • Improvement on four of five benchmarks
  • Top 20% among XL colleges on two benchmarks
  • Student Effort is our strongest benchmark
  • Tutoring and skills labs remain very important to our students

and highly respected

  • Substantial gains on Support for Learners
  • Financial aid has emerged as an area of strength
  • Noticeable improvements in service satisfaction

Institutional Research & Effectiveness

  • Student‐Faculty Interaction is already a top performer

while having additional room to grow

  • Students may not feel as challenged by their exams, nor as

great a need to prepare

  • Consider additional opportunities for students to work

with each other during class

  • Peer tutoring and service learning opportunities remain

very low (though not out of line with cohort)

  • Importance‐to‐satisfaction gaps exist in all areas of

advising – academic, career, financial aid

52 53

slide-25
SLIDE 25

10/23/2019 25

Institutional Research & Effectiveness

Palm Beach State College CCSSE 2019

Institutional Research & Effectiveness

54 55

slide-26
SLIDE 26

10/23/2019 26

Institutional Research & Effectiveness

  • Develop a process for reviewing the data by various

stakeholders

  • Develop action plans for intervention and

improvement, where necessary

  • Document changes made as a result of CCSSE
  • Focus on continuous improvement

Institutional Research & Effectiveness

  • CCSSE website – http://www.ccsse.org
  • Palm Beach State College IRE –

http://www.palmbeachstate.edu/ire

56 57