Background UCC Enrollment (2002/2003) The University College of the - - PowerPoint PPT Presentation

▶
background ucc enrollment 2002 2003
SMART_READER_LITE
LIVE PREVIEW

Background UCC Enrollment (2002/2003) The University College of the - - PowerPoint PPT Presentation

Jul 12, 2023 316 likes •403 views

Overview Entry Assessment Testing as a Background Information Predictor of Student Success Introduction to the Study Findings presented by Conclusions Cindy James Assessment Centre Coordinator University College of the

slide-1
SLIDE 1

1 Entry Assessment Testing as a Predictor of Student Success

presented by

Cindy James

Assessment Centre Coordinator University College of the Cariboo Kamloops, British Columbia, Canada cjames@cariboo.bc.ca

Overview

†

Background Information

†

Introduction to the Study

†

Findings

†

Conclusions

Background

†

The main campus is located in Kamloops, British Columbia, Canada.

†

Seven regional

  • ffices/campuses within

the central and southern interior of B.C.

The University College of the Cariboo (UCC) is a public educational institute offering both college and university programs.

UCC Enrollment (2002/2003)

10081 Totals 1657 Developmental 1462 Vocational 1387 Diplomas 5575 University Degrees

slide-2
SLIDE 2

2

UCC Assessment Centre

Purpose:

†

To provide general educational assessments to facilitate appropriate placement in courses/programs.

†

To administer entry assessments for admission to various UCC programs.

†

To coordinate and/or invigilate examinations for

  • ther educational institutions and outside agencies.

†

Administered/Coordinate ~ 3500 assessments/tests per year

Accuplacer

† WEB-based computer testing system † Utilizes Adaptive Technology † Customized Testing † Computer scored † Built-in Database

Accuplacer Tests

†

Reading Comprehension

†

Sentence Skills

†

Arithmetic

†

Elementary Algebra

†

College Level Mathematics

†

WritePlacer Plus & WritePlacer ESL

†

Language of English Proficiency tests

UCC College Preparation

Purpose Offers adult learners the opportunity to complete prerequisites for admission into career, vocational and academic programs and/or to complete an ABE diploma. Courses (offered year round) English, Math, General Science, Biology, Physics, Chemistry, Student Success, Psychology, Computing and Social Science. Placement

†

Self – select for lower level courses (040 & 050)

†

Pre-requisites for the higher level courses (060)

slide-3
SLIDE 3

3

The Study

The Big Question To improve the placement procedure and hence the success rate for College Preparation courses and programs, should entry assessment testing be mandatory for College Preparation applicants? The Consequential Question Can Accuplacer Tests Scores Predict Student Success/Nonsuccess in College Preparation Courses?

Study Timeline

Spring/Summer session 2003

†

Accuplacer tests administered to 6 different classes

  • f English and Math students on the first day of

classes.

†

Classes met on a daily basis for 7 weeks (total of 75 hours of instruction).

†

Final Grades collected at the end of each course.

†

Data analysis conducted during the Fall 2003.

Study Participants

27 Average Age 45 Males 48 Females 93 Sample size (n)

Total Statistics

Study Cohorts

Math English 60 Total 34 Math 060 15 Math 050 11 Math 040

# of participants

Cohort 33 Total 16 English 060 7 English 050 10 English 040

# of participants

Cohort

slide-4
SLIDE 4

4

Success Rates

90 % Success Rate 9 NonSuccessful Students

(final grade < 50%, DNC, Withdrew)

84 Successful Students

(final grade ≥ 50%)

Total Statistics

Regression Analysis Utilized

† Linear & Multiple Regression Analysis

To evaluate the linear relationship between the predictor variables (Accuplacer test scores) and the

  • utcome (final grade).

† Logistic Regression Analysis

To evaluate the relationship between the predictor variables (Accuplacer test scores) and the dichotomous outcome (success vs nonsuccess).

Linear & Multiple Regression Analysis

Math Cohort

Accuplacer Test Scores Both Tests Algebra Arithmetic Final Grade

0.619 0.397 0.469 0.617 0.391

Math 060

(n = 32)

0.392 0.290

Math 050

(n = 13)

0.303 0.460

Math 040

(n = 10)

Pearson’s Correlation Coefficient (r)

Linear Regression Analysis

Final Math Grade as a Function of Arithmetic Test Scores

Accuplacer Arithmetic Test Score

120 100 80 60 40 20

Final Grade in Math Course (%)

110 100 90 80 70 60 50 40 30 Math 060 Rsq = 0.1528 Math 050 Rsq = 0.0841 Math 040 Rsq = 0.2117

slide-5
SLIDE 5

5

Linear Regression Analysis

Final Math Grade as a Function of Algebra Test Scores

Accuplacer Elementary Algebra Test Scores

120 100 80 60 40 20

Final Grade in Math (%)

110 100 90 80 70 60 50 40 30 Math 060 Rsq = 0.3806 Math 050 Rsq = 0.1533 Math 040 Rsq = 0.0916

Linear & Multiple Regression Analysis

English Cohort

Accuplacer Test Scores

0.575 0.563 0.508

English 060

(n = 15)

0.172 0.143 0.071

English 050

(n = 6)

0.669 0.641 0.285

English 040

(n = 10)

Both Tests Sentence Skills Reading Comprehension Final Grade

Pearson’s Correlation Coefficient (r)

Linear Regression Analysis

Final English Grade as a Function of Reading Comprehension Test Scores

Accuplacer Reading Comprehension Test Score

120 100 80 60 40 20

Final Grade in English Course (%)

100 90 80 70 60 50 English 060 Rsq = 0.2580 English 050 Rsq = 0.0050 English 040 Rsq = 0.0814

Linear Regression Analysis

Final English Grade as a Function of Sentence Skills Test Scores

Accuplacer Sentence Skills Test Score

120 100 80 60 40 20

Final Grade in English (%)

100 90 80 70 60 50 English 060 Rsq = 0.3169 English 050 Rsq = 0.0206 English 040 Rsq = 0.4111

slide-6
SLIDE 6

6

Logistic Regression Analysis

Creates a model that predicts a dichotomous

  • utcome based on one or more predictor

variables.

For this Study:

Outcome = Success or NonSuccess Predictor variables = Accuplacer test scores

Logistic Regression

Sample Classification Table - Math 050 cohort

Overall

0.033 P-value

80.0% 90.9% 10 1 Success (11) 50.0% 2 2 NonSuccess (4) Percentage Correct Success NonSuccess Predicted Outcome Predictor – Elementary Algebra Test score

Cutoff = 0.5

Logistic Regression

Sample Classification Table - English 060 cohort

Predictor – Sentence Skills Test score

0.030 P-value

93.8% Overall 100.0% 15 Success (15) 0% 1 NonSuccess (1) Percentage Correct Success NonSuccess Predicted Outcome

Cutoff = 0.5

Logistic Regression Models

Math Cohort

94.1%* 88.2%* 88.2%* Math 060

(n = 34)

Overall Percentage Correct 73.3% 80.0%* 73.3% Math 050

(n = 15)

100 %* 90.9% 90.9% Math 040

(n = 11)

Both Tests Elementary Algebra Arithmetic

*Level of significance (p-value) < 0.05

slide-7
SLIDE 7

7

Logistic Regression Models

English Cohort

n/a n/a n/a English 040

(n = 10)

100%* 93.8%* 100%* English 060

(n = 16)

100% 100%* 71.4% English 050

(n = 7)

Both Tests Sentence Skills Reading Comprehension Overall Percentage Correct

*Level of significance (p-value) < 0.05

Answers to the Questions?

† Can Accuplacer Tests Scores Predict Student

Success/Nonsuccess in College Preparation Courses? Yes!

† Should entry Assessment Testing be

Mandatory for College Preparation Applicants? Yes, but used as an advising tool only!

What Now?

Gather more data to support or refute the findings.

†

Test the prediction Models

†

Expand the study

†

Initiate new studies

Contact Information

Cindy James UCC Assessment Centre Coordinator 900 McGill Road Box 3010 Kamloops, BC Canada Phone: 250 – 828 – 5471 Fax: 250 – 371 – 5690 Email: cjames@cariboo.bc.ca Website: www.cariboo.bc.ca/dsd/assmnt/