SLIDE 1 Collecting and Analyzing “Dosage” Data to Improve Program Outcomes
Kelly Bay-Meyer, Ph.D. Lisa Predovich, M.Ed.
Presentation at the National College Access Network Conference in Orlando, Florida (September 28, 2015). www.collegesuccessfoundation.org/NCAN2015
SLIDE 2 Agenda
15 minutes
- Overview
- Selecting Milestones
30 minutes
15 minutes
- Recommendations
- Reflections
SLIDE 3
Introduction to CSF
Mission Statement
We provide the unique integrated system of supports and scholarships to inspire underserved, low-income students to finish high school, graduate from college and succeed in life.
SLIDE 4
Introduction to CSF
Focus Areas Scholarships Training &Technical Assistance Advocacy Research Student Supports
SLIDE 5 Dosage Data
- Dosage data is defined by interactions that last
longer than 15 minutes.
- This data is measured longitudinally against
National Student Clearinghouse data, milestone completions and student surveys to help determine how specific interventions can affect post-secondary success.
- This data can be collected in an Excel spreadsheet.
SLIDE 6 Selecting Milestones
- 1. Program outcomes were developed based on
research that demonstrated specific tasks that led to an increase in student persistence.
- 2. Program staff collaborated with Research &
Evaluation team to build a logic model and determine methods for tracking data.
- 3. Realistic goals were set based on literature review.
SLIDE 7 Milestone Examples
High School-Level:
- Take the ACT/SAT
- Apply to more than one college
- File the FAFSA by the priority deadline
- Participate in campus visits
- Apply to more than one scholarship
College-Level:
- Meet with faculty during office hours
- Get involved in extra-curricular activities
- Participate in academic advising
- Participate in early career exploration activities
- File the FAFSA by the priority deadline
SLIDE 8 Dosage Data Collection & Analysis
- 1. Set-up Dosage Data File
- 2. Define Program’s Data Fields
- 3. Train Staff
- 4. Collect Dosage Data
- 5. Analyze Data
SLIDE 9
Demonstration
Please see Dosage Data Guide & Excel template located here: www.collegesuccessfoundation.org/NCAN2015
SLIDE 10
Results Milestone Completion
SLIDE 11
Results Dosage Analysis
SLIDE 12
Results “Engaged” vs. “High Dosage”
SLIDE 13
Recommendations
1. Based on milestone completion rates, to what extent are we on track to meet programmatic goals? 2. Based on contact hours, how are students most frequently connecting with staff? 3. How do topic hours provided compare to programmatic priorities? 4. What impact might this program have on FAFSA completion?
SLIDE 14
How can collecting dosage data help improve your program?
Reflections
SLIDE 15
Kelly Bay-Meyer, Ph.D. Senior Research & Evaluation Officer, CSF kbay@collegesuccessfoundation.org Lisa Predovich, M.Ed. Senior Program Officer, Navigators, CSF lpredovich@collegesuccessfoundation.org
Contact Information
