SLIDE 1
Evaluating widening participation Key findings from CFEs reports to - - PowerPoint PPT Presentation
Evaluating widening participation Key findings from CFEs reports to - - PowerPoint PPT Presentation
Evaluating widening participation Key findings from CFEs reports to HEFCE 2 nd September 2015 About CFE Research An independent not- for-profit company specialising in providing research and evaluation services in the fields of education,
SLIDE 2
SLIDE 3
Working in partnership with...
- Professor Liz Thomas
- Economists from:
- University of Sheffield
- University of Sussex
- University of Birmingham
- London School of Economics
SLIDE 4
Two reports for HEFCE
Report on the piloting of a more detailed data return
SLIDE 5
Two reports for HEFCE
Report on the piloting of a more detailed data return In-depth study with case studies
SLIDE 6
What we did
SLIDE 7
Reviewed evidence
SLIDE 8
Review of evidence
Drafted frameworks
SLIDE 9
Consulted with HE providers
- Visits to 25 institutions
- Interviews with key staff
- 15 institutions also piloted the data return
- Six case studies
SLIDE 10
Designed & piloted a more detailed data return
SLIDE 11
Key messages
SLIDE 12
The purpose of an evaluation framework
- Accountability
- Benchmarking
- What works
- Impact assessment
- Return on investment
SLIDE 13
Different purposes require different approaches
SLIDE 14
Accountability
- Data return most
appropriate for this purpose
- Any new data or
changes need to be requested in advance
- f reporting periods...
- ...with plenty of time
to put in place data collection
SLIDE 15
Benchmarking
- UK Performance
Indicators meet this need
- Measures should link
back to the issue funding/activity is seeking to address
- The role of measuring
‘distance travelled’
SLIDE 16
What works and impact
- Need to improve attribution
- Stronger evaluation methods with good
comparison groups including RCTs
- More appropriate for new or innovative
approaches
- Longitudinal tracking of students
- Better use of secondary data
- Supported by qualitative research
SLIDE 17
More evaluations with good comparison groups
SLIDE 18
More longitudinal tracking
SLIDE 19
Making better use of existing data
- For example,
National Pupil Database , HM Revenue & Customs
- Data Labs
- Small Business,
Enterprise & Employment Act 2015
SLIDE 20
A role for qualitative research
- How does it work?
- Does it matter?
- Is this intervention
right for this group
- f people?
Heinrich-Boll-Stiftung CC BY-SA 2.0
SLIDE 21
Return on investment
- Econometric analysis
- f secondary data
- Not all benefits of WP
can or should be measured in financial terms
Mattia Landoni CC BY-SA 2.0
SLIDE 22
Make findings accessible
SLIDE 23
Thank you
Rachel Moreton rachel.moreton@cfe.org.uk 0116 229 3300 www.cfe.org.uk