Higher Education Data Workshop 26 July 2012 Agenda Data issues - - PowerPoint PPT Presentation

Higher Education Data Workshop 26 July 2012

Agenda

– Data issues – End of year monitoring arrangements for 2011/12 – EYM HESA extraction 2010/11 – Changes to the HESA IRIS system for 2011/12 submissions – Data quality analysis 2010/11 – Data relating to Welsh medium provision – Welsh studies data – HESA student record, updates on data collections and KIS – Audit outcomes and future audit arrangements – Maximum student number – Redistribution – Timetable – Part-time fees and funding for 2013/14 – Corporate Strategy monitoring and development

Data Issues (1)

• Continued issues with return of module

data on the HESA student record (MODSTAT and MODOUT), though improved since last year

• Issues found during HESA/EYM analysis,

similar to last year

• Data requirements circular

– To be published in August

Data Issues (2)

• HESES 2012/13

– Some issues with the new entrants table – recognise will include elements of estimation – May collect different information depending on part-time funding method for 2013/14

• I&E funding data verification

– Data verified for the first time this year – Questions about part-time credits data – will revisit to see if changes need to be made to extraction criteria – No specific authorised signatory or data contact, will collect details at data contact audit

Data Issues – NSS

• Possibility of separating out NSS results for

students taking all or part of their course through the medium of Welsh

• Would include responses for students with at least
• ne module with MODLANG=1 and LANGPCNT>0
• Likely to only be available at institutional level
• PVC group have been asked if they support this
• Would be provided by Ipsos MORI to institutions on

an ad hoc basis with cost implications

• Possibility of being funded centrally in future and

making the analysis available through the Custom Analysis Tool on the results website

Changes proposed for HESA 2013/14

–Not intending to request any major changes for 2013/14 –Will request increased coverage of fees- related fields to part-time undergraduate and PGCE –Information to come through the SLC for those in receipt of fee grant

Validation for the 2011/12 HESA student record

• Validation changes intended to draw attention to

issues found with 2010/11 HESA student record data

– MODOUT – MODSTAT – FUNDCOMP – FUNDCODE/MSFUND – FUNDCODE/MODCOUNT – Medical/dental JACS codes

End of year monitoring arrangements for 2011/12 (1)

– Last year we indicated we would cease to collect detailed credit values data using the EYM survey for HEIs, subject to consultation responses – Would use data extracted from the HESA student record instead – Quality of data wasn’t good enough in 2009/10 to not collect EYM for 2010/11 – HESA IRIS system introduced for 2010/11 to give a preview of the extraction at the time of submitting HESA data

End of year monitoring arrangements for 2011/12 (2)

– Data quality improvements since 2009/10

• Some improvements in module outcome

coding

• Still coding issues with JACS/ASC,

sandwich year out, module outcomes

• Not all of 2010/11 extraction would be

suitable to use in place of 2010/11 EYM

End of year monitoring arrangements for 2011/12 (3)

– Informal consultation by email sent to HEIs and FEIs in July 2012 – Proposed that:

• FEIs would continue to return data on the EYM

survey

• No data would be collected on the EYM survey

from HEIs

• Data for HEIs to be extracted from the HESA

student record in early 2013

– Proposal was accepted by the majority of institutions

End of year monitoring arrangements for 2011/12 (4)

– Arrangements for 2011/12

• Extraction will be available in IRIS
• Institutions are expected to scrutinise the output
• Data will be extracted from the signed off 2011/12

HESA student record by HEFCW in early 2013

• HEIs will be able to make changes to the data
• Verified data will be used in clawback calculations

and as the definitive end of year aggregate picture for HEIs

Timetable

2012 Summer/Autumn Extracted data from the 2011/12 HESA record made available through the IRIS system End November Signed off HESA data provided to HEFCW by HESA 2013 January Extraction of end of year data from the 2011/12 record End of year data sent to HEIs for verification February HEIs to send back verified data, signed, with any changes Spring Verified data used to calculate adjustment of grant Any adjustments to 2011/12 grant notified to institutions

EYM data extracted from HESA 2010/11 (1)

– Extracted as part of the HESA IRIS system – Re-extracted from HESA student data at HEFCW in 2012 – Some differences compared to IRIS:

• 2 week rule added to registration criteria
• Level 5 estimations correctly categorised
• Minor cell differences (<100 credits in most cases)
• ITT (QTS) located at lead financial partner
• PGCE (FE) courses included as non-degree

EYM data extracted from HESA 2010/11 (2) Table 1a

– Differences between HESA and EYM for Table 1a range from -11% to +11% (8 within 2%) overall

• For UG degree -10% to 3% (9 within 3%)
• For UG non-degree -12% to 65% (6 within 5%)
• For PGT -5% to 308% (8 within 5%)

– Large percentage differences generally relate to small numbers or specific coding errors – Improvement on 2009/10 in most categories for most institutions (overall range in 2009/10 was -11% to 16% (5 within 2%))

EYM data extracted from HESA 2010/11 (3) Table 1a

– Some large differences by ASC

• ASC 2 – possibly due to miscoding of fundability

status for NLIAH-funded courses

• ASC 1 – division of clinical and non-clinical

provision

• Much variation by institution

EYM data extracted from HESA 2010/11 (4) Table 1a

– Degree of estimation of completion status for modules varies:

• From 0% to 5% for UG degree (1 over 2%)
• From 0% to 100% for UG non-degree (3 over

10%)

• From 0% to 34% for PGT (7 over 10%)
• From 0% to 6% overall

– Low levels of estimation for UG as might be expected, higher levels for PGT

EYM data extracted from HESA 2010/11 (5) Table 1a

– Still some estimation for modules contained within the reporting year (2% overall with unknown outcomes, 11% in PGT) – MODOUT=6 – should some be coded as non- completions or should MODSTAT be 3? – Small proportions (<0.5%) or no modules coded as non-completions

– MODSTAT – higher proportions of MODSTAT=3 than MODSTAT=1

EYM data extracted from HESA 2010/11 (6) Table 1b

– Large mismatch with EYM at some institutions – a lot more credits on EYM than HESA – Particular issue with ASC 9 – language courses with a year out – Differences in other ASCs – Highlights coding issues on HESA

• LOCSDY
• SPECFEE

EYM data extracted from HESA 2010/11 (7) Table 1b

– Large proportions of estimation of completion status at some institutions (5 over 25%) – 51% of credit values have MODSTAT=2 and MODOUT=6 – All instances coded as being within the reporting year (TYPEYR=1)

EYM data extracted from HESA 2010/11 (8) Table 1c

– Differences between HESA and EYM for Table 1c (PT credit values) range from -27% to +29% (6 within 5%)

• For UG -31% to 14% (6 within 5%)
• For UG FO -27% to 2% (3 within 2%, + 1 outlier)
• For PGT -34% to 76% (7 within 10%)

– Comparisons vary widely by institution – Improvement on 2009/10 when overall comparisons were -43% to 16% (5 within 5%)

EYM data extracted from HESA 2010/11 (9) Table 1c

– Degree of estimation of completion status for modules varies:

• From 3% to 52% for UG
• From 20% to 79% for PGT
• From 9% to 54% overall

– More estimation than for FT – High levels of estimation don’t seem to be linked to large differences between HESA and EYM – Still getting unknown outcomes for modules contained within the year

EYM data extracted from HESA 2010/11 (10) Tables 2a and 2b

– HESA and EYM match well for registrations to 1 November – Number of registrations gaining QTS is not as good a match – Some miscoding of OUTCOME

EYM data extracted from HESA 2010/11 (11) Table 3

• Fundable

– FT UG degree all within 5% – FT UG non-degree all but 2 within 7% – FT PGT range from -39% to 20%

• Non-fundable

– large differences, EYM>HESA – Non-fundable registrations not being picked up from HESA – Some non-fundable coded as FUNDCOMP=9

• Island and overseas

– 7 less than 10% difference overall, 3 with 25%+ difference – Non-fundable/IO being interchanged

EYM data extracted from HESA 2010/11 (12) Table 4

• Totals by level, mode, ASC are close for UG
• More differences seen for PGT and PGR in

total and by ASC

• Large differences in ASC 9 for sandwich

year out

EYM data extracted from HESA 2010/11 (13) Funding Summary

• Comparisons of funding value of HESA and EYM

are close in most cases

• 8 within 5% of each other
• Larger differences seen where there are coding

and extraction issues

EYM data extracted from HESA 2010/11 (14) General issues Extraction method:

• Weaknesses in estimation method for

module outcomes for some institutions and modes/levels

• Lack of estimation of unknown outcomes

for registrations

• Credit values and registrations not rounded

EYM data extracted from HESA 2010/11 (15) General issues

Coding by institutions:

• JACS codes

– Medical and dental courses – Y000

• module outcomes

– modules contained within the academic year which have unknown outcomes – Categories with no non-completions

• FUNDCOMP

– Use of FUNDCOMP = 9 for non-fundable students

• FUNDCODE

– Miscoding of health-related courses

• sandwich year out

– Miscoding of LOCSDY and SPECFEE

EYM data extracted from HESA Future developments (1)

• HESA student record validation checks for

2011/12 will highlight some of the coding issues

• IRIS 2011/12 – even more important to scrutinise,

want to minimise changes at verification

• Estimation:

– Will investigate how effective this currently is and revise where necessary – Possibility of using previous years’ data – Will develop method for registrations

EYM data extracted from HESA Future developments (2)

• Need institution feedback

– Are differences due to

» Errors and coding practice » Difference in timing of EYM and HESA » Problems with our estimation method » Problems with our extraction method » Different definitions used in HESA and EYM

HESA IRIS system 2011/12 (1)

– 2011/12 version set to go live on 6 August – At TEST COMMIT and COMMIT stages of submission, a file created by HEFCW will be available for download – Will include (as last year):

– EYM extraction – Maximum student number data – Per capita, premium and PGR funding data

Changes to the IRIS system for 2011/12 submissions (1)

• Addition of:

– Data quality analysis » Excludes tables with linked data » Comparisons with previous years not included » Maps not included – Expensive and priority subject premium data » As extracted for 2012/13 funding – For our Future indicators » All those using HESA student data only

Changes to the IRIS system for 2011/12 submissions (2)

• Amended versions of:

– EYM extraction, to reflect changes made to 2010/11 extraction post-IRIS – Per capita, premium and PGR funding data extraction, to reflect changes made for 2012/13 funding

IRIS system 2011/12 (2)

• Institutions need to:

– Scrutinise the output in plenty of time before the HESA deadline – is the output what you’d expect? – Resubmit where possible – HEFCW will scrutinise data if requested – Take account of issues in data coding for 2012/13 – Where errors and coding issues cannot be fixed, let HEFCW know

HESA Data quality analysis 2010/11

HESA data quality analysis 2010/11 – 1

Purpose

– HEIs to compare their data with the sector – HEFCW to draw attention to particular fields

Tables

– No new tables added since 2009/10 analysis – 4 years’ trend data for tables based on fields new in 2007/08 HESA student record – 5 years’ trend data for all other tables

Discussion

– Selection of more problematic tables

HESA data quality analysis 2010/11 – 2

Table 1 – Postcodes

– 2% postcodes missing (3% in 2009/10) – Between 0% and 5% at ten HEIs, 13% at one HEI

Table 5 – Coding of non-standard academic year

– 24% of enrolments starting after 1 Jan and leaving after 31 Jul coded as standard academic year (23% in 2009/10) – Between 38% and 89% at six HEIs, 3% or less for three HEIs – 9% of full-time masters lasting more than 40 weeks coded as standard academic year (17% in 2009/10)

HESA data quality analysis 2010/11 – 3

Table 6 – Average FTE/credits per enrolment

– Strange maximums and minimums at some HEIs

Table 8 – using HEFCE linking

– 5% of students with different HUSID in previous year (6% in 2009/10) – Between 0% and 46% at individual HEIs – Majority of students with different HUSID have changed HEI – Full-time postgraduates most likely to have different HUSIDs

HESA data quality analysis 2010/11 – 4

Table 12 –Welsh fluency

– 88% with known Welsh speaker status – (53% in 2004/05, 87% in 2009/10) – Between 88% and 99% at ten HEIs, 45% at one HEI.

Table 13 – Disability

– 100% have known disability status (95% in 2009/10)

Table 14 – Disabled Students’ Allowance (DSA)

– 12% of disabled student enrolments with information on DSA not known (13% in 2009/10) – Between 1% and 37% at eight HEIs, 0% at three HEIs

HESA data quality analysis 2010/11 – 5

Table 15 –Level of subject coding

– 28% of enrolments coded to three or more places (between 9% and 46% at individual HEIs)

Table 17 – Module outcome not yet known

– 41% continuing into next reporting year (21% in 2009/10) – 4 HEIs where100% NOT continuing into next reporting year

Table 18 – Term-time postcode

– 5% with term-time postcode missing (11% in 2009/10) Between 1% and 4% at eight HEIs, between 13% and 23% at three HEIs

HESA data quality analysis 2010/11 – 6

HESA data quality analysis 2010/11 – 7

Table 20 – Socio-economic classification (SEC)

– 71% with valid SEC (69% in 2009/10) – 23% SEC not classified (24% in 2009/10) – 6% SEC not recorded (7% in 2009/10) – SEC not classified between 15% and 37% at individual HEIs (UCAS and non-UCAS entrants) – SEC not recorded between 0% and 24% at individual HEIs (non-UCAS entrants only)

HESA data quality analysis 2010/11 – 8

Future changes

– Comments on current content welcome – Suggestions for new content welcome – Possible future changes, changing use, new fields – Inclusion in IRIS from 2011/12 – Continue current form of analysis

HESA data quality analysis 2010/11 – 9

Contact details Liz Heal 029 2068 2231 elizabeth.heal@hefcw.ac.uk hestats@hefcw.ac.uk

Data Cyfrwng Cymraeg Welsh Medium Data

Let’s Get it Right!

Dr Dafydd Trystan Cofrestrydd / Registrar d.trystan@colegcymraeg.ac.uk

Strwythur y Cyflwyniad Presentation

 Data Cyfrwng Cymraeg  Targedau Cyfrwng Cymraeg  Cofnodi’n Gywir – Darpariaeth Cyfrwng Cymraeg  Welsh Medium Data  Welsh Medium Targets  Getting it right – Welsh Medium provision

HESA Data

 Pob blwyddyn mae data HESA yn cael ei gyflwyno gan sefydliadau am bob myfyriwr ac aelod o’r staff a’u gweithgareddau academaidd yn y Brifysgol  Mae data yn cael ei gyflwyno i HESA yn Nhymor yr Hydref ac ar gael i’r Coleg erbyn Tymor y Gwanwyn  Every year HESA data is submitted by the HEIs for the academic activities of all students and staff  Data is submitted during the Autumn term and is available to the Coleg during the Spring term

Pa ddata cyfrwng Cymraeg sydd ar gael? / What data is available?

 Astudiaethau Myfyrwyr yn ôl modiwl  Myfyriwr ar fodiwl  Gallu Ieithyddol Myfyriwr  Statws y myfyriwr (IR/OR, Llawn amser / Rhan Amser)  Staff sy’n dysgu yn Gymraeg / Staff all ddysgu yn Gymraeg  Student studies by module  Student on a module  Student’s linguistic ability  Student Status (FT/PT, UG/PG)  Staff that teach in Welsh

• r who can teach in

Welsh

Beth yw astudio yn Gymraeg? / What is studying in Welsh?

O leiaf 2 credyd yn Gymraeg

 Dull Adrodd HESA  Cyrsiau cyflwyno’r Gymraeg

At least 2 credits in Welsh

 HESA reporting practice  Introducing Welsh Language in modules

Targedau Cyfrwng Cymraeg Welsh Medium Target

 5,600 o fyfyrwyr o

Gymru yn astudio

rhywfaint o’r cwrs

yn Gymraeg

 (Targed wedi ei ddiwygio ychydig yn dilyn amrywiadau data yn y sefydliadau)

 5,600 of Welsh

domiciled students studying some element

• f the course in Welsh

 (Target has been refined somewhat following work on data in institutions)

Fesul Prifysgol By University

Prifysgol / University 2010/11 2012/13

Morgannwg / Glamorgan 170 275 Casnewydd / Newport 66 75 Met Abertawe / Swansea Met 65 75 Drindod Dewi Sant / TSD 1,994 2,000 Caerdydd / Cardiff 208 325 Met Caerdydd / Cardiff Met 144 225 Bangor 1,482 1,500 Agored / Open 93 100 Glyndwr 93 100 Abertawe / Swansea 248 325 Aberystwyth 481 600 Cyfanswm / Total 5,044 5,600

Beth yw gwerth canran cyfrwng Cymraeg modiwl? What is the Welsh language %age of a module?

 Man cychwyn – profiad y myfyriwr a synnwyr cyffredin!  Rhaid bod y ffigyrau yn rhesymol, yn gyson ac ar gael i’w harchwilio  Os am gyngor penodol, cysylltwch d.trystan@colegcymraeg. ac.uk  Starting point – the student experience and common sense!  The figures should be reasonable, consistent and auditable  For specific advice please contact d.trystan@colegcymraeg. ac.uk

Y modiwlau hawdd The straightforward modules

 Wedi ei addysgu a’i asesu yn Gymraeg yn unig: 100%  Y Gymraeg ac nid Saesneg yw’r cyfrwng addysgu (Ieithoedd Modern): 100%  Ble nad oes unrhyw gyswllt myfyriwr yn Gymraeg: 0%  Taught and assessed in Welsh only: 100%  Welsh and not English as medium of instruction (Modern Languages): 100%  Where there is no student contact in Welsh: 0%

Sut i gyfrifo? How do we calculate how much is in Welsh?

 Oriau Cyswllt  Asesu  Gweithgareddau eraill hunan-gyfeiriedig neu wedi eu trefnu  Scheduled teaching and learning hours  Assesment  Other self-directed learning activities

Enghraifft 1: Deall Data HEFCW Example 1: Understanding HEFCW data HE10110W

 10 darlith (Saesneg)  10 seminar (Cymraeg)  Traethawd ac arholiad (Cymraeg)  Pecyn hunan-gyfeiriedig (Cymraeg)  10 lectures (English)  10 seminars (Welsh)  Essay and exam (Welsh)  Self directed learning pack (Welsh)

75%

Enghraifft 2: Deall REF Example 2: Understanding REF HE10210W

 10 darlith (Saesneg)  5 seminar (Saesneg)  5 tiwtorial unigol (Cymraeg)  Traethawd ac arholiad (Saesneg)  10 lectures (English)  5 seminars (English)  5 individual tutorials (Welsh)  Essay and exam (English)

20%

Yr her fawr Getting it Right 2012!

 Darpariaeth ddim yn cael ei gofrestru  Methu â chyrraedd targedau  Colli cyllid  Failure to record current provision accurately  Potential failure to meet targets  Loss of funding

Data Cyfrwng Cymraeg Welsh Medium Data

Let’s Get it Right!

Dr Dafydd Trystan Cofrestrydd / Registrar d.trystan@colegcymraeg.ac.uk

Welsh studies

“I would like the Council to focus on the delivery of . . . the disciplines of what might be called Welsh studies, including the study of Welsh history and literature, culture, society and politics in both languages.” (HEFCW’s 2012-13 Remit letter)

Student Record 2011/12 and KIS

HEFCW Workshop, Cardiff 26/07/12

Student Record 2012/13

New qualification checks

• New exception rules will be introduced to tighten the relationship

between QUALENT3 and qualifications on entry

• Error where QUALENT3=P91 (L3 of which some or all are subject to

UCAS tariff) but there are no QUALTYPEs which are tariff-bearing reported in Qualifications on entry (and vice-versa)

• Error where QUALENT3=P92 (L3 of which none are subject to UCAS

tariff) but there are QUALTYPEs which are tariff-bearing reported in qualifications on entry (and vice-versa)

• Only looks at data submitted this year - will not use register
• Will check QUALTYPE is tariff-bearing in either the UCAS or HESA

tariff definitions

New data supply table

Field Name Description Element name in XML output Field length QOE.HUSID HESA unique student identifier HUSID 13 QOE.UKPRN UK Provider Reference Number UKPRN 8 QOE.NUMHUS Student instance identifier NUMHUS 20 QOE.QUALGRADE Qualification grade QUALGRADE 11 QOE.QUALSIT Qualification sitting QUALSIT 1 QOE.QUALSBJ Qualification subject QUALSBJ 3 QOE.QUALTYPE Qualification type QUALTYPE 2 QOE.QUALYEAR Qualification year QUALYEAR 4 XQEYEAR01 Year QualificationsOnEntry last updated XQEYEAR01 4

Instance.INITIATIVES

• Institutions in Wales must now use this field where

applicable…

• … 7 ‘Universities Heads of the Valleys Institute’ only
• Code 6 ‘Undergraduate internships’ is no longer available for

English HEIs

• Exception checks will no longer be run comparing HEFCE

counts of Lifelong Learning Networks (code 1) instances

• Exception will however continue checking 2 ‘Employer

engagement co-funded students’

StudentOnModule.MODOUT

• StudentOnModule.MODOUT records both funding

completion and credit outcomes for modules

• Important in deriving FUNDCOMP coding
• New exception rules added to warn institutions

where 5%(FT) or 15% (PT) of student on module records recorded as 6 ‘outcome not yet known’ but MODSTAT = 1 ‘Continuing from previous reporting year’ or 2 ‘Contained within reporting year’

StudentOnModule.MODSTAT

• StudentOnModule.MODSTAT records whether modules span

HESA years

• Data needs updating each instance year to reflect the status
• f the student on module
• Where code 1 ‘Continuing from previous reporting year’ is

used then it is expected that there will also be student on module records with 3 ‘Continuing into next reporting period ‘

• New exception warnings will be in place to check this tie-up

where 500+ student on module records have MODSTAT = 1 or 3 – institutions should ensure accurate coding

Check documentation change

• New MODOUT and MODSTAT table
• Important cross-referencing tool…
• …will help to quality assure FUNDCOMP derivations

STULOAD rule changes

• The 4.2 rules will be in place but increased to 5 times the

number of weeks in order to address the issues with the rule last year

• STULOAD should be less than 100 where TYPEYR is not equal

to 1 (i.e. non-standard years) and COMDATE is greater than Y1-07-31

• STULOAD should be less than 100 where TYPEYR is not equal

to 1 (i.e. non-standard years) and ENDDATE is in the current reporting period

• Only warnings to take into account accelerated learning

Check documentation change

• New DLHE item (contained in a new DLHE tab)

breaking down DLHE population by JACS level 2

• Beneficial for understanding future KIS reporting

Other validation changes

• EntryProfile.DOMICILE:
• Where >5% of entrants coded XK (error)
• Where >2% of entrants coded XK (warning)
• Instance.SPLENGTH:
• new validation rule will error any courses that have an

expected length of study of greater than 9 years…

• Instance.YEARSTU:
• Error for over 13,000 instances where YEARSTU=1,

TYPEYR=1 (standard year) but COMDATE is in a previous reporting year (in some cases going back to 1997!)

KIS 2012/13

• 22nd August 2012 – Final deadline for submission and

sign off

• 22nd August 2012 – Survey forms to be sent out from

HESA to assess how the HEIs found the process

• September 2012 – Institutional preview of the

UNISTATS/KIS WWW site

• October – Early Evaluation of KIS (EEK) workshops
• 31 October – KIS systems opens for updates
• 30 November – EEK report presented to HEPISG
• December – KIS 2013/14 Coding manual issued

KIS 2012/13

• HEFCE have issued a new circular (July) ‘Key

information Sets and Unistats: Overview and next steps’

• http://www.hefce.ac.uk/pubs/year/2012/201215/
• HESA training seminars on KIS 2013/14 (including

changes resulting from EEK)

Institution profile data collection

• New data collection June 2013
• Replaces current Campus Information System

Institution profile Academic cost centres Departments Proportions Campuses Locations

Cost centre changes

Academic cost centres

• Benchmarking opportunity - data to be added to

heidi (http://www.heidi.ac.uk)

• For HEIs in England return of departmental academic

cost centres is required. This is optional for institutions in Scotland, Wales and Northern Ireland.

• For all HEIs the return of tier and cost centre splits is
• ptional
• Contacts to be sought in the Autumn
• Data submitted to be used as cross-check in Student,

Staff and Finance returns

Department cost centre allocations

History Department Cost centre 139 History 75% Cost centre 140 Classics 25% For E HEIs return of departmental academic cost centres is required. This is optional for W, NI, S.

Tiers

Optional for all

More information

Visit the HESA website at www.hesa.ac.uk For help and advice on all aspects of the data collection and data submission process: liaison@hesa.ac.uk

Audit Outcomes – External Audits (1)

Findings of the audits: EYM:

• Credits counted where assessments hadn’t

been completed

• A download of the EYM data at the time
• f submission was not kept

Premium data:

• A small number of students’ postcodes did not

meet the criteria for the access and retention premium

Audit Outcomes – External Audits (2)

I&E funding data:

• Some discrepancies in part-time modules
• Collaborative Research Activity overstated
• The number of graduate start ups is estimated
• Graduate start ups being returned before the

individuals had graduated

• Evidence not available for the calculation of contact

time per distance learning student

• Academic staff time spent on public engagement is

estimated

Audit Outcomes – Internal Audits (1)

Recommendations included:

• Student data

– JACS codes should be assigned on entry – Withdrawals should be identified and notified to Registry

• n a timely basis

– It should be ensured that the date of birth field is updated – Accurate completion of the HE data returns should be included as a current risk on the University’s risk register – The arrangements for HESES with franchising partners should be formally documented to ensure that the return is completed accurately and in time

Audit Outcomes – Internal Audits (2)

• HEBCIS

– The University should consider making a return for facilities and equipment related services so activity is not underestimated in these areas – Record Retention Procedures should be developed to take account of procedures for EU related payments – The HEBCI return should be independently reviewed by suitably experienced members of staff – Evidence that validation and credibility checks are undertaken before returning data should be retained – Validation checks should include a reconciliation of the income data with the audited financial statements

Audit Outcomes – Internal Audits (3)

• HESA staff record

– Casual staff should be included in the HESA staff return – A record of previous errors identified and any checks performed in relation to them should be documented and retained – The HR department should determine if it is possible to produce reports for amendments not related to payroll and retain them on file

• Other

– The procedure document for RAS and charitable income should be updated to reflect that fact that the RAS will no longer be collected – Job descriptions should be updated

Audit Outcomes – Internal Audits (4)

Other continued

– The University should ensure that all relevant documentation relating to achievement data, such as the award confirmations and meeting attendance lists, are signed by all relevant individuals – Contracts for franchised programmes should be signed and dated by all relevant individuals in a timely manner – Procedures for the preparation of each return (HESA staff, HEBCIS, student, and HESES) should be documented, to ensure that the returns can be prepared in the absence of the manager responsible

External Audit for 2011/12

• End of five year audit cycle
• Extending KPMG contract by one year to cover

2011/12

• Scope of the 2011/12 audit will include:

– areas where previous audits have picked up issues – new areas of funding – the extraction of end of year data from the HESA student record

• Three HEIs will be audited
• Audits relating to data used in funding and end of year

data likely to take place in spring 2013

Audit Timetable for 2011/12

• August 2012

– Feedback from internal and external audits sent to institutions – Official notification of external audits for 2011/12 – Notes of guidance for external auditors issued

• September 2012

– Notes of guidance for internal auditors issued

• September 2012 to August 2013

– External audits take place

Future audit arrangements

• We will be reviewing the scope and arrangements

for the external audit of data during this year

• The scope of the external audit will change to

reflect the funding changes from 2012/13

• The external audit changes may have an impact on

the scope of internal audits at institutions

• Information returned on fee plans will be

increasingly in the scope of the audit, as will data used in the KIS

• We would welcome feedback from institutions

about the audits carried out in the past and any suggestions for future arrangements

Monitoring of the maximum student number 2011/12 (1)

• Final monitoring for 2011/12 will take place in early

2013 using 2011/12 HESA student data

• A preview will be available in IRIS – based on

published criteria:

– FT UG and PGCE home and EU fundable completed new entrants – Completion status estimated for the small number with unknown completion status – Medical and dental students on intercalated years will be excluded from monitoring

Monitoring of the maximum student number 2011/12 (2)

• Verification of HESA data 2011/12

– Recruited numbers for 2011/12 sent to institutions with details of students included – Amendments can be made

• Details of amendments and reasons for

amendments provided to HEFCW

• Need approval by HEFCW

– Intention that data will be sent to institutions along with other HESA data to be verified in early 2013

Monitoring of the maximum student number 2012/13 (1)

• New entrants
• Graduate diplomas where a degree is a requirement

will be excluded

• Improvements in retention will be taken into account
• Will be monitored initially using SLC data and data

collected on HESES 2012/13

• Are considering whether to exclude students topping

up to a degree who come from another institution

Monitoring of the maximum student number 2012/13 (2)

Penalty arrangements for 2012/13

• WG will calculate an overall financial penalty to

impose if monitoring of SLC data shows over- recruitment

• Initial monitoring using HESES 2012/13 data used to

share the penalty between institutions

• Final monitoring using HESA 2012/13 data, with any

necessary adjustments made

• A number penalty for over-recruitment in 2012/13 will

be applied to the 2013/14 maximum student number

Redistribution

• Informal process this year
• Email sent to institutions on 13 July 2012
• Transfers of 2012/13 maximum numbers

between institutions or movement of credits for

• ther modes and levels to be discussed on an

informal basis

Monitoring of the maximum student number - Timetable

Timetable for 2011/12 and 2012/13 December 2012 Initial monitoring of recruitment to the 2012/13 maximum student number using SLC and HESES data January 2013 Notification of any initial financial and number penalties to the institutions concerned Verifications for 2011/12 maximum student number sent to institutions February 2013 Verifications for 2011/12 returned by institutions Spring 2013 Initial financial penalties for 2012/13 imposed

Monitoring of the maximum student number 2013/14

• Start of all cohort monitoring
• Conversion rates for further years of 2012/13

and 2013/14 starters will be subject to verification before we use them

• Considering changes to the monitoring

process for 2013/14 to allow more flexibility

Timetable for 2012/13 (1)

26 July Workshop for institutions July Corporate Strategy consultation with sector Mid September Data submitted to HESA Mid Sept/Oct HESA data quality checking October Corporate strategy consultation deadline for responses End October HESES survey published November/ HESES returned and verifications issued December

Timetable for 2012/13 (2)

January Verifications for EYM, maximum student number, premium, per capita and PGR funding issued Signed HESES verifications returned February Signed verifications of HESA data returned Spring Funding allocations for 2013/14 announced, including 2011/12 adjustments to grant (EYM) and initial penalty for over-recruitment in 2012/13

Developing the HEFCW Corporate Strategy from 2013

Celia Hunt and Liz Heal

Today

• Report on the consultation on HEFCW’s new

Corporate Strategy 2013-14 to 2015-16

• Discuss the development of the measures

But first ... Part-time

• Part-time UG Working Group
• Modelling on possible scenarios (funding ELQ and

<25% FTE)

• 75% of PTUG students would not be covered by new

proposals

• Highlighted challenges about how these students

might be supported in light of other funding pressures

• HEFCW/WG to do more work on this
• Next Working Group meeting after summer

What is a Corporate Strategy – Welsh Government guidance

• ‘Following publication by the Welsh Government of a strategic

agenda, HEFCW must produce a corporate plan.

• In developing its corporate plan, HEFCW must have due regard

to the Welsh Government’s policy framework as described in the remit letter.

• The corporate plan must cover the period of the strategic agenda

and be updated as and when requested by the sponsor team.

• Unless otherwise agreed, corporate plans will be rolled forward

year on year in consultation with the sponsor team as they develop their own Business Plans’. [draft Framework Document]

Renewing Corporate Strategy – Remit letter 2012-13

• ‘The Council’s current Corporate Strategy formally ends in 2013.
• The Government’s broader strategies to promote economic

renewal and to enhance social justice or mobility, together with the changes already being implemented in relation to the structure, governance and funding of higher education in Wales constitute the backdrop against which the Council will need to frame its future strategy.

• I intend to ask my officials later this year to begin a programme
• f work to redefine the outcomes we expect from the higher

educations sector, building on the changes now under way. I will look to the Council to work closely with my officials to establish desirable outcomes at national level and in the light of our renewed vision for higher education to develop a new Corporate Strategy for the medium to long term.’

What is the underpinning strategic agenda?

• For our Future;
• FoF expectations
• Programme of Government (to 2016)
• Science Strategy;
• Structure, governance and funding of HE in

Wales (changes already underway)

What is the underpinning strategic agenda – remit 2012-13?

• Active and supporting role in institutional merger;
• More direct line of sight to institutional governance;
• Capping, Fee Plans, Condition of Funding: smooth transition;
• Subject focus: STEM, MFL and now Welsh Studies;
• Student voice – including in Governance;
• Support for Coleg Cymraeg Cenedlaethol
• Graduate employability including higher level apprenticeships;
• Selective funding for research and implementing science policy;
• Sustainable development framework
• Interest in i-Tunes U and online resources (including WM);
• Widening Access, building on Child Poverty Strategy, CF and

UHOVI, as well as regional policy

• Internationalisation and Sustainable Development

Reviewing performance against the strategy

• Currently twelve measures/targets as well as

monitoring measures

• HESA/LLWR data (currently 2010/11)
• Comparators with UK
• Institutional forecasts
• Narrative (eg reviewing the widening access and

student experience strategic approaches)

What are we seeking to achieve?

Outcomes:

• Social justice
• A buoyant economy

What are we seeking to achieve?

Vision and mission Vision: sustainable, accessible, internationally excellent higher education Mission: We aim to:

• Secure an excellent quality higher education student experience

and excellent quality research

• Promote to Welsh Government, employers and the wider public

the contribution of higher education in Wales

• Ensure universities and colleges deliver Welsh Government

priorities in higher education In order to enhance social justice and support a buoyant economy

What are we seeking to achieve?

Five strategic themes:

• Widening Access: Ensure inclusion, progression and success in

higher education;

• Student Experience: Ensure that the student learning

experience is of excellent quality and is enhanced by the student voice;

• Skills: Ensure that all graduates are equipped for life and work

and universities deliver an upskilled workforce;

• Innovation and Engagement: Ensure strengthened productive

relationships between HEIs and the public, private and third sectors;

• Research: Ensure excellent quality research to underpin the

knowledge economy and support civil society

What are we seeking to achieve?

Enabling themes:

• Reconfiguration and Collaboration: Deliver a reconfigured HE

system with strong providers that, through partnership working, particularly regionally, offer more accessible HE opportunities;

• Governance: Deliver continual improvement in the quality of

governance and long terms sustainability of the HE system

• Organisational Effectiveness: Be a well run and cost effective
• rganisation which will work productively with the Welsh

Government and the sector

Strategic Diagram

Given what we say we want to achieve (the strategic and enabling themes/objectives), how should we measure our performance?

Twelve current measures:

• Widening Access: Communities First and Module Completion;
• Student Experience: NSS, Welsh medium, Overseas Students;
• Skills: Employability; UHOVI participation; Part-time
• Knowledge Transfer: Spin-out
• Research: Research Council Income
• Reconfiguration and Collaboration: Income
• Governance: Institutional Risk

Possible corporate strategy measures – 1

Of 12 measures in HEFCW’s current corporate strategy: 7 may be retained in their current form:

• National student survey overall satisfaction (student experience)
• Overseas students (student experience)
• Employment (skills)
• UHOVI participation (skills)
• Research Councils income (research)
• Research and collaboration
• Governance

Possible corporate strategy measures – 2

3 may be modified:

• Module completion (widening access)

– Currently completed modules – Propose completed modules where credit achieved

• Welsh medium (student experience)

– Propose increase in target, additional component looking at volume of study – Currently Welsh domiciled only – Propose all students

• Part-time (skills)

– Currently absolute target – Propose monitoring growth/decline compared to UK

Possible corporate strategy measures – 3

1 may be modified, or if necessary, dropped:

• Communities first (widening access)

– Currently uses April 2009 Communities First areas – Propose using new areas being introduced by WG if possible

1 may be dropped:

• Spin-out (innovation and engagement)

Possible corporate strategy measures – 4

11 possible new measures in areas of:

• Widening access
• Student experience
• Skills
• Innovation and engagement
• Research

Possible corporate strategy measures – 5

Widening access

• Community first

– Propose Welsh domiciled students only – Propose measure based on UK performance indicator or HEFCW funding method

Student experience

• National Student Survey - other areas
• Overseas student experience
• Digital technologies

Possible corporate strategy measures – 6

Skills

• Employability

– GO Wales targets – Longitudinal destinations of leavers from HE data – Additional questions in the NSS

• Participation
• Continuing professional development
• STEM

Innovation and engagement

• Basket style measure based on all HEBCIS data

Possible corporate strategy measures – 7

Research

• Research income relative to QR funding
• Research quality

– Citation indices – REF data

New theme

• Organisational effectiveness

Possible corporate strategy measures – 8

• Consultation issued to HEIs and FEIs today
• Public consultation from September
• Response required by 12 October
• Welcome all views on our proposals, suggestions for

alternative measures and data sources

• In general data needs to be publicly available and easily
• btained