EYM data extracted from HESA 2010/11 (15) General issues Coding by institutions: • JACS codes – Medical and dental courses – Y000 • module outcomes – modules contained within the academic year which have unknown outcomes – Categories with no non-completions • FUNDCOMP – Use of FUNDCOMP = 9 for non-fundable students • FUNDCODE – Miscoding of health-related courses • sandwich year out – Miscoding of LOCSDY and SPECFEE
EYM data extracted from HESA Future developments (1) • HESA student record validation checks for 2011/12 will highlight some of the coding issues • IRIS 2011/12 – even more important to scrutinise, want to minimise changes at verification • Estimation: – Will investigate how effective this currently is and revise where necessary – Possibility of using previous years’ data – Will develop method for registrations
EYM data extracted from HESA Future developments (2) • Need institution feedback – Are differences due to » Errors and coding practice » Difference in timing of EYM and HESA » Problems with our estimation method » Problems with our extraction method » Different definitions used in HESA and EYM
HESA IRIS system 2011/12 (1) – 2011/12 version set to go live on 6 August – At TEST COMMIT and COMMIT stages of submission, a file created by HEFCW will be available for download – Will include (as last year): – EYM extraction – Maximum student number data – Per capita, premium and PGR funding data
Changes to the IRIS system for 2011/12 submissions (1) • Addition of: – Data quality analysis » Excludes tables with linked data » Comparisons with previous years not included » Maps not included – Expensive and priority subject premium data » As extracted for 2012/13 funding – For our Future indicators » All those using HESA student data only
Changes to the IRIS system for 2011/12 submissions (2) • Amended versions of: – EYM extraction, to reflect changes made to 2010/11 extraction post-IRIS – Per capita, premium and PGR funding data extraction, to reflect changes made for 2012/13 funding
IRIS system 2011/12 (2) • Institutions need to: – Scrutinise the output in plenty of time before the HESA deadline – is the output what you’d expect? – Resubmit where possible – HEFCW will scrutinise data if requested – Take account of issues in data coding for 2012/13 – Where errors and coding issues cannot be fixed, let HEFCW know
HESA Data quality analysis 2010/11
HESA data quality analysis 2010/11 – 1 Purpose – HEIs to compare their data with the sector – HEFCW to draw attention to particular fields Tables – No new tables added since 2009/10 analysis – 4 years’ trend data for tables based on fields new in 2007/08 HESA student record – 5 years’ trend data for all other tables Discussion – Selection of more problematic tables
HESA data quality analysis 2010/11 – 2 Table 1 – Postcodes – 2% postcodes missing (3% in 2009/10) – Between 0% and 5% at ten HEIs, 13% at one HEI Table 5 – Coding of non-standard academic year – 24% of enrolments starting after 1 Jan and leaving after 31 Jul coded as standard academic year (23% in 2009/10) – Between 38% and 89% at six HEIs, 3% or less for three HEIs – 9% of full-time masters lasting more than 40 weeks coded as standard academic year (17% in 2009/10)
HESA data quality analysis 2010/11 – 3 Table 6 – Average FTE/credits per enrolment – Strange maximums and minimums at some HEIs Table 8 – using HEFCE linking – 5% of students with different HUSID in previous year (6% in 2009/10) – Between 0% and 46% at individual HEIs – Majority of students with different HUSID have changed HEI – Full-time postgraduates most likely to have different HUSIDs
HESA data quality analysis 2010/11 – 4 Table 12 – Welsh fluency – 88% with known Welsh speaker status – (53% in 2004/05, 87% in 2009/10) – Between 88% and 99% at ten HEIs, 45% at one HEI. Table 13 – Disability – 100% have known disability status (95% in 2009/10) Table 14 – Disabled Students’ Allowance (DSA) – 12% of disabled student enrolments with information on DSA not known (13% in 2009/10) – Between 1% and 37% at eight HEIs, 0% at three HEIs
HESA data quality analysis 2010/11 – 5 Table 15 – Level of subject coding – 28% of enrolments coded to three or more places (between 9% and 46% at individual HEIs) Table 17 – Module outcome not yet known – 41% continuing into next reporting year (21% in 2009/10) – 4 HEIs where100% NOT continuing into next reporting year Table 18 – Term-time postcode – 5% with term-time postcode missing (11% in 2009/10) Between 1% and 4% at eight HEIs, between 13% and 23% at three HEIs
HESA data quality analysis 2010/11 – 6
HESA data quality analysis 2010/11 – 7 Table 20 – Socio-economic classification (SEC) – 71% with valid SEC (69% in 2009/10) – 23% SEC not classified (24% in 2009/10) – 6% SEC not recorded (7% in 2009/10) – SEC not classified between 15% and 37% at individual HEIs (UCAS and non-UCAS entrants) – SEC not recorded between 0% and 24% at individual HEIs (non-UCAS entrants only)
HESA data quality analysis 2010/11 – 8 Future changes – Comments on current content welcome – Suggestions for new content welcome – Possible future changes, changing use, new fields – Inclusion in IRIS from 2011/12 – Continue current form of analysis
HESA data quality analysis 2010/11 – 9 Contact details Liz Heal 029 2068 2231 elizabeth.heal@hefcw.ac.uk hestats@hefcw.ac.uk
Data Cyfrwng Cymraeg Welsh Medium Data Let’s Get it Right! Dr Dafydd Trystan Cofrestrydd / Registrar d.trystan@colegcymraeg.ac.uk
Strwythur y Cyflwyniad Presentation Data Cyfrwng Cymraeg Welsh Medium Data Targedau Cyfrwng Welsh Medium Targets Cymraeg Getting it right – Cofnodi’n Gywir – Welsh Medium Darpariaeth Cyfrwng provision Cymraeg
HESA Data Pob blwyddyn mae data HESA yn cael ei gyflwyno Every year HESA data is gan sefydliadau am bob submitted by the HEIs myfyriwr ac aelod o’r for the academic staff a’u gweithgareddau activities of all students academaidd yn y and staff Brifysgol Data is submitted during Mae data yn cael ei the Autumn term and is gyflwyno i HESA yn available to the Coleg Nhymor yr Hydref ac ar during the Spring term gael i’r Coleg erbyn Tymor y Gwanwyn
Pa ddata cyfrwng Cymraeg sydd ar gael? / What data is available? Student studies by Astudiaethau Myfyrwyr module yn ôl modiwl Student on a module Myfyriwr ar fodiwl Student’s linguistic Gallu Ieithyddol Myfyriwr ability Statws y myfyriwr Student Status (FT/PT, (IR/OR, Llawn amser / UG/PG) Rhan Amser) Staff that teach in Welsh Staff sy’n dysgu yn or who can teach in Gymraeg / Staff all Welsh ddysgu yn Gymraeg
Beth yw astudio yn Gymraeg? / What is studying in Welsh? O leiaf 2 At least 2 credyd yn credits in Gymraeg Welsh Dull Adrodd HESA HESA reporting practice Cyrsiau cyflwyno’r Introducing Welsh Gymraeg Language in modules
Targedau Cyfrwng Cymraeg Welsh Medium Target 5,600 o fyfyrwyr o 5,600 of Welsh Gymru yn astudio domiciled students rhywfaint o’r cwrs studying some element of the course in Welsh yn Gymraeg (Target has been refined (Targed wedi ei ddiwygio somewhat following work on ychydig yn dilyn amrywiadau data in institutions) data yn y sefydliadau)
Fesul Prifysgol By University Prifysgol / University 2010/11 2012/13 Morgannwg / Glamorgan 170 275 Casnewydd / Newport 66 75 Met Abertawe / Swansea Met 65 75 Drindod Dewi Sant / TSD 1,994 2,000 Caerdydd / Cardiff 208 325 Met Caerdydd / Cardiff Met 144 225 Bangor 1,482 1,500 Agored / Open 93 100 Glyndwr 93 100 Abertawe / Swansea 248 325 Aberystwyth 481 600 Cyfanswm / Total 5,044 5,600
Beth yw gwerth canran cyfrwng Cymraeg modiwl? What is the Welsh language %age of a module? Man cychwyn – profiad y Starting point – the myfyriwr a synnwyr student experience and cyffredin! common sense! Rhaid bod y ffigyrau yn The figures should be rhesymol, yn gyson ac ar reasonable, consistent gael i’w harchwilio and auditable Os am gyngor penodol, For specific advice please cysylltwch contact d.trystan@colegcymraeg. d.trystan@colegcymraeg. ac.uk ac.uk
Y modiwlau hawdd The straightforward modules Wedi ei addysgu a’i Taught and assessed in asesu yn Gymraeg yn Welsh only: 100% unig: 100% Welsh and not English as Y Gymraeg ac nid medium of instruction Saesneg yw’r cyfrwng (Modern Languages): addysgu (Ieithoedd 100% Modern): 100% Where there is no Ble nad oes unrhyw student contact in Welsh: gyswllt myfyriwr yn 0% Gymraeg: 0%
Sut i gyfrifo? How do we calculate how much is in Welsh? Oriau Cyswllt Scheduled teaching and learning hours Asesu Assesment Gweithgareddau eraill hunan-gyfeiriedig neu Other self-directed wedi eu trefnu learning activities
Enghraifft 1: Deall Data HEFCW Example 1: Understanding HEFCW data HE10110W 10 lectures (English) 10 darlith (Saesneg) 10 seminars (Welsh) 10 seminar (Cymraeg) Essay and exam (Welsh) Traethawd ac arholiad (Cymraeg) Self directed learning pack (Welsh) Pecyn hunan-gyfeiriedig (Cymraeg)
75%
Enghraifft 2: Deall REF Example 2: Understanding REF HE10210W 10 darlith (Saesneg) 10 lectures (English) 5 seminar (Saesneg) 5 seminars (English) 5 tiwtorial unigol 5 individual tutorials (Cymraeg) (Welsh) Traethawd ac arholiad Essay and exam (Saesneg) (English)
20%
Yr her fawr Getting it Right 2012! Darpariaeth ddim Failure to record yn cael ei current provision gofrestru accurately Methu â chyrraedd Potential failure to targedau meet targets Colli cyllid Loss of funding
Data Cyfrwng Cymraeg Welsh Medium Data Let’s Get it Right! Dr Dafydd Trystan Cofrestrydd / Registrar d.trystan@colegcymraeg.ac.uk
Welsh studies “I would like the Council to focus on the delivery of . . . the disciplines of what might be called Welsh studies, including the study of Welsh history and literature, culture, society and politics in both languages.” (HEFCW’s 2012 -13 Remit letter)
Student Record 2011/12 and KIS HEFCW Workshop, Cardiff 26/07/12
Student Record 2012/13
New qualification checks • New exception rules will be introduced to tighten the relationship between QUALENT3 and qualifications on entry - Error where QUALENT3=P91 (L3 of which some or all are subject to UCAS tariff) but there are no QUALTYPEs which are tariff-bearing reported in Qualifications on entry (and vice-versa) - Error where QUALENT3=P92 (L3 of which none are subject to UCAS tariff) but there are QUALTYPEs which are tariff-bearing reported in qualifications on entry (and vice-versa) • Only looks at data submitted this year - will not use register • Will check QUALTYPE is tariff-bearing in either the UCAS or HESA tariff definitions
New data supply table Element name in Field Name Description Field length XML output QOE.HUSID HESA unique student identifier HUSID 13 QOE.UKPRN UK Provider Reference Number UKPRN 8 QOE.NUMHUS Student instance identifier NUMHUS 20 QOE.QUALGRADE Qualification grade QUALGRADE 11 QOE.QUALSIT Qualification sitting QUALSIT 1 QOE.QUALSBJ Qualification subject QUALSBJ 3 QOE.QUALTYPE Qualification type QUALTYPE 2 QOE.QUALYEAR Qualification year QUALYEAR 4 XQEYEAR01 Year QualificationsOnEntry last XQEYEAR01 4 updated
Instance.INITIATIVES • Institutions in Wales must now use this field where applicable… • … 7 ‘Universities Heads of the Valleys Institute’ only • Code 6 ‘Undergraduate internships’ is no longer available for English HEIs • Exception checks will no longer be run comparing HEFCE counts of Lifelong Learning Networks (code 1) instances • Exception will however continue checking 2 ‘Employer engagement co- funded students’
StudentOnModule.MODOUT • StudentOnModule.MODOUT records both funding completion and credit outcomes for modules • Important in deriving FUNDCOMP coding • New exception rules added to warn institutions where 5%(FT) or 15% (PT) of student on module records recorded as 6 ‘outcome not yet known’ but MODSTAT = 1 ‘Continuing from previous reporting year’ or 2 ‘Contained within reporting year’
StudentOnModule.MODSTAT • StudentOnModule.MODSTAT records whether modules span HESA years • Data needs updating each instance year to reflect the status of the student on module • Where code 1 ‘Continuing from previous reporting year’ is used then it is expected that there will also be student on module records with 3 ‘Continuing into next reporting period ‘ • New exception warnings will be in place to check this tie-up where 500+ student on module records have MODSTAT = 1 or 3 – institutions should ensure accurate coding
Check documentation change • New MODOUT and MODSTAT table • Important cross- referencing tool… • …will help to quality assure FUNDCOMP derivations
STULOAD rule changes • The 4.2 rules will be in place but increased to 5 times the number of weeks in order to address the issues with the rule last year • STULOAD should be less than 100 where TYPEYR is not equal to 1 (i.e. non-standard years) and COMDATE is greater than Y1-07-31 • STULOAD should be less than 100 where TYPEYR is not equal to 1 (i.e. non-standard years) and ENDDATE is in the current reporting period - Only warnings to take into account accelerated learning
Check documentation change • New DLHE item (contained in a new DLHE tab) breaking down DLHE population by JACS level 2 • Beneficial for understanding future KIS reporting
Other validation changes • EntryProfile.DOMICILE: - Where >5% of entrants coded XK (error) - Where >2% of entrants coded XK (warning) • Instance.SPLENGTH: - new validation rule will error any courses that have an expected length of study of greater than 9 years … • Instance.YEARSTU: • Error for over 13,000 instances where YEARSTU=1, TYPEYR=1 (standard year) but COMDATE is in a previous reporting year (in some cases going back to 1997!)
KIS 2012/13 • 22 nd August 2012 – Final deadline for submission and sign off • 22 nd August 2012 – Survey forms to be sent out from HESA to assess how the HEIs found the process • September 2012 – Institutional preview of the UNISTATS/KIS WWW site • October – Early Evaluation of KIS (EEK) workshops • 31 October – KIS systems opens for updates • 30 November – EEK report presented to HEPISG • December – KIS 2013/14 Coding manual issued
KIS 2012/13 • HEFCE have issued a new circular (July) ‘Key information Sets and Unistats: Overview and next steps’ • http://www.hefce.ac.uk/pubs/year/2012/201215/ • HESA training seminars on KIS 2013/14 (including changes resulting from EEK)
Institution profile data collection • New data collection June 2013 • Replaces current Campus Information System Institution profile Academic Campuses cost centres Departments Proportions Locations
Cost centre changes
Academic cost centres • Benchmarking opportunity - data to be added to heidi (http://www.heidi.ac.uk) • For HEIs in England return of departmental academic cost centres is required. This is optional for institutions in Scotland, Wales and Northern Ireland. • For all HEIs the return of tier and cost centre splits is optional • Contacts to be sought in the Autumn • Data submitted to be used as cross-check in Student, Staff and Finance returns
Department cost centre allocations For E HEIs return of departmental History academic cost Department centres is required. This is optional for W, NI, S. Cost centre Cost centre 139 History 140 Classics 75% 25%
Optional for all Tiers
More information Visit the HESA website at www.hesa.ac.uk For help and advice on all aspects of the data collection and data submission process: liaison@hesa.ac.uk
Audit Outcomes – External Audits (1) Findings of the audits: EYM: • Credits counted where assessments hadn’t been completed • A download of the EYM data at the time of submission was not kept Premium data: • A small number of students’ postcodes did not meet the criteria for the access and retention premium
Audit Outcomes – External Audits (2) I&E funding data: • Some discrepancies in part-time modules • Collaborative Research Activity overstated • The number of graduate start ups is estimated • Graduate start ups being returned before the individuals had graduated • Evidence not available for the calculation of contact time per distance learning student • Academic staff time spent on public engagement is estimated
Audit Outcomes – Internal Audits (1) Recommendations included: • Student data – JACS codes should be assigned on entry – Withdrawals should be identified and notified to Registry on a timely basis – It should be ensured that the date of birth field is updated – Accurate completion of the HE data returns should be included as a current risk on the University’s risk register – The arrangements for HESES with franchising partners should be formally documented to ensure that the return is completed accurately and in time
Audit Outcomes – Internal Audits (2) • HEBCIS – The University should consider making a return for facilities and equipment related services so activity is not underestimated in these areas – Record Retention Procedures should be developed to take account of procedures for EU related payments – The HEBCI return should be independently reviewed by suitably experienced members of staff – Evidence that validation and credibility checks are undertaken before returning data should be retained – Validation checks should include a reconciliation of the income data with the audited financial statements
Audit Outcomes – Internal Audits (3) • HESA staff record – Casual staff should be included in the HESA staff return – A record of previous errors identified and any checks performed in relation to them should be documented and retained – The HR department should determine if it is possible to produce reports for amendments not related to payroll and retain them on file • Other – The procedure document for RAS and charitable income should be updated to reflect that fact that the RAS will no longer be collected – Job descriptions should be updated
Audit Outcomes – Internal Audits (4) Other continued – The University should ensure that all relevant documentation relating to achievement data, such as the award confirmations and meeting attendance lists, are signed by all relevant individuals – Contracts for franchised programmes should be signed and dated by all relevant individuals in a timely manner – Procedures for the preparation of each return (HESA staff, HEBCIS, student, and HESES) should be documented, to ensure that the returns can be prepared in the absence of the manager responsible
External Audit for 2011/12 • End of five year audit cycle • Extending KPMG contract by one year to cover 2011/12 • Scope of the 2011/12 audit will include: – areas where previous audits have picked up issues – new areas of funding – the extraction of end of year data from the HESA student record • Three HEIs will be audited • Audits relating to data used in funding and end of year data likely to take place in spring 2013
Audit Timetable for 2011/12 • August 2012 – Feedback from internal and external audits sent to institutions – Official notification of external audits for 2011/12 – Notes of guidance for external auditors issued • September 2012 – Notes of guidance for internal auditors issued • September 2012 to August 2013 – External audits take place
Future audit arrangements • We will be reviewing the scope and arrangements for the external audit of data during this year • The scope of the external audit will change to reflect the funding changes from 2012/13 • The external audit changes may have an impact on the scope of internal audits at institutions • Information returned on fee plans will be increasingly in the scope of the audit, as will data used in the KIS • We would welcome feedback from institutions about the audits carried out in the past and any suggestions for future arrangements
Monitoring of the maximum student number 2011/12 (1) • Final monitoring for 2011/12 will take place in early 2013 using 2011/12 HESA student data • A preview will be available in IRIS – based on published criteria: – FT UG and PGCE home and EU fundable completed new entrants – Completion status estimated for the small number with unknown completion status – Medical and dental students on intercalated years will be excluded from monitoring
Monitoring of the maximum student number 2011/12 (2) • Verification of HESA data 2011/12 – Recruited numbers for 2011/12 sent to institutions with details of students included – Amendments can be made • Details of amendments and reasons for amendments provided to HEFCW • Need approval by HEFCW – Intention that data will be sent to institutions along with other HESA data to be verified in early 2013
Monitoring of the maximum student number 2012/13 (1) • New entrants • Graduate diplomas where a degree is a requirement will be excluded • Improvements in retention will be taken into account • Will be monitored initially using SLC data and data collected on HESES 2012/13 • Are considering whether to exclude students topping up to a degree who come from another institution
Monitoring of the maximum student number 2012/13 (2) Penalty arrangements for 2012/13 • WG will calculate an overall financial penalty to impose if monitoring of SLC data shows over- recruitment • Initial monitoring using HESES 2012/13 data used to share the penalty between institutions • Final monitoring using HESA 2012/13 data, with any necessary adjustments made • A number penalty for over-recruitment in 2012/13 will be applied to the 2013/14 maximum student number
Redistribution • Informal process this year • Email sent to institutions on 13 July 2012 • Transfers of 2012/13 maximum numbers between institutions or movement of credits for other modes and levels to be discussed on an informal basis
Monitoring of the maximum student number - Timetable Timetable for 2011/12 and 2012/13 December 2012 Initial monitoring of recruitment to the 2012/13 maximum student number using SLC and HESES data January 2013 Notification of any initial financial and number penalties to the institutions concerned Verifications for 2011/12 maximum student number sent to institutions February 2013 Verifications for 2011/12 returned by institutions Spring 2013 Initial financial penalties for 2012/13 imposed
Monitoring of the maximum student number 2013/14 • Start of all cohort monitoring • Conversion rates for further years of 2012/13 and 2013/14 starters will be subject to verification before we use them • Considering changes to the monitoring process for 2013/14 to allow more flexibility
Timetable for 2012/13 (1) 26 July Workshop for institutions July Corporate Strategy consultation with sector Mid September Data submitted to HESA Mid Sept/Oct HESA data quality checking October Corporate strategy consultation deadline for responses End October HESES survey published November/ HESES returned and verifications issued December
Timetable for 2012/13 (2) January Verifications for EYM, maximum student number, premium, per capita and PGR funding issued Signed HESES verifications returned February Signed verifications of HESA data returned Spring Funding allocations for 2013/14 announced, including 2011/12 adjustments to grant (EYM) and initial penalty for over-recruitment in 2012/13
Developing the HEFCW Corporate Strategy from 2013 Celia Hunt and Liz Heal
Today Report on the consultation on HEFCW’s new Corporate Strategy 2013-14 to 2015-16 Discuss the development of the measures
But first ... Part-time Part-time UG Working Group Modelling on possible scenarios (funding ELQ and <25% FTE) 75% of PTUG students would not be covered by new proposals Highlighted challenges about how these students might be supported in light of other funding pressures HEFCW/WG to do more work on this Next Working Group meeting after summer
Recommend
More recommend
