Sharing of the IQA and EQA experience Pierre Dalmas Director, QA 1 - - PowerPoint PPT Presentation

Operational Programme II – Cohesion Policy 2007-2013 Empowering People for More Jobs and a Better Quality of Life Project part-financed by the European Union European Social Fund (ESF) Co-financing rate: 85% EU Funds; 15% National Funds Investing in your future

Sharing of the IQA and EQA experience

Pierre Dalmas Director, QA 1st July 2015

Contents of Presentation

• General comments
• The milestones
• Organisational set-up and EQA awareness
• Self-evaluation process
• The scoping visit, in between and the main visit
• Concluding comments, opportunities, challenges
• Discussion, question and answer

Acronyms

• IQA : Internal Quality Assurance (10 standards)
• SED : Self evaluation document aka IQA Report
• EQA : External QA Assessment of the institution

General Comments

Preparing for the EQA - a 4 step process

• Understanding and interpreting the IQA Standard
• Compiling the SED
• Hosting the EQA
• Analysing and addressing the findings

General Comments

• The EQA process is an opportunity for the Institution to transfer tacit and

explicit knowledge within the organisation.

• Comparing the EQA process to the ‘SECI’ model (Ikujro Nonaka - A

Process Theory of the Knowledge Based Organisation), the EQA process has four distinct phases.

Step Behaviour Process

1

Socialisation - Consolidation of tacit

knowledge Understanding and interpreting the IQA Standard 2

Externalisation – Transfer of tacit knowledge

to explicit knowledge Compiling the SED 3

Combination – Transfer of explicit knowledge

between institution and peer assessment team The EQA assessment 4

Internalisation - Transfer of explicit knowledge

to tacit (organisational) knowledge. Analysing and addressing the findings

• At the end of the each step, quality improvement takes place.

The Milestones

November 2014

• Release of National QA Framework including IQA standards.

December 2014

• Received official notification of EQA visit.
• Information meetings with Senior Management.
• Appointment of EQA Facilitator
• Approval of action plan.

January 2015

• 1 day EQA awareness sessions with Programme Coordinators (Malta and

Gozo)

• Dissemination of EQA information to lecturing staff and students

February 2015

• Mapping of IQA standard with College quality management system processes
• Briefing of core EQA team and identification of roles and responsibilities

The Milestones

March / April 2015

• Meetings with internal stakeholders
• Identification of gaps, areas for improvement
• Submission of draft IQA Self-Assessment Report to Peer Assessment Team
• EQA Scoping Visit (15 – 17th April 2015)

May 2015

• Remedial action
• Submission of final IQA Self-Assessment Report to Peer Assessment Team
• Submission of policies, procedures, regulations and other evidence to PAT
• EQA Main assessment (4th – 8th May 2015)

June 2015

• Receipt of draft EQA External Quality Audit report
• Acceptance letter of EQA report

Organisational set-up and EQA awareness

• Nomination of Institutional Facilitator
• Setting-up of a core team
• Identification of stakeholders
• Dissemination of information to all stakeholders
• Reporting back to senior management
• Liaison with / requests for clarification from NCFHE

Self-evaluation process

Mapping IQA standards with Institutions processes

Self-evaluation process

IQA - interpreting and understanding the standard

IQA 1 : Mission, Vission, Strategy, Quality Polciy, Policy, Regulations, Roles and Responsibilities IQA 2 : Institutional Probity IQA 3 & 10 : Programme Design, Development, Approval and Review IQA 4 : Student Centred Learning, Teaching, Learning and Assessment IQA 5 : Student Admission to Student Exit IQA 6 : FT and PT Teaching Staff, Recruitment, Induction, Appraisal, CPD IQA 8 : Information, Anlaysis, Improvement (PDCA) IQA 9 : Public Information, Prospectus.

Self-evaluation process

Identifying the Institution’s processes (Part1 )

Self-evaluation process

Mapping IQA standards with Institutions processes

Self-evaluation process

Identifying the Institution’s processes (Part 2)

Self-evaluation process

Mapping IQA standards with Institutions processes

Compiling the IQA report. Documenting of the Institution’s processes.

Compiling the IQA report. Documenting of the Institution’s processes.

Identifying and addressing gaps and weaknesses Identifying strengths Corrective action plan

The scoping and the main EQA Audit visit

Scoping Visit 2 days, 2 peer assessors

• Opening meeting with Senior Management
• Meeting with Registrar, Curriculum and QA
• Visits to two satellite institutes (lectures and students)
• Meeting with Institute Directors
• Closing meeting with senior management

The scoping and the main EQA Audit visit

The EQA Main Visit : Types of Meetings / Interviews

• Peer Team meetings

– Private meetings (1st and last day) – Clarification meetings (with Institute Facilitator) – End of day meetings

The scoping and the main EQA Audit visit

The EQA Main Visit : Main Statistics

Duration : 5 full days EQA Peer Assessment Team

• EQA Team Leader
• EQA International Expert
• NCFHe Representative
• Student Assessor x 2
• NCFHE Observer

The scoping and the main EQA Audit visit

The EQA Main Visit : A total of 26 meetings (+ joker meeting) were planned. Interviews held with :

• Senior Management (opening meeting)
• Institute Directors
• Registrar
• Student Support services
• Students, Student Body representatives, alumni
• Programme Coordinators, Lecturers
• External stakeholders (employers, unions etc)
• Human Resources
• Financial Controller
• Chief Administration Officer
• Library and Learning Resource Centre

Closing meeting held with Senior Management

Concluding Reflections

• CPD building exercise
• Promotes quality within the Institution
• Tests internal communication
• Requires internal collaboration
• Challenges the ‘sate of denial’
• Tests feedback mechanisms (students, lecturers, employers)
• Gives an official voice to staff , students and employers
• Process, scope and benefits are not to be underestimated !!
• Need to work hard on IQA SED !!
• The EQA provides an unprecedented assessment of the institution
• Establishes an enhanced relationship and network with NCFHE

Benefits to the Institution

• An external, independent comprehensive review of the

internal processes.

• Provides for people feedback.
• An independent, professional report that maps a 2 – 3

year path for the institution’s improvement plan.

Challenges and opportunities

• Updates of IQA standard to allow for more focus on

– Internal communication – Assessment of WBL – Quality Management System review – User friendliness of IQA document

• Selection of Peer Review Teams
• ‘Norming’ of reports

Discussion, questions and answers

Operational Programme II – Cohesion Policy 2007-2013 Empowering People for More Jobs and a Better Quality of Life Project part-financed by the European Union European Social Fund (ESF) Co-financing rate: 85% EU Funds; 15% National Funds Investing in your future

Thank You