Tools as a Component for Improving the Quality of Higher Education - PowerPoint PPT Presentation

Creating Modern Educational Measurement Tools as a Component for Improving the Quality of Higher Education Sergiy Londar, Director of SSI “Institute of Educational Analytics”, Doctor of Economic Sciences, Professor 2019 1

THERE IS A WIDE RANGE OF APPROACHES TO THE DEFINITION OF THE "EDUCATION QUALITY" CONCEPT Education quality is the compliance of learning outcomes with the requirements established by the legislation, relevant educational standard and/or an agreement on the provision of educational services (Law of Ukraine "On Education") Education quality is a set of characteristics of the educational process, determining a consistent and practically effective formation of competence and professional consciousness. It is a certain level of knowledge and skills, mental, physical and moral development, which graduates of an educational institution have achieved in accordance with the planned objectives of training and upbringing (website of the Ministry of Education and Science of Ukraine) Education quality is an integral characteristic of the education system, which reflects the degree of compliance of the achieved results with the regulatory requirements, social and personal expectations ( Kovaleva, G. S. ) A good quality education is one that enables all learners to realise the capabilities they require to become economically productive, to develop sustainable livelihoods, to contribute to peaceful and democratic societies, and to enhance wellbeing ( VVOB, the Flemish Association for Development Cooperation and Technical Assistance ) Education quality is a well-balanced conformity of education (as an educational system, process, result) with imposed needs, goals, demands, norms (standards) ( ENQA, European Association for Quality Assurance in Higher Education ) 2

In general, the quality of education is associated with the educational tools and technologies that make such transformations in those who study in such a way that they will benefit in the adulthood and the expectations of their family, inner circle and society are met. How to connect the results of a person’s activity in adulthood with the influence of education on him/her, including higher education? If such a connection can be identified, this will provide an additional information on the quality of higher education, provide a tool for monitoring quality and relevant managerial decision-making at various levels. Such a prototype tool already exists. It is Education Management Information Systems for graduate tracer studies (hereinafter - EMIS for graduate tracer studies). The main ideas for creating such a system are listed below. 3

CREATING A PUBLIC PORTRAIT OF AN EDUCATED PERSON IN AN “ADULTHOOD": A PERSON SIMULTANEOUSLY ACTS IN VARIOUS DIMENSIONS Job: salary level; 02 taxes paid Education: Law abiding: the knowledge, 01 03 absence/existence skills, of offenses competencies PERSON Future planning: Supporting the pension family; 06 04 contributions; participation in health insurance, social funds etc. Participation 05 in public life 4

1. In order to create a “portrait” of a person who has received a higher education (according to the characteristics of his/her functioning in adulthood), information from the various state databases (due to the EMIS integration with other state databases) is compared with the help of a certain depersonalized identification number: • person's education (educational databases); • employment characteristics (salary level; taxes paid: tax service register); • relations with law enforcement agencies (police register); • participation in pension funds, health insurance funds (relevant registries); • family (civil status registry), participation in social programs, etc. 2. The individual graduate tracer for a "successful person" is determined in the following way: which university, college, school, and kindergarten he/she graduated from. 3. For the purpose of depersonalization of information about a “successful person” the individual trajectories of 3-4 persons are "averaged" into one. 4. Determining the education influence on a person, in particular, the influence of higher education. 5

APPROACHES TO THE ANALYSIS OF THE HIGHER EDUCATION INFLUENCE Educational policy analysis State of the higher education system OUTPUT SOCIAL VISION INPUT DATA PROCESS RESULT DATA IMPACT • National Education • Teachers • Approaches to • Graduates • Employment • Family Concept in the context of teaching • Curriculums • Achievements • Demand / labour • Life goals socio-economic • Educational process force supply • Equipment • Exams • Behavior (crime development • Student • Entrepreneurship level) • Financing • Knowledge, skills, • National Education assessment • Health competencies Strategy • Organization and • Certification • Law “On Higher Education” administration • Higher Education State Policy 1 2 3 POLICY FORMATION POLICY IMPLEMENTATION МО NITORING Quality standard Quality assurance Analysis of quality improvement opportunities agreement Suggestions for improving quality Source: Dr. Hayan Hua, Harvard University Graduate School of Education 6

Implementation of the component “graduate tracer studies” in EMIS (experience of Lithuania) 1. DATA COLLECTION INFLUENCE ANALYSIS EDUCATIONAL А NALYSIS OF EDUCATIONAL OF (EDUCATION, CONTEXT PARTICIPANTS RESULTS PROCESS DYNAMICS SOCIETY, ECONOMY) ANALYSIS OF QUALITY IMPROVEMENT OPPORTUNITIES QUALITY ASSESSMENT DESCRIPTION OF INFORMATION COMPONENTS: • • • • • Data collection Collection of Data collection Comparative Identification of • Collection of Information impersonal about analysis of the education impersonal gathering on the depersonalized educational dynamics of influence on depersonalized peculiarities of the statistics process and its change of "adulthood". statistics on country in the concerning on features in education system Strategic students’ context of: specificity persons who different indicators and decision-making educational of its economy, labor study and teach in educational socio-economic on education performance , market, labor force, the higher institutions indicators of the transformation international education level of education country as a comparative the population, etc. institutions whole measurements, etc. DATA WITHIN THE COMPONENTS: • Grades in • • • • Gross domestic Students, • Analysis results Identification of Organization of subjects product per capita teachers in terms educational education • • Identification of of specializations, Incl. depending process components that • Unemployment rate curriculums, etc. on the funding causal define its quality • Training • Salary level in terms method relationships schedule of industry sectors, • Proposals for • The proportion etc. • Knowledge education of students who assessment transformation have not methods, etc. completed their 7 Source: Civitta company studies, etc.

Implementation of the component “graduate tracer studies” in EMIS (experience of Lithuania) 2. ANALYSIS OF RELATION BETWEEN "SUCCESSFUL PERSON" AND HIGHER EDUCATION RESULTS AFTER ORGANIZATION OF SITUATION IN THE GRADUATION EDUCATION COUNTRY • Position at work • • Curriculums’ Economic • Salary level content indicators • Socially important • • Teaching methods Social indicators activity • • Forms of control Innovativeness EDUCATIONAL APPROACHES EDUCATIONAL PERSON ACHIEVEMENTS CONTEXT RESULTS PROCESS TO EDUCATION PERSON’S STUDENTS’ RESULTS EDUCATIONAL • CHARACTERISTICS number of students CONDITIONS • that have not number of graduated universities • • students’ grades number of students • financing the educational process Consultants in Lithuania: Dr. Hayan Hua and Dr. Tom Cassidy, Harvard University Graduate School of Education; 8 Source: Civitta company

THE ROLE OF EMIS GRADUATE TRACER STUDIES IN THE EDUCATION QUALITY MANAGEMENT The SSI "Institute of Educational Analytics" has considerable experience in the process of MODEL OF EDUCATION QUALITY MANAGEMENT collecting and processing of educational data. The Institute's employees established a 2 Quality partnerships and gained monitoring experience during abroad business (including EMIS GTS) 1 trips devoted to the best practices National Defining the Development education studying of developed countries in Strategy quality 3 order to create the education Quality improvement management information system. When deciding on the need to • Defining indicators for assessing the education quality 1 create EMIS GTS in Ukraine and • Determining threshold values for certain indicators determining the funding source, • Collection and processing of statistics necessary for monitoring and education quality 2 the SSI "Institute of Educational management Analytics" can carry out the • Creating internal systems for monitoring and ensuring the education quality in higher 3 education institutions (ISO 9001, EFQM, ISO 9004, ISO 26000, ISO 14001) necessary organizational work. • Creating a strategic plan for higher education institutions development 9