Joint external evaluation Dr Nirmal Kandel, MBBS, MA (Anthropology), - - PowerPoint PPT Presentation

Dr Nirmal Kandel, MBBS, MA (Anthropology), MPH, EMBA Team Lead – JEE Thailand 26 – 30 June, 2017 Bangkok, Thailand

Joint external evaluation

Joint External Evaluation

2

2

IHR monitoring and evaluation framework (IHR – MEF)

IHR Review Committee makes recommendations

IHR (2005)

IHR Revie w Com mitte e

2005 2014 2015 2016

The first JEE mission is conducted JEE Tool is developed

Combining the GHSA Action packages and the IHR Capacities

WHA 58

The IHR (2005) is adopted by the 58th World Health Assembly (WHA) WHA61.2 is

• adopted. WHO

develops a framework for annual reporting to the WHA

2008

IHR M&E Framework

Joint External Evaluation

3

IHR monitoring and evaluation framework (IHR – MEF)

Country plannin g

IHR MEF

Annual Reporting After Action Review Exercises Joint External Evaluation

• Transparency
• Mutual accountability
• Trust building
• Appreciation of

public health benefits

• Dialogue
• Sustainability

Joint External Evaluation

4

Process improvement approach

IHR/preparedness for health security Using IHR Monitoring and Evaluation Framework Use of information to develop action plan and costing

Support to

• Priority capacities
• Priority countries

Health systems National review cycle and budget planning

Joint External Evaluation

5

The JEE tool: overview

In February 2016, the WHO developed the joint external evaluation (JEE) tool. The JEE tool consists of 19 technical areas. The JEE tool assesses country capacity under the International Health Regulations (2005) to prevent, detect and rapidly respond to public health threats whether occurring naturally or due to deliberate or accidental events. The JEE tool can be used for internal self-evaluation or external evaluation. Since February 2016, all external evaluations are being done using the JEE tool.

Joint External Evaluation

6

JEE tool: core elements

The JEE tool is a data gathering instrument designed to evaluate IHR capacities for health security across all relevant sectors at the national level. The 19 technical areas of the tool are arranged according to the following core elements:

• Preventing and reducing the likelihood of outbreaks and
• ther public health hazards and events defined by the IHR

(2005) is essential.

• Detecting threats early to save lives.
• Rapid and effective response requires multisectoral, national

and international coordination and communication.

Joint External Evaluation

7

JEE tool: outcomes

This tool specifically helps to:

• determine the baseline capacity, including gaps and needs;
• inform the development of implementations plans;
• measure progress on work implemented across the IHR core

capacities; and

• highlight gaps and needs for current and prospective donors and

partners, as well as to inform country level planning and priority setting.

Joint External Evaluation

8

JEE process: a different kind of evaluation

1. Voluntary external evaluation – openness and transparency 2. Peer-to-peer review is a fully collaborative process, with joint development of scores and priority actions; it is not an audit or an inspection 3. Multisectoral includes agriculture, wildlife, security, and others, both within the host country and on the external team 4. Field visits support and inform technical area discussions 5. Integrates and supports findings from other assessments 6. Focus is on the development of priority actions 7. Final report presented to host country within two weeks of completion of the mission 8. Broad donor and international support is on a common platform

Joint External Evaluation

9

JEE process final report

1. Focus on “end user” needs, i.e. establishing baseline and next steps to strengthen capacity in each technical area. These include:

• Scores
• Strengths
• Areas which need strengthening
• Top three (maximum five) priority actions for each technical area.

2. The final report is typically provided to the host country for review within two weeks of completion of the mission. 3. Evaluation results are openly available and posted online.

Joint External Evaluation

10

Experiences from JEE mission



Member States/countries, international organizations, and donors/partners have considered the external evaluation process a success (for example, Pakistan at the WHA 2016 encouraged all Member States to conduct the JEE mission, based on their experience).



The evaluation process has also been a learning experience for those who have participated in the JEE missions.



Forty-seven countries have already completed external JEEs as of now.



It is standard JEE practice to have all evaluation reports publicly available on the WHO website as of now 26 reports are already online and remaining are in process

Joint External Evaluation

11

COMPLETED - 47 IN PIPELINE - 27

Afghanistan, Albania, Armenia, Bahrain, Bangladesh, Belgium, Belize, Benin, Cote d'Ivoire, Cambodia, Ghana, Guinea, Eritrea, Ethiopia, Finland, Jordan, Kenya, Kuwait, Kyrgyzstan, Lao People's Democratic Republic, Latvia, Lebanon, Liberia, Maldives, Mauritania, Mongolia Morocco, Mozambique, Myanmar, Namibia, Nigeria, Oman, Pakistan, Qatar, Saudi Arabia, Senegal, Sierra Leone, Slovenia, Somalia, Sri Lanka, Sudan, Tunisia, Turkmenistan, United Republic of Tanzania and Zanzibar , United Arab Emirates, United States of America, Viet Nam

Australia, Bhutan, Cameroon, Canada, Chad, Comoros, Djibouti, Indonesia, Iraq, Japan,, Lesotho, Libya, Madagascar, Malaysia, Mali, New Zealand,, Federated States of Micronesia , Republic of Korea, Singapore, South Africa, Switzerland, Liechtenstein, Thailand, The Gambia, Togo, Uganda, Zambia

JEE Missions

(June 2017)

Joint External Evaluation

12

Examples of impact of external assessment

“The National Center .. AMR reference laboratory has since 2014 been certified by the international CEASAR program AMR External Quality Assessment program” “Passive monitoring in animals is in place for over 80 notifiable diseases and in humans for 52 diseases (including zoonotic diseases)” “Further enhancement of co-operation between the health and veterinary services could be pursued through formalized procedures and designated responsibilities to support the sustainability, even if good informal exchange of information exists” “This is the first time we are meeting together and we realized the concept of working together for the people of Balochistan and we commit to support and work together with provincial health office” ”The country formed a permanent cross-cutting ministerial council to put policies, plans, and processes in place to comply with the International Health Regulations” ” The vaccination coverage for the first dose of the MMR vaccine in the country for children aged 2 years is above 92%.”

Joint External Evaluation

13

The role of evaluations Country: Partner Interaction

Joint External Evaluation

14

Tools, Guides and Templates (Supporting Materials)

 Joint External Evaluation Implementation Guide  Joint External Evaluation Tool and Process Overview  Joint External Evaluation Reporting Template  JEE Roster Database  Self-Evaluation Toolkit  Standard Operating Procedures for JEE Roster of Experts  Online Team Orientation Course  Team Lead Training Course  Standard JEE opening presentation, technical areas presentation and country health system overview templates  Performance Evaluation of JEE and Checklists. Accessible On: http://www.who.int/ihr/procedures/implementation/en/

THANK YOU