2/1/2010 Presentation Summary Participatory Project Review (PPR) 1. PPR overview An Overview 2. PPR steps 3. PPR limitations January 2010 4. PPR Benefits Scott Chaplow e Senior M& E Officer scott.chaplow e@ ifrc.org 5. Group discussion. Scott Chaplowe, IFRC Performance & 1 2 Accountability Department What is a PPR? Participatory Appeal � A Participatory Project Review (PPR) is a participatory “Learning should always be the main focus of any type of approach to evaluation that can be adapted to different evaluation. Where the traditional kind of external evaluation may contexts and interventions according to need. produce good quality evaluations results and recommendations, quite often these remain with the senior management of the program. Consequently, the learning is not disseminated let alone C l h l i i di i d l l � Draws upon a variety of methodologies that can be tailored to incorporated among important stakeholders, such as project staff, specific project needs, interests, timeframes, resources, and representatives of the communities and relevant government capacity. authorities or other NGOs in the region. The participatory type of evaluation involving multiple stakeholders is therefore emerging rapidly.” � The PPR is more than an evaluation/review exercise – it is a project activity itself, involving participants in a meaningful (Susanne van Lieshout and Natasha Cassiere, 2007. “Maximize Learning from Participatory Evaluation with Peer Review,” MDF South Asia.) way towards project success! Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 3 4 Accountability Department Accountability Department 1
2/1/2010 PPR = Combination of Methods Other Participatory Approaches � Vulnerability & Capacity Assessment (VCA) Empowerment Evaluation (David Fetterman). “VCA is a participatory investigative process designed to assess the risks that “Program participants – including clients – conduct their own evaluations; an people face in their locality, their vulnerability to those risks, and the capacities outside evaluator often serves as a coach or additional facilitator depending on they possess to cope with a hazard and recover from it.” (IFRC) internal program capabilities…The group thus can serve as a check on its own members, moderating the various biases and agendas of individual participants.” � Participatory Rapid (Rural)Appraisal (PPR) “Participatory Rural Appraisal (PRA) comprises a set of techniques aimed at The Most Significant Change technique (Rick Davies and Jessica shared learning between local people and outsiders” (World Bank) Dart). � “(T)he collection of significant change (SC) stories emanating from the field Participatory Impact Assessment (PIA) level, and the systematic selection of the most significant of these stories by “(Participatory Impact Assessment (PIA) is an extension of Participatory Rural panels of designated stakeholders or staff. It is a form of monitoring because it Appraisal (PRA) and involves the adaptation of participatory tools combined with occurs throughout the program cycle and provides information to help people more conventional statistical approaches specifically to measure the impact of manage the program. It contributes to evaluation because it provides data on humanitarian assistance and development projects on people’s lives. (Feinstein impact and outcomes that can be used to help assess the performance of the International Center, Tufts University). Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & program as a whole. 5 6 Accountability Department Accountability Department Prior PPR Experience How is a PPR flexible? � Not a blueprint for assessment , but should be tailored to � Sri Lanka: Canadian Red Cross community health specific interests, timeframes, resources, and capacity. program, 2007. � Can be used for multiple purposes : initial assessment, review, � Sri Lanka: American Red Cross ceramic water filter evaluation, etc. , project in water/sanitation program, 2008. � Can be conducted at different times: beginning, middle, or end of an intervention (project/program). � Maldives: American Red Cross PSP program, 2008. � Can be used alone, or in combination with other methods. � Peru: International Federation Red Cross/Crescent (IFRC) � Can be internal, or facilitated with external assistance and response to the Peru Earthquake, 2009. participation. � Can be done once (one-off), or multiple times. Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 7 8 Accountability Department Accountability Department 2
2/1/2010 How does a PPR evaluation w ork? Key PPR Features 1 PPR: � Safe and anonymous identification of opinions � 1 day (6 hours + 2 hours for lunch, tea break, etc.) � 10 – 20 people � Participatory discussion of opinions Participatory discussion of opinions Multiple PPRs repeated with additional groups through M l i l PPR d i h ddi i l h h purposeful sampling. � Democratic prioritization of opinions � Program HQ – project team and senior management � Branch Level – field team key managers and field officers. � Community Level - How to representatively sample communities within program capacity (time & resources). � Consensus PPR to organize action steps into Action Plan. Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 9 10 Accountability Department Accountability Department Participatory Continuum Key PPR Steps Participatory Top-Down Step #3 Step #2 Step #1 What Beneficiaries Beneficiaries Beneficiaries Beneficiaries Beneficiaries Start-up have decide decide participate in are a are an Prep consulted observed we if/what/how to questions to data data source data source data source data source evaluate. l t answer. collection & ll ti & d done? ? (interviews & analysis Beneficiaries focus are a groups) secondary data source In PPR, stakeholders are involved in the: Step #6 Step #4 Step #5 � Data Collection Follow-up What What should � Data Analysis has be done � Identification of Lessons and Recommendations • Action Plan changed? in the future? • Write-Up FWRS Federation-wide Reporting System Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 11 12 Accountability Department Accountability Department 3
2/1/2010 PPR Preparation Key PPR Steps � Timing: start 2 months prior , allowing proper time to Step #3 Step #2 inform and involve key stakeholders. Step #1 What Start-up have � Refer to IFRC Evaluation Policy. Prep we d done? ? � Stakeholder Meeting � Determine evaluation need and if PPR is appropriate. � Identify PPR manager (someone in program/country). Step #6 Step #4 Step #5 � Identify available time, money, personnel, resources. What Follow-up What should � Clarify sample frame and purposeful selection criteria. has be done • Action Plan changed? � Identify key decision makers and deal breakers. in the future? • Write-Up Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 13 14 Accountability Department Accountability Department PPR Preparation Key PPR Steps � TOR Development Step #3 Step #2 � Identify facilitators and arrange for TOT Step #1 What Start-up have Prep � Gatekeeper Visits we Gatekeeper Visits done? d ? • Identify, inform, and obtain initial consent of participants, as well as any local permission, etc. � Arrange PPR Logistics Step #6 Step #4 Step #5 • PPR scope and duration: 1 week or 1 month? Follow-up What What should has be done • Place/venues, transportation, refreshments. • Action Plan changed? in the future? • Prepare materials! • Write-Up Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 15 16 Accountability Department Accountability Department 4
2/1/2010 Inform & Confidentiality PPR Start Up � Should clearly answ er WHAT & WHY Timing: ~ 1 hour. Introductions � Should reassure CONFIDENTIALIY! � Should reassure CONFIDENTIALIY! Inform & Consent “What is shared in the room stays in the room.” � Manage Expectations (M& E)!!!!!! � Participant understanding is critical. � Stress that it w ill be their exercise. � Address any QUESTIONS or CONCERNS! Guidelines & Logistics Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 17 18 Accountability Department Accountability Department WHAT HAVE WE DONE? Key PPR Steps Objective: to warm up participants mind to the what Step #3 Step #2 has been done - factual. Step #1 What Start-up have Prep we Timing: ~1.5 hours. g done? d ? Method : this can be facilitated in multiple ways, based on consultative planning process with team. Step #6 Step #4 Step #5 � Mission-ing Follow-up What What should has be done • Action Plan changed? in the future? � Timeline • Write-Up Scott Chaplowe, IFRC Performance & Scott Chaplowe, IFRC Performance & 19 20 Accountability Department Accountability Department 5
Recommend
More recommend
