Evaluating Climate Services: Lessons from Mali Edward R Carr - - PowerPoint PPT Presentation

▶
evaluating climate services lessons from mali
SMART_READER_LITE
LIVE PREVIEW

Evaluating Climate Services: Lessons from Mali Edward R Carr - - PowerPoint PPT Presentation

Aug 25, 2023 134 likes •241 views

Evaluating Climate Services: Lessons from Mali Edward R Carr Humanitarian Response and Development Lab Department of Geography University of South Carolina Malis Agrometeorologial Program Pilot phase (4 villages, 16 farmers) was very

slide-1
SLIDE 1

Evaluating Climate Services: Lessons from Mali

Edward R Carr Humanitarian Response and Development Lab Department of Geography University of South Carolina

slide-2
SLIDE 2

Mali’s Agrometeorologial Program

  • Pilot phase (4 villages, 16 farmers) was very successful
  • Swiss funded it for nearly 25 years
  • GoM saw the program as important, funded up to the coup
  • This program endured where others failed across the Sahel

1982 1985 2005 2012

Project Inception End of Pilot Phase End of Swiss funding Current Assessment

No performance data gathered All performance claims from data gathered in four villages in this phase

  • Practically nothing else
  • No baselines
  • No data collection
  • No list/map of participating communities

¡

slide-3
SLIDE 3

Assessing program impacts

  • Post-hoc evaluation

– Treatment/control model

  • Treatment/Former Treatment/Control outcome
  • Differentiate between seasonal decision and

behavioral change

– Representative sampling?

  • Effectively impossible under time and budget

constraints

  • Triangulation model

– Documents/scientific evidence – Focus groups – Interviews

slide-4
SLIDE 4

Assessment outcomes

  • Very “noisy” data

– Evidence of strong correlations between crop selection and access to program

  • Very uneven – only a few crops, and different

crops depending on location

– Evidence of strong correlations between variety selection and access to program

  • Also uneven – usually only one crop per

location

slide-5
SLIDE 5

GLAM senior man Former GLAM senior man Control Senior Man Avg # crops 5.0 Avg # crops 4.3 Avg # crops 3.4 Peanut 100.00% Millet 93.33% Millet 100.00% Sorghum 100.00% Sorghum 86.67% Sorghum 56.00% Millet 80.00% Peanut 73.33% Peanut 48.00% Fonio 60.00% Cowpeas 40.00% Cowpeas 48.00% Cowpeas 60.00% Fonio 33.33% Fonio 24.00% Henna 40.00% Maize 33.33% Sesame 24.00% Sesame 40.00% Rice 26.67% Maize 16.00% Maize 20.00% Bambara nuts 26.67% Henna 12.00% Sesame 13.33% Cotton 4.00% Watermelon 4.00% Bambara nuts 4.00%

Cluster ¡1 ¡

slide-6
SLIDE 6

Assessment outcomes

  • Very “noisy” data

– Evidence of strong correlations between crop selection and access to program

  • Very uneven – only a few crops, and different

crops depending on location

– Evidence of strong correlations between variety selection and access to program

  • Also uneven – usually only one crop per

location

slide-7
SLIDE 7

0.00% ¡ 10.00% ¡ 20.00% ¡ 30.00% ¡ 40.00% ¡ 50.00% ¡ 60.00% ¡ 70.00% ¡ 80.00% ¡ 90.00% ¡ 100.00% ¡

Senior ¡Men: ¡Peanuts ¡

GLAM ¡ Former ¡GLAM ¡ Control ¡ 0.00% ¡ 10.00% ¡ 20.00% ¡ 30.00% ¡ 40.00% ¡ 50.00% ¡ 60.00% ¡ 70.00% ¡ 80.00% ¡ 90.00% ¡ 100.00% ¡

Senior ¡Men: ¡Maize ¡

GLAM ¡ Former ¡GLAM ¡ Control ¡ 0.00% ¡ 10.00% ¡ 20.00% ¡ 30.00% ¡ 40.00% ¡ 50.00% ¡ 60.00% ¡ 70.00% ¡ 80.00% ¡ 90.00% ¡ 100.00% ¡

Senior ¡Men: ¡Millet ¡

GLAM ¡ Former ¡GLAM ¡ Control ¡ 0.00% ¡ 10.00% ¡ 20.00% ¡ 30.00% ¡ 40.00% ¡ 50.00% ¡ 60.00% ¡ 70.00% ¡ 80.00% ¡ 90.00% ¡ 100.00% ¡

Senior ¡Men: ¡Sorghum ¡

GLAM ¡ Former ¡GLAM ¡ Control ¡

slide-8
SLIDE 8

Assessment outcomes

  • Very “noisy” data

– Evidence of strong correlations between crop selection and access to program

  • Very uneven – only a few crops, and different

crops depending on location

– Evidence of strong correlations between variety selection and access to program

  • Also uneven – usually only one crop per location

– Cannot rigorously explain correlations

  • Too many confounding explanations
  • Need qualitative work to sort this out
slide-9
SLIDE 9

Assessing Climate Services: Lessons from Mali

  • Post-hoc evaluation is time-consuming and

expensive

– Its outcomes are often “noisy” – Rigorous explanation requires extensive investments of time and money

  • If evaluation matters, it has to be built into

project design

– Project design cannot assume that any climate services will be useful

  • What information is needed?
  • Who needs it/can act on it?
  • If outcomes matter, be prepared to act on

“surprise” findings of assessments

slide-10
SLIDE 10

Acknowledgements