Cartographic Assessment and Quality Assurance for the Haitis 5 th - - PowerPoint PPT Presentation

cartographic assessment
SMART_READER_LITE
LIVE PREVIEW

Cartographic Assessment and Quality Assurance for the Haitis 5 th - - PowerPoint PPT Presentation

EGM ON INNOVATIONS TO STRUCTURED DATA COLLECTION METHOD New York, 4-6 Dec 2019 Cartographic Assessment and Quality Assurance for the Haitis 5 th Population and Housing Census By : Daniel Milbin, National Director of the Census project,


slide-1
SLIDE 1

EGM ON INNOVATIONS TO STRUCTURED DATA COLLECTION METHOD

New York, 4-6 Dec 2019

Cartographic Assessment and Quality Assurance for the Haiti’s 5th Population and Housing Census

By : Daniel Milbin, National Director of the Census project, IHSI Mohamed Laghdaf Cheikh Melainine, Chief Technical Adviser – Census, UNFPA

slide-2
SLIDE 2
  • Introduction
  • Census methodology
  • Use of Cartography in Data Quality assessment
  • Lessons learnt
  • Conclusion

≈ 18 min

OUTLINE

slide-3
SLIDE 3

Haiti’s Census intervenes in a context of rarity of reliable statistical data in the country, where population censuses remain the most reliable data source. Haiti’s 5th Census is the first digital census to be conducted in the country, a gender sensitive census, and one of the first censuses of the 2020 census round in the Latin America and Caribbean region. The last census in the country was conducted 16 years ago, while the UN recommends conducting a population census every ten years.

CONTEXT

slide-4
SLIDE 4
  • De Juré Census
  • Each Enumerator is assigned 1 EA
  • Direct Interview with the HHH
  • 2 months field staff training
  • 8 weeks Data Collection
  • PES is planned
  • Wide dissemination and use of

Census results.

METHODOLOGY

  • Enumeration conducted in June-August

2018.

  • 120 EA, 4 Departments, 8 communes
  • 232 Field staff.
  • Data collection monitored almost in real

time.

  • Transparent and exhaustive evaluation -

220 recommendations

Pilot Census

slide-5
SLIDE 5

MAPS

slide-6
SLIDE 6

1- CARTOGRAPHY INDICATORS : For each variable (Buildings, HH, Population), compare numbers, average, median, mode, minimum, maximum, STD Deviation…

THREE DATA SOURCES

2- FIELD REPORTS 3- DATA FILES

THREE VARIABLES BUILDINGS HOUSEHOLDS POPULATION

Monitor enumeration implementation almost on real time. Lessons Learnt and Recommendations to improve for mapping and main Census enumeration Recommendations Costing and Implementation

1 2 3 4 6 7 8

Evaluate Pilot Coverage and Assess Data Quality …

5 CARTOGRAPHIC DATA USE IN PILOT DATA QUALITY ASSESSMENT AND IMPROVEMENT

slide-7
SLIDE 7

▪ Less than 0.05% of difference between the number

  • f buildings in mapping and the pilot.

▪ The pilot enumeration was not completed in some EAs in the Ouest Department due to security reason. ▪ The average EA size in buildings was reasonable to be completed by an enumerator in 4 weeks’ time. ▪ About 1 in 5 mapped buildings were found empty. ▪ In 2 departments, about 1 in 4 mapped buildings were empty, due to Rural-Urban migrations.

2 153 5 051 5 785 4 609 17 598 1 244 5 185 6 441 4 720 17 590 1 244 5 185 6 441 4 626 17 496 Ouest Artibonite Grand Anse Nord Ouest All Department

Number of Buildings per source and domain

Mapping Pilot-Field Report Pilot-Data Files 195,7 168,4 186,6 184,4 181,4 113,1 172,8 207,8 188,8 181,3 113,1 172,8 207,8 185,0 181,4 Ouest Artibonite Grand Anse Nord Ouest All Department

Average EA size ( Buildings)

Mapping Pilot-Field Report Pilot-Data Files 83,7 75,2 85,3 74,1 79,2 16,3

24,8

14,7

23,8

20,2 Ouest Artibonite Grand Ansa Nord Ouest All Departments

% of Occupied buildings

Occupied Buildings (FR) Empty Buildings

Slight differences in number of buildings in mapping and the pilot.

RESULTS PILOT DATA QUALITY ASSESMENT

slide-8
SLIDE 8

2 071 4 568 5 671 4 824 17 134 1 195 5 001 5 847 3 747 15 790 856 5 540 5 482 3 330 15 208 Ouest Artibonite Grand Anse Nord Ouest All Departments

Number of Households

Mapping Pilot-Field Report Pilot-Data Files 188,27 152,27 182,94 192,96 176,64 108,64 166,70 188,61 149,88 162,78 77,82 184,67 176,84 133,20 156,78 Ouest Artibonite Grand Anse Nord Ouest All Departments

Average EA size ( Households)

Mapping Pilot-Field Report Pilot-Data Files 34,5 72,5 46,9 49,7 54,7 68,2 57,5 53,7 62,0 57,7 Ouest Artibonite Grand Anse Nord Ouest All Departments

% of Female headed HH

Pilot-Field Report Pilot-Data Files

▪ The number of HH is different by up to 11% between the 3 sources. ▪ 582 HH were reported in the field staff report, but not found in the raw data files – misunderstanding by some field staff of concept of Head of HH. ▪ Up to 33.7 percentage points difference between female headed HH in the field staff reports and the raw data file. ▪ The average EA size in HH is reasonable to be completed in 4 weeks. On average an enumerator completed 7HH per Day.

RESULTS PILOT DATA QUALITY ASSESMENT

slide-9
SLIDE 9

9 030 21 078 28 921 24 473 83 502 2 989 19 761 23 380 15 994 62 124 2 989 19 761 23 380 15 994 62 124 Ouest Artibonite Grand Anse Nord Ouest All Departments

Population per source and domain

Mapping Pilot-Field Report Pilot-Data Files 820,91 702,60 932,94 978,92 860,85 271,73 658,70 754,19 639,76 640,45 271,73 658,70 754,19 639,76 640,45 Ouest Artibonite Grand Anse Nord Ouest All Departments

Average EA size ( Population)

Mapping Pilot-Field Report Pilot-Data Files

84,1 79,5 104,9 87,5 90,8

Ouest Artibonite Grand Anse Nord Ouest All Departments

Sex Ratio (M/100F) ▪ The population estimated by mapping is 25.6% higher than the actual enumerated population. ▪ Mapping counts all persons in a building, while the enumeration counts only resident population. ▪ The population from the field reports is equal to the one in the raw data files. ▪ The average EA size is 641 inhabitants. ▪ Sex Ratio is 90,8 M/100 F. It reaches 104.9 in Grand Anse

RESULTS PILOT DATA QUALITY ASSESMENT

slide-10
SLIDE 10
  • 1000
  • 500

500 1000 7 14 21 28 35 42 49 56 63 70 77 84 91 98 108

Pop Pyramid

Féminin Masculin

97,4 99,9 96,6 87,9 94,6 76,3 85,0 85,6 86,8 71,2 83,9 90,3 86,4 83,9 101,5 97,4 0-4 ans 5-9 ans 10-14 ans 15-19 ans 20-24 ans 25-29 ans 30-34 ans 35-39 ans 40-45 ans 45-49 ans 50-54 ans 50-59 ans 60-64 ans 65-69 ans 70-75 ans 75 ans +

Sex Ratio

ND 5,0% Célibataire 47,1% Marié( e) 18,8% Placé( e) 17,3% Vivavèk 3,7% Veuf/ve 3,2% Séparé(e ) après mariage 0,4% Séparé(e ) après plaçage 1,8% Divorcé( e) 0,2% Autre 2,4%

▪ The Pilot Census data reflects the country’s sociodemographic profile. ▪ Marked heaping on ages ending in the digits 0, 5 and 8. ▪ Broad base of the pop pyramid, which reflects high fertility and child and infant mortality levels. ▪ Low Sex Ratio for the age group 20 to 45 years – due to economic migration. ▪ Only 18.8% of population aged 10 years + are legally married.

Marital Status

PILOT CENSUS SELECTED RESULTS

slide-11
SLIDE 11

49,9% 46,1% 47,9% Masculin Féminin Total

Have a Cell Phone

ND; 5,0% Oui, Régulièremen t (plusieurs fois par jour/semaine); 15,7% Oui, Souvent (plusieurs fois par mois); 6,6% Oui, Oui, Occasionnelle ment (une fois par mois ou moins); 3,5% Non, n'a pas utilisé internet; 43,3% Non, ne sait pas utilisé internet; 21,6% Ne sait pas; 4,3% 15,3% 18,8% 17,1% Masculin Féminin Total

Illiteracy Rates (6 years +)

▪ 17.1% of pop 6 years &+ are illiterate - 15.3% males versus 18.8% females ▪ 47.9 % of pop 10 years &+ own a cell phone. ▪ 15.7 % of pop aged 10 years &+ use internet regularly, 43.3% have never used internet and 21.6% don’t know how to use Internet.

Internet use

PILOT CENSUS SELECTED RESULTS

slide-12
SLIDE 12

R e s p o n s e R a t e s ( H H )

68,5 93,7 94,6 85,9 90,2 0,3 1,0 0,9 4,1 1,7 31,2 5,3 4,5 10,0 8,1 0,0 20,0 40,0 60,0 80,0 100,0 120,0 Ouest Artibonite Grand Ansa Nord Ouest All Departments

Response rates (Buildings)

FULLY COMPLETED PARTIALLY COMPLETED NOT COMPLETED

Variable Response Rate EA 100% Qp3 - Relationship to HHH 97.59% Qp4 - Sex 99.99% Qp5- DOB - Day 70.14% Qp5- DOB - Month 72.32% Qp5- DOB - Year 84.49% Qp6- Religion 95.77% Qp7- Citizenship 95.54% Qp8- Mother still alive 95.45% Qp10- Place of Birth 95.51% Qp11- Place of Residence 95.41% Qe1- Literacy 95.86% Qt1- Own a Cell Phone 94.98% Qt2- Use of Internent 94.98% Qsm1- Marital Status 94.98%

Department No of EA Completed EAs Area (km2) Average EA area (Km2) Ouest 15 11 0.33 0.03 Artibonite 15 30 52.26 1.74 Grand Anse 15 31 88.23 2.85 Nord Ouest 15 25 49.35 1.97 All Department 120 97 190.17 1.96

PILOT CENSUS SELECTED RESULTS

slide-13
SLIDE 13

No Issue / Lessons Learnt Recommendations Comments

1 Slight difference between the number of buildings in mapping and the pilot. Use number of buildings as indicators for:

  • Monitoring enumeration progress.
  • Payment of field staff.
  • Evaluation of mapping.
  • 2nd quality control Vble for EA Demarcation.

For better supervision, the number of mapped buildings in an EA is not shared with enumerators. 2 About 1 in 5 mapped building were found empty.

  • The number of buildings is no longer used as first

variable for EA demarcation.

  • Provide the list and GPS coordinate of empty

buildings for field supervision missions.

  • Add to Supervisor’s task to check at least 5

buildings reported as empty in an EA.

  • If the number of empty buildings in an EA exceeds

20%, a field supervisory mission should be sent to double check. Most empty buildings were found in rural areas, due to Rural-urban migration. 3 The average EA of 156.8 buildings, 181.4 HH, 641 inhabitants and 1.96 km2, is reasonable to complete in 4 weeks by an enumerator.

  • Initial 4 weeks data collection time is confirmed

enough for an enumerator to complete his entire EA.

  • The initial 15,000 enumerators and 3,600

supervisors are enough, no additional costs are required.

  • The pilot EA average sizes where used in the

enumeration planning (nbr of field staff in each commune department, distribution plan, logistics plan, payments plan, etc.) On average, an enumerator completes 7HH/Day.

EXAMPLES OF RECOMMENDATIONS PILOT DATA QUALITY ASSESSMENT

slide-14
SLIDE 14

No Issue / Lessons Learnt Recommendations Comments

4 Module on buildings was not completed in the census questionnaire for about 10% of

  • ccupied buildings.
  • Review the module on buildings in field staff’s

manuals of instructions.

  • Review the test of concordance and edit

specifications for the part concerning buildings.

  • Add a task to enumerators’ and supervisors’ ToR to

explain the reasons for all buildings where the module on building was not completed on census questionnaire.

  • Add to the ToR of field supervision missions to

check at least 5 buildings where the module on building was not completed. 5 The number of HH is different by up to 11% between the 3 sources.

  • Review the module on HH definition in field staff’s

manuals of instructions.

  • Review the test of concordance and edit

specification for the part concerning the HH. and HHH.

  • Extend the field staff training by 3 days.
  • Add more field practices in the field staff training.

Misunderstanding of some field staff of the concept of Household. 6 Up to 33.7 percentage points difference between female headed HH in the field staff reports and the raw data file.

  • Review the module on HHH definition in field

staff’s manuals of instructions.

  • Review the test of concordance and edit

specification for the part concerning the HHH.

EXAMPLES OF RECOMMENDATIONS PILOT DATA QUALITY ASSESSMENT

slide-15
SLIDE 15

No Issue / Lessons Learnt Recommendations Comments

7 The population estimated by mapping is 25.6% higher than the actual enumerated population.

  • Use the number of HH, instead of population, as a

primary variable in EA demarcation.

  • Use the number of HH in monitoring the

enumeration progress. Thanks to the VPN and IT applications, the data collection monitoring was done almost on a real time basis and at all levels (EAs, Communes, Departments and Country). 8 The population from the field report is equal to the one in the raw data files.

  • Confirmation that the reports generated by field

staff are correct and can be used for the main census enumeration.

  • Confirmation that all the data transfer system

(from Enumerator to Supervisors to Data Center) is working perfectly. 9 For 6 Pilot EA (out of 120), enumeration couldn’t be conducted because of security reasons.

  • Estimation of number of HH, Housing Units, and

superficies of insecure areas.

  • Use of Hybrid Census in areas controlled by

gangs.

  • Use of proxy-publicity in areas controlled by

gangs. Thanks to cartographic data, the Haiti’s Census team was able to produce maps of security levels (High, medium and low) for the entire country

EXAMPLES OF RECOMMENDATIONS PILOT DATA QUALITY ASSESSMENT

slide-16
SLIDE 16

The Cartographic data helped in monitoring the enumeration progress almost in real time, in the evaluation of the pilot census and in formulating over 200 recommendations to improve the main census coverage and data quality. The Cartographic data resulted in the review of census manuals of instructions, IT applications, tests

  • f

concordance, edits specifications and training timeline and contents. The pilot census data are of good quality and reflect the country’s sociodemographic profile. Over 220 recommendations from the pilot and mapping assessment were drafted and about to be implemented to improve for the main census. Haiti’s 5th Census is expected to be one of the best censuses in the country, and probably in the region.

CONCLUSION

slide-17
SLIDE 17
  • Mr. Mohamed Laghdaf CHEIKH MELAININE is an engineer in Statistics,

with M.Phil. in Demography and Bachelor’s degree in Economics. He has over 21 years of professional experience in sociodemographic data collection, analysis and dissemination. His experience includes 9 population censuses, 4 Census Post Enumeration Surveys, and over 15 large households’ surveys (DHS, MICS, SLMS...). His current position is UNFPA Census Chief Technical Adviser for Haiti’s 5th Census. cheikhmalainine@unfpa.org mmalainine@gmail.com

THE PRESENTERS

  • Mr. Daniel Milbin has a Bachelor’s degree in Statistics Specialized in

Sampling, Specialized Diploma in Demography and a Master’s degree in Population and Development and Public Policy. He has over 35 years of professional experience in sociodemographic data collection and analysis. His experience includes 3 population censuses and 4 large households surveys. His current position is Director of National Survey at Haiti’s Statistical Office, and national Director of the Haiti’s 5th Census. dlmilbin@gmail.com

slide-18
SLIDE 18

Thank You

Questions and Comments, please.