Data Generation and Disaggregation for Monitoring and Evaluation of - - PDF document

1

Action Plan and Methodological Guidelines for

Data Generation and Disaggregation for Monitoring and Evaluation of SDGs

• Md. Alamgir Hossen

Deputy Director and Member-Secretary, SDG Cell Bangladesh Bureau of Statistics (BBS)

Background

Under supervision and guidance of Statistics and Informatics Division (SID), Bangladesh Bureau of Statistics (BBS), as the National Statistical Office (NSO), has completed a rigorous exercise

• n

Data Gaps for SDGs monitoring and the first analytical report was published in April, 2016 based on the targets

2

cont... Background

Based

• n

the publication, General Economics Division (GED) has conducted workshops and rigorous consultation with most of the data generating relevant Ministries/Divisions and agencies including BBS and prepared a national data gap analysis and Monitoring and Evaluation Framework

Ministries/Divisions responsible for data source

105 42 34 28 20 18 14 11 10 9 9 8 8 7 7 5 5 5 5 4 4 4 4 4 4 3 3 3 3 3 2 2 2 2 2 2 2 2 1 1 1 1 1 20 40 60 80 100 120 SID MoEF MoHFW ERD FD LGD MoDMR MoHA MoA FID MoE MoFL MoPME MoC MoFA MoWR GED LPAD PMO MoST MoLE PTD PD MoEWOE MoHPW MoL MoWCA RTHD MoS MoD MoSW MoF EMRD MoR CoCAT MoCA IRD MoCHTA MoYS MoP IMED MoPA LJD

3

Departments/Agencies responsible for SDG Data Source

101 21 19 17 15 8 7 6 5 5 4 4 4 3 3 3 3 3 2 2 2 2 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 20 40 60 80 100

BBS DoE DGHS BFD NIPORT BB BP DoF DDM DPE BIDA BTRC BANBEIS DAE BRTA WDB SREDA DPHE DSS BADC FPMU DNC DIFE HEU BIWTA BIWTC BR WARPO BMET BN NHRC NBR LGED MRA BARI BTC BMDA JRC BERC HCU CLU UGC BOESL CAAB HBRI PWD CPTU BGB DOP NGOAB PPPA DYD DSHE BRTC

Data source by departments

Data Availability in Bangladesh

64 58 110 Readily Available Partially Available Not Available

4

Data Availability SDGs indicators in Bangladesh

5 10 15 20 25 30

3 3 13 1 8 10 3 4 3 4 1 1 2 4 12 4 5 10 7 4 1 8 3 1 3 4 1 1 5 5 5 7 5 4 3 2 4 2 5 6 6 11 9 6 9 7 14 8

Readily Available Partially Available Not Available

7

• Data available in BBS –

Official data

• Data available outside BBS

– Administrative data

• Data not available (to be

collected and developed)

Sources of Data

To be collected

• r new

intervention

5

Definitions of Tier Classification

Tier I : Indicator conceptually clear, established methodology and standards available and data regularly produced by countries. Tier II : Indicator conceptually clear, established methodology and standards available but data are not regularly produced by countries. Tier III : Indicator for which there are no established methodology and standards

• r

methodology/standards are being developed/tested.

9

Tier classification Status of SDG indicators

Tier Conceptually clear Internationally established methodology and standards Regularly produced # of Indicators

Tier I    93 Tier II   ? 72 Tier III ? ? ? 62

* 5 indicators with more than one tier assigned

10

6

Data Interpretation

• Before using data
• bjective should be

defined clearly

• Core factors must be

explored before using data

• 5W1H (who, what, where,

when, why, how) Core Factors

Concepts and Definition

Reference Time

Methodo logy Source Area Significa nce Level Compara bility Meta Data

12

NSO in data coordination

“...global monitoring should be based on comparable and standardized national data

• btained through well-established reporting mechanisms from countries to the

international statistical system. Such mechanisms can be improved by strengthening the coordination function of national statistical offices and/or other national institutions. In

• rder to fill data gaps and improve international comparability, countries will need to

adopt internationally agreed standards at the national level, strengthen national statistical capacity and improve reporting mechanisms. International organizations and regional mechanisms play a significant role in facilitating the process.”

[Report of the Secretary-General- E/2016/75 ]

7

13 Flow chart on global SDG (meta‐)data flow and (meta‐)data reporting

Analysing Disseminating Custodian agency UN SD e.g. Apply disclosure control Blue colour means an involvement of the national statistical system Flow chart on global SDG (meta‐)data flow and (meta‐)data reporting Compiling Custodian agency (CA) Custodian agency Make regional and/or international aggregated data available via SDG indicators global database If issues found, technical consultation If agreement found to utilise adjusted data set e.g. Scrutinise and explain e.g. Finalise

• utputs

Make country data available e.g. via national reporting platforms (NRP) Processing Utilisation of the data set? Disseminating National statistical office and/ or national focal point Data available for each indicator? Utilisation of the data source? Harmonisat ion check If no issues found that make adjustmet of data necessary, utilise data set e.g. Prepare draft

• utput

If no agreement found, Side by Side + explanation by both; if both parties wish / agree call upon regional commission If no data is provided, CA checks back with NSO/ focal point Utilising data: No CA may searches for country data CA proposes use of found country data If data available on NRP, CA retrieves data Approval procedure for data not provided by NSO/ focal point Decision to utilise data to be taken consensual with national statistical office and national focal point Utilising datasource: Yes No agreement: data can be used for calculation of global aggregates

14

Global SDG Indicator Database (UNSD) Regional Organizations

Data and Metadata Adjusted, estimated

• r modelled data

UN Recommendation on Data Flow in SDG Reporting

Country Data Lab (UNSD)

CSOs CSOs

Private Sector Private Sector

Academi a

International Agencies NSO

8

Data disaggre gatio n

 T

he spe c ific dime nsio ns upo n whic h the indic ato rs are to be disaggre gate d inc lude d:

 Se x and ge nde r  Age (5 ye ars gro up/ ne o natal/ c hildre n/ yo ung/ adult/ age d

e tc .)

 I

nc o me (quintile s/ de c ile s/ c ate go rie s)

 L

• c atio n o r spatial varie tie s (urban, rural, me tro po litan,

distric ts, upazila e tc .)

 Disability (Cate go rie s/ Status)  E

thnic ity and indige no us status (Status/ Cate go ry)

 E

c o no mic ac tivity (Oc c upatio n/ F arm/ No n-farm/ se c to ral e tc .)

 Migrant status (I

nte rnatio nal migrants/ inte rnally displac e d e tc .

15

Authentication of Data for SDGs

Authentication by BBS

Online sources Data from NDPs Admin data

SDG Tracker

www.sdg.gov.bd

9

Subject Matter Expert Sub- committee

SDG Cell, BBS

Subject Matter Wings of BBS

Custodian Agencies

SDG Tracker Database Innovative Approaches

Survey/Ce nsus

Administra tive Record Authentication/Validation by BBS Authority Yes

SDG Tracker

www.sdg.gov.bd

Other National Data Providers

No

NSO’s Organizational Framework

Census Wing National Accounting Wing Demography and Health Wing Agriculture Wing Industry and Labour Wing

Web Platform

17

Challenges: Data Support to SDGs

• Production of disaggregated and frequent statistics by age,

sex, disability and sub-national level

• Comparability of Data: Harmonizing the concepts, definitions,

methodologies etc. following international standards

• Availability of baseline data
• Conducting a large number of new surveys
• Technical support availability for regular monitoring
• Introduction of modern technology in collection of statistical

data and quick dissemination

10

Way Forward

• Leading Role of BBS in generation and validation of the official data as NSO
• Preparation of

methodological guidelines for data disaggregation and frequency

• Conducting

new surveys identified for data generation- review

• f

questionnaires are also required

• Mining of microdata of different survey/census/administrative sources
• Developing partnership with other national and international organizations
• Formulation of Guidelines for Administrative Data generation for SDGs

indicators

• Implementation of

Statistics Act, 2013 and National Strategy for the Development of Statistics (NSDS)

• Role of National Data Coordination Committee (NDCC) to be ensured
• Developing the capacity of manpower- more data analytics/data scientists

Surveys need to conduct by BBS to Support SDGs

• 1. Literacy Assessment Survey
• 2. District Community Survey
• 3. Access to Public Transport Survey
• 4. Citizen Household Perception Survey
• 5. Child and Mother Nutrition Survey
• 6. Health and Morbidity Status Survey
• 7. Survey on Manufacturing Industries
• 8. Child Labour Survey
• 9. Bangladesh Disaster Survey
• 10. Survey for Tourism Satellite Account

11

National Activities facilitated by UNSD Develop SDG monitoring implementation strategy Meetings with producers of SDG indicators Engage users within and outside the government Establish and maintain national data platforms Compile metadata for SDG indicators Analyze and explain differences between national and international SDG datasets

Goals and targets and Indicators Custodian Agency (ies) Tier Classifications Definition, Rationale, Concept, Computation Methods and formula UN Suggested activities of data generation UN Suggested data provider Recent Available Data Sources Possible future Sources Required Disaggreg ation Types Frequency

• f data

generation Local Indicator Group* Timeline Action Plan for Data Publishing

Remarks

1 2 3 4 5 6 7 8 9 10 11 12 13

Template of Action Plan and Methodological Guidelines for Data Generation and Disaggregation for Monitoring and Evaluation of SDGs

Local Group Classification: Group 1 : Indicators already produced by NSS and data exist for baseline report (preferably Year 1 = 2016) Group 2 : Indicators in an ongoing process or could be produced within the NSDS up to 2023 Group 3 : Indicators needing more efforts ( methods, financing, etc. )

12

THANK YOU