Country Practices on Census Evaluation 2000 Census Round

Country Practices on Census Evaluation: 2000 Census Round � United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys United Nations Conference Centre, Bangkok, Thailand 10 – 14 May 2010

Objectives of the Questionnaire § To better understand census evaluation activities at the country level § To facilitate the sharing of experience on methods of census evaluation among countries in the region Total of 16 respondents

Respondent Profile: 2000 Round & PES Country Banglades h Cambodia China India Rep of Korea Malaysia 2000 Round 2001 1998 2000 2001 1995/2000 Country Myanmar Nepal Pakistan Philippines Sri Lanka Thailand 2000 Round 1983* 2001 1998 -x 1995/2000 2001 2000

Respondent Profile: 2010 Round & PES Country Banglades h Cambodia China India Rep of Korea Malaysia 2010 Round 2011 Country Myanmar 2010 Round ? 2008 2010 2011 2010 Nepal Pakistan Philippines Sri Lanka 2011 2010 -x 2011 2010 Thailand 2010

Objective of Evaluation (2000 Round) Yes Count • Measure coverage errors: undercount; overcount • Measure content errors: data quality 11111 -11111 -11 • Identify conceptual issues and methodological areas needing improvement 11

Objective of Evaluation (2000 Round) Yes Count • Measure coverage errors: undercount; overcount • Measure content errors: data quality 11111 -1111 • Identify conceptual issues and methodological areas needing improvement • Adjust census results 11 • Evaluate suitability of census enumeration areas for intercensal sample surveys 11111 -11 11111 -

Objective of Evaluation (2010 Round) Yes Count • Measure coverage errors: undercount; overcount • Measure content errors: data quality 11111 -1111 • Identify conceptual issues and methodological areas needing improvement • Adjust census results 11 111

N=15 countries conducted PES Organization and Planning • Planning & Implementing Agency • National Statistical or Census Office • Census team and PES team different • Independent organization/other • Part of census budget • Adequate funding Yes Count 11111 -11111 -1 1 11111 -11111 -

Operationalising Independence • PES planning done by independent group • PES implementation independent from Census implementation • Different set of supervisors and enumerators • PES sample held confidential • Different design: questionnaires • Census information held confidential • Independent data processing Yes Count 1111111111 -1 1 11 11

Recruitment of PES Staff • Recruitment from • Census staff • Others • NSO • Available in the labour market • Mixed • Selection criteria • Different from census enumerators • Experience Yes Count 11111 -1111111 -11111 1 1 11111 -11

Training of PES Staff • Training duration: enumerators • 1 -3 days • 4 -7 days • Training duration: supervisors • 1 -3 days • 4 -10 days Yes Count 11111 -11111

Sample Design Yes Count • Number of stages • 1 stage 11111 -11111 • 2 stages 11111 • Sample size (PSUs) • Range: 54 (Nepal) to 3000 (India) • 10% population (Maldives); 0. 5% of urban areas (Mongolia) • Stratification • Urban-Rural • Geographic, administrative groups

Domains of Analysis • National only • Urban-Rural • Administrative areas (region/province/state) Yes Count 11111 11 11111 -11

Matching Procedures • Method • Computer • Manual • Both • Rules were documented • Made field reconciliation visits Yes Count 1 11111 -1111111

Coverage Measures • • Coverage rate only Net coverage rate only Both coverage & net coverage rates Others: Coverage plus • Net*/Omission rate • Erroneous inclusion rate • Gross coverage error rate • Completeness rate Yes Count 11111 111

Content Analysis Measures Yes Count • Collected data for content analysis 11111 -1111111 • Measures • Consistency: Index of Inconsistency • Agreement: Rate of Agreement; Net/Gross Difference Rate • Age accuracy indexes • Coincidence rates between census and PES • Omission rates by individual characteristics

Use of PES Results Yes Count • Report was produced • For lay users 11111 -11 • Only for office use 11111 -111 • Time to release results [from start of data collection] • One year or less [minimum = 2 11 months] • More than one year [max = 3 111 years] • Used to adjust census results 11111

Lessons Learned • Improving quality of PES results- Field issues • Mismatches due to faulty EA maps • Need for close monitoring of field work and use monitoring information for early detection of errors • More efficient workload distribution (difficult areas: urban, . . . ) • Strategy for dealing with nonresponse • More and better supervision • Better training • Improve sample design and weighting • Improve implementation of matching procedures

Country Practices on Census Evaluation: 2000 Census Round � United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys United Nations Conference Centre, Bangkok, Thailand 10 – 14 May 2010