DATA ARCHIVING POPULATION AND HOUSING CENSUS PRESENTED BY

DATA ARCHIVING POPULATION AND HOUSING CENSUS PRESENTED BY Richard A. P. Phiri Demographic and Social Statistics Division NATIONAL STATISTICS OFFICE - MW

OUTLINE • Rationale • Background • Census ØProcessing ØArchiving • Dissemination and Policies of Micro-data

Rationale Census /Survey conducted and disseminated growing supply of data but unsatisfied demand under-use Researchers common obstacles/ problems : Ø Ø Ø Ø Quality and technical capacity Accessibility and Timeliness Limited impact Coherence Lack of metadata / documentation Poorly organized archives Management / political / legal / ethical issues

Background Malawi conducted its recent census in June, 2008 and launched results in November, 2009 Usual census attributes were collected Data has been further analyzed by themes – THEMATIC REPORTS These characteristics or attributes Ø enables the assessment of living conditions Ø have profound effects on health and welfare of individuals within the HH

CENSUS PROCESSING

Census Processing DRS Optical Mark Scanners Administered questionnaires were scanned

Census Processing – Cont’d Storage of successfully scanned questionnaires

Census Processing – Cont’d Successfully scanned and edited data images were preserved Converted to CSPro Files concatenated Back-up the dataset Ø Demography division server Ø Technical services division server Ø Senior NSO officers Tabulations of data Reports

IHSN METADATA TOOLKIT

Data Archiving Through the PARIS 21 > NSO expressed interest to archive Technical assistance - 2008 ØCapacity building team was sent Ø Workshops ØInvolved 12 participants from different NSO divisions: -Demography and Social Statistics -Agriculture -Economics ØIHSN Metadata Toolkit / software

Data Archiving – cont’d Subsequent workshops in 2009 Working workshop scheduled for May, coincided with Census analysis Archiving workshop outputs: ØCensus, 1998 and 2008 Ø Intergrated Household Survey ØWelfare Monitoring Survey ØMalawi Demographic and Household Survey – 2000 and 2004

Infrastructure Improvement Census funding Ø acquired laptops and desktop PCs Norwegian and Malawi Government support ØServer – centralised storage of Census data images and micro-data ØICT team – supporting the running of the server ØTraining of the ICT team – India and South Africa

CENSUS ARCHIVING

Study Description Identification ØTitle, Subtitle ØAbbreviation ØStudy type, Id No Version Overview Ø Abstract, Population and housing censuses have regularly been conducted in Malawi since the colonial era. However, the most comprehensive censuses have only been undertaken during the post-colonial period. Censuses have been conducted along with the Integrated Household Survey, Demographic and Health Survey (DHS) and the annual Welfare Monitoring Survey. Besides providing benchmark data on demographic and socio-economic characteristics of the Malawi population, censuses are unique sources of information for small geographical areas and sub-national groups. which is vital for planning and decision-making at lower levels of the country's administrative structures. The 2008 PHC was conducted from 8 - 28 June 2008 by the National Statistical Office (NSO) which deployed rigorously trained teams of enumerators and supervisors to ensure good household coverage. The 2008 PHC report presents basic results on the population size, composition and distribution; population characteristics; population dynamics and household and housing characteristics. ……

Study Description – cont’d Overview – cont’d ØKind of data (Census/enumerated data) ØUnit of analysis - Individuals - Households - Housing Scope and Coverage Ø Modules or topics - Individual - Housing units - Migration ØGeographic

Study Description – cont’d

Sampling, Data Collection and Processing

Data and Accessibility Data Appraisal Ø Based on the Census Data evaluation and assessment report Accessibility Ø Official request through the commissioner Ø Agreement to use the data for research purposes Confidentiality Ø NSO highly values the confidentiality of the census and survey data Ø Requirement of Oath of secrecy – Data user – Data collectors – NSO officers Ø The data user agrees to use the data for research purposes

Copyright and Contacts Copyright Ø Standard legal statement Ø Liability limitation regarding data use Contacts Ø for long term validity preferably by title Ø Affiliation, Ø Email, Ø Uniform Resource Identifier(URI)

Dataset and Variable groups preparation Convert data to IHSN compatible formats ØSPSS ØSTATA ØStatistica, Excel etc Import data Data file description ØName , Contents, Producer, Data version, Processing checks, Missing data, Notes ØKey variable and relations Variable groups

Dataset and Variable groups preparation IHSN compatible formats ØSPSS ØSTATA ØStatistica Ø Excel etc Converted 2008 census micro-data to SPSS Import data Data file description ØName , Contents, Producer, Data version, Processing checks, Missing data, Notes ØKey variable and relations

Dataset Anonymization No tool/software for anonymizing the microdata Planning to develop an in-house tool 100% micro-data on NSO website – not in the public domain Micro-data up to TA level – collapsed or removed direct identifiers(EA, Village, EA, Occupation etc) though not available – still checking the efficiency 10% micro-data on IPUMS website

External resources Resource description ØLabel , say 2008 PHC questionnaire, Manual, Report ØURI or import the resource to Nesstar server Identification ØType, title, subtitle, author(s), date ØCountry, language, format, ID Number Contributor(s) Publisher(s) and Rights Content ØDescription, Abstract, Table of contents ØSubjects say Modules, Key topics

DISSEMINATION AND POLICIES

Dissemination CD-ROMs Ø disseminated during the launch of the Census results ØUpon request of the Census and any other archived survey ØNo dataset Available on-line (including other surveys) NB: 10% of the micro-data to IPUMS

Policies on archived data and confidentiality – not finalized Planned policies: ØFollowing the launch of Census/Survey results, comprehensively archive micro-data and metadata (agricultural, economics, demographic and social) in a data infrastructure that prevents loss or damage ØEncourage data sharing while acknowledging the legal rights § complying with the release/sharing conditions

Policies – cont’d ØEncourage data sharing – cont’d § register to access the micro-data and metadata ØDisseminated data or micro-data user to acknowledgement and abide by the NSO data user agreement and any other general conditions § Micro-data with scrambled IDs or noncorresponding geocodes § 10% of the micro-data

Challenges Lack of anonymization system for crumbling the unique identifiers / IDs Advanced training Technological tools Ø Sophisticated scanners (i. e. ZYLAB scanners for unarchived censuses and Surveys) Insufficient computers and personnel Computer viruses Data archiving software or licence ØNSO - Intends to use IHSN tool kit in future surveys and censuses

ZIKOMO KWAMBIRI FOR YOUR ATTEN TION!!