The Core Welfare Indicators Questionnaire A CWIQ Option

The Core Welfare Indicators Questionnaire: A CWIQ Option for Monitoring Poverty Reduction Strategies

FUTURE APPLICATIONS • CWIQ Technology could be adopted for other surveys/censuses GENERAL HOUSEHOLD SURVEY (GHS) üMonitoring socio-economic progr üMeasuring impacts of policies & p ECONOMIC SURVEYS üPrices (CPI, INFLATION) üIndustrial Production POPULATION CENSUS

The Logframe defines M&E activities at four levels Impact on living standards Outcomes Who are the beneficiaries? (access, usage & satisfaction) Outputs Goods & services generated by the project/Program Inputs Resources provided for Project/Program activities

The CWIQ is a household survey It is used to monitor outcomes of development actions, (such as PRSPs) …. …. . through the use of leading indicators, such as access, use and satisfaction

Using CWIQ to monitor primary education in Ghana Access to schools (within 30 minutes) Usage (enrollment rates) Quality of service (% satisfied) WARNING! % satisfied All households 40% Rural households 30% Poor rural households 18%

Using CWIQ to monitor primary education in Ghana What are they complaining about? Lack of books a problem everywhere Poor facilities - serious problem in poor rural communities

Sample CWIQ outputs Nigeria Note margin of error at 95% confidence level Overall more household feel they are better off now, especially among the poor

Sample CWIQ outputs Tanzania

Countries in which the CWIQ is planned or has been implemented H H H H Kenya (pilot) Ghana (1997) Nigeria (1999, 2001) Tanzania (2001) Lesotho (Nov. 2001) Malawi (Sept. 2001) Zambia (pilot) H H H Senegal Mali Rwanda CAR Guinea Bissau Mozambique (2000/2001)

EXPERIENCES FROM COUNTRIES q q As part of an on-going survey programme (master sample available, permanent survey organization) Modification of questionnaire ü Nigeria (additional question on electricity, educational attainment categorization, Gender module) ü Mozambique (module on Flood damage) ü Rwanda (Consumption module) ü HIV/AIDS module waiting to be tested ü Predictor variables are getting country-specific ü Questionnaire Translation (Tanzania) ü Probability Sample Pilots (Nigeria) ü National Surveys (Ghana, Mozambique)

How does the CWIQ work? An off-the-shelf survey package Fixed core, flexible modules Quick data entry & validation Large sample Simple reporting Short questionnaire Rigorous control of data quality

1. Sampling issues H H H Large samples are encouraged (for high precision) A ‘core’ survey in a 5 -10 year survey program Annual sampling from Master Sample frames builds up time series Not really intended for panel studies - but these are not excluded Suitable for small area sampling

2. The questionnaire H H H 8 pages / 9 sections (additional modules are increasing the pages) 3 levels hierarchy (household, household members, children) Service delivery indicators (access, use and satisfaction) Indicators on welfare status (Assets, housing, literacy, nutrition, employment) Additional modules (HIV/AIDS; Gender; Flood Effects) Suitable to monitor crisis situation (speed)

2. The questionnaire (contd. ) H H The CWIQ does not collect consumption or expenditure data The issue of poverty predictors – Kenya experience – Ghana experience – Nigeria/Mozambique experience – Rwanda experience

2. The questionnaire designed for scanning

3. Quality control H Data quality is achieved through tight control: – thorough training; – close supervision in the field; – rapid data loading with extensive computerised validation checks; and. – early feedback to interviewers in the case of problems. H H Average number of interviews per enumerator/day - four. Mean interview duration - about 40 minutes (with anthropometry). With additional module – slight increase of 5 minutes. Average comes down with national surveys.

4. Data Processing - Stage 1 H Requires. TELEform for image processing of the scanned forms, converting the marked areas into data values; H Objective is to start data processing as soon as possible after the start of fieldwork. A questionnaire can be scanned and converted into the database format in about 2 minutes. H H Three people in the data processing team can handle 300 questionnaires per day. H The package includes comprehensive documentation on all aspects of the data

4. Data Processing - Stage 1 How character recognition is verified and corrected using TELEform

4. Data Processing - Stage 2 H H Requires Microsoft Access to build data structures, validate, correct, summarise and tabulate the data; Once scanned the data are transferred to MSAccess which has been configured to: – perform a number of validation checks to test logical consistency of the data – provide a means of editing erroneous records – generate derived variables

5. Generating results H H Pre-programmed standard report using Access and Excel Data can be exported to standard statistical analysis packages Data and metadata stored and disseminated on CD-ROM Standardized indicators simplify crosscountry comparisons

CAPACITY BUILDING FEATURES OF CWIQ • • • Acquired capacity through CWIQ could benefit other Data Production Process Ø Improved Surveys Programming Ø Tight Quality Control (better accuracy) Ø Use of large sample (higher precision of estimates) Ø Quick processing and quick release of results (Improved Timeliness) Ø Overall Survey Management (rigorous training, close supervision, report writing) Additional Capacity Ø Building team of Consultants trained at EASTC to bring about rapid technology transfer to Africa Ø Training Statisticians/DP specialists from African Statistical Offices Ø Getting students of Training Institutions familiar with CWIQ methodology Subsequent CWIQ rounds in African countries to be guided by African Experts (Ownership)

CHALLENGES AND OPPORTUNITIES Challenges v v Adopting the technology for other surveys in developing countries particularly in Africa Sustainability of the survey system through getting the national governments to fund the surveys Cooperation among International Community to improve the system further What role for ECA (say) to serve as catalyst in the statistical development in this direction Opportunities v v Opportunity to involve the users in questionnaire review to assure RELEVANCE of output African National Statistical Offices to establish Internet addresses to bring about easy exchanges, namely: Ø Ø v Dissemination of CWIQ results Dissemination of new developments/improvements in CWIQ system Implementation problems and solutions Results of field/methodological research Networking (establish list – serve) African CSO’s, CWIQ consultants, Experts and persons directly working on CWIQ survey system including USERS.

Summary information H H H It is quick! It’s a package Helps build institutional capacity: – to collect quality data – to speed up turnaround time – to generate annual series H H H TA is needed (2 X 6 weeks) Duration: 2 -6 months Cost per household (approximate): – First year $54: (pilot survey on 1000 hh. costs $54, 000) – Next year $33: (national survey on 10, 000 hh. costs $330, 000) – Cost to Respondents (40 -45 minutes)

The CWIQ is just one of several tools needed for a poverty reduction information system H Poverty monitoring and moneymetric analysis ‡ H Poverty monitoring over time ‡ H CWIQ; Admin. records; Prices collection Poverty monitoring and poverty maps ‡ H LSMS: Income and expenditure surveys Censuses; small area surveys Participative poverty monitoring (listening to the poor)

More information on the CWIQ is available at: http: //www. worldbank. org/afr/stats /