M E Basics Miguel Aragon Lopez MD MPH UNAIDS

M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009

Why Standardized M&E Terminology? A common understanding of M&E terminology is critical for: –maintaining clear communication –taking a common approach UNCT 26 th February 2009

M&E Definitions: Why Standardized M&E Terminology? • Monitoring—routine tracking and reporting of priority information about a plan / program / project, its inputs and intended outputs, outcomes and impacts • Measurement of progress toward achieving program/project objectives; most often involves counting what we are doing. UNCT 26 th February 2009

M&E Definitions: Why Standardized M&E Terminology? Evaluation—the rigorous, scientifically-based collection of information about plan / program / intervention activities, characteristics, and outcomes that determine the merit or worth of the program/intervention

The Purpose of M&E Program Improvement Data Sharing with Partners Reporting/ Accountability

M&E Definitions: Results – RBM approach UNDAF and agency programmes in terms of a hierarchy of SMART results which has five levels: –MDG related national priority/ goal (equated with impact) –UNDAF outcome, know in Moz also as pillars –Outcome of one or more agencies working together –Output usually of one agency, but possibly of more than one working together –Activity Result

M&E Definitions: Results – RBM approach SMART Results S pecific: Results must use change language – they must describe a specific future condition M easurable: Results, whether quantitative or qualitative, must have measurable indicators, making it possible to assess whether they were achieved or not A chievable: Results must be within the capacity of the UNCT and partners to achieve R elevant: Results must make a contribution to selected priorities of the national development framework T imebound: Results are never open-ended - there is an expected date of accomplishment

The chain of results: causal sequence for an intervention to achieve desired objective INPUTS . Infrastructure. Human. Finance. Equipment. Technology. Policy. Time. Volunteers. Partners ACTIVITIES . Management. Training. Counseling. Logistic management. Operation research. BCC. Conference. Facilitation. etc. Measure UNCT 26 th February 2009 process OUTPUTS . Services - Access - Quality. Awareness. Knowledge. Attitude. Capacities. Competency. Opinion. Aspiration. Motivation OUTCOMES . Behaviors. Practices. Decision. Utilization of services IMPACT Quality of life Conditions: . Human. Economic. Civic. Environment MDGs: . Poverty. Morbidity. Mortality. HIV prevalence. Education. Employment. Gender equality Measure impact

What & how well we are doing? Planning -Formative Evaluation (Planning and Assessment) Implementation Outcomes -Input/Output Monitoring -Process Evaluation -Outcome Monitoring -Outcome Evaluation -Impact Monitoring -Impact Evaluation

Baselines, targets and performance Commitment Performance Current level of achievem ent Baseline Target Achievement

WFP Emergency Operation M&E Framework RESULTS Input (Resources) X kg maize, X kg oil X Kg other Output Outcomes Impact ( Interventions, Services) Targeted women receiving full family ration Increased household food supply Increased consumption especially W, Ch & V Ind. Distribution of Family ration to Women # of family ration recipients disaggregated by gender Activities % of target house Hold with adequate Food supply Average # of Meals per day by gender and age Program-based Data Population-based Survey Measure process Measure impact

HIV/AIDS M&E Framework Assessment & Planning Input (Resources) Situation Analysis Response Analysis Stakeholder Needs Resource Analysis Collaboration plans Program Development Data Staff Funds Materials Facilities Supplies Output Outcomes Impact ( Interventions, Services) (Immediate Effects) (Intermediate Effects) (Long-term Effects) Trainings Services Education Treatments Interventions # Staff Trained # Condoms Provided # Clients Served # Tests Conducted Provider Behavior Risk Behavior Service Use Clinical Outcomes Quality of Life Social Norms HIV prevalence STI Incidence AIDS Morbidity AIDS Mortality Economic Impact Activities Program-based Data Measure process Population-based Biological, Behavioral & Social Data Measure impact

M&E Definitions: Indicators An Indicator is…. a variable that measures one aspect of a program/project and useful to measure changes Indicators are measures used to monitor progress made towards the achievement of intended RESULTS, considering as the output, outcome or impact of a development intervention.

M&E Definitions: SMART Indicators Specific: indicators need to measure what they claim to measure Measurable: can be quantified and measured by some scale Achievable: can data on the indicator actually be colleted? Relevant: does it provide information that is relevant to the programme decision makers? Time-bound: when is change expected?

Strategic Planning for M&E: Setting Realistic Expectations Number of Projects All Most Some Input/ Output Monitoring Process Evaluation Outcome Monitoring / Evaluation Few* Impact Monitoring / Evaluation Levels of Monitoring & Evaluation Effort 15

Key messages: 1. The main purpose of M&E is programme/project improvement. 2. M&E is not only about INDICATORS. 3. M&E is an essential management tool and it is present along programme/project implementation. 4. M&E starts with the planning process.

THANK YOU