Enhancing evidence-based policy making through Country-Led M&E Systems* Marco Segone, Regional Chief, Monitoring and Evaluation, UNICEF CEE/CIS, and former Vice President, IOCE E-mail: msegone@unicef. org *: The opinions expressed are those of the author and do not necessarily reflect the policies or views of UNICEF. The text has not been edited to official publication standards and UNICEF accepts no responsibility for errors.
Based on book published by UNICEF in partnership with key international institutions §Authors: 21 global evaluation leaders §Partnership: IDEAS, IOCE, Dev. Info, WB, UNECE, and MICS Available for free download at: http: //www. unicef. org/ceecis/resources_10597. html
1. M&E should be instrumental in ensuring effective decision making , by providing strong evidence. Then: • Why is M&E not playing its role to its full potential? • What are the factors, in addition to the quality and adequacy of evidence, influencing the decision-making process in organizations and societies? • How can the uptake of evidence in decision-making be increased?
What is Evidence-based Policy making? An approach that helps people make well informed decisions about policies, programmes and projects by putting the best available evidence at the heart of policy development and implementation.
Qualitative research evidence Experimental and quasiexperimental evidence Survey and Administrative evidence Consultative techniques High Evaluation evidence Low Systematic review evidence Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Low High Enabling policy environment
Practice of Political Life High Low Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Timing of the analysis Low High Enabling policy environment Judgement Experience Resources Lobby system ►Think-tank ► Opinion leaders ► Media ► Civil Society
Evaluation evidence Qualitative research evidence Experimental and quasiexperimental evidence Survey and Administrative evidence Consultative techniques Practice of Political Life Low Systematic review evidence Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Timing of the analysis Vicious circle countries Opinion-based Low Enabling policy environment Judgement Experience Resources Lobby system ►Think-tank ► Opinion leaders ► Media ► Civil Society
Evaluation evidence Qualitative research evidence Experimental and quasiexperimental evidence Survey and Administrative evidence Consultative techniques High Systematic review evidence Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Evidence demandconstrained countries Evidence-influenced Low Enabling policy environment Practice of Political Life Timing of the analysis Judgement Experience Resources Lobby system ►Think-tank ► Opinion leaders ► Media ► Civil Society
Evaluation evidence Qualitative research evidence Experimental and quasiexperimental evidence Survey and Administrative evidence Consultative techniques Evidence supplyconstrained countries Low Systematic review evidence Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Evidence-influenced High Enabling policy environment Practice of Political Life Timing of the analysis Judgement Experience Resources Lobby system ►Think-tank ► Opinion leaders ► Media ► Civil Society
Evaluation evidence Qualitative research evidence Experimental and quasiexperimental evidence Survey and Administrative evidence Consultative techniques Virtuous circle countries High Systematic review evidence Technical quality and trustworthiness Putting the best available evidence at the heart of policy making? Evidence-based High Enabling policy environment Practice of Political Life Timing of the analysis Judgement Experience Resources Lobby system ►Think-tank ► Opinion leaders ► Media ► Civil Society
Evidence into practice: Increasing the uptake of evidence in policy making Data Users (Policy Makers) Data Providers (Statisticians, Evaluators, Researchers) Need to improve dialogue How? Reliable and trustworthy evidence Effective Improving dissemination “usability” of evidence Wide Access What ? Why? When? Getting appropriate Buy-in Incentives to use evidence
The “quality” challenge: How to match technical rigour and policy relevance? Technical rigour but no policy relevance Better evidence, technically rigorous and policy relevant. Policy relevance but no technical rigour
Country-led M&E systems (CLES): a strategy to match technical rigour with policy relevance rigour Technical levance o policy re but n ce, iden rous ev etter ally rigo nt B nic eva tech olicy rel p and ce levan gour y re Polic hnical ri tec ut no b Better Policies Better Development Results
Country-led M&E systems: what? Country (and not donors) leads and owns the evaluation process by determining: l what policy or programme will be evaluated (including donors coordination and alignment) l what evaluation questions will be asked l what methods will be used l what analytical approach will be undertaken
“Country” led? • Not exclusively the Government • Also civil society, including Professional evaluation International Development Evaluation Association – IDEAS (Individual membership) International Organisation for Cooperation in Evaluation – IOCE (Organisational membership) organizations (from 15 to 70 in a decade) 11 Source: Quesnel, 2006
Country-led M&E systems: implications From To Towards Evaluation of aid effectiveness Evaluation of national development Evaluation of global governance Asymmetrical approach: Developed countries evaluating developing countries Neutral approach: Developing countries evaluating national development policies Symmetrical approach: Developed and developing countries evaluating global governance
National ownership and capacity development: the key ingredients to CLES Managing for Mutual Harmoni results accounta Alignment zation bility Paris Declaration on Aid Effectiveness Ownership
Partner countries exercise effective leadership over their development policies and strategies Paris Declaration Commitment l Partner countries exercise leadership in developing and implementing their national development strategies l Donors respect partner country leadership and help strengthen their capacity to exercise it. Implications to the M&E Function l Strengthen and use country M&E systems l M&E capacity development
What are the challenges and way-forward? On you view and experience: • What are the challenges to implement country-led M&E systems? What are the perceived risks by partner countries and by donors ? • What are the way forward? What’s the role of national, regional and international evaluation organizations such as IDEAS, and International agencies?
CLES: Challenges • drive towards ownership is partly supply-driven • longer time frame • perceived risk by partner countries that independent evaluations of donor support may have political and financial consequences • perceived risk by donors of weak national capacities and, in some cases, of weak independence of national M&E systems
CLES: way forward • Middle income, transition and developing countries cooperation to share good practices and lessons learned • National evaluation organizations fostering endogenous demand (and supply) for monitoring & evaluation • International organizations strengthening national capacities to design and implement national M&E systems
Скачать презентацию Enhancing evidence-based policy making through Country-Led M E Systems
2d9e420599c80bd0f43fdafe1ab97fe2.ppt