Publication: Building Better Policies : The Nuts
and Bolts of Monitoring and Evaluation Systems
Loading...
Date
2012-04-13
ISSN
Published
2012-04-13
Author(s)
Abstract
Governments around the world face ongoing pressures from citizens to provide more and better services, and to do this under a tight fiscal environment. This provides the context for government efforts to ensure their policies and programs are as effective, and as efficient, as possible. An emphasis on government performance has led a number of governments to create formal systems for monitoring and evaluating (M&E) their performance on a regular, planned, and systematic basis with the objective of improving it. The focus of this book is on these government M&E systems: what they comprise, how they are built and managed, and how they can be used to improve government performance. M&E systems focus on measuring the results produced by government its outputs, outcomes, and impacts. The M&E system may exist at the level of an individual agency, entire sector, or the government as a whole. M&E can provide unique information about the performance of government policies, programs, and projects at the national, sector, and sub-national levels. It can identify what works, what does not, and the reasons why. M&E also provides information about the performance of a government, of individual ministries and agencies, and of managers and their staff. This book endeavors to expand the frontiers of issues that have been researched and analyzed. However, there are still a number of issues that are still not understood well enough. This book presents case studies on several countries that have succeeded in achieving high levels of utilization of M&E information, including Australia, Canada, Chile, and Mexico.
Link to Data Set
Citation
“Krause, Philipp; Lopez-Acevedo, Gladys; Mackay, Keith. Lopez-Acevedo, Gladys; Krause, Philipp; Mackay, Keith, editors. 2012. Building Better Policies : The Nuts
and Bolts of Monitoring and Evaluation Systems. World Bank Training Series. © World Bank. http://hdl.handle.net/10986/6015 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Tools for Institutional, Political, and Social Analysis of Policy Reform : A Sourcebook for Development Practitioners(Washington, DC: World Bank, 2007)This Sourcebook deals with social analysis in policy reform, encompassing the transition from gaining a better understanding of the distributional impacts of proposed or continuing reform to influencing a more informed and locally embedded process of policy review and design. In a generic sense, the term "social analysis" encompasses institutional, political, and social analyses. These three overlapping areas, derived from different disciplinary backgrounds, focus on the rules and relations that underpin and influence reform outcomes: Institutional analysis looks at the rules that people develop to govern group behavior and interaction in political, economic, and social spheres of life. Institutional analysis is based on an understanding that these rules-whether formally constructed or informally embedded in cultural practice-mediate and distort, sometimes fundamentally, the expected impacts of policy reform. Political analysis looks at the structure of power relations and often-entrenched interests of different stakeholders that affect decision making and distributional outcomes. Political analysis is built on recognition that political interests underpin many areas of policy debate and economic reform, challenging assumptions about the technical nature of policy making. Social analysis looks at the social relationships that govern interaction at different organizational levels, including households, communities, and social groups. Social analysis is built on an understanding of the role of social and cultural norms in governing relationships within and between groups of social actors, with implications for the degree of inclusion and empowerment of specific social groups.Publication Analyzing the Effects of Policy Reforms on the Poor : An Evaluation of the Effectiveness of World Bank Support to Poverty and Social Impact Analyses(Washington, DC: World Bank, 2010)The current global financial and economic crises are likely to put enormous pressure on governments to respond with immediate measures and to undertake far-reaching reforms in the medium term, requiring a substantial increase in donor support. To protect the poor and enhance benefits to them, key policy reforms will need to be underpinned by systematic analysis of their expected poverty and social impacts. The World Bank's experience to date with the Poverty and Social Impact Analysis (PSIA) approach provides useful lessons for addressing these issues. Overall, implementation of the PSIA approach has had considerable limitations. There have been tensions between the various operational objectives assigned to PSIAs. The tensions concern inconsistencies between informing country and Bank policy decisions in a timely way and building country analytic capacity. PSIAs have had limited ownership by Bank staff and managers and have often not been effectively integrated into country assistance programs. Quality assurance, monitoring, and evaluation of the overall effectiveness of PSIAs have been weak. To improve PSIAs' effectiveness, this evaluation recommends that the Bank take measures to ensure that staff fully understands what the PSIA approach is and when to use it, clarify the operational objectives of each PSIA, and ensure that the approach and timeline adopted are aligned with those objectives. Quality assurance mechanisms should be strengthened to ensure that PSIAs are designed to achieve the intended effects.Publication Results Readiness in Social Protection and Labor Operations(World Bank, Washington, DC, 2011-02)The main focus of the social protection and labor portfolio is on strengthening client's institutional capacity in the design and implementation of programs, but projects are not well equipped to track progress in this area. Correspondingly, there is a need to strengthen approaches to measuring and monitoring a 'missing middle' of service delivery, precisely those areas for which counterpart institutions are responsible during the course of a project. In particular, better measures of the primary functions of social protection and labor agencies are needed, such as identifying and enrolling beneficiaries, targeting, payment systems, fraud and error control, performance monitoring of service delivery providers, responsiveness to citizens, transparency, efficiency, management information systems and monitoring and evaluation systems. New World Bank initiatives particularly standard core indicators by sector and the introduction of results based investment lending call for substantial improvements in the use of monitoring and evaluation (M&E). Impact evaluations are included in about half of projects and should continue to be used selectively and strategically, particularly when the program is innovative, replicable and/ or scalable to reach a broader set of beneficiaries, addresses a knowledge gap and is likely to have a substantial policy impact. Structuring evaluations around core themes with common outcome measures is fundamental to building a global knowledge base on development effectiveness.Publication Poverty and Social Impact Analysis of Reform : Lessons and Examples from Implementation(Washington, DC: World Bank, 2006)Poverty and Social Impact Analysis (PSIA) is an approach used increasingly by governments, civil society organizations, the World Bank, and other development partners to examine the distributional impacts of policy reforms on the well-being of different stakeholders groups, particularly the poor and vulnerable. PSIA has an important role in the elaboration and implementation of poverty reduction strategies in developing countries because it promotes evidence-based policy choices and fosters debate on policy reform options. This publication presents a collection of case studies that illustrate the spectrum of sectors and policy reforms to which PSIA can be applied; it also elaborates on the broad range of analytical tools and techniques that can be used for PSIA. The case studies provide examples of the impact that PSIA can have on the design of policy reforms and draw operational lessons for PSIA implementation. The case studies deal largely with policy reforms in a single sector, such as agriculture (crop marketing boards in Malawi and Tanzania and cotton privatization in Tajikistan); energy (mining sector in Romania and oil subsidies in Ghana); utilities (power sector reform in Ghana, Rwanda, and transition economies, and water sector reform in Albania); social sectors (education reform in Mozambique and social welfare reform in Sri Lanka); taxation reform (Nicaragua); as well as macroeconomic modeling (Burkina Faso).Publication Planning, Monitoring, and Evaluation : Methods and Tools for Poverty and Inequality Reduction Programs(World Bank, Washington, DC, 2013-01)As the author enter the second decade of the twenty-first century, governments, international organizations, nongovernmental organizations (NGOs), philanthropic organizations, and civil society groups worldwide are actively focusing on evidence-based policy and increased accountability to stakeholders (results agenda).The widespread implementation of the Results Agenda has generated a plethora of books, guides, academic papers, trainings, and case studies, which has enabled an ongoing maturation process in the field. Consequently, specialists are now better equipped to understand what works under which circumstances. Broadly speaking there are two interrelated questions which must be answered when assessing the sustainability of a government results agenda. First, is the institutional design and practice of government conducive to evidence-based policy making? Second, are the overarching monitoring and evaluation (M&E) methods and specific tools used appropriate for garnering the evidence demanded by government? These series of notes aim to make a small contribution to the latter question by summarizing and highlighting a selection of PM&E methods and the tools that governments and international organizations around the world have developed to put these into practice in their own contexts. The central goal of this initiative is to prompt a process of learning, reflection and action by providing practical information to those whose leadership role requires them to understand PM&E methods and their potential for enhancing evidence-based policy making.
Users also downloaded
Showing related downloaded files
Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Impact Evaluation in Practice, First Edition(World Bank, 2011)The Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. The book incorporates real-world examples to present practical guidelines for designing and implementing evaluations. Readers will gain an understanding of the uses of impact evaluation and the best ways to use evaluations to design policies and programs that are based on evidence of what works most effectively. The handbook is divided into three sections: Part One discusses what to evaluate and why; Part Two outlines the theoretical underpinnings of impact evaluation; and Part Three examines how to implement an evaluation. Case studies illustrate different methods for carrying out impact evaluations.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication Poverty and Shared Prosperity 2022(Washington, DC : World Bank, 2022)Poverty and Shared Prosperity 2022: Correcting Course provides the first comprehensive analysis of the pandemic’s toll on poverty in developing countries. It identifies how governments can optimize fiscal policy to help correct course. Fiscal policies offset the impact of COVID-19 on poverty in many high-income countries, but those policies offset barely one quarter of the pandemic’s impact in low-income countries and lower-middle-income countries. Improving support to households as crises continue will require reorienting protective spending away from generally regressive and inefficient subsidies and toward a direct transfer support system—a first key priority. Reorienting fiscal spending toward supporting growth is a second key priority identified by the report. Some of the highest-value public spending often pays out decades later. Amid crises, it is difficult to protect such investments, but it is essential to do so. Finally, it is not enough just to spend wisely - when additional revenue does need to be mobilized, it must be done in a way that minimizes reductions in poor people’s incomes. The report highlights how exploring underused forms of progressive taxation and increasing the efficiency of tax collection can help in this regard. Poverty and Shared Prosperity is a biennial series that reports on global trends in poverty and shared prosperity. Each report also explores a central challenge to poverty reduction and boosting shared prosperity, assessing what works well and what does not in different settings. By bringing together the latest evidence, this corporate flagship report provides a foundation for informed advocacy around ending extreme poverty and improving the lives of the poorest in every country in the world. For more information, please visit worldbank.org/poverty-and-shared-prosperity.