Publication: Building Better Policies : The Nuts
and Bolts of Monitoring and Evaluation Systems
Loading...
Published
2012-04-13
ISSN
Date
2012-04-27
Author(s)
Abstract
Governments around the world face ongoing pressures from citizens to provide more and better services, and to do this under a tight fiscal environment. This provides the context for government efforts to ensure their policies and programs are as effective, and as efficient, as possible. An emphasis on government performance has led a number of governments to create formal systems for monitoring and evaluating (M&E) their performance on a regular, planned, and systematic basis with the objective of improving it. The focus of this book is on these government M&E systems: what they comprise, how they are built and managed, and how they can be used to improve government performance. M&E systems focus on measuring the results produced by government its outputs, outcomes, and impacts. The M&E system may exist at the level of an individual agency, entire sector, or the government as a whole. M&E can provide unique information about the performance of government policies, programs, and projects at the national, sector, and sub-national levels. It can identify what works, what does not, and the reasons why. M&E also provides information about the performance of a government, of individual ministries and agencies, and of managers and their staff. This book endeavors to expand the frontiers of issues that have been researched and analyzed. However, there are still a number of issues that are still not understood well enough. This book presents case studies on several countries that have succeeded in achieving high levels of utilization of M&E information, including Australia, Canada, Chile, and Mexico.
Link to Data Set
Citation
“Krause, Philipp; Lopez-Acevedo, Gladys; Mackay, Keith. Lopez-Acevedo, Gladys; Krause, Philipp; Mackay, Keith, editors. 2012. Building Better Policies : The Nuts
and Bolts of Monitoring and Evaluation Systems. World Bank Training Series. © World Bank. http://hdl.handle.net/10986/6015 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Tools for Institutional, Political, and Social Analysis of Policy Reform : A Sourcebook for Development Practitioners(Washington, DC: World Bank, 2007)This Sourcebook deals with social analysis in policy reform, encompassing the transition from gaining a better understanding of the distributional impacts of proposed or continuing reform to influencing a more informed and locally embedded process of policy review and design. In a generic sense, the term "social analysis" encompasses institutional, political, and social analyses. These three overlapping areas, derived from different disciplinary backgrounds, focus on the rules and relations that underpin and influence reform outcomes: Institutional analysis looks at the rules that people develop to govern group behavior and interaction in political, economic, and social spheres of life. Institutional analysis is based on an understanding that these rules-whether formally constructed or informally embedded in cultural practice-mediate and distort, sometimes fundamentally, the expected impacts of policy reform. Political analysis looks at the structure of power relations and often-entrenched interests of different stakeholders that affect decision making and distributional outcomes. Political analysis is built on recognition that political interests underpin many areas of policy debate and economic reform, challenging assumptions about the technical nature of policy making. Social analysis looks at the social relationships that govern interaction at different organizational levels, including households, communities, and social groups. Social analysis is built on an understanding of the role of social and cultural norms in governing relationships within and between groups of social actors, with implications for the degree of inclusion and empowerment of specific social groups.Publication Analyzing the Effects of Policy Reforms on the Poor : An Evaluation of the Effectiveness of World Bank Support to Poverty and Social Impact Analyses(Washington, DC: World Bank, 2010)The current global financial and economic crises are likely to put enormous pressure on governments to respond with immediate measures and to undertake far-reaching reforms in the medium term, requiring a substantial increase in donor support. To protect the poor and enhance benefits to them, key policy reforms will need to be underpinned by systematic analysis of their expected poverty and social impacts. The World Bank's experience to date with the Poverty and Social Impact Analysis (PSIA) approach provides useful lessons for addressing these issues. Overall, implementation of the PSIA approach has had considerable limitations. There have been tensions between the various operational objectives assigned to PSIAs. The tensions concern inconsistencies between informing country and Bank policy decisions in a timely way and building country analytic capacity. PSIAs have had limited ownership by Bank staff and managers and have often not been effectively integrated into country assistance programs. Quality assurance, monitoring, and evaluation of the overall effectiveness of PSIAs have been weak. To improve PSIAs' effectiveness, this evaluation recommends that the Bank take measures to ensure that staff fully understands what the PSIA approach is and when to use it, clarify the operational objectives of each PSIA, and ensure that the approach and timeline adopted are aligned with those objectives. Quality assurance mechanisms should be strengthened to ensure that PSIAs are designed to achieve the intended effects.Publication Results Readiness in Social Protection and Labor Operations(World Bank, Washington, DC, 2011-02)The main focus of the social protection and labor portfolio is on strengthening client's institutional capacity in the design and implementation of programs, but projects are not well equipped to track progress in this area. Correspondingly, there is a need to strengthen approaches to measuring and monitoring a 'missing middle' of service delivery, precisely those areas for which counterpart institutions are responsible during the course of a project. In particular, better measures of the primary functions of social protection and labor agencies are needed, such as identifying and enrolling beneficiaries, targeting, payment systems, fraud and error control, performance monitoring of service delivery providers, responsiveness to citizens, transparency, efficiency, management information systems and monitoring and evaluation systems. New World Bank initiatives particularly standard core indicators by sector and the introduction of results based investment lending call for substantial improvements in the use of monitoring and evaluation (M&E). Impact evaluations are included in about half of projects and should continue to be used selectively and strategically, particularly when the program is innovative, replicable and/ or scalable to reach a broader set of beneficiaries, addresses a knowledge gap and is likely to have a substantial policy impact. Structuring evaluations around core themes with common outcome measures is fundamental to building a global knowledge base on development effectiveness.Publication Poverty and Social Impact Analysis of Reform : Lessons and Examples from Implementation(Washington, DC: World Bank, 2006)Poverty and Social Impact Analysis (PSIA) is an approach used increasingly by governments, civil society organizations, the World Bank, and other development partners to examine the distributional impacts of policy reforms on the well-being of different stakeholders groups, particularly the poor and vulnerable. PSIA has an important role in the elaboration and implementation of poverty reduction strategies in developing countries because it promotes evidence-based policy choices and fosters debate on policy reform options. This publication presents a collection of case studies that illustrate the spectrum of sectors and policy reforms to which PSIA can be applied; it also elaborates on the broad range of analytical tools and techniques that can be used for PSIA. The case studies provide examples of the impact that PSIA can have on the design of policy reforms and draw operational lessons for PSIA implementation. The case studies deal largely with policy reforms in a single sector, such as agriculture (crop marketing boards in Malawi and Tanzania and cotton privatization in Tajikistan); energy (mining sector in Romania and oil subsidies in Ghana); utilities (power sector reform in Ghana, Rwanda, and transition economies, and water sector reform in Albania); social sectors (education reform in Mozambique and social welfare reform in Sri Lanka); taxation reform (Nicaragua); as well as macroeconomic modeling (Burkina Faso).Publication Planning, Monitoring, and Evaluation : Methods and Tools for Poverty and Inequality Reduction Programs(World Bank, Washington, DC, 2013-01)As the author enter the second decade of the twenty-first century, governments, international organizations, nongovernmental organizations (NGOs), philanthropic organizations, and civil society groups worldwide are actively focusing on evidence-based policy and increased accountability to stakeholders (results agenda).The widespread implementation of the Results Agenda has generated a plethora of books, guides, academic papers, trainings, and case studies, which has enabled an ongoing maturation process in the field. Consequently, specialists are now better equipped to understand what works under which circumstances. Broadly speaking there are two interrelated questions which must be answered when assessing the sustainability of a government results agenda. First, is the institutional design and practice of government conducive to evidence-based policy making? Second, are the overarching monitoring and evaluation (M&E) methods and specific tools used appropriate for garnering the evidence demanded by government? These series of notes aim to make a small contribution to the latter question by summarizing and highlighting a selection of PM&E methods and the tools that governments and international organizations around the world have developed to put these into practice in their own contexts. The central goal of this initiative is to prompt a process of learning, reflection and action by providing practical information to those whose leadership role requires them to understand PM&E methods and their potential for enhancing evidence-based policy making.
Users also downloaded
Showing related downloaded files
Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Participatory Budgeting(Washington, DC : World Bank, 2007)This book provides an overview of the principles underlying participatory budgeting. It analyzes the merits and demerits of participatory budgeting practices around the world with a view to guiding policy makers and practitioners on improving such practices in the interest of inclusive governance. This publication includes five regional surveys, and seven country case studies can be found on the accompanying CD ROM. The study explains that participatory budgeting has been advanced by budget practitioners and academics as an important tool for inclusive and accountable governance and has been implemented in various forms in many developing countries around the globe. It adds that through participatory budgeting, citizens have the opportunity to gain firsthand knowledge of government operations, influence government policies, and hold government to account. However, participatory processes also run the risk of capture by interest groups. Captured processes may continue to promote elitism in government decision making. This book examines the potential and perils of participatory budgeting, as observed from practices around the globe. It is divided into three parts. Part I presents the nuts and bolts of participatory budgeting. Part II surveys experiences with participatory budgeting in various regions of the world. Part III (Vol. 2) is on the CD ROM accompanying this book, and it examines case studies of practices in seven countries.Publication A Guide to Assessing Needs : Essential Tools for Collecting Information, Making Decisions, and Achieving Development Results(World Bank, 2012-01-06)This book will benefit people and teams involved in planning and decision making. On the basis of their pragmatic value in guiding decisions, needs assessments are used in various professions and settings from emergency rooms to corporate boardrooms to guide decision making. Nonetheless, although needs assessments have many different applications, in this book on needs assessments as they are applied in organizations to accomplish results, as opposed to their use in personal decisions or medical triage. This book, in turn, is guide to assessing needs and then making essential decisions about what to do next. This book filled with practical strategies, tools, and guides covers both large-scale, formal needs assessments and less-formal assessments that guide daily decisions. Included in the book is a blend of rigorous methods and realistic tools that can help make informed and reasoned decisions. Together, these methods and tools offer a comprehensive, yet realistic, approach to identifying needs and selecting among alternative ways as go forward. Sections one and two offer quick, yet full, answers to many frequently asked questions regarding how to make justifiable decisions. Next, section three examines a variety of tools and techniques that can be used for both collecting information and making decisions. Appendix A then offers a number of checklists and guides for managing the systematic assessment processes that lead to quality decisions. Finally, the reference list at the end of the book is a valuable resource to research, tools, and discussions of needs assessment.Publication The Road to Results : Designing and Conducting Effective Development Evaluations(World Bank, 2009-12-01)The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.Publication Moving Out of Poverty : Volume 1. Cross-Disciplinary Perspectives on Mobility(Washington, DC: World Bank and Palgrave Macmillan, 2007)This volume brings together multidisciplinary perspectives on poor people's mobility, a dynamic approach that hopefully will add to the reader's understanding of how and why people move into and out of poverty. The chapters draw on the latest longitudinal micro data to present a moving picture of poverty that is rather different from what one can see in single snapshots, the staple of traditional poverty analysis. The book is also important because the contributors' distinct disciplinary perspectives demonstrate clearly why it is critical to draw on diverse information to improve the reader's understanding about how to reduce poverty. The economic findings reinforce what has been known for some time: fast economic growth underpins poverty reduction, but the speed of declines in poverty is greatly affected by social and political factors. The economic panels also show that the people mired in chronic poverty around the world are actually fewer in number than the people moving in and out of poverty. Static studies do not capture this dynamic quality of poverty and vulnerability. Of particular interest are the chapters clarifying interactions between the local social, political, and economic factors that underlie persistent poverty, vulnerability, and inequality. They point to the need to draw from different disciplines as we turn to the task of reaching the bottom poor trapped in poverty and those churning in and out of poverty.