Publication: Conducting Diagnoses of M&E Systems and Capacities
Loading...
Published
2011-11
ISSN
Date
2012-08-13
Author(s)
Editor(s)
Abstract
A diagnosis of a country's monitoring and evaluation (M&E) activities is indispensable if that country is to develop projects or policy proposals to improve the impact of M&E. This note provides a guide to some of the topics that need to be considered when undertaking such a diagnosis. These topics emphasize both the institutional analysis of factors that drive demand for M&E and the technical factors that drive supply. For each of the nine topics identified, this note discusses some of the major issues analysts would need to consider. This discussion principally centers on reviewing how these issues were covered in recent M&E studies for a number of developed and developing countries.
Link to Data Set
Citation
“Shepherd, Geoffrey. 2011. Conducting Diagnoses of M&E Systems and Capacities. PREM Notes; No. 16. © World Bank. http://hdl.handle.net/10986/11054 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication The World Bank Group and Public Procurement--An Independent Evaluation : Volume 2: Achieving Development Effectiveness through Procurement in Bank Financial Assistance(Washington, DC: World Bank, 2014)Good public procurement practices are a major determinant of the effectiveness of public expenditure. On behalf of their citizens, governments typically spend as much as 5-20 percent of their gross domestic product on procurement of goods and services, and effective procurement policies enable better use of government budgets. Good national procurement practices are therefore an essential element of the poverty reduction focus of the Bank. Good procurement in Bank projects is also associated with better development outcomes. Equally, sound public procurement in client countries is a prerequisite for the success of the Bank's newly introduced program for results lending instrument. The Bank seeks to ensure that its funds are used for the purpose intended and that they support development effectively and efficiently. Thus, the twin issues that underpin this Independent Evaluation Group (IEG) evaluation are first, how effectively has the World Bank helped build well-functioning public procurement systems in client countries and second, how well have Bank procurement policies and procedures for its investment lending supported the development effectiveness of Bank lending? The evaluation parallels an intensive review by Bank management of the institution's procurement function, motivated by the need to respond to a range of internal and external changes in the Bank's procurement environment. Several evaluations point to the value of coordination between procurement and public expenditure reforms, but also to the difficulties of realizing such coordination. Finally, there are queries related to the adaptability of current Bank procurement guidelines to new contexts, such as public-private partnerships (PPPs); technology loans; and small, fragile, or conflict-affected states. These questions have also contributed to the evaluation's design and coverage.Publication Influencing Change : Building Evaluation Capacity to Strengthen Governance(World Bank, 2011-03-28)Evaluation Capacity Building (ECB) is an often-discussed topic in developing countries and their partner international institutions. This book takes on an elusive yet frequently mentioned concept in development evaluation ECB. Differences and divergences were apparent in the spring of 2009, when the International Development Evaluation Association (IDEAS) held its biannual global assembly in Johannesburg, South Africa, around the theme of 'getting to results: evaluation capacity building and development.' What became apparent was that a number of challenges had already been identified, but that trying to capture lessons learned on effective strategies was difficult, because of the failure to agree upon a unique and coherent definition of ECB, its various objectives and wide scope, and the diversity of institutional contexts in which it takes place. This book brings together the key papers from that global assembly, as well as new papers that reflect on what was learned and shared at the conference.Publication Building Better Policies : The Nuts and Bolts of Monitoring and Evaluation Systems(Washington, DC: World Bank, 2012-04-13)Governments around the world face ongoing pressures from citizens to provide more and better services, and to do this under a tight fiscal environment. This provides the context for government efforts to ensure their policies and programs are as effective, and as efficient, as possible. An emphasis on government performance has led a number of governments to create formal systems for monitoring and evaluating (M&E) their performance on a regular, planned, and systematic basis with the objective of improving it. The focus of this book is on these government M&E systems: what they comprise, how they are built and managed, and how they can be used to improve government performance. M&E systems focus on measuring the results produced by government its outputs, outcomes, and impacts. The M&E system may exist at the level of an individual agency, entire sector, or the government as a whole. M&E can provide unique information about the performance of government policies, programs, and projects at the national, sector, and sub-national levels. It can identify what works, what does not, and the reasons why. M&E also provides information about the performance of a government, of individual ministries and agencies, and of managers and their staff. This book endeavors to expand the frontiers of issues that have been researched and analyzed. However, there are still a number of issues that are still not understood well enough. This book presents case studies on several countries that have succeeded in achieving high levels of utilization of M&E information, including Australia, Canada, Chile, and Mexico.Publication Implementing a Government-wide Monitoring and Evaluation System in South Africa(World Bank, Washington, DC, 2010-07)Monitoring and evaluation (M&E) is an extremely complex, multidisciplinary and skill intensive endeavor. Government-wide M&E is even more so because it requires detailed knowledge across and within sectors, as well as of interactions among planning, budgeting, and implementation functions in the public sector. The situation is complicated even further when the machinery of government is decentralized, with powers and functions distributed across three spheres of government. This paper outlines the process of implementing a government-wide monitoring and evaluation (GWM&E) system in South Africa. The first section sketches the context that created the impetus for establishing such a system. This context is clearly shaping the evolution of the system and influencing its longer-term sustainability. The second section outlines the various stages of conceptualizing and implementing the GWM&E system, which is currently very much a 'work in progress.' The third section reviews international experiences for lessons learned, which may also be germane to the South African context, noting similarities and differences in approach. Some of the critical implementation factors relate to the role of political leadership and championing of M&E, incentives for promoting usage of M&E findings, dealing with information and data constraints, capacity building, "ownership" of the M&E system by line ministries and other agencies, and managing the challenges of change. The fourth section examines a range of challenges and difficulties encountered in South Africa. The final section reflects on lessons distilled from the South African experience to date.Publication The Canadian Monitoring and Evaluation System(World Bank, Washington, DC, 2011-06)Performance measurement, monitoring, and evaluation have long been part of the infrastructure within the federal government in Canada. With more than 30 years of formalized evaluation experience in most large federal departments and agencies, many lessons can be gained, not the least of which is the recognition that the monitoring and evaluation (M&E) system itself is not static. The Canadian government has a formalized evaluation policy, standards, and guidelines; and these have been modified on three occasions over the past three decades. Changes have usually come about because of a public sector reform initiative such as the introduction of a results orientation to government management, a political issue that may have generated a demand for greater accountability and transparency in government, or a change in emphasis on where and how M&E information should be used in government. This chapter provides an overview of the Canadian M&E model, examining its defining elements and identifying key lessons learned.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2014(Washington, DC, 2013-10-06)The past 25 years have witnessed unprecedented changes around the world—many of them for the better. Across the continents, many countries have embarked on a path of international integration, economic reform, technological modernization, and democratic participation. As a result, economies that had been stagnant for decades are growing, people whose families had suffered deprivation for generations are escaping poverty, and hundreds of millions are enjoying the benefits of improved living standards and scientific and cultural sharing across nations. As the world changes, a host of opportunities arise constantly. With them, however, appear old and new risks, from the possibility of job loss and disease to the potential for social unrest and environmental damage. If ignored, these risks can turn into crises that reverse hard-won gains and endanger the social and economic reforms that produced these gains. The World Development Report 2014 (WDR 2014), Risk and Opportunity: Managing Risk for Development, contends that the solution is not to reject change in order to avoid risk but to prepare for the opportunities and risks that change entails. Managing risks responsibly and effectively has the potential to bring about security and a means of progress for people in developing countries and beyond. Although individuals’ own efforts, initiative, and responsibility are essential for managing risk, their success will be limited without a supportive social environment—especially when risks are large or systemic in nature. The WDR 2014 argues that people can successfully confront risks that are beyond their means by sharing their risk management with others. This can be done through naturally occurring social and economic systems that enable people to overcome the obstacles that individuals and groups face, including lack of resources and information, cognitive and behavioral failures, missing markets and public goods, and social externalities and exclusion. These systems—from the household and the community to the state and the international community—have the potential to support people’s risk management in different yet complementary ways. The Report focuses on some of the most pressing questions policy makers are asking. What role should the state take in helping people manage risks? When should this role consist of direct interventions, and when should it consist of providing an enabling environment? How can governments improve their own risk management, and what happens when they fail or lack capacity, as in many fragile and conflict-affected states? Through what mechanisms can risk management be mainstreamed into the development agenda? And how can collective action failures to manage systemic risks be addressed, especially those with irreversible consequences? The WDR 2014 provides policy makers with insights and recommendations to address these difficult questions. It should serve to guide the dialogue, operations, and contributions from key development actors—from civil society and national governments to the donor community and international development organizations.Publication Zimbabwe(World Bank, Washington, DC, 2019-03-01)This report presents an assessment of Zimbabwe’s agriculture sector disaster risk and management capacity. The findings indicate that Zimbabwe is highly exposed to agricultural risks and has limited capacity to manage risk at various levels. The report shows that disaster-related shocks along Zimbabwe’s agricultural supply chains directly translate to volatility in agricultural GDP. Such shocks have a substantial impact on economic growth, food security, and fiscal balance. When catastrophic disasters occur, the economy absorbs the shocks, without benefiting from any instruments that transfer the risk to markets and coping ability. The increasing prevalence of ‘shock recovery-shock’ cycles impairs Zimbabwe’s ability to plan and pursue a sustainable development path. The findings presented here confirm that it is highly pertinent for Zimbabwe to strengthen the capacity to manage risk at various levels, from the smallholder farmer, to other participants along the supply chain, to consumers (who require a reliable, safe food supply), and ultimately to the government to manage natural disasters. The assessment provides the following evidence on sources of risks and plausible risk management solutions. It is our hope that the report contributes to action by the Government of Zimbabwe to adopt a proactive and integrated risk management strategy appropriate to the current structure of the agricultural sector.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication World Development Report 2019(Washington, DC: World Bank, 2019)Work is constantly reshaped by technological progress. New ways of production are adopted, markets expand, and societies evolve. But some changes provoke more attention than others, in part due to the vast uncertainty involved in making predictions about the future. The 2019 World Development Report will study how the nature of work is changing as a result of advances in technology today. Technological progress disrupts existing systems. A new social contract is needed to smooth the transition and guard against rising inequality. Significant investments in human capital throughout a person’s lifecycle are vital to this effort. If workers are to stay competitive against machines they need to train or retool existing skills. A social protection system that includes a minimum basic level of protection for workers and citizens can complement new forms of employment. Improved private sector policies to encourage startup activity and competition can help countries compete in the digital age. Governments also need to ensure that firms pay their fair share of taxes, in part to fund this new social contract. The 2019 World Development Report presents an analysis of these issues based upon the available evidence.Publication The Power of Survey Design : A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents(Washington, DC: World Bank, 2006)The vast majority of data used for economic research, analysis, and policy design comes from surveys-surveys of households, firms, schools, hospitals, and market participants, and, the accuracy of the estimate will depend on how well the survey is done. This innovative book is both a 'how-to' go about carrying out high-quality surveys, especially in the challenging environment of developing countries, and a 'user's guide' for anyone who uses statistical data. Reading this book will provide data users with a wealth of insight into what kinds of problems, or biases to look for in different data sources, based on the underlying survey approaches that were used to generate the data. In that sense the book is an invaluable 'skeptics guide to data'. Yet, the broad storyline of the book is something that should be absorbed by statistical data users. The book will teach and show how difficult it often is to obtain reliable estimates of important social and economic facts, and, therefore encourages you to approach all estimates with sensible caution.