Publication: Conducting Diagnoses of M&E Systems and Capacities
Loading...
Published
2011-11
ISSN
Date
2012-08-13
Author(s)
Editor(s)
Abstract
A diagnosis of a country's monitoring and evaluation (M&E) activities is indispensable if that country is to develop projects or policy proposals to improve the impact of M&E. This note provides a guide to some of the topics that need to be considered when undertaking such a diagnosis. These topics emphasize both the institutional analysis of factors that drive demand for M&E and the technical factors that drive supply. For each of the nine topics identified, this note discusses some of the major issues analysts would need to consider. This discussion principally centers on reviewing how these issues were covered in recent M&E studies for a number of developed and developing countries.
Link to Data Set
Citation
“Shepherd, Geoffrey. 2011. Conducting Diagnoses of M&E Systems and Capacities. PREM Notes; No. 16. © World Bank. http://hdl.handle.net/10986/11054 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication The World Bank Group and Public Procurement--An Independent Evaluation : Volume 2: Achieving Development Effectiveness through Procurement in Bank Financial Assistance(Washington, DC: World Bank, 2014)Good public procurement practices are a major determinant of the effectiveness of public expenditure. On behalf of their citizens, governments typically spend as much as 5-20 percent of their gross domestic product on procurement of goods and services, and effective procurement policies enable better use of government budgets. Good national procurement practices are therefore an essential element of the poverty reduction focus of the Bank. Good procurement in Bank projects is also associated with better development outcomes. Equally, sound public procurement in client countries is a prerequisite for the success of the Bank's newly introduced program for results lending instrument. The Bank seeks to ensure that its funds are used for the purpose intended and that they support development effectively and efficiently. Thus, the twin issues that underpin this Independent Evaluation Group (IEG) evaluation are first, how effectively has the World Bank helped build well-functioning public procurement systems in client countries and second, how well have Bank procurement policies and procedures for its investment lending supported the development effectiveness of Bank lending? The evaluation parallels an intensive review by Bank management of the institution's procurement function, motivated by the need to respond to a range of internal and external changes in the Bank's procurement environment. Several evaluations point to the value of coordination between procurement and public expenditure reforms, but also to the difficulties of realizing such coordination. Finally, there are queries related to the adaptability of current Bank procurement guidelines to new contexts, such as public-private partnerships (PPPs); technology loans; and small, fragile, or conflict-affected states. These questions have also contributed to the evaluation's design and coverage.Publication Influencing Change : Building Evaluation Capacity to Strengthen Governance(World Bank, 2011-03-28)Evaluation Capacity Building (ECB) is an often-discussed topic in developing countries and their partner international institutions. This book takes on an elusive yet frequently mentioned concept in development evaluation ECB. Differences and divergences were apparent in the spring of 2009, when the International Development Evaluation Association (IDEAS) held its biannual global assembly in Johannesburg, South Africa, around the theme of 'getting to results: evaluation capacity building and development.' What became apparent was that a number of challenges had already been identified, but that trying to capture lessons learned on effective strategies was difficult, because of the failure to agree upon a unique and coherent definition of ECB, its various objectives and wide scope, and the diversity of institutional contexts in which it takes place. This book brings together the key papers from that global assembly, as well as new papers that reflect on what was learned and shared at the conference.Publication Building Better Policies : The Nuts and Bolts of Monitoring and Evaluation Systems(Washington, DC: World Bank, 2012-04-13)Governments around the world face ongoing pressures from citizens to provide more and better services, and to do this under a tight fiscal environment. This provides the context for government efforts to ensure their policies and programs are as effective, and as efficient, as possible. An emphasis on government performance has led a number of governments to create formal systems for monitoring and evaluating (M&E) their performance on a regular, planned, and systematic basis with the objective of improving it. The focus of this book is on these government M&E systems: what they comprise, how they are built and managed, and how they can be used to improve government performance. M&E systems focus on measuring the results produced by government its outputs, outcomes, and impacts. The M&E system may exist at the level of an individual agency, entire sector, or the government as a whole. M&E can provide unique information about the performance of government policies, programs, and projects at the national, sector, and sub-national levels. It can identify what works, what does not, and the reasons why. M&E also provides information about the performance of a government, of individual ministries and agencies, and of managers and their staff. This book endeavors to expand the frontiers of issues that have been researched and analyzed. However, there are still a number of issues that are still not understood well enough. This book presents case studies on several countries that have succeeded in achieving high levels of utilization of M&E information, including Australia, Canada, Chile, and Mexico.Publication Implementing a Government-wide Monitoring and Evaluation System in South Africa(World Bank, Washington, DC, 2010-07)Monitoring and evaluation (M&E) is an extremely complex, multidisciplinary and skill intensive endeavor. Government-wide M&E is even more so because it requires detailed knowledge across and within sectors, as well as of interactions among planning, budgeting, and implementation functions in the public sector. The situation is complicated even further when the machinery of government is decentralized, with powers and functions distributed across three spheres of government. This paper outlines the process of implementing a government-wide monitoring and evaluation (GWM&E) system in South Africa. The first section sketches the context that created the impetus for establishing such a system. This context is clearly shaping the evolution of the system and influencing its longer-term sustainability. The second section outlines the various stages of conceptualizing and implementing the GWM&E system, which is currently very much a 'work in progress.' The third section reviews international experiences for lessons learned, which may also be germane to the South African context, noting similarities and differences in approach. Some of the critical implementation factors relate to the role of political leadership and championing of M&E, incentives for promoting usage of M&E findings, dealing with information and data constraints, capacity building, "ownership" of the M&E system by line ministries and other agencies, and managing the challenges of change. The fourth section examines a range of challenges and difficulties encountered in South Africa. The final section reflects on lessons distilled from the South African experience to date.Publication The Canadian Monitoring and Evaluation System(World Bank, Washington, DC, 2011-06)Performance measurement, monitoring, and evaluation have long been part of the infrastructure within the federal government in Canada. With more than 30 years of formalized evaluation experience in most large federal departments and agencies, many lessons can be gained, not the least of which is the recognition that the monitoring and evaluation (M&E) system itself is not static. The Canadian government has a formalized evaluation policy, standards, and guidelines; and these have been modified on three occasions over the past three decades. Changes have usually come about because of a public sector reform initiative such as the introduction of a results orientation to government management, a political issue that may have generated a demand for greater accountability and transparency in government, or a change in emphasis on where and how M&E information should be used in government. This chapter provides an overview of the Canadian M&E model, examining its defining elements and identifying key lessons learned.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication The Design and Implementation of a Menu of Evaluations(World Bank, Washington, DC, 2011-01)Policy makers and program managers are faced every day with major decisions resulting from insufficient funding, ongoing complaints about service delivery, unmet needs among different population groups, and limited results on the ground. There is a menu of evaluation types implemented by developing and Organization for Economic Co-operation Development (OECD) countries to tackle a wide range of policy and program management issues, considering time, resources and capacity constraints. International experience highlights the importance of a gradual approach when introducing evaluation tools into country-level monitoring and evaluation (M and E) systems. Different paths may work better for different countries depending on the main purpose of their M and E system, existing institutional capacity, the availability of funds, and external technical assistance.Publication Monitoring and Evaluation(World Bank, Washington, DC, 2004-09-01)Monitoring and evaluation (M&E) of development activities provides government officials, development managers, and civil society with better means for learning from past experience, improving service delivery, planning and allocating resources, and demonstrating results as part of accountability to key stakeholders. Within the development community there is a strong focus on results, this helps explain the growing interest in M&E. Yet there is often confusion about what M&E entails. The purpose of this M&E overview is to strengthen awareness and interest in M&E, and to clarify what it entails. The M&E overview discusses: performance indicators, the logical framework approach, theory-based evaluation, formal surveys, rapid appraisal methods, participatory methods, public expenditure tracking surveys, cost-benefit and cost-effectiveness analysis, and impact evaluation.Publication The Global Findex Database 2025: Connectivity and Financial Inclusion in the Digital Economy(Washington, DC: World Bank, 2025-07-16)The Global Findex 2025 reveals how mobile technology is equipping more adults around the world to own and use financial accounts to save formally, access credit, make and receive digital payments, and pursue opportunities. Including the inaugural Global Findex Digital Connectivity Tracker, this fifth edition of Global Findex presents new insights on the interactions among mobile phone ownership, internet use, and financial inclusion. The Global Findex is the world’s most comprehensive database on digital and financial inclusion. It is also the only global source of comparable demand-side data, allowing cross-country analysis of how adults access and use mobile phones, the internet, and financial accounts to reach digital information and resources, save, borrow, make payments, and manage their financial health. Data for the Global Findex 2025 were collected from nationally representative surveys of about 145,000 adults in 141 economies. The latest edition follows the 2011, 2014, 2017, and 2021 editions and includes new series measuring mobile phone ownership and internet use, digital safety, and frequency of transactions using financial services. The Global Findex 2025 is an indispensable resource for policy makers in the fields of digital connectivity and financial inclusion, as well as for practitioners, researchers, and development professionals.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.