Publication: Benchmarking : A Tool to improve the Effectiveness of Monitoring and Evaluation in the Policy Cycle
Loading...
Published
2010-03
ISSN
Date
2012-08-13
Author(s)
Editor(s)
Abstract
To benchmark is to compare performance against a standard. As part of an effort to improve the effectiveness of monitoring and evaluation (M&E) in the policy cycle, benchmarking can be useful in three ways. First, benchmarking can help place an outcome in the next context. Was the achievement good, bad, or indifferent? Second, benchmarking can help assess the reasonableness of targets that may be set. Third, benchmarking can help identify specific regions or subgroups that are exceptionally good or poor results hint at what factors drive performance, it can be hard to extract information about potential determinants. Therefore, the process of analyzing performance at the extremes can make it easier to extract information and to introduce more feedback into the policy cycle.
Link to Data Set
Citation
“Newman, John L.; Azevedo, João Pedro; Pungiluppi, Juliana. 2010. Benchmarking : A Tool to improve the Effectiveness of Monitoring and Evaluation in the Policy Cycle. en breve; No. 154. © World Bank. http://hdl.handle.net/10986/10205 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Setting Reasonable Performance Targets for Public Service Delivery(World Bank, Washington, DC, 2013-03)Reaching agreement on a reasonable performance target is a challenge, with costs associated with getting it wrong. Attention in the literature has focused on the potential negative effects of gaming or of creaming. However, even if there is no gaming or creaming taking place, there can still be costs associated with setting a level of the performance target that is either too low or too high. On the one hand, if the negotiated performance target is too low, there is a strong risk that the target would be met without any change in behavior or performance from what would have been realized without a performance management system. In that case, there would be no benefit -- only the cost of covering the administrative costs associated with developing the monitoring and management systems. On the other hand, if the negotiated performance target is too high, there could also be significant costs. The exact nature of the costs depends on which one of two unattractive options the principal chooses to follow once it becomes apparent that the performance targets were set unrealistically high. If the principal chooses simply to waive any possible repercussions for the agents for not meeting the performance targets, this can undermine the credibility of the system. If the principal insists on holding agents to meeting the performance targets -- no matter how unrealistic they were -- this can breed resentment and adversely affect future productivity. This paper considers some approaches to target setting that have been used in the literature and proposes an approach based on the use of quantile regressions to construct a Characteristic Adjusted Performance distribution of performance to guide the selection of targets. The paper then presents two concrete examples of applications of this approach related to the setting of targets on School Test Scores and Improvement in Homicide rates in Police Districts in the State of Minas Gerais, Brazil.Publication Pathways to the Middle Class in Turkey : How Have Reducing Poverty and Boosting Shared Prosperity Helped?(World Bank, Washington, DC, 2014-04)Turkey's poverty reduction performance in the 2000s has been remarkably consistent. Extreme and moderate poverty have fallen considerably since 2003. Between 2002 and 2011, extreme poverty fell from 13 percent to 5 percent, while moderate poverty halved from 44 percent to 22 percent (respectively, defined using the World Bank's Europe and Central Asia regional poverty lines of 2.5 and 5 USD/PPP). Most of this poverty reduction (89 percent) has been driven by growth, a performance consistent with most countries in Europe and Central Asia. This is substantially different form the recent performance of other regions, such as Latin America, where redistribution contributed to poverty reduction almost four times more than in Turkey. Turkey has also achieved sustained consumption growth of the bottom 40 percent of the population, even during the years of the world recession. Turkey's performance in poverty reduction and increased shared prosperity has been complemented by the systematic expansion of the middle class by 20 percentage points. This paper analyzes the main drivers of poverty reduction, shared prosperity, and changes in inequality in Turkey from 2002 to 2011. The analysis shows that labor markets, demographics, pensions, and social assistance have played a critical role in this process. It further explores some of the mechanisms that have facilitated these changes.Publication What Are the Impacts of Syrian Refugees on Host Community Welfare in Turkey?(World Bank, Washington, DC, 2016-01)In recent years, Turkey has been host to more than two million Syrians seeking refuge. Initially concentrated in the southeastern regions, these refugees now reside throughout the country. There are many questions from policy makers regarding the impact of the population of Syrians Under Temporary Protection on the host community. This paper examines the impact of migrants on regional host communities from a poverty perspective. The paper does not find any negative impacts on poverty for the host community from the increasing population of Syrians Under Temporary Protection as of 2013, despite the high poverty rates experienced among the recent migrants.Publication When Job Earnings Are Behind Poverty Reduction(World Bank, Washington, DC, 2012-11)Improvement in labor market conditions has been the main explanation behind many of the poverty success stories observed in the last decade, that is the primary conclusion of an analysis of changes in poverty by income source. Changes in labor earnings were the largest contributor to poverty reduction for a sample of 16 countries where poverty increased substantially. In 10 of these countries, labor income explained more than half of the change in poverty, and in another 4 countries, it accounted for more than 40 percent of the reduction in poverty. A declining dependency rate accounts for over a fifth of the reduction in poverty in 10 out of 16 countries, while transfers and other non-earned incomes account for more than a quarter of the reduction in poverty in 9 of these countries. A further decomposition of the contribution of labor income to poverty reduction in Bangladesh, Peru, and Thailand found that changes in individual characteristics (education, work experience, and region of residence) were important, but that overall, increases in real earnings among the poor matter the most.Publication Monitoring and Evaluating Projects : A Step-by-Step Primer on Monitoring, Benchmarking, and Impact Evaluation(World Bank, Washington, DC, 2006-11)This paper attempts to be a practical step-by-step guide to prepare and carry out benchmarking and impact analyses of projects. It's purpose is to attempt to present analytical tools solidly grounded in economic theory all while focusing on the practical questions of evaluations. Little space is given to theory, in order to spend more time on the actual steps involved, trying to make this paper as easy-to-use as possible. The paper is divided in two parts: the first part gives a rationale for quantitative evaluations and provides detailed operative guidance for benchmarking and impact evaluation (Chapter 1-4); and the second part provides templates for the tools needed in an evaluation, such as a data collection checklist, a focus group guide, and an example Terms of Reference (TOR) to subcontract an impact evaluation (Chapter 5).
Users also downloaded
Showing related downloaded files
Publication The World Bank Group in Tanzania, Fiscal Years 2012–22(Washington, DC: World Bank, 2025-07-22)This evaluation assesses the relevance and effectiveness of the World Bank Group's support to Tanzania between Fiscal Years 2012 and 2022. Over the past decade, Tanzania has experienced resilient growth, with an average annual per capita GDP increase of 2.2%. However, poverty remains widespread and slow to decline, underscoring the need for more inclusive growth. The report examines the Bank Group's strategic and operational approaches during this period, which were aligned with Tanzania's development priorities and focused on industrialization, human development, and public sector reforms. The evaluation includes thematic chapters on the Bank Group's support for private sector-led growth and spatial transformation, as well as lessons to inform future support to the country.Publication Evaluation Insight Note(Washington, DC: World Bank, 2024-11-12)This Evaluation Insight Note (EIN) aims to contribute to the World Bank’s goal of encouraging the use of data, digital technology, and innovation towards transforming agri-food systems in client countries. The EIN was guided by the overall question: “How are World Bank agriculture and irrigation projects using technologies and what insights can be drawn from them” In answering this question, the EIN draws from a portfolio identification and review of 158 active and 113 closed projects (FY16-23) World Bank agriculture and irrigation projects to describe the extent and utilization of agricultural technologies. It supplemented the findings from the review with insights drawn from four project evaluations (Project Performance Assessment Reports) prepared by IEG in Bangladesh, Brazil, Cote d’Ivoire, and Vietnam, which were selected because of their likely lessons on agriculture technology. The portfolio and systematic review provided the basis for seven main insights on coverage and nature of technologies used in World Bank agriculture projects, demand-based technological solutions, technology diffusion, collaboration, and investment in enabling environment factors, among others. (1) The World Bank Agriculture and Irrigation portfolio shows limited coverage of advanced technologies. (2) The technologies that are prevalent in projects are mainly focused on increasing agricultural productivity with limited focus on technologies for facilitating market linkages. (3) Among the technologies promoted in Bank agriculture and irrigation projects, some technologies, and applications such GIS, early warning systems and MIS are more concentrated than others. (4) Combining demand-based technological solutions with training and technical assistance supported uptake of those solutions. (5) Technology diffusion worked well when there was strong collaboration between key research and extension agencies, each with well-defined roles and responsibilities in the projects. (6) When technology dissemination efforts are combined with investments in enabling environment factors such as infrastructure (i.e., roads, markets), they facilitated technology adoption. (7) Building sustainable institutional models – key for technology uptake and use – continue to be challenging in Bank supported projects.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication FY 2025 China Country Opinion Survey Report(Washington, DC: World Bank, 2025-08-04)The Country Opinion Survey in China assists the World Bank Group (WBG) in better understanding how stakeholders in China perceive the WBG. It provides the WBG with systematic feedback from national and local governments, multilateral/bilateral agencies, media, academia, the private sector, and civil society in China on 1) their views regarding the general environment in China; 2) their overall attitudes toward the WBG in China; 3) overall impressions of the WBG’s effectiveness and results, knowledge work and activities, and communication and information sharing in China; and 4) their perceptions of the WBG’s future role in China.Publication The World Bank Group in Georgia, 2014-23(Washington, DC: World Bank, 2025-07-30)This Country Program Evaluation assesses the performance and effectiveness of the World Bank Group’s support to Georgia in achieving the country’s development objectives. In the decade leading up to the evaluation period, Georgia pursued economic reforms to attract critical investments for becoming a regional trade and transport hub. Ambitious economic reforms went hand in hand with efforts to improve human development and strengthening social protection systems. Growing geopolitical tensions and internal political polarization have challenged Georgia’s reform progress in recent years. The Bank Group’s strategy adapted well to Georgia’s development needs and was well coordinated with other development partners. It successfully employed a range of instruments to help increase competitiveness, growth, and job creation, and effectively contributed to improved infrastructure and increased trade by using programmatic and innovative approaches. The Bank Group’s regular investments in analytical work and the switch to results-based programmatic support helped improve the efficiency and effectiveness of education and health care systems. The IEG offers the following lessons based on the evidence and analysis in the Country Program Evaluation: (i) Prioritizing Bank Group support around the move towards deeper regional integration was an effective anchor for key economic reforms for economic convergence. (ii) Pursuing a selective and adaptive approach in a country with high implementation capacity and institutions, strong coordination among development partners, and access to a wide range of external resources can allow the Bank Group to exercise significant influence in areas of comparative advantage and global expertise. (iii) A stronger focus on outcome-based programmatic approaches helped to build local capacity and crowd-in partner financing.