Publication: Benchmarking : A Tool to improve the Effectiveness of Monitoring and Evaluation in the Policy Cycle
Loading...
Date
2010-03
ISSN
Published
2010-03
Author(s)
Editor(s)
Abstract
To benchmark is to compare performance against a standard. As part of an effort to improve the effectiveness of monitoring and evaluation (M&E) in the policy cycle, benchmarking can be useful in three ways. First, benchmarking can help place an outcome in the next context. Was the achievement good, bad, or indifferent? Second, benchmarking can help assess the reasonableness of targets that may be set. Third, benchmarking can help identify specific regions or subgroups that are exceptionally good or poor results hint at what factors drive performance, it can be hard to extract information about potential determinants. Therefore, the process of analyzing performance at the extremes can make it easier to extract information and to introduce more feedback into the policy cycle.
Link to Data Set
Citation
“Newman, John L.; Azevedo, João Pedro; Pungiluppi, Juliana. 2010. Benchmarking : A Tool to improve the Effectiveness of Monitoring and Evaluation in the Policy Cycle. en breve; No. 154. © World Bank. http://hdl.handle.net/10986/10205 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Setting Reasonable Performance Targets for Public Service Delivery(World Bank, Washington, DC, 2013-03)Reaching agreement on a reasonable performance target is a challenge, with costs associated with getting it wrong. Attention in the literature has focused on the potential negative effects of gaming or of creaming. However, even if there is no gaming or creaming taking place, there can still be costs associated with setting a level of the performance target that is either too low or too high. On the one hand, if the negotiated performance target is too low, there is a strong risk that the target would be met without any change in behavior or performance from what would have been realized without a performance management system. In that case, there would be no benefit -- only the cost of covering the administrative costs associated with developing the monitoring and management systems. On the other hand, if the negotiated performance target is too high, there could also be significant costs. The exact nature of the costs depends on which one of two unattractive options the principal chooses to follow once it becomes apparent that the performance targets were set unrealistically high. If the principal chooses simply to waive any possible repercussions for the agents for not meeting the performance targets, this can undermine the credibility of the system. If the principal insists on holding agents to meeting the performance targets -- no matter how unrealistic they were -- this can breed resentment and adversely affect future productivity. This paper considers some approaches to target setting that have been used in the literature and proposes an approach based on the use of quantile regressions to construct a Characteristic Adjusted Performance distribution of performance to guide the selection of targets. The paper then presents two concrete examples of applications of this approach related to the setting of targets on School Test Scores and Improvement in Homicide rates in Police Districts in the State of Minas Gerais, Brazil.Publication Pathways to the Middle Class in Turkey : How Have Reducing Poverty and Boosting Shared Prosperity Helped?(World Bank, Washington, DC, 2014-04)Turkey's poverty reduction performance in the 2000s has been remarkably consistent. Extreme and moderate poverty have fallen considerably since 2003. Between 2002 and 2011, extreme poverty fell from 13 percent to 5 percent, while moderate poverty halved from 44 percent to 22 percent (respectively, defined using the World Bank's Europe and Central Asia regional poverty lines of 2.5 and 5 USD/PPP). Most of this poverty reduction (89 percent) has been driven by growth, a performance consistent with most countries in Europe and Central Asia. This is substantially different form the recent performance of other regions, such as Latin America, where redistribution contributed to poverty reduction almost four times more than in Turkey. Turkey has also achieved sustained consumption growth of the bottom 40 percent of the population, even during the years of the world recession. Turkey's performance in poverty reduction and increased shared prosperity has been complemented by the systematic expansion of the middle class by 20 percentage points. This paper analyzes the main drivers of poverty reduction, shared prosperity, and changes in inequality in Turkey from 2002 to 2011. The analysis shows that labor markets, demographics, pensions, and social assistance have played a critical role in this process. It further explores some of the mechanisms that have facilitated these changes.Publication What Are the Impacts of Syrian Refugees on Host Community Welfare in Turkey?(World Bank, Washington, DC, 2016-01)In recent years, Turkey has been host to more than two million Syrians seeking refuge. Initially concentrated in the southeastern regions, these refugees now reside throughout the country. There are many questions from policy makers regarding the impact of the population of Syrians Under Temporary Protection on the host community. This paper examines the impact of migrants on regional host communities from a poverty perspective. The paper does not find any negative impacts on poverty for the host community from the increasing population of Syrians Under Temporary Protection as of 2013, despite the high poverty rates experienced among the recent migrants.Publication When Job Earnings Are Behind Poverty Reduction(World Bank, Washington, DC, 2012-11)Improvement in labor market conditions has been the main explanation behind many of the poverty success stories observed in the last decade, that is the primary conclusion of an analysis of changes in poverty by income source. Changes in labor earnings were the largest contributor to poverty reduction for a sample of 16 countries where poverty increased substantially. In 10 of these countries, labor income explained more than half of the change in poverty, and in another 4 countries, it accounted for more than 40 percent of the reduction in poverty. A declining dependency rate accounts for over a fifth of the reduction in poverty in 10 out of 16 countries, while transfers and other non-earned incomes account for more than a quarter of the reduction in poverty in 9 of these countries. A further decomposition of the contribution of labor income to poverty reduction in Bangladesh, Peru, and Thailand found that changes in individual characteristics (education, work experience, and region of residence) were important, but that overall, increases in real earnings among the poor matter the most.Publication Monitoring and Evaluating Projects : A Step-by-Step Primer on Monitoring, Benchmarking, and Impact Evaluation(World Bank, Washington, DC, 2006-11)This paper attempts to be a practical step-by-step guide to prepare and carry out benchmarking and impact analyses of projects. It's purpose is to attempt to present analytical tools solidly grounded in economic theory all while focusing on the practical questions of evaluations. Little space is given to theory, in order to spend more time on the actual steps involved, trying to make this paper as easy-to-use as possible. The paper is divided in two parts: the first part gives a rationale for quantitative evaluations and provides detailed operative guidance for benchmarking and impact evaluation (Chapter 1-4); and the second part provides templates for the tools needed in an evaluation, such as a data collection checklist, a focus group guide, and an example Terms of Reference (TOR) to subcontract an impact evaluation (Chapter 5).
Users also downloaded
Showing related downloaded files
Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.