Publication: Setting Reasonable Performance Targets for Public Service Delivery
Loading...
Published
2013-03
ISSN
Date
2013-04-12
Author(s)
Newman, John L.
Editor(s)
Abstract
Reaching agreement on a reasonable performance target is a challenge, with costs associated with getting it wrong. Attention in the literature has focused on the potential negative effects of gaming or of creaming. However, even if there is no gaming or creaming taking place, there can still be costs associated with setting a level of the performance target that is either too low or too high. On the one hand, if the negotiated performance target is too low, there is a strong risk that the target would be met without any change in behavior or performance from what would have been realized without a performance management system. In that case, there would be no benefit -- only the cost of covering the administrative costs associated with developing the monitoring and management systems. On the other hand, if the negotiated performance target is too high, there could also be significant costs. The exact nature of the costs depends on which one of two unattractive options the principal chooses to follow once it becomes apparent that the performance targets were set unrealistically high. If the principal chooses simply to waive any possible repercussions for the agents for not meeting the performance targets, this can undermine the credibility of the system. If the principal insists on holding agents to meeting the performance targets -- no matter how unrealistic they were -- this can breed resentment and adversely affect future productivity. This paper considers some approaches to target setting that have been used in the literature and proposes an approach based on the use of quantile regressions to construct a Characteristic Adjusted Performance distribution of performance to guide the selection of targets. The paper then presents two concrete examples of applications of this approach related to the setting of targets on School Test Scores and Improvement in Homicide rates in Police Districts in the State of Minas Gerais, Brazil.
Link to Data Set
Citation
“Newman, John L.; Azevedo, João Pedro. 2013. Setting Reasonable Performance Targets for Public Service Delivery. Policy Research Working Paper;No. 6385. © World Bank. http://hdl.handle.net/10986/13178 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication The Lasting Effects of Working while in School(Washington, DC: World Bank, 2025-08-18)This paper provides the first experimental evidence on the long-term effects of work-study programs, leveraging a randomized lottery design from a national program in Uruguay. Participation leads to a persistent 11 percent increase in formal labor earnings, observable seven years after the program. Effects are stronger for youth who participate during pivotal educational transitions and are larger for vulnerable youth and men, while remaining positive for women and non-vulnerable youth. The program is highly cost-effective, with average impacts exceeding those of job training programs and comparable to early childhood investments.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Efficient Learning for the Poor : Insights from the Frontier of Cognitive Neuroscience(Washington, DC : World Bank, 2006)This book integrates research into applications that extend from preschool brain development to the memory of adult educators. In layman's terms, it provides explanations and answers to questions such as: Why do children have to read fast before they can understand what they read? How do health, nutrition, and stimulation influence brain development? Why should students learn basic skills in their maternal language? Is there such a thing as an untrained teacher? What signs in a classroom show whether students are getting a quality education? How must information be presented in class so that students can retain it and use it? What training techniques are most likely to help staff put their learning into use? This book is intended for use by policymakers, donor agency staff, teacher trainers, supervisors, and inspectors, as well as university professors and students.Publication Uganda - Developing the Enabling Context for Student Assessment(World Bank, Washington, DC, 2013-01)Uganda's commitment to improving the quality and outcomes of its education system has translated into a parallel commitment to creating stronger, more sustainable student assessment system, one that includes: (i) examinations for selection and certification; (ii) large scale assessments for monitoring education quality at the country level; and (iii) classroom assessments for evaluating student work and informing ongoing teaching and learning. A number of lessons can be learned from Uganda's experience. First, political stability and a strong commitment to education are key drivers for building a strong assessment system. Second, charging a single institution with all assessment activities can allow for clearer institutional structures, as well as efficient coordination, development, and implementation of assessment programs. Third, competitive salaries need to be in place to attract and retain personnel, and training needs to be provided for capacity building. Finally, a strong focus on student learning and curriculum reforms can act as important catalyst for strengthening the assessment systemPublication How Much Teachers Know and How Much It Matters in Class(World Bank, Washington, DC, 2016-02)Improving the quality of education is one of today's main challenges for governments in the developing world. Based on a unique matched student-to-teacher panel data set on test scores this paper presents two empirical results for Indonesia. First, through detailed inspection of teacher-level responses to test questions, the paper concludes that subject matter knowledge of primary school teachers in Indonesia is low on average and that a 1.0, but also a 2.0 standard deviation increase in teachers' subject matter knowledge seem to be achievable medium-term goals for education policy making in Indonesia. Second, the paper presents the results of three types of value-added regressions, a (standard) level specification, a school fixed-effects specification, and a flexible student-teacher fixed-effects specification. The student-teacher fixed-effects approach estimates the parameters of a value-added model using test score variation within each student-teacher pair across three different subjects, mathematics, science and Indonesian language. The results suggest that a 1.0 (and 2.0) standard deviation increase in teachers' subject matter knowledge across-the-board can yield increases in student achievement by 0.25 (and 0.50) student-level standard deviations by the time students complete the six-year primary school cycle.Publication Uganda Student Assessment : SABER Country Report 2012(Washington, DC, 2012)In 2012, Uganda joined the Russia Education Aid for Development (READ) trust fund program, the goal of which is to help countries improve their capacity to design, carry out, analyze, and use assessments for improved student learning. As part of the READ trust fund program, and in order to gain a better understanding of the strengths and weaknesses of its existing assessment system, Tajikistan participated in a formal exercise to benchmark its student assessment system under The World Bank's Systems Approach for Better Education Results (SABER) program. SABER is an evidence-based program to help countries systematically examine and strengthen the performance of different aspects of their education systems. SABER-student assessment is a component of the SABER program that focuses specifically on benchmarking student assessment policies and systems. The goal of SABER-student assessment is to promote stronger assessment systems that contribute to improved education quality and learning for all. The importance of assessment is linked to its role in: providing information on levels of student learning and achievement in the system; monitoring trends in education quality over time; supporting educators and students with real-time information to improve teaching and learning; and holding stakeholders accountable for results. The SABER-student assessment framework is built on the available evidence base for what an effective assessment system looks like. The framework provides guidance on how countries can build more effective student assessment systems. The framework is structured around two main dimensions of assessment systems: the types/purposes of assessment activities and the quality of those activities. Assessment systems tend to be comprised of three main types of assessment activities, each of which serves a different purpose and addresses different information needs. These three main types are: classroom assessment, examinations, and large scale, system level assessments. This report focuses specifically on policies in the area of student assessment.Publication Botswana : Skills for Competitiveness and Economic Growth(Washington, DC, 2014)Botswana has pursued prudent macroeconomic policies to manage the revenue streams from diamond exports. It is now an upper-middle-income country that outperforms other countries in Sub-Saharan Africa on key indicators of socioeconomic performance including education, health, and social services. The economic structure in Botswana has undergone changes in recent years, but these changes have not yet ended the countryapos;s reliance on diamond exports. Until recently, Botswana also had a telecommunications monopoly; other utilities are not always accessible at competitive terms. Looking at the lessons offered by successful economies that have grown rapidly in a short period of time, such as those in East Asia, it is clear that export-led industrialization policies contributed to their growth. These policies involve the state taking the lead in crafting and managing market institutions, building physical infrastructure to support industrialization, and minimizing coordination failure within the various segments of the economy. A well-educated and trained population with a wide spectrum of skills also played a vital supporting role in this growth in East Asia. This population had a sufficient skills base to absorb and assimilate technology (via foreign direct investment), operate equipment and infrastructure, and create effective organizations. The country faces significant challenges in transforming its human resources into a force that can drive total factor productivity improvements and, consequently, economic growth.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.