Publication:
Making Services Work : Indicators, Assessments, and Benchmarking of the Quality and Governance of Public Service Delivery in the Human Development Sectors

Loading...
Thumbnail Image
Files in English
English PDF (885.97 KB)
957 downloads
English Text (72.68 KB)
98 downloads
Date
2011-06-01
ISSN
Published
2011-06-01
Author(s)
Ringold, Dena
Rogers, F. Halsey
Editor(s)
Abstract
Improving governance is central to improving results in human development. It is clear that money is not enough: improved outcomes from service delivery require better governance, including mechanisms for holding service providers accountable and appropriate incentives for performance. There is therefore a growing demand for indicators to measure how and whether these processes work, and how they affect health and education results. This paper makes the case for measuring governance policies and performance, and the quality of service delivery in health and education. It develops a framework for selecting and measuring a set of indicators and proposes options, drawing from new and innovative measurement tools and approaches. The paper proposes the adoption of a more systematic approach that will both facilitate the work of health and education policymakers and allow for cross-country comparisons and benchmarking.
Link to Data Set
Citation
Ringold, Dena; Fiszbein, Ariel; Rogers, F. Halsey. 2011. Making Services Work : Indicators, Assessments, and Benchmarking of the Quality and Governance of Public Service Delivery in the Human Development Sectors. Policy Research working paper ; no. WPS 5690. © World Bank. http://hdl.handle.net/10986/3454 License: CC BY 3.0 IGO.
Associated URLs
Associated content
Report Series
Report Series
Other publications in this report series
  • Publication
    The Future of Poverty
    (Washington, DC: World Bank, 2025-07-15) Fajardo-Gonzalez, Johanna; Nguyen, Minh C.; Corral, Paul
    Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.
  • Publication
    Exports, Labor Markets, and the Environment
    (Washington, DC: World Bank, 2025-07-14) Góes, Carlos; Conceição, Otavio; Lara Ibarra, Gabriel; Lopez-Acevedo, Gladys
    What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.
  • Publication
    The Macroeconomic Implications of Climate Change Impacts and Adaptation Options
    (Washington, DC: World Bank, 2025-05-29) Abalo, Kodzovi; Boehlert, Brent; Bui, Thanh; Burns, Andrew; Castillo, Diego; Chewpreecha, Unnada; Haider, Alexander; Hallegatte, Stephane; Jooste, Charl; McIsaac, Florent; Ruberl, Heather; Smet, Kim; Strzepek, Ken
    Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.
  • Publication
    The Asymmetric Bank Distress Amplifier of Recessions
    (Washington, DC: World Bank, 2025-07-11) Kim, Dohan
    One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.
  • Publication
    Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers
    (Washington, DC: World Bank, 2025-07-14) Miranda, Juan José; Contreras, Cesar
    This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue

Related items

Showing items related by metadata.

  • Publication
    Bangladesh Governance in the Health Sector
    (World Bank, Dhaka, 2014-09) Rose, Jonathan; Lane, Tracey M.; Rahman, Tashmina
    The purpose of this systematic review is to inform the World Bank, development partners and other stakeholders on the state of governance in the health sector of Bangladesh. With billions2 of Bangladeshi Taka invested in the government-run health sector every year, financed by domestic and international sources, there have been numerous efforts to better understand the governance challenges in the sector. This report reviews sixty such reports and studies written by NGOs, academics, government entities, research institutions, consultants and development partners, in the last fourteen years. However, translating that research into policy dialogue and improvement has been challenged due to poor knowledge management, a lack of a systematic approach to research (building on earlier studies findings), and limited efforts to place the work in the public domain and discourse. This paper takes a systematic approach to the literature review, bringing the key findings together and evaluating the weight of evidence on the governance problems in the sector, as well as the gaps that should be addressed by future research efforts. This review furthermore emphasizes the need to understand the factors, and political economy factors in particular, that explain the current state of affairs. The review is structured to systematically assess this literature, leading to several broad conclusions. First, it identifies the structure and method of the review and outlines the categorization of the governance issues reviewed, and provides a background to the health sector. It then methodically summarizes the relevant literature for each governance issue, highlighting the lessons and identifying the gaps and weaknesses. The review ends by highlighting these gaps in research, with a view to improve its scope and impact.
  • Publication
    Governance in Health Care Delivery : Raising Performance
    (2009-10-01) Lewis, Maureen; Pettersson, Gunilla
    The impacts of health care investments in developing and transition countries are typically measured by inputs and general health outcomes. Missing from the health agenda are measures of performance that reflect whether health systems are meeting their objectives; public resources are being used appropriately; and the priorities of governments are being implemented. This paper suggests that good governance is central to raising performance in health care delivery. Crucial to high performance are standards, information, incentives and accountability. This paper provides a definition of good governance in health and a framework for thinking about governance issues as a way of improving performance in the health sector. Performance indicators that offer the potential for tracking relative health performance are proposed, and provide the context for the discussion of good governance in health service delivery in the areas of budget and resource management, individual provider performance, health facility performance, informal payments, and corruption perceptions. What we do and do not know about effective solutions to advance good governance and performance in health is presented for each area, drawing on existing research and documented experiences.
  • Publication
    PETS-QSDS in Sub-Saharan Africa
    (World Bank, Washington, DC, 2010-07) Gauthier, Bernard
    This study examines Public Expenditure Tracking Survey (PETS) and Quantitative Service Delivery Survey (QSDS) carried out in Africa with the objective of assessing their approaches, main findings, and contributions. Section 2 investigates the context, motivations, and objectives of PETS and QSDS that have been carried out in Sub-Saharan Africa. Section 3 examines the institutional arrangements for resource allocation and service delivery in social sectors. Section 4 presents some of the main findings of tracking surveys. Section 5 analyzes methodological approaches used in previous tracking surveys in order to identify factors that could explain the difference in past surveys' success, and identify potential methodological harmonization. Section 6 presents a series of good practice principles that arise from past experience, and discusses how they could be implemented. Section 7 proposes potential future surveys and endeavors.
  • Publication
    Critical Administrative Constraints to Service Delivery : Improving Public Services in Afghanistan's Transformational Decade
    (Washington, DC, 2014-05) World Bank
    Since 2001, the Afghan population's access to basic services has greatly improved in nearly all sectors. School enrolment has increased sharply, with over eight million children currently enrolled in school, of which 39 percent are girls. Current strategies for improving sub-national service delivery focus on delegating greater authority to provincial and district administrations. This report aims to identify administrative constraints in three key sectors of public service delivery, education, health and agricultural extension services. The analysis follows the service delivery chain, from central to provincial, through district to community level, and is particularly concerned to examine service delivery in these three sectors through the window of sub-national governance and its relations to the service delivery mandates of line ministries. The study provides the Government of Afghanistan with recommendations on how to alleviate critical constraints to service delivery at sub-national levels on a sustainable basis, in the context of an expected restrained fiscal future. The report's main findings are based on qualitative research. The key findings are based on existing literature and reports as well as field visits to 5 provinces and 10 districts and qualitative analyses of over 171 key-informant interviews on different levels of service delivery administration, 68 in-depth interviews with community leaders, and a community household survey in 20 communities spread over 5 provinces and 55 service facilities (for example, schools and clinics) were assessed. The report is split into six sections: section one gives executive summary; section two provides a brief introduction to the study objectives and clarifies some key definitions; section three outlines the methods used to perform the analysis; sections four, five, and six provide in-depth discussions of education, health, and agriculture extension respectively; and section seven provides recommendations and concludes. The over-arching governance structures and further methodological details are given in appendix one. All references and research tools are presented in annexes.
  • Publication
    Using Public Expenditure Tracking Surveys to Monitor Projects and Small-Scale Programs : A Guidebook
    (World Bank, 2010) Koziol, Margaret; Tolmie, Courtney
    The goal of this guidebook is to serve as a starting point for civil society organizations, as well as Bank teams interested in conducting Public Expenditure Tracking Surveys, both on a small and larger scale. It is designed to lead a research team from idea inception to results dissemination, while emphasizing the importance of utilizing evidence to influence policy, regardless of whether it is on a macro or micro-level. Though the World Bank has been at the forefront of efforts to measure the effectiveness of service delivery, it is hoped that Bank teams and civil society alike will take the research one step further and empower citizen users to keep service providers accountable through information dissemination and citizen engagement efforts.

Users also downloaded

Showing related downloaded files

  • Publication
    Government Matters III : Governance Indicators for 1996-2002
    (World Bank, Washington, DC, 2003-08) Kaufmann, Daniel; Kraay, Aart; Mastruzzi, Massimo
    The authors present estimates of six dimensions of governance covering 199 countries and territories for four time periods: 1996, 1998, 2000, and 2002. These indicators are based on several hundred individual variables measuring perceptions of governance, drawn from 25 separate data sources constructed by 18 different organizations. The authors assign these individual measures of governance to categories capturing key dimensions of governance and use an unobserved components model to construct six aggregate governance indicators in each of the four periods. They present the point estimates of the dimensions of governance as well as the margins of errors for each country for the four periods. The governance indicators reported here are an update and expansion of previous research work on indicators initiated in 1998 (Kaufmann, Kraay, and Zoido-Lobat 1999a,b and 2002). The authors also address various methodological issues, including the interpretation and use of the data given the estimated margins of errors.
  • Publication
    Governance Matters VIII : Aggregate and Individual Governance Indicators 1996–2008
    (2009-06-01) Kaufmann, Daniel; Kraay, Aart; Mastruzzi, Massimo
    This paper reports on the 2009 update of the Worldwide Governance Indicators (WGI) research project, covering 212 countries and territories and measuring six dimensions of governance between 1996 and 2008: Voice and Accountability, Political Stability and Absence of Violence/Terrorism, Government Effectiveness, Regulatory Quality, Rule of Law, and Control of Corruption. These aggregate indicators are based on hundreds of specific and disaggregated individual variables measuring various dimensions of governance, taken from 35 data sources provided by 33 different organizations. The data reflect the views on governance of public sector, private sector and NGO experts, as well as thousands of citizen and firm survey respondents worldwide. The authors also explicitly report the margins of error accompanying each country estimate. These reflect the inherent difficulties in measuring governance using any kind of data. They find that even after taking margins of error into account, the WGI permit meaningful cross-country comparisons as well as monitoring progress over time. The aggregate indicators, together with the disaggregated underlying indicators, are available at www.govindicators.org.
  • Publication
    Breaking the Conflict Trap : Civil War and Development Policy
    (Washington, DC: World Bank and Oxford University Press, 2003) Collier, Paul; Elliott, V. L.; Hegre, Håvard; Hoeffler, Anke; Reynal-Querol, Marta; Sambanis, Nicholas
    Most wars are now civil wars. Even though international wars attract enormous global attention, they have become infrequent and brief. Civil wars usually attract less attention, but they have become increasingly common and typically go on for years. This report argues that civil war is now an important issue for development. War retards development, but conversely, development retards war. This double causation gives rise to virtuous and vicious circles. Where development succeeds, countries become progressively safer from violent conflict, making subsequent development easier. Where development fails, countries are at high risk of becoming caught in a conflict trap in which war wrecks the economy and increases the risk of further war. The global incidence of civil war is high because the international community has done little to avert it. Inertia is rooted in two beliefs: that we can safely 'let them fight it out among themselves' and that 'nothing can be done' because civil war is driven by ancestral ethnic and religious hatreds. The purpose of this report is to challenge these beliefs.
  • Publication
    Design Thinking for Social Innovation
    (2010-07) Brown, Tim; Wyatt, Jocelyn
    Designers have traditionally focused on enchancing the look and functionality of products.
  • Publication
    Governance Matters IV : Governance Indicators for 1996-2004
    (World Bank, Washington, DC, 2005-06) Kaufmann, Daniel; Kraay, Aart; Mastruzzi, Massimo
    The authors present the latest update of their aggregate governance indicators, together with new analysis of several issues related to the use of these measures. The governance indicators measure the following six dimensions of governance: (1) voice and accountability; (2) political instability and violence; (3) government effectiveness; (4) regulatory quality; (5) rule of law, and (6) control of corruption. They cover 209 countries and territories for 1996, 1998, 2000, 2002, and 2004. They are based on several hundred individual variables measuring perceptions of governance, drawn from 37 separate data sources constructed by 31 organizations. The authors present estimates of the six dimensions of governance for each period, as well as margins of error capturing the range of likely values for each country. These margins of error are not unique to perceptions-based measures of governance, but are an important feature of all efforts to measure governance, including objective indicators. In fact, the authors give examples of how individual objective measures provide an incomplete picture of even the quite particular dimensions of governance that they are intended to measure. The authors also analyze in detail changes over time in their estimates of governance; provide a framework for assessing the statistical significance of changes in governance; and suggest a simple rule of thumb for identifying statistically significant changes in country governance over time. The ability to identify significant changes in governance over time is much higher for aggregate indicators than for any individual indicator. While the authors find that the quality of governance in a number of countries has changed significantly (in both directions), they also provide evidence suggesting that there are no trends, for better or worse, in global averages of governance. Finally, they interpret the strong observed correlation between income and governance, and argue against recent efforts to apply a discount to governance performance in low-income countries.