Publication: Looking into the Performance-Based Financing Black Box: Evidence from an Impact Evaluation in the Health Sector in Cameroon
Loading...
Published
2017-08
ISSN
Date
2017-08-24
Author(s)
Editor(s)
Abstract
Performance-based financing is a complex health system intervention aimed at improving coverage and quality of care. This paper presents the results of an impact evaluation in Cameroon that seeks to isolate the role of specific components of the performance-based financing approach on outcomes of interest, such as explicit financial incentives linked to results, additional resources available at the point of service delivery (not linked to performance), and enhanced supervision, coaching, and monitoring. Four evaluation groups were established to measure the effects of each component that was studied. In general, the results indicate that performance-based financing in Cameroon is an efficient mechanism to channel payments and funding to the provider level, leading to significant increases in utilization in the performance-based financing arm for several services (child and maternal vaccinations and use of modern family planning), but not for others, such as antenatal care visits and facility-based deliveries. However, for many of those outcomes, the differences between the performance-based financing group and the additional financing group are not significant. In terms of quality, performance-based financing was found to have a significant impact on the availability of essential inputs and equipment, qualified health workers, reduction in formal and informal user fees, and increased satisfaction among patients and providers. However, there was a clear effect of additional financing, irrespective of whether it was linked to incentives, in combination with reinforced supervision through performance-based financing. This result suggests that enhanced supervision and monitoring on their own are not sufficient to improve maternal and child health outcomes.
Link to Data Set
Citation
“Robyn, Paul Jacob; de Walque, Damien; Saidou, Hamadou; Sorgho, Gaston; Steenland, Maria. 2017. Looking into the Performance-Based Financing Black Box: Evidence from an Impact Evaluation in the Health Sector in Cameroon. Policy Research Working Paper;No. 8162. © World Bank. http://hdl.handle.net/10986/27969 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication The Lasting Effects of Working while in School(Washington, DC: World Bank, 2025-08-18)This paper provides the first experimental evidence on the long-term effects of work-study programs, leveraging a randomized lottery design from a national program in Uruguay. Participation leads to a persistent 11 percent increase in formal labor earnings, observable seven years after the program. Effects are stronger for youth who participate during pivotal educational transitions and are larger for vulnerable youth and men, while remaining positive for women and non-vulnerable youth. The program is highly cost-effective, with average impacts exceeding those of job training programs and comparable to early childhood investments.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Looking into the performance-based financing black box(Oxford University Press, 2021-07)Performance-based financing (PBF) is a complex health systems intervention aimed at improving the coverage and quality of care. Several studies have shown a positive impact of PBF on health service coverage, often coupled with improvements in quality, but relatively little is known about the mechanisms driving those results. This article presents results of a randomized impact evaluation in Cameroon designed to isolate the role of specific components of the PBF approach with four study groups: (i) PBF with explicit financial incentives linked to results, (ii) direct financing with additional resources available for health providers not linked to performance, (iii) enhanced supervision and monitoring without additional resources and (iv) a control group. Overall, results indicate that, when compared with the pure control group, PBF in Cameroon led to significant increases in utilization for several services (child and maternal vaccinations, use of modern family planning), but not for others like antenatal care visits and facility-based deliveries. In terms of quality, PBF increased the availability of inputs and equipment, qualified health workers, led to a reduction in formal and informal user fees but did not affect the content of care. However, for many positively impacted outcomes, the differences between the PBF group and the group receiving additional financing not linked to performance are not significant, suggesting that additional funding rather than the explicit incentives might be driving improvements. In contrast, the intervention group offering enhanced supervision, coaching and monitoring without additional funding did not experience significant impacts compared to the control group.Publication Performance-Based Financing to Increase Utilization of Maternal Health Services(Elsevier, 2017-12)Performance-based financing (PBF) programs are increasingly implemented in low and middle-income countries to improve health service quality and utilization. In April 2011, a PBF pilot program was launched in Boulsa, Leo and Titao districts in Burkina Faso with the objective of increasing the provision and quality of maternal health services. We evaluate the impact of this program using facility-level administrative data from the national health management information system (HMIS). Primary outcomes were the number of antenatal care visits, the proportion of antenatal care visits that occurred during the first trimester of pregnancy, the number of institutional deliveries and the number of postnatal care visits. To assess program impact we use a difference-in-differences approach, comparing changes in health service provision post-introduction with changes in matched comparison areas. All models were estimated using ordinary least squares (OLS) regression models with standard errors clustered at the facility level. On average, PBF facilities had 2.3 more antenatal care visits (95% CI [0.446–4.225]), 2.1 more deliveries (95% CI [0.034–4.069]) and 9.5 more postnatal care visits (95% CI [6.099, 12.903]) each month after the introduction of PBF. Compared to the service provision levels prior to the interventions, this implies a relative increase of 27.7 percent for ANC, of 9.2 percent for deliveries, and of 118.7 percent for postnatal care. Given the positive results observed during the pre-pilot period and the limited resources available in the health sector, the PBF program in Burkina Faso may be a low-cost, high impact intervention to improve maternal and child health.Publication Performance-Based Financing as a Health System Reform(BioMed Central, 2013-09-29)Performance-based financing is increasingly being applied in a variety of contexts, with the expectation that it can improve the performance of health systems. However, while there is a growing literature on implementation issues and effects on outputs, there has been relatively little focus on interactions between PBF and health systems and how these should be studied. This paper aims to contribute to filling that gap by developing a framework for assessing the interactions between PBF and health systems, focusing on low and middle income countries. In doing so, it elaborates a general framework for monitoring and evaluating health system reforms in general.Publication Performance-Based Financing Toolkit(Washington, DC: World Bank, 2014-02-26)Performance-based financing (PBF) approaches have expanded rapidly in lower-and middle income countries, and especially in Africa. The number of countries has grown from three in 2006 to 32 in 2013. PBF schemes are flourishing and cause considerable demand for technical assistance in executing these health reforms in a rational and accountable manner. Currently there is a lack of knowledge among many health reformers of how to implement performance-based financing pilot projects, and scale them up intelligently. In a context of tremendous demand for solid design and implementation experience and given the rapid expansion of results-based financing (RBF) programs, there is an urgent need to build capacity in designing and implementing PBF programs. As yet there has been little attempt to gather the learning from these experiences together in one volume and, moreover, in a form that serves as a guide to implementers. This toolkit answers the most pressing issues related to the supply-side RBF programs of which PBF forms part.Publication Impacts of Performance‑Based Financing on Health System Performance(BMC Medicine, 2023-10-10)Health systems’ weakness remains one of the primary obstacles towards achieving universal access to quality healthcare in low-income settings. Performance-based financing (PBF) programs have been increasingly used to increase access to quality care in LMICs. However, evidence on the impacts of these programs remains fragmented and inconclusive. We analyze the health system impacts of the PBF program in the Democratic Republic of the Congo (DRC), one of the largest such programs introduced in LMICs to date. We used a health systems perspective to analyze the benefits of PBF relative to unconditional financing of health facilities. Fifty-eight health zones in six provinces were randomly assigned to either a control group (28 zones) in which facilities received unconditional transfers or to a PBF program (30 zones) that started at the end of 2016. Follow-up data collection took place in 2021–2022 and included health facility assessments, health worker interviews, direct observations of consultations and deliveries, patient exit interviews, and household surveys. Using multivariate regression models, we estimated the impact of the program on 55 outcomes in seven health system domains: structural quality, technical process quality, non-technical process quality, service fees, facility management, providers’ satisfaction, and service coverage. We used random-effects meta-analysis to generate pooled average estimates within each domain. The PBF program improved the structural quality of health facilities by 4 percentage points (ppts) (95% CI 0.01–0.08), technical process quality by 5 ppts (0.03–0.07), and non-technical process by 2 ppts (0–0.04). PBF also increased coverage of priority health services by 3 ppts (0.02–0.04). Improvements were also observed for facility management (9 ppts, 0.04–0.15), service fee policies, and users’ satisfaction with service affordability (14 ppts, 0.07–0.20). Service fees and health workers’ satisfaction were not affected by the program. The results suggest that well-designed PBF programs can lead to improvements in most health systems domains relative to comparable unconditional financing. However, the large persisting gaps suggest that additional changes, such as allocating more resources to the health system and reforming the human resources for health management, will be necessary in DRC to achieve the ambitious global universal health coverage and mortality goals.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners(Washington, DC: World Bank, 2004)An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.Publication Pakistan at 100(World Bank, Washington, DC, 2019-03)This policy note was prepared in parallel to the report Pakistan at 100 - Shaping the Future. The report Pakistan at 100 discusses options to accelerate and sustain growth in Pakistan so that the country becomes an upper middle-income country when it turns hundred years old in 2047. This policy note discusses Pakistan’s slow transformation and the need to reallocate resources to the most productive uses.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.