Publication:
Looking into the Performance-Based Financing Black Box: Evidence from an Impact Evaluation in the Health Sector in Cameroon

Loading...
Thumbnail Image
Files in English
English PDF (2.48 MB)
3,048 downloads
English Text (239.87 KB)
35 downloads
Date
2017-08
ISSN
Published
2017-08
Author(s)
Robyn, Paul Jacob
Saidou, Hamadou
Sorgho, Gaston
Steenland, Maria
Editor(s)
Abstract
Performance-based financing is a complex health system intervention aimed at improving coverage and quality of care. This paper presents the results of an impact evaluation in Cameroon that seeks to isolate the role of specific components of the performance-based financing approach on outcomes of interest, such as explicit financial incentives linked to results, additional resources available at the point of service delivery (not linked to performance), and enhanced supervision, coaching, and monitoring. Four evaluation groups were established to measure the effects of each component that was studied. In general, the results indicate that performance-based financing in Cameroon is an efficient mechanism to channel payments and funding to the provider level, leading to significant increases in utilization in the performance-based financing arm for several services (child and maternal vaccinations and use of modern family planning), but not for others, such as antenatal care visits and facility-based deliveries. However, for many of those outcomes, the differences between the performance-based financing group and the additional financing group are not significant. In terms of quality, performance-based financing was found to have a significant impact on the availability of essential inputs and equipment, qualified health workers, reduction in formal and informal user fees, and increased satisfaction among patients and providers. However, there was a clear effect of additional financing, irrespective of whether it was linked to incentives, in combination with reinforced supervision through performance-based financing. This result suggests that enhanced supervision and monitoring on their own are not sufficient to improve maternal and child health outcomes.
Link to Data Set
Citation
Robyn, Paul Jacob; de Walque, Damien; Saidou, Hamadou; Sorgho, Gaston; Steenland, Maria. 2017. Looking into the Performance-Based Financing Black Box: Evidence from an Impact Evaluation in the Health Sector in Cameroon. Policy Research Working Paper;No. 8162. © World Bank. http://hdl.handle.net/10986/27969 License: CC BY 3.0 IGO.
Associated URLs
Associated content
Report Series
Report Series
Other publications in this report series
  • Publication
    Geopolitics and the World Trading System
    (Washington, DC: World Bank, 2024-12-23) Mattoo, Aaditya; Ruta, Michele; Staiger, Robert W.
    Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.
  • Publication
    The Macroeconomic Implications of Climate Change Impacts and Adaptation Options
    (Washington, DC: World Bank, 2025-05-29) Abalo, Kodzovi; Boehlert, Brent; Bui, Thanh; Burns, Andrew; Castillo, Diego; Chewpreecha, Unnada; Haider, Alexander; Hallegatte, Stephane; Jooste, Charl; McIsaac, Florent; Ruberl, Heather; Smet, Kim; Strzepek, Ken
    Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.
  • Publication
    Global Poverty Revisited Using 2021 PPPs and New Data on Consumption
    (Washington, DC: World Bank, 2025-06-05) Foster, Elizabeth; Jolliffe, Dean Mitchell; Ibarra, Gabriel Lara; Lakner, Christoph; Tettah-Baah, Samuel
    Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
  • Publication
    Global Socio-economic Resilience to Natural Disasters
    (Washington, DC: World Bank, 2025-05-22) Middelanis, Robin; Jafino, Bramka Arga; Hill, Ruth; Nguyen, Minh Cong; Hallegatte, Stephane
    Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.
  • Publication
    From Patriarchy to Policy
    (Washington, DC: World Bank, 2025-05-29) Bussolo, Maurizio; Rexer, Jonah M.; Hu, Lynn
    Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue

Related items

Showing items related by metadata.

  • Publication
    Looking into the performance-based financing black box
    (Oxford University Press, 2021-07) Robyn, Paul Jacob; de Walque, Damien; Saidou, Hamadou; Sorgho, Gaston; Steenland, Maria
    Performance-based financing (PBF) is a complex health systems intervention aimed at improving the coverage and quality of care. Several studies have shown a positive impact of PBF on health service coverage, often coupled with improvements in quality, but relatively little is known about the mechanisms driving those results. This article presents results of a randomized impact evaluation in Cameroon designed to isolate the role of specific components of the PBF approach with four study groups: (i) PBF with explicit financial incentives linked to results, (ii) direct financing with additional resources available for health providers not linked to performance, (iii) enhanced supervision and monitoring without additional resources and (iv) a control group. Overall, results indicate that, when compared with the pure control group, PBF in Cameroon led to significant increases in utilization for several services (child and maternal vaccinations, use of modern family planning), but not for others like antenatal care visits and facility-based deliveries. In terms of quality, PBF increased the availability of inputs and equipment, qualified health workers, led to a reduction in formal and informal user fees but did not affect the content of care. However, for many positively impacted outcomes, the differences between the PBF group and the group receiving additional financing not linked to performance are not significant, suggesting that additional funding rather than the explicit incentives might be driving improvements. In contrast, the intervention group offering enhanced supervision, coaching and monitoring without additional funding did not experience significant impacts compared to the control group.
  • Publication
    Performance-Based Financing to Increase Utilization of Maternal Health Services
    (Elsevier, 2017-12) Steenland, Maria; Robyn, Paul Jacob; Compaore, Philippe; Kabore, Moussa; Tapsoba, Boukary; Zongo, Aloys; Haidara, Ousmane Diadie; Fink, Gunther
    Performance-based financing (PBF) programs are increasingly implemented in low and middle-income countries to improve health service quality and utilization. In April 2011, a PBF pilot program was launched in Boulsa, Leo and Titao districts in Burkina Faso with the objective of increasing the provision and quality of maternal health services. We evaluate the impact of this program using facility-level administrative data from the national health management information system (HMIS). Primary outcomes were the number of antenatal care visits, the proportion of antenatal care visits that occurred during the first trimester of pregnancy, the number of institutional deliveries and the number of postnatal care visits. To assess program impact we use a difference-in-differences approach, comparing changes in health service provision post-introduction with changes in matched comparison areas. All models were estimated using ordinary least squares (OLS) regression models with standard errors clustered at the facility level. On average, PBF facilities had 2.3 more antenatal care visits (95% CI [0.446–4.225]), 2.1 more deliveries (95% CI [0.034–4.069]) and 9.5 more postnatal care visits (95% CI [6.099, 12.903]) each month after the introduction of PBF. Compared to the service provision levels prior to the interventions, this implies a relative increase of 27.7 percent for ANC, of 9.2 percent for deliveries, and of 118.7 percent for postnatal care. Given the positive results observed during the pre-pilot period and the limited resources available in the health sector, the PBF program in Burkina Faso may be a low-cost, high impact intervention to improve maternal and child health.
  • Publication
    Performance-Based Financing as a Health System Reform
    (BioMed Central, 2013-09-29) Witter, Sophie; Toonen, Jurrien; Meessen, Bruno; Kagubare, Jean; Fritsche, György; Vaughan, Kelsey
    Performance-based financing is increasingly being applied in a variety of contexts, with the expectation that it can improve the performance of health systems. However, while there is a growing literature on implementation issues and effects on outputs, there has been relatively little focus on interactions between PBF and health systems and how these should be studied. This paper aims to contribute to filling that gap by developing a framework for assessing the interactions between PBF and health systems, focusing on low and middle income countries. In doing so, it elaborates a general framework for monitoring and evaluating health system reforms in general.
  • Publication
    Performance-Based Financing Toolkit
    (Washington, DC: World Bank, 2014-02-26) Fritsche, György Bèla; Soeters, Robert; Meessen, Bruno; Ndizeye, Cedric; Bredenkamp, Caryn; van Heteren, Godelieve
    Performance-based financing (PBF) approaches have expanded rapidly in lower-and middle income countries, and especially in Africa. The number of countries has grown from three in 2006 to 32 in 2013. PBF schemes are flourishing and cause considerable demand for technical assistance in executing these health reforms in a rational and accountable manner. Currently there is a lack of knowledge among many health reformers of how to implement performance-based financing pilot projects, and scale them up intelligently. In a context of tremendous demand for solid design and implementation experience and given the rapid expansion of results-based financing (RBF) programs, there is an urgent need to build capacity in designing and implementing PBF programs. As yet there has been little attempt to gather the learning from these experiences together in one volume and, moreover, in a form that serves as a guide to implementers. This toolkit answers the most pressing issues related to the supply-side RBF programs of which PBF forms part.
  • Publication
    Impacts of Performance‑Based Financing on Health System Performance
    (BMC Medicine, 2023-10-10) Shapira, Gil; Booto, Baudouin Makuma; Samaha, Hadia; Fritsche, György Bèla; Muvudi, Michel; Baabo, Dominique; Antwisi, Delphin; Ramanana, Didier; Benami, Saloua; Fink, Günther
    Health systems’ weakness remains one of the primary obstacles towards achieving universal access to quality healthcare in low-income settings. Performance-based financing (PBF) programs have been increasingly used to increase access to quality care in LMICs. However, evidence on the impacts of these programs remains fragmented and inconclusive. We analyze the health system impacts of the PBF program in the Democratic Republic of the Congo (DRC), one of the largest such programs introduced in LMICs to date. We used a health systems perspective to analyze the benefits of PBF relative to unconditional financing of health facilities. Fifty-eight health zones in six provinces were randomly assigned to either a control group (28 zones) in which facilities received unconditional transfers or to a PBF program (30 zones) that started at the end of 2016. Follow-up data collection took place in 2021–2022 and included health facility assessments, health worker interviews, direct observations of consultations and deliveries, patient exit interviews, and household surveys. Using multivariate regression models, we estimated the impact of the program on 55 outcomes in seven health system domains: structural quality, technical process quality, non-technical process quality, service fees, facility management, providers’ satisfaction, and service coverage. We used random-effects meta-analysis to generate pooled average estimates within each domain. The PBF program improved the structural quality of health facilities by 4 percentage points (ppts) (95% CI 0.01–0.08), technical process quality by 5 ppts (0.03–0.07), and non-technical process by 2 ppts (0–0.04). PBF also increased coverage of priority health services by 3 ppts (0.02–0.04). Improvements were also observed for facility management (9 ppts, 0.04–0.15), service fee policies, and users’ satisfaction with service affordability (14 ppts, 0.07–0.20). Service fees and health workers’ satisfaction were not affected by the program. The results suggest that well-designed PBF programs can lead to improvements in most health systems domains relative to comparable unconditional financing. However, the large persisting gaps suggest that additional changes, such as allocating more resources to the health system and reforming the human resources for health management, will be necessary in DRC to achieve the ambitious global universal health coverage and mortality goals.

Users also downloaded

Showing related downloaded files

  • Publication
    World Development Report 2019
    (Washington, DC: World Bank, 2019) World Bank
    Work is constantly reshaped by technological progress. New ways of production are adopted, markets expand, and societies evolve. But some changes provoke more attention than others, in part due to the vast uncertainty involved in making predictions about the future. The 2019 World Development Report will study how the nature of work is changing as a result of advances in technology today. Technological progress disrupts existing systems. A new social contract is needed to smooth the transition and guard against rising inequality. Significant investments in human capital throughout a person’s lifecycle are vital to this effort. If workers are to stay competitive against machines they need to train or retool existing skills. A social protection system that includes a minimum basic level of protection for workers and citizens can complement new forms of employment. Improved private sector policies to encourage startup activity and competition can help countries compete in the digital age. Governments also need to ensure that firms pay their fair share of taxes, in part to fund this new social contract. The 2019 World Development Report presents an analysis of these issues based upon the available evidence.
  • Publication
    Supporting Youth at Risk
    (World Bank, Washington, DC, 2008) Cohan, Lorena M.; Cunningham, Wendy; Naudeau, Sophie; McGinnis, Linda
    The World Bank has produced this policy Toolkit in response to a growing demand from our government clients and partners for advice on how to create and implement effective policies for at-risk youth. The author has highlighted 22 policies (six core policies, nine promising policies, and seven general policies) that have been effective in addressing the following five key risk areas for young people around the world: (i) youth unemployment, underemployment, and lack of formal sector employment; (ii) early school leaving; (iii) risky sexual behavior leading to early childbearing and HIV/AIDS; (iv) crime and violence; and (v) substance abuse. The objective of this Toolkit is to serve as a practical guide for policy makers in middle-income countries as well as professionals working within the area of youth development on how to develop and implement an effective policy portfolio to foster healthy and positive youth development.
  • Publication
    Zimbabwe
    (World Bank, Washington, DC, 2019-03-01) World Bank
    This report presents an assessment of Zimbabwe’s agriculture sector disaster risk and management capacity. The findings indicate that Zimbabwe is highly exposed to agricultural risks and has limited capacity to manage risk at various levels. The report shows that disaster-related shocks along Zimbabwe’s agricultural supply chains directly translate to volatility in agricultural GDP. Such shocks have a substantial impact on economic growth, food security, and fiscal balance. When catastrophic disasters occur, the economy absorbs the shocks, without benefiting from any instruments that transfer the risk to markets and coping ability. The increasing prevalence of ‘shock recovery-shock’ cycles impairs Zimbabwe’s ability to plan and pursue a sustainable development path. The findings presented here confirm that it is highly pertinent for Zimbabwe to strengthen the capacity to manage risk at various levels, from the smallholder farmer, to other participants along the supply chain, to consumers (who require a reliable, safe food supply), and ultimately to the government to manage natural disasters. The assessment provides the following evidence on sources of risks and plausible risk management solutions. It is our hope that the report contributes to action by the Government of Zimbabwe to adopt a proactive and integrated risk management strategy appropriate to the current structure of the agricultural sector.
  • Publication
    The Power of Survey Design : A User's Guide for Managing Surveys, Interpreting Results, and Influencing Respondents
    (Washington, DC: World Bank, 2006) Iarossi, Giuseppe
    The vast majority of data used for economic research, analysis, and policy design comes from surveys-surveys of households, firms, schools, hospitals, and market participants, and, the accuracy of the estimate will depend on how well the survey is done. This innovative book is both a 'how-to' go about carrying out high-quality surveys, especially in the challenging environment of developing countries, and a 'user's guide' for anyone who uses statistical data. Reading this book will provide data users with a wealth of insight into what kinds of problems, or biases to look for in different data sources, based on the underlying survey approaches that were used to generate the data. In that sense the book is an invaluable 'skeptics guide to data'. Yet, the broad storyline of the book is something that should be absorbed by statistical data users. The book will teach and show how difficult it often is to obtain reliable estimates of important social and economic facts, and, therefore encourages you to approach all estimates with sensible caution.
  • Publication
    Ten Steps to a Results-Based Monitoring and Evaluation System : A Handbook for Development Practitioners
    (Washington, DC: World Bank, 2004) Zall Kusek, Jody; Rist, Ray C.
    An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, Non-governmental Organizations (NGOs), civil society, international organizations, and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a 'readiness assessment' and take the practitioner through the design, management, and importantly, the sustainability of such systems. The handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way.