Publication: A Puzzle with Missing Pieces: Explaining the Effectiveness of World Bank Development Projects
Loading...
Date
2021-12
ISSN
Published
2021-12
Author(s)
Ashton, Louise
Goldemberg, Diana
Hussain, Mustafa Zakir
Kenyon, Thomas
Khan, Akib
Zhou, Mo
Editor(s)
Abstract
The identification of key determinants of aid effectiveness is a long-standing question in the development community. This paper reviews the literature on aid effectiveness at the project level and then extends the inquiry in a variety of dimensions with new data on World Bank investment project financing. It confirms that the country institutional setting and quality of project supervision are associated with project success, as identified previously. However, many aspects of the development project cycle, especially project design, have been difficult to measure and therefore under-investigated. The paper finds that project design, as proxied by the estimated value added of design staff, the presence of prior analytic work, and other specially collected measures, is a significant predictor of ultimate project success. These factors generally grow in predictive importance as the income level of the country rises. The results also indicate that a key determinant of the staff’s contribution is their experience with previous World Bank projects, but not other characteristics such as age, education, or country location. Key inputs to the project production process associated with subsequent performance are not captured in routine data systems, although it is feasible to do so. Further, the conceptualization and measurement of the success of project-based aid should be revisited by evaluative bodies to reflect a project’s theorized contribution to development outcomes.
Link to Data Set
Citation
“Ashton, Louise; Friedman, Jed; Goldemberg, Diana; Hussain, Mustafa Zakir; Kenyon, Thomas; Khan, Akib; Zhou, Mo. 2021. A Puzzle with Missing Pieces: Explaining the Effectiveness of World Bank Development Projects. Policy Research Working Paper;No. 9884. © World Bank. http://hdl.handle.net/10986/36742 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication A Puzzle with Missing Pieces(Published by Oxford University Press on behalf of the World Bank, 2022-07-12)The identification of key determinants of aid effectiveness is a long-standing question in the development community. This paper reviews the literature on aid effectiveness at the project level and then extends the inquiry in a variety of dimensions with new data on World Bank investment project financing. It confirms that the country institutional setting and quality of project supervision are associated with project success, as identified previously. However, many aspects of the development project cycle, especially project design, have been difficult to measure and therefore under-investigated. The paper finds that project design, as proxied by the estimated value added of design staff, the presence of prior analytic work, and other specially collected measures, is a significant predictor of ultimate project success. These factors generally grow in predictive importance as the income level of the country rises. The results also indicate that a key determinant of the staff's contribution is their experience with previous World Bank projects, but not other characteristics such as age, education, or country location. Key inputs to the project production process associated with subsequent performance are not captured in routine data systems, although it is feasible to do so. Further, the conceptualization and measurement of the success of project-based aid should be revisited by evaluative bodies to reflect a project's theorized contribution to development outcomes.Publication Minding the Gap(World Bank, Washington, DC, 2023-08-02)This paper applies novel techniques to long-standing questions of aid effectiveness. It first replicates findings that donor finance is discernibly but weakly associated with sector outcomes in recipient countries. It then shows robustly that donors' own ratings of project success provide limited information on the contribution of those projects to development outcomes. By training a machine learning model on World Bank projects, the paper shows instead that the strongest predictor of these projects’ contribution to outcomes is their degree of adaptation to country context, and the largest differences between ratings and actual impact occur in large projects in institutionally weak settings.Publication Minding the Gap: Aid Effectiveness, Project Ratings and Contextualization(Oxford University on behalf of the World Bank, 2025-04-03)This paper applies novel techniques to long-standing questions of aid effectiveness. It constructs a new data set using machine-learning methods to encode aspects of development project documents that would be infeasible with manual methods. It then uses that data set to show that the strongest predictor of these projects’ contributions to development outcomes is not the self-evaluation ratings assigned by donors, but their degree of adaptation to country context and that the largest differences between ratings and actual impact occur in large projects in institutionally weak settings. It also finds suggestive evidence that the content of ex post reviews of project effectiveness may predict sector outcomes, even if ratings do not.Publication Lessons from Output-Based Aid for Leveraging Finance for Clean Energy(World Bank, Washington, DC, 2012-09)This paper focused on the delivery mechanisms for bilateral, multi-lateral, host government subsidy, and consumer cross-subsidy funding to enhance private sector investment. However, the specific source of funds is not deemed to be especially relevant for the purposes of this working paper. Focus on some of the useful characteristics of Output-Based Aid (OBA) experience to date that may be relevant. Propose an option for how OBA experience could be used to deliver national and programmatic supports to projects in middle- and low-income countries in coordination with other multi-lateral development bank instruments such as concessional loans and credits. This working paper does not: specifically address strengths and weaknesses of the clean development mechanism and only briefly touches on issues with using carbon finance in the current market. Carry out an assessment of experience with feed-in tariffs or advanced market commitments, or indeed other results orientated schemes.Publication Results and Performance of the World Bank Group 2013 : An Independent Evaluation, Volume 2. Appendixes(World Bank, Washington, DC, 2014)The global extreme poverty rate has fallen by half since 1990, but progress within the developing world has been uneven. Extreme poverty remains widespread in most low-income countries while many middle-income countries also continue to have substantial levels with many people there who have escaped extreme poverty remaining poor and vulnerable. Nor has there been robust progress in sharing prosperity: in many developing countries rapid growth has been accompanied by rising inequality, often with a geographic and ethnic dimension as progress in isolated areas has lagged behind. This appendix describes select elements of the evaluation systems in the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) that are the basis for this report. They illustrate commonalities as well as differences in evaluation practices across the institutions. The World Bank, IFC, and MIGA differ in the instruments and approaches they use to achieve development results. Each institution has an evaluation system tailored to its needs. In each organization, the evaluation system comprises different components, self-evaluation, independent evaluation, and validation of self-evaluation.
Users also downloaded
Showing related downloaded files
Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Western Balkans 6 Country Climate and Development Report(Washington, DC: World Bank Group, 2024-07-16)This Regional Western Balkans Countries Climate and Development Report (CCDR) stands out in several ways. In a region that often lacks cohesive regional alliances, this report emphasizes how the challenges faced across countries are often common and interconnected, and, importantly, that climate action requires coordination on multiple fronts. Simultaneously, it illustrates the differences across countries, places, and people that require targeted strategies and interventions. This report demonstrates how shocks and stressors re intensifying and how investments in adaptation could bring significant benefits in the form of avoided losses, accelerated economic potential, and amplified social and economic spillovers. Given the region’s high emission and energy intensity and the limitations of its current fossil fuel-based development model, the report articulates a path to greener and more resilient growth, a path that is more consistent with the aspiration of accession to the EU. The report finds that the net zero transition can be undertaken without compromising the economic potential of the Western Balkans and that it could lead to higher growth than under the Reference Scenario (RS) with appropriate structural reforms.