Publication: A Puzzle with Missing Pieces: Explaining the Effectiveness of World Bank Development Projects
Loading...
Published
2021-12
ISSN
Date
2021-12-16
Author(s)
Ashton, Louise
Goldemberg, Diana
Hussain, Mustafa Zakir
Kenyon, Thomas
Khan, Akib
Zhou, Mo
Editor(s)
Abstract
The identification of key determinants of aid effectiveness is a long-standing question in the development community. This paper reviews the literature on aid effectiveness at the project level and then extends the inquiry in a variety of dimensions with new data on World Bank investment project financing. It confirms that the country institutional setting and quality of project supervision are associated with project success, as identified previously. However, many aspects of the development project cycle, especially project design, have been difficult to measure and therefore under-investigated. The paper finds that project design, as proxied by the estimated value added of design staff, the presence of prior analytic work, and other specially collected measures, is a significant predictor of ultimate project success. These factors generally grow in predictive importance as the income level of the country rises. The results also indicate that a key determinant of the staff’s contribution is their experience with previous World Bank projects, but not other characteristics such as age, education, or country location. Key inputs to the project production process associated with subsequent performance are not captured in routine data systems, although it is feasible to do so. Further, the conceptualization and measurement of the success of project-based aid should be revisited by evaluative bodies to reflect a project’s theorized contribution to development outcomes.
Link to Data Set
Citation
“Ashton, Louise; Friedman, Jed; Goldemberg, Diana; Hussain, Mustafa Zakir; Kenyon, Thomas; Khan, Akib; Zhou, Mo. 2021. A Puzzle with Missing Pieces: Explaining the Effectiveness of World Bank Development Projects. Policy Research Working Paper;No. 9884. © World Bank. http://hdl.handle.net/10986/36742 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication A Puzzle with Missing Pieces(Published by Oxford University Press on behalf of the World Bank, 2022-07-12)The identification of key determinants of aid effectiveness is a long-standing question in the development community. This paper reviews the literature on aid effectiveness at the project level and then extends the inquiry in a variety of dimensions with new data on World Bank investment project financing. It confirms that the country institutional setting and quality of project supervision are associated with project success, as identified previously. However, many aspects of the development project cycle, especially project design, have been difficult to measure and therefore under-investigated. The paper finds that project design, as proxied by the estimated value added of design staff, the presence of prior analytic work, and other specially collected measures, is a significant predictor of ultimate project success. These factors generally grow in predictive importance as the income level of the country rises. The results also indicate that a key determinant of the staff's contribution is their experience with previous World Bank projects, but not other characteristics such as age, education, or country location. Key inputs to the project production process associated with subsequent performance are not captured in routine data systems, although it is feasible to do so. Further, the conceptualization and measurement of the success of project-based aid should be revisited by evaluative bodies to reflect a project's theorized contribution to development outcomes.Publication Minding the Gap(World Bank, Washington, DC, 2023-08-02)This paper applies novel techniques to long-standing questions of aid effectiveness. It first replicates findings that donor finance is discernibly but weakly associated with sector outcomes in recipient countries. It then shows robustly that donors' own ratings of project success provide limited information on the contribution of those projects to development outcomes. By training a machine learning model on World Bank projects, the paper shows instead that the strongest predictor of these projects’ contribution to outcomes is their degree of adaptation to country context, and the largest differences between ratings and actual impact occur in large projects in institutionally weak settings.Publication Minding the Gap: Aid Effectiveness, Project Ratings and Contextualization(Oxford University on behalf of the World Bank, 2025-04-03)This paper applies novel techniques to long-standing questions of aid effectiveness. It constructs a new data set using machine-learning methods to encode aspects of development project documents that would be infeasible with manual methods. It then uses that data set to show that the strongest predictor of these projects’ contributions to development outcomes is not the self-evaluation ratings assigned by donors, but their degree of adaptation to country context and that the largest differences between ratings and actual impact occur in large projects in institutionally weak settings. It also finds suggestive evidence that the content of ex post reviews of project effectiveness may predict sector outcomes, even if ratings do not.Publication Lessons from Output-Based Aid for Leveraging Finance for Clean Energy(World Bank, Washington, DC, 2012-09)This paper focused on the delivery mechanisms for bilateral, multi-lateral, host government subsidy, and consumer cross-subsidy funding to enhance private sector investment. However, the specific source of funds is not deemed to be especially relevant for the purposes of this working paper. Focus on some of the useful characteristics of Output-Based Aid (OBA) experience to date that may be relevant. Propose an option for how OBA experience could be used to deliver national and programmatic supports to projects in middle- and low-income countries in coordination with other multi-lateral development bank instruments such as concessional loans and credits. This working paper does not: specifically address strengths and weaknesses of the clean development mechanism and only briefly touches on issues with using carbon finance in the current market. Carry out an assessment of experience with feed-in tariffs or advanced market commitments, or indeed other results orientated schemes.Publication Results and Performance of the World Bank Group 2013 : An Independent Evaluation, Volume 2. Appendixes(World Bank, Washington, DC, 2014)The global extreme poverty rate has fallen by half since 1990, but progress within the developing world has been uneven. Extreme poverty remains widespread in most low-income countries while many middle-income countries also continue to have substantial levels with many people there who have escaped extreme poverty remaining poor and vulnerable. Nor has there been robust progress in sharing prosperity: in many developing countries rapid growth has been accompanied by rising inequality, often with a geographic and ethnic dimension as progress in isolated areas has lagged behind. This appendix describes select elements of the evaluation systems in the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) that are the basis for this report. They illustrate commonalities as well as differences in evaluation practices across the institutions. The World Bank, IFC, and MIGA differ in the instruments and approaches they use to achieve development results. Each institution has an evaluation system tailored to its needs. In each organization, the evaluation system comprises different components, self-evaluation, independent evaluation, and validation of self-evaluation.
Users also downloaded
Showing related downloaded files
Publication The Global Findex Database 2025: Connectivity and Financial Inclusion in the Digital Economy(Washington, DC: World Bank, 2025-07-16)The Global Findex 2025 reveals how mobile technology is equipping more adults around the world to own and use financial accounts to save formally, access credit, make and receive digital payments, and pursue opportunities. Including the inaugural Global Findex Digital Connectivity Tracker, this fifth edition of Global Findex presents new insights on the interactions among mobile phone ownership, internet use, and financial inclusion. The Global Findex is the world’s most comprehensive database on digital and financial inclusion. It is also the only global source of comparable demand-side data, allowing cross-country analysis of how adults access and use mobile phones, the internet, and financial accounts to reach digital information and resources, save, borrow, make payments, and manage their financial health. Data for the Global Findex 2025 were collected from nationally representative surveys of about 145,000 adults in 141 economies. The latest edition follows the 2011, 2014, 2017, and 2021 editions and includes new series measuring mobile phone ownership and internet use, digital safety, and frequency of transactions using financial services. The Global Findex 2025 is an indispensable resource for policy makers in the fields of digital connectivity and financial inclusion, as well as for practitioners, researchers, and development professionals.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Women, Business and the Law 2024(Washington, DC: World Bank, 2024-03-04)Women, Business and the Law 2024 is the 10th in a series of annual studies measuring the enabling conditions that affect women’s economic opportunity in 190 economies. To present a more complete picture of the global environment that enables women’s socioeconomic participation, this year Women, Business and the Law introduces two new indicators—Safety and Childcare—and presents findings on the implementation gap between laws (de jure) and how they function in practice (de facto). This study presents three indexes: (1) legal frameworks, (2) supportive frameworks (policies, institutions, services, data, budget, and access to justice), and (3) expert opinions on women’s rights in practice in the areas measured. The study’s 10 indicators—Safety, Mobility, Workplace, Pay, Marriage, Parenthood, Childcare, Entrepreneurship, Assets, and Pension—are structured around the different stages of a woman’s working life. Findings from this new research can inform policy discussions to ensure women’s full and equal participation in the economy. The indicators build evidence of the critical relationship between legal gender equality and women’s employment and entrepreneurship. Data in Women, Business and the Law 2024 are current as of October 1, 2023.Publication Reboot Development: The Economics of a Livable Planet(Washington, DC: World Bank, 2025-09-01)“Reboot Development: The Economics of a Livable Planet” explores how the foundational natural endowments of land, air, and water—long taken for granted—are under growing threat, putting at risk the very progress they helped create. For generations, natural resources have powered development, supporting health, food, energy, and economic opportunity. Today, strains on these resources are intensifying. This report argues that failing to maintain a livable planet is not merely a distant environmental concern, but a present economic threat. Drawing on new data, the report shows that over 90 percent of the world is exposed to poor air quality, degraded land, or water stress. Loss of forests cuts rainfall, dries soils, and worsens droughts, costing billions of dollars. The nitrogen paradox emerges—fertilizers boost yields but overuse in some regions harms crops and ecosystems. Meanwhile, air and water pollution silently damage health, productivity, and cognition, sapping human potential. The report warns that these hidden costs are too large to ignore. Yet the message is not one of constraint but of possibility. Nature, when wisely stewarded, can drive growth, create jobs, and build resilience. The report shows that more efficient resource use—like better nitrogen management and forest restoration—yields benefits that far exceed the costs. It also urges a shift to cleaner sectors and producing “better things,” noting that these provide new sources of growth, creating more jobs per dollar invested. The findings are clear: Investing in nature is not only good for the planet, it is smart development.