Publication: Predicting Project Outcomes: A Simple Methodology for Predictions Based on Project Ratings
Loading...
Published
2016-08
ISSN
Date
2016-09-12
Editor(s)
Abstract
The downgrading of projects at the closing from moderately satisfactory to moderately unsatisfactory has been a persistent problem in the World Bank and a particular problem in the World Bank's East Asia and Pacific region since 2012. Through analysis of the projects that exited the East Asia and Pacific region's portfolio in fiscal years 2012 and 2013, this paper derives a prediction model based on ratings for implementation progress and achievement of development objectives during project supervision. The model, used in combination with other indicators of project progress toward outcomes, appears to improve on existing methods for assessing the downgrade risk.
Link to Data Set
Citation
“Blanc, Marc; Esmail, Talib; Mascarell, Caroline; Rodriguez, Rukshan. 2016. Predicting Project Outcomes: A Simple Methodology for Predictions Based on Project Ratings. Policy Research Working Paper;No. 7800. © World Bank. http://hdl.handle.net/10986/25045 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication GLS Estimation and Empirical Bayes Prediction for Linear Mixed Models with Heteroskedasticity and Sampling Weights : A Background Study for the POVMAP Project(World Bank Group, Washington, DC, 2014-09)This note adapts results by Huang and Hidiroglou (2003) on Generalized Least Squares estimation and Empirical Bayes prediction for linear mixed models with sampling weights. The objective is to incorporate these results into the poverty mapping approach put forward by Elbers et al. (2003). The estimators presented here have been implemented in version 2.5 of POVMAP, the custom-made poverty mapping software developed by the World Bank.Publication School Access, Resources, and Learning Outcomes(World Bank, Washington, DC, 2011-05)This study reports evidence from an unusual policy intervention- The Reaching Out of School Children (ROSC) project in Bangladesh where school grants and education allowances are offered to attract hard-to-reach children to schools comprised of a single teacher and a classroom. The operating unit cost of these schools is a fraction of that of formal primary schools. Panel data is used to investigate whether ROSC schools are effective in raising enrolment and learning outcomes. The findings suggest that there is a modest impact on school participation: ROSC schools increase enrolment probability between 9 and 18 percent for children in the two age cohorts 6 to 8 and 6 to 10. They perform as well as non-ROSC schools in terms of raising test scores, and even have positive impacts on academically stronger students. There is also strong evidence of positive externalities on non-ROSC schools in program areas. These results point to the effectiveness of a new model of non-formal primary schools that can be replicated in similar settings. This paper consists of following sections: section one gives introduction. The context for the country and the program description is provided in section two, and the data is described in section three. The impacts of the ROSC project on education outcomes as measured by student enrolment and test scores are discussed in section four and other program effects are considered in section five, with the empirical estimation frameworks being respectively detailed in each section. The relative efficiency of ROSC schools versus non-ROSC schools is discussed in section six and section seven gives conclusion.Publication Assessing the Impacts of Mais Educacao on Educational Outcomes(World Bank, Washington, DC, 2016-04)To address the educational gap, many Latin American countries are focusing on extension of the school day and enrichment of the curriculum. In Brazil, a nationwide policy -- Mais Educação -- was implemented in 2008 with this objective. This paper explores the nationwide rollout of the program across the country and compares the performance of schools before and after implementation of the program. The paper quantifies the impacts of the program on student learning and dropout rates in urban areas, and investigates the heterogeneity of impacts by several characteristics of the program's implementation. Participating schools are compared with nonparticipating schools after controlling for school selection into the program based on observable characteristics using propensity score matching. The analysis finds that participation in Mais Educação has on average no impacts on school dropout rates and average negative impacts on mathematics test scores. The negative impacts on student achievement are stronger in the short term, which suggests that the negative effects may be reduced as the program improves its implementation. In addition, especially for fifth-grade schools, the level of student spending is associated with reduced dropout rates. Interestingly, in schools choosing the fields of Portuguese and/or sports in the added hours, the program is associated with lower test scores in Portuguese and mathematics. Finally, for the sample of fifth-grade schools, heterogeneous impacts are seen in the program according to the GDP per capita of the city where the school is located. The higher the GDP per capita, the greater the positive impact of the program on mathematics test scores and on dropout rates.Publication Predicting World Bank Project Outcome Ratings(World Bank Group, Washington, DC, 2014-08-01)A number of recent studies have empirically documented links between characteristics of World Bank projects and their ultimate outcomes as evaluated by the World Bank's Independent Evaluation Group. This paper explores the in-sample and out-of-sample predictive performance of empirical models relating project outcomes to project characteristics observed early in the life of a project. Such models perform better than self-assessments of project performance provided by World Bank staff during the implementation of the project. These findings are applied to the problem of predicting eventual Independent Evaluation Group ratings for currently active projects in the World Bank's portfolio.Publication Beyond Downscaling : A Bottom-Up Approach to Climate Adaptation for Water Resources Management(World Bank Group, Washington, DC, 2014-09-11)This report focuses on how we achieve water sustainability over long timescales - decades, even centuries from now. These timescales are important and relevant to our decisions about planning, infrastructure, and institutions today. Many of the methods we use to manage water, directly or indirectly, commit us to future decision pathways and restrict us from making other, alternative decisions. Across the first four chapters, this report describes the challenges of including climate change in water management decision-making and provides an overview of current practices in the adaptation field. After considering the pros and cons of these practices, the book concludes with a framework for an adaptation approach supported by Alliance for Global Water Adaptation (AGWA).
Users also downloaded
Showing related downloaded files
Publication FY2018 Sudan Country Opinion Survey Report(World Bank, Washington, DC, 2018-10)The Country Opinion Survey in Sudan assists the World Bank Group (WBG) in gaining a better understanding of how stakeholders in Sudan perceive the WBG. It provides the WBG with systematic feedback from national and local governments, multilateral/bilateral agencies, media, academia, the private sector, and civil society in Sudan on 1) their views regarding the general environment in Sudan; 2) their overall attitudes toward the WBG in Sudan; 3) overall impressions of the WBG’s effectiveness and results, knowledge work and activities, and communication and information sharing in Sudan; and 4) their perceptions of the WBG’s future role in Sudan.Publication State Capture Analysis(World Bank, Washington, DC, 2021-05-17)This note describes how political economy analysis can be used to promote development, focusing specifically on state capture. It is intended to help practitioners within the World Bank execute and disseminate political economy analysis of state capture. It is not intended to be comprehensive but serves as a how-to guide for those not intimately familiar with the topic.Publication Public Expenditure Reviews in Science, Technology, and Innovation : A Guidence Note(World Bank Group, Washington, DC, 2014)This Guidance Note lays out a framework for the assessment of science, technology, and innovation (STI) expenditures in developing countries, with an emphasis on their contribution to economic development.Publication World Bank East Asia and the Pacific Economic Update, October 2024: Jobs and Technology(Washington, DC: World Bank, 2024-10-07)East Asia and the Pacific, seen in the context of the world economy, stands out as a paragon of development. Despite the recent ravages of the pandemic and the persistent tensions of geopolitics, the region is growing at stably high rates and the benefits are widely shared. But compared to its own past and potential, the region’s economic performance is less impressive. Growth is still below pre-pandemic rates, except in Indonesia, and output has not yet recovered to pre-pandemic levels in several countries, especially in the Pacific. This Economic Update highlights three key developments: shifting regional growth dynamics as China’s growth slows, changing trade patterns due to global tensions, and the impact of technologies such as robots, artificial intelligence, and digital platforms on jobs. The report calls for productivity-enhancing structural reforms to strengthen domestic growth drivers through; deeper international trade agreements to foster more open and stable trade regimes; deeper technical, digital, and soft skills while addressing impediments to labor mobility, factor price distortions and expanding social protection for workers in the digital informal economy to boost productivity and employment.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.