Publication: Predicting Project Outcomes: A Simple Methodology for Predictions Based on Project Ratings
Loading...
Date
2016-08
ISSN
Published
2016-08
Editor(s)
Abstract
The downgrading of projects at the closing from moderately satisfactory to moderately unsatisfactory has been a persistent problem in the World Bank and a particular problem in the World Bank's East Asia and Pacific region since 2012. Through analysis of the projects that exited the East Asia and Pacific region's portfolio in fiscal years 2012 and 2013, this paper derives a prediction model based on ratings for implementation progress and achievement of development objectives during project supervision. The model, used in combination with other indicators of project progress toward outcomes, appears to improve on existing methods for assessing the downgrade risk.
Link to Data Set
Citation
“Blanc, Marc; Esmail, Talib; Mascarell, Caroline; Rodriguez, Rukshan. 2016. Predicting Project Outcomes: A Simple Methodology for Predictions Based on Project Ratings. Policy Research Working Paper;No. 7800. © World Bank. http://hdl.handle.net/10986/25045 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication From Tailwinds to Headwinds(Washington, DC: World Bank, 2025-07-10)The first quarter of the twenty-first century has been transformative for emerging market and developing economies (EMDEs). These economies now account for about 45 percent of global GDP, up from about 25 percent in 2000, a trend driven by robust collective growth in the three largest EMDEs—China, India, and Brazil (the EM3). Collectively, EMDEs have contributed about 60 percent of annual global growth since 2000, on average, double the share during the 1990s. Their ascendance was powered by swift global trade and financial integration, especially during the first decade of the century. Interdependence among these economies has also increased markedly. Today, nearly half of goods exports from EMDEs go to other EMDEs, compared to one-quarter in 2000. As cross-border linkages have strengthened, business cycles among EMDEs and between EMDEs and advanced economies have become more synchronized, and a distinct EMDE business cycle has emerged. Cross-border business cycle spillovers from the EM3 to other EMDEs are sizable, at about half of the magnitude of spillovers from the largest advanced economies (the United States, the euro area, and Japan). Yet EMDEs confront a host of headwinds at the turn of the second quarter of the century. Progress implementing structural reforms in many of these economies has stalled. Globally, protectionist measures and geopolitical fragmentation have risen sharply. High debt burdens, demographic shifts, and the rising costs of climate change weigh on economic prospects. A successful policy approach to accelerate growth and development should focus on boosting investment and productivity, navigating a difficult external environment, and enhancing macroeconomic stability.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication GLS Estimation and Empirical Bayes Prediction for Linear Mixed Models with Heteroskedasticity and Sampling Weights : A Background Study for the POVMAP Project(World Bank Group, Washington, DC, 2014-09)This note adapts results by Huang and Hidiroglou (2003) on Generalized Least Squares estimation and Empirical Bayes prediction for linear mixed models with sampling weights. The objective is to incorporate these results into the poverty mapping approach put forward by Elbers et al. (2003). The estimators presented here have been implemented in version 2.5 of POVMAP, the custom-made poverty mapping software developed by the World Bank.Publication School Access, Resources, and Learning Outcomes(World Bank, Washington, DC, 2011-05)This study reports evidence from an unusual policy intervention- The Reaching Out of School Children (ROSC) project in Bangladesh where school grants and education allowances are offered to attract hard-to-reach children to schools comprised of a single teacher and a classroom. The operating unit cost of these schools is a fraction of that of formal primary schools. Panel data is used to investigate whether ROSC schools are effective in raising enrolment and learning outcomes. The findings suggest that there is a modest impact on school participation: ROSC schools increase enrolment probability between 9 and 18 percent for children in the two age cohorts 6 to 8 and 6 to 10. They perform as well as non-ROSC schools in terms of raising test scores, and even have positive impacts on academically stronger students. There is also strong evidence of positive externalities on non-ROSC schools in program areas. These results point to the effectiveness of a new model of non-formal primary schools that can be replicated in similar settings. This paper consists of following sections: section one gives introduction. The context for the country and the program description is provided in section two, and the data is described in section three. The impacts of the ROSC project on education outcomes as measured by student enrolment and test scores are discussed in section four and other program effects are considered in section five, with the empirical estimation frameworks being respectively detailed in each section. The relative efficiency of ROSC schools versus non-ROSC schools is discussed in section six and section seven gives conclusion.Publication Assessing the Impacts of Mais Educacao on Educational Outcomes(World Bank, Washington, DC, 2016-04)To address the educational gap, many Latin American countries are focusing on extension of the school day and enrichment of the curriculum. In Brazil, a nationwide policy -- Mais Educação -- was implemented in 2008 with this objective. This paper explores the nationwide rollout of the program across the country and compares the performance of schools before and after implementation of the program. The paper quantifies the impacts of the program on student learning and dropout rates in urban areas, and investigates the heterogeneity of impacts by several characteristics of the program's implementation. Participating schools are compared with nonparticipating schools after controlling for school selection into the program based on observable characteristics using propensity score matching. The analysis finds that participation in Mais Educação has on average no impacts on school dropout rates and average negative impacts on mathematics test scores. The negative impacts on student achievement are stronger in the short term, which suggests that the negative effects may be reduced as the program improves its implementation. In addition, especially for fifth-grade schools, the level of student spending is associated with reduced dropout rates. Interestingly, in schools choosing the fields of Portuguese and/or sports in the added hours, the program is associated with lower test scores in Portuguese and mathematics. Finally, for the sample of fifth-grade schools, heterogeneous impacts are seen in the program according to the GDP per capita of the city where the school is located. The higher the GDP per capita, the greater the positive impact of the program on mathematics test scores and on dropout rates.Publication Predicting World Bank Project Outcome Ratings(World Bank Group, Washington, DC, 2014-08-01)A number of recent studies have empirically documented links between characteristics of World Bank projects and their ultimate outcomes as evaluated by the World Bank's Independent Evaluation Group. This paper explores the in-sample and out-of-sample predictive performance of empirical models relating project outcomes to project characteristics observed early in the life of a project. Such models perform better than self-assessments of project performance provided by World Bank staff during the implementation of the project. These findings are applied to the problem of predicting eventual Independent Evaluation Group ratings for currently active projects in the World Bank's portfolio.Publication Beyond Downscaling : A Bottom-Up Approach to Climate Adaptation for Water Resources Management(World Bank Group, Washington, DC, 2014-09-11)This report focuses on how we achieve water sustainability over long timescales - decades, even centuries from now. These timescales are important and relevant to our decisions about planning, infrastructure, and institutions today. Many of the methods we use to manage water, directly or indirectly, commit us to future decision pathways and restrict us from making other, alternative decisions. Across the first four chapters, this report describes the challenges of including climate change in water management decision-making and provides an overview of current practices in the adaptation field. After considering the pros and cons of these practices, the book concludes with a framework for an adaptation approach supported by Alliance for Global Water Adaptation (AGWA).
Users also downloaded
Showing related downloaded files
Publication Growth in the Middle East and North Africa(Washington, DC: World Bank, 2024-10-16)This issue of the MENA Economic Update presents a summary of recent macroeconomic trends, including an update of the conflict centered in Gaza and its regional spillovers, alongside an analysis of factors that shape the long-term growth potential of the region, with special attention to the persistent effects of conflicts. A modest uptick in growth is forecast for 2024, which nonetheless masks important disparities within the region. The acceleration is driven by the high-income oil exporters, while growth is expected to decelerate among developing MENA countries, both developing oil exporters and developing oil importers. Despite current challenges, the region can dramatically boost growth by better allocating talent in the labor market, leveraging its strategic location, and promoting innovation. Closing the gender employment gap, rethinking the footprint of the public sector, and facilitating technology transfers through trade under enhanced data quality and transparency can help the region leap toward the frontier. Peace is a pre-condition for catching up to the frontier, as conflict can undo decades of progress, delaying economic development by generations.Publication World Development Report 2023: Migrants, Refugees, and Societies(Washington, DC : World Bank, 2023-04-25)Migration is a development challenge. About 184 million people—2.3 percent of the world’s population—live outside of their country of nationality. Almost half of them are in low- and middle-income countries. But what lies ahead? As the world struggles to cope with global economic imbalances, diverging demographic trends, and climate change, migration will become a necessity in the decades to come for countries at all levels of income. If managed well, migration can be a force for prosperity and can help achieve the United Nations’ Sustainable Development Goals. World Development Report 2023 proposes an innovative approach to maximize the development impacts of cross-border movements on both destination and origin countries and on migrants and refugees themselves. The framework it offers, drawn from labor economics and international law, rests on a “Match and Motive Matrix” that focuses on two factors: how closely migrants’ skills and attributes match the needs of destination countries and what motives underlie their movements. This approach enables policy makers to distinguish between different types of movements and to design migration policies for each. International cooperation will be critical to the effective management of migration.Publication Africa’s Resource Future(Washington DC : World Bank, 2023-04-03)This book examines the role for natural resource wealth in driving Africa’s economic transformation and the implications of the low-carbon transition for resource-rich economies. Resource wealth remains central to most Sub-Saharan African economies, and significant untapped potential is in the ground. Subsoil assets—such as metals, minerals, oil, and gas—are key sources of government revenues, export earnings, and development potential in most countries in the Africa region. Despite large reserves, success in converting subsoil wealth into aboveground sustainable prosperity has been limited. Since the decline in commodity prices in 2014, resource-rich Africa has grown more slowly than the region’s average growth rate. Finding ways to more effectively harness natural resource wealth to drive economic transformation will be central to Africa’s economic future. As the world moves away from fossil fuels in alignment with commitments under the Paris Agreement, Africa’s resource-rich countries face new risks and opportunities. Recent estimates suggest that 80 percent of the world’s proven fossil fuel reserves must remain underground to meet the Paris targets, and much of these stranded reserves may be in Africa. This issue of stranded assets and, relatedly, “stranded nations,” has major implications for the many African economies that are dependent on petroleum extraction and export. On the other hand, the energy transition will increase demand for raw material inputs involved in clean energy technologies. The transition from fossil fuels to clean energy may create demand by 2050 for 3 billion tons of minerals and metals that are needed to deploy solar, wind, and geothermal energy. How can African economies tap into these opportunities while managing the downside risk to their fossil fuel wealth? "Africa’s Resource Future" explores these themes and offers policy makers insights to help them navigate the coming years of uncertainty.Publication Increasing Female Labor Force Participation(World Bank, Washington, DC, 2023-01)Gender gaps in labor force participation persist worldwide. Closing this gap can lead to sizeable gains for economies—a 20 percent increase in GDP per capita, on average. Female labor force participation (FLFP) remains low due to lack of skills, assets and networks, time-based constraints, limited mobility, gender discrimination in hiring and promotion, and restrictive gender norms. Effective evidence-backed policy options can increase FLFP. They include providing childcare services, disseminating information on work opportunities and returns to employment, training in socio-emotional skills, addressing norms by engaging partners and family members, and targeting women via social protection, safety net, and public-works programs. The World Bank Group actively supports countries in boosting FLFP through development policy lending, advisory and analytical work, and supporting reforms to address constraining contextual factors, including legal barriers, social norms, and gender-based violence. This note sheds light on an array of policy options that are effective or show promise in improving FLFP.Publication Poverty, Prosperity, and Planet Report 2024(Washington, DC: World Bank, 2024-10-15)The Poverty, Prosperity, and Planet Report 2024 is the latest edition of the series formerly known as Poverty and Shared Prosperity. The report emphasizes that reducing poverty and increasing shared prosperity must be achieved in ways that do not come at unacceptably high costs to the environment. The current “polycrisis”—where the multiple crises of slow economic growth, increased fragility, climate risks, and heightened uncertainty have come together at the same time—makes national development strategies and international cooperation difficult. Offering the first post-Coronavirus (COVID)-19 pandemic assessment of global progress on this interlinked agenda, the report finds that global poverty reduction has resumed but at a pace slower than before the COVID-19 crisis. Nearly 700 million people worldwide live in extreme poverty with less than US$2.15 per person per day. Progress has essentially plateaued amid lower economic growth and the impacts of COVID-19 and other crises. Today, extreme poverty is concentrated mostly in Sub-Saharan Africa and fragile settings. At a higher standard more typical of upper-middle-income countries—US$6.85 per person per day—almost one-half of the world is living in poverty. The report also provides evidence that the number of countries that have high levels of income inequality has declined considerably during the past two decades, but the pace of improvements in shared prosperity has slowed, and that inequality remains high in Latin America and the Caribbean and Sub-Saharan Africa. Worldwide, people’s incomes today would need to increase fivefold on average to reach a minimum prosperity threshold of US$25 per person per day. Where there has been progress in poverty reduction and shared prosperity, there is evidence of an increasing ability of countries to manage natural hazards, but climate risks are significantly higher in the poorest settings. Nearly one in five people globally is at risk of experiencing welfare losses due to an extreme weather event from which they will struggle to recover. The interconnected issues of climate change and poverty call for a united and inclusive effort from the global community. Development cooperation stakeholders—from governments, nongovernmental organizations, and the private sector to communities and citizens acting locally in every corner of the globe—hold pivotal roles in promoting fair and sustainable transitions. By emphasizing strategies that yield multiple benefits and diligently monitoring and addressing trade-offs, we can strive toward a future that is prosperous, equitable, and resilient.