Publication: Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning
Loading...
Date
2016-10
ISSN
Published
2016-10
Author(s)
Editor(s)
Abstract
Proxy means test (PMT) poverty targeting tools have become common tools for beneficiary targeting and poverty assessment where full means tests are costly. Currently popular estimation procedures for generating these tools prioritize minimization of in-sample prediction errors; however, the objective in generating such tools is out-of-sample prediction. This paper presents evidence that prioritizing minimal out-of-sample error, identified through cross-validation and stochastic ensemble methods, in PMT tool development can substantially improve the out-of-sample performance of these targeting tools. The USAID poverty assessment tool and base data are used for demonstration of these methods; however, the methods applied in this paper should be considered for PMT and other poverty-targeting tool development more broadly.
Link to Data Set
Citation
“McBride, Linden; Nichols, Austin. 2016. Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning. Policy Research Working Paper;No. 7849. © World Bank. http://hdl.handle.net/10986/25166 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication Exports, Labor Markets, and the Environment(Washington, DC: World Bank, 2025-07-14)What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers(Washington, DC: World Bank, 2025-07-14)This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning(Published by Oxford University Press on behalf of the World Bank, 2018-10)Proxy means test (PMT) poverty targeting tools have become common tools for beneficiary targeting and poverty assessment where full means tests are costly. Currently popular estimation procedures for generating these tools prioritize minimization of in-sample prediction errors; however, the objective in generating such tools is out-of-sample prediction.We present evidence that prioritizing minimal out-of-sample error, identified through cross-validation and stochastic ensemble methods, in PMT tool development can substantially improve the out-of-sample performance of these targeting tools.We take the United States Agency for International Development (USAID) poverty assessment tool and base data for demonstration of these methods; however, the methods applied in this paper should be considered for PMT and other poverty-targeting tool development more broadly.Publication Improving the Targeting of Social Programs in Ghana(Washington, DC: World Bank, 2012-10-31)This study provides a diagnostic of the benefit incidence and targeting performance of a large number of social programs in Ghana. Both broad-based programs (such as spending for education and health, and subsidies for food, oil-related products and electricity) as well as targetd programs (such as LEAP, the indigent exemption under the NHIS, school lunches and uniforms, or fertilizer subsidies) are considered. In addition, the study provides tools and recommendations for better targeting of those programs in the future. The tools include new maps and data sets for geographic targeting according to poverty and food security, as well as ways to implement proxy means-testing. The purpose of this introductory chapter is to provide a brief synthesis of the key findings and messages from the study.Publication A Review of the Targeting System in Georgia(World Bank, Washington, DC, 2020-06-25)This paper first reviews the performance of the current targeting system and recommends improvements to the existing PMT formula. One implementation issue we identified is the inconsistency in how monetary and nonmonetary values are treated when calculating the PMT score. The practice has been to calculate the score based on monetary variables (income, social benefits package, and utility expenditures) at current nominal prices, which have inevitably inflated the predicted consumption. As the PMT formula was estimated at 2013 prices, the recommendation to correctly implement the current PMT formula would be to deflate all monetary variables to 2013 prices. Second, to further improve the poverty targeting accuracy, the paper presents the updated PMT model estimation and discusses the benefits and cost of transitioning to the new PMT formula. The empirical analysis is based on the 2018 HIES collected by the National Statistics Office of Georgia (Geostat), the latest available to the team at the time of the analysis. The remainder of this note is organized as follows. Section two looks at the performance of the current PMT model to identify key areas of possible improvements. Section three develops alternative estimates and proposes a new PMT formula, comparing its theoretical performance with that of the current one. This is followed by a discussion of the implementation of the formula in the following years to avoid problems encountered with the current approach. Section four goes further to make a more radical proposal to consider moving to an ‘hybrid’ approach combining an income test with the PMT, highlighting the advantages of the approach and the steps needed for its development and implementation. A final section provides a summary of key recommendations for the immediate, short, and medium term.Publication Targeting Ultra-Poor Households in Honduras and Peru(Published by Oxford University Press on behalf of the World Bank, 2019-02)For policy purposes, it is important to understand the relative efficacy of various methods to target the poor. Recently, participatory methods have received particular attention. We examine the effectiveness of a hybrid two-step process that combines a participatory wealth ranking and a verification household survey, relative to two proxy means tests (the Progress out of Poverty Index and a housing index), in Honduras and Peru. The methods we examine perform similarly by various metrics. They all identify most accurately the poorest and the wealthiest households but perform with mixed results among households in the middle of the distribution. Ultimately, given similar performance, the analysis suggests that costs should be the driving consideration in choosing across methods.Publication PMT Based Targeting in Burkina Faso(World Bank, Washington, DC, 2016-11-02)Beneficiaries of the ongoing safety net program Burkin-Naong-Saya in Burkina Faso are selected based on a multi-step targeting strategy. One part of this strategy is Proxy Means Testing (PMT). The current PMT method, however, was developed using outdated 2009 data. This study uses a new, nationally representative household survey conducted in 2014 to evaluate the efficiency of updated PMT models. The findings are three-fold. First, a single national PMT model is preferable to urban/rural-specific models. Second, while the updated national model performs better than the old model in selecting the poorest urban households, it does not perform as well as the 2009 model in rural areas. Since rural areas are the current focus of the intervention, the PMT formula should not be changed. Third, parsimonious PMT models using only variables from HEA questionnaires are almost as efficient as models that use a much larger number of variables. This allows for PMT targeting based on HEA data, without the need for prior PMT data collection.
Users also downloaded
Showing related downloaded files
Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication The Journey Ahead(Washington, DC: World Bank, 2024-10-31)The Journey Ahead: Supporting Successful Migration in Europe and Central Asia provides an in-depth analysis of international migration in Europe and Central Asia (ECA) and the implications for policy making. By identifying challenges and opportunities associated with migration in the region, it aims to inform a more nuanced, evidencebased debate on the costs and benefits of cross-border mobility. Using data-driven insights and new analysis, the report shows that migration has been an engine of prosperity and has helped address some of ECA’s demographic and socioeconomic disparities. Yet, migration’s full economic potential remains untapped. The report identifies multiple barriers keeping migration from achieving its full potential. Crucially, it argues that policies in both origin and destination countries can help maximize the development impacts of migration and effectively manage the economic, social, and political costs. Drawing from a wide range of literature, country experiences, and novel analysis, The Journey Ahead presents actionable policy options to enhance the benefits of migration for destination and origin countries and migrants themselves. Some measures can be taken unilaterally by countries, whereas others require close bilateral or regional coordination. The recommendations are tailored to different types of migration— forced displacement as well as high-skilled and low-skilled economic migration—and from the perspectives of both sending and receiving countries. This report serves as a comprehensive resource for governments, development partners, and other stakeholders throughout Europe and Central Asia, where the richness and diversity of migration experiences provide valuable insights for policy makers in other regions of the world.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.