Publication: Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail
Loading...
Published
2025-08-21
ISSN
Date
2025-08-21
Author(s)
Editor(s)
Abstract
Accurate and timely poverty measurement is central to development policy, yet the availability of up-to-date high-quality household survey data remains limited—particularly in countries where poverty is most concentrated. Survey-to-survey imputation has emerged as a practical response to this challenge, allowing practitioners to update poverty estimates using recent surveys that lack direct welfare measures by borrowing information from other comprehensive surveys. A critical review of the method is provided, revisiting its statistical underpinnings and testing its limitations through extensive model-based simulations. Through these simulations, the analysis demonstrates how violations of parameter stability, omitted variable bias, and shifts in survey design can introduce substantial errors—particularly when imputing across time or under economic and structural change. Results show that standard corrections such as re-weighting or covariate standardization may fail to eliminate these biases, especially when imputing across time or under structural change. The performance of alternative model specifications is also evaluated under various methods, including performance under heteroskedastic errors, non-normality. The findings offer practical guidance for practitioners on when survey-to-survey imputation is likely to succeed, when it should be reconsidered, and how to communicate its limitations transparently in the context of poverty monitoring and policy design.
Link to Data Set
Citation
“Corral, Paul; Ham, Andres; Lanjouw, Peter; Lucchetti, Leonardo; Stemmler, Henry. 2025. Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail. Policy Research Working Paper; 11192. © World Bank. http://hdl.handle.net/10986/43629 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Updating Poverty Estimates at Frequent Intervals in the Absence of Consumption Data : Methods and Illustration with Reference to a Middle-Income Country(World Bank Group, Washington, DC, 2014-09)Obtaining consistent estimates on poverty over time as well as monitoring poverty trends on a timely basis is a priority concern for policy makers. However, these objectives are not readily achieved in practice when household consumption data are neither frequently collected, nor constructed using consistent and transparent criteria. This paper develops a formal framework for survey-to-survey poverty imputation in an attempt to overcome these obstacles, and to elevate the discussion of these methods beyond the largely ad-hoc efforts in the existing literature. The framework introduced here imposes few restrictive assumptions, works with simple variance formulas, provides guidance on the selection of control variables for model building, and can be generally applied to imputation either from one survey to another survey with the same design, or to another survey with a different design. Empirical results analyzing the Household Expenditure and Income Survey and the Unemployment and Employment Survey in Jordan are quite encouraging, with imputation-based poverty estimates closely tracking the direct estimates of poverty.Publication Imputed Welfare Estimates in Regression Analysis(World Bank, Washington, D.C., 2004-04)The authors discuss the use of imputed data in regression analysis, in particular the use of highly disaggregated welfare indicators (from so-called "poverty maps"). They show that such indicators can be used both as explanatory variables on the right-hand side and as the phenomenon to explain on the left-hand side. The authors try out practical ways of adjusting standard errors of the regression coefficients to reflect the error introduced by using imputed, rather than actual, welfare indicators. These are illustrated by regression experiments based on data from Ecuador. For regressions with imputed variables on the left-hand side, the authors argue that essentially the same aggregate relationships would be found with either actual or imputed variables. They address the methodological question of how to interpret aggregate relationships found in such regressions.Publication Intra-generational Mobility and Repeated Cross-Sections : A Three-country Validation Exercise(2011-12-01)This paper validates a recently proposed method to estimate intra-generational mobility through repeated cross-sectional surveys. The technique allows the creation of a "synthetic panel" -- done by predicting future or past household income using a set of simple modeling and error structure assumptions -- and thus permits the estimation of lower and upper bounds on directional mobility measures. The authors validate the approach in three different settings where good panel data also exist (Chile, Nicaragua, and Peru). In doing so, they also carry out a number of refinements to the validation procedure. The results are broadly encouraging: the methodology performs well in all three settings, especially in cases where richer model specifications can be estimated. The technique does equally well in predicting short and long-term mobility patterns and is robust to a broad set of additional "stress" and sensitivity tests. Overall, the paper lends support to the application of this approach to settings where panel data are absent.Publication Measuring Poverty in Latin America and the Caribbean(World Bank, Washington, DC, 2016-04)This paper contributes to the methodological literature on the estimation of poverty lines for country poverty comparisons in Latin America and the Caribbean. The paper exploits a unique, comprehensive data set of 86 up-to-date urban official extreme and moderate poverty lines across 18 countries in Latin America and the Caribbean, as well as the recent values of the national purchasing power parity conversion factors from the 2011 International Comparison Program and a set of harmonized household surveys that are part of the Socio-Economic Database for Latin America and the Caribbean project. Because of the dispersion of country-specific poverty lines, the paper concludes that the value of a regional poverty line largely depends on the selected aggregation method, which ends up having a direct impact on the estimation of regional extreme and moderate poverty headcounts.Publication Small Area Estimation-Based Prediction Methods to Track Poverty : Validation and Applications(2011-06-01)Tracking poverty is predicated on the availability of comparable consumption data and reliable price deflators. However, regular series of strictly comparable data are only rarely available. Price deflators are also often missing or disputed. In response, poverty prediction methods that track consumption correlates as opposed to consumption itself have been developed. These methods typically assume that the estimated relation between consumption and its predictors is stable over time -- an assumption that cannot usually be tested directly. This study analyzes the performance of poverty prediction models based on small area estimation techniques. Predicted poverty estimates are compared with directly observed levels in two country settings where data comparability over time is not a problem. Prediction models that employ either non-staple food or non-food expenditures or a full set of assets as predictors are found to yield poverty estimates that match observed poverty well. This offers some support to the use of such methods to approximate the evolution of poverty. Two further country examples illustrate how an application of the method employing models based on household assets can help to adjudicate between alternative price deflators.
Users also downloaded
Showing related downloaded files
Publication Jobs in a Changing Climate: Insights from World Bank Group Country Climate and Development Reports Covering 93 Economies(Washington, DC: World Bank, 2025-11-05)The World Bank Group’s Country Climate and Development Reports (CCDRs) provide a crosscutting look at how countries’ development prospects, and the job opportunities they offer to their people, can be threatened by climate impacts and supported by climate policies. Climate change and policies affect jobs through impacts on productivity, energy and material efficiency, and physical, human, and natural capital. They can also transform employment opportunities, especially through complementary measures that help workers and firms adapt to and benefit from new technologies and production practices. Prepared by the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA), CCDRs integrate country perspectives, climate science and economic modeling, private sector information, and policy analysis to assess how countries can successfully grow and develop their economies and create jobs despite increasing climate risks and while achieving their climate objectives and commitments. Each CCDR starts from the country’s development priorities, opportunities, and challenges, and is developed in close consultation with governments, businesses, and civil society, ensuring the recommendations reflect national priorities. By combining evidence on adaptation, resilience, and emissions pathways, CCDRs highlight where climate action can reinforce development and job creation, and where targeted policies are needed to manage risks and smooth labor market transitions. Taken together, these elements can help create local jobs, ensure economic transitions are just and inclusive, and equip workers and firms to navigate the disruptions and opportunities of a changing climate and changing technologies.Publication Forging Viet Nam's Semiconductor Future: Talent and Innovation Leading the Way(Washington, DC: World Bank, 2025-09-10)Vietnam has prioritized semiconductors as one of ten critical technologies and set explicit goals of becoming a global semiconductor talent hub by 2030, moving up the value chain toward higher value-added segments, and developing a complete semiconductor value chain by 2045. Delivering on that pledge hinges on strategic and urgent investment in top talent, science, and innovation. This report concentrates on the most urgent gap – cultivating a cadre of scientists and engineers (S&E). and, to the extent possible, tech entrepreneurs, to support Vietnam’s semiconductor and high-tech ambitions. The analysis and interventions focus on the highly skilled workforce and frontier talent development, and cover research, innovation, and university-industry linkages in relation to the talent challenges. The report recognizes that to unlock its semiconductor potential, Viet Nam must address other binding constraints, notably: weak linkages between FDI and domestic firms, emerging infrastructure gaps (e.g., energy and logistics), and intellectual property rights regulations, amid evolving geoeconomics conditions.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication The World Bank Group Annual Report 2025(Washington, DC: World Bank, 2025-10-09)The World Bank Group Annual Report 2025 presents on World Bank Group activities in fiscal 2025. The Annual Report is prepared by the Executive Directors of ICSID, IFC, MIGA, and the World Bank (IBRD/IDA) in accordance with the by-laws of the institutions. The President of the World Bank Group and Chairman of the Board of Executive Directors submit the Annual Report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication Gabon Country Climate and Development Report(Washington, DC: World Bank, 2025-11-01)Gabon has a unique opportunity to drive inclusive growth, reduce poverty, and build a resilient post-oil economy, with climate action accelerating progress toward these goals. The country’s main development challenge is achieving higher growth and poverty reduction, as stronger growth is needed regardless of projected climate shocks to create jobs, raise living standards, and enable a viable post-oil economy. While pursuing growth-promoting economic reforms, climate action that prioritizes people must remain central to its development pathway. However, climate change risks exacerbating poverty and regional inequalities in a country already facing long-term challenges in expanding economic opportunities and basic public services, especially in rural areas. Climate shifts compound these challenges, making stronger private sector-led growth driven by reforms essential for resilience, diversification, job creation, and poverty reduction, though targeted investments in adaptation will still be required to mitigate climate shocks. Using a whole-of-economy approach, the Gabon Country Climate Development Report (CCDR) estimates that climate change impacts could result in GDP losses of 3.5 to 5.3 percent per year through 2050 compared to a business-as-usual baseline trajectory.