Publication: Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail
Loading...
Published
2025-08-21
ISSN
Date
2025-08-21
Author(s)
Editor(s)
Abstract
Accurate and timely poverty measurement is central to development policy, yet the availability of up-to-date high-quality household survey data remains limited—particularly in countries where poverty is most concentrated. Survey-to-survey imputation has emerged as a practical response to this challenge, allowing practitioners to update poverty estimates using recent surveys that lack direct welfare measures by borrowing information from other comprehensive surveys. A critical review of the method is provided, revisiting its statistical underpinnings and testing its limitations through extensive model-based simulations. Through these simulations, the analysis demonstrates how violations of parameter stability, omitted variable bias, and shifts in survey design can introduce substantial errors—particularly when imputing across time or under economic and structural change. Results show that standard corrections such as re-weighting or covariate standardization may fail to eliminate these biases, especially when imputing across time or under structural change. The performance of alternative model specifications is also evaluated under various methods, including performance under heteroskedastic errors, non-normality. The findings offer practical guidance for practitioners on when survey-to-survey imputation is likely to succeed, when it should be reconsidered, and how to communicate its limitations transparently in the context of poverty monitoring and policy design.
Link to Data Set
Citation
“Corral, Paul; Ham, Andres; Lanjouw, Peter; Lucchetti, Leonardo; Stemmler, Henry. 2025. Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail. Policy Research Working Paper; 11192. © World Bank. http://hdl.handle.net/10986/43629 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication Engineering Ukraine’s Wirtschaftswunder(Washington, DC: World Bank, 2025-07-29)As Ukraine emerges from the devastation of war, it faces a historic opportunity to engineer its own Wirtschaftswunder—a productivity-driven economic transformation akin to post-war West Germany. While investment-led growth may offer quick wins, it is efficiency, innovation, and institutional reform that will determine Ukraine’s long-term economic trajectory. Drawing on rich micro-level firm data spanning 25 years, this paper uncovers deep structural distortions that have suppressed creative destruction and productivity in Ukraine. It finds that business dynamism is on the decline, alongside rising market concentration among incumbent businesses, including low productivity state owned enterprises. To inform priorities for reviving business dynamism, this study develops a model of creative destruction drawing on Acemoglu et al. (2018) and Akcigit et al. (2021). The quantitative assessment highlights that policies that discipline entrenched incumbents are the bedrock for reviving business dynamism and engineer Ukraine’s Wirtschaftswunder. Policies targeting specific types of firms have limited efficacy when incumbents run wild.Publication Fiscal Multipliers in Resource-Rich Economies: Evidence from the Gulf Countries(Washington, DC: World Bank, 2025-08-21)This paper utilizes the unique dynamics of fiscal budgeting in countries with a large hydro-carbon sector to estimate fiscal multipliers. The main identifying assumption rests on the idea that exogenously identified global hydrocarbon demand shocks can be considered plausible instruments for the fiscal space of countries in which that space is significantly dictated by hydrocarbon income, with such shocks being uncorrelated with non-hydrocarbon output at the same time. Using a local projection-instrumental variables (LP-IV) framework, the paper estimates that short-run fiscal expenditure multipliers to be in the ballpark of 0.1–0.4. In addition, the findings show that multipliers are at the upper end of this interval during recessions, indicating that fiscal policy in the Gulf countries is particularly effective during economic downturns.Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication The Impact of Knowledge and Deliberative Processes on Local Spending Preferences for Climate Action(Washington, DC: World Bank, 2025-08-19)The success of climate adaptation and mitigation often depends on support from local communities. Yet, it remains unclear what strategies are most effective to inform and activate support for climate action. This paper presents the results of a randomized controlled trial in Indonesia that evaluated how local climate information and different facilitation strategies for group decision-making on local development spending impacted preferences for climate adaptation and mitigation. In the first treatment, participants watched an educational video on climate change and a presentation on local climate vulnerabilities; in the second, they discussed and voted on spending priorities for local development funds after receiving the same educational materials; and in the third, they deliberated over group spending priorities after receiving the educational materials, discussing, and voting. The findings show that participants who engaged in deliberation about the allocation of local funding demonstrated significantly greater support for climate adaptation and mitigation actions as compared to all other groups. Further, they showed a statistically significant increase in their preferences for climate action after the intervention. The findings demonstrate the importance of sharing accessible information and using deliberative approaches to foster local support for climate action.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Updating Poverty Estimates at Frequent Intervals in the Absence of Consumption Data : Methods and Illustration with Reference to a Middle-Income Country(World Bank Group, Washington, DC, 2014-09)Obtaining consistent estimates on poverty over time as well as monitoring poverty trends on a timely basis is a priority concern for policy makers. However, these objectives are not readily achieved in practice when household consumption data are neither frequently collected, nor constructed using consistent and transparent criteria. This paper develops a formal framework for survey-to-survey poverty imputation in an attempt to overcome these obstacles, and to elevate the discussion of these methods beyond the largely ad-hoc efforts in the existing literature. The framework introduced here imposes few restrictive assumptions, works with simple variance formulas, provides guidance on the selection of control variables for model building, and can be generally applied to imputation either from one survey to another survey with the same design, or to another survey with a different design. Empirical results analyzing the Household Expenditure and Income Survey and the Unemployment and Employment Survey in Jordan are quite encouraging, with imputation-based poverty estimates closely tracking the direct estimates of poverty.Publication Imputed Welfare Estimates in Regression Analysis(World Bank, Washington, D.C., 2004-04)The authors discuss the use of imputed data in regression analysis, in particular the use of highly disaggregated welfare indicators (from so-called "poverty maps"). They show that such indicators can be used both as explanatory variables on the right-hand side and as the phenomenon to explain on the left-hand side. The authors try out practical ways of adjusting standard errors of the regression coefficients to reflect the error introduced by using imputed, rather than actual, welfare indicators. These are illustrated by regression experiments based on data from Ecuador. For regressions with imputed variables on the left-hand side, the authors argue that essentially the same aggregate relationships would be found with either actual or imputed variables. They address the methodological question of how to interpret aggregate relationships found in such regressions.Publication Intra-generational Mobility and Repeated Cross-Sections : A Three-country Validation Exercise(2011-12-01)This paper validates a recently proposed method to estimate intra-generational mobility through repeated cross-sectional surveys. The technique allows the creation of a "synthetic panel" -- done by predicting future or past household income using a set of simple modeling and error structure assumptions -- and thus permits the estimation of lower and upper bounds on directional mobility measures. The authors validate the approach in three different settings where good panel data also exist (Chile, Nicaragua, and Peru). In doing so, they also carry out a number of refinements to the validation procedure. The results are broadly encouraging: the methodology performs well in all three settings, especially in cases where richer model specifications can be estimated. The technique does equally well in predicting short and long-term mobility patterns and is robust to a broad set of additional "stress" and sensitivity tests. Overall, the paper lends support to the application of this approach to settings where panel data are absent.Publication Measuring Poverty in Latin America and the Caribbean(World Bank, Washington, DC, 2016-04)This paper contributes to the methodological literature on the estimation of poverty lines for country poverty comparisons in Latin America and the Caribbean. The paper exploits a unique, comprehensive data set of 86 up-to-date urban official extreme and moderate poverty lines across 18 countries in Latin America and the Caribbean, as well as the recent values of the national purchasing power parity conversion factors from the 2011 International Comparison Program and a set of harmonized household surveys that are part of the Socio-Economic Database for Latin America and the Caribbean project. Because of the dispersion of country-specific poverty lines, the paper concludes that the value of a regional poverty line largely depends on the selected aggregation method, which ends up having a direct impact on the estimation of regional extreme and moderate poverty headcounts.Publication Small Area Estimation-Based Prediction Methods to Track Poverty : Validation and Applications(2011-06-01)Tracking poverty is predicated on the availability of comparable consumption data and reliable price deflators. However, regular series of strictly comparable data are only rarely available. Price deflators are also often missing or disputed. In response, poverty prediction methods that track consumption correlates as opposed to consumption itself have been developed. These methods typically assume that the estimated relation between consumption and its predictors is stable over time -- an assumption that cannot usually be tested directly. This study analyzes the performance of poverty prediction models based on small area estimation techniques. Predicted poverty estimates are compared with directly observed levels in two country settings where data comparability over time is not a problem. Prediction models that employ either non-staple food or non-food expenditures or a full set of assets as predictors are found to yield poverty estimates that match observed poverty well. This offers some support to the use of such methods to approximate the evolution of poverty. Two further country examples illustrate how an application of the method employing models based on household assets can help to adjudicate between alternative price deflators.
Users also downloaded
Showing related downloaded files
Publication Mapping Impact In Chad(Washington, DC: World Bank, 2025-06-25)In the Sahel, Adaptive Social Protection (ASP) is a set of social protection policies, systems, and programs that promote human capital, productivity, and resilience of the poorest and strengthen their capacity to prepare for, cope with, and adapt to shocks. Through the delivery of regular social safety nets, productive inclusion interventions, and shock-responsive programs, ASP has demonstrated strong positive impacts on various dimensions in the Sahel. For the poorest and most vulnerable, it has resulted in improvements in household welfare and food security, productivity, and resilience. More broadly, it has shown significant positive impacts on the economy, society, and future generations.Publication Port Reform Toolkit(Washington, DC: World Bank, 2025-07-31)Ports are undergoing constant transformation, induced by changes in the global economy, technology, or the environment. Port reform is influenced by factors that include aspirations for change underpinned by complex internal and external drivers. In a sector where public and private interests must work together, closely managing change is important. Having the right tools is key for a successful port reform and improvement process which enables economic growth, creates jobs, and fosters sustainable development. For over two decades, the Port Reform Toolkit has been one of the most comprehensive guides for implementing port reforms. Along the way, the Toolkit has evolved in response to changing sectoral trends. The first edition, published in 2001, established a common language for policymakers and port industry stakeholders. It has since become the established reference for port privatization, labor, and modernization programs. Further experiences from a first wave of port reforms in Latin America, Africa, and Asia in the 1990s and early 2000s informed the second edition of the Toolkit, which was released in 2007. By that time, ports in developing economies had attracted over 21 billion dollars in investments from over 200 public-private partnership projects. In this context, the Port Reform Toolkit enabled port stakeholders to provide strategic advice to governments and the private sector.Publication Migration: Africa’s Untapped Potential(Washington, DC: World Bank, 2025-08-21)Migration in Africa is primarily driven by the search for economic opportunity, safety, and security, including from environmental hardships. However, migration’s potential to uplift African livelihoods remains largely untapped. While nearly 15 percent of the world’s migrant population is from Sub-Saharan Africa, two-thirds of Sub-Saharan migrants stay within Africa, and the majority move within regional economic communities. Africa is also home to a quarter of the world’s refugees, primarily hosted in neighboring countries. Africa is now at a pivotal crossroads. With a rapidly growing young population facing economic stagnation, conflict, and climate change, the continent’s workforce is expected to increase by 600 million people by 2050, making up a third of the world’s youth. In contrast, labor forces in high-income and upper-middle-income countries are set to decline by 200 million. This demographic divergence opens a window of opportunity for Africa to enhance its migration management systems. Realizing the potential of migration requires deliberate policies to address challenges and maximize the benefits of migration for both origin and destination countries, as well as for the migrants. Investing in migration systems can better support migrants across the migration cycle, from developing skills in demand domestically, regionally, and globally to ensuring dignity and safety in transit or at their destination. Increasing the number of legal migration pathways is crucial to disincentivize irregular movements and foster safe, orderly migration. Effective migration management also includes promoting integration in host societies and facilitating voluntary returns. This can be achieved through instruments such as bilateral labor migration agreements with destination countries. Entering these agreements as a unified bloc would strengthen individual countries’ bargaining power, improve conditions for migrants, and maximize the economic benefits of migration. Additionally, the empowerment and self-reliance of refugees and internally displaced persons call for increased collaboration among African nations.Publication Algeria Economic Update, Spring 2025(Washington, DC: World Bank, 2025-06-20)Algeria’s economic growth remained robust in 2024 but is expected to slow moderately in 2025. Strong investment momentum and robust growth in household consumption, both fueled by government spending, supported manufacturing and services activity, while agricultural production accelerated. However, growth in domestic demand boosted imports, which, combined with lower hydrocarbon production and exports, weighed on growth. Overall, non-hydrocarbon GDP grew at a pace of 4.8 percent, offsetting the 1.4 percent contraction in GDP from hydrocarbons. Real GDP growth is projected at 3.3 percent in 2025, driven by the rebound in growth in the hydrocarbon sectors (+1.6 percent), boosted by the recovery of OPEC production quotas and gas production. Non-hydrocarbon growth is expected to slow (+3.6 percent), driven by the expected consolidation of public spending, which would be more marked for investment. Agricultural production is expected to remain robust despite limited rainfall, offsetting the slowdown in industry and services. The analysis of productivity trends in different sectors offers avenues for reflection to accelerate the structural transformation of the Algerian economy. The public-spending-led growth model resulted in important economic and social achievements in the 2000s, before slowing down in the last decade as the pace of spending growth became unsustainable. In doing so, this growth model has steered employment to low-value-added sectors, including non-commercial services and construction. In addition, a comparative analysis of Algerian productivity suggests a heterogeneous performance, with strong momentum in the agricultural sector contrasting with limited gains in the manufacturing sector. Thus, a growth acceleration could be achieved by increasing productivity gains in the manufacturing and services sectors, on the one hand, and a gradual reallocation of employment to high-value-added sectors on the other, combined with a gradual rebalancing of public spending. Such an economic transformation calls for targeted cross-cutting and sectoral policies to support growth and jobs in the private sector, while equipping workers with the necessary skills.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.