Publication: Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment
Loading...
Date
2024-03-26
ISSN
Published
2024-03-26
Author(s)
Editor(s)
Abstract
Survey data on household consumption are often unavailable or incomparable over time in many low- and middle-income countries. Based on a unique randomized survey experiment implemented in Tanzania, this study offers new and rigorous evidence demonstrating that survey-to-survey imputation can fill consumption data gaps and provide low-cost and reliable poverty estimates. Basic imputation models featuring utility expenditures, together with a modest set of predictors on demographics, employment, household assets, and housing, yield accurate predictions. Imputation accuracy is robust to varying the survey questionnaire length, the choice of base surveys for estimating the imputation model, different poverty lines, and alternative (quarterly or monthly) Consumer Price Index deflators. The proposed approach to imputation also performs better than multiple imputation and a range of machine learning techniques. In the case of a target survey with modified (shortened or aggregated) food or non-food consumption modules, imputation models including food or non-food consumption as predictors do well only if the distributions of the predictors are standardized vis-à-vis the base survey. For the best-performing models to reach acceptable levels of accuracy, the minimum required sample size should be 1,000 for both the base and target surveys. The discussion expands on the implications of the findings for the design of future surveys.
Link to Data Set
Citation
“Dang, Hai-Anh; Kilic, Talip; Hlasny, Vladimir; Abanokova, Kseniya; Carletto, Calogero; Abanokova, Ksenia. 2024. Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment. Policy Research Working Paper; 10738. © World Bank. http://hdl.handle.net/10986/41291 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication From Tailwinds to Headwinds(Washington, DC: World Bank, 2025-07-10)The first quarter of the twenty-first century has been transformative for emerging market and developing economies (EMDEs). These economies now account for about 45 percent of global GDP, up from about 25 percent in 2000, a trend driven by robust collective growth in the three largest EMDEs—China, India, and Brazil (the EM3). Collectively, EMDEs have contributed about 60 percent of annual global growth since 2000, on average, double the share during the 1990s. Their ascendance was powered by swift global trade and financial integration, especially during the first decade of the century. Interdependence among these economies has also increased markedly. Today, nearly half of goods exports from EMDEs go to other EMDEs, compared to one-quarter in 2000. As cross-border linkages have strengthened, business cycles among EMDEs and between EMDEs and advanced economies have become more synchronized, and a distinct EMDE business cycle has emerged. Cross-border business cycle spillovers from the EM3 to other EMDEs are sizable, at about half of the magnitude of spillovers from the largest advanced economies (the United States, the euro area, and Japan). Yet EMDEs confront a host of headwinds at the turn of the second quarter of the century. Progress implementing structural reforms in many of these economies has stalled. Globally, protectionist measures and geopolitical fragmentation have risen sharply. High debt burdens, demographic shifts, and the rising costs of climate change weigh on economic prospects. A successful policy approach to accelerate growth and development should focus on boosting investment and productivity, navigating a difficult external environment, and enhancing macroeconomic stability.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Imputing Poverty Indicators without Consumption Data(Washington, DC: World Bank, 2024-08-19)Accurate poverty measurement relies on household consumption data, but such data are often inadequate, outdated, or display inconsistencies over time in poorer countries. To address these data challenges, this paper employs survey-to-survey imputation to produce estimates for several poverty indicators, including headcount poverty, extreme poverty, poverty gap, near-poverty rates, as well as mean consumption levels and the entire consumption distribution. Analysis of 22 multi-topic household surveys conducted over the past decade in Bangladesh, Ethiopia, Malawi, Nigeria, Tanzania, and Viet Nam yields encouraging results. Adding household utility expenditures or food expenditures to basic imputation models with household-level demographic, employment, and asset variables could improve the probability of imputation accuracy by 0.1 to 0.4. Adding predictors from geospatial data could further increase imputation accuracy. The analysis also shows that a larger time interval between surveys is associated with a lower probability of predicting some poverty indicators, and that a better imputation model goodness-of-fit (R2) does not necessarily help. The results offer cost-saving inputs for future survey design.Publication Poverty Imputation in Contexts without Consumption Data(World Bank, Washington, DC, 2021-11)A key challenge with poverty measurement is that household consumption data are often unavailable or infrequently collected or may be incomparable over time. In a development project setting, it is seldom feasible to collect full consumption data for estimating the poverty impacts. While survey-to-survey imputation is a cost-effective approach to address these gaps, its effective use calls for a combination of both ex-ante design choices and ex-post modeling efforts that are anchored in validated protocols. This paper refines various aspects of existing poverty imputation models using 14 multi-topic household surveys conducted over the past decade in Ethiopia, Malawi, Nigeria, Tanzania, and Vietnam. The analysis reveals that including an additional predictor that captures household utility consumption expenditures—as part of a basic imputation model with household-level demographic and employment variables—provides poverty estimates that are not statistically significantly different from the true poverty rates. In many cases, these estimates even fall within one standard error of the true poverty rates. Adding geospatial variables to the imputation model improves imputation accuracy on a cross-country basis. Bringing in additional community-level predictors (available from survey and census data in Vietnam) related to educational achievement, poverty, and asset wealth can further enhance accuracy. Yet, there is within-country spatial heterogeneity in model performance, with certain models performing well for either urban areas or rural areas only. The paper provides operationally-relevant and cost-saving inputs into the design of future surveys implemented with a poverty imputation objective and suggests directions for future research.Publication Data Gaps, Data Incomparability, and Data Imputation(World Bank, Washington, DC, 2017-12)This paper reviews methods that have been employed to estimate poverty in contexts where household consumption data are unavailable or missing. These contexts range from completely missing and partially missing consumption data in cross-sectional household surveys, to missing panel household data. The paper focuses on methods that aim to compare trends and dynamic patterns of poverty outcomes over time. It presents the various methods under a common framework, with pedagogical discussion on the intuition. Empirical illustrations are provided using several rounds of household survey data from Vietnam. Furthermore, the paper provides a practical guide with detailed instructions on computer programs that can be used to implement the reviewed techniques.Publication Educational inequalities during COVID-19: Results from longitudinal surveys in Sub-Saharan Africa(Elsevier, 2025-01-21)While the literature on the COVID-19 pandemic is growing, there are few studies on learning inequalities in a lower-income, multi-country context. Analyzing a rich database consisting of 34 longitudinal household and phone survey rounds from Burkina Faso, Ethiopia, Malawi, Mali, Nigeria, Tanzania, and Uganda with a rigorous linear mixed model framework, we find lower school enrolment rates during the pandemic. But countries exhibit heterogeneity. Our variance decomposition analysis suggests that policies targeting individual household members are most effective for improving learning activities, followed by those targeting households, communities, and regions. Households with higher education levels or living standards or those in urban residences are more likely to engage their children in learning activities and more diverse types of learning activities. Furthermore, we find some evidence for a strong and positive relationship between public transfers and household head employment with learning activities for almost all the countries.Publication Is Climate Change Slowing the Urban Escalator out of Poverty?(World Bank, Washington, DC, 2023-03-30)While urbanization has great potential to facilitate poverty reduction, climate shocks represent a looming threat to such upward mobility. This paper empirically analyzes the effects of climatic risks on the function of urban agglomerations to support poor households to escape from poverty. Combining household surveys with climatic datasets, the panel regression analysis for Chile, Colombia, and Indonesia finds that households in large metropolitan areas are more likely to escape from poverty, indicating better access to economic opportunities in those areas. However, the climate shocks offset such benefits of urban agglomerations, as extreme rainfalls and high flood risks significantly reduce the chance of upward mobility. The findings underscore the need to enhance resilience among the urban poor to allow them to fully utilize the benefits of urban agglomerations.
Users also downloaded
Showing related downloaded files
Publication South Asia Development Update, October 2024: Women, Jobs, and Growth(Washington, DC: World Bank, 2024-10-10)South Asia’s growth is on track to exceed earlier expectations, in a broad-based upturn. The region is expected to remain the fastest-growing among emerging market and developing economies (EMDEs). Several risks could upend this generally promising outlook, including extreme weather events, social unrest, and policy missteps, such as reform delays. But South Asian countries also have considerable untapped potential that could help them further boost productivity growth and employment and adapt to climate change. In particular, with about two-thirds of the region’s working-age women out of the labor force, raising female employment rates to those of men could increase per capita income by as much as one-half. Measures to accelerate job creation, remove obstacles to women working, and equalize gender rights would be more effective if combined with a shift toward social norms that looked more favorably on working women. Also, most South Asian countries rank among the EMDEs least open to global trade and investment. Greater openness could boost women’s employment, spur the growth of firms, and allow the region to take better advantage of the reshaping of global supply chains and trade. Reducing the cost of conducting business could help the region better harness large-scale remittance inflows.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Global Economic Prospects, June 2024(Washington, DC: World Bank, 2024-06-11)After several years of negative shocks, global growth is expected to hold steady in 2024 and then edge up in the next couple of years, in part aided by cautious monetary policy easing as inflation gradually declines. However, economic prospects are envisaged to remain tepid, especially in the most vulnerable countries. Risks to the outlook, while more balanced, are still tilted to the downside, including the possibility of escalating geopolitical tensions, further trade fragmentation, and higher-for-longer interest rates. Natural disasters related to climate change could also hinder activity. Subdued growth prospects across many emerging market and developing economies and continued risks underscore the need for decisive policy action at the global and national levels. Global Economic Prospects is a World Bank Group Flagship Report that examines global economic developments and prospects, with a special focus on emerging market and developing economies, on a semiannual basis (in January and June). Each edition includes analytical pieces on topical policy challenges faced by these economies.