Publication: When Aggregation Misleads: Bias in Unit-Level Small Area Estimates of Poverty with Aggregate Data
Loading...
Published
2025-05-01
ISSN
Date
2025-05-01
Author(s)
Editor(s)
Abstract
This paper explores why small area poverty estimates from models at the household level that only use aggregate data as covariates, exhibit systematic bias. The analysis demonstrates that this bias stems from the model’s inability to capture the complete between-household variation in welfare, as they rely solely on covariates aggregated at geographic levels. Through model-based simulations, the paper shows that the bias in these models is minimized when the empirical variability of simulated welfare based on the model is closest to the true empirical variance of welfare at the area level. This finding also has implications for bias in unit-level models.
Link to Data Set
Citation
“Corral, Paul. 2025. When Aggregation Misleads: Bias in Unit-Level Small Area Estimates of Poverty with Aggregate Data. Public Research Working Paper; 11110. © World Bank. http://hdl.handle.net/10986/43150 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Marshall Plan: Then and Now(Washington, DC: World Bank, 2025-10-14)This paper is a product of the Development Policy Team, Development Economics. It is part of a larger effort by the World Bank to provide open access to its research and make a contribution to development policy discussions around the world. Policy Research Working Papers are also posted on the Web at http://www.worldbank.org/prwp.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Poverty Mapping in the Age of Machine Learning(World Bank, Washington, DC, 2023-05-04)Recent years have witnessed considerable methodological advances in poverty mapping, much of which has focused on the application of modern machine-learning approaches to remotely sensed data. Poverty maps produced with these methods generally share a common validation procedure, which assesses model performance by comparing subnational machine-learning-based poverty estimates with survey-based, direct estimates. Although unbiased, survey-based estimates at a granular level can be imprecise measures of true poverty rates, meaning that it is unclear whether the validation procedures used in machine-learning approaches are informative of actual model performance. This paper examines the credibility of existing approaches to model validation by constructing a pseudo-census from the Mexican Intercensal Survey of 2015, which is used to conduct several design-based simulation experiments. The findings show that the validation procedure often used for machine-learning approaches can be misleading in terms of model assessment since it yields incorrect information for choosing what may be the best set of estimates across different methods and scenarios. Using alternative validation methods, the paper shows that machine-learning-based estimates can rival traditional, more data intensive poverty mapping approaches. Further, the closest approximation to existing machine-learning approaches, using publicly available geo-referenced data, performs poorly when evaluated against “true” poverty rates and fails to outperform traditional poverty mapping methods in targeting simulations.Publication Migration, Remittances and Forests : Disentangling the Impact of Population and Economic Growth on Forests(2011-12-01)International migration has increased rapidly in recent decades and this has been accompanied by a remarkable increase in transfers made by migrants to their home countries. This paper investigates the effect of the rural economic growth brought about by migration and remittances on Nepal's Himalayan forests. The authors assemble a unique village-panel dataset combining remote sensing data on land use and forest cover change with data from the census and multiple rounds of living standards surveys to test various inter-relationships between population, economic growth and forests. The results suggest that rural economic growth spurred by remittances has had an overall positive impact on forests. The paper also finds that remittances caused an increase in rural wages and an increase in income, but a decrease in land prices. Considered together, however, the relationship between forests and remittances is driven largely through the income channel, indicating that the demand for amenities provided by forests in the rural Nepali setting may have been more important than factor prices in influencing land use changes for the period of the study.Publication Estimating Small Area Population Density Using Survey Data and Satellite Imagery(World Bank, Washington, DC, 2019-03)Country-level census data are typically collected once every 10 years. However, conflict, migration, urbanization, and natural disasters can cause rapid shifts in local population patterns. This study uses Sri Lankan data to demonstrate the feasibility of a bottom-up method that combines household survey data with contemporaneous satellite imagery to track frequent changes in local population density. A Poisson regression model based on indicators derived from satellite data, selected using the least absolute shrinkage and selection operator, accurately predicts village-level population density. The model is estimated in villages sampled in the 2012/13 Household Income and Expenditure Survey to obtain out-of-sample density predictions in the nonsurveyed villages. The predictions approximate the 2012 census density well and are more accurate than other bottom-up studies based on lower-resolution satellite data. The predictions are also more accurate than most publicly available population products, which rely on areal interpolation of census data to redistribute population at the local level. The accuracies are similar when estimated using a random forest model, and when density estimates are expressed in terms of population counts. The collective evidence suggests that combining surveys with satellite data is a cost-effective method to track local population changes at more frequent intervals.Publication Guidelines to Small Area Estimation for Poverty Mapping(Washington, DC : World Bank, 2022-06-16)The eradication of poverty, which was the first of the millennium development goals (MDG) established by the United Nations and followed by the sustainable development goals (SDG), requires knowing where the poor are located. Traditionally, household surveys are considered the best source of information on the living standards of a country’s population. Data from these surveys typically provide a sufficiently accurate direct estimate of household expenditures or income and thus estimates of poverty at the national level and larger international regions. However, when one starts to disaggregate data by local areas or population subgroups, the quality of these direct estimates diminishes. Consequently, national statistical offices (NSOs) cannot provide reliable wellbeing statistical figures at a local level. For example, the module of socioeconomic conditions of the Mexican national survey of household income and expenditure (ENIGH) is designed to produce estimates of poverty and inequality at the national level and for the 32 federate entities (31 states and Mexico City) with disaggregation by rural and urban zones, every two years, but there is a mandate to produce estimates by municipality every five years, and the ENIGH alone cannot provide estimates for all municipalities with adequate precision. This makes monitoring progress toward the sustainable development goals more difficult.Publication Estimating Small Area Poverty and Welfare Indicators in Timor-Leste Using Satellite Imagery Data(World Bank, Washington, DC, 2020-09-28)This report is structured as follows: an in-depth explanation of the FHSAE method is presented in section two. Section three reviews the sub-district level data used in this study, which includes imprecise TL-SLS and DHS direct estimates, as well as satellite imagery data used in this study. The variable selection method used for the FHSAE model in this model is explained in section four. Section five provides the results of the FHSAE exercise on poverty estimates, average real per capita consumption and welfare index, presenting them in the graphical maps. Section six concludes.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Taking Stock, September 2025: Special Focus : Nurturing Viet Nam’s High-tech Talents(Washington, DC: World Bank, 2025-09-04)Following strong momentum in the first half of 2025, driven by front-loaded exports, the Vietnamese economy is expected to moderate over the remainder of the year as export growth normalizes, with a forecast real GDP growth of 6.6 percent in 2025. As an export-oriented economy, Viet Nam remains vulnerable to slower global growth and softening demand from major trading partners. Trade-policy uncertainty may also begin to weigh on business and consumer confidence. Over the medium term, growth is projected to ease to 6.1 percent in 2026 before rebounding to 6.5 percent in 2027, supported by a recovery in global trade and Viet Nam’s continued appeal as a competitive manufacturing base. To support growth and hedge against external uncertainty, the report recommends a focus on scaling up public investment, mitigating financial-sector risks, and advancing structural reforms. The special focus of this edition titled Nurturing Viet Nam’s High Tech Talents” highlights the need to build a skilled talent base that can support and accelerate the country’s innovation ecosystem. Achieving Viet Nam’s high tech ambitions and its goal of high income status by 2045 will require not only a broad and growing pipeline of young STEM graduates, but also a stronger core of experts who lead research, run laboratories, and turn ideas into market-ready products. The report highlights the potential to raise public and private R&D spending in Viet Nam, complementing broader business enabling reforms. Total R&D spending in Viet Nam remains lower than more developed regional peers. There is scope to increase PhD-level faculty to grow the pipeline of advanced-degree graduates and high-caliber researchers. Strengthening university–industry-government linkages could catalyze the development of a work-ready workforce and promote technology transfer and knowledge spillovers.Publication World Bank East Asia and Pacific Economic Update, April 2025: A Longer View(Washington, DC: World Bank, 2025-04-24)East Asia and Pacific (EAP) outpaced most regions in economic growth in 2024. To sustain this momentum and generate jobs, EAP countries must navigate global uncertainty and tackle long-term challenges tied to shifting global integration, climate change, and demographic trends. In its 2025 Regional Economic Update, the World Bank projects that growth in EAP will slow down to 4.0 percent in 2025, compared to 5.0 percent in 2024. Uncertainty around these projections remains high, and growth outcomes will depend on global developments and national policy choices.