Publication: When Aggregation Misleads: Bias in Unit-Level Small Area Estimates of Poverty with Aggregate Data
Loading...
Published
2025-05-01
ISSN
Date
2025-05-01
Author(s)
Editor(s)
Abstract
This paper explores why small area poverty estimates from models at the household level that only use aggregate data as covariates, exhibit systematic bias. The analysis demonstrates that this bias stems from the model’s inability to capture the complete between-household variation in welfare, as they rely solely on covariates aggregated at geographic levels. Through model-based simulations, the paper shows that the bias in these models is minimized when the empirical variability of simulated welfare based on the model is closest to the true empirical variance of welfare at the area level. This finding also has implications for bias in unit-level models.
Link to Data Set
Citation
“Corral, Paul. 2025. When Aggregation Misleads: Bias in Unit-Level Small Area Estimates of Poverty with Aggregate Data. Public Research Working Paper; 11110. © World Bank. http://hdl.handle.net/10986/43150 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Investing in Human Capital During Wartime: Experimental Evidence from Ukraine(Washington, DC: World Bank, 2025-09-02)This paper provides insights into human capital investments during wartime by presenting evidence from three experiments of an online tutoring program for Ukrainian students amid Russia’s invasion of Ukraine. Conducted between early 2023 and mid-2024, the experiments reached nearly 10,000 students across all regions of Ukraine. The program offered three hours per week of small-group tutoring in math and Ukrainian language over six weeks and used academic and psychosocial tools to address student challenges at different intensities of disruption. Results show that the program led to substantial improvements in learning—up to 0.49 standard deviations in math and 0.40 standard deviations in Ukrainian language—and consistent reductions in stress—up to 0.12 standard deviations. High take-up and engagement rates were observed, and four mechanisms were identified as drivers of impact: structured peer interactions, improved attitudes toward learning, enhanced socio-emotional skills, and increased student investments. A complementary experiment using information nudges to increase parental engagement highlights challenges in promoting parental investments in a conflict setting. The program was cost-effective across all experiments, with benefit-to-cost ratios ranging from 31 to 56, and scalable given its reliance on existing infrastructure and teaching capacity.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Children in Monetary Poor Households: Global, Regional, and Select National Trends in the Progress against Child Poverty(Washington, DC: World Bank, 2025-09-05)This paper presents the first estimates of extreme child poverty and child poverty using the World Bank’s recently revised international poverty lines. Using the international poverty line of $3.00 per day and the higher $8.30 per day poverty line (both expressed in 2021 purchasing power parity), the paper provides new results of the global and regional trends over 2014–24. The estimates show that 19.2 percent of children, approximately 412 million children, were living on less than $3.00 (2021 PPP) per day as of 2024, a reduction from 507 million children in 2014. This long-term decrease was slower than that for the general population. At the higher line of $8.30, the child poverty rate in 2024 was 65.9 percent, representing around 1.4 billion children, a drop from the 73.1 percent registered in 2014. At the regional level, the East Asia and Pacific and South Asia regions witnessed significant reductions in child poverty and extreme child poverty between 2014 and 2024, and the Europe and Central Asia and Latin America and the Caribbean regions showed reductions mostly in child poverty. In the same period, there was an increase in extreme child poverty in the Middle East and North Africa region. Sub-Saharan Africa experienced a “lost decade” of child poverty reduction between 2014 and 2024, increasing its concentration of global poverty. In 2024, Sub-Saharan Africa hosted more than three-quarters of children in extreme poor households (more than 311 million children), although its share of the global child population was around 23 percent. Country-level results show evidence of regional heterogeneity in progress against extreme child poverty.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Poverty Mapping in the Age of Machine Learning(World Bank, Washington, DC, 2023-05-04)Recent years have witnessed considerable methodological advances in poverty mapping, much of which has focused on the application of modern machine-learning approaches to remotely sensed data. Poverty maps produced with these methods generally share a common validation procedure, which assesses model performance by comparing subnational machine-learning-based poverty estimates with survey-based, direct estimates. Although unbiased, survey-based estimates at a granular level can be imprecise measures of true poverty rates, meaning that it is unclear whether the validation procedures used in machine-learning approaches are informative of actual model performance. This paper examines the credibility of existing approaches to model validation by constructing a pseudo-census from the Mexican Intercensal Survey of 2015, which is used to conduct several design-based simulation experiments. The findings show that the validation procedure often used for machine-learning approaches can be misleading in terms of model assessment since it yields incorrect information for choosing what may be the best set of estimates across different methods and scenarios. Using alternative validation methods, the paper shows that machine-learning-based estimates can rival traditional, more data intensive poverty mapping approaches. Further, the closest approximation to existing machine-learning approaches, using publicly available geo-referenced data, performs poorly when evaluated against “true” poverty rates and fails to outperform traditional poverty mapping methods in targeting simulations.Publication Migration, Remittances and Forests : Disentangling the Impact of Population and Economic Growth on Forests(2011-12-01)International migration has increased rapidly in recent decades and this has been accompanied by a remarkable increase in transfers made by migrants to their home countries. This paper investigates the effect of the rural economic growth brought about by migration and remittances on Nepal's Himalayan forests. The authors assemble a unique village-panel dataset combining remote sensing data on land use and forest cover change with data from the census and multiple rounds of living standards surveys to test various inter-relationships between population, economic growth and forests. The results suggest that rural economic growth spurred by remittances has had an overall positive impact on forests. The paper also finds that remittances caused an increase in rural wages and an increase in income, but a decrease in land prices. Considered together, however, the relationship between forests and remittances is driven largely through the income channel, indicating that the demand for amenities provided by forests in the rural Nepali setting may have been more important than factor prices in influencing land use changes for the period of the study.Publication Estimating Small Area Population Density Using Survey Data and Satellite Imagery(World Bank, Washington, DC, 2019-03)Country-level census data are typically collected once every 10 years. However, conflict, migration, urbanization, and natural disasters can cause rapid shifts in local population patterns. This study uses Sri Lankan data to demonstrate the feasibility of a bottom-up method that combines household survey data with contemporaneous satellite imagery to track frequent changes in local population density. A Poisson regression model based on indicators derived from satellite data, selected using the least absolute shrinkage and selection operator, accurately predicts village-level population density. The model is estimated in villages sampled in the 2012/13 Household Income and Expenditure Survey to obtain out-of-sample density predictions in the nonsurveyed villages. The predictions approximate the 2012 census density well and are more accurate than other bottom-up studies based on lower-resolution satellite data. The predictions are also more accurate than most publicly available population products, which rely on areal interpolation of census data to redistribute population at the local level. The accuracies are similar when estimated using a random forest model, and when density estimates are expressed in terms of population counts. The collective evidence suggests that combining surveys with satellite data is a cost-effective method to track local population changes at more frequent intervals.Publication Guidelines to Small Area Estimation for Poverty Mapping(Washington, DC : World Bank, 2022-06-16)The eradication of poverty, which was the first of the millennium development goals (MDG) established by the United Nations and followed by the sustainable development goals (SDG), requires knowing where the poor are located. Traditionally, household surveys are considered the best source of information on the living standards of a country’s population. Data from these surveys typically provide a sufficiently accurate direct estimate of household expenditures or income and thus estimates of poverty at the national level and larger international regions. However, when one starts to disaggregate data by local areas or population subgroups, the quality of these direct estimates diminishes. Consequently, national statistical offices (NSOs) cannot provide reliable wellbeing statistical figures at a local level. For example, the module of socioeconomic conditions of the Mexican national survey of household income and expenditure (ENIGH) is designed to produce estimates of poverty and inequality at the national level and for the 32 federate entities (31 states and Mexico City) with disaggregation by rural and urban zones, every two years, but there is a mandate to produce estimates by municipality every five years, and the ENIGH alone cannot provide estimates for all municipalities with adequate precision. This makes monitoring progress toward the sustainable development goals more difficult.Publication Estimating Small Area Poverty and Welfare Indicators in Timor-Leste Using Satellite Imagery Data(World Bank, Washington, DC, 2020-09-28)This report is structured as follows: an in-depth explanation of the FHSAE method is presented in section two. Section three reviews the sub-district level data used in this study, which includes imprecise TL-SLS and DHS direct estimates, as well as satellite imagery data used in this study. The variable selection method used for the FHSAE model in this model is explained in section four. Section five provides the results of the FHSAE exercise on poverty estimates, average real per capita consumption and welfare index, presenting them in the graphical maps. Section six concludes.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Taking Stock, March 2025: Electrifying Journeys(Washington, DC: World Bank, 2025-03-12)Viet Nam’s real GDP growth reached 7.1 percent in 2024, driven by a strong rebound in exports, outpacing most regional peers. External demand strongly rebounded in 2024 after a contraction in 2023. Final consumption and investment growth also accelerated in 2024 reaching 6.6 and 7.2 percent, respectively, supporting the growth momentum. However, private consumption remained a moderate driver of aggregate demand relative to the region (54 percent of GDP compared to a median of 61.7 percent, respectively) as household savings increased amid heightened uncertainty in recent years. Viet Nam’s GDP growth is forecast to moderate to 6.8 percent in 2025 before settling at 6.5 percent in 2026. The rebound in exports in 2024 is expected to ease in 2025 and further into 2026 due to projected economic slowdown in China and the United States in the near-team - Viet Nam’s largest trade partners – and uncertain global trade prospects from shifts in trade policy. Domestic activities and services are expected to continue to firm up in 2025 and into 2026 as the real estate market recovery gathers steam. The outlook for Viet Nam remains positive but with heightened uncertainties. Given Viet Nam’s openness to the global economy, the main uncertainty stems from slower-than-expected global growth and trade disruptions, particularly among major trading partners such as the United States, European Union, and China. Such developments, including heightened uncertainties from trade policy shifts and deepening trade fragmentation, could impact Viet Nam’s manufacturing exports, industrial production, and growth. On the other hand, increased public investment could further support demand and contribute to growth. An accelerated recovery in the real estate market thanks to faster project clearance could further boost domestic demand. The special focus of this edition focuses on preparing e-mobility transition in the transport sector. This analysis examines the critical steps required to decarbonize road transportation in Vietnam by using electric vehicles and rolling out a network of public charging stations. It explores the implications of this transition on electricity demand, greenhouse gas emissions, and job creation. The report presents a set of recommendations to achieve the Government’s ambitious target of having 50 percent of urban vehicles and 100 percent of urban buses and taxis powered by electricity or green energy by 2030, and subsequently reaching 100 percent for all road vehicles by 2050.