Publication: New Algorithm to Estimate Inequality Measures in Cross-Survey Imputation: An Attempt to Correct the Underestimation of Extreme Values
Loading...
Date
2022-04
ISSN
Published
2022-04
Author(s)
Editor(s)
Abstract
This paper contributes to the debate on ways to improve the calculation of inequality measures in developing countries experiencing severe budget constraints. Linear regression-based survey-to-survey imputation techniques are most frequently discussed in the literature. These are effective at estimating predictions of poverty indicators but are much less accurate with inequality indicators. To demonstrate this limited accuracy, the first part of the paper discusses several simulations using Moroccan Household Budget Surveys and Labor Force Surveys. The paper proposes a method for overcoming these limitations based on an algorithm that minimizes the sum of the squared difference between a certain number of direct estimates of an index and its empirical version obtained from the predicted values. Indeed, when comparing the estimated results with those directly estimated from the original sample, the bias is negligible. Furthermore, the inequality indices for the years for which there are only model estimates, rather than direct information on expenditures, seem to be consistent with Moroccan economic trends.
Link to Data Set
Citation
“Betti, Gianni; Molini, Vasco; Mori, Lorenzo. 2022. New Algorithm to Estimate Inequality Measures in Cross-Survey Imputation: An Attempt to Correct the Underestimation of Extreme Values. Policy Research Working Paper;10013. © World Bank. http://hdl.handle.net/10986/37329 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication Exports, Labor Markets, and the Environment(Washington, DC: World Bank, 2025-07-14)What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers(Washington, DC: World Bank, 2025-07-14)This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Using Poverty Maps to Improve the Design of Household Surveys(World Bank, Washington, DC, 2021-05)This paper proposes a new method for improving the design effect of household surveys based on a two-stage design in which the first stage clusters, or primary selection units, are stratified along administrative boundaries. Improvement of the design effect can result in more precise survey estimates (smaller standard errors and confidence intervals) or reduction of the necessary sample size, that is, a reduction in the budget needed for a survey. The proposed method is based on the availability of a previously conducted poverty mapping, that is, spatial descriptions of the distribution of poverty, which are finely disaggregated in small geographic units, such as cities, municipalities, districts, or other administrative partitions of a country that are linked to primary selection units. Such information is then used to select primary selection units with systematic sampling by introducing further implicit stratification in the survey design, to maximize the improvement of the design effect. The proposed methodology has been implemented for the new 2021 Household Budget Survey in Tunisia, conducted under a cooperation project funded by the World Bank. The underlying poverty mapping is based on the 2015 Household Budget Survey and the 2014 Population and Housing Census.Publication Appraising Cross-National Income Inequality Databases(World Bank, Washington, DC, 2015-11)In response to a growing interest in comparing inequality levels and trends across countries, several cross-national inequality databases are now available. These databases differ considerably in purpose, coverage, data sources, inclusion and exclusion criteria, and quality of documentation. A special issue of the Journal of Economic Inequality, which this paper introduces, is devoted to an assessment of the merits and shortcomings of eight such databases. Five of these sets are microdata-based: CEPALSTAT, Income Distribution Database, Luxembourg Income Study, PovcalNet, and Socio-Economic Database for Latin America and the Caribbean. Two are based on secondary sources: All the Ginis and the World Income Inequality Database; and one is generated entirely through multiple-imputation methods: the Standardized World Income Inequality Database. Although there is much agreement across these databases, there is also a nontrivial share of country/year cells for which substantial discrepancies exist. In some cases, different databases would lead users to radically different conclusions about inequality dynamics in certain countries and periods. The methodological differences that lead to these discrepancies often appear to be driven by a fundamental trade-off between a wish for broader coverage on the one hand, and for greater comparability on the other hand. These differences across databases place considerable responsibility on both producers and users: on the former, to better document and explain their assumptions and procedures, and on the latter, to understand the data they are using, rather than merely taking them as true because available.Publication Imputed Welfare Estimates in Regression Analysis(World Bank, Washington, D.C., 2004-04)The authors discuss the use of imputed data in regression analysis, in particular the use of highly disaggregated welfare indicators (from so-called "poverty maps"). They show that such indicators can be used both as explanatory variables on the right-hand side and as the phenomenon to explain on the left-hand side. The authors try out practical ways of adjusting standard errors of the regression coefficients to reflect the error introduced by using imputed, rather than actual, welfare indicators. These are illustrated by regression experiments based on data from Ecuador. For regressions with imputed variables on the left-hand side, the authors argue that essentially the same aggregate relationships would be found with either actual or imputed variables. They address the methodological question of how to interpret aggregate relationships found in such regressions.Publication Estimating Poverty in the Absence of Consumption Data : The Case of Liberia(World Bank Group, Washington, DC, 2014-09)In much of the developing world, the demand for high frequency quality household data for poverty monitoring and program design far outstrips the capacity of the statistics bureau to provide such data. In these environments, all available data sources must be leveraged. Most surveys, however, do not collect the detailed consumption data necessary to construct aggregates and poverty lines to measure poverty directly. This paper benefits from a shared listing exercise for two large-scale national household surveys conducted in Liberia in 2007 to explore alternative methodologies to estimate poverty indirectly. The first is an asset-based model that is commonly used in Demographic and Health Surveys. The second is a survey-to-survey imputation that makes use of small area estimation techniques. In addition to a standard base model, separate models are estimated for urban and rural areas and an expanded model that includes climatic variables. Special attention is paid to the inclusion of cell phones, with implications for other assets whose cost and availability may be changing rapidly. The results demonstrate substantial limitations with asset-based indexes, but also leave questions as to the accuracy and stability of imputation models.Publication Poverty in Mozambique : New Evidence from Recent Household Surveys(World Bank, Washington, DC, 2012-10)This paper has three primary objectives: (i) to investigate potential problems regarding Mozambique's most recent nationally representative household survey on poverty dynamics; (ii) to assess the robustness and reliability of official poverty statistics; and (iii) to provide alternative estimates of poverty and welfare indicators in light of the methodological and analytical issues raised in areas (i) and (ii). It is determined that at least two significant weaknesses affect the official poverty-rate estimates: measurement errors in consumption data and flaws in the methodology used to calculate poverty lines (the cost-of-basic-needs approach based on provincial food bundles with entropy correction). A number of observations appear to be affected by substantial measurement errors, which severely distort the official poverty statistics. The paper provides methods to correct the consumption distribution by recalculating poverty lines based on a single national food basket -- as opposed to the current estimates, which are based on province-specific food baskets. The revised poverty statistics differ considerably from the official estimates of poverty across provinces and are far more consistent with other poverty indicators. In addition, poverty appears to be highly concentrated in certain areas, with dramatically higher rates found in Central and Northern Mozambique, as well as in rural areas overall, compared with relatively low rates in Southern Mozambique and in the country's urban centers. These findings substantially contradict the government's official poverty figures, which appear to systematically overestimate poverty rates in Mozambique's Southern provinces and urban areas while simultaneously underestimating the prevalence of poverty in the country's Central and Northern regions and in rural areas nationwide.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2017(Washington, DC: World Bank, 2017-01-30)Why are carefully designed, sensible policies too often not adopted or implemented? When they are, why do they often fail to generate development outcomes such as security, growth, and equity? And why do some bad policies endure? This book addresses these fundamental questions, which are at the heart of development. Policy making and policy implementation do not occur in a vacuum. Rather, they take place in complex political and social settings, in which individuals and groups with unequal power interact within changing rules as they pursue conflicting interests. The process of these interactions is what this Report calls governance, and the space in which these interactions take place, the policy arena. The capacity of actors to commit and their willingness to cooperate and coordinate to achieve socially desirable goals are what matter for effectiveness. However, who bargains, who is excluded, and what barriers block entry to the policy arena determine the selection and implementation of policies and, consequently, their impact on development outcomes. Exclusion, capture, and clientelism are manifestations of power asymmetries that lead to failures to achieve security, growth, and equity. The distribution of power in society is partly determined by history. Yet, there is room for positive change. This Report reveals that governance can mitigate, even overcome, power asymmetries to bring about more effective policy interventions that achieve sustainable improvements in security, growth, and equity. This happens by shifting the incentives of those with power, reshaping their preferences in favor of good outcomes, and taking into account the interests of previously excluded participants. These changes can come about through bargains among elites and greater citizen engagement, as well as by international actors supporting rules that strengthen coalitions for reform.Publication Finance and Prosperity 2024(Washington, DC: World Bank, 2024-08-29)While financial sector risks in the larger and higher per capita countries are moderate, half of lower-income countries face significant risks over the next 12 months. Nearly 70 percent of countries facing high financial sector risks are currently not adequately prepared to handle financial stress. The report also identifies a particular risk facing financial sectors in several countries: a large and growing exposure to sovereign debt. This exposure surged to its highest level in the past decade. Finally, the report looks at how countries can enable more climate finance through the banking sector without compromising on the important goals of financial sector stability and inclusion for underserved people.Publication World Development Report 2004(World Bank, 2003)Too often, services fail poor people in access, in quality, and in affordability. But the fact that there are striking examples where basic services such as water, sanitation, health, education, and electricity do work for poor people means that governments and citizens can do a better job of providing them. Learning from success and understanding the sources of failure, this year’s World Development Report, argues that services can be improved by putting poor people at the center of service provision. How? By enabling the poor to monitor and discipline service providers, by amplifying their voice in policymaking, and by strengthening the incentives for providers to serve the poor. Freedom from illness and freedom from illiteracy are two of the most important ways poor people can escape from poverty. To achieve these goals, economic growth and financial resources are of course necessary, but they are not enough. The World Development Report provides a practical framework for making the services that contribute to human development work for poor people. With this framework, citizens, governments, and donors can take action and accelerate progress toward the common objective of poverty reduction, as specified in the Millennium Development Goals.Publication Unlocking the Power of Healthy Longevity(Washington, DC: World Bank, 2024-09-12)Noncommunicable diseases (NCDs) are among the major health and development challenges of our time. Every year, about 41 million people die due to NCDs. This makes up about 74 percent of all deaths globally, the majority of which are in low- and middle-income countries (LMICs). Countless more people live with NCDs every day. Yet, NCDs are largely treatable and preventable. The risk of developing NCDs and deaths from them can both be lowered with appropriate attention to prevention and treatment. However, weak health systems and limited access to affordable care and information, especially in LMICs, contribute to lapses in seeking and receiving appropriate and timely care. This compendium is a compilation of 18 chapters, each exploring a different but related topic in the nexus of NCDs, human capital, and productivity. It is based on a series of analytical work taken up by the World Bank to support the Healthy Longevity Initiative (HLI) - a collaborative effort between the World Bank, the University of Toronto, and key academic and development partners including the Harvard University and the University of Washington. The HLI presents one of a growing set of efforts to increase the urgency of policy response to NCDs across the world.Publication Choosing Our Future(Washington, DC: World Bank, 2024-09-04)Education can propel faster and better climate action in two crucial ways. First, education can galvanize behavior change at scale - not just for tomorrow, but also for today. Second, education can unlock skills and innovation to shift economies onto greener trajectories for growth. At the same time, education needs to be protected from climate change. Extreme climate events and temperatures are already eroding hard-won progress on schooling and learning. Climate change is causing school closures, learning losses, and dropouts. These will turn into long-run inter-generational earnings losses putting into jeopardy education’s powerful potential for spurring poverty alleviation and economic growth. Governments can act now to adapt schools for climate change in cost-effective ways. This report outlines new data, evidence, and examples on how countries can harness education to propel climate action. It provides an actionable policy agenda to meet development, education, and climate goals together, recognizing that tackling climate change requires changes to individual beliefs, behaviors, and skills – changes that education is uniquely positioned to catalyze.