Publication: How Well Did Real-Time Indicators Track Household Welfare Changes in Developing Countries during the COVID-19 Crisis?
Loading...
Published
2024-09-23
ISSN
Date
2024-09-23
Editor(s)
Abstract
This paper investigates the extent to which real-time indicators derived from internet search, cell phones, and satellites predict changes in household socioeconomic indicators across approximately 300 administrative level-1 regions in 20 countries during the COVID-19 crisis. Measures of changes in socioeconomic status in each region are taken from high-frequency phone surveys. When using the first wave of data, fielded between April and August 2020, models selected using the least absolute shrinkage and selection operator explain 37 percent of the cross-regional variation in the share of households reporting declines in total income and 34 percent of the share of respondents reporting work stoppages since the onset of the crisis. Real-time indicators explain a lower amount of the within-region variation in income losses and current employment over time, with an R2 of 15 percent for current employment and 22 to 26 percent for the prevalence of income declines. When limiting the sample to urban regions, real-time indicators are far more effective at explaining within-region variation in income losses and current employment, with R2 values of approximately 0.54 and 0.38, respectively. Income gains, self-reported food insecurity, social distancing behavior, and child school engagement are more difficult to predict, with R2 values ranging from 0.06 to 0.17. Google search terms related to food, money, jobs, and religion were the most powerful predictors of work stoppage and income declines in the first survey wave, while those related to food, exercise, and religion better tracked changes in income declines and employment over time. Google mobility measures are also strong predictors of changes in employment and the prevalence of specific types of income declines. In general, satellite data on vegetation, pollution, and nighttime lights are far less predictive. Google mobility and search data, and to a lesser extent vegetation and pollution data, can provide a meaningful signal of regional economic distress and recovery, particularly during the early phases of a major crisis such as COVID-19.
Link to Data Set
Citation
“Newhouse, David; Swindle, Rachel; Wang, Shun; Merfeld, Joshua D.; Pape, Utz; Tafere , Kibrom; Weber, Michael. 2024. How Well Did Real-Time Indicators Track Household Welfare Changes in Developing Countries during the COVID-19 Crisis?. Policy Research Working Paper; 10916. © World Bank. http://hdl.handle.net/10986/42188 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Higher Education Expansion and Firm Organization(Washington, DC: World Bank, 2025-09-17)This paper investigates the impact of higher education expansion on firm performance in developing countries. It focuses on the significant expansion of higher education in Brazil between 2000 and 2012, which substantially increased higher education enrollment and graduation rates, thereby reducing the costs of hiring college-educated workers. Building on the theory of knowledge-based hierarchies and using a difference-in-differences approach and matching techniques, the paper finds that the surge in skilled labor supply led to a rise in the proportion of college-educated workers within firms in the treated microregions. This increase was accompanied by an increased prob-ability of firms adding knowledge hierarchies, followed by a rise in productivity and an increased likelihood of export. The findings suggest that policies affecting the cost and accessibility of hiring professionals and managers can significantly influence firms’ organizational structures, with implications for firm performance and productivity.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication How Well Can Real-Time Indicators Track the Economic Impacts of a Crisis Like COVID-19?(World Bank, Washington, DC, 2022-06)This paper presents evidence on the extent to which a set of real-time indicators tracked changes in gross domestic product across 142 countries in 2020. The real-time indicators include Google mobility, Google search trends, food price information, nitrogen dioxide, and nighttime lights. Google mobility and staple food prices both declined sharply in March and April, followed by a rapid recovery that returned to baseline levels by July and August. Mobility and staple food prices fell less in low-income countries. Nitrogen dioxide levels show a similar pattern, with a steep fall and rapid recovery in high-income and upper-middle-income countries but not in low-income and lower-middle-income countries. In April and May, Google search terms reflecting economic distress and religiosity spiked in some regions but not others. Data on nighttime lights show no clear drop in March outside East Asia. Linear models selected using the Least Absolute Shrinkage and Selection Operator explain about a third of the variation in annual gross domestic product growth rates across 72 countries. In a smaller subset of higher income countries, real-time indicators explain about 40 percent of the variation in quarterly gross domestic product growth. Overall, mobility and food price data, as well as pollution data in more developed countries, appeared to be best at capturing the widespread economic disruption experienced during the summer of 2020. The results indicate that these real-time indicators can track a substantial percentage of both annual and quarterly changes in gross domestic product.Publication The Welfare Implications of COVID-19 for Fragile and Conflict-Affected Areas(World Bank, Washington, DC, 2022-06)Understanding the impacts of the COVID-19 pandemic on households’ welfare in areas at the admin-1 level subject to fragility, conflict, and violence is important to inform programs and policies in this context. Harmonized data from high-frequency phone surveys indicate that, at the onset of the pandemic, a higher fraction of households in areas affected by fragility, conflict, and violence reported income declines and a higher fraction of respondents reported that they had stopped working since the beginning of the crisis. Households in areas affected by fragility, conflict, and violence were far less likely to report receiving government assistance than those in other areas. These findings suggest that the initial effects of the pandemic exacerbated preexisting economic gaps between areas affected by fragility, conflict, and violence and other areas, indicating that an even larger effort will be necessary in areas affected by fragility, conflict, and violence to recover from COVID-19, with implications for funding needs and policy as well as program design.Publication Near-Real-Time Welfare and Livelihood Impacts of an Active Civil War(World Bank, Washington, DC, 2022-04)Ethiopia is currently embroiled in a large-scale civil war that has continued for more than a year. Using unique High-Frequency Phone Survey data, which spans several months before and after the outbreak of the war, this paper provides fresh evidence on the ex durante impacts of the conflict on the food security and livelihood activities of affected households. The analysis uses difference-in-differences estimation to compare trends in the outcomes of interest across affected and unaffected regions (households) and before and after the outbreak of the civil war. The findings show that seven months into the conflict, the outbreak of the civil war increased the probability of moderate to severe food insecurity by 38 percentage points. Using the Armed Conflict Location and Event Data on households’ exposure to violent conflict, the analysis shows that exposure to one additional battle leads to a 1 percentage point increase in the probability of moderate to severe food insecurity. The conflict has reduced households’ access to food through supply chain disruptions while also curtailing non-farm livelihood activities. Non-farm and wage-related activities have been the most affected by the conflict, while farming activities have been relatively more resilient. Similarly, economic activities in urban areas have been much more affected than those in rural areas. These substantial impact estimates, which are likely to be underestimates of the true average effects on the population, constitute novel evidence of the near-real-time impacts of an ongoing civil conflict, providing direct evidence of how violent conflict disrupts the functioning of market supply chains and livelihoods activities. The paper highlights the potential of phone surveys to monitor active and large-scale conflicts, especially in contexts where conventional data sources are not immediately available.Publication Insuring Well-Being?(World Bank, Washington, DC, 2017-11)This paper estimates the causal effects of index insurance coverage on subjective well-being among livestock herders in southern Ethiopia. The randomization of incentives to purchase index-based livestock insurance and three rounds of panel data are exploited to separately identify ex ante welfare gains from insurance that reduces risk exposure and ex post buyer's remorse effects that may arise after the resolution of uncertainty. Insurance coverage currently in force generates subjective well-being gains that are significantly higher than the buyer's remorse effect of an insurance that lapsed without paying out. Given the temporal correlation in insurance purchase propensity, failure to control for potential buyer's remorse effects can bias downward estimates of welfare gains from current insurance coverage.Publication Does Climbing the Jobs Ladder Promote Poverty Reduction?(Washington, DC: World Bank, 2024-07-24)This paper explores trends in and the potential determinants of the types of jobs held by workers, and their relationship with poverty reduction, in an unbalanced panel of 89 countries over the past 30 years. Jobs are classified into five categories according to formality, occupation or level of skills required, and wage work versus self-employment. Net shifts into "upper tier" or skilled informal wage jobs, defined as professionals, managers, technicians, or clerks, from "lower tier" or lower skilled informal jobs were strongly associated with poverty reduction at the $1.90 and $3.20 lines. In contrast, net shifts into formal wage jobs from lower tier informal jobs were associated with modest poverty reductions at the $5.50 poverty line. The share of workers in informal upper tier jobs represents less than 2 percent of the workforce and has increased little over the past 30 years in low- and middle-income countries. The findings show that increases in upper tier informal wage jobs are associated with shifts of the workforce from microenterprises to small firms in lower- and upper-middle-income countries, but they are not discernibly associated with higher educational attainment or urbanization. In contrast, increases in the share of formal wage jobs are strongly associated with increases in the share of workers with post-secondary education, driven by high-income countries. The results suggest that upper tier informal wage jobs and the skills they require play a potentially important role in poverty reduction but are not automatically generated by increased educational attainment, urbanization, or firm size.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.