Publication: How Well Did Real-Time Indicators Track Household Welfare Changes in Developing Countries during the COVID-19 Crisis?
Loading...
Date
2024-09-23
ISSN
Published
2024-09-23
Editor(s)
Abstract
This paper investigates the extent to which real-time indicators derived from internet search, cell phones, and satellites predict changes in household socioeconomic indicators across approximately 300 administrative level-1 regions in 20 countries during the COVID-19 crisis. Measures of changes in socioeconomic status in each region are taken from high-frequency phone surveys. When using the first wave of data, fielded between April and August 2020, models selected using the least absolute shrinkage and selection operator explain 37 percent of the cross-regional variation in the share of households reporting declines in total income and 34 percent of the share of respondents reporting work stoppages since the onset of the crisis. Real-time indicators explain a lower amount of the within-region variation in income losses and current employment over time, with an R2 of 15 percent for current employment and 22 to 26 percent for the prevalence of income declines. When limiting the sample to urban regions, real-time indicators are far more effective at explaining within-region variation in income losses and current employment, with R2 values of approximately 0.54 and 0.38, respectively. Income gains, self-reported food insecurity, social distancing behavior, and child school engagement are more difficult to predict, with R2 values ranging from 0.06 to 0.17. Google search terms related to food, money, jobs, and religion were the most powerful predictors of work stoppage and income declines in the first survey wave, while those related to food, exercise, and religion better tracked changes in income declines and employment over time. Google mobility measures are also strong predictors of changes in employment and the prevalence of specific types of income declines. In general, satellite data on vegetation, pollution, and nighttime lights are far less predictive. Google mobility and search data, and to a lesser extent vegetation and pollution data, can provide a meaningful signal of regional economic distress and recovery, particularly during the early phases of a major crisis such as COVID-19.
Link to Data Set
Citation
“Newhouse, David; Swindle, Rachel; Wang, Shun; Merfeld, Joshua D.; Pape, Utz; Tafere , Kibrom; Weber, Michael. 2024. How Well Did Real-Time Indicators Track Household Welfare Changes in Developing Countries during the COVID-19 Crisis?. Policy Research Working Paper; 10916. © World Bank. http://hdl.handle.net/10986/42188 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Innovative Financial Instruments and Their Role in the Development of Jurisdictional REDD+(Washington, DC: World Bank, 2025-05-08)Achieving global net zero carbon emissions requires stopping deforestation and making full use of tropical forests as carbon sinks. Market instruments for the sale and purchase of emission outcomes coming from Reducing Emissions from Deforestation and Forest Degradation framework programs could play a very significant role in achieving this goal. The development of these markets has been insufficient so far: their scale as of today is much lower than what would be required to generate meaningful resources for the countries that host tropical forests, and the quality of existing instruments is generally insufficient to allow a scaling up in demand. However, efforts to improve the transparency and integrity of these instruments are accelerating, particularly around jurisdictional Reducing Emissions from Deforestation and Forest Degradation framework programs. In parallel with these efforts, innovations in financial instruments suited for the framework’s carbon markets are also taking place, but their scale is limited so far. This paper looks beyond the current state of the framework’s carbon markets to consider a set of innovative financial instruments that would allow completing the infrastructure of emissions trading, enhancing its utility for both issuers and buyers of carbon credits in the framework’s jurisdictional programs. The paper shows how a combination of forest carbon bonds, where countries sell forward (or commit) their emission reduction outcomes, as well as call and put options can be used to de-risk and encourage early investment in jurisdictional Reducing Emissions from Deforestation and Forest Degradation framework programs. To quantify the value of these innovations, the paper evaluates the potential scale of these instruments for the case of Brazil. The estimates suggest that the amounts that could be mobilized would represent a critical contribution to effective forest conservation. The proposed instruments and methods can be used by other tropical nations that are prepared to implement a large-scale jurisdictional program. Although the paper acknowledges that the current state of carbon markets would still not allow their deployment in the short term, the conclusion is that these instruments have significant potential, and their future development could be an important contribution to the establishment of successful markets for the conservation of tropical forests.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.Publication Labor Market Scarring in a Developing Economy(Washington, DC: World Bank, 2025-05-08)This paper estimates the magnitude of labor market scarring in a developing economy, a setting that has been understudied by the labor scarring literature dominated by advanced economies. The paper assesses the contributions of “stigma” versus “lost human capital,” which cause earnings losses among displaced workers relative to non-displaced workers. The findings indicate that job separations caused by plant closings result in sizable and long-lasting reductions in earnings, with an average decline of 7.5 percent in hourly wages over a nine-year period. The estimate for one year after a plant closing is larger, at a decline of 10.8 percent. In a common sample, after controlling for unobserved, time-invariant individual characteristics, the impact of a plant closing declines from 11.9 to 8.2 percent. These results imply that stigma in the labor market due to imperfect information about workers (captured by unobservable worker characteristics) accounts for 30.8 percent of the average earnings losses, whereas lost employer-specific human capital explains the remaining 69.2 percent. The paper explores the effects of job separations due to plant closings on other labor market outcomes, including hours worked and informality, and provides estimates across genders and levels of education.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication How Well Can Real-Time Indicators Track the Economic Impacts of a Crisis Like COVID-19?(World Bank, Washington, DC, 2022-06)This paper presents evidence on the extent to which a set of real-time indicators tracked changes in gross domestic product across 142 countries in 2020. The real-time indicators include Google mobility, Google search trends, food price information, nitrogen dioxide, and nighttime lights. Google mobility and staple food prices both declined sharply in March and April, followed by a rapid recovery that returned to baseline levels by July and August. Mobility and staple food prices fell less in low-income countries. Nitrogen dioxide levels show a similar pattern, with a steep fall and rapid recovery in high-income and upper-middle-income countries but not in low-income and lower-middle-income countries. In April and May, Google search terms reflecting economic distress and religiosity spiked in some regions but not others. Data on nighttime lights show no clear drop in March outside East Asia. Linear models selected using the Least Absolute Shrinkage and Selection Operator explain about a third of the variation in annual gross domestic product growth rates across 72 countries. In a smaller subset of higher income countries, real-time indicators explain about 40 percent of the variation in quarterly gross domestic product growth. Overall, mobility and food price data, as well as pollution data in more developed countries, appeared to be best at capturing the widespread economic disruption experienced during the summer of 2020. The results indicate that these real-time indicators can track a substantial percentage of both annual and quarterly changes in gross domestic product.Publication The Welfare Implications of COVID-19 for Fragile and Conflict-Affected Areas(World Bank, Washington, DC, 2022-06)Understanding the impacts of the COVID-19 pandemic on households’ welfare in areas at the admin-1 level subject to fragility, conflict, and violence is important to inform programs and policies in this context. Harmonized data from high-frequency phone surveys indicate that, at the onset of the pandemic, a higher fraction of households in areas affected by fragility, conflict, and violence reported income declines and a higher fraction of respondents reported that they had stopped working since the beginning of the crisis. Households in areas affected by fragility, conflict, and violence were far less likely to report receiving government assistance than those in other areas. These findings suggest that the initial effects of the pandemic exacerbated preexisting economic gaps between areas affected by fragility, conflict, and violence and other areas, indicating that an even larger effort will be necessary in areas affected by fragility, conflict, and violence to recover from COVID-19, with implications for funding needs and policy as well as program design.Publication Near-Real-Time Welfare and Livelihood Impacts of an Active Civil War(World Bank, Washington, DC, 2022-04)Ethiopia is currently embroiled in a large-scale civil war that has continued for more than a year. Using unique High-Frequency Phone Survey data, which spans several months before and after the outbreak of the war, this paper provides fresh evidence on the ex durante impacts of the conflict on the food security and livelihood activities of affected households. The analysis uses difference-in-differences estimation to compare trends in the outcomes of interest across affected and unaffected regions (households) and before and after the outbreak of the civil war. The findings show that seven months into the conflict, the outbreak of the civil war increased the probability of moderate to severe food insecurity by 38 percentage points. Using the Armed Conflict Location and Event Data on households’ exposure to violent conflict, the analysis shows that exposure to one additional battle leads to a 1 percentage point increase in the probability of moderate to severe food insecurity. The conflict has reduced households’ access to food through supply chain disruptions while also curtailing non-farm livelihood activities. Non-farm and wage-related activities have been the most affected by the conflict, while farming activities have been relatively more resilient. Similarly, economic activities in urban areas have been much more affected than those in rural areas. These substantial impact estimates, which are likely to be underestimates of the true average effects on the population, constitute novel evidence of the near-real-time impacts of an ongoing civil conflict, providing direct evidence of how violent conflict disrupts the functioning of market supply chains and livelihoods activities. The paper highlights the potential of phone surveys to monitor active and large-scale conflicts, especially in contexts where conventional data sources are not immediately available.Publication Insuring Well-Being?(World Bank, Washington, DC, 2017-11)This paper estimates the causal effects of index insurance coverage on subjective well-being among livestock herders in southern Ethiopia. The randomization of incentives to purchase index-based livestock insurance and three rounds of panel data are exploited to separately identify ex ante welfare gains from insurance that reduces risk exposure and ex post buyer's remorse effects that may arise after the resolution of uncertainty. Insurance coverage currently in force generates subjective well-being gains that are significantly higher than the buyer's remorse effect of an insurance that lapsed without paying out. Given the temporal correlation in insurance purchase propensity, failure to control for potential buyer's remorse effects can bias downward estimates of welfare gains from current insurance coverage.Publication Does Climbing the Jobs Ladder Promote Poverty Reduction?(Washington, DC: World Bank, 2024-07-24)This paper explores trends in and the potential determinants of the types of jobs held by workers, and their relationship with poverty reduction, in an unbalanced panel of 89 countries over the past 30 years. Jobs are classified into five categories according to formality, occupation or level of skills required, and wage work versus self-employment. Net shifts into "upper tier" or skilled informal wage jobs, defined as professionals, managers, technicians, or clerks, from "lower tier" or lower skilled informal jobs were strongly associated with poverty reduction at the $1.90 and $3.20 lines. In contrast, net shifts into formal wage jobs from lower tier informal jobs were associated with modest poverty reductions at the $5.50 poverty line. The share of workers in informal upper tier jobs represents less than 2 percent of the workforce and has increased little over the past 30 years in low- and middle-income countries. The findings show that increases in upper tier informal wage jobs are associated with shifts of the workforce from microenterprises to small firms in lower- and upper-middle-income countries, but they are not discernibly associated with higher educational attainment or urbanization. In contrast, increases in the share of formal wage jobs are strongly associated with increases in the share of workers with post-secondary education, driven by high-income countries. The results suggest that upper tier informal wage jobs and the skills they require play a potentially important role in poverty reduction but are not automatically generated by increased educational attainment, urbanization, or firm size.
Users also downloaded
Showing related downloaded files
Publication Media and Messages for Nutrition and Health(World Bank, Washington, DC, 2020-06)The Lao People’s Democratic Republic (Lao PDR) has experienced rapid and significant economic growth over the past decade. However, poor nutritional outcomes remain a concern. Rates of childhood undernutrition are particularly high in remote, rural, and upland areas. Media have the potential to play an important role in shaping health and nutrition–related behaviors and practices as well as in promoting sociocultural and economic development that might contribute to improved nutritional outcomes. This report presents the results of a media audit (MA) that was conducted to inform the development and production of mass media advocacy and communication strategies and materials with a focus on maternal and child health and nutrition that would reach the most people from the poorest communities in northern Lao PDR. Making more people aware of useful information, essential services and products and influencing them to use these effectively is the ultimate goal of mass media campaigns, and the MA measures the potential effectiveness of media efforts to reach this goal. The effectiveness of communication channels to deliver health and nutrition messages to target beneficiaries to ensure maximum reach and uptake can be viewed in terms of preferences, satisfaction, and trust. Overall, the four most accessed media channels for receiving information among communities in the study areas were village announcements, mobile phones, television, and out-of-home (OOH) media. Of the accessed media channels, the top three most preferred channels were village announcements (40 percent), television (26 percent), and mobile phones (19 percent). In terms of trust, village announcements were the most trusted source of information (64 percent), followed by mobile phones (14 percent) and television (11 percent). Hence of all the media channels, village announcements are the most preferred, have the most satisfied users, and are the most trusted source of information in study communities from four provinces in Lao PDR with some of the highest burden of childhood undernutrition.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.Publication Remarks at the United Nations Biodiversity Conference(World Bank, Washington, DC, 2021-10-12)World Bank Group President David Malpass discussed biodiversity and climate change being closely interlinked, with terrestrial and marine ecosystems serving as critically important carbon sinks. At the same time climate change acts as a direct driver of biodiversity and ecosystem services loss. The World Bank has financed biodiversity conservation around the world, including over 116 million hectares of Marine and Coastal Protected Areas, 10 million hectares of Terrestrial Protected Areas, and over 300 protected habitats, biological buffer zones and reserves. The COVID pandemic, biodiversity loss, climate change are all reminders of how connected we are. The recovery from this pandemic is an opportunity to put in place more effective policies, institutions, and resources to address biodiversity loss.Publication Economic Recovery(World Bank, Washington, DC, 2021-04-06)World Bank Group President David Malpass spoke about the world facing major challenges, including COVID, climate change, rising poverty and inequality and growing fragility and violence in many countries. He highlighted vaccines, working closely with Gavi, WHO, and UNICEF, the World Bank has conducted over one hundred capacity assessments, many even more before vaccines were available. The World Bank Group worked to achieve a debt service suspension initiative and increased transparency in debt contracts at developing countries. The World Bank Group is finalizing a new climate change action plan, which includes a big step up in financing, building on their record climate financing over the past two years. He noted big challenges to bring all together to achieve GRID: green, resilient, and inclusive development. Janet Yellen, U.S. Secretary of the Treasury, mentioned focusing on vulnerable people during the pandemic. Kristalina Georgieva, Managing Director of the International Monetary Fund, focused on giving everyone a fair shot during a sustainable recovery. All three commented on the importance of tackling climate change.