Publication: Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?
Loading...
Date
2023-10-10
ISSN
Published
2023-10-10
Author(s)
Editor(s)
Abstract
The World Bank’s High-Frequency Phone Surveys were deployed to support the monitoring of household welfare during the COVID-19 pandemic, when most of the regular household survey data collection was suspended. This paper reviews the analytical insights gained from the High-Frequency Phone Survey data, including uneven dynamics of household welfare during the pandemic across and within countries, as well as novel applications to simulate estimates of poverty and intergenerational mobility following the pandemic. The paper further derives lessons from the data collection experience. First, phone surveys, while inexpensive and quick, require reliable sampling frames. The predominant sampling strategies—previous household survey and random digit dialing—each have pros and cons in terms of representativeness, non-response, and post-survey adjustments. Second, on questionnaire design, country customization needs to be carefully balanced against standardization when cross-country comparisons are likely to be important. Finally, baseline metrics are critical for crisis monitoring; this requires more frequent welfare monitoring and better alignment of questions in phone surveys and existing data sources. While phone surveys can be a reliable toolkit for researchers and governments, more research is needed on key questions related to the survey mode effect, and the implications of different sampling frames and questionnaire design.
Link to Data Set
Citation
“Brunckhorst, Ben; Kim, Yeon Soo; Cojocaru, Alexandru. 2023. Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?. Policy Research Working Papers; 10585. © World Bank. http://hdl.handle.net/10986/40444 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Long COVID(World Bank, Washington, DC, 2023-02)This paper examines the welfare impacts of the COVID-19 pandemic, using harmonized data from 343 high-frequency phone surveys conducted in 80 economies during 2020 and 2021, representing more than 2.5 billion people. The analysis focuses on the scarring effects of the initial losses of employment and income by examining their evolution over time across and within countries, as restrictions on mobility and economic activity were introduced and then gradually relaxed. The employment and welfare outcomes of some groups that were impacted to a greater degree initially—including women, informal workers, and those with less education—have been improving at a slower pace. The social protection response in lower-income economies was largely insufficient to protect households from the pandemic shock. Unmitigated welfare losses, as seen for example from the large share of households indicating income losses well into 2021, are highly correlated with food insecurity, which likely led some households to sell physical assets and deplete their savings. Without proper remediation, the uneven welfare impacts associated with COVID-19 may be amplified over the medium to long term, leading to future increases in poverty and inequality.Publication COVID-19 Vaccine Hesitancy in 53 Developing Countries(World Bank, Washington, DC, 2022-09)This paper presents new evidence on the levels and trends of vaccine hesitancy in developing countries based on harmonized high-frequency phone surveys from more than 120,000 respondents in 53 low- and middle-income countries. These countries represent a combined 30 percent of the population of low- and middle-income countries. On average across countries, one in five adults is hesitant about the COVID-19 vaccine, with the most cited reasons for hesitancy being concerns about the safety of the vaccine, followed by concerns about its efficacy. Between late 2020 and the first half of 2021, there tended to be little change in levels of hesitancy except in Iraq, Malawi, and Uzbekistan, where hesitancy increased. COVID-19 vaccine hesitancy is higher among female, young, less educated, and rural respondents, after controlling for selected observable characteristics. Country estimates of vaccine hesitancy from the high-frequency phone surveys are correlated with but lower than those from earlier studies, which often relied on less representative survey samples. The results suggest that vaccine hesitancy in developing countries, while less prevalent than previously thought, will be an important and enduring obstacle to recovery from the pandemic.Publication Updating the Poverty Estimates in Serbia in the Absence of Micro Data : A Microsimulation Approach(World Bank, Washington, DC, 2014-05)The continued poverty impact of the financial crisis in Serbia is difficult to establish beyond 2010 because of the lack of survey data. This paper tackles this difficulty. It uses a micro-simulation approach that accounts for a key pathway of the financial crisis in Serbia, the labor market. The results suggest a further increase in poverty in 2011 on account of a continued deterioration of the labor market indicators and despite a recovering gross domestic product. In order to evaluate the forecast, the model is applied to generate forecasts for previous years (2009 and 2010), which are compared with realized poverty estimates. The micro-simulation model performs well in predicting poverty dynamics during 2009-10 and less so during 2008-09. The accuracy of the predictions improves when the response of the social protection system is accounted for.Publication Estimating Poverty in the Absence of Consumption Data : The Case of Liberia(World Bank Group, Washington, DC, 2014-09)In much of the developing world, the demand for high frequency quality household data for poverty monitoring and program design far outstrips the capacity of the statistics bureau to provide such data. In these environments, all available data sources must be leveraged. Most surveys, however, do not collect the detailed consumption data necessary to construct aggregates and poverty lines to measure poverty directly. This paper benefits from a shared listing exercise for two large-scale national household surveys conducted in Liberia in 2007 to explore alternative methodologies to estimate poverty indirectly. The first is an asset-based model that is commonly used in Demographic and Health Surveys. The second is a survey-to-survey imputation that makes use of small area estimation techniques. In addition to a standard base model, separate models are estimated for urban and rural areas and an expanded model that includes climatic variables. Special attention is paid to the inclusion of cell phones, with implications for other assets whose cost and availability may be changing rapidly. The results demonstrate substantial limitations with asset-based indexes, but also leave questions as to the accuracy and stability of imputation models.Publication Monitoring COVID-19 Impacts on Households in Sudan(World Bank, Washington, DC, 2022-06)This brief focuses on the household survey component of the High-Frequency Phone Survey of Households (HFS). The sampling methodology adopted for the implementation of the household survey is probabilistic, and the sampling frame is provided by a compilation of a list of phone numbers collected during the implementation of various projects/surveys during the last few years at the household level across the country. The sample is representative of the 18 states of Sudan. This brief summarizes the main results of the core questions in the completed six rounds of the Sudan HFS of the same households (i.e., a panel survey). Results of the firm survey will be reported in a separate report.
Users also downloaded
Showing related downloaded files
Publication South Asia Development Update, April 2024: Jobs for Resilience(Washington, DC: World Bank, 2024-04-02)South Asia is expected to continue to be the fastest-growing emerging market and developing economy (EMDE) region over the next two years. This is largely thanks to robust growth in India, but growth is also expected to pick up in most other South Asian economies. However, growth in the near-term is more reliant on the public sector than elsewhere, whereas private investment, in particular, continues to be weak. Efforts to rein in elevated debt, borrowing costs, and fiscal deficits may eventually weigh on growth and limit governments' ability to respond to increasingly frequent climate shocks. Yet, the provision of public goods is among the most effective strategies for climate adaptation. This is especially the case for households and farms, which tend to rely on shifting their efforts to non-agricultural jobs. These strategies are less effective forms of climate adaptation, in part because opportunities to move out of agriculture are limited by the region’s below-average employment ratios in the non-agricultural sector and for women. Because employment growth is falling short of working-age population growth, the region fails to fully capitalize on its demographic dividend. Vibrant, competitive firms are key to unlocking the demographic dividend, robust private investment, and workers’ ability to move out of agriculture. A range of policies could spur firm growth, including improved business climates and institutions, the removal of financial sector restrictions, and greater openness to trade and capital flows.Publication The Journey Ahead(Washington, DC: World Bank, 2024-10-31)The Journey Ahead: Supporting Successful Migration in Europe and Central Asia provides an in-depth analysis of international migration in Europe and Central Asia (ECA) and the implications for policy making. By identifying challenges and opportunities associated with migration in the region, it aims to inform a more nuanced, evidencebased debate on the costs and benefits of cross-border mobility. Using data-driven insights and new analysis, the report shows that migration has been an engine of prosperity and has helped address some of ECA’s demographic and socioeconomic disparities. Yet, migration’s full economic potential remains untapped. The report identifies multiple barriers keeping migration from achieving its full potential. Crucially, it argues that policies in both origin and destination countries can help maximize the development impacts of migration and effectively manage the economic, social, and political costs. Drawing from a wide range of literature, country experiences, and novel analysis, The Journey Ahead presents actionable policy options to enhance the benefits of migration for destination and origin countries and migrants themselves. Some measures can be taken unilaterally by countries, whereas others require close bilateral or regional coordination. The recommendations are tailored to different types of migration— forced displacement as well as high-skilled and low-skilled economic migration—and from the perspectives of both sending and receiving countries. This report serves as a comprehensive resource for governments, development partners, and other stakeholders throughout Europe and Central Asia, where the richness and diversity of migration experiences provide valuable insights for policy makers in other regions of the world.Publication Economic Recovery(World Bank, Washington, DC, 2021-04-06)World Bank Group President David Malpass spoke about the world facing major challenges, including COVID, climate change, rising poverty and inequality and growing fragility and violence in many countries. He highlighted vaccines, working closely with Gavi, WHO, and UNICEF, the World Bank has conducted over one hundred capacity assessments, many even more before vaccines were available. The World Bank Group worked to achieve a debt service suspension initiative and increased transparency in debt contracts at developing countries. The World Bank Group is finalizing a new climate change action plan, which includes a big step up in financing, building on their record climate financing over the past two years. He noted big challenges to bring all together to achieve GRID: green, resilient, and inclusive development. Janet Yellen, U.S. Secretary of the Treasury, mentioned focusing on vulnerable people during the pandemic. Kristalina Georgieva, Managing Director of the International Monetary Fund, focused on giving everyone a fair shot during a sustainable recovery. All three commented on the importance of tackling climate change.Publication Media and Messages for Nutrition and Health(World Bank, Washington, DC, 2020-06)The Lao People’s Democratic Republic (Lao PDR) has experienced rapid and significant economic growth over the past decade. However, poor nutritional outcomes remain a concern. Rates of childhood undernutrition are particularly high in remote, rural, and upland areas. Media have the potential to play an important role in shaping health and nutrition–related behaviors and practices as well as in promoting sociocultural and economic development that might contribute to improved nutritional outcomes. This report presents the results of a media audit (MA) that was conducted to inform the development and production of mass media advocacy and communication strategies and materials with a focus on maternal and child health and nutrition that would reach the most people from the poorest communities in northern Lao PDR. Making more people aware of useful information, essential services and products and influencing them to use these effectively is the ultimate goal of mass media campaigns, and the MA measures the potential effectiveness of media efforts to reach this goal. The effectiveness of communication channels to deliver health and nutrition messages to target beneficiaries to ensure maximum reach and uptake can be viewed in terms of preferences, satisfaction, and trust. Overall, the four most accessed media channels for receiving information among communities in the study areas were village announcements, mobile phones, television, and out-of-home (OOH) media. Of the accessed media channels, the top three most preferred channels were village announcements (40 percent), television (26 percent), and mobile phones (19 percent). In terms of trust, village announcements were the most trusted source of information (64 percent), followed by mobile phones (14 percent) and television (11 percent). Hence of all the media channels, village announcements are the most preferred, have the most satisfied users, and are the most trusted source of information in study communities from four provinces in Lao PDR with some of the highest burden of childhood undernutrition.Publication Remarks at the United Nations Biodiversity Conference(World Bank, Washington, DC, 2021-10-12)World Bank Group President David Malpass discussed biodiversity and climate change being closely interlinked, with terrestrial and marine ecosystems serving as critically important carbon sinks. At the same time climate change acts as a direct driver of biodiversity and ecosystem services loss. The World Bank has financed biodiversity conservation around the world, including over 116 million hectares of Marine and Coastal Protected Areas, 10 million hectares of Terrestrial Protected Areas, and over 300 protected habitats, biological buffer zones and reserves. The COVID pandemic, biodiversity loss, climate change are all reminders of how connected we are. The recovery from this pandemic is an opportunity to put in place more effective policies, institutions, and resources to address biodiversity loss.