Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?
Loading...
Published
2023-10-10
Author(s)
Brunckhorst, Ben
Kim, Yeon Soo
Cojocaru, Alexandru
Kim, Yeon Soo
Cojocaru, Alexandru
Editor(s)
Abstract
The World Bank’s High-Frequency Phone Surveys were deployed to support the monitoring of household welfare during the COVID-19 pandemic, when most of the regular household survey data collection was suspended. This paper reviews the analytical insights gained from the High-Frequency Phone Survey data, including uneven dynamics of household welfare during the pandemic across and within countries, as well as novel applications to simulate estimates of poverty and intergenerational mobility following the pandemic. The paper further derives lessons from the data collection experience. First, phone surveys, while inexpensive and quick, require reliable sampling frames. The predominant sampling strategies—previous household survey and random digit dialing—each have pros and cons in terms of representativeness, non-response, and post-survey adjustments. Second, on questionnaire design, country customization needs to be carefully balanced against standardization when cross-country comparisons are likely to be important. Finally, baseline metrics are critical for crisis monitoring; this requires more frequent welfare monitoring and better alignment of questions in phone surveys and existing data sources. While phone surveys can be a reliable toolkit for researchers and governments, more research is needed on key questions related to the survey mode effect, and the implications of different sampling frames and questionnaire design.
Link to Data Set
Citation
“Brunckhorst, Ben; Kim, Yeon Soo; Cojocaru, Alexandru. 2023. Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?. Policy Research Working Papers; 10585. © World Bank. http://hdl.handle.net/10986/40444 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Collections
Related items
Showing items related by metadata.
Publication COVID-19 Vaccine Hesitancy in 53 Developing Countries(World Bank, Washington, DC, 2022-09)This paper presents new evidence on the levels and trends of vaccine hesitancy in developing countries based on harmonized high-frequency phone surveys from more than 120,000 respondents in 53 low- and middle-income countries. These countries represent a combined 30 percent of the population of low- and middle-income countries. On average across countries, one in five adults is hesitant about the COVID-19 vaccine, with the most cited reasons for hesitancy being concerns about the safety of the vaccine, followed by concerns about its efficacy. Between late 2020 and the first half of 2021, there tended to be little change in levels of hesitancy except in Iraq, Malawi, and Uzbekistan, where hesitancy increased. COVID-19 vaccine hesitancy is higher among female, young, less educated, and rural respondents, after controlling for selected observable characteristics. Country estimates of vaccine hesitancy from the high-frequency phone surveys are correlated with but lower than those from earlier studies, which often relied on less representative survey samples. The results suggest that vaccine hesitancy in developing countries, while less prevalent than previously thought, will be an important and enduring obstacle to recovery from the pandemic.Publication Updating the Poverty Estimates in Serbia in the Absence of Micro Data : A Microsimulation Approach(World Bank, Washington, DC, 2014-05)The continued poverty impact of the financial crisis in Serbia is difficult to establish beyond 2010 because of the lack of survey data. This paper tackles this difficulty. It uses a micro-simulation approach that accounts for a key pathway of the financial crisis in Serbia, the labor market. The results suggest a further increase in poverty in 2011 on account of a continued deterioration of the labor market indicators and despite a recovering gross domestic product. In order to evaluate the forecast, the model is applied to generate forecasts for previous years (2009 and 2010), which are compared with realized poverty estimates. The micro-simulation model performs well in predicting poverty dynamics during 2009-10 and less so during 2008-09. The accuracy of the predictions improves when the response of the social protection system is accounted for.Publication Long COVID(World Bank, Washington, DC, 2023-02)This paper examines the welfare impacts of the COVID-19 pandemic, using harmonized data from 343 high-frequency phone surveys conducted in 80 economies during 2020 and 2021, representing more than 2.5 billion people. The analysis focuses on the scarring effects of the initial losses of employment and income by examining their evolution over time across and within countries, as restrictions on mobility and economic activity were introduced and then gradually relaxed. The employment and welfare outcomes of some groups that were impacted to a greater degree initially—including women, informal workers, and those with less education—have been improving at a slower pace. The social protection response in lower-income economies was largely insufficient to protect households from the pandemic shock. Unmitigated welfare losses, as seen for example from the large share of households indicating income losses well into 2021, are highly correlated with food insecurity, which likely led some households to sell physical assets and deplete their savings. Without proper remediation, the uneven welfare impacts associated with COVID-19 may be amplified over the medium to long term, leading to future increases in poverty and inequality.Publication Estimating Poverty in the Absence of Consumption Data : The Case of Liberia(World Bank Group, Washington, DC, 2014-09)In much of the developing world, the demand for high frequency quality household data for poverty monitoring and program design far outstrips the capacity of the statistics bureau to provide such data. In these environments, all available data sources must be leveraged. Most surveys, however, do not collect the detailed consumption data necessary to construct aggregates and poverty lines to measure poverty directly. This paper benefits from a shared listing exercise for two large-scale national household surveys conducted in Liberia in 2007 to explore alternative methodologies to estimate poverty indirectly. The first is an asset-based model that is commonly used in Demographic and Health Surveys. The second is a survey-to-survey imputation that makes use of small area estimation techniques. In addition to a standard base model, separate models are estimated for urban and rural areas and an expanded model that includes climatic variables. Special attention is paid to the inclusion of cell phones, with implications for other assets whose cost and availability may be changing rapidly. The results demonstrate substantial limitations with asset-based indexes, but also leave questions as to the accuracy and stability of imputation models.Publication Monitoring COVID-19 Impacts on Households in Sudan(World Bank, Washington, DC, 2022-06)This brief focuses on the household survey component of the High-Frequency Phone Survey of Households (HFS). The sampling methodology adopted for the implementation of the household survey is probabilistic, and the sampling frame is provided by a compilation of a list of phone numbers collected during the implementation of various projects/surveys during the last few years at the household level across the country. The sample is representative of the 18 states of Sudan. This brief summarizes the main results of the core questions in the completed six rounds of the Sudan HFS of the same households (i.e., a panel survey). Results of the firm survey will be reported in a separate report.
Users also downloaded
Showing related downloaded files
Publication Global Regulations, Institutional Development, and Market Authorities Perspective Toolkit (GRIDMAP) - Framework and Methodology(Washington, DC: World Bank, 2024-12-05)GRIDMAP--the Global Regulations, Institutional Development, and Market Authorities Perspective Toolkit--provides emerging markets and developing economies (EMDEs) with a “Minimum Package” of policies to build markets that are trustworthy, safe, and competitive. The “Minimum Package” sets out essential regulatory provisions, institutional arrangements, and implementation and enforcement needed for those markets to thrive. GRIDMAP will provide modules focused on various subjects of market regulation, such as consumer protection and data markets.Publication Media and Messages for Nutrition and Health(World Bank, Washington, DC, 2020-06)The Lao People’s Democratic Republic (Lao PDR) has experienced rapid and significant economic growth over the past decade. However, poor nutritional outcomes remain a concern. Rates of childhood undernutrition are particularly high in remote, rural, and upland areas. Media have the potential to play an important role in shaping health and nutrition–related behaviors and practices as well as in promoting sociocultural and economic development that might contribute to improved nutritional outcomes. This report presents the results of a media audit (MA) that was conducted to inform the development and production of mass media advocacy and communication strategies and materials with a focus on maternal and child health and nutrition that would reach the most people from the poorest communities in northern Lao PDR. Making more people aware of useful information, essential services and products and influencing them to use these effectively is the ultimate goal of mass media campaigns, and the MA measures the potential effectiveness of media efforts to reach this goal. The effectiveness of communication channels to deliver health and nutrition messages to target beneficiaries to ensure maximum reach and uptake can be viewed in terms of preferences, satisfaction, and trust. Overall, the four most accessed media channels for receiving information among communities in the study areas were village announcements, mobile phones, television, and out-of-home (OOH) media. Of the accessed media channels, the top three most preferred channels were village announcements (40 percent), television (26 percent), and mobile phones (19 percent). In terms of trust, village announcements were the most trusted source of information (64 percent), followed by mobile phones (14 percent) and television (11 percent). Hence of all the media channels, village announcements are the most preferred, have the most satisfied users, and are the most trusted source of information in study communities from four provinces in Lao PDR with some of the highest burden of childhood undernutrition.Publication Remarks at the United Nations Biodiversity Conference(World Bank, Washington, DC, 2021-10-12)World Bank Group President David Malpass discussed biodiversity and climate change being closely interlinked, with terrestrial and marine ecosystems serving as critically important carbon sinks. At the same time climate change acts as a direct driver of biodiversity and ecosystem services loss. The World Bank has financed biodiversity conservation around the world, including over 116 million hectares of Marine and Coastal Protected Areas, 10 million hectares of Terrestrial Protected Areas, and over 300 protected habitats, biological buffer zones and reserves. The COVID pandemic, biodiversity loss, climate change are all reminders of how connected we are. The recovery from this pandemic is an opportunity to put in place more effective policies, institutions, and resources to address biodiversity loss.Publication Economic Recovery(World Bank, Washington, DC, 2021-04-06)World Bank Group President David Malpass spoke about the world facing major challenges, including COVID, climate change, rising poverty and inequality and growing fragility and violence in many countries. He highlighted vaccines, working closely with Gavi, WHO, and UNICEF, the World Bank has conducted over one hundred capacity assessments, many even more before vaccines were available. The World Bank Group worked to achieve a debt service suspension initiative and increased transparency in debt contracts at developing countries. The World Bank Group is finalizing a new climate change action plan, which includes a big step up in financing, building on their record climate financing over the past two years. He noted big challenges to bring all together to achieve GRID: green, resilient, and inclusive development. Janet Yellen, U.S. Secretary of the Treasury, mentioned focusing on vulnerable people during the pandemic. Kristalina Georgieva, Managing Director of the International Monetary Fund, focused on giving everyone a fair shot during a sustainable recovery. All three commented on the importance of tackling climate change.Publication Education, Social Norms, and the Marriage Penalty(Washington, DC: World Bank, 2024-10-16)A growing literature attributes gender inequality in labor market outcomes in part to the reduction in female labor supply after childbirth, the child penalty. However, if social norms constrain married women’s activities outside the home, then marriage can independently reduce employment, even in the absence childbearing. Given the correlation in timing between childbirth and marriage, conventional estimates of child penalties will conflate these two effects. The paper studies the marriage penalty in South Asia, a context featuring conservative gender norms and low female labor force participation. The study introduces a split-sample, pseudo-panel approach that allows for the separation of marriage and child penalties even in the absence of individual-level panel data. Marriage reduces women’s labor force participation in South Asia by 12 percentage points, whereas the marginal penalty of childbearing is small. Consistent with the central roles of both opportunity costs and social norms, the marriage penalty is smaller among cohorts with higher education and less conservative gender attitudes.