Publication: Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?
Loading...
Published
2023-10-10
ISSN
Date
2023-10-10
Author(s)
Editor(s)
Abstract
The World Bank’s High-Frequency Phone Surveys were deployed to support the monitoring of household welfare during the COVID-19 pandemic, when most of the regular household survey data collection was suspended. This paper reviews the analytical insights gained from the High-Frequency Phone Survey data, including uneven dynamics of household welfare during the pandemic across and within countries, as well as novel applications to simulate estimates of poverty and intergenerational mobility following the pandemic. The paper further derives lessons from the data collection experience. First, phone surveys, while inexpensive and quick, require reliable sampling frames. The predominant sampling strategies—previous household survey and random digit dialing—each have pros and cons in terms of representativeness, non-response, and post-survey adjustments. Second, on questionnaire design, country customization needs to be carefully balanced against standardization when cross-country comparisons are likely to be important. Finally, baseline metrics are critical for crisis monitoring; this requires more frequent welfare monitoring and better alignment of questions in phone surveys and existing data sources. While phone surveys can be a reliable toolkit for researchers and governments, more research is needed on key questions related to the survey mode effect, and the implications of different sampling frames and questionnaire design.
Link to Data Set
Citation
“Brunckhorst, Ben; Kim, Yeon Soo; Cojocaru, Alexandru. 2023. Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?. Policy Research Working Papers; 10585. © World Bank. http://hdl.handle.net/10986/40444 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication COVID-19 Vaccine Hesitancy in 53 Developing Countries(World Bank, Washington, DC, 2022-09)This paper presents new evidence on the levels and trends of vaccine hesitancy in developing countries based on harmonized high-frequency phone surveys from more than 120,000 respondents in 53 low- and middle-income countries. These countries represent a combined 30 percent of the population of low- and middle-income countries. On average across countries, one in five adults is hesitant about the COVID-19 vaccine, with the most cited reasons for hesitancy being concerns about the safety of the vaccine, followed by concerns about its efficacy. Between late 2020 and the first half of 2021, there tended to be little change in levels of hesitancy except in Iraq, Malawi, and Uzbekistan, where hesitancy increased. COVID-19 vaccine hesitancy is higher among female, young, less educated, and rural respondents, after controlling for selected observable characteristics. Country estimates of vaccine hesitancy from the high-frequency phone surveys are correlated with but lower than those from earlier studies, which often relied on less representative survey samples. The results suggest that vaccine hesitancy in developing countries, while less prevalent than previously thought, will be an important and enduring obstacle to recovery from the pandemic.Publication Long COVID(World Bank, Washington, DC, 2023-02)This paper examines the welfare impacts of the COVID-19 pandemic, using harmonized data from 343 high-frequency phone surveys conducted in 80 economies during 2020 and 2021, representing more than 2.5 billion people. The analysis focuses on the scarring effects of the initial losses of employment and income by examining their evolution over time across and within countries, as restrictions on mobility and economic activity were introduced and then gradually relaxed. The employment and welfare outcomes of some groups that were impacted to a greater degree initially—including women, informal workers, and those with less education—have been improving at a slower pace. The social protection response in lower-income economies was largely insufficient to protect households from the pandemic shock. Unmitigated welfare losses, as seen for example from the large share of households indicating income losses well into 2021, are highly correlated with food insecurity, which likely led some households to sell physical assets and deplete their savings. Without proper remediation, the uneven welfare impacts associated with COVID-19 may be amplified over the medium to long term, leading to future increases in poverty and inequality.Publication Updating the Poverty Estimates in Serbia in the Absence of Micro Data : A Microsimulation Approach(World Bank, Washington, DC, 2014-05)The continued poverty impact of the financial crisis in Serbia is difficult to establish beyond 2010 because of the lack of survey data. This paper tackles this difficulty. It uses a micro-simulation approach that accounts for a key pathway of the financial crisis in Serbia, the labor market. The results suggest a further increase in poverty in 2011 on account of a continued deterioration of the labor market indicators and despite a recovering gross domestic product. In order to evaluate the forecast, the model is applied to generate forecasts for previous years (2009 and 2010), which are compared with realized poverty estimates. The micro-simulation model performs well in predicting poverty dynamics during 2009-10 and less so during 2008-09. The accuracy of the predictions improves when the response of the social protection system is accounted for.Publication Estimating Poverty in the Absence of Consumption Data : The Case of Liberia(World Bank Group, Washington, DC, 2014-09)In much of the developing world, the demand for high frequency quality household data for poverty monitoring and program design far outstrips the capacity of the statistics bureau to provide such data. In these environments, all available data sources must be leveraged. Most surveys, however, do not collect the detailed consumption data necessary to construct aggregates and poverty lines to measure poverty directly. This paper benefits from a shared listing exercise for two large-scale national household surveys conducted in Liberia in 2007 to explore alternative methodologies to estimate poverty indirectly. The first is an asset-based model that is commonly used in Demographic and Health Surveys. The second is a survey-to-survey imputation that makes use of small area estimation techniques. In addition to a standard base model, separate models are estimated for urban and rural areas and an expanded model that includes climatic variables. Special attention is paid to the inclusion of cell phones, with implications for other assets whose cost and availability may be changing rapidly. The results demonstrate substantial limitations with asset-based indexes, but also leave questions as to the accuracy and stability of imputation models.Publication Monitoring COVID-19 Impacts on Households in Sudan(World Bank, Washington, DC, 2022-06)This brief focuses on the household survey component of the High-Frequency Phone Survey of Households (HFS). The sampling methodology adopted for the implementation of the household survey is probabilistic, and the sampling frame is provided by a compilation of a list of phone numbers collected during the implementation of various projects/surveys during the last few years at the household level across the country. The sample is representative of the 18 states of Sudan. This brief summarizes the main results of the core questions in the completed six rounds of the Sudan HFS of the same households (i.e., a panel survey). Results of the firm survey will be reported in a separate report.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 1994(New York: Oxford University Press, 1994)World Development Report 1994, the seventeenth in this annual series, examines the link between infrastructure and development and explores ways in which developing countries can improve both the provision and the quality of infrastructure services. In recent decades, developing countries have made substantial investments in infrastructure, achieving dramatic gains for households and producers by expanding their access to services such as safe water, sanitation, electric power, telecommunications, and transport. Even more infrastructure investment and expansion are needed in order to extend the reach of services - especially to people living in rural areas and to the poor. But as this report shows, the quantity of investment cannot be the exclusive focus of policy. Improving the quality of infrastructure service also is vital. Both quantity and quality improvements are essential to modernize and diversify production, help countries compete internationally, and accommodate rapid urbanization. The report identifies the basic cause of poor past performance as inadequate institutional incentives for improving the provision of infrastructure. To promote more efficient and responsive service delivery, incentives need to be changed through commercial management, competition, and user involvement. Several trends are helping to improve the performance of infrastructure. First, innovation in technology and in the regulatory management of markets makes more diversity possible in the supply of services. Second, an evaluation of the role of government is leading to a shift from direct government provision of services to increasing private sector provision and recent experience in many countries with public-private partnerships is highlighting new ways to increase efficiency and expand services. Third, increased concern about social and environmental sustainability has heightened public interest in infrastructure design and performance. This report includes the World Development Indicators, which offer selected social and economic statistics for 132 countries.