Publication: Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?
Loading...
Published
2023-10-10
ISSN
Date
2023-10-10
Author(s)
Editor(s)
Abstract
The World Bank’s High-Frequency Phone Surveys were deployed to support the monitoring of household welfare during the COVID-19 pandemic, when most of the regular household survey data collection was suspended. This paper reviews the analytical insights gained from the High-Frequency Phone Survey data, including uneven dynamics of household welfare during the pandemic across and within countries, as well as novel applications to simulate estimates of poverty and intergenerational mobility following the pandemic. The paper further derives lessons from the data collection experience. First, phone surveys, while inexpensive and quick, require reliable sampling frames. The predominant sampling strategies—previous household survey and random digit dialing—each have pros and cons in terms of representativeness, non-response, and post-survey adjustments. Second, on questionnaire design, country customization needs to be carefully balanced against standardization when cross-country comparisons are likely to be important. Finally, baseline metrics are critical for crisis monitoring; this requires more frequent welfare monitoring and better alignment of questions in phone surveys and existing data sources. While phone surveys can be a reliable toolkit for researchers and governments, more research is needed on key questions related to the survey mode effect, and the implications of different sampling frames and questionnaire design.
Link to Data Set
Citation
“Brunckhorst, Ben; Kim, Yeon Soo; Cojocaru, Alexandru. 2023. Tracing Pandemic Impacts in the Absence of Regular Survey Data: What Have We Learned from the World Bank’s High-Frequency Phone Surveys?. Policy Research Working Papers; 10585. © World Bank. http://hdl.handle.net/10986/40444 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Long COVID(World Bank, Washington, DC, 2023-02)This paper examines the welfare impacts of the COVID-19 pandemic, using harmonized data from 343 high-frequency phone surveys conducted in 80 economies during 2020 and 2021, representing more than 2.5 billion people. The analysis focuses on the scarring effects of the initial losses of employment and income by examining their evolution over time across and within countries, as restrictions on mobility and economic activity were introduced and then gradually relaxed. The employment and welfare outcomes of some groups that were impacted to a greater degree initially—including women, informal workers, and those with less education—have been improving at a slower pace. The social protection response in lower-income economies was largely insufficient to protect households from the pandemic shock. Unmitigated welfare losses, as seen for example from the large share of households indicating income losses well into 2021, are highly correlated with food insecurity, which likely led some households to sell physical assets and deplete their savings. Without proper remediation, the uneven welfare impacts associated with COVID-19 may be amplified over the medium to long term, leading to future increases in poverty and inequality.Publication COVID-19 Vaccine Hesitancy in 53 Developing Countries(World Bank, Washington, DC, 2022-09)This paper presents new evidence on the levels and trends of vaccine hesitancy in developing countries based on harmonized high-frequency phone surveys from more than 120,000 respondents in 53 low- and middle-income countries. These countries represent a combined 30 percent of the population of low- and middle-income countries. On average across countries, one in five adults is hesitant about the COVID-19 vaccine, with the most cited reasons for hesitancy being concerns about the safety of the vaccine, followed by concerns about its efficacy. Between late 2020 and the first half of 2021, there tended to be little change in levels of hesitancy except in Iraq, Malawi, and Uzbekistan, where hesitancy increased. COVID-19 vaccine hesitancy is higher among female, young, less educated, and rural respondents, after controlling for selected observable characteristics. Country estimates of vaccine hesitancy from the high-frequency phone surveys are correlated with but lower than those from earlier studies, which often relied on less representative survey samples. The results suggest that vaccine hesitancy in developing countries, while less prevalent than previously thought, will be an important and enduring obstacle to recovery from the pandemic.Publication Updating the Poverty Estimates in Serbia in the Absence of Micro Data : A Microsimulation Approach(World Bank, Washington, DC, 2014-05)The continued poverty impact of the financial crisis in Serbia is difficult to establish beyond 2010 because of the lack of survey data. This paper tackles this difficulty. It uses a micro-simulation approach that accounts for a key pathway of the financial crisis in Serbia, the labor market. The results suggest a further increase in poverty in 2011 on account of a continued deterioration of the labor market indicators and despite a recovering gross domestic product. In order to evaluate the forecast, the model is applied to generate forecasts for previous years (2009 and 2010), which are compared with realized poverty estimates. The micro-simulation model performs well in predicting poverty dynamics during 2009-10 and less so during 2008-09. The accuracy of the predictions improves when the response of the social protection system is accounted for.Publication Estimating Poverty in the Absence of Consumption Data : The Case of Liberia(World Bank Group, Washington, DC, 2014-09)In much of the developing world, the demand for high frequency quality household data for poverty monitoring and program design far outstrips the capacity of the statistics bureau to provide such data. In these environments, all available data sources must be leveraged. Most surveys, however, do not collect the detailed consumption data necessary to construct aggregates and poverty lines to measure poverty directly. This paper benefits from a shared listing exercise for two large-scale national household surveys conducted in Liberia in 2007 to explore alternative methodologies to estimate poverty indirectly. The first is an asset-based model that is commonly used in Demographic and Health Surveys. The second is a survey-to-survey imputation that makes use of small area estimation techniques. In addition to a standard base model, separate models are estimated for urban and rural areas and an expanded model that includes climatic variables. Special attention is paid to the inclusion of cell phones, with implications for other assets whose cost and availability may be changing rapidly. The results demonstrate substantial limitations with asset-based indexes, but also leave questions as to the accuracy and stability of imputation models.Publication Monitoring COVID-19 Impacts on Households in Sudan(World Bank, Washington, DC, 2022-06)This brief focuses on the household survey component of the High-Frequency Phone Survey of Households (HFS). The sampling methodology adopted for the implementation of the household survey is probabilistic, and the sampling frame is provided by a compilation of a list of phone numbers collected during the implementation of various projects/surveys during the last few years at the household level across the country. The sample is representative of the 18 states of Sudan. This brief summarizes the main results of the core questions in the completed six rounds of the Sudan HFS of the same households (i.e., a panel survey). Results of the firm survey will be reported in a separate report.
Users also downloaded
Showing related downloaded files
Publication Senegal Country Climate and Development Report(Washington, DC: World Bank, 2024-11-05)Climate action offers an opportunity to safeguard development gains and accompany the ambitious transformation Senegal is embarking on to achieve its objective of reaching middle income status in the next decade. While the country was among the fastest growing economies in Sub-Saharan Africa (SSA), poverty reduction was slow, vulnerabilities persisted, and inequalities increased. In addition, overall productivity remained low, with lagging structural transformation, high informality, and low job creation. To attain its middle-income goal, Senegal must initiate a series of reforms for a productive, sustainable, and inclusive growth model, with climate considerations at the center given the country’s high vulnerability. Senegal’s high climate vulnerability is caused by the country’s coastal exposure and reliance on natural resources for food, jobs, and growth (partly a consequence of its slow structural transformation). With temperatures soaring, precipitation expected to decrease, and erosion threatening 75 percent of the coastline at term, Senegal’s population and assets are under high risk. The poorest are particularly vulnerable, with 55 percent of total households teetering on the edge of poverty because of recurrent shocks. Without action, annual economic losses could reach 3-4 percent of Gross Domestic Product (GDP) as soon as 2030 and further increase to 9.4 percent by 2050, wiping years of per capita income growth and eroding any potential human capital accumulation. Overall, climate change could push two more million Senegalese in poverty by mid-century. Building resilience and leveraging the low-carbon economy will help Senegal realizing its growth ambitions, contributing to a more productive, sustainable, and inclusive development pathway. The macro-economic analysis for this CCDR finds that adaptation measures in selected sectors could bring GDP gains of about 2 percent by 2030, and between 0.5 and 1 percent afterwards (for climate financing needs of about 0.9 percent of GDP in the period to 2030 and 0.1 percent afterwards). Adaptation could also reduce poverty headcount, with 40 percent less people pushed into poverty by climate change compared to no adaptation action. In addition, emission reductions could reach 20MtCO2e per year over the period to 2050, from interventions in forestry, improved cooking services, urban transport, waste management, and energy production. The energy transition provides an opportunity to meet both development and climate objectives, exceeding NDC targets and putting the country well on track for net zero by 2050, but significant downside risks remain, linked to delays in the deployment and financing availability for renewable generation and domestic gas. Senegal’s formidable renewable energy potential (chiefly around solar) offers the lowest cost generation option to meet rising energy demand while accelerating decarbonization. At term, the country could play a leading role in decarbonizing the region though export opportunities and bolster resilience across the regional grid. In the short term, given constraints to the fast deployment of renewables, the transitional use of domestic gas will help phase out expensive and high-emitting coal and Heavy Fuel Oil (HFO) generation, while balancing the electricity system and lowering the cost of electricity. Climate action will require a financing of US$8.2 billion over 2025-30 (in present value, at 6 percent per year), or 4.5 percent of discounted cumulative GDP over the same period, and US$10.6 billion over 2031-50 (in present value terms), or 2.0 percent of discounted cumulative GDP over the same period. Water security, sustainable (urban) transport, and the energy transition account for the largest share. Importantly, climate action is expected to bring significant benefits over time, beyond climate adaptation and mitigation – including health or jobs, (as in the primary sector, with 155,000 jobs created, of which 80 percent in agriculture). Many benefits could not be properly estimated, implying that the returns from climate action might well be underestimated.Publication Guinea-Bissau Country Climate and Development Report(Washington, DC: World Bank, 2024-10-23)Guinea-Bissau is endowed with a wealth of natural resources, with the highest natural capital per capita in West Africa (US3,874 dollars per capita), which could be leveraged for sustainable and resilient growth. However, Guinea-Bissau faces significant development hurdles, such as high poverty rates, political instability, and economic challenges, including an over-reliance on cashew nuts. Rural poverty has increased, and the nation's infrastructure, education, and health care systems are underdeveloped. Climate change poses a severe threat, potentially impacting agriculture, fisheries, and infrastructure. Without adaptation, it could lead to a significant cut in real GDP per capita (minus 7.3 percent by 2050) and increase in poverty (with up to over 200,000 additional poor by 2050, that is, 5 percent of the expected population, in the worst scenario). The country's low greenhouse gas emissions are expected to rise, mainly due to agriculture and land-use changes, with deforestation being a major contributing factor. Although Guinea-Bissau is a low emitter, it has high mitigation ambitions, targeting a 30 percent reduction in greenhouse gas emissions by 2030. The Nationally Determined Contribution outlines significant climate actions, with initiatives focused on forest conservation, sustainable agriculture, and community development. However, the country's political instability, institutional weaknesses, and limited financial resources pose challenges to implementing these climate commitments, which depend heavily on external funding. The financial sector's underdevelopment and vulnerability to external shocks limit its ability to support green investments, though reforms could enhance resilience. Guinea-Bissau must consider its climate financing as development financing and vice-versa, engage the private sector, and integrate climate goals with national development plans to ensure a sustainable future. Concessional climate financing is vital due to the underdeveloped financial sector and the government’s limited borrowing capacity. Addressing Guinea-Bissau's vulnerability to climate change and its structural issues requires a cohesive approach that integrates development and climate strategies. This could involve improving governance, diversifying the economy, protecting natural capital, developing human capital, and investing in sustainable agriculture and infrastructure. The transition to a more sustainable and inclusive development pathway that supports economic growth is possible, but requires focusing on key strategic sectors, enhancing institutional capacity, and creating the conditions to mobilize finance. As a highly vulnerable country, there are myriad needs in the different sectors; however, to be more efficient and effective, Guinea-Bissau should prioritize actions in a few sectors, especially actions on biodiversity, agriculture, and social protection. Low carbon development, especially in energy and forestry sectors, could provide cost-efficient solutions and attract climate finance, including from the private sector, which will support the overall development agenda.Publication Unlocking the Power of Healthy Longevity(Washington, DC: World Bank, 2024-09-12)Noncommunicable diseases (NCDs) are among the major health and development challenges of our time. Every year, about 41 million people die due to NCDs. This makes up about 74 percent of all deaths globally, the majority of which are in low- and middle-income countries (LMICs). Countless more people live with NCDs every day. Yet, NCDs are largely treatable and preventable. The risk of developing NCDs and deaths from them can both be lowered with appropriate attention to prevention and treatment. However, weak health systems and limited access to affordable care and information, especially in LMICs, contribute to lapses in seeking and receiving appropriate and timely care. This compendium is a compilation of 18 chapters, each exploring a different but related topic in the nexus of NCDs, human capital, and productivity. It is based on a series of analytical work taken up by the World Bank to support the Healthy Longevity Initiative (HLI) - a collaborative effort between the World Bank, the University of Toronto, and key academic and development partners including the Harvard University and the University of Washington. The HLI presents one of a growing set of efforts to increase the urgency of policy response to NCDs across the world.Publication Tajikistan Country Climate and Development Report(Washington, DC: World Bank, 2025-03-28)The Tajikistan Country Climate and Development Report (CCDR) explores the impact of climate change and global decarbonization on Tajikistan’s development. It identifies key areas to enhance climate resilience and deepen decarbonization and outlines priority recommendations for a successful green transition in Tajikistan, requiring structural reforms, climate-conscious policies, and inclusive strategies for a resilient and sustainable future. Despite economic growth and poverty reduction over the past two decades, Tajikistan's reliance on natural resources and remittances has led to unsustainable development, depleting natural capital and limiting job creation. The government’s green transition plan focuses on renewable energy, promising energy security, economic growth, and regional electricity exports. However, further efforts are needed for a resilient development path, including a complementary reform program to bring significant economic benefits, climate adaptation, and low-carbon development that will benefit Tajikistan and Central Asia's electricity systems. Climate change poses significant risks, threatening water security, agricultural productivity, and infrastructure, potentially reducing GDP per capita by 5-6% by mid-century and pushing 100,000 people into poverty. Additional adaptation measures are crucial, focusing on water management, resilient landscapes, climate-smart agriculture, and disaster risk management. A low-carbon development pathway offers a more resilient and prosperous future, with near net-zero emissions in energy and waste sectors by 2050, boosting economic growth, and job creation and reducing air pollution. Achieving these goals requires substantial investments and institutional reforms to mobilize private capital and attract green foreign investment. Development partners can provide financial assistance, technical expertise, and capacity building.Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.