Publication: Talk or Text?: Evaluating Response Rates by Remote Survey Method during COVID-19
Loading...
Published
2022-04
ISSN
Date
2022-04-08
Author(s)
Editor(s)
Abstract
Researchers and policy makers face significant challenges in selecting a method to conduct remote surveys, especially when collecting sensitive information or during turbulent life stages of hard-to-reach groups. In the context of the COVID-19 lockdown, this study randomly selected about 600 adults in El Salvador to survey using two different tools: telephone interviews or a self-completion survey via WhatsApp. The findings show that phone-based surveys increase the rate of survey completion by 42 percentage points. Even larger effects are documented for women and older adults. Although the direct costs of phone-based surveys are substantially higher—doubling implementation cost—the estimates imply that when adjusted for the probability of completion, the costs of conducting phone-based surveys can be 25 percent lower.
Link to Data Set
Citation
“Amaral, Sofia; Dinarte Diaz, Lelys; Dominguez, Patricio; Perez-Vincent, Santiago M.; Romero, Steffanny. 2022. Talk or Text?: Evaluating Response Rates by Remote Survey Method during COVID-19. Policy Research Working Paper;9999. © World Bank. http://hdl.handle.net/10986/37279 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Gender Gaps in the Performance of Small Firms: Evidence from Urban Peru(Washington, DC: World Bank, 2025-09-23)This paper estimates the gender gap in the performance of firms in Peru using representative data on both formal and informal firms. On average, informal female-led firms have lower sales, labor productivity, and profits compared to their male-led counterparts, with differences more pronounced when controlling for observable determinants of firm performance. However, gender gaps are only significant at the bottom of the performance distribution of informal firms, and these gaps disappear at the top of the distribution of informal firms and for formal firms. Possible explanations for the performance gaps at the bottom of the distribution include the higher likelihood of small, female-led firms being home-based, which is linked to lower profits, and their concentration in less profitable sectors. The paper provides suggestive evidence that household responsibilities play a key role in explaining the gender gap in firm performance among informal firms. Therefore, policies that promote access to care services or foster a more equal distribution of household activities may reduce gender productivity gaps and allow for a more efficient allocation of resources.Publication The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-02-05)Research on the labor market implications of artificial intelligence has focused principally on high-income countries. This paper analyzes this issue using microdata from a large set of low- and middle-income countries, applying a measure of potential artificial intelligence occupational exposure to a harmonized set of labor force surveys for 25 countries, covering a population of 3.5 billion people. The approach advances work by using harmonized microdata at the level of individual workers, which allows for a multivariate analysis of factors associated with exposure. Additionally, unlike earlier papers, the paper uses highly detailed (4 digit) occupation codes, which provide a more reliable mapping of artificial intelligence exposure to occupation. Results within countries, show that artificial intelligence exposure is higher for women, urban workers, and those with higher education. Exposure decreases by country income level, with high exposure for just 12 percent of workers in low-income countries and 15 percent of workers in lower-middle-income countries. Furthermore, lack of access to electricity limits effective exposure in low-income countries. These results suggest that for developing countries, and in particular low-income countries, the labor market impacts of artificial intelligence will be more limited than in high-income countries. While greater exposure to artificial intelligence indicates larger potential for future changes in certain occupations, it does not equate to job loss, as it could result in augmentation of worker productivity, automation of some tasks, or both.Publication Geopolitical Risks and Trade(Washington, DC: World Bank, 2025-09-23)This paper studies the impact of geopolitical risks on international trade, using the Geopolitical Risk (GPR) index of Caldara and Iacoviello (2022) and an empirical gravity model. The impact of spikes in geopolitical risk on trade is negative, strong, and heterogeneous across sectors. The findings show that increases in geopolitical risk reduce trade by about 30 to 40 percent. These effects are equivalent to an increase of global tariffs of up to 14 percent. Services trade is most vulnerable to geopolitical risks, followed by agriculture, and the impact on manufacturing trade is moderate. These negative effects are partially mitigated by cultural and geographic proximity, as well as by the presence of trade agreements.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Helping Families Help Themselves? Heterogeneous Effects of a Digital Parenting Program(World Bank, Washington, DC, 2021-11)Parenting practices are crucial for the development of children’s brains and social skills. However, parenting styles may be far from ideal, particularly those of caregivers with high stress levels. Using an individual-level experiment with male and female caregivers of young children in El Salvador, this paper evaluates the impact of a free digital stress management and positive parenting intervention. The results indicate that, for males, the intervention increased stress and anxiety and lowered caregiver-child interactions. The effect on males was concentrated among the poorer and those residing with a partner. In contrast, women’s mental health was not impacted. Yet, their use of physical violence toward children decreased by 18 percent. These results align with theories linking economic deprivation and family structure to caregivers’ cognitive overload and mental health.Publication Closing the Gaps(Washington, DC: World Bank, 2024-05-17)Can alternative survey methods address the underreporting of women’s and youths’ labor market outcomes, and thus improve the measurement of the underlying gender- and age-based gaps This paper addresses this question using a survey experiment in El Salvador that compares two alternative survey methods—a list of activities survey module and enforced self-responses—against a traditional household survey, which consists of proxy responses without a list of activities module. The findings show that including the list of activities module yields higher work and employment rates for the average respondent compared to the standard household survey. Notably, when using the list of activities module, the reported work gap between men and women falls by 8.1 percentage points. Moreover, when using enforced self-responses, the male age gaps in employment and work rates fall by 13.9 and 12.3 percentage points, respectively. The paper provides evidence that the prevalence of peers’ informal employment or social norms for domestic obligations drive these results.Publication Filling the Gaps(World Bank, Washington, DC, 2023-07-11)This paper aims to provide global evidence on whether and what attributes of laws governing the provision of childcare services affect women's labor market outcomes. It merges country-year-level data from the World Bank's Women, Business and the Law database, which documents childcare laws across countries, with data on women's labor force participation from ILOSTAT. Using a difference-in-difference estimation framework, the analysis finds that the enactment of childcare laws increases women's labor force participation by 2 percent, on average. Moreover, the effect increases over time, reaching up to 4 percent five years after an enactment. This effect is driven by women who are married, have completed less than primary education, and are between the ages of 35 and 44. Lastly, regulation of the availability and affordability of childcare has a similar impact on female labor force participation, whereas the effect of quality regulation is smaller.Publication Arab Republic of Egypt : Gender assessment 2010(World Bank, 2010-01-01)The objective of this policy note is to examine the gender dimension of the Egyptian labor market, with a focus on identifying the scope for policies to improve female labor force participation. An update to the Egypt gender assessment report of 2003, it is envisioned as a contribution to programmatic work on gender and inclusion in Egypt, helping build evidence which can inform policy aimed at improving the participation and retention of women in the labor force. Analytical and investigative in nature, it is the hope that this note will motivate discussion and debate among stakeholders in the country. The questions to be addressed in the note are also relevant for policy discussions and Bank operations in other countries, especially those in the Middle East North Africa (MENA) region where females face similar challenges to labor force participation. Besides laying out the underlying correlates of gender gaps in these areas, the report recommended a comprehensive list of 'strategic interventions' by sector for the government and other development actors, in areas such as investment in women's education, the re-examination of certain discriminatory provisions in the country's legal system, and the promotion of cultural norms that value women as equal partners to men. In the sphere of women's economic opportunities, the report pinpointed vulnerabilities such as high unemployment rates (particularly among the more educated), and a disproportionate dependence on an already shrinking public sector. Highlighting the need for creating productive and sustainable jobs for women in the private sector, the report suggested initiatives such as increasing women's access to training, technology, land, credit and information.Publication Neither by Land nor by Sea(World Bank, Washington, DC, 2022-05)Despite concerns that the COVID-19 economic collapse would torpedo international remittances, formal remittances to several developing countries ballooned early in the pandemic. This increase might, however, have reflected a shift from informal channels to formal ones rather than a change in actual flows. This paper employs Mexican data to explore this and finds that remittance channels did change. The rise in formal inflows was larger among municipalities that were previously more reliant on informal channels (for example, near a border crossing). Households there also experienced a disproportionate increase in bank accounts opened after lockdown measures. The paper also rules out hypotheses related to the US Coronavirus Aid, Relief, and. Economic Security Act and altruism.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.