Publication: Are Vaccination Campaigns Misinformed?: Experimental Evidence from COVID-19 in Low and Middle-Income Countries
Loading...
Date
2023-05-16
ISSN
Published
2023-05-16
Author(s)
Editor(s)
Abstract
Routine immunization coverage estimated in surveys often substantially differs from figures reported in administrative records, presenting a dilemma for researchers and policy makers. Using high-frequency phone surveys and administrative records from government sources in 36 low- and middle-income countries, this paper shows that such misalignment has also been common in the case of COVID-19. Across the sample, survey estimates exceed administrative figures by 47 percent on average, at times suggesting markedly different policy conclusions depending on the data source consulted. This pattern is particularly stark and consistent in Sub-Saharan Africa. To investigate the sources of this discrepancy, the paper presents results from six methodological experiments that vary survey design choices and documents their effect on estimated COVID-19 vaccine coverage. The results show that design choices matter, in particular the selection of respondents to be interviewed. However, phone survey estimates prove remarkably robust to several commonly claimed biases. After accounting for observed errors of representation and measurement in the survey data, there remains a nonnegligible, unexplained residual gap with administrative records. The paper provides indicative evidence of flaws and weaknesses in administrative data recording and reporting that affect reported vaccination rates and could contribute to this gap. The findings matter for past research on COVID-19 vaccination, future immunization efforts, and the design of robust data production systems on health topics.
Link to Data Set
Citation
“Markhof, Yannick; Wollburg, Philip; Zezza, Alberto. 2023. Are Vaccination Campaigns Misinformed?: Experimental Evidence from COVID-19 in Low and Middle-Income Countries. © World Bank. http://hdl.handle.net/10986/39816 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Acceptance of COVID-19 Vaccines in Sub-Saharan Africa(World Bank, Washington, DC, 2021-07)Recent debates surrounding the lagging COVID-19 vaccination campaigns in low-income countries center around vaccine supply and financing. Yet, relatively little is known about attitudes toward COVID-19 vaccines in these countries and in Africa in particular. This paper provides cross-country comparable estimates of the willingness to accept a COVID-19 vaccine in six Sub-Saharan African countries. It uses data from six national high-frequency phone surveys in countries representing 38 percent of the Sub-Saharan African population (Burkina Faso, Ethiopia, Malawi, Mali, Nigeria, and Uganda). Samples were drawn from large, nationally representative sampling frames providing a rich set of demographic and socioeconomic characteristics which are used to disaggregate the analysis. The findings show acceptance rates to be generally high, with at least four in five people willing to be vaccinated in all but one country. Vaccine acceptance ranges from nearly universal in Ethiopia (97.9 percent) to below what would likely be required for herd immunity in Mali (64.5 percent). Safety concerns about the vaccine in general and its side effects emerge as the primary reservations toward a COVID-19 vaccine across countries. These findings suggest that limited supply, not inadequate demand, likely presents the key bottleneck to reaching high COVID-19 vaccine coverage in Sub-Saharan Africa.Publication Turning COVID-19 Vaccines into Vaccinations(World Bank, Washington, DC, 2022-08)As COVID-19 vaccines have become more widely available in Sub-Saharan Africa, vaccination campaigns in the region have struggled to pick up pace and trail the rest of the world. This paper presents new evidence on vaccine hesitancy, uptake, last-mile delivery barriers, and potential strategies to reach those who remain unvaccinated. The data come from high-frequency phone surveys in five countries in East and West Africa (Burkina Faso, Kenya, Malawi, Nigeria, and Tanzania). The surveys were conducted by countries’ national statistical agencies, have national scope, are cross-country comparable, and draw their samples from nationally representative sampling frames. The findings show that across the study countries, a majority is willing to get vaccinated. Still, vaccine hesitancy is non-negligible among those pending vaccination. Concerns about side effects of the vaccine are the primary reason for hesitancy. At the same time, many who are willing to get vaccinated are deterred by a lack of easy access to vaccines at the local level. Radio broadcasts have widespread reach and medical professionals have good rapport among the unvaccinated population. Furthermore, social ties and perceptions as well as intrahousehold power relations matter for vaccine take-up. Based on the findings, the paper elaborates policy options to boost vaccination campaigns in Sub-Saharan Africa.Publication The Evolution of COVID-19 Vaccine Hesitancy in Sub-Saharan Africa(World Bank, Washington, DC, 2023-01-12)COVID-19 vaccination rates in Sub-Saharan Africa lag behind other world regions, with just over 20 percent of the population in Sub-Saharan Africa fully vaccinated. To reach widespread coverage, high willingness to get vaccinated for COVID-19 among the population is considered an important prerequisite. Drawing on two years of panel survey data, this paper studies the dynamics of vaccine acceptance, its correlates, and reasons for hesitancy over time. The data come from multiple rounds of national High-Frequency Phone Surveys in five countries in East and West Africa (Burkina Faso, Ethiopia, Malawi, Nigeria, and Uganda), covering the period between 2020 and 2022. The surveys are cross-country comparable and draw their samples from nationally representative sampling frames. The paper finds that COVID-19 vaccine acceptance has been high throughout the study period (68 to 98 percent). However, acceptance levels were lower in 2022 than in 2020 in three countries (Burkina Faso, Malawi, and Nigeria) and higher in one country (Uganda). Moreover, individuals are observed to change their stated vaccine attitudes between survey rounds, to a limited extent in some countries (Ethiopia) and more frequently in others (Burkina Faso, Malawi, Nigeria, and Uganda). Vaccine hesitancy is higher in richer households and among those residing in urban areas, women, and the better educated. Conversely, hesitancy is lower in larger households and among heads of the household. The main reasons for hesitancy are concerns about side effects of the vaccine, its safety and efficacy, as well as assessments of COVID-19 risk, although these reasons fluctuate over time. The findings suggest that vaccine hesitancy is not the primary obstacle to reaching greater vaccine coverage in Sub-Saharan Africa. Instead, low coverage rates may be related to access and delivery barriers as well as supply shortages. Nevertheless, vaccine attitudes appear malleable so that continued efforts are needed to retain high levels of vaccine acceptance.Publication From Necessity to Opportunity(World Bank, Washington, DC, 2022-09)The COVID-19 pandemic has disrupted survey and data systems globally and especially in low- and middle-income countries. Lockdowns necessitated remote data collection as demand for data on the impacts of the pandemic surged. Phone surveys started being implemented at a national scale in many places that previously had limited experience with them. As in-person data collection resumes, the experience gained provides the grounds to reflect on how phone surveys may be incorporated into survey and data systems in low- and middle-income countries. This includes agricultural and rural surveys supported by international survey programs such as the World Bank’s Living Standards Measurement Study—Integrated Surveys on Agriculture, the Food and Agriculture Organization’s AGRISurvey, or the 50x2030 Initiative. Reviewing evidence and experiences from before and during the pandemic, the paper analyzes and provides guidance on the scope of and considerations for using phone surveys for agricultural data collection. It addresses the domains of sampling and representativeness, post-survey adjustments, questionnaire design, respondent selection and behavior, interviewer effects, as well as cost considerations, all with an emphasis on the particularities of agricultural and rural surveys. Ultimately, the integration of phone interviews with in-person data collection offers a promising opportunity to leverage the benefits of phone surveys while addressing their limitations, including the depth of content constraints and potential coverage biases, which are especially challenging for agricultural and rural populations in low- and middle-income countries.Publication The Impacts of Disasters on African Agriculture(World Bank, Washington, DC, 2024-01-16)Disasters affect millions of people each year and cause economic losses worth many billions of dollars globally. Reporting on disaster impacts in research, policy, and news primarily relies on macro statistics based on disaster inventories. The macro statistics suggest that a relatively small share of disaster damages accrues in Africa. This paper, instead, uses detailed survey micro-data from six African countries to quantify disaster damages in one key sector: crop agriculture. The micro-data reveals much higher damages and more people affected than the macro statistics would indicate. On average, 36 percent of the agricultural plots in the sample suffer crop losses due to adverse climatic events. In the countries and time period analyzed, these losses reduced total crop production by an average of 29 percent. Importantly, many of these losses are underreported or undetected in key disaster inventories and therefore elude macro statistics. In the case of droughts and floods, the economic losses recorded in the micro-data are $5.1 billion higher than in the macro statistics, affecting 145 million to 170 million people, more than four times as many as the macro statistics suggest. The difference stems mostly from smaller and less severe but frequent adverse events that are not recorded in disaster inventories.
Users also downloaded
Showing related downloaded files
Publication Economic Recovery(World Bank, Washington, DC, 2021-04-06)World Bank Group President David Malpass spoke about the world facing major challenges, including COVID, climate change, rising poverty and inequality and growing fragility and violence in many countries. He highlighted vaccines, working closely with Gavi, WHO, and UNICEF, the World Bank has conducted over one hundred capacity assessments, many even more before vaccines were available. The World Bank Group worked to achieve a debt service suspension initiative and increased transparency in debt contracts at developing countries. The World Bank Group is finalizing a new climate change action plan, which includes a big step up in financing, building on their record climate financing over the past two years. He noted big challenges to bring all together to achieve GRID: green, resilient, and inclusive development. Janet Yellen, U.S. Secretary of the Treasury, mentioned focusing on vulnerable people during the pandemic. Kristalina Georgieva, Managing Director of the International Monetary Fund, focused on giving everyone a fair shot during a sustainable recovery. All three commented on the importance of tackling climate change.Publication South Asia Development Update, April 2024: Jobs for Resilience(Washington, DC: World Bank, 2024-04-02)South Asia is expected to continue to be the fastest-growing emerging market and developing economy (EMDE) region over the next two years. This is largely thanks to robust growth in India, but growth is also expected to pick up in most other South Asian economies. However, growth in the near-term is more reliant on the public sector than elsewhere, whereas private investment, in particular, continues to be weak. Efforts to rein in elevated debt, borrowing costs, and fiscal deficits may eventually weigh on growth and limit governments' ability to respond to increasingly frequent climate shocks. Yet, the provision of public goods is among the most effective strategies for climate adaptation. This is especially the case for households and farms, which tend to rely on shifting their efforts to non-agricultural jobs. These strategies are less effective forms of climate adaptation, in part because opportunities to move out of agriculture are limited by the region’s below-average employment ratios in the non-agricultural sector and for women. Because employment growth is falling short of working-age population growth, the region fails to fully capitalize on its demographic dividend. Vibrant, competitive firms are key to unlocking the demographic dividend, robust private investment, and workers’ ability to move out of agriculture. A range of policies could spur firm growth, including improved business climates and institutions, the removal of financial sector restrictions, and greater openness to trade and capital flows.Publication Media and Messages for Nutrition and Health(World Bank, Washington, DC, 2020-06)The Lao People’s Democratic Republic (Lao PDR) has experienced rapid and significant economic growth over the past decade. However, poor nutritional outcomes remain a concern. Rates of childhood undernutrition are particularly high in remote, rural, and upland areas. Media have the potential to play an important role in shaping health and nutrition–related behaviors and practices as well as in promoting sociocultural and economic development that might contribute to improved nutritional outcomes. This report presents the results of a media audit (MA) that was conducted to inform the development and production of mass media advocacy and communication strategies and materials with a focus on maternal and child health and nutrition that would reach the most people from the poorest communities in northern Lao PDR. Making more people aware of useful information, essential services and products and influencing them to use these effectively is the ultimate goal of mass media campaigns, and the MA measures the potential effectiveness of media efforts to reach this goal. The effectiveness of communication channels to deliver health and nutrition messages to target beneficiaries to ensure maximum reach and uptake can be viewed in terms of preferences, satisfaction, and trust. Overall, the four most accessed media channels for receiving information among communities in the study areas were village announcements, mobile phones, television, and out-of-home (OOH) media. Of the accessed media channels, the top three most preferred channels were village announcements (40 percent), television (26 percent), and mobile phones (19 percent). In terms of trust, village announcements were the most trusted source of information (64 percent), followed by mobile phones (14 percent) and television (11 percent). Hence of all the media channels, village announcements are the most preferred, have the most satisfied users, and are the most trusted source of information in study communities from four provinces in Lao PDR with some of the highest burden of childhood undernutrition.Publication Remarks at the United Nations Biodiversity Conference(World Bank, Washington, DC, 2021-10-12)World Bank Group President David Malpass discussed biodiversity and climate change being closely interlinked, with terrestrial and marine ecosystems serving as critically important carbon sinks. At the same time climate change acts as a direct driver of biodiversity and ecosystem services loss. The World Bank has financed biodiversity conservation around the world, including over 116 million hectares of Marine and Coastal Protected Areas, 10 million hectares of Terrestrial Protected Areas, and over 300 protected habitats, biological buffer zones and reserves. The COVID pandemic, biodiversity loss, climate change are all reminders of how connected we are. The recovery from this pandemic is an opportunity to put in place more effective policies, institutions, and resources to address biodiversity loss.Publication Europe and Central Asia Economic Update, Fall 2024: Better Education for Stronger Growth(Washington, DC: World Bank, 2024-10-17)Economic growth in Europe and Central Asia (ECA) is likely to moderate from 3.5 percent in 2023 to 3.3 percent this year. This is significantly weaker than the 4.1 percent average growth in 2000-19. Growth this year is driven by expansionary fiscal policies and strong private consumption. External demand is less favorable because of weak economic expansion in major trading partners, like the European Union. Growth is likely to slow further in 2025, mostly because of the easing of expansion in the Russian Federation and Turkiye. This Europe and Central Asia Economic Update calls for a major overhaul of education systems across the region, particularly higher education, to unleash the talent needed to reinvigorate growth and boost convergence with high-income countries. Universities in the region suffer from poor management, outdated curricula, and inadequate funding and infrastructure. A mismatch between graduates' skills and the skills employers are seeking leads to wasted potential and contributes to the region's brain drain. Reversing the decline in the quality of education will require prioritizing improvements in teacher training, updated curricula, and investment in educational infrastructure. In higher education, reforms are needed to consolidate university systems, integrate them with research centers, and provide reskilling opportunities for adult workers.