Publication: Behaviorally Informed Messages Increase COVID-19 Vaccination Intentions: Insights from a Global Meta-Analysis
Loading...
Date
2024-11-22
ISSN
Published
2024-11-22
Author(s)
Pinzon Hernandez, Daniel Alejandro
Lim, Jungkyu Rhys
Dugas, Michelle
Moscoe, Ellen
Chatila, Mohamad
Cameron, Corey
Afif, Zeina
Orozco Olvera, Victor Hugo
Editor(s)
Abstract
During the COVID-19 pandemic, low- and middle-income countries struggled with lower vaccination rates compared to wealthier countries, posing challenges to reducing virus transmission, mitigating healthcare system pressures, and promoting economic recovery. Communications campaigns offer low-cost opportunities to overcome such challenges by strengthening vaccine confidence and intentions to get vaccinated, but empirical testing is needed to identify which messages will be most effective in different contexts. To support policy-making efforts to design effective communication rapidly during the pandemic, a global research program of 28 online experiments was conducted by recruiting respondents (123,270 individuals) through social media between January 2021 and June 2022 across 23 mostly low- and middle-income countries and territories. An individual participant data (IPD) meta-analysis of these data summarizes the results of this research program testing the impact of behaviorally informed messaging on vaccine intentions. Results from the meta-analysis show that among unvaccinated survey respondents, behaviorally informed messages significantly increased the odds of vaccination intention by 1.28 times overall and up to 1.93 times in individual studies (safety messages in Papua New Guinea). Significant pooled effects of specific framings ranged from increasing the odds of vaccination intention by 1.16 times (variant framing) to 1.45 times (experts and religious leaders framing). This research underscores the importance of communication tailored to address different drivers of vaccine hesitancy and offers insights for handling future health crises with behavioral communication strategies leveraging rapid insights afforded by social media.
Link to Data Set
Citation
“Pinzon Hernandez, Daniel Alejandro; Lim, Jungkyu Rhys; Dugas, Michelle; Moscoe, Ellen; Chatila, Mohamad; Cameron, Corey; Vakis, Renos; Afif, Zeina; Orozco Olvera, Victor Hugo. 2024. Behaviorally Informed Messages Increase COVID-19 Vaccination Intentions: Insights from a Global Meta-Analysis. Policy Research Working Paper; 10981. © World Bank. http://hdl.handle.net/10986/42455 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Chinese Imports and Industrialization in Africa(Washington, DC: World Bank, 2025-05-12)The rise of China in the global economy has been linked with negative impacts on employment across many high- and middle-income countries. However, evidence for African countries is limited. This paper investigates the causal relationship between Chinese imports and manufacturing employment in Ethiopia. Imports may harm domestic firms through a revenue effect (lower market shares) or benefit them, indirectly if competition spurs innovation or directly through access to better quality or cheaper inputs. The analysis shows that a one unit increase in import penetration leads to a 15.2 percent increase in industry employment. The inputs effect is disentangled from the other two effects by decomposing total Chinese imports by their end-use category using input-output tables. The evidence shows that imported intermediate inputs are driving the employment gains. The findings are consistent with the idea that employment gains are a result of productivity gains and increases in capacity utilization. These employment gains appear to benefit large firms and labor-intensive industries disproportionately.Publication VAT Exemptions, Embedded Tax, and Unintended Consequences(Washington, DC: World Bank, 2025-05-15)The value-added tax (VAT) has proved to be a highly effective tool at raising revenue in developed and developing countries alike. However, the effective operation of the VAT breaks down in the presence of exemptions. Unlike zero rates, exemptions deny input tax credits, thereby increasing production costs and resulting in VAT being embedded within the prices of goods and services. This paper develops a VAT model based on input-output table and household budget survey data for 29 European countries to examine the effects of VAT exemptions on final prices and to assess the merits of their use. Simulation results show that exemptions suffer from the same targeting problems as reduced VAT rates, but, in addition, they are non-transparent and have unpredictable and counterproductive indirect effects. These effects are in addition to the well-known distortionary impact of exemptions on production decisions, and their creation of incentives to self-supply. The paper concludes that the use of exemptions should be limited to addressing pragmatic concerns, such as the disproportionate compliance costs of small businesses and the practical difficulty in taxing margin-based financial services.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Behavioral Science and COVID-19(Washington, DC: World Bank, 2022-07-27)The first Coronavirus (COVID-19) cases were reported in December 2019 (WHO, 2020). Governments around the world have tried various interventions to stop the COVID-19 spread and encourage vaccination. With growing evidence of the governments’ COVID-19 efforts to deal with the pandemic, this guide aims to summarize interventions and applications, and their effectiveness to address the following three COVID-19 topics: How to reduce COVID-19 spread; How to encourage people to get vaccinated; and How to address misinformation and fake news.Publication Find the Fake(Washington, DC: World Bank, 2024-09-30)The proliferation of misinformation and disinformation threatens to erode the credibility of public institutions and limit their capacity to implement policies that enhance public well-being. While health misinformation represents an urgent global challenge, relatively little research has examined solutions in low- and middle-income countries. This study experimentally tests the impact of a novel WhatsApp chatbot game pre-bunking inoculation intervention in Jordan to boost capacity to identify common misinformation techniques and reduce the likelihood of sharing misleading headlines with otherseffectively “inoculating” them against health misinformation. A sample of 2,851 participants was recruited online and randomly assigned to five study arms: (1) comprehensive game-based inoculation, (2) brief game-based inoculation that highlighted examples of only misinformation, (3) infographics-based inoculation, (4) exposure to placebo infographics unrelated to misinformation, and (5) pure control. To evaluate the impact of the intervention, the study assesses two main outcomes: (1) ability to discern accurately headlines using misinformation techniques and headlines that do not use misinformation techniques, and (2) discernment in sharing the two types of headlines. Compared to the placebo group, the comprehensive game significantly improved discernment of misinformation and reduced the likelihood of sharing misleading headlines. A brief version of the game yielded weaker effects on discernment of misinformation, but similarly reduced intentions to share misleading headlines. In contrast, exposure to infographics teaching similar techniques showed no significant impacts on discernment of misinformation, and marginal effects on intention to share misleading headlines. These findings suggest that games can effectively inoculate the public against misinformation in the context of a middle-income country in the short term. Future research is needed to explore the boundary conditions of the findings.Publication Can Environmental Cash Transfers Reduce Deforestation and Improve Social Outcomes? A Regression Discontinuity Analysis of Mexico’s National Program (2011-2014)(World Bank, Washington, DC, 2019-01)Environmental conditional cash transfers, or "payments for ecosystem services" are a centerpiece of global efforts to protect biodiversity, safeguard watersheds, and mitigate climate change by reducing forest loss. This paper evaluates the impacts of Mexico's national payments for ecosystem services program, which provides five years of payments to landowners in exchange for maintaining and managing natural land cover. Using a regression discontinuity design, the paper studies impacts on environmental, socioeconomic, and social capital outcomes for the 2011-14 program cohorts. The analysis finds that treated communities increased management activities to protect land cover, such as patrolling for illegal conversion or combatting soil erosion (by 48 percent compared to controls). The program reduced the loss of tree cover in areas at high risk of deforestation (by 29 percent compared to controls), with effects being larger for those that have been in the program the longest (38 percent compared to controls). These results are similar to estimates of impact for earlier program cohorts and continue to highlight the importance of targeting the program to areas of high risk of land cover loss to increase environmental effectiveness. The program continued to reach poor communities and households, but estimated impacts on household wealth indicators are small in magnitude and not statistically significant. These results indicate that community-level conditional payments did not harm household-level socioeconomic indicators, a key safeguard requirement of conservation policies of the United Nations Programme on Reducing Emissions from Deforestation and Forest Degradation. The data also show that payments for ecosystem services significantly increased community social capital -- the institutions, attitudes, and values that govern human interactions -- (by 9 percent compared to controls), and these externally provided incentives did not crowd out household contributions to other community work.Publication Behavioral insights for COVID-19 vaccine uptake in the Caribbean(World Bank, Washington, DC, 2023-10-18)In the wake of the pandemic, the greatest obstacle to COVID-19 vaccination in the Caribbean is vaccine acceptance and uptake rather than supply. Social media surveys were conducted in three Caribbean countries to better understand the socio-behavioral drivers of vaccine acceptance and uptake to address ongoing vaccination challenges to prevent morbidity and mortality. Behavioral science made critical contributions to global COVID-19 vaccination campaigns. We wanted to understand vaccine intentions, behavioral biases and barriers limiting vaccine uptake to better target vaccination efforts and inform health communication campaigns. Surveys were administered via Facebook messenger chatbot, with data drawn from a non-probability sample of both vaccinated and unvaccinated respondents. Surveys were conducted in April-May 2022, with respondents from Belize (n=2,657), Jamaica (n=4,096), and Haiti (n=10,419). We focused on the ‘movable middle’, i.e., people who are still undecided about whether they wanted the COVID-19 vaccine. Further, surveys tested the impact of different behaviorally informed messages on vaccine intention. Each country presented unique vaccination uptake challenges which required specific interventions or outreach strategies to change vaccination attitudes and behaviors. The responses of the movable middle provide insights into how this group could be targeted for improving uptake. Knowledge of this group can aid in targeting messaging, selection of trusted messengers and channels.Publication The Entertaining Way to Behavioral Change(World Bank, Washington, DC, 2019-09)This paper tests the effectiveness of an entertainment education television series, MTV Shuga, aimed at providing information and changing attitudes and behaviors related to HIV/AIDS. Using a simple model, the paper shows that “edutainment” can work through an individual or a social channel. This study is a randomized controlled trial conducted in urban Nigeria, where young viewers were exposed to MTV Shuga or a placebo television series. Among those exposed to MTV Shuga, the trial created additional variation in the social messages they received and the people with whom they watched the show. The study finds significant improvements in knowledge and attitudes toward HIV and risky sexual behavior. Treated subjects are twice as likely to get tested for HIV eight months after the intervention. The study also finds reductions in sexually transmitted diseases among women. These effects are stronger for viewers who reported being more involved with the narrative, consistent with the psychological underpinnings of edutainment. The trial’s experimental manipulations of the social norm component did not produce significantly different results from the main treatment. The individual effect of edutainment thus seems to have prevailed in the context of this study.
Users also downloaded
Showing related downloaded files
Publication Find the Fake(Washington, DC: World Bank, 2024-09-30)The proliferation of misinformation and disinformation threatens to erode the credibility of public institutions and limit their capacity to implement policies that enhance public well-being. While health misinformation represents an urgent global challenge, relatively little research has examined solutions in low- and middle-income countries. This study experimentally tests the impact of a novel WhatsApp chatbot game pre-bunking inoculation intervention in Jordan to boost capacity to identify common misinformation techniques and reduce the likelihood of sharing misleading headlines with otherseffectively “inoculating” them against health misinformation. A sample of 2,851 participants was recruited online and randomly assigned to five study arms: (1) comprehensive game-based inoculation, (2) brief game-based inoculation that highlighted examples of only misinformation, (3) infographics-based inoculation, (4) exposure to placebo infographics unrelated to misinformation, and (5) pure control. To evaluate the impact of the intervention, the study assesses two main outcomes: (1) ability to discern accurately headlines using misinformation techniques and headlines that do not use misinformation techniques, and (2) discernment in sharing the two types of headlines. Compared to the placebo group, the comprehensive game significantly improved discernment of misinformation and reduced the likelihood of sharing misleading headlines. A brief version of the game yielded weaker effects on discernment of misinformation, but similarly reduced intentions to share misleading headlines. In contrast, exposure to infographics teaching similar techniques showed no significant impacts on discernment of misinformation, and marginal effects on intention to share misleading headlines. These findings suggest that games can effectively inoculate the public against misinformation in the context of a middle-income country in the short term. Future research is needed to explore the boundary conditions of the findings.Publication Monitoring the Socio-Economic Impacts of COVID-19 on Djiboutian and Refugee Households in Djibouti(World Bank, Washington, DC, 2021-05-27)The third round of data collection on monitoring of socio-economic impacts of the COVID-19 (coronavirus) pandemic in Djibouti followed urban national households based on two previous waves of data collection as well as a replacement sub-sample. This round also includes a refugee sub-sample, covering urban refugees and those based in refugee villages. Economic recovery in Djibouti continues to follow a positive trend. Breadwinners from Djiboutian households continue to come back to work. Only 4 percent of those working before the pandemic were not working at the time of the survey. Even when counting those who were not working before the pandemic, 83 percent of all national households' breadwinners are now working – continuing strong trends from waves 1 and 2. Nationals with waged work grew from 22 to 76 percent in that time, and only 9 percent of those currently working report working less than usual. Djiboutian workers are also working more – but for less pay. Only one in five Djiboutian breadwinners are working less than they were before the pandemic or not at all. However, half of those who worked less than usual received no pay in wave 3 – 53 percent up from 35 percent in wave 2, and fewer received partial payment compared to the previous waves. Poor households were more likely to have received no pay for work performed. Refugees based in refugee villages face worse employment conditions than those living in urban areas or urban nationals. They were less likely to be employed prior to COVID-19, more likely to lose their job during pandemic, and do not exhibit similar signs of recovery. Around 68 percent of urban refugee breadwinners are currently working and 7 percent who worked before the pandemic are currently not working. In comparison, less than half (49 percent) of refugee breadwinners based in refugee villages are currently working, and 16 percent are no longer working relative to pre-COVID-19. A quarter of urban refugees and around 35 percent of refugees in refugee villages worked neither now nor before the pandemic, and nearly a third (29 percent) of the latter who are working report working less than usual. In addition, refugee breadwinners’ concentration in the informal sector (87 percent) highlights the precarity of their livelihood.Publication Equality of Opportunity for Sexual and Gender Minorities 2024(Washington, DC: World Bank, 2024-09-10)By assessing discrimination in laws, regulations, and policies, the Equality of Opportunity for Sexual and Gender Minorities (EQOSOGI) initiative examines institutionalized challenges encountered by sexual and gender minorities. This second edition of the EQOSOGI report expands its coverage from 16 to 64 countries representing different geographic areas, income levels, legal traditions, and inclusiveness of sexual and gender minorities, ensuring a diverse and holistic representation of the issues. EQOSOGI presents indicators to identify differences in the legal and policy environment for sexual and gender minorities in six areas: Decriminalization, Access to Education, Access to Labor Markets, Access to Services and Social Protection, Civil and Political Inclusion, and Protection from Hate Crimes. The indicators are also disaggregated into the three dimensions of sexual orientation, gender identity and expression, and sex characteristics. Building a global knowledge base on laws and policies affecting sexual and gender minorities is at the foundation of advocacy and policy change, especially because sexual and gender minorities are largely excluded from development efforts. By collecting and sharing data on national frameworks, the EQOSOGI study aims to promote a dialogue on equality of opportunity and to encourage law and policy reforms that enable sexual and gender minorities to fully participate in the economy and share in the benefits of development. It also aims to promote a deeper understanding of the legal hurdles hindering inclusive job creation and private sector development and, ultimately, to encourage reforms that are conducive to poverty reduction and shared prosperity on a liveable planet. The report also offers a deep dive into discriminatory legal practices in these areas and how they relate to socioeconomic outcomes for sexual and gender minorities. It provides areas of policy engagement to prevent discrimination based on sexual orientation, gender identity and expression, and sex characteristics, and to promote increased social and economic inclusion.Publication Poor Expectations(World Bank, Washington, DC, 2021-03)Do teachers’ stereotypes of social class bias their assessment of students? This study uses a lab-in-the-field experiment among primary school teachers to test whether they are biased against poor students. Teachers assessed a student in a video of an oral exam after watching one of two versions of an introductory video that portrayed the child’s home and playground. When the student in the exam video exhibited inconsistent performance, showing varying levels of scholastic aptitude and focus during the exam, teachers were far more likely to judge his scholastic aptitude as below grade-level if they had watched the introductory video portraying a poor background than if they had watched the introductory video portraying a middle-class background. The social class background portrayed in the introductory video did not affect teachers’ behavioral assessments of the student. When the student in the exam video was consistently high achieving, showing high levels of scholastic aptitude and focus throughout the exam, teachers who watched the introductory video depicting a poor background were more likely to assess the student as above grade-level than teachers who watched the video conveying a middle-class background. In this case, however, they had a more negative assessment of the child’s behavior when they thought he came from a poor background, deeming him to be less motivated and less emotionally mature than when the introductory video depicted a middle-class background. These findings suggest that stereotypes influence how teachers assess the scholastic aptitude and behavior of their students.Publication World Development Report 2015(Washington, DC: World Bank, 2015)Every policy relies on explicit or implicit assumptions about how people make choices. Those assumptions typically rest on an idealized model of how people think, rather than an understanding of how everyday thinking actually works. This year’s World Development Report argues that a more realistic account of decision-making and behavior will make development policy more effective. The Report emphasizes what it calls 'the three marks of everyday thinking.' In everyday thinking, people use intuition much more than careful analysis. They employ concepts and tools that prior experience in their cultural world has made familiar. And social emotions and social norms motivate much of what they do. These insights together explain the extraordinary persistence of some social practices, and rapid change in others. They also offer new targets for development policy. A richer understanding of why people save, use preventive health care, work hard, learn, and conserve energy provides a basis for innovative and inexpensive interventions. The insights reveal that poverty not only deprives people of resources but is an environment that shapes decision making, a fact that development projects across the board need to recognize. The insights show that the psychological foundations of decision making emerge at a young age and require social support. The Report applies insights from modern behavioral and social sciences to development policies for addressing poverty, finance, productivity, health, children, and climate change. It demonstrates that new policy ideas based on a richer view of decision-making can yield high economic returns. These new policy targets include: the choice architecture (for example, the default option); the scope for social rewards; frames that influence whether or not a norm is activated; information in the form of rules of thumb; opportunities for experiences that change mental models or social norms. Finally, the Report shows that small changes in context have large effects on behavior. As a result, discovering which interventions are most effective, and with which contexts and populations, inherently requires an experimental approach. Rigor is needed for testing the processes for delivering interventions, not just the products that are delivered.