Publication: Overview and Meta-Analysis of Global Water, Sanitation, and Hygiene Impact Evaluations
Loading...
Published
2018-05
ISSN
Date
2018-05-23
Author(s)
Editor(s)
Abstract
This paper presents an overview and meta-analysis of the effects of water, sanitation, and hygiene interventions around the world. It is based on 136 impact evaluations (randomized and quasi-experimental studies) that explore the effects of water, sanitation, and hygiene interventions on health and non-health outcomes, ranging from behavior change -- such as the adoption of water treatment -- to school attendance rates, to a reduction in diarrhea. The selected impact evaluations were divided into five groups, and meta-regressions with fixed effects (at the regional level) and random effects were performed, controlling for each study's characteristics (implementing organization, sample sizes, type of publication, number of publication views, and so forth). All results are reported as changes in odds ratios, with respect to the standard deviation of reported effects. Water, sanitation, and hygiene interventions were found to increase the likelihood of behavior changes and the adoption of new hygiene practices by 17 percent. The smallest effects were observed from water, sanitation, and hygiene interventions aimed at reducing the rates of child mortality and non-diarrheal disease. Water, sanitation, and hygiene interventions implemented in schools showed statistically significant results in reducing school absenteeism and dropouts. Similarly, the results showed a statistically significant aggregate likelihood of increased access to safe water and improved water quality, as well as increased water treatment options -- a difference of one-fifth with respect to the standard deviation of the average effect size reported. Finally, the results showed that water, sanitation, and hygiene interventions reduced the likelihood of the incidence of diarrheal and enteric disease by 13 percent, which is consistent with findings in other meta-analyses of the same subject.
Link to Data Set
Citation
“Fenwick, Crystal; Andres, Luis; de Jesus Filho, Jaime; Borja-Vega, Christian; Gomez-Suarez, Ronald. 2018. Overview and Meta-Analysis of Global Water, Sanitation, and Hygiene Impact Evaluations. Policy Research Working Paper;No. 8444. © World Bank. http://hdl.handle.net/10986/29856 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The State of Global Services Trade Policies: Evidence from Recent Data(Washington, DC: World Bank, 2025-10-28)The economic environment for services trade has changed dramatically over the past 15 years, driven by rapid technological progress that has expanded the possibilities for exchanging services. How has trade policy responded to these changes? How do policy stances in a wide range of service sectors compare across economies? With its unprecedented global coverage, the Services Trade Policy Database and the associated Services Trade Restrictions Index, developed jointly by the World Bank and the World Trade Organization, help address these questions. This paper makes three principal contributions. First, it offers an in-depth discussion of the current state of services trade policies and their differences across 134 economies and 34 services subsectors. Second, the paper reveals how recent (2016–22) changes in policy stances have seen progressive liberalization by lower-income economies but stabilization or even slight policy reversals in high-income economies. This dynamic differs fundamentally from the trend that unfolded after the Great Recession over 2008–16. Third, the paper shows the implications of policy changes over the past six years on services trade costs, and it showcases how the Services Trade Policy Database’s regulatory information can inform trade negotiations, regulatory analysis, and policy making. Alongside these contributions, the paper documents updates to the Services Trade Policy Database’s economy and sector coverage and explains the latest methodological improvements made to the World Bank–World Trade Organization Services Trade Restrictions Index.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication A Brief Summary of Global WASH Interventions(World Bank, Washington, DC, 2018-05)WASH practitioners and decision-makers lack evidence on the wider health and social effects of WASHinterventions needed to create a paradigm shift in the sector. A global overview and meta-analysis on the effects of different WASH interventions on different health and socioeconomic outcomes was undertaken. The results of this analysis show that evaluations of WASH interventions continue to focus predominantly on reducing diarrheal disease and there is a strong need for larger, more rigorously designed studies covering a broader scope of outcome effects. Similarly, there is a need for greater geographical representation and finally, well-trained implementing agencies to achieve the desired results.Publication The Impact of Government Support on Firm R&D Investments : A Meta-Analysis(World Bank, Washington, DC, 2013-07)This paper applies meta-analysis techniques to a sample of 37 studies published during 2004-2011. These papers assess the impact of direct subsidies on business research and development. The results show that the effect of public investment on research and development is predominantly positive and significant. Furthermore, public funds do not crowd out but incentivize firms to revert funds into research and development. The coefficient of additionality impacts on research and development ranges from 0.166 to 0.252, with reasonable confidence intervals at the 95 percent level. The results are highly sensitive to the method used. The high heterogeneity of precision is explained by the wide variety of methodologies used to estimate the impacts and paper characteristics.Publication Can Intense Exposure to Hand-Washing and Hygiene Information Campaigns Affect Children's Socio-Emotional Skills?(World Bank, Washington, DC, 2015-11)Hygiene information and practices play a critical role in preventing diseases, particularly among children. Hygiene behaviors practiced in the household have been linked to development outcomes such as socio-emotional skills. This paper exploits data from impact evaluation surveys of a hygiene information campaign conducted in Senegal, where the randomized design suffered from contamination between comparison groups. The variations in exposure and intensity to hygiene information campaigns captured in the surveys were used to understand contamination biases. Such variations were interacted with the presence of household communication assets to explore potential effects on children’s socio-emotional scores. In the presence of contamination biases, the study exploited the longitudinal sample of children in the surveys to reduce time-dependent biases. For robustness, statistical matching was applied between the impact evaluation surveys and Demographic and Health Surveys conducted in 2008 and 2011. Socio-emotional outcomes were the imputed into Demographic and Health surveys to expand sample sizes. By applying matching techniques and imputing outcomes into a larger sample, impacts were non-negligible. Double-difference estimates showed that children’s socio-emotional scores were higher when intervention status was interacted with the presence of communication assets within households. Without the presence of communication assets in the households the impacts were close to zero. Evaluating the effect of hygiene campaigns on children’s socio-emotional skills is challenging because of the biases from contamination that exist when information flows between comparison groups. Targeted hygiene information to the poorest households is relevant for reducing risks of recurrent infections and enables better conditions for socio-emotional development of children.Publication Innovations in WASH Impact Measures(Washington, DC: World Bank, 2018)The new 2030 Agenda for Sustainable Development includes water, sanitation, and hygiene (WASH) at its core. A dedicated Sustainable Development Goal (SDG 6) declares a commitment to “ensure availability and sustainable management of water and sanitation for all.” Monitoring progress toward this goal will be challenging: direct measures of water and sanitation service quality and use are either expensive or elusive. However, reliance on household surveys poses limitations and likely overstated progress during the Millennium Development Goal period. In Innovations in WASH Impact Measures: Water and Sanitation Measurement Technologies and Practices to Inform the Sustainable Development Goals, we review the landscape of proven and emerging technologies, methods, and approaches that can support and improve on the WASH indicators proposed for SDG target 6.1, “by 2030, achieve universal and equitable access to safe and affordable drinking water for all,” and target 6.2, “by 2030, achieve access to adequate and equitable sanitation and hygiene for all and end open defecation, paying special attention to the needs of women and girls and those in vulnerable situations.” Although some of these technologies and methods are readily available, other promising approaches require further field evaluation and cost reductions. Emergent technologies, methods, and data-sharing platforms are increasingly aligned with program impact monitoring. Improved monitoring of water and sanitation interventions may allow more cost-effective and measurable results. In many cases, technologies and methods allow more complete and impartial data in time to allow program improvements. Of the myriad monitoring and evaluation methods, each has its own advantages and limitations. Surveys, ethnographies, and direct observation give context to more continuous and objective electronic sensor data. Overall, combined methodologies can provide a more comprehensive and instructive depiction of WASH usage and help the international development community measure our progress toward reaching the SDG WASH goals.Publication Doing More with Less(World Bank, Washington, DC, 2019-08-28)This report explores how scarce public resources can be used most effectively to achieve universal delivery of water supply and sanitation services. It analyzes the prevalence and performance of subsidies in the sector, then guide policymakers on improving subsidy design and implementation to improve their efficacy and efficiency in attaining their objectives.
Users also downloaded
Showing related downloaded files
Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Sourcebook on the Foundations of Social Protection Delivery Systems(Washington, DC: World Bank, 2020-07-30)The Sourcebook synthesizes real-world experiences and lessons learned of social protection delivery systems from around the world, with a particular focus on social and labor benefits and services. It takes a practical approach, seeking to address concrete “how-to” questions, including: How do countries deliver social protection benefits and services? How do they do so effectively and efficiently? How do they ensure dynamic inclusion, especially for the most vulnerable and needy? How do they promote better coordination and integration—not only among social protection programs but also programs in other parts of government? How can they meet the needs of their intended populations and provide a better client experience? The Sourcebook structures itself around eight key principles that can frame the delivery systems mindset: (1) delivery systems evolve over time, do so in a non-linear fashion, and are affected by the starting point(s); (2) additional efforts should be made to “do simple well”, and to do so from the start rather than trying to remedy by after-the-fact adding-on of features or aspects; (3) quality implementation matters, and weaknesses in the design or structure of any core system element will negatively impact delivery; (4) defining the “first mile” for people interface greatly affects the system and overall delivery, and is most improved when that “first mile” is understood as the weakest link in delivery systems); (5) delivery systems do not operate in a vacuum and thus should not be developed in silos; (6) delivery systems can contribute more broadly to government’s ability to intervene in other sectors, such as health insurance subsidies, scholarships, social energy tariffs, housing benefits, and legal services; (7) there is no single blueprint for delivery systems, but there are commonalities and those common elements constitute the core of the delivery systems framework; (8) inclusion and coordination are pervasive and perennial dual challenges, and they contribute to the objectives of effectiveness and efficiency.Publication Europe and Central Asia Economic Update, Spring 2025: Accelerating Growth through Entrepreneurship, Technology Adoption, and Innovation(Washington, DC: World Bank, 2025-04-23)Business dynamism and economic growth in Europe and Central Asia have weakened since the late 2000s, with productivity growth driven largely by resource reallocation between firms and sectors rather than innovation. To move up the value chain, countries need to facilitate technology adoption, stronger domestic competition, and firm-level innovation to build a more dynamic private sector. Governments should move beyond broad support for small- and medium-sized enterprises and focus on enabling the most productive firms to expand and compete globally. Strengthening competition policies, reducing the presence of state-owned enterprises, and ensuring fair market access are crucial. Limited availability of long-term financing and risk capital hinders firm growth and innovation. Economic disruptions are a shock in the short term, but they provide an opportunity for implementing enterprise and structural reforms, all of which are essential for creating better-paying jobs and helping countries in the region to achieve high-income status.Publication Morocco Economic Update, Winter 2025(Washington, DC: World Bank, 2025-04-03)Despite the drought causing a modest deceleration of overall GDP growth to 3.2 percent, the Moroccan economy has exhibited some encouraging trends in 2024. Non-agricultural growth has accelerated to an estimated 3.8 percent, driven by a revitalized industrial sector and a rebound in gross capital formation. Inflation has dropped below 1 percent, allowing Bank al-Maghrib to begin easing its monetary policy. While rural labor markets remain depressed, the economy has added close to 162,000 jobs in urban areas. Morocco’s external position remains strong overall, with a moderate current account deficit largely financed by growing foreign direct investment inflows, underpinned by solid investor confidence indicators. Despite significant spending pressures, the debt-to-GDP ratio is slowly declining.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.