Publication: Evidence Gap Maps : A Tool for Promoting Evidence-Informed Policy and Prioritizing Future Research
Loading...
Published
2013-12
ISSN
Date
2014-02-05
Editor(s)
Abstract
Evidence-gap maps present a new addition to the tools available to support evidence-informed policy making. Evidence-gap maps are thematic evidence collections covering a range of issues such as maternal health, HIV/AIDS, and agriculture. They present a visual overview of existing systematic reviews or impact evaluations in a sector or subsector, schematically representing the types of interventions evaluated and outcomes reported. Gap maps enable policy makers and practitioners to explore the findings and quality of the existing evidence and facilitate informed judgment and evidence-based decision making in international development policy and practice. The gap map also identifies key "gaps" where little or no evidence from impact evaluations and systematic reviews is available and where future research should be focused. Thus, gap maps can be a useful tool for developing a strategic approach to building the evidence base in a particular sector. This paper provides an introduction to evidence-gap maps, outlines the gap-map methodology, and presents some examples.
Link to Data Set
Citation
“Snilstveit, Birte; Vojtkova, Martina; Bhavsar, Ami; Gaarder, Marie. 2013. Evidence Gap Maps : A Tool for Promoting Evidence-Informed Policy and Prioritizing Future Research. Policy Research Working Paper;No. 6725. © World Bank. http://hdl.handle.net/10986/16941 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Rigging the Scores: Corruption through Scoring Rule Manipulation in Public Procurement Auctions(Washington, DC: World Bank, 2025-12-02)Public procurement is highly susceptible to corruption, especially in developing countries. Although open auctions are widely adopted to curb it, this paper finds that corruption remains prevalent even within this procurement format. Procurement officers can collaborate with firms to manipulate scoring rules, ensuring predetermined winners, while corrupt firms submit noncompetitive bids to meet minimum bidder requirements. Using extensive data from Chinese public procurement auctions, the paper introduces model-driven statistical tools to detect such corruption, identifying a corruption rate of 65 percent. A procurement expert audit survey confirms the tools’ reliability, with a 91 percent probability that experts recognize suspicious scoring rules when flagged. Firm-level analysis reveals that local, state-owned, and less productive firms are favored in corrupt auctions. Lastly, the paper explores policy implications. Analysis of the national anti-corruption campaign since 2012 suggests that general investigations may be insufficient to address deeply ingrained corrupt practices. Using counterfactuals based on an estimated structural model, the paper shows that implementing anonymous call-for-tender evaluations could improve social welfare by 10 percent by eliminating suspicious rules and encouraging broader participation.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication Investment Policy Reforms and Foreign Direct Investment Inflows(Washington, DC: World Bank, 2025-12-01)Foreign direct investment has the potential to introduce much-needed capital and expertise in emerging and developing economies. To attract foreign direct investment, many countries have eased restrictions on foreign ownership in various sectors, reformed their institutions, and set up investment promotion agencies. Until the mid-2010s, Ethiopia remained one of the few countries that resisted this trend, with several stringent restrictions in place on foreign direct investment entry and operations in the country. This study employs a synthetic control method to examine patterns in foreign capital inflows following a series of investment policy reforms that were substantively introduced in the mid-2010s (circa 2015). The study offers evidence that investment policy reforms contributed to a significant foreign direct investment inflow in Ethiopia, compared to what would have occurred in the absence of these policies. An alternative strategy that conservatively specifies the donor country pool using an AI-assisted deep search technique changes the donor pool weighting matrix of the synthetic control method, but the estimated policy effects largely remain robust to this specification. The findings highlight the importance of targeted reforms in promoting foreign direct investment inflow in developing countries.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Right to Information(World Bank, Washington, DC, 2014-12-01)The findings from the study suggest that international pressure for more effective Right to Information (RTI) implementation only goes so far. The development of RTI laws with the encouragement, assistance, or insistence of the international community was a prominent theme throughout the case studies, particularly for EU countries during their accession process. But implementation is a less straightforward task, with many interlocking, moving parts, and international support comes in ad hoc fashion as the process unfolds. A strong implication from these findings is that a national coordinating strategy may be valuable for implementation. This kind of strategy document should take the interdependence of the drivers of effectiveness into account when drafting policies and rules for practice, and can serve as a guiding document when deciding on foreign funding priorities.Publication Technical Assessment of Open Data Platforms for National Statistical Organisations(World Bank, Washington, DC, 2014-10-18)The term quot;open dataquot; is generally understood to be data that are made available to the public free of charge, without registration or restrictive licenses, for any purpose whatsoever (including commercial purposes), in electronic, machine-readable formats that ensure data are easy to find, download and use. National Statistics Offices (NSOs) have the potential to play a pivotal role in the implementation of open data initiatives. As producers and curators of data, the objective of making high quality data more accessible and usable is consistent with their guiding principles. NSOs indicate, in research conducted in support of this report, that one of the difficulties they encounter is that the technology they use to publish - or electronically distribute - data for public use is not compatible with open formats. They also indicate that common software packages used for open data portals do not accommodate the data formats and metadata they produce. Two key concerns related to data dissemination products are addresses: (1) Can such products designed primarily for NSOs satisfy requirements for an open data initiative?; and (2) Can such products designed primarily for open data satisfy the requirements of NSOs? Furthermore, data reuse, both by data experts and the public at large, is key to creating new opportunities and benefits from government data. The following recommendations are made to improve the overall utility of data publication platforms to NSOs and the open data community: improve technical documentation; ensure public Application Programming Interfaces (APIs) and endpoints are interoperable; presentation of metadata and Uniform Resource Identifiers (URIs) must conform to W3C standards; natural language search and metadata faceting should be standard; structural metadata and hypercube support are core NSO requirements; dashboards and visualisations are necessary for user engagement; and develop data engagement tools for improving data-quality and reuse.Publication Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes(World Bank, Washington, DC, 2016-02)This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.Publication Central America : Big Data in Action for Development(Washington, DC, 2014)This report stemmed from a World Bank pilot activity to explore the potential of big data to address development challenges in Central American countries. As part of this activity we collected and analyzed a number of examples of leveraging big data for development. Because of the growing interest in this topic this report makes available to a broader audience those examples as well as the underlying conceptual framework to think about big data for development. To make effective use of big data, many practitioners emphasize the importance of beginning with a question instead of the data itself. A question clarifies the purpose of utilizing big data, whether it is for awareness, understanding, and/or forecasting. In addition, a question suggests the kinds of real-world behaviors or conditions that are of interest. These behaviors are encoded into data through some generating process which includes the media through which behavior is captured. Then various data sources are accessed, prepared, consolidated and analyzed. This ultimately gives rise to insights into the question of interest, which are implemented to effect changes in the relevant behaviors. Utilizing big data for any given endeavor requires a host of capabilities. Hardware and software capabilities are needed for interaction of data from a variety of sources in a way which is efficient and scalable. Human capabilities are needed not only to make sense of data but to ensure a question-centered approach, so that insights are actionable and relevant. To this end, cooperation between development experts as well as social scientists and computer scientists is extremely important.Publication Mulitlateral Development Bank International Survey of e-Procurement Systems(World Bank, Washington, DC, 2007-05-01)This survey of e-procurement systems in Asia/Oceania, South America and Europe was funded by the Asian Development Bank, the Inter-American Development Bank and the World Bank. It is a project of the Multilateral Development Bank (MDB) harmonization of e-procurement group. The survey was developed by Curtin University and International Governance Solutions using an experienced research and consultancy team. The survey covered systems in fourteen countries, which vary in size of the procurement market, the degree of integration of systems and degree of centralized management of procurement. While there is clear evidence as to how common issues were addressed, the relatively small number of countries involved makes identifying some trends difficult.
Users also downloaded
Showing related downloaded files
Publication State and Trends of Carbon Pricing 2024(Washington, DC: World Bank, 2024-05-21)This report provides an up-to-date overview of existing and emerging carbon pricing instruments around the world, including international, national, and subnational initiatives. It also investigates trends surrounding the development and implementation of carbon pricing instruments and some of the drivers seen over the past year. Specifically, this report covers carbon taxes, emissions trading systems (ETSs), and crediting mechanisms. Key topics covered in the 2024 report include uptake of ETSs and carbon taxes in low- and middle- income economies, sectoral coverage of ETSs and carbon taxes, and the use of crediting mechanisms as part of the policy mix.Publication Commodity Markets Outlook, April 2025(Washington, DC: World Bank, 2025-04-29)Commodity prices are set to fall sharply this year, by about 12 percent overall, as weakening global economic growth weighs on demand. In 2026, commodity prices are projected to reach a six-year low. Oil prices are expected to exert substantial downward pressure on the aggregate commodity index in 2025, as a marked slowdown in global oil consumption coincides with expanding supply. The anticipated commodity price softening is broad-based, however, with more than half of the commodities in the forecast set to decrease this year, many by more than 10 percent. The latest shocks to hit commodity markets extend a so far tumultuous decade, marked by the highest level of commodity price volatility in at least half a century. Between 2020 and 2024, commodity price swings were frequent and sharp, with knock-on consequences for economic activity and inflation. In the next two years, commodity prices are expected to put downward pressure on global inflation. Risks to the commodity price projections are tilted to the downside. A sharper-than-expected slowdown in global growth—driven by worsening trade relations or a prolonged tightening of financial conditions—could further depress commodity demand, especially for industrial products. In addition, if OPEC+ fully unwinds its voluntary supply cuts, oil production will far exceed projected consumption. There are also important upside risks to commodity prices—for instance, if geopolitical tensions worsen, threatening oil and gas supplies, or if extreme weather events lead to agricultural and energy price spikes.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication G5 Sahel Region Country Climate and Development Report(Washington, DC: World Bank, 2022-07-01)The five countries of Burkina Faso, Chad, Mali, Mauritania, and Niger (the G5) in the Sahel region of Africa are among the least developed countries in the world. The now regular and growing climate shocks are causing large losses in outputs, reducing human capital accumulation, and leading to potentially devastating ecological and economic tipping points in the region. This World Bank country climate development report (CCDR) has examined the most critical actions and policy changes needed to accelerate the region's economic recovery, sustainable and inclusive development, and adaptation to the impacts of climate change. This report has three main messages. First, the opportunities for a resilient and lower-carbon development of the G5 countries are significant. They can reverse environmental degradation and maximize the benefits of climate action for the poor. Second, rapid, resilient, and inclusive growth is both the best form of adaptation to climate change and the best strategy for meeting development goals in an effective, sustainable, and productive manner. Third, the costs of inaction are far greater than the costs of action. Early and targeted action on policies and programs presented in this report can move the G5 Sahel countries towards a greener, more resilient, prosperous, and inclusive future.