Publication: Improving Public Procurement Outcomes: Review of Tools and the State of the Evidence Base
Loading...
Published
2021-06
ISSN
Date
2021-06-10
Author(s)
Editor(s)
Abstract
Considering that about 15 percent of global gross domestic product flows through public procurement systems, the lack of systematic evidence on what works in this field is a major challenge for effective policy making. Hence, this paper systematically reviews the state of the evidence on major public procurement reforms and their impact on value for money and open access to public tenders. It discusses the reliably identified costs and benefits and systematically evaluates the quality of the evidence base, relying on academic and policy literature. The quality of evidence on the impact of public procurement interventions is mediocre, with reliable evidence established in multiple countries using diverse analytical methods only for selective, typically narrow tools. Although there is a range of policy tools with global policy interest and extensive implementation record, these have received little to no evaluation. As high-quality research uses different outcome measures, comparing intervention effectiveness is only possible for a very narrow outcome: savings. Comparing intervention types according to their effects on savings, centralized procurement and framework agreements stand out with the largest effects, over 50 percent. Most other intervention types were documented to achieve about 5-10 percent price savings if they were well implemented. Given the estimated US$11 trillion spent on procurement annually around the world, even savings of 1 percent amounts to US$110 billion annually. This systematic review points out that research on e-procurement and its variants, transparency portals, civil society supervision, and opening up the black box of public management, among others, would deserve considerably more research going forward.
Link to Data Set
Citation
“Fazekas, Mihály; Blum, Jurgen Rene. 2021. Improving Public Procurement Outcomes: Review of Tools and the State of the Evidence Base. Policy Research Working Paper;No. 9690. © World Bank. http://hdl.handle.net/10986/35727 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The State of Global Services Trade Policies: Evidence from Recent Data(Washington, DC: World Bank, 2025-10-28)The economic environment for services trade has changed dramatically over the past 15 years, driven by rapid technological progress that has expanded the possibilities for exchanging services. How has trade policy responded to these changes? How do policy stances in a wide range of service sectors compare across economies? With its unprecedented global coverage, the Services Trade Policy Database and the associated Services Trade Restrictions Index, developed jointly by the World Bank and the World Trade Organization, help address these questions. This paper makes three principal contributions. First, it offers an in-depth discussion of the current state of services trade policies and their differences across 134 economies and 34 services subsectors. Second, the paper reveals how recent (2016–22) changes in policy stances have seen progressive liberalization by lower-income economies but stabilization or even slight policy reversals in high-income economies. This dynamic differs fundamentally from the trend that unfolded after the Great Recession over 2008–16. Third, the paper shows the implications of policy changes over the past six years on services trade costs, and it showcases how the Services Trade Policy Database’s regulatory information can inform trade negotiations, regulatory analysis, and policy making. Alongside these contributions, the paper documents updates to the Services Trade Policy Database’s economy and sector coverage and explains the latest methodological improvements made to the World Bank–World Trade Organization Services Trade Restrictions Index.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Introducing E-Procurement in Bangladesh(World Bank, Washington, DC, 2023-04-05)Governments around the world spend about one-third of their budgets through public procurement systems where electronic administration of public tenders promises great benefits. However, surprisingly little is known about how, under which circumstances, and through which features electronic systems work. To address these questions, this paper looks at the introduction of an electronic procurement system compared to a fully paper-based system in Bangladesh in 2011–16. The impact of the electronic procurement system on access to public tenders, their economy, and administrative efficiency is estimated. Contracts were matched both within procuring entities and years, and fixed effects regressions were run to address biases emanating from nonrandom assignment to treatment. The findings show an overwhelmingly positive impact. Access improves, with the number of bidders increasing by 1.6–2.2 and the probability of a single bidder decreasing by 7.8–13.5 percentage points. Economy also improves as discounts firms offer increase by 7.4–8.0 percentage points. Administrative efficiency greatly improves too: the total time of processing a tender—starting from the public call for tenders to contract signature—drops by 15.6–19.2 days. However, it is possible that low performance and rent-seeking were displaced to the contract implementation phase, which remained principally paper-administered. These results indicate that the government directly saved US$460 million to US$513 million in the analyzed electronic tenders, largely due to increased winning rebates and lower advertising costs. Considering the indirect macro effects, the introduction of electronic procurement increased Bangladesh’s gross domestic product by 0.48 to 0.54 percent, or US$1.4 billion to US$1.6 billion in 2019.Publication What Factors Predict How Public Sector Projects Perform? A Review of the World Bank's Public Sector Management Portfolio(World Bank, Washington, DC, 2014-03)This paper uses regression analysis to identify which country context, reform content, process, and project management variables predict the performance of public sector management projects, as measured by the Independent Evaluation Group's project outcome ratings. The paper draws on data from a large sample of World Bank public sector management projects that were approved between 1990 and 2013. It contributes to an emerging literature that uses cross-country regressions to analyze public sector management reform patterns. The findings suggest that political context factors have a greater impact on the performance of public sector management projects than on other projects. Specifically, public sector management projects perform better in countries with democratic regimes than autocratic ones. They fare better in the presence of programmatic political parties and in more aid-dependent countries. Project managers' subjective risk assessments predict performance in public sector management operations better than objective risk indicators. These findings suggest that the performance of public sector management projects would benefit from a better alignment of project design with political context and from a more open dialogue about risk between task team leaders and management.Publication Public Sector Management Reform : Toward a Problem-Solving Approach(World Bank, Washington, DC, 2012-12)This note sets out key ideas from recent discussions inside and outside the Bank on how donors can support governments more effectively in delivering results in Public Sector Management (PSM) reforms. This note also reflects the discussions that have led to the Bank's new PSM approach for 2011 to 2020; identifies challenges to reforming public sector institutions; and summarizes how current thinking on PSM reform strategies has shifted toward pragmatic problem solving, seeking to improve results by identifying sustainable improvements for the public sector results chain.Publication Procurement Monitoring and Social Accountability(World Bank, Washington, DC, 2009)The devolution of procurement responsibilities to local levels of government is increasingly occurring across South Asia. This trend is significant because increasingly localized decision-making better enables communities to hold government authorities accountable for the effectiveness of public spending, which can lead to various improved development outcomes, such as improvements in quality of service delivery; greater empowerment and understanding by end-users services supplied through public procurement processes; and improved oversight and accountability of service delivery agencies. The objective of this report is to set out an overview of the strategic approach developed by World Bank Institute (WBI) as a component of the Norwegian governance trust fund (NTF) program `procurement and service delivery: establishing effective collaboration between government and beneficiaries on monitoring procurement outcomes`. WBI received funds under the NTF to facilitate the development of context and audience-specific knowledge products by recognized practitioners and civil society organizations in South Asia as part of a broader effort to create a practical curriculum on social accountability in procurement.Publication Enhanced Transparency in Procurement through Voluntary Disclosure under the RTI Act 2005(Washington, DC, 2009-03)Good practices reduce costs and produce timely results; poor practices lead to waste and delays and are often the cause for allegations of corruption and Government inefficiency. Enhanced transparency in procurement through voluntary disclosure under the Right to Information (RTI) Act (2005)' is one of the individual components of the larger initiative undertaken by Yashwantrao Academy of Development Administration (YASHADA) under the national resource centre for social accountability, and funded by the World Bank institute, New Delhi. Sound public procurement policies and practices are among the essential elements of good governance. The objective of the study is to: study the current procurement process; suggest measures to tackle the discrepancies by developing mechanisms; and enhance social accountability and transparency in the procurement process by focused implementation of right to information as a tool. The project takes into account the four pillar approach towards public procurement which believes that unless all the aspects of the function (i.e. efficiency, economy, fairness and transparency) are taken care of, the overall impact will not be evident. The focus of this project is mainly on social accountability. Obviously the focus of the study is on transparency and how by making the systems more transparent the other aspects of fairness, efficiency and economy can be pushed for reforming the procurement process.
Users also downloaded
Showing related downloaded files
Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.