Publication: Improving Public Procurement Outcomes: Review of Tools and the State of the Evidence Base
Loading...
Date
2021-06
ISSN
Published
2021-06
Author(s)
Editor(s)
Abstract
Considering that about 15 percent of global gross domestic product flows through public procurement systems, the lack of systematic evidence on what works in this field is a major challenge for effective policy making. Hence, this paper systematically reviews the state of the evidence on major public procurement reforms and their impact on value for money and open access to public tenders. It discusses the reliably identified costs and benefits and systematically evaluates the quality of the evidence base, relying on academic and policy literature. The quality of evidence on the impact of public procurement interventions is mediocre, with reliable evidence established in multiple countries using diverse analytical methods only for selective, typically narrow tools. Although there is a range of policy tools with global policy interest and extensive implementation record, these have received little to no evaluation. As high-quality research uses different outcome measures, comparing intervention effectiveness is only possible for a very narrow outcome: savings. Comparing intervention types according to their effects on savings, centralized procurement and framework agreements stand out with the largest effects, over 50 percent. Most other intervention types were documented to achieve about 5-10 percent price savings if they were well implemented. Given the estimated US$11 trillion spent on procurement annually around the world, even savings of 1 percent amounts to US$110 billion annually. This systematic review points out that research on e-procurement and its variants, transparency portals, civil society supervision, and opening up the black box of public management, among others, would deserve considerably more research going forward.
Link to Data Set
Citation
“Fazekas, Mihály; Blum, Jurgen Rene. 2021. Improving Public Procurement Outcomes: Review of Tools and the State of the Evidence Base. Policy Research Working Paper;No. 9690. © World Bank. http://hdl.handle.net/10986/35727 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication Exports, Labor Markets, and the Environment(Washington, DC: World Bank, 2025-07-14)What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The Asymmetric Bank Distress Amplifier of Recessions(Washington, DC: World Bank, 2025-07-11)One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.Publication Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers(Washington, DC: World Bank, 2025-07-14)This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Introducing E-Procurement in Bangladesh(World Bank, Washington, DC, 2023-04-05)Governments around the world spend about one-third of their budgets through public procurement systems where electronic administration of public tenders promises great benefits. However, surprisingly little is known about how, under which circumstances, and through which features electronic systems work. To address these questions, this paper looks at the introduction of an electronic procurement system compared to a fully paper-based system in Bangladesh in 2011–16. The impact of the electronic procurement system on access to public tenders, their economy, and administrative efficiency is estimated. Contracts were matched both within procuring entities and years, and fixed effects regressions were run to address biases emanating from nonrandom assignment to treatment. The findings show an overwhelmingly positive impact. Access improves, with the number of bidders increasing by 1.6–2.2 and the probability of a single bidder decreasing by 7.8–13.5 percentage points. Economy also improves as discounts firms offer increase by 7.4–8.0 percentage points. Administrative efficiency greatly improves too: the total time of processing a tender—starting from the public call for tenders to contract signature—drops by 15.6–19.2 days. However, it is possible that low performance and rent-seeking were displaced to the contract implementation phase, which remained principally paper-administered. These results indicate that the government directly saved US$460 million to US$513 million in the analyzed electronic tenders, largely due to increased winning rebates and lower advertising costs. Considering the indirect macro effects, the introduction of electronic procurement increased Bangladesh’s gross domestic product by 0.48 to 0.54 percent, or US$1.4 billion to US$1.6 billion in 2019.Publication What Factors Predict How Public Sector Projects Perform? A Review of the World Bank's Public Sector Management Portfolio(World Bank, Washington, DC, 2014-03)This paper uses regression analysis to identify which country context, reform content, process, and project management variables predict the performance of public sector management projects, as measured by the Independent Evaluation Group's project outcome ratings. The paper draws on data from a large sample of World Bank public sector management projects that were approved between 1990 and 2013. It contributes to an emerging literature that uses cross-country regressions to analyze public sector management reform patterns. The findings suggest that political context factors have a greater impact on the performance of public sector management projects than on other projects. Specifically, public sector management projects perform better in countries with democratic regimes than autocratic ones. They fare better in the presence of programmatic political parties and in more aid-dependent countries. Project managers' subjective risk assessments predict performance in public sector management operations better than objective risk indicators. These findings suggest that the performance of public sector management projects would benefit from a better alignment of project design with political context and from a more open dialogue about risk between task team leaders and management.Publication Public Sector Management Reform : Toward a Problem-Solving Approach(World Bank, Washington, DC, 2012-12)This note sets out key ideas from recent discussions inside and outside the Bank on how donors can support governments more effectively in delivering results in Public Sector Management (PSM) reforms. This note also reflects the discussions that have led to the Bank's new PSM approach for 2011 to 2020; identifies challenges to reforming public sector institutions; and summarizes how current thinking on PSM reform strategies has shifted toward pragmatic problem solving, seeking to improve results by identifying sustainable improvements for the public sector results chain.Publication Procurement Monitoring and Social Accountability(World Bank, Washington, DC, 2009)The devolution of procurement responsibilities to local levels of government is increasingly occurring across South Asia. This trend is significant because increasingly localized decision-making better enables communities to hold government authorities accountable for the effectiveness of public spending, which can lead to various improved development outcomes, such as improvements in quality of service delivery; greater empowerment and understanding by end-users services supplied through public procurement processes; and improved oversight and accountability of service delivery agencies. The objective of this report is to set out an overview of the strategic approach developed by World Bank Institute (WBI) as a component of the Norwegian governance trust fund (NTF) program `procurement and service delivery: establishing effective collaboration between government and beneficiaries on monitoring procurement outcomes`. WBI received funds under the NTF to facilitate the development of context and audience-specific knowledge products by recognized practitioners and civil society organizations in South Asia as part of a broader effort to create a practical curriculum on social accountability in procurement.Publication Enhanced Transparency in Procurement through Voluntary Disclosure under the RTI Act 2005(Washington, DC, 2009-03)Good practices reduce costs and produce timely results; poor practices lead to waste and delays and are often the cause for allegations of corruption and Government inefficiency. Enhanced transparency in procurement through voluntary disclosure under the Right to Information (RTI) Act (2005)' is one of the individual components of the larger initiative undertaken by Yashwantrao Academy of Development Administration (YASHADA) under the national resource centre for social accountability, and funded by the World Bank institute, New Delhi. Sound public procurement policies and practices are among the essential elements of good governance. The objective of the study is to: study the current procurement process; suggest measures to tackle the discrepancies by developing mechanisms; and enhance social accountability and transparency in the procurement process by focused implementation of right to information as a tool. The project takes into account the four pillar approach towards public procurement which believes that unless all the aspects of the function (i.e. efficiency, economy, fairness and transparency) are taken care of, the overall impact will not be evident. The focus of this project is mainly on social accountability. Obviously the focus of the study is on transparency and how by making the systems more transparent the other aspects of fairness, efficiency and economy can be pushed for reforming the procurement process.
Users also downloaded
Showing related downloaded files
Publication Government Matters III : Governance Indicators for 1996-2002(World Bank, Washington, DC, 2003-08)The authors present estimates of six dimensions of governance covering 199 countries and territories for four time periods: 1996, 1998, 2000, and 2002. These indicators are based on several hundred individual variables measuring perceptions of governance, drawn from 25 separate data sources constructed by 18 different organizations. The authors assign these individual measures of governance to categories capturing key dimensions of governance and use an unobserved components model to construct six aggregate governance indicators in each of the four periods. They present the point estimates of the dimensions of governance as well as the margins of errors for each country for the four periods. The governance indicators reported here are an update and expansion of previous research work on indicators initiated in 1998 (Kaufmann, Kraay, and Zoido-Lobat 1999a,b and 2002). The authors also address various methodological issues, including the interpretation and use of the data given the estimated margins of errors.Publication Breaking the Conflict Trap : Civil War and Development Policy(Washington, DC: World Bank and Oxford University Press, 2003)Most wars are now civil wars. Even though international wars attract enormous global attention, they have become infrequent and brief. Civil wars usually attract less attention, but they have become increasingly common and typically go on for years. This report argues that civil war is now an important issue for development. War retards development, but conversely, development retards war. This double causation gives rise to virtuous and vicious circles. Where development succeeds, countries become progressively safer from violent conflict, making subsequent development easier. Where development fails, countries are at high risk of becoming caught in a conflict trap in which war wrecks the economy and increases the risk of further war. The global incidence of civil war is high because the international community has done little to avert it. Inertia is rooted in two beliefs: that we can safely 'let them fight it out among themselves' and that 'nothing can be done' because civil war is driven by ancestral ethnic and religious hatreds. The purpose of this report is to challenge these beliefs.Publication Governance Matters IV : Governance Indicators for 1996-2004(World Bank, Washington, DC, 2005-06)The authors present the latest update of their aggregate governance indicators, together with new analysis of several issues related to the use of these measures. The governance indicators measure the following six dimensions of governance: (1) voice and accountability; (2) political instability and violence; (3) government effectiveness; (4) regulatory quality; (5) rule of law, and (6) control of corruption. They cover 209 countries and territories for 1996, 1998, 2000, 2002, and 2004. They are based on several hundred individual variables measuring perceptions of governance, drawn from 37 separate data sources constructed by 31 organizations. The authors present estimates of the six dimensions of governance for each period, as well as margins of error capturing the range of likely values for each country. These margins of error are not unique to perceptions-based measures of governance, but are an important feature of all efforts to measure governance, including objective indicators. In fact, the authors give examples of how individual objective measures provide an incomplete picture of even the quite particular dimensions of governance that they are intended to measure. The authors also analyze in detail changes over time in their estimates of governance; provide a framework for assessing the statistical significance of changes in governance; and suggest a simple rule of thumb for identifying statistically significant changes in country governance over time. The ability to identify significant changes in governance over time is much higher for aggregate indicators than for any individual indicator. While the authors find that the quality of governance in a number of countries has changed significantly (in both directions), they also provide evidence suggesting that there are no trends, for better or worse, in global averages of governance. Finally, they interpret the strong observed correlation between income and governance, and argue against recent efforts to apply a discount to governance performance in low-income countries.Publication Design Thinking for Social Innovation(2010-07)Designers have traditionally focused on enchancing the look and functionality of products.Publication Governance Matters VIII : Aggregate and Individual Governance Indicators 1996–2008(2009-06-01)This paper reports on the 2009 update of the Worldwide Governance Indicators (WGI) research project, covering 212 countries and territories and measuring six dimensions of governance between 1996 and 2008: Voice and Accountability, Political Stability and Absence of Violence/Terrorism, Government Effectiveness, Regulatory Quality, Rule of Law, and Control of Corruption. These aggregate indicators are based on hundreds of specific and disaggregated individual variables measuring various dimensions of governance, taken from 35 data sources provided by 33 different organizations. The data reflect the views on governance of public sector, private sector and NGO experts, as well as thousands of citizen and firm survey respondents worldwide. The authors also explicitly report the margins of error accompanying each country estimate. These reflect the inherent difficulties in measuring governance using any kind of data. They find that even after taking margins of error into account, the WGI permit meaningful cross-country comparisons as well as monitoring progress over time. The aggregate indicators, together with the disaggregated underlying indicators, are available at www.govindicators.org.