Publication: Improving Productivity Measurement in World Bank Group Interventions
Loading...
Date
2022
ISSN
Published
2022
Author(s)
Editor(s)
Abstract
This note aims to help teams implementing interventions to employ firm productivity measures in their projects. It does so by providing guidance on: (a) measuring firm productivity, (b) strengthening theories of change as they relate to firm productivity, and (c) attributing productivity changes to projects. The note begins by first introducing the various productivity measures that can be used. It then discusses how project interventions may be linked to effects on firms and any measure of productivity, through a theory of change. Further, it provides guidance on productivity estimation in practice, before discussing how to attribute actual changes in productivity to project interventions. Finally, the note summarizes the key dos and don’ts for teams working on productivity.
Link to Data Set
Citation
“Avdiu, Besart. 2022. Improving Productivity Measurement in World Bank Group Interventions. Equitable Growth, Finance & Institutions Insight;. © World Bank. http://hdl.handle.net/10986/38100 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Relevance of the World Bank Group’s Early Response to COVID-19(Washington, DC: World Bank, 2022-02-10)Evaluating the relevance of development interventions is a complex task because many different dimensions must be considered. This study focuses on one particular, quantifiable aspect of relevance and proposes a method for generating data-driven evidence that can be used to assess the relevance of past interventions and guide decisions about future strategic priorities. For the purpose of this study, relevance is defined as the match between the types and scopes of provided support and the types and scopes of support that are most needed in each country. The latter is estimated based on a multidimensional vulnerability score, which is constructed using data on various empirical indicators that have been argued in the economic literature to proxy vulnerability to shocks at the country level. Comparing the vulnerability score with the sector-specific allocation of support yields two empirical measures of relevance, one at the country level and one at the sector level within each country. The proposed method is designed and applied to evaluate the relevance of the World Bank Group’s early response to COVID-19. At the same time, many of the modeling insights are more broadly applicable and may also be useful in informing evaluations of development programs beyond the specific application considered here.Publication Informal Economy and the World Bank(World Bank, Washington, DC, 2014-05)Many countries have expressed an interest in the size, performance and motivation of the informal sector, especially where the informal sector provides the livelihood and employment for a critical segment of the population. This essay reviews recent literature, methodologies, and relevant Bank studies as a way to share information with country teams interested in expanding their knowledge of the informal sector and related policy debates. Research in a number of regions points to four main areas where development policy can be improved by taking the informal sector into account. First, improvements should be made along a continuum; the heterogeneity among informal firms points to different policy approaches for different types of firms. Second, there should be public-private collaboration on mutual reforms. Many efforts to improve firm performance focus on elements of the production function (labor skills, credit) while treating government mainly as a cost (taxes, cost of compliance with regulations). Yet research reveals that many characteristics of the public regime strongly influence the decisions of firms regarding informality. Third, research indicates a strong relation between basic skills and labor outcomes, particularly in the informal sector, despite the sector's lower average returns. Research also indicates the benefits of targeted training programs. Business services programs have a decidedly mixed record, yet ongoing research is refining results on what works best. Fourth, informal trade is pervasive in developing countries and the networks developed in informal trade -- wholesalers, credit suppliers and money-changers, transporters -- are a strong presence in the informal sector. Yet these kinds of complex and nontransparent trading systems can be discouraging to foreign investors and can otherwise undermine trade policy and the international competitiveness of developing countries. The paper concludes with recommendations.Publication Improving Effectiveness and Outcomes for the Poor in Health, Nutrition, and Population : An Evaluation of World Bank Group Support since 1997(Washington, DC: World Bank, 2009)This evaluation aims to inform the implementation of the most recent the World Bank and International Finance Corporation (IFC) health, nutrition, and population (HNP) strategies to enhance the effectiveness of future support. It covers the period since fiscal year 1997 and is based on desk reviews of the portfolio, background studies, and field visits. The evaluation of the HNP support of the World Bank focuses on the effectiveness of policy dialogue, analytic work, and lending at the country level, while that of IFC focuses on the performance of health investments and advisory services before and after its 2002 health strategy. The themes it covers are drawn from the two strategies and the approaches adopted by international donors in the past decade. Independent Evaluation Group (IEG) has previously evaluated several aspects of the Bank's HNP support. IFC's support for the health sector has never been fully evaluated. Many lessons have been learned over the past decade about the successes and pitfalls of support for health reform: First, the failure to assess fully the political economy of reform and to prepare a proactive plan to address it can considerably diminish prospects for success. Political risks, the interests of key stakeholders, and the risk of complexity- issues the evaluation case studies found to be critical are often neglected in risk analysis in project appraisal documents for health reform projects. Second, reforms based on careful prior analytic work hold a greater chance of success, but analytic work does not ensure success. Third, the sequencing of reforms can improve political feasibility, reduce complexity, ensure that adequate capacity is in place, and facilitate learning. When implementation is flagging, the Bank can help preserve reform momentum with complementary programmatic lending through the Ministry of Finance, as it did in Peru and the Kyrgyz Republic. Finally, monitoring and evaluation are critical in health reform projects-to demonstrate the impact of pilot reforms to garner political support, but also because many reforms cannot work without a well-functioning management information system.Publication Infrastructure and Growth in South Africa: Direct and Indirect Productivity Impacts of 19 Infrastructure Measures(World Bank, Washington, DC, 2006-08)Empirical explorations of the growth and productivity impacts of infrastructure have been characterized by ambiguous (countervailing signs) results with little robustness. A number of explanations of the contradictory findings have been proposed. These range from the crowd-out of private by public sector investment, non-linearities generating the possibility of infrastructure overprovision, simultaneity between infrastructure provision and growth, and the possibility of multiple (hence indirect) channels of influence between infrastructure and productivity improvements. The authors explore these possibilities using panel data for South Africa over the 1970-2000 period, and a range of 19 infrastructure measures. Using a number of alternative measures of productivity, the prevalence of ambiguous (countervailing signs) results, with little systematic pattern is also shown to hold for their data set in estimations that include the infrastructure measures in simple growth frameworks. The authors demonstrate that controlling for potential endogeneity of infrastructure in estimation robustly eliminates virtually all evidence of ambiguous impacts of infrastructure, due for example to possible overinvestment in infrastructure. Controlling for the possibility of endogeneity in the infrastructure measures renders the impact of infrastructure capital not only positive, but of economically meaningful magnitudes. These findings are invariant between the direct impact of infrastructure on labor productivity, and the indirect impact of infrastructure on total factor productivity.Publication The World Bank Group and Public Procurement--An Independent Evaluation : Volume 2: Achieving Development Effectiveness through Procurement in Bank Financial Assistance(Washington, DC: World Bank, 2014)Good public procurement practices are a major determinant of the effectiveness of public expenditure. On behalf of their citizens, governments typically spend as much as 5-20 percent of their gross domestic product on procurement of goods and services, and effective procurement policies enable better use of government budgets. Good national procurement practices are therefore an essential element of the poverty reduction focus of the Bank. Good procurement in Bank projects is also associated with better development outcomes. Equally, sound public procurement in client countries is a prerequisite for the success of the Bank's newly introduced program for results lending instrument. The Bank seeks to ensure that its funds are used for the purpose intended and that they support development effectively and efficiently. Thus, the twin issues that underpin this Independent Evaluation Group (IEG) evaluation are first, how effectively has the World Bank helped build well-functioning public procurement systems in client countries and second, how well have Bank procurement policies and procedures for its investment lending supported the development effectiveness of Bank lending? The evaluation parallels an intensive review by Bank management of the institution's procurement function, motivated by the need to respond to a range of internal and external changes in the Bank's procurement environment. Several evaluations point to the value of coordination between procurement and public expenditure reforms, but also to the difficulties of realizing such coordination. Finally, there are queries related to the adaptability of current Bank procurement guidelines to new contexts, such as public-private partnerships (PPPs); technology loans; and small, fragile, or conflict-affected states. These questions have also contributed to the evaluation's design and coverage.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Empowerment in Practice : From Analysis to Implementation(Washington, DC: World Bank, 2006)This book represents an effort to present an easily accessible framework to readers, especially those for whom empowerment remains a puzzling development concern, conceptually and in application. The book is divided into two parts. Part 1 explains how the empowerment framework can be used for understanding, measuring, monitoring, and operationalizing empowerment policy and practice. Part 2 presents summaries of each of the five country studies, using them to discuss how the empowerment framework can be applied in very different country and sector contexts and what lessons can be learned from these test cases. While this book can offer only a limited empirical basis for the positive association between empowerment and development outcomes, it does add to the body of work supporting the existence of such a relationship. Perhaps more importantly, it also provides a framework for future research to test the association and to prioritize practical interventions seeking to empower individuals and groups.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.