Publication: What Lies Behind “Good”
Analytical Work on Development ? Four Years of Knowledge
Products at the World Bank
Loading...
Date
2024-02-14
ISSN
Published
2024-02-14
Author(s)
Editor(s)
Abstract
The World Bank’s analytical work has a strong reputation, but its knowledge products are also perceived to be of varying quality and relevance, and the drivers of this heterogeneity are only partially understood. Building on previous evaluations, this paper adopts a production function approach to assess how budget resources, time to completion, technical skills, and institutional responsibilities affect the internal ratings and external visibility of different types of analytical tasks at the World Bank. To this effect, the paper first matches records from three unconnected electronic platforms — for internal documents, budget codes, and external publications — to assemble a comprehensive database of knowledge products and their key characteristics. With analytical documents as its unit of observation, the exercise shows that: (1) devoting more resources to analytical tasks leads to both better ratings and greater visibility; (2) both outcomes are systematically worse when a greater share of resources comes from trust funds; (3) they are also consistently worse for tasks that take longer to complete; (4) more academically oriented team leaders underperform on ratings and overperform on visibility, whereas technically solid but less stellar team leaders overperform on ratings; and (5) everything else equal, performance varies systematically with the nature of the unit in charge. The findings of the paper can be read as a cautionary note against knowledge management that is based on the counting of analytical tasks. Instead, the findings call for much stronger information systems on knowledge products, a better alignment of incentives for the units in charge, and regular evaluations in the spirit of this paper.
Link to Data Set
Citation
“Rama, Martin; Singh, Rucheta; Aslam, Aiza. 2024. What Lies Behind “Good”
Analytical Work on Development ? Four Years of Knowledge
Products at the World Bank. Policy Research Working Paper; 10704. © World Bank. http://hdl.handle.net/10986/41083”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Chinese Imports and Industrialization in Africa(Washington, DC: World Bank, 2025-05-12)The rise of China in the global economy has been linked with negative impacts on employment across many high- and middle-income countries. However, evidence for African countries is limited. This paper investigates the causal relationship between Chinese imports and manufacturing employment in Ethiopia. Imports may harm domestic firms through a revenue effect (lower market shares) or benefit them, indirectly if competition spurs innovation or directly through access to better quality or cheaper inputs. The analysis shows that a one unit increase in import penetration leads to a 15.2 percent increase in industry employment. The inputs effect is disentangled from the other two effects by decomposing total Chinese imports by their end-use category using input-output tables. The evidence shows that imported intermediate inputs are driving the employment gains. The findings are consistent with the idea that employment gains are a result of productivity gains and increases in capacity utilization. These employment gains appear to benefit large firms and labor-intensive industries disproportionately.Publication VAT Exemptions, Embedded Tax, and Unintended Consequences(Washington, DC: World Bank, 2025-05-15)The value-added tax (VAT) has proved to be a highly effective tool at raising revenue in developed and developing countries alike. However, the effective operation of the VAT breaks down in the presence of exemptions. Unlike zero rates, exemptions deny input tax credits, thereby increasing production costs and resulting in VAT being embedded within the prices of goods and services. This paper develops a VAT model based on input-output table and household budget survey data for 29 European countries to examine the effects of VAT exemptions on final prices and to assess the merits of their use. Simulation results show that exemptions suffer from the same targeting problems as reduced VAT rates, but, in addition, they are non-transparent and have unpredictable and counterproductive indirect effects. These effects are in addition to the well-known distortionary impact of exemptions on production decisions, and their creation of incentives to self-supply. The paper concludes that the use of exemptions should be limited to addressing pragmatic concerns, such as the disproportionate compliance costs of small businesses and the practical difficulty in taxing margin-based financial services.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Scaling-Up the Impact of Good Practices in Rural Development : A Working Paper to Support Implementation of the World Bank’s Rural Development Strategy(Washington, DC, 2003-06)A key thrust in the implementation of the Bank's new rural development strategy is identifying and "scaling-up good practice investments and innovations in rural development." Historically, successful World Bank projects have been one-time investments without strategies for leveraging projects to a larger scale or to broader coverage to increase efficiency and developmental impact in a country or region. The Bank believes that scaling-up good practices must become an integral part of national rural development strategies to reduce rural poverty and support broad-based rural development. This working paper, written in support of the Bank's rural development strategy, is intended to contribute to the development of a framework for thinking about scaling-up. The paper begins with a review of the literature on scaling-up in rural development and other contexts to develop an understanding of basic concepts and terms. Drawing from the literature review and interviews, the authors develop a working definition of the term scaling-up and a provisional framework for analyzing experiences of scaling-up in rural development. Then, to evaluate the provisional framework, the authors apply it to a few well-documented case studies of rapid scaling-up. The final sections of the paper draw lessons from the application of the framework to the case studies and identify key areas for moving forward to support scaling-up impacts in rural development.Publication What Difference Does Good Monitoring and Evaluation Make to World Bank Project Performance?(World Bank, Washington, DC, 2016-06)For more than 20 years, the development community has claimed that monitoring and evaluation helps projects achieve their objectives. This study uses data from 1,300 World Bank projects evaluated between 2008 and 2014 to investigate this suggested link between the quality of monitoring and evaluation and project performance. The propensity score matching results indicate that the quality of monitoring and evaluation is significantly and positively associated with project outcome as institutionally measured at the World Bank. This positive relationship holds when controlling for project manager identity, and is robust to various specification choices. Through a systematic text analysis of the narrative produced by the Independent Evaluation Group to justify its monitoring and evaluation quality rating, the study shows that there are common markers of good quality monitoring and evaluation, such as: clear institutional setup and division of labor around monitoring and evaluation activities; simple monitoring and evaluation framework that is well aligned with clients' existing monitoring and evaluation systems; good integration with operational tasks; and a system that can generate regular and timely reporting, and that is used during and after lending.Publication The World Bank’s Publication Record(2010-07-01)The World Bank has produced a huge volume of books and papers on development -- 20,000 publications spanning decades, but growing appreciably since 1990. This paper finds evidence that many of these publications have influenced development thinking, as indicated by the citations found using Google Scholar and in bibliographic data bases. However, the authors also find that a non-negligible share of the Bank's publications have received no citations, suggesting that they have had little scholarly influence, though they may well have had influence on non-academic audiences. Individually-authored journal articles have been the main channel for scholarly influence. The volume of the Bank's research output on development is greater than that of any of the comparator institutions identified, including other international agencies and the top universities in economics. The bibliometric indicators of the quality and influence of the Bank's portfolio of scholarly publications are on a par with, or better than, most of the top universities.Publication Using Knowledge to Improve Development Effectiveness : An Evaluation of World Bank Economic and Sector Work and Technical Assistance, 2000-2006(Washington, DC : World Bank, 2008)In 1996, the World Bank committed itself to becoming a 'global knowledge bank,' using knowledge to improve the development effectiveness of its work. In fiscal 2008, the Bank reiterated its focus on knowledge and learning, naming it as one of its six strategic directions. This evaluation focuses on two of the analytical and advisory activities through which the Bank provides knowledge to its client countries: economic and sector work (ESW) and nonlending technical assistance (TA). This evaluation found that the majority of ESW and TA met their objectives at least to an average extent during fiscal 2000-06, although there were substantial differences across countries and tasks. ESW and TA of higher technical quality were clearly more effective in meeting their objectives. Close collaboration with clients during the process mattered for effectiveness, whether clients actually produced part of the task or not. Sustained follow-up after the completion of the tasks was important for effectiveness. Whether clients requested the tasks did not matter for effectiveness, although all tasks needed to be tailored to client needs and interests to be effective. ESW and TA were less effective in countries where government capacity was lower. Clients in middle-income countries prefer nonlending to lending services, and clients in all countries prefer TA over ESW.Publication Thirty Years of World Bank Shelter Lending : What Have We Learned?(Washington, DC: World Bank, 2006)By reviewing the Bank's experience with shelter lending, this paper seeks to address the question of whether the Bank has helped developing countries deal with the inevitable problems that arise with urbanization, particularly problems with the provision of shelter. It reviews the Bank's performance, with a focus on identifying lessons learned so that current demands can be more effectively addressed. In contrast to earlier studies, however, this review focuses more on how the changing policy environment has affected the structure of Bank assistance, rather than on how Bank assistance has affected the policy environment. This perspective is taken for two reasons. First, in recent years, benevolent changes in the policy environment are helping to ensure that better shelter conditions are provided to the poor in rapidly growing cities. However, despite the generally improved environment, some serious and often long-standing obstacles are impeding and, in some places, preventing progress. The emphasis on the policy environment allows the Bank to give greater weight to these constraints. Second, Bank shelter assistance is no longer an experimental program, as it was when the first review took place. Shelter assistance is now a mature sector, with 278 loans (including International Finance Corporation [IFC] loans). As a result, this review devotes considerably more attention to the outcomes of the Bank's shelter projects than did the earlier studies. Conclusions about shelter lending are by no means completely positive, however. In particular, while the nature of the lending has evolved to embrace the private sector more fully, it has also moved away from the poverty orientation that was for many years the core focus. If the Bank is to make a meaningful contribution to the Millennium Development Goal of affecting the lives of 100 million slum dwellers, this trend will have to change.
Users also downloaded
Showing related downloaded files
Publication Cybersecurity Economics for Emerging Markets(Washington, DC: World Bank, 2024-09-17)In our increasingly interconnected world, where digital technologies are rapidly transforming multiple aspects of daily life, the critical role of cybersecurity cannot be overstated, especially in developing nations. As these countries strive to harness the power of modern technology to drive economic growth, enhance public services, and elevate living standards, they concurrently face heightened risks associated with cyber threats. The increasing exposure of developing countries to cyber incidents is often compounded by various factors, including scarce resources, inadequate infrastructure, political unrest, inefficiencies in cybersecurity and technology markets, shortages of skilled cybersecurity professionals, legislative voids, and rapid rates of digital adoption. "Cybersecurity Economics for Emerging Markets" is a pioneering research work that delves into the drivers and profound consequences of cyber incidents worldwide. From economic setbacks that can destabilize entire economies to interruptions of vital services and impediments to social and economic development, the impacts of cyber incidents are far-reaching. This book analyzes hundreds of scholarly works and thousands of publicly disclosed cyber incidents over the past decade across some 190 countries. It sheds light on these incidents’ characteristics and trends, as well as the proactive roles that private market players and governments can assume to safeguard infrastructure in cyberspace effectively. The book presents practical, evidence-based policy suggestions that include efforts to strengthen the resilience of the most essential and interconnected sectors. It advocates for bolstering the national cybersecurity industries, strategizing cybersecurity research and development, addressing market failures through cybersecurity awareness and training programs, and taking proactive steps to reduce and control contagion effects from cyber incidents. By revealing crucial empirical and theoretical dimensions of cybersecurity economics, this book provides insights that could inform the creation of effective cybersecurity investments, with a focus on developing countries. These insights are invaluable for policy makers and stakeholders committed to fortifying the digital ecosystem against the ever-evolving landscape of cyber threats.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication World Bank Annual Report 2024(Washington, DC: World Bank, 2024-10-25)This annual report, which covers the period from July 1, 2023, to June 30, 2024, has been prepared by the Executive Directors of both the International Bank for Reconstruction and Development (IBRD) and the International Development Association (IDA)—collectively known as the World Bank—in accordance with the respective bylaws of the two institutions. Ajay Banga, President of the World Bank Group and Chairman of the Board of Executive Directors, has submitted this report, together with the accompanying administrative budgets and audited financial statements, to the Board of Governors.