Publication: The Development Effectiveness of the Use of Doing Business Indicators, Fiscal Years 2010-20 - An Independent Evaluation
Loading...
Published
2022-03-15
ISSN
Date
2022-03-16
Author(s)
Editor(s)
Abstract
IEG began preparing the evaluation in June 2020, in response to a request from the World Bank Group Board’s Committee on Development Effectiveness. In March 2021, IEG produced an Issues Paper identifying lines of inquiry for the main evaluation, distributed it for internal and management reviews, and submitted it to CODE in June 2021. In September 2021, as the evaluation was undergoing final revisions, World Bank Group management decided to discontinue the Doing Business report. In announcing its decision, the Bank Group stated that it intended to work on a new approach to assess business and investment climates. In February 2022, the Bank published a pre-concept note introducing the Business Enabling Environment project (BEE), a new benchmarking exercise to “measure the business enabling environment in economies worldwide.” In this context and given the use of multiple other global indicators in reforms, the learning from this evaluation report is highly relevant. A cover note extends its findings to the use of other global indicators, including the successor Business Enabling Environment Project. The evaluation seeks to guide any new approach using evidence-based indicators so that it builds on the many good practices observed in Doing Business and considers the substantial power that these indicators have to motivate and engage client countries in business environment reform. It calls for indicators to be used in a balanced and accurate manner guiding the choice of reform priorities in client countries with the greatest development benefits for their socio-economic situation. The following generalized lessons can be drawn from the report: (i) Recognizing the powerful motivational effect of reform indicators, this evaluation notes the limitations in the coverage and guidance offered by any single indicator set on its own and advocates integrating them with complementary analytic tools and indicators. (ii) Recognizing the granularity and specificity of individual reforms in any given country context, the findings suggest that it is better to avoid using business regulatory or similar global indicators as explicit reform objectives or monitoring indicators in Bank Group projects and country strategies focused on improving the business environment. This does not preclude the use of primary data to track and measure agreed targets critical to Bank Group institutional commitments. (iii) Global indicators coverage and specifications are improved if, at regular and predictable intervals, they are updated to reflect learning from research and field experience to (i) improve links to important development outcomes; (ii) strengthen relevance to the experience of the subject of coverage; and (iii) adapt to technological changes in the areas covered by the indicators. (iv) The DB experience indicates the need for mechanisms and safeguards to assure the accuracy and validity of World Bank Group global indicator-based reports and related communications, using robust and transparent standards of evidence.
Link to Data Set
Citation
“Independent Evaluation Group. 2022. The Development Effectiveness of the Use of Doing Business Indicators, Fiscal Years 2010-20 - An Independent Evaluation. © Independent Evaluation Group. http://hdl.handle.net/10986/37143 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Doing Business, An Independent Evaluation : Taking the Measure of the World Bank-IFC Doing Business Indicators(Washington, DC : World Bank, 2008)Doing Business (DB), the annual World Bank- International Finance Corporation (IFC) benchmarking exercise launched in 2004, is one of the Bank Group's flagship knowledge products. It aims to measure the costs to firms of business regulations in 178 countries and ranks the countries along 10 dimensions. It also aims to advance the World Bank Group's private sector development agenda by motivating and informing the design of regulatory reforms, enriching international initiatives on development effectiveness, and informing theory. By ranking countries and spotlighting both leaders and laggards, DB has attracted the interest of senior policy makers and is claimed to have inspired reforms on business climate issues. DB's lively communications style has helped give the DB indicators an international profile. The report has five sections: the first chapter reviews the intellectual underpinnings of the DB indicators. The second chapter reports on how DB collects and assembles data. The chapters third and fourth discuss the relevance of the dimensions measured by the exercise and their use inside and outside the Bank. And finally, chapter fifth presents findings and recommendations.Publication The World Bank Group and Public Procurement--An Independent Evaluation : Volume 2: Achieving Development Effectiveness through Procurement in Bank Financial Assistance(Washington, DC: World Bank, 2014)Good public procurement practices are a major determinant of the effectiveness of public expenditure. On behalf of their citizens, governments typically spend as much as 5-20 percent of their gross domestic product on procurement of goods and services, and effective procurement policies enable better use of government budgets. Good national procurement practices are therefore an essential element of the poverty reduction focus of the Bank. Good procurement in Bank projects is also associated with better development outcomes. Equally, sound public procurement in client countries is a prerequisite for the success of the Bank's newly introduced program for results lending instrument. The Bank seeks to ensure that its funds are used for the purpose intended and that they support development effectively and efficiently. Thus, the twin issues that underpin this Independent Evaluation Group (IEG) evaluation are first, how effectively has the World Bank helped build well-functioning public procurement systems in client countries and second, how well have Bank procurement policies and procedures for its investment lending supported the development effectiveness of Bank lending? The evaluation parallels an intensive review by Bank management of the institution's procurement function, motivated by the need to respond to a range of internal and external changes in the Bank's procurement environment. Several evaluations point to the value of coordination between procurement and public expenditure reforms, but also to the difficulties of realizing such coordination. Finally, there are queries related to the adaptability of current Bank procurement guidelines to new contexts, such as public-private partnerships (PPPs); technology loans; and small, fragile, or conflict-affected states. These questions have also contributed to the evaluation's design and coverage.Publication World Bank Group Support for Innovation and Entrepreneurship : An Independent Evaluation(World Bank Group, Washington, DC, 2013-09)World Bank Group management welcomes Independent Evaluation Group (IEG) review of innovation and entrepreneurship. The global financial crisis required developing economies to actively seek new sources of economic growth. Natural resource-intensive economies are pursuing new ways to diversify their productive capacity to build resilience to commodity cycles. Middle-income countries (MICs) are looking for ways to escape the middle-income trap. A number of developmental challenges, from climate adaptation to food security and health, require new, efficient technological solutions adapted to developing countries' needs. In such context, innovation and entrepreneurship are increasingly seen as essential ingredients for economic and social prosperity. The report notes there are limited mechanisms in place to share learning about innovation and entrepreneurship and few formal efforts to improve coordination. However, important initiatives are already under way to foster learning, cross fertilization, and codification of knowledge to support innovation policy. The innovation, technology, and entrepreneurship (ITE) global practice, for example, brings together innovation and entrepreneurship specialists across the Bank Group in knowledge exchange forums and other learning activities. The innovation policy platform (IPP), under advanced development, will provide a repository of knowledge on the "how to" of innovation policy and a collaborative space for users to exchange knowledge. The report recognizes that venture capital investments typically have high rates of failure in which only one or two investments earn high returns for every ten investments made. It states further that market practice assesses a fund's performance on a portfolio basis against its peers of the same vintage, not on a stand-alone basis. The positive effects on private sector development of International Finance Corporation (IFC) investments in venture capital funds confirm that this type of financing can be an important mechanism for fostering innovation, entrepreneurship, and growth of private enterprises. The report states that Multilateral Investment Guarantee Agency (MIGA) support helped jump-start private sector foreign direct investment in post conflict situations in Mozambique and Nicaragua. The report concludes that the effectiveness of MIGA's interventions to support innovation and entrepreneurship will be enhanced with improvements in the quality of its front-end work in assessment, underwriting, and monitoring. This report is organized as follows: chapter one presents evaluation context; chapter two gives strategies to support innovation and entrepreneurship; and chapter three deals with supporting innovation and entrepreneurship in World Bank Group projects; chapter four presents portfolio performance of World Bank Group support for innovation and entrepreneurship; chapter five gives learning from World Bank Group interventions; and chapter six gives conclusions and recommendations.Publication Independent Evaluation of IFC's Development Results 2007 : Lessons and Implications from 10 Years of Experience(2008)IFC's overriding objective is to help reduce poverty and support sustainable development in developing countries. This report, which assesses the impact of IFC toward that mission, appears at a time of unprecedented levels of private investment in the emerging markets. The report takes a look back at the development results that IFC-supported projects have achieved in the last 10 years, the main lessons that have emerged at the project level and the strategic implications for IFC going forward, in the context of rapid organizational growth. The report finds that IFC-supported project performance is closely linked to the quality of a country's business climate, the presence of a high quality sponsor, well-managed company and product market risk, and in particular, to IFC's work quality (especially at the appraisal and structuring stage, and including oversight of the environmental and social effects of projects). Going forward, the report highlights major challenges IFC faces to achieving overall development effectiveness. IFC will need to adopt a sharper country focus and better exploit synergies with the Bank and other development partners in improving business climates in developing countries.Publication Impact Evaluation of Business License Simplification in Peru : An Independent Assessment of an International Finance Corporation-Supported Project(Washington, DC: World Bank, 2013)This evaluation assesses the impact of International Finance Corporation's (IFC's) Business License Simplification Project in the municipality of Lima, Peru. It reviews two previous evaluations sponsored by IFC and adds new evidence. Under the project, IFC's Foreign Investment Advisory Services (FIAS) worked with the municipality of Lima to reform the administrative process for obtaining a business license in Cercado de Lima, one of 44 districts that comprise metropolitan Lima. According to the municipality, 64 percent of the businesses in this district lacked a business license in 2005, and most of them were microenterprises. The project was implemented from January 2005 to March 2007. The present evaluation conducted an independent review of both previous studies, collected additional data, verified the previous findings, and placed the findings in the context of related studies and evaluations. The goal was to take stock of the results, collect and use other evidence, and draw lessons for future IFC and World Bank operations. This chapter describes and compares the divergent evidence on which procedures were simplified by the license reform and by how much. A second chapter reviews existing evaluations and previous relevant findings from other countries; a third replicates and extends the regression evidence on the impact of license reform on critical business outcomes, such as revenues and employment. The fourth chapter, a cost-benefit assessment of the desirability of the whole program, reviews what the behavior of businesses and their own testimony reveals about the benefits of registration. The final chapter takes into account the findings reviewed in previous chapters, as well as new evidence in this study, and offers policy implications and recommendations for IFC.
Users also downloaded
Showing related downloaded files
Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.