Publication:
How Can We Learn Whether Firm Policies Are Working in Africa? Challenges (and Solutions?) for Experiments and Structural Models

Loading...
Thumbnail Image
Files in English
English PDF (933.4 KB)
364 downloads
English Text (70.15 KB)
254 downloads
Date
2011-04-01
ISSN
Published
2011-04-01
Editor(s)
Abstract
Firm productivity is low in African countries, prompting governments to try a number of active policies to improve it. Yet despite the millions of dollars spent on these policies, we are far from a situation where we know whether many of them are yielding the desired payoffs. This paper establishes some basic facts about the number and heterogeneity of firms in different sub-Saharan African countries and discusses their implications for experimental and structural approaches towards trying to estimate firm policy impacts. It shows that the typical firm program such as a matching grant scheme or business training program involves only 100 to 300 firms, which are often very heterogeneous in terms of employment and sales levels. As a result, standard experimental designs will lack any power to detect reasonable sized treatment impacts, while structural models which assume common production technologies and few missing markets will be ill-suited to capture the key constraints firms face. Nevertheless, the author suggests a way forward which involves focusing on a more homogeneous sub-sample of firms and collecting a lot more data on them than is typically collected.
Link to Data Set
Citation
McKenzie, David. 2011. How Can We Learn Whether Firm Policies Are Working in Africa? Challenges (and Solutions?) for Experiments and Structural Models. Policy Research working paper ; no. WPS 5632. © World Bank. http://hdl.handle.net/10986/3398 License: CC BY 3.0 IGO.
Associated URLs
Associated content
Report Series
Report Series
Other publications in this report series
  • Publication
    The Future of Poverty
    (Washington, DC: World Bank, 2025-07-15) Fajardo-Gonzalez, Johanna; Nguyen, Minh C.; Corral, Paul
    Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.
  • Publication
    Exports, Labor Markets, and the Environment
    (Washington, DC: World Bank, 2025-07-14) Góes, Carlos; Conceição, Otavio; Lara Ibarra, Gabriel; Lopez-Acevedo, Gladys
    What is the environmental impact of exports? Focusing on 2000–20, this paper combines customs, administrative, and census microdata to estimate employment elasticities with respect to exports. The findings show that municipalities that faced increased exports experienced faster growth in formal employment. The elasticities were 0.25 on impact, peaked at 0.4, and remained positive and significant even 10 years after the shock, pointing to a long and protracted labor market adjustment. In the long run, informal employment responds negatively to export shocks. Using a granular taxonomy for economic activities based on their environmental impact, the paper documents that environmentally risky activities have a larger share of employment than environmentally sustainable ones, and that the relationship between these activities and exports is nuanced. Over the short run, environmentally risky employment responds more strongly to exports relative to environmentally sustainable employment. However, over the long run, this pattern reverses, as the impact of exports on environmentally sustainable employment is more persistent.
  • Publication
    The Macroeconomic Implications of Climate Change Impacts and Adaptation Options
    (Washington, DC: World Bank, 2025-05-29) Abalo, Kodzovi; Boehlert, Brent; Bui, Thanh; Burns, Andrew; Castillo, Diego; Chewpreecha, Unnada; Haider, Alexander; Hallegatte, Stephane; Jooste, Charl; McIsaac, Florent; Ruberl, Heather; Smet, Kim; Strzepek, Ken
    Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.
  • Publication
    The Asymmetric Bank Distress Amplifier of Recessions
    (Washington, DC: World Bank, 2025-07-11) Kim, Dohan
    One defining feature of financial crises, evident in U.S. and international data, is asymmetric bank distress—concentrated losses on a subset of banks. This paper proposes a model in which shocks to borrowers’ productivity dispersion lead to asymmetric bank losses. The framework exhibits a “bank distress amplifier,” exacerbating economic downturns by causing costly bank failures and raising uncertainty about the solvency of banks, thereby pushing banks to deleverage. Quantitative analysis shows that the bank distress amplifier doubles investment decline and increases the spread by 2.5 times during the Great Recession compared to a standard financial accelerator model. The mechanism helps explain how a seemingly small shock can sometimes trigger a large crisis.
  • Publication
    Impact of Heat Waves on Learning Outcomes and the Role of Conditional Cash Transfers
    (Washington, DC: World Bank, 2025-07-14) Miranda, Juan José; Contreras, Cesar
    This paper evaluates the impact of higher temperatures on learning outcomes in Peru. The results suggest that 1 degree above 20°C is equivalent to 7 and 6 percent of a standard deviation of what a student learns in a year for math and reading tests, respectively. These results hold true when the main specification is changed, splitting the sample, collapsing the data at school level, and using other climate specifications. The paper aims to improve understanding of how to deal with the impacts of climate change on learning outcomes in developing countries. The evidence suggests that conditional cash transfer programs can mitigate the negative effects of higher temperatures on students’ learning outcomes in math and reading.
Journal
Journal Volume
Journal Issue

Related items

Showing items related by metadata.

  • Publication
    Learning from the Experiments That Never Happened : Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa
    (World Bank, Washington, DC, 2012-12) Campos, Francisco; Coville, Aidan; Fernandes, Ana M.; Goldstein, Markus; McKenzie, David
    Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects.
  • Publication
    The Impact of Business Support Services for Small and Medium Enterprises on Firm Performance in Low- and Middle-Income Countries
    (World Bank, Washington, DC, 2016-05) Cravo, Tulio A.; Piza, Caio
    Interventions designed to support small and medium enterprises are popular among policy makers, given the role small and medium enterprises play in job creation around the world. Business support interventions in low- and middle-income countries are often based on the assumption that market failures and institutional constraints impede the growth of small and medium enterprises. Significant resources from governments and international organizations are directed to small and medium enterprises to maximize their socioeconomic impact. Business-support interventions for small and medium enterprises in low- and middle-income countries most often relate to formalization and business environments, exports, value chains and clusters, training and technical assistance, and access to credit and innovation. Very little is known about the impact of such interventions despite the abundance of resources directed to small and medium enterprise business-support services. This paper systematically reviews and summarizes 40 rigorous evaluations of small and medium enterprise support services in low- and middle-income countries, and presents evidence to help inform policy debates. The study found indicative evidence that overall business-support interventions help improve firm performance and create jobs. However, little is still known about which interventions work best for small and medium enterprises and why. More rigorous impact evaluations are needed to fill the large knowledge gap in the field.
  • Publication
    Fostering Entrepreneurship in Georgia
    (Washington, DC: World Bank, 2013) Kuriakose, Smita; Kuriakose, Smita
    Job creation and productivity growth are at the forefront of today's global development agenda. The 2013 world development report on jobs identified entrepreneurship as an important tool in addressing these dual goals. This study uses the entrepreneurship model put forth in the organization for Economic Co-operation and Development (OECD)-Eurostat Entrepreneurship Indicator Program (2009), with minor modifications. The model comprises various determinants that policy can affect and that in turn influence entrepreneurial performance, or the amount and type of entrepreneurship that take place. The model then refers to the impact of entrepreneurship on higher-level goals such as economic growth, job creation, and poverty reduction. This study focuses on determining the level of entrepreneurship in Georgia and analyzes the role of each determinant in both fostering and constraining entrepreneurial activity. Entrepreneurs view opportunities in the economy by measuring their profit-making potential; that is their first motivation. Entrepreneurs will not pursue a societal need unless they can successfully make a profit. Entrepreneurship also depends on various social and individual characteristics of gender and culture. It involves taking risks, and potential entrepreneurs cannot be risk-averse. A fundamental question stemming from analyzing these determinants of entrepreneurship is how to design effective public policy that promotes innovative firm creation and enables existing firms to catch up, improve productivity, and grow. Experiences from Asian countries and developed economies have shown that innovative Small Medium Enterprises (SMEs) and knowledge-based firm creation have played a major role in the development of new national economic advantages. In this context public policy is pivotal in creating an enabling environment that helps alleviate the market failures that inhibit firm growth. Emerging markets have other environmental conditions that are not present (or are less prevalent) in developed markets, and investors considering investing in emerging markets will face added risk as a result.
  • Publication
    The Additionality Impact of a Matching Grant Program for Small Firms
    (World Bank, Washington, DC, 2016-02-05) Assaf, Nabila; McKenzie, David; Cusolito, Ana Paula
    Matching grants are one of the most common types of private sector development programs used in developing countries. But government subsidies to private firms can be controversial. A key question is that of additionality: do these programs get firms to undertake innovative activities that they would not otherwise do, or merely subsidize activities that will take place anyway? Randomized controlled trials can provide the counterfactual needed to answer this question, but efforts to experiment with matching grant programs have often failed. This paper uses a randomized controlled trial of a matching grant program for firms in the Republic of Yemen to demonstrate the feasibility of conducting experiments with well-designed programs, and to measure the additionality impact. In the first year, the matching grant is found to have led to more product innovation, firms upgrading their accounting systems, marketing more, making more capital investments, and being more likely to report their sales grew.
  • Publication
    Tanzania : Productive Jobs Wanted
    (Washington, DC, 2014-09) World Bank Group
    Over the past 18 months, the World Bank has been working on a comprehensive plan to address the challenge of productive jobs in Tanzania. This study represents a step towards a better understanding of how to promote job creation in Tanzania. Indeed, the growth of productive jobs is vital for alleviating poverty and promoting shared prosperity - two important goals of Tanzania's economic strategy. This booklet highlights the three-pillar plan for job creation derived from the Tanzania country economic memorandum. The first pillar looks at job creation from the angle of small non-farm businesses, which have been growing very fast during the rapid urbanization. The second pillar focuses on farms because those still capture the largest share of employment in Tanzania, while the third pillar discusses the job-creation potential associated with business expansion into new markets. By focusing on a comprehensive set of concrete actions, the goal is to stimulate debate as well as to build ownership and accountability among policy-makers and key stakeholders in the country.

Users also downloaded

Showing related downloaded files

  • Publication
    Classroom Assessment to Support Foundational Literacy
    (Washington, DC: World Bank, 2025-03-21) Luna-Bazaldua, Diego; Levin, Victoria; Liberman, Julia; Gala, Priyal Mukesh
    This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.
  • Publication
    Crime and Violence in Central America : A Development Challenge - Main Report
    (World Bank, 2011-01-01) World Bank
    Crime and violence are now a key development issue for Central American countries. In three nations El Salvador, Guatemala, and Honduras crime rates are among the top five in Latin America. This report argues that successful strategies require actions along multiple fronts, combining prevention and criminal justice reform, together with regional approaches in the areas of drug trafficking and firearms. It also argues that interventions should be evidence based, starting with a clear understanding of the risk factors involved and ending with a careful evaluation of how any planned action might affect future options. In addition, the design of national crime reduction plans and the establishment of national cross-sectoral crime commissions are important steps to coordinate the actions of different government branches, ease cross-sectoral collaboration and prioritize resource allocation. Of equal importance is the fact that national plans offer a vehicle for the involvement of civil society organizations, in which much of the expertise in violence prevention and rehabilitation resides. Prevention efforts need to be complemented by effective law enforcement. The required reforms are no longer primarily legislative in nature because all six countries have advanced toward more transparent adversarial criminal procedures. The second-generation reforms should instead help deliver on the promises of previous reforms by: (i) strengthening key institutions and improving the quality and timeliness of the services they provide to citizens; (ii) improving efficiency and effectiveness while respecting due process and human rights; (iii) ensuring accountability and addressing corruption; (iv) increasing inter-agency collaboration; and (v) improving access to justice, especially for poor and disenfranchised groups. Specific interventions reviewed in the report include: information systems and performance indicators as a prerequisite to improve inter-institutional coordination and information sharing mechanisms; an internal overhaul of court administration and case management to create rapid reaction, one-stop shops; the strengthening of entities that provide legal counseling to the poor and to women; and the promotion of alternative dispute-resolution mechanisms and the implementation of community policing programs.
  • Publication
    Guide to the Debt Management Performance Assessment Tool
    (Washington, DC, 2008-02-05) World Bank
    The purpose of this document is to provide guidance and supplemental information to assist with country assessments of debt management performance, using the Debt Management Performance Assessment (DeMPA) tool. The DeMPA is a methodology used for assessing public debt management performance through a comprehensive set of 15 performance indicators spanning the full range of government Debt Management (DeM) functions. It is based on the principles set out in the International Monetary Fund (IMF) and World Bank guidelines for public debt management, initially published in 2001 and updated in 2003. It is modeled after the Public Expenditure and Financial Accountability (PEFA) framework for performance measurement of public financial management. The DeMPA has been designed to be a user-friendly tool to undertake an assessment of the strengths and weaknesses in government DeM practices. This guide provides additional background and supporting information so that a no specialist in the area of debt management may undertake a country assessment effectively. The guide can be used by assessors in preparing for and undertaking an assessment. It is particularly useful for understanding the rationale for the inclusion of the indicators, the scoring methodology, and the list of supporting documents or evidence required, and the questions that could be asked for the assessment.
  • Publication
    Argentina Country Climate and Development Report
    (World Bank, Washington, DC, 2022-11) World Bank Group
    The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.
  • Publication
    The Mexican Social Protection System in Health
    (World Bank, Washington DC, 2013-01) Bonilla-Chacín, M.E.; Aguilera, Nelly
    With a population of 113 million and a per-capita Gross Domestic Product, or GDP of US$10,064 (current U.S. dollars), Mexico is one of the largest and highest-income countries in Latin America and the Caribbean (LAC). The country has benefited from sustained economic growth during the last decade, which was temporarily interrupted by the financial and economic crisis. Real GDP is projected to grow 3.8 percent and 3.6 percent in 2012 and 2013, respectively (International Monetary Fund, or IMF 2012). Despite this growth, poverty in the country remains high; with half of the population living below the national poverty line. The country is also highly heterogeneous, with large socioeconomic differences across states and across urban and rural areas. In 2010, while the extreme poverty ratio in the Federal District and the states of Colima and Nuevo Leon was below 3 percent, in Chiapas, Guerrero, and Oaxaca it was 25 percent or higher. These large regional differences are also found in other indicators of well-being, such as years of schooling, housing conditions, and access to social services. This case study assesses key features and achievements of the Social Protection System in Health (Sistema de Proteccion Social en Salud) in Mexico, and particularly of its main pillar, Popular Health Insurance (Seguro Popular, PHI). It analyzes the contribution of this policy to the establishment and implementation of universal health coverage in Mexico. In 2003, with the reform of the General Health Law, the PHI was institutionalized as a subsidized health insurance scheme open to the population not covered by the social security schemes. Today, the PHI covers all of its intended affiliates, about 52 million people