Publication: Can Business Owners Form Accurate Counterfactuals?: Eliciting Treatment and Control Beliefs about Their Outcomes in the Alternative Treatment Status
Loading...
Files in English
322 downloads
Published
2017-06-20
ISSN
0735-0015
Date
2019-01-10
Author(s)
Editor(s)
Abstract
A survey of participants in a large-scale business plan competition experiment, in which winners received an average of U.S. $50,000 each, is used to elicit ex-post beliefs about what the outcomes would have been in the alternative treatment status. Participants are asked the percent chance they would be operating a firm, and the number of employees and monthly sales they would have, had their treatment status been reversed. The study finds the control group to have reasonably accurate expectations of the large treatment effect they would experience on the likelihood of operating a firm, although this may reflect the treatment effect being close to an upper bound. The control group dramatically overestimates how much winning would help them grow the size of their firm. The treatment group overestimates how much winning helps their chance of their business surviving and also overestimates how much winning helps them grow their firms. In addition, these counterfactual expectations appear unable to generate accurate relative rankings of which groups of participants benefit most from treatment.
Link to Data Set
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Can Business Owners form Accurate Counterfactuals?(World Bank, Washington, DC, 2016-05)A survey of participants in a large-scale business plan competition experiment, in which winners received an average of US$50,000 each, is used to elicit beliefs about what the outcomes would have been in the alternative treatment status. Participants are asked the percent chance they would be operating a firm, and the number of employees and monthly sales they would have, had their treatment status been reversed. The study finds the control group to have reasonably accurate expectations of the large treatment effect they would experience on the likelihood of operating a firm, although this may reflect the treatment effect being close to an upper bound. The control group dramatically overestimates how much winning would help them grow the size of their firm. The treatment group overestimates how much winning helps their chance of running a business, and also overestimates how much winning helps them grow their firms. In addition, these counterfactual expectations appear unable to generate accurate relative rankings of which groups of participants benefit most from treatment.Publication Who Are the Microenterprise Owners? Evidence from Sri Lanka on Tokman v. de Soto(World Bank, Washington, DC, 2008-05)Is the vast army of the self-employed in low income countries a source of employment generation? This paper uses data from surveys in Sri Lanka to compare the characteristics of own account workers (non-employers) with wage workers and with owners of larger firms. The authors use a rich set of measures of background, ability, and attitudes, including lottery experiments measuring risk attitudes. Consistent with the International Labor Organization's views of the self employed (represented by Tokman), the analysis finds that two-thirds to three-quarters of the own account workers have characteristics which are more like wage workers than larger firm owners. This suggests the majority of the own account workers are unlikely to become employers. Using a two and a half year panel of enterprises, the authors show that the minority of own account workers who are more like larger firm owners are more likely to expand by adding paid employees. The results suggest that finance is not the sole constraint to growth of microenterprises, and provides an explanation for the low rates of growth of enterprises supported by microlending.Publication Innovative Firms or Innovative Owners? Determinants of Innovation in Micro, Small, and Medium Enterprises(2009-05-01)Innovation is key to technology adoption and creation, and to explaining the vast differences in productivity across and within countries. Despite the central role of the entrepreneur in the innovation process, data limitations have restricted standard analysis of the determinants of innovation to consideration of the role of firm characteristics. The authors develop a model of innovation that incorporates the role of both owner and firm characteristics, and use this to determine how product, process, marketing, and organizational innovations should vary with firm size and competition. They then use a new, large, representative survey from Sri Lanka to test this model and to examine whether and how owner characteristics matter for innovation. The survey also allows analysis of the incidence of innovation in micro and small firms, which have traditionally been overlooked in the study of innovation, despite these firms comprising the majority of firms in developing countries. The analysis finds that more than one-quarter of the microenterprises are engaging in innovation, with marketing innovations the most common. As predicted by the model, firm size has a stronger positive effect, and competition a stronger negative effect, on process and organizational innovations than on product innovations. Owner ability, personality traits, and ethnicity have a significant and substantial impact on the likelihood of a firm innovating, confirming the importance of the entrepreneur in the innovation process.Publication Learning from the Experiments That Never Happened : Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa(World Bank, Washington, DC, 2012-12)Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects.Publication The Additionality Impact of a Matching Grant Program for Small Firms(World Bank, Washington, DC, 2016-02-05)Matching grants are one of the most common types of private sector development programs used in developing countries. But government subsidies to private firms can be controversial. A key question is that of additionality: do these programs get firms to undertake innovative activities that they would not otherwise do, or merely subsidize activities that will take place anyway? Randomized controlled trials can provide the counterfactual needed to answer this question, but efforts to experiment with matching grant programs have often failed. This paper uses a randomized controlled trial of a matching grant program for firms in the Republic of Yemen to demonstrate the feasibility of conducting experiments with well-designed programs, and to measure the additionality impact. In the first year, the matching grant is found to have led to more product innovation, firms upgrading their accounting systems, marketing more, making more capital investments, and being more likely to report their sales grew.
Users also downloaded
Showing related downloaded files
Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Using Immunization Coverage Rates for Monitoring Health Sector Performance : Measurement and Interpretation Issues(World Bank, Washington, DC, 2000-08)Immunization against childhood diseases such as diphtheria, pertussis, tetanus, polio and measles is one of the most important means of preventing childhood morbidity and mortality. Despite the low cost of basic childhood immunizations, nearly 3 million children still die each year from vaccine-preventable diseases. Achieving and maintaining high levels of immunization coverage must therefore be a priority for all health systems. In order to monitor progress in achieving this objective, immunization coverage data can serve as an indicator of a health system's capacity to deliver essential services to the most vulnerable members of a population. This note discusses the use of trends in immunization coverage data, and argues that immunization is a health output with a strong impact on child morbidity, child mortality and permanent disability. This note discusses measurement and interpretation issues for coverage data collected through surveys and administrative records.Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.