Publication: Can Business Owners Form Accurate Counterfactuals?: Eliciting Treatment and Control Beliefs about Their Outcomes in the Alternative Treatment Status
Loading...
Files in English
260 downloads
Date
2017-06-20
ISSN
0735-0015
Published
2017-06-20
Author(s)
Editor(s)
Abstract
A survey of participants in a large-scale business plan competition experiment, in which winners received an average of U.S. $50,000 each, is used to elicit ex-post beliefs about what the outcomes would have been in the alternative treatment status. Participants are asked the percent chance they would be operating a firm, and the number of employees and monthly sales they would have, had their treatment status been reversed. The study finds the control group to have reasonably accurate expectations of the large treatment effect they would experience on the likelihood of operating a firm, although this may reflect the treatment effect being close to an upper bound. The control group dramatically overestimates how much winning would help them grow the size of their firm. The treatment group overestimates how much winning helps their chance of their business surviving and also overestimates how much winning helps them grow their firms. In addition, these counterfactual expectations appear unable to generate accurate relative rankings of which groups of participants benefit most from treatment.
Link to Data Set
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Citations
- Cited 15 times in Scopus (view citations)
Collections
Related items
Showing items related by metadata.
Publication Can Business Owners form Accurate Counterfactuals?(World Bank, Washington, DC, 2016-05)A survey of participants in a large-scale business plan competition experiment, in which winners received an average of US$50,000 each, is used to elicit beliefs about what the outcomes would have been in the alternative treatment status. Participants are asked the percent chance they would be operating a firm, and the number of employees and monthly sales they would have, had their treatment status been reversed. The study finds the control group to have reasonably accurate expectations of the large treatment effect they would experience on the likelihood of operating a firm, although this may reflect the treatment effect being close to an upper bound. The control group dramatically overestimates how much winning would help them grow the size of their firm. The treatment group overestimates how much winning helps their chance of running a business, and also overestimates how much winning helps them grow their firms. In addition, these counterfactual expectations appear unable to generate accurate relative rankings of which groups of participants benefit most from treatment.Publication Who Are the Microenterprise Owners? Evidence from Sri Lanka on Tokman v. de Soto(World Bank, Washington, DC, 2008-05)Is the vast army of the self-employed in low income countries a source of employment generation? This paper uses data from surveys in Sri Lanka to compare the characteristics of own account workers (non-employers) with wage workers and with owners of larger firms. The authors use a rich set of measures of background, ability, and attitudes, including lottery experiments measuring risk attitudes. Consistent with the International Labor Organization's views of the self employed (represented by Tokman), the analysis finds that two-thirds to three-quarters of the own account workers have characteristics which are more like wage workers than larger firm owners. This suggests the majority of the own account workers are unlikely to become employers. Using a two and a half year panel of enterprises, the authors show that the minority of own account workers who are more like larger firm owners are more likely to expand by adding paid employees. The results suggest that finance is not the sole constraint to growth of microenterprises, and provides an explanation for the low rates of growth of enterprises supported by microlending.Publication Innovative Firms or Innovative Owners? Determinants of Innovation in Micro, Small, and Medium Enterprises(2009-05-01)Innovation is key to technology adoption and creation, and to explaining the vast differences in productivity across and within countries. Despite the central role of the entrepreneur in the innovation process, data limitations have restricted standard analysis of the determinants of innovation to consideration of the role of firm characteristics. The authors develop a model of innovation that incorporates the role of both owner and firm characteristics, and use this to determine how product, process, marketing, and organizational innovations should vary with firm size and competition. They then use a new, large, representative survey from Sri Lanka to test this model and to examine whether and how owner characteristics matter for innovation. The survey also allows analysis of the incidence of innovation in micro and small firms, which have traditionally been overlooked in the study of innovation, despite these firms comprising the majority of firms in developing countries. The analysis finds that more than one-quarter of the microenterprises are engaging in innovation, with marketing innovations the most common. As predicted by the model, firm size has a stronger positive effect, and competition a stronger negative effect, on process and organizational innovations than on product innovations. Owner ability, personality traits, and ethnicity have a significant and substantial impact on the likelihood of a firm innovating, confirming the importance of the entrepreneur in the innovation process.Publication Learning from the Experiments That Never Happened : Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa(World Bank, Washington, DC, 2012-12)Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects.Publication The Additionality Impact of a Matching Grant Program for Small Firms(World Bank, Washington, DC, 2016-02-05)Matching grants are one of the most common types of private sector development programs used in developing countries. But government subsidies to private firms can be controversial. A key question is that of additionality: do these programs get firms to undertake innovative activities that they would not otherwise do, or merely subsidize activities that will take place anyway? Randomized controlled trials can provide the counterfactual needed to answer this question, but efforts to experiment with matching grant programs have often failed. This paper uses a randomized controlled trial of a matching grant program for firms in the Republic of Yemen to demonstrate the feasibility of conducting experiments with well-designed programs, and to measure the additionality impact. In the first year, the matching grant is found to have led to more product innovation, firms upgrading their accounting systems, marketing more, making more capital investments, and being more likely to report their sales grew.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication Global Economic Prospects, January 2024(Washington, DC: World Bank, 2024-01-09)Note: Chart 1.2.B has been updated on January 18, 2024. Chart 2.2.3 B has been updated on January 14, 2024. Global growth is expected to slow further this year, reflecting the lagged and ongoing effects of tight monetary policy to rein in inflation, restrictive credit conditions, and anemic global trade and investment. Downside risks include an escalation of the recent conflict in the Middle East, financial stress, persistent inflation, weaker-than-expected activity in China, trade fragmentation, and climate-related disasters. Against this backdrop, policy makers face enormous challenges. In emerging market and developing economies (EMDEs), commodity exporters face the enduring challenges posed by fiscal policy procyclicality and volatility, which highlight the need for robust fiscal frameworks. Across EMDEs, previous episodes of investment growth acceleration underscore the critical importance of macroeconomic and structural policies and an enabling institutional environment in bolstering investment and long-term growth. At the global level, cooperation needs to be strengthened to provide debt relief, facilitate trade integration, tackle climate change, and alleviate food insecurity.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.