Publication: Asking Better Questions: The Effect of Changing Investment Organizations’ Evaluation Practices on Gender Disparities in Funding Innovation
Loading...
Date
2023-12-05
ISSN
Published
2023-12-05
Editor(s)
Abstract
Female innovators raise fewer resources from investors, even when their ventures are similar to those of all-male teams. Efforts to mitigate the disparities have typically focused on changing how founders seek investment. However, the causes of gender disparities are systemic: in uncertain contexts, evaluators value women’s competence or leadership potential lower than men’s, and investors inquire more about risks when facing female founders than males. What is the effect of investment organizations’ evaluation practices on gender disparities in funding innovation This paper examines a two-stage global field experiment with investors making 1,871 investment decisions on early-stage startups, which resulted in $320,000 invested in 16 startups. The experiment changed an organization’s evaluation framework to systematize investor inquiry across all ventures by including prompts about (1) risk and reward and (2) progress during the evaluation period. This caused treated investors to (1) assess startups more consistently and (2) assess startup competence more dynamically than control investors. It eliminated, even reversed, the gender gap in investment outcomes. These results have implications for organizations making decisions in uncertain contexts, and those aiming to reduce gender disparities.
Link to Data Set
Citation
“Miller, Amisha; Lall, Saurabh A.; Goldstein, Marjus; Montalvao, Joao. 2023. Asking Better Questions: The Effect of Changing Investment Organizations’ Evaluation Practices on Gender Disparities in Funding Innovation. Policy Research Working Papers; 19625. © World Bank. http://hdl.handle.net/10986/40693 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.Publication Participation in Pension Programs in Low- and Middle-Income Countries(Washington, DC: World Bank, 2025-04-24)Low- and middle-income countries are aging rapidly but stagnation of growth in participation in pension programs, due to widespread informal employment, presents a major fiscal challenge. Some claim that improving the design of pension program rules can encourage more pension contributions, while others push for universal non-contributory pensions. This paper reviews the recent academic literature on the determinants of active participation in pension systems in high- informality settings. An emerging body of evidence shows that participation responds significantly to financial incentives as well as nonfinancial obstacles. At the same time, pensions are imperfect substitutes for other strategies to cover longevity risk, including support through the family, which will remain crucial for many older people in fiscally constrained environments. Therefore, policy makers should integrate the design of contributory pensions, social pensions, and policies that facilitate other forms of elderly support and consider how all three interact. To inform such efforts, these interactions must be more systematically investigated, and the empirical evidence must be expanded beyond a small number of middle-income countries.Publication Capitalizing on Digital Transformation to Enhance the Effectiveness of Property Institutions(Washington, DC: World Bank, 2025-04-14)Property registries have long been a pillar of state capacity and a basis for private market activity. While registry establishment and operation traditionally were costly and time consuming, digital technology makes low-cost registry operation and wide outreach easier. To guide developing countries aiming to establish such registries and measure progress, this paper develops indicators (in terms of digital coverage, interoperability, and property taxation for local service delivery and public land management) of effective digital registry service provision. Data from 85 countries highlight vast differences and provide suggestions for strategic reforms as well as a basis for measuring progress over time. Expanding geographical coverage and collecting these indicators on a regular basis could provide guidance to improve the way in which, by protecting property, the state creates the basis for widely shared prosperity and a livable environment.Publication Bridging the Gap(Washington, DC: World Bank, 2025-04-21)This paper examines tax revenue shortfalls in South Asian countries. On average during 2019–23, South Asian revenues totaled 18 percent of GDP—well below the average 24 percent among emerging market and developing economies (EMDEs). Econometric estimates from stochastic frontier analysis, which control for tax rates and the size of potential tax bases, suggest that tax revenues in the region are 1 to 7 percentage points of GDP below potential, with shortfalls in five of the region’s eight countries larger than in the average EMDE. Even after controlling for country characteristics, such as widespread informal economic activity outside the tax net and large agriculture sectors, sizable tax gaps remain, suggesting the need for improved tax policy and administration. The paper discusses and provides evidence from international experience with reforms to raise government revenues.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Are Mobile Savings the Silver Bullet to Help Women Grow Their Businesses?(World Bank, Washington, DC, 2018-09)In Tanzania and Indonesia, we promoted the expansion of mobile savings accounts among women micro-entrepreneurs and provided them with business related training. In doing so, we simultaneously relaxed supply- and demand side constraints to savings that women might face. In both countries, the training enhanced the impact of promoting mobile savings. In Indonesia it led women to save more overall, including a nascent use of mobile accounts, and report greater decision making power within the household. In Tanzania, it led to substantially higher mobile savings, new businesses and products, more capital investment, labor effort, and better business practices. However, these short-term impacts have yet to translate into higher business profits. In Indonesia, we observe increased household welfare, but no discernible effects on business outcomes shortly after the training ended. In Tanzania, the increased business investments were not accompanied by greater profitability.Publication Women's Empowerment, Sibling Rivalry, and Competitiveness(World Bank, Washington, DC, 2016-06)This study looks at how a community event—adolescent women's economic and social empowerment -- and a family factor -- sibling sex composition—interact in shaping gender differences in preferences for competition. To do so, a lab-in-the-field experiment is conducted using competitive games layered over the randomized rollout of a community program that empowered adolescent girls in Uganda. In contrast with the literature, the study finds no gender differences in competitiveness among adolescents, on average. It also finds no evidence of differences in competitiveness between girls in treatment and control communities, on average. However, in line with the literature, in control communities the study finds that boys surrounded by sisters are less competitive. Strikingly, this pattern is reversed in treatment communities, where boys surrounded by (empowered) sisters are more competitive.Publication Soft Skills for Hard Constraints(World Bank, Washington, DC, 2017-07)Most women farmers in developing countries engage in subsistence agriculture. Previous research highlights a variety of barriers hindering women’s ability to participate in the production and marketing of cash crops, which though riskier can be much more profitable. A study by the World Bank’s Africa Gender Innovation Lab, the Living Standards Measurement Study and Methods Team, and the National University of Singapore Business School, provides evidence that noncognitive entrepreneurial skills, such as the will to persevere, optimism, and passion for work play a decisive role – even more so in communities where women face greater constraints to their economic empowerment. Overall, the authors findings complement the growing literature in psychology and economics documenting the importance of noncognitive skills in determining important economic outcomes. For more information visit us at: http://www.worldbank.org/en/programs/africa-gender-innovation-lab.Publication Two Sides of Gender(World Bank, Washington, DC, 2022-06)Adolescents in Sub-Saharan Africa have some of the highest rates of intimate partner violence across the globe. This paper evaluates the impact of a randomized controlled trial that offers females a goal setting activity to improve their sexual and reproductive health outcomes and offers their male partners a soccer intervention, which educates and inspires young men to make better sexual and reproductive health choices. Both interventions reduce female reports of intimate partner violence. Impacts are larger among females who were already sexually active at baseline. The paper develops a game theoretic model to understand the mechanisms at play. In line with the model, the soccer intervention improves male attitudes around violence and sexual and reproductive health and reduces sexual activity. In the goal setting arm, females take more control of their sexual and reproductive health by exiting violent relationships. Females in this arm have higher quality partners at endline.Publication Breaking the Metal Ceiling(World Bank, Washington, DC, 2015-12)A range of reasons is cited to explain gender differences in business performance in Africa. Within those, the sector of operations is consistently identified as a major issue. This paper uses a mixed methods approach to assess how women entrepreneurs in Uganda start (and strive) operating firms in male-dominated sectors, and what hinders other women from doing so. The study finds that women who cross over into male-dominated sectors make as much as men, and three times more than women who stay in female-dominated sectors. The paper examines a set of factors to explain the differences in sector choices, and finds that there is a problem of information about opportunities in male-dominated industries. The analysis also concludes that psychosocial factors, particularly the influence of male role models and exposure to the sector from family and friends, are critical in helping women circumvent or overcome the norms that undergird occupational segregation.
Users also downloaded
Showing related downloaded files
Publication Is US Trade Policy Reshaping Global Supply Chains ?(World Bank, Washington, DC, 2023-11-01)This paper examines the reshaping of supply chains using detailed US 10-digit import data (tariff-line level) between 2017 and 2022. The results show that while US-China decoupling in bilateral trade is real, supply chains remain intertwined with China. Over the period, China’s share of US imports fell from 22 to 16 percent. The paper shows that the decline is due to US tariffs. US imports from China are being replaced with imports from large developing countries with revealed comparative advantage in a product. Countries replacing China tend to be deeply integrated into China’s supply chains and are experiencing faster import growth from China, especially in strategic industries. Put differently, to displace China on the export side, countries must embrace China’s supply chains. Within products, the reorientation of trade is consistent with a “China + 1” strategy, as opposed to diversified sourcing across multiple countries. There is some evidence of nearshoring, but it is exclusive to border nations, and there is no consistent evidence of reshoring. Despite the significant reshaping, China remained the top supplier of imported goods to the US in 2022.Publication The Macroeconomy After Tariffs(Published by Oxford University Press on behalf of the World Bank, 2021-08-23)What does the macroeconomy look like in the aftermath of tariff changes This study estimates impulse response functions from local projections using a panel of annual data that spans 151 countries from 1963 to 2014. Tariff increases are associated with persistent, economically and statistically significant declines in domestic output and productivity, as well as higher unemployment and inequality, real exchange rate appreciation, and insignificant changes to the trade balance. Output and productivity impacts are magnified when tariffs rise during expansions and when they are imposed by more advanced or smaller (as opposed to developing or larger) economies; effects are asymmetric, being larger when tariffs go up than when they fall. While firmly establishing causality is always a challenge, the results are robust to a large number of perturbations to the baseline methodology, and they hold using both macroeconomic and industry-level data.Publication World Development Report 2014(Washington, DC, 2013-10-06)The past 25 years have witnessed unprecedented changes around the world—many of them for the better. Across the continents, many countries have embarked on a path of international integration, economic reform, technological modernization, and democratic participation. As a result, economies that had been stagnant for decades are growing, people whose families had suffered deprivation for generations are escaping poverty, and hundreds of millions are enjoying the benefits of improved living standards and scientific and cultural sharing across nations. As the world changes, a host of opportunities arise constantly. With them, however, appear old and new risks, from the possibility of job loss and disease to the potential for social unrest and environmental damage. If ignored, these risks can turn into crises that reverse hard-won gains and endanger the social and economic reforms that produced these gains. The World Development Report 2014 (WDR 2014), Risk and Opportunity: Managing Risk for Development, contends that the solution is not to reject change in order to avoid risk but to prepare for the opportunities and risks that change entails. Managing risks responsibly and effectively has the potential to bring about security and a means of progress for people in developing countries and beyond. Although individuals’ own efforts, initiative, and responsibility are essential for managing risk, their success will be limited without a supportive social environment—especially when risks are large or systemic in nature. The WDR 2014 argues that people can successfully confront risks that are beyond their means by sharing their risk management with others. This can be done through naturally occurring social and economic systems that enable people to overcome the obstacles that individuals and groups face, including lack of resources and information, cognitive and behavioral failures, missing markets and public goods, and social externalities and exclusion. These systems—from the household and the community to the state and the international community—have the potential to support people’s risk management in different yet complementary ways. The Report focuses on some of the most pressing questions policy makers are asking. What role should the state take in helping people manage risks? When should this role consist of direct interventions, and when should it consist of providing an enabling environment? How can governments improve their own risk management, and what happens when they fail or lack capacity, as in many fragile and conflict-affected states? Through what mechanisms can risk management be mainstreamed into the development agenda? And how can collective action failures to manage systemic risks be addressed, especially those with irreversible consequences? The WDR 2014 provides policy makers with insights and recommendations to address these difficult questions. It should serve to guide the dialogue, operations, and contributions from key development actors—from civil society and national governments to the donor community and international development organizations.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.