Publication: Measuring Firm-Level Innovation Using Short Questionnaires: Evidence from an Experiment
Loading...
Published
2016-06
ISSN
Date
2016-06-14
Author(s)
Muzi, Silvia
Editor(s)
Abstract
Little is known about innovation in developing countries, partly because of the lack of comparable and reliable data. Collecting data on firm-level innovation is challenging because of the subjective definition of what determines an innovation, a problem that is exacerbated in developing countries where innovation is likely to be more incremental and less radical. This paper contributes to the literature by presenting the results of an experiment aiming to identify the survey instrument that better captures firm-level innovation in developing countries. The paper shows that a small set of questions included in a multi-topic, firm-level survey does not provide an accurate picture of firm-level innovation and tends to overestimate innovation rates. Issues related to framing explain some of the unreliability of innovation responses, while cognitive problems do not appear to play a significant role.
Link to Data Set
Citation
“Muzi, Silvia; Cirera, Xavier. 2016. Measuring Firm-Level Innovation Using Short Questionnaires: Evidence from an Experiment. Policy Research Working Paper;No. 7696. © World Bank. http://hdl.handle.net/10986/24531 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication Engineering Ukraine’s Wirtschaftswunder(Washington, DC: World Bank, 2025-07-29)As Ukraine emerges from the devastation of war, it faces a historic opportunity to engineer its own Wirtschaftswunder—a productivity-driven economic transformation akin to post-war West Germany. While investment-led growth may offer quick wins, it is efficiency, innovation, and institutional reform that will determine Ukraine’s long-term economic trajectory. Drawing on rich micro-level firm data spanning 25 years, this paper uncovers deep structural distortions that have suppressed creative destruction and productivity in Ukraine. It finds that business dynamism is on the decline, alongside rising market concentration among incumbent businesses, including low productivity state owned enterprises. To inform priorities for reviving business dynamism, this study develops a model of creative destruction drawing on Acemoglu et al. (2018) and Akcigit et al. (2021). The quantitative assessment highlights that policies that discipline entrenched incumbents are the bedrock for reviving business dynamism and engineer Ukraine’s Wirtschaftswunder. Policies targeting specific types of firms have limited efficacy when incumbents run wild.Publication Fiscal Multipliers in Resource-Rich Economies: Evidence from the Gulf Countries(Washington, DC: World Bank, 2025-08-21)This paper utilizes the unique dynamics of fiscal budgeting in countries with a large hydro-carbon sector to estimate fiscal multipliers. The main identifying assumption rests on the idea that exogenously identified global hydrocarbon demand shocks can be considered plausible instruments for the fiscal space of countries in which that space is significantly dictated by hydrocarbon income, with such shocks being uncorrelated with non-hydrocarbon output at the same time. Using a local projection-instrumental variables (LP-IV) framework, the paper estimates that short-run fiscal expenditure multipliers to be in the ballpark of 0.1–0.4. In addition, the findings show that multipliers are at the upper end of this interval during recessions, indicating that fiscal policy in the Gulf countries is particularly effective during economic downturns.Publication Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail(Washington, DC: World Bank, 2025-08-21)Accurate and timely poverty measurement is central to development policy, yet the availability of up-to-date high-quality household survey data remains limited—particularly in countries where poverty is most concentrated. Survey-to-survey imputation has emerged as a practical response to this challenge, allowing practitioners to update poverty estimates using recent surveys that lack direct welfare measures by borrowing information from other comprehensive surveys. A critical review of the method is provided, revisiting its statistical underpinnings and testing its limitations through extensive model-based simulations. Through these simulations, the analysis demonstrates how violations of parameter stability, omitted variable bias, and shifts in survey design can introduce substantial errors—particularly when imputing across time or under economic and structural change. Results show that standard corrections such as re-weighting or covariate standardization may fail to eliminate these biases, especially when imputing across time or under structural change. The performance of alternative model specifications is also evaluated under various methods, including performance under heteroskedastic errors, non-normality. The findings offer practical guidance for practitioners on when survey-to-survey imputation is likely to succeed, when it should be reconsidered, and how to communicate its limitations transparently in the context of poverty monitoring and policy design.Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Catching Up to the Technological Frontier?(World Bank Group, Washington, DC, 2015-03-06)Kenya s economy has undergone a significant process of structural transformation over the last decade. Since 2002, the economy has shown an accelerating trend with GDP growth increasing steadily from below 1 percent in 2002 to 7 percent in 2007. After a slowdown in GDP growth to 1.5 percent and 2.7 percent in 2008 and 2009 respectively, economic growth started to rebound in 2010. Amidst this positive growth context, in October 2013, the Kenyan Government launched the Second Medium-Term Plan (MTP-2) of the Vision 2030. The aim of Kenya s Vision 2030 is to create a globally competitive and prosperous country with a high quality of life by 2030 and to shift the country s status to upper-middle income level.Publication Human Capital and University-Industry Linkages' Role in Fostering Firm Innovation : An Empirical Study of Chile and Colombia(World Bank, Washington, DC, 2007-12)A firm's absorptive capacity, human capital and linkages with knowledge institutions have been shown to increase the firm's probability of innovating in OECD economies. Despite its importance for national- and firm-level competitiveness, few papers examine the impact of the same variables for firms innovation in Latin America. This paper investigates the link between firm innovation and its absorption capacity as proxied by the presence of a R&D department, the firm's human capital, and its interaction with research centers and universities. We analyze the case of Chilean and Colombian manufacturing firms using data from innovation surveys. A probit regression model is applied to identify the determinants of innovation activity. We find that collaboration with university and research institutions is associated with an increase in the probability of introducing a new product in Chilean and Colombian firms of 29 and 44 percent, respectively, and it can increase up to 58 percent in the case of Colombian firms interacting with research centers. Moreover, firms whose employees have a higher level of education, or whose managers/supervisors have a higher (perceived) level of knowledge, are more likely to innovate. Although the estimates could be affected by biases and suffer from shortcomings in data, the findings suggest that policies and incentives to increase firm-level human capital and industry-university linkages are important to increase innovation in Latin America.Publication Innovative Firms or Innovative Owners? Determinants of Innovation in Micro, Small, and Medium Enterprises(2009-05-01)Innovation is key to technology adoption and creation, and to explaining the vast differences in productivity across and within countries. Despite the central role of the entrepreneur in the innovation process, data limitations have restricted standard analysis of the determinants of innovation to consideration of the role of firm characteristics. The authors develop a model of innovation that incorporates the role of both owner and firm characteristics, and use this to determine how product, process, marketing, and organizational innovations should vary with firm size and competition. They then use a new, large, representative survey from Sri Lanka to test this model and to examine whether and how owner characteristics matter for innovation. The survey also allows analysis of the incidence of innovation in micro and small firms, which have traditionally been overlooked in the study of innovation, despite these firms comprising the majority of firms in developing countries. The analysis finds that more than one-quarter of the microenterprises are engaging in innovation, with marketing innovations the most common. As predicted by the model, firm size has a stronger positive effect, and competition a stronger negative effect, on process and organizational innovations than on product innovations. Owner ability, personality traits, and ethnicity have a significant and substantial impact on the likelihood of a firm innovating, confirming the importance of the entrepreneur in the innovation process.Publication Chile(Washington, DC, 2008)Chile is increasingly looking to innovation as a pillar of its competitiveness and an engine of growth to close the income gap with the Organization for Economic Cooperation and Development (OECD) economies. The country has doubled its per capita income since the 1990s. The growth slowdown in the late 1990s and early 2000s, however, raised concerns about that the old sources of growth. While the rate of growth has picked up again, spurred by a favorable external environment, there is an increased awareness of the importance of innovation to growth and a desire to move toward a more diversified and knowledge-based economy, following the example of other successful resource-rich economies such as Australia and Finland. Higher government commitments to innovation have raised new challenges. The remaining of the report is structured as follows. Chapter two discusses the importance of innovation to Chile's economy and highlights the need to define innovation policy within a comprehensive framework that encompasses the entire production system. Chapter three organizes thinking around some basic governance principles for innovation systems drawing form the public governance literature, the broader innovation literature, and international experiences. Chapter four applies those principles to Chile's public institutions and agents that will be responsible for defining and implementing innovation policies. Chapter five examines the rationale and guiding principles of regional innovation policies and offers recommendations for Chile's regional innovation systems and their governance framework. Chapter six summarizes the main conclusions.Publication Commercialization of Publicly Funded Research and Development in Russia : Scaling up the Emergence of Spinoff Companies(World Bank, Washington, DC, 2012-11)This paper explores fundamental issues affecting technology commercialization of publicly funded research and development (R&D) in the Russian Federation. Despite substantial R&D investments, Russia has experienced a decline in scientific output and employment. Nevertheless, the innovation system remains strong in several technological fields. This paper develops an analytical framework to discuss conditions for technology commercialization, which hinge on the innovation system research base, governance of research institutions, alignment between specialization and sector prioritization, availability and performance of scientists and engineers, intellectual property (IP) regime for publicly funded discoveries, and early stage finance. The paper identifies areas for policy and regulatory improvement to incentivize research institutes and scientists to undertake research with market potential. These include: stronger results-based management that rewards commercialization efforts and focuses not only on high-technology sectors, but also on sectors where Russia has technological comparative advantages. In addition, researchers' career development could consider performance metrics that include entrepreneurial achievements, as well as support for young scientists and for international collaboration. Moreover, the IP regime for federally funded R&D may consider transferring full ownership of research discoveries to research organizations. Finally, to increase deal-flow of new ventures, enhancing the supply of early-stage financing for new technologies may be considered.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication Global Economic Prospects, January 2025(Washington, DC: World Bank, 2025-01-16)Global growth is expected to hold steady at 2.7 percent in 2025-26. However, the global economy appears to be settling at a low growth rate that will be insufficient to foster sustained economic development—with the possibility of further headwinds from heightened policy uncertainty and adverse trade policy shifts, geopolitical tensions, persistent inflation, and climate-related natural disasters. Against this backdrop, emerging market and developing economies are set to enter the second quarter of the twenty-first century with per capita incomes on a trajectory that implies substantially slower catch-up toward advanced-economy living standards than they previously experienced. Without course corrections, most low-income countries are unlikely to graduate to middle-income status by the middle of the century. Policy action at both global and national levels is needed to foster a more favorable external environment, enhance macroeconomic stability, reduce structural constraints, address the effects of climate change, and thus accelerate long-term growth and development.Publication The Container Port Performance Index 2023(Washington, DC: World Bank, 2024-07-18)The Container Port Performance Index (CPPI) measures the time container ships spend in port, making it an important point of reference for stakeholders in the global economy. These stakeholders include port authorities and operators, national governments, supranational organizations, development agencies, and other public and private players in trade and logistics. The index highlights where vessel time in container ports could be improved. Streamlining these processes would benefit all parties involved, including shipping lines, national governments, and consumers. This fourth edition of the CPPI relies on data from 405 container ports with at least 24 container ship port calls in the calendar year 2023. As in earlier editions of the CPPI, the ranking employs two different methodological approaches: an administrative (technical) approach and a statistical approach (using matrix factorization). Combining these two approaches ensures that the overall ranking of container ports reflects actual port performance as closely as possible while also being statistically robust. The CPPI methodology assesses the sequential steps of a container ship port call. ‘Total port hours’ refers to the total time elapsed from the moment a ship arrives at the port until the vessel leaves the berth after completing its cargo operations. The CPPI uses time as an indicator because time is very important to shipping lines, ports, and the entire logistics chain. However, time, as captured by the CPPI, is not the only way to measure port efficiency, so it does not tell the entire story of a port’s performance. Factors that can influence the time vessels spend in ports can be location-specific and under the port’s control (endogenous) or external and beyond the control of the port (exogenous). The CPPI measures time spent in container ports, strictly based on quantitative data only, which do not reveal the underlying factors or root causes of extended port times. A detailed port-specific diagnostic would be required to assess the contribution of underlying factors to the time a vessel spends in port. A very low ranking or a significant change in ranking may warrant special attention, for which the World Bank generally recommends a detailed diagnostic.Publication Digital Progress and Trends Report 2023(Washington, DC: World Bank, 2024-03-05)Digitalization is the transformational opportunity of our time. The digital sector has become a powerhouse of innovation, economic growth, and job creation. Value added in the IT services sector grew at 8 percent annually during 2000–22, nearly twice as fast as the global economy. Employment growth in IT services reached 7 percent annually, six times higher than total employment growth. The diffusion and adoption of digital technologies are just as critical as their invention. Digital uptake has accelerated since the COVID-19 pandemic, with 1.5 billion new internet users added from 2018 to 2022. The share of firms investing in digital solutions around the world has more than doubled from 2020 to 2022. Low-income countries, vulnerable populations, and small firms, however, have been falling behind, while transformative digital innovations such as artificial intelligence (AI) have been accelerating in higher-income countries. Although more than 90 percent of the population in high-income countries was online in 2022, only one in four people in low-income countries used the internet, and the speed of their connection was typically only a small fraction of that in wealthier countries. As businesses in technologically advanced countries integrate generative AI into their products and services, less than half of the businesses in many low- and middle-income countries have an internet connection. The growing digital divide is exacerbating the poverty and productivity gaps between richer and poorer economies. The Digital Progress and Trends Report series will track global digitalization progress and highlight policy trends, debates, and implications for low- and middle-income countries. The series adds to the global efforts to study the progress and trends of digitalization in two main ways: · By compiling, curating, and analyzing data from diverse sources to present a comprehensive picture of digitalization in low- and middle-income countries, including in-depth analyses on understudied topics. · By developing insights on policy opportunities, challenges, and debates and reflecting the perspectives of various stakeholders and the World Bank’s operational experiences. This report, the first in the series, aims to inform evidence-based policy making and motivate action among internal and external audiences and stakeholders. The report will bring global attention to high-performing countries that have valuable experience to share as well as to areas where efforts will need to be redoubled.