Publication: Design of Partial Population Experiments with an Application to Spillovers in Tax Compliance
Loading...
Date
2025-02-07
ISSN
Published
2025-02-07
Editor(s)
Abstract
This paper develops a framework to analyze partial population experiments, a generalization of the cluster experimental design where clusters are assigned to different treatment intensities. The framework allows for heterogeneity in cluster sizes and outcome distributions. The paper studies the large-sample behavior of OLS estimators and cluster-robust variance estimators and shows that (i) ignoring cluster heterogeneity may result in severely underpowered experiments and (ii) the cluster-robust variance estimator may be upward-biased when clusters are heterogeneous. The paper derives formulas for power, minimum detectable effects, and optimal cluster assignment probabilities. All the results apply to cluster experiments, a particular case of the framework. The paper sets up a potential outcomes framework to interpret the OLS estimands as causal effects. It implements the methods in a large-scale experiment to estimate the direct and spillover effects of a communication campaign on property tax compliance. The analysis reveals an increase in tax compliance among individuals directly targeted with the mailing, as well as compliance spillovers on untreated individuals in clusters with a high proportion of treated taxpayers.
Link to Data Set
Citation
“Cruces, Guillermo; Tortarolo, Dario; Vazquez-Bare, Gonzalo. 2025. Design of Partial Population Experiments with an Application to Spillovers in Tax Compliance. Policy Research Working Paper; 11059. © World Bank. http://hdl.handle.net/10986/42775 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication Chinese Imports and Industrialization in Africa(Washington, DC: World Bank, 2025-05-12)The rise of China in the global economy has been linked with negative impacts on employment across many high- and middle-income countries. However, evidence for African countries is limited. This paper investigates the causal relationship between Chinese imports and manufacturing employment in Ethiopia. Imports may harm domestic firms through a revenue effect (lower market shares) or benefit them, indirectly if competition spurs innovation or directly through access to better quality or cheaper inputs. The analysis shows that a one unit increase in import penetration leads to a 15.2 percent increase in industry employment. The inputs effect is disentangled from the other two effects by decomposing total Chinese imports by their end-use category using input-output tables. The evidence shows that imported intermediate inputs are driving the employment gains. The findings are consistent with the idea that employment gains are a result of productivity gains and increases in capacity utilization. These employment gains appear to benefit large firms and labor-intensive industries disproportionately.Publication VAT Exemptions, Embedded Tax, and Unintended Consequences(Washington, DC: World Bank, 2025-05-15)The value-added tax (VAT) has proved to be a highly effective tool at raising revenue in developed and developing countries alike. However, the effective operation of the VAT breaks down in the presence of exemptions. Unlike zero rates, exemptions deny input tax credits, thereby increasing production costs and resulting in VAT being embedded within the prices of goods and services. This paper develops a VAT model based on input-output table and household budget survey data for 29 European countries to examine the effects of VAT exemptions on final prices and to assess the merits of their use. Simulation results show that exemptions suffer from the same targeting problems as reduced VAT rates, but, in addition, they are non-transparent and have unpredictable and counterproductive indirect effects. These effects are in addition to the well-known distortionary impact of exemptions on production decisions, and their creation of incentives to self-supply. The paper concludes that the use of exemptions should be limited to addressing pragmatic concerns, such as the disproportionate compliance costs of small businesses and the practical difficulty in taxing margin-based financial services.Publication Disentangling the Key Economic Channels through Which Infrastructure Affects Jobs(Washington, DC: World Bank, 2025-04-03)This paper takes stock of the literature on infrastructure and jobs published since the early 2000s, using a conceptual framework to identify the key channels through which different types of infrastructure impact jobs. Where relevant, it highlights the different approaches and findings in the cases of energy, digital, and transport infrastructure. Overall, the literature review provides strong evidence of infrastructure’s positive impact on employment, particularly for women. In the case of electricity, this impact arises from freeing time that would otherwise be spent on household tasks. Similarly, digital infrastructure, particularly mobile phone coverage, has demonstrated positive labor market effects, often driven by private sector investments rather than large public expenditures, which are typically required for other large-scale infrastructure projects. The evidence on structural transformation is also positive, with some notable exceptions, such as studies that find no significant impact on structural transformation in rural India in the cases of electricity and roads. Even with better market connections, remote areas may continue to lack economic opportunities, due to the absence of agglomeration economies and complementary inputs such as human capital. Accordingly, reducing transport costs alone may not be sufficient to drive economic transformation in rural areas. The spatial dimension of transformation is particularly relevant for transport, both internationally—by enhancing trade integration—and within countries, where economic development tends to drive firms and jobs toward urban centers, benefitting from economies scale and network effects. Turning to organizational transformation, evidence on skill bias in developing countries is more mixed than in developed countries and may vary considerably by context. Further research, especially on the possible reasons explaining the differences between developed and developing economies, is needed.Publication Economic Consequences of Trade and Global Value Chain Integration(World Bank, Washington, DC, 2025-04-04)This paper introduces a new approach to measuring Global Value Chains (GVC), crucial for informed policy-making. It features a tripartite classification (backward, forward, and two-sided) covering trade and production data. The findings indicate that traditional trade-based GVC metrics significantly underestimate global GVC activity, especially in sectors like services and upstream manufacturing, and overstate risks in early trade liberalization stages. Additionally, conventional backward-forward classifications over-estimate backward linkages. The paper further applies these measures empirically to assess how GVC participation mediates the impact of demand shocks on domestic output, highlighting both the exposure and stabilizing potential of GVC integration. These new measures are comprehensively available on the World Bank’s WITS Platform, providing a key resource for GVC analysis.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Exploring the Gender Divide in Real Estate Ownership and Property Tax Compliance(Washington, DC: World Bank, 2025-02-07)This paper investigates gender disparities in residential property ownership and tax compliance in a large Argentine municipality using detailed tax administrative data. While ownership is evenly distributed between women, men, and co-owned properties up to the 40th percentile of the value distribution, higher-value properties exhibit significant gender disparities, with women’s share dropping to less than 20% in the top 1%. Tax compliance increases with property value, with an average evasion rate of 46%, and men and women are equally likely to meet their tax obligations across the distribution. However, women face slightly higher effective tax rates due to owning lower-value properties, which are disproportionately affected by a mildly regressive tax schedule. Gender responses to enforcement measures are also comparable. A soft randomized communication campaign significantly increased timely payments equally for both men and women, with men responding more quickly. Similarly, the findings show no gender-based differences in responses to macroeconomic shocks such as COVID-19. The study underscores the role of property tax in promoting equitable revenue mobilization and highlights the importance of gender-disaggregated data for informing tax policy and enforcement strategies.Publication Conducting Ethical Economic Research : Complications from the Field(World Bank, Washington, DC, 2013-05)This essay discusses practical issues confronted when conducting surveys as well as designing appropriate field trials. First, it looks at the challenge of ensuring transparency while maintaining confidentiality. Second, it explores the role of trust in light of asymmetric information held by the surveyor and by the respondents as well as the latter's expectations as to what their participation will set in motion. The authors present case studies relevant to both of these issues. Finally, they discuss the role of ethical review from the perspective of research conducted through the World Bank.Publication Micro-Level Estimation of Welfare(World Bank, Washington, DC, 2002-10)The authors construct and derive the properties of estimators of welfare that take advantage of the detailed information about living standards available in small household surveys and the comprehensive coverage of a census or large sample. By combining the strengths of each, the estimators can be used at a remarkably disaggregated level. They have a clear interpretation, are mutually comparable, and can be assessed for reliability using standard statistical theory. Using data from Ecuador, the authors obtain estimates of welfare measures, some of which are quite reliable for populations as small as 15,000 households--a "town." They provide simple illustrations of their use. Such estimates open up the possibility of testing, at a more convincing intra-country level, the many recent models relating welfare distributions to growth and a variety of socioeconomic and political outcomes.Publication Large Country-Lot Quality Assurance Sampling : A New Method for Rapid Monitoring and Evaluation of Health, Nutrition and Population Programs at Sub-National Levels(World Bank, Washington, DC, 2008-05)Sampling theory facilitates development of economical, effective and rapid measurement of a population. While national policy maker value survey results measuring indicators representative of a large area (a country, state or province), measurement in smaller areas produces information useful for managers at the local level. It is often not possible to disaggregate a national survey to obtain local information if that was not the intent of the original survey design. Cluster sampling is typically used for national or large area surveys because sampling in clusters lowers the cost of a survey. Lot Quality Assurance Sampling (LQAS) is used to measure results at a local level, since it requires small random samples and produces results useful to local managers. However, current LQAS methodology requires all local areas (strata) be included in the survey in order to be aggregated to produce point estimates for the nation or state. In large countries it is not feasible to sample all strata for logistical and financial reasons. This paper resolves this problem by presenting Large Country (LC)-LQAS, a method with two concurrent objectives: 1) provide local managers with accurate local information to enable data driven decisions, and 2) provide central policy makers with the aggregate information they require. These are achieved by integrating cluster sampling with LQAS methodologies. Two examples of the implementation of LC-LQAS are provided, in an HIV/AIDS program in Kenya and a Malaria Booster Project in Nigeria. Classifications of local health units into performance categories and aggregate estimates of coverage, with associated confidence intervals, are provided for select indicators in order to demonstrate its use, analysis, and costs. This paper is written as a manual to support the use of LC-LQAS by others.Publication Brazil within Brazil : Testing the Poverty Map Methodology in Minas Gerais(World Bank, Washington, DC, 2008-02)The small-area estimation technique developed for producing poverty maps has been applied in a large number of developing countries. Opportunities to formally test the validity of this approach remain rare due to lack of appropriately detailed data. This paper compares a set of predicted welfare estimates based on this methodology against their true values, in a setting where these true values are known. A recent study draws on Monte Carlo evidence to warn that the small-area estimation methodology could significantly over-state the precision of local-level estimates of poverty, if underlying assumptions of spatial homogeneity do not hold. Despite these concerns, the findings in this paper for the state of Minas Gerais, Brazil, indicate that the small-area estimation approach is able to produce estimates of welfare that line up quite closely to their true values. Although the setting considered here would seem, a priori, unlikely to meet the homogeneity conditions that have been argued to be essential for the method, confidence intervals for the poverty estimates also appear to be appropriate. However, this latter conclusion holds only after carefully controlling for community-level factors that are correlated with household level welfare.
Users also downloaded
Showing related downloaded files
Publication State of Social Protection Report 2025(Washington, DC: World Bank, 2025-04-07)Social protection goes well beyond cash transfers; it includes policies and programs that bridge skill, financial, and information gaps, aiding people in securing better jobs. The three pillars of social protection—social assistance, social insurance, and labor market programs—support households and workers in handling crises, escaping poverty, facing transitions, and seizing employment opportunities. But despite a substantial expansion over the past decade, 2 billion people remain uncovered or inadequately covered across low- and middle-income countries. Drawing from administrative and household survey data from the World Bank’s Atlas of Social Protection Indicators of Resilience and Equity (ASPIRE), the "State of Social Protection Report 2025: The 2-Billion-Person Challenge" documents advances and challenges to strengthening social protection and labor systems across low- and middle-income countries, analyzing the evolution of expenditure, coverage, and adequacy of support. This report details four policy action areas governments can embrace to maximize the benefits of adequate social protection for all: extending social protection to those in need; strengthening the adequacy of social protection support; building shock-proof social protection systems; and optimizing social protection financing. The report discusses how the path of reforms will depend on country context, capacity, and fiscal space. The rising frequency of shocks and crises calls for major investments in the adaptability and preparedness of social protection and labor systems. Amid a world in transition, social protection is more important and necessary than ever.Publication Manual de Analítica Gubernamental(Washington, DC: World Bank, 2024-11-26)El Manual de Analítica Gubernamental (Government Analytics Handbook) presenta evidencia innovadora e ideas de profesionales sobre cómo aprovechar los datos para fortalecer la administración pública. Abarca una amplia gama de fuentes de microdatos —como datos administrativos y encuestas de empleados públicos—, así como herramientas y recursos para realizar los análisis, para transformar la capacidad de los gobiernos para adoptar un enfoque basado en datos para diagnosticar y mejorar el funcionamiento de las organizaciones públicas. Esta versión ha sido traducida por el Centro Latinoamericano de Administración para el Desarrollo (CLAD) y contiene una selección de siete capítulos que abordan temas fundamentales para América América Latina y el Caribe.Publication Latin America and the Caribbean Economic Review, October 2024: Taxing Wealth for Equity and Growth(Washington, DC: World Bank, 2024-10-09)The report highlights the progress made on inflation and, despite some resistance in the last mile, the resulting fall in interest rates that will ease pressures on debt service and investment. However, growth is projected to remain low, debt remains high, private and public investment is depressed, and the region appears to be missing the boat on nearshoring FDI. The need to generate more fiscal space, reduce the high corporate tax burden, and mitigate persistent inequality have moved wealth taxes to center stage. But traditional wealth taxes on financial assets face challenges due to the ease of moving and hiding assets which will be difficult to control without elusive global coordination. A viable alternative is a tax on real estate which is less mobile, easier to track, and less of a distortionary burden on economic activity, given the low initial rates. Property taxes also have the potential to reduce the excessive dependence of subnational governments on federal transfers. For property taxes to play a greater role, there must be improvements in property valuation which can be engineered through the use of digital platforms and centralized land registries.Publication Financial Deepening and Carbon Emissions Intensity(Washington, DC: World Bank, 2024-10-16)Financial deepening contributes to economic development, but its effect on the carbon intensity of production is an open empirical question. If banks finance investments in new, greener technologies, they can contribute to lowering carbon dioxide emissions per unit of output. But if they finance investments in more traditional, carbon-intensive technologies, they can contribute to increasing carbon dioxide emissions per unit of output. This paper studies the impact of financial deepening—an increased provision of bank credit as a share of gross domestic product—on carbon dioxide emissions per dollar of gross domestic product in a global sample of 125 economies from 1990 to 2019. Using a local projections approach, the paper finds that, on average, financial deepening leads to a relative increase in carbon dioxide emissions per dollar of gross domestic product, indicating that financial institutions finance relatively more carbon-intensive investments and consumption. However, a better institutional environment mitigates this adverse effect of financial deepening: conditional local projections reveal that in countries with more environmental regulations, a stronger rule of law, and a financial system that is relatively more market- than bank-based, financial deepening does not lead to higher carbon dioxide emissions per dollar of gross domestic product. Specifically, the results show that countries with an initially lower carbon intensity of production can mitigate the average adverse effect of financial deepening on carbon dioxide emissions per dollar of gross domestic product by improving their general institutional environment proxied by adherence to the rule of law, and, to some extent, by developing their financial markets. By contrast, countries with an initially higher carbon intensity of production are better off focusing on environmental regulations to mitigate the unconditional adverse effect of financial deepening on carbon dioxide emissions per dollar of gross domestic product.Publication Understanding Income Security for Older Adults - Rethink Social Protection and Jobs in an Actively Aging World(Washington, DC: World Bank, 2025-01-14)The note first discusses the main pillars of financial securityat older ages before focusing on the status of contributory and noncontributory (orsocial) pension systems in developing countries. It highlights worrying under-coverage ofcontributory pension systems in the face of persistent labor market informality, as well asthe rise of social pensions and innovative informal sector matching schemes in response,and the trade-offs between coverage, adequacy and sustainability of pension systems. Itthen reviews World Bank support on the old age financial protection agenda, includingdifferent forms of budget support and investment lending, policy advisory and analyticalwork, capacity building and technical assistance (TA), and convening. It concludes bynoting the need to broaden the policy dialogue to wider dimensions of old age financialwell-being, as well as innovating with public sector and market instruments which candiversify sources of financial security at older ages.