Publication: Design of Partial Population Experiments with an Application to Spillovers in Tax Compliance
Loading...
Published
2025-02-07
ISSN
Date
2025-02-07
Editor(s)
Abstract
This paper develops a framework to analyze partial population experiments, a generalization of the cluster experimental design where clusters are assigned to different treatment intensities. The framework allows for heterogeneity in cluster sizes and outcome distributions. The paper studies the large-sample behavior of OLS estimators and cluster-robust variance estimators and shows that (i) ignoring cluster heterogeneity may result in severely underpowered experiments and (ii) the cluster-robust variance estimator may be upward-biased when clusters are heterogeneous. The paper derives formulas for power, minimum detectable effects, and optimal cluster assignment probabilities. All the results apply to cluster experiments, a particular case of the framework. The paper sets up a potential outcomes framework to interpret the OLS estimands as causal effects. It implements the methods in a large-scale experiment to estimate the direct and spillover effects of a communication campaign on property tax compliance. The analysis reveals an increase in tax compliance among individuals directly targeted with the mailing, as well as compliance spillovers on untreated individuals in clusters with a high proportion of treated taxpayers.
Link to Data Set
Citation
“Cruces, Guillermo; Tortarolo, Dario; Vazquez-Bare, Gonzalo. 2025. Design of Partial Population Experiments with an Application to Spillovers in Tax Compliance. Policy Research Working Paper; 11059. © World Bank. http://hdl.handle.net/10986/42775 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Exploring the Gender Divide in Real Estate Ownership and Property Tax Compliance(Washington, DC: World Bank, 2025-02-07)This paper investigates gender disparities in residential property ownership and tax compliance in a large Argentine municipality using detailed tax administrative data. While ownership is evenly distributed between women, men, and co-owned properties up to the 40th percentile of the value distribution, higher-value properties exhibit significant gender disparities, with women’s share dropping to less than 20% in the top 1%. Tax compliance increases with property value, with an average evasion rate of 46%, and men and women are equally likely to meet their tax obligations across the distribution. However, women face slightly higher effective tax rates due to owning lower-value properties, which are disproportionately affected by a mildly regressive tax schedule. Gender responses to enforcement measures are also comparable. A soft randomized communication campaign significantly increased timely payments equally for both men and women, with men responding more quickly. Similarly, the findings show no gender-based differences in responses to macroeconomic shocks such as COVID-19. The study underscores the role of property tax in promoting equitable revenue mobilization and highlights the importance of gender-disaggregated data for informing tax policy and enforcement strategies.Publication Conducting Ethical Economic Research : Complications from the Field(World Bank, Washington, DC, 2013-05)This essay discusses practical issues confronted when conducting surveys as well as designing appropriate field trials. First, it looks at the challenge of ensuring transparency while maintaining confidentiality. Second, it explores the role of trust in light of asymmetric information held by the surveyor and by the respondents as well as the latter's expectations as to what their participation will set in motion. The authors present case studies relevant to both of these issues. Finally, they discuss the role of ethical review from the perspective of research conducted through the World Bank.Publication Micro-Level Estimation of Welfare(World Bank, Washington, DC, 2002-10)The authors construct and derive the properties of estimators of welfare that take advantage of the detailed information about living standards available in small household surveys and the comprehensive coverage of a census or large sample. By combining the strengths of each, the estimators can be used at a remarkably disaggregated level. They have a clear interpretation, are mutually comparable, and can be assessed for reliability using standard statistical theory. Using data from Ecuador, the authors obtain estimates of welfare measures, some of which are quite reliable for populations as small as 15,000 households--a "town." They provide simple illustrations of their use. Such estimates open up the possibility of testing, at a more convincing intra-country level, the many recent models relating welfare distributions to growth and a variety of socioeconomic and political outcomes.Publication Large Country-Lot Quality Assurance Sampling : A New Method for Rapid Monitoring and Evaluation of Health, Nutrition and Population Programs at Sub-National Levels(World Bank, Washington, DC, 2008-05)Sampling theory facilitates development of economical, effective and rapid measurement of a population. While national policy maker value survey results measuring indicators representative of a large area (a country, state or province), measurement in smaller areas produces information useful for managers at the local level. It is often not possible to disaggregate a national survey to obtain local information if that was not the intent of the original survey design. Cluster sampling is typically used for national or large area surveys because sampling in clusters lowers the cost of a survey. Lot Quality Assurance Sampling (LQAS) is used to measure results at a local level, since it requires small random samples and produces results useful to local managers. However, current LQAS methodology requires all local areas (strata) be included in the survey in order to be aggregated to produce point estimates for the nation or state. In large countries it is not feasible to sample all strata for logistical and financial reasons. This paper resolves this problem by presenting Large Country (LC)-LQAS, a method with two concurrent objectives: 1) provide local managers with accurate local information to enable data driven decisions, and 2) provide central policy makers with the aggregate information they require. These are achieved by integrating cluster sampling with LQAS methodologies. Two examples of the implementation of LC-LQAS are provided, in an HIV/AIDS program in Kenya and a Malaria Booster Project in Nigeria. Classifications of local health units into performance categories and aggregate estimates of coverage, with associated confidence intervals, are provided for select indicators in order to demonstrate its use, analysis, and costs. This paper is written as a manual to support the use of LC-LQAS by others.Publication Brazil within Brazil : Testing the Poverty Map Methodology in Minas Gerais(World Bank, Washington, DC, 2008-02)The small-area estimation technique developed for producing poverty maps has been applied in a large number of developing countries. Opportunities to formally test the validity of this approach remain rare due to lack of appropriately detailed data. This paper compares a set of predicted welfare estimates based on this methodology against their true values, in a setting where these true values are known. A recent study draws on Monte Carlo evidence to warn that the small-area estimation methodology could significantly over-state the precision of local-level estimates of poverty, if underlying assumptions of spatial homogeneity do not hold. Despite these concerns, the findings in this paper for the state of Minas Gerais, Brazil, indicate that the small-area estimation approach is able to produce estimates of welfare that line up quite closely to their true values. Although the setting considered here would seem, a priori, unlikely to meet the homogeneity conditions that have been argued to be essential for the method, confidence intervals for the poverty estimates also appear to be appropriate. However, this latter conclusion holds only after carefully controlling for community-level factors that are correlated with household level welfare.
Users also downloaded
Showing related downloaded files
Publication Senegal Country Climate and Development Report(Washington, DC: World Bank, 2024-11-05)Climate action offers an opportunity to safeguard development gains and accompany the ambitious transformation Senegal is embarking on to achieve its objective of reaching middle income status in the next decade. While the country was among the fastest growing economies in Sub-Saharan Africa (SSA), poverty reduction was slow, vulnerabilities persisted, and inequalities increased. In addition, overall productivity remained low, with lagging structural transformation, high informality, and low job creation. To attain its middle-income goal, Senegal must initiate a series of reforms for a productive, sustainable, and inclusive growth model, with climate considerations at the center given the country’s high vulnerability. Senegal’s high climate vulnerability is caused by the country’s coastal exposure and reliance on natural resources for food, jobs, and growth (partly a consequence of its slow structural transformation). With temperatures soaring, precipitation expected to decrease, and erosion threatening 75 percent of the coastline at term, Senegal’s population and assets are under high risk. The poorest are particularly vulnerable, with 55 percent of total households teetering on the edge of poverty because of recurrent shocks. Without action, annual economic losses could reach 3-4 percent of Gross Domestic Product (GDP) as soon as 2030 and further increase to 9.4 percent by 2050, wiping years of per capita income growth and eroding any potential human capital accumulation. Overall, climate change could push two more million Senegalese in poverty by mid-century. Building resilience and leveraging the low-carbon economy will help Senegal realizing its growth ambitions, contributing to a more productive, sustainable, and inclusive development pathway. The macro-economic analysis for this CCDR finds that adaptation measures in selected sectors could bring GDP gains of about 2 percent by 2030, and between 0.5 and 1 percent afterwards (for climate financing needs of about 0.9 percent of GDP in the period to 2030 and 0.1 percent afterwards). Adaptation could also reduce poverty headcount, with 40 percent less people pushed into poverty by climate change compared to no adaptation action. In addition, emission reductions could reach 20MtCO2e per year over the period to 2050, from interventions in forestry, improved cooking services, urban transport, waste management, and energy production. The energy transition provides an opportunity to meet both development and climate objectives, exceeding NDC targets and putting the country well on track for net zero by 2050, but significant downside risks remain, linked to delays in the deployment and financing availability for renewable generation and domestic gas. Senegal’s formidable renewable energy potential (chiefly around solar) offers the lowest cost generation option to meet rising energy demand while accelerating decarbonization. At term, the country could play a leading role in decarbonizing the region though export opportunities and bolster resilience across the regional grid. In the short term, given constraints to the fast deployment of renewables, the transitional use of domestic gas will help phase out expensive and high-emitting coal and Heavy Fuel Oil (HFO) generation, while balancing the electricity system and lowering the cost of electricity. Climate action will require a financing of US$8.2 billion over 2025-30 (in present value, at 6 percent per year), or 4.5 percent of discounted cumulative GDP over the same period, and US$10.6 billion over 2031-50 (in present value terms), or 2.0 percent of discounted cumulative GDP over the same period. Water security, sustainable (urban) transport, and the energy transition account for the largest share. Importantly, climate action is expected to bring significant benefits over time, beyond climate adaptation and mitigation – including health or jobs, (as in the primary sector, with 155,000 jobs created, of which 80 percent in agriculture). Many benefits could not be properly estimated, implying that the returns from climate action might well be underestimated.Publication Guinea-Bissau Country Climate and Development Report(Washington, DC: World Bank, 2024-10-23)Guinea-Bissau is endowed with a wealth of natural resources, with the highest natural capital per capita in West Africa (US3,874 dollars per capita), which could be leveraged for sustainable and resilient growth. However, Guinea-Bissau faces significant development hurdles, such as high poverty rates, political instability, and economic challenges, including an over-reliance on cashew nuts. Rural poverty has increased, and the nation's infrastructure, education, and health care systems are underdeveloped. Climate change poses a severe threat, potentially impacting agriculture, fisheries, and infrastructure. Without adaptation, it could lead to a significant cut in real GDP per capita (minus 7.3 percent by 2050) and increase in poverty (with up to over 200,000 additional poor by 2050, that is, 5 percent of the expected population, in the worst scenario). The country's low greenhouse gas emissions are expected to rise, mainly due to agriculture and land-use changes, with deforestation being a major contributing factor. Although Guinea-Bissau is a low emitter, it has high mitigation ambitions, targeting a 30 percent reduction in greenhouse gas emissions by 2030. The Nationally Determined Contribution outlines significant climate actions, with initiatives focused on forest conservation, sustainable agriculture, and community development. However, the country's political instability, institutional weaknesses, and limited financial resources pose challenges to implementing these climate commitments, which depend heavily on external funding. The financial sector's underdevelopment and vulnerability to external shocks limit its ability to support green investments, though reforms could enhance resilience. Guinea-Bissau must consider its climate financing as development financing and vice-versa, engage the private sector, and integrate climate goals with national development plans to ensure a sustainable future. Concessional climate financing is vital due to the underdeveloped financial sector and the government’s limited borrowing capacity. Addressing Guinea-Bissau's vulnerability to climate change and its structural issues requires a cohesive approach that integrates development and climate strategies. This could involve improving governance, diversifying the economy, protecting natural capital, developing human capital, and investing in sustainable agriculture and infrastructure. The transition to a more sustainable and inclusive development pathway that supports economic growth is possible, but requires focusing on key strategic sectors, enhancing institutional capacity, and creating the conditions to mobilize finance. As a highly vulnerable country, there are myriad needs in the different sectors; however, to be more efficient and effective, Guinea-Bissau should prioritize actions in a few sectors, especially actions on biodiversity, agriculture, and social protection. Low carbon development, especially in energy and forestry sectors, could provide cost-efficient solutions and attract climate finance, including from the private sector, which will support the overall development agenda.Publication Tajikistan Country Climate and Development Report(Washington, DC: World Bank, 2025-03-28)The Tajikistan Country Climate and Development Report (CCDR) explores the impact of climate change and global decarbonization on Tajikistan’s development. It identifies key areas to enhance climate resilience and deepen decarbonization and outlines priority recommendations for a successful green transition in Tajikistan, requiring structural reforms, climate-conscious policies, and inclusive strategies for a resilient and sustainable future. Despite economic growth and poverty reduction over the past two decades, Tajikistan's reliance on natural resources and remittances has led to unsustainable development, depleting natural capital and limiting job creation. The government’s green transition plan focuses on renewable energy, promising energy security, economic growth, and regional electricity exports. However, further efforts are needed for a resilient development path, including a complementary reform program to bring significant economic benefits, climate adaptation, and low-carbon development that will benefit Tajikistan and Central Asia's electricity systems. Climate change poses significant risks, threatening water security, agricultural productivity, and infrastructure, potentially reducing GDP per capita by 5-6% by mid-century and pushing 100,000 people into poverty. Additional adaptation measures are crucial, focusing on water management, resilient landscapes, climate-smart agriculture, and disaster risk management. A low-carbon development pathway offers a more resilient and prosperous future, with near net-zero emissions in energy and waste sectors by 2050, boosting economic growth, and job creation and reducing air pollution. Achieving these goals requires substantial investments and institutional reforms to mobilize private capital and attract green foreign investment. Development partners can provide financial assistance, technical expertise, and capacity building.Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.Publication Unlocking the Power of Healthy Longevity(Washington, DC: World Bank, 2024-09-12)Noncommunicable diseases (NCDs) are among the major health and development challenges of our time. Every year, about 41 million people die due to NCDs. This makes up about 74 percent of all deaths globally, the majority of which are in low- and middle-income countries (LMICs). Countless more people live with NCDs every day. Yet, NCDs are largely treatable and preventable. The risk of developing NCDs and deaths from them can both be lowered with appropriate attention to prevention and treatment. However, weak health systems and limited access to affordable care and information, especially in LMICs, contribute to lapses in seeking and receiving appropriate and timely care. This compendium is a compilation of 18 chapters, each exploring a different but related topic in the nexus of NCDs, human capital, and productivity. It is based on a series of analytical work taken up by the World Bank to support the Healthy Longevity Initiative (HLI) - a collaborative effort between the World Bank, the University of Toronto, and key academic and development partners including the Harvard University and the University of Washington. The HLI presents one of a growing set of efforts to increase the urgency of policy response to NCDs across the world.