Publication: How Important is Selection? Experimental versus Non-Experimental Measures of the Income Gains from Migration
Loading...
Published
2006-05
ISSN
Date
2012-06-21
Author(s)
Editor(s)
Abstract
Measuring the gain in income from migration is complicated by non-random selection of migrants from the general population, making it difficult to obtain an appropriate comparison group of non-migrants. This paper uses a migrant lottery to overcome this problem, providing an experimental measure of the income gains from migration. New Zealand allows a quota of Tongans to immigrate each year with a lottery to choose among the excess number of applicants. A unique survey conducted by the authors in these two countries allows experimental estimates of the income gains from migration by comparing the incomes of migrants to those who applied to migrate, but whose names were not drawn in the lottery, after allowing for the effect of non-compliance among some of those whose names were drawn. The authors also conducted a survey of individuals who did not apply for the lottery. Comparing this non-applicant group with the migrants enables assessment of the degree to which non-experimental methods can provide an unbiased estimate of the income gains from migration. They find evidence of migrants being positively selected in terms of both observed and unobserved skills. As a result, non-experimental methods are found to overstate the gains from migration, by 9 to 82 percent. A good instrumental variable works best, while difference-in-differences and bias-adjusted propensity-score matching also perform comparatively well.
Link to Data Set
Citation
“Gibson, John; McKenzie, David; Stillman, Steven. 2006. How Important is Selection? Experimental versus Non-Experimental Measures of the Income Gains from Migration. Policy Research Working Paper; No. 3906. © World Bank. http://hdl.handle.net/10986/8679 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication How Important Is Selection? Experimental vs. Non-experimental Measures of the Income Gains from Migration(2010)How much do migrants stand to gain in income from moving across borders? Answering this question is complicated by non-random selection of migrants from the general population, which makes it hard to obtain an appropriate comparison group of non-migrants. New Zealand allows a quota of Tongans to immigrate each year with a random ballot used to choose among the excess number of applicants. A unique survey conducted by the authors allows experimental estimates of the income gains from migration to be obtained by comparing the incomes of migrants to those who applied to migrate, but whose names were not drawn in the ballot, after allowing for the effect of non-compliance among some of those whose names were drawn. We also conducted a survey of individuals who did not apply for the ballot. Comparing this non-applicant group to the migrants enables assessment of the degree to which non-experimental methods can provide an unbiased estimate of the income gains from migration. We find evidence of migrants being positively selected in terms of both observed and unobserved skills. As a result, non-experimental methods other than instrumental variables are found to overstate the gains from migration by 20-82%, with difference-in-differences and bias-adjusted matching estimators performing best among the alternatives to instrumental variables.Publication Migration and Mental Health : Evidence from a Natural Experiment(World Bank, Washington, DC, 2007-02)People migrate to improve their well-being, whether through an expansion of economic and social opportunities or a reduction in persecution. Yet a large literature suggests that migration can be a stressful process, with potentially negative impacts on mental health, reducing the net benefits of migration. However, to truly understand the effect of migration on mental health one must compare the mental health of migrants to what their mental health would have been had they stayed in their home country. The existing literature is not able to do this and typically settles for comparing the mental health of migrants to that of natives in the destination country, which takes no account of any pre-existing differences between these groups. This paper overcomes the selection problems affecting previous studies of the effect of migration on mental health by examining a migrant lottery program. New Zealand allows a quota of Tongans to immigrate each year with a lottery used to choose among the excess number of applicants. A unique survey conducted by the authors in these two countries allows experimental estimates of the mental health effects of migration to be obtained by comparing the mental health of migrants who were successful applicants in the lottery to the mental health of those who applied to migrate under the quota, but whose names were not drawn in the lottery. Migration is found to lead to improvements in mental health, particularly for women and those with poor mental health in their home country.Publication A Land of Milk and Honey with Streets Paved with Gold : Do Emigrants Have Over-Optimistic Expectations about Incomes Abroad?(World Bank, Washington, DC, 2007-03)Millions of people emigrate every year in search of better economic and social opportunities. Anecdotal evidence suggests that emigrants may have over-optimistic expectations about the incomes they can earn abroad, resulting in excessive migration pressure, and in disappointment among those who do migrate. Yet there is almost no statistical evidence on how accurately these emigrants predict the incomes that they will earn working abroad. In this paper the authors combine a natural emigration experiment with unique survey data on would-be emigrants' probabilistic expectations about employment and incomes in the migration destination. Their procedure enables them to obtain moments and quantiles of the subjective distribution of expected earnings in the destination country. The authors find a significant underestimation of both unconditional and conditional labor earnings at all points in the distribution. This underestimation appears driven in part by potential migrants placing too much weight on the negative employment experiences of some migrants, and by inaccurate information flows from extended family, who may be trying to moderate remittance demands by understating incomes.Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.Publication Accounting for Selectivity and Duration-Dependent Heterogeneity When Estimating the Impact of Emigration on Incomes and Poverty in Sending Areas(2010-04-01)The impacts of international emigration and remittances on incomes and poverty in sending areas are increasingly studied with household survey data. But comparing households with and without emigrants is complicated by a triple-selectivity problem: first, households self-select into emigration; second, in some emigrant households everyone moves while others leave members behind; and third, some emigrants choose to return to the origin country. Allowing for duration-dependent heterogeneity introduces a fourth form of selectivity -- one must now worry not just about whether households migrate, but also when they do so. This paper clearly sets out these selectivity issues and their implications for existing migration studies, and then addresses them by using survey data designed specifically to take advantage of a randomized lottery that determines which applicants to the over-subscribed Samoan Quota may immigrate to New Zealand. The analysis compares incomes and poverty rates among left behind members in households in Samoa that sent Samoan Quota emigrants with those for members of similar households that were unsuccessful in the lottery. Policy rules control who can accompany the principal migrant, providing an instrument to address the second selectivity problem, while differences among migrants in which year their ballot was selected allow for estimation of duration effects. The authors find that migration reduced poverty among former household members, but they also find suggestive evidence that this effect may be short-lived as both remittances and agricultural income are negatively related to the duration that the migrant has been abroad.
Users also downloaded
Showing related downloaded files
Publication Continental Drying: A Threat to Our Common Future(Washington, DC: World Bank, 2025-11-04)Grounded in new evidence from satellite data, “Continental Drying: A Threat to Our Common Future” presents the first global assessment of freshwater reserves over the past two decades. The findings expose an alarming trend of “continental drying,” a persistent long-term decline in freshwater availability across vast landmasses. Not only are droughts and deluges becoming more unpredictable, but the total amount of freshwater available for use has also significantly declined. Continental drying, driven by global warming, worsening droughts, and unsustainable water and land use, is a silent but accelerating crisis—largely unknown to the public—that reshapes the global water narrative. Continental drying raises profound risks. This report reveals new empirical evidence showing how freshwater depletion leads to major job losses, reduced incomes, wildfires, and biodiversity threats. In the long term, the combined effects of drying and warming could push societies toward a tipping point where damage accelerates rapidly and adaptation becomes increasingly difficult. Against the backdrop of continental drying, global water consumption rose by 25 percent between 2000 and 2019, with about a third of this increase occurring in regions already experiencing drying. Compounding the pressure, a substantial share of water use in drying regions remains inefficient. Continental Drying identifies hot spots where rising demand and declining supply converge and explores where and how water savings can be realized. This report recommends a three-pronged approach to address the crisis: managing demand, augmenting water supply, and improving water allocation. Five cross-cutting levers—strengthening institutions, reforming water tariffs and repurposing subsidies, adopting water accounting, leveraging data and technological innovations, and valuing water in trade—are essential for effective implementation and to attract private investment to finance the approach. Beyond water, addressing trade barriers, investing in education and skills development, and improving access to markets and financial services are critical for strengthening job and livelihood resilience amid a continental drying crisis.Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.Publication Taxes, Spending, and Equity: International Patterns and Lessons for Developing Countries(Washington, DC: World Bank, 2025-11-17)Taxes and public spending underpin the basic administration of government and finance the human capital and infrastructure investments needed for economic growth. They can also have a significant and immediate impact on poverty and inequality. The question of how public finance can support longer-term growth objectives while promoting equity has become even more important in recent years, given the high fiscal deficits and debt levels most countries emerged with in the aftermath of the COVID-19 pandemic. These included the increasing cost of debt and the need to restart environmentally sustainable growth while helping households address the learning losses and other social scars caused by the pandemic. This paper examines the global evidence on which households pay which taxes and who benefits from what spending, and critically, the net effect on different households across the income distribution. The aim is to identify the patterns and lessons that emerge for designing progressive fiscal policies. A global dataset of 96 countries is assembled, spanning all regions of the world and all national income levels, grounded in the Commitment to Equity (CEQ) approach to fiscal incidence.Publication Direct and Indirect Impacts of Transport Mobility on Access to Jobs: Evidence from South Africa(Washington, DC: World Bank, 2025-11-12)Access to jobs is essential for economic growth. In Africa, unemployment rates are notably high. This paper reexamines the relationship between transport mobility and labor market outcomes, with a particular focus on the direct and indirect effects of transport connectivity. As predicted by theory, wages are influenced by the level of commuting deterrence. Generally, higher earnings are associated with longer commute times and/or higher commuting costs. Local accessibility is also important, especially for individuals with time constraints. Both direct and indirect impacts are found to be significant in South Africa, where job accessibility has been challenging since the end of apartheid. For the direct impact, the wage elasticity associated with commuting costs is significant. Returns on commute are particularly high for women. Local accessibility to socioeconomic facilities, such as shops and health services, is also found to have a significant impact, consistent with the concept of mobility of care. To enhance employment, therefore, it is crucial to connect people not only to job locations but also to various socioeconomic points of interest, such as markets and hospitals, in an integrated manner. This integration will enable individuals to spend more time working and commuting longer distances.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.