Publication: The Entry of Randomized Assignment into the Social Sciences
Loading...
Published
2017-05
ISSN
Date
2017-05-24
Author(s)
Editor(s)
Abstract
Although the concept of randomized assignment to control for extraneous factors reaches back hundreds of years, the first empirical use appears to have been in an 1835 trial of homeopathic medicine. Throughout the 19th century, there was primarily a growing awareness of the need for careful comparison groups, albeit often without the realization that randomization could be a particularly clean method to achieve that goal. In the second and more crucial phase of this history, four separate but related disciplines introduced randomized control trials within a few years of one another in the 1920s: agricultural science, clinical medicine, educational psychology, and social policy (specifically political science). Randomized control trials brought more rigor to fields that were in the process of expanding their purviews and focusing more on causal relationships. In the third phase, the 1950s through the 1970s saw a surge of interest in more applied randomized experiments in economics and elsewhere, in the lab and especially in the field.
Link to Data Set
Citation
“Jamison, Julian C.. 2017. The Entry of Randomized Assignment into the Social Sciences. Policy Research Working Paper;No. 8062. © World Bank. http://hdl.handle.net/10986/26754 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Reducing Crime and Violence(World Bank, Washington, DC, 2016-04)The paper shows that self-control, time preferences, and values are malleable in adults, and that investments in these skills and preferences reduce crime and violence. The authors recruited criminally-engaged Liberian men and randomized half to eight weeks of group cognitive behavioral therapy, fostering self-regulation, patience, and noncriminal values. They also randomized $200 grants. Cash alone and therapy alone dramatically reduced crime and violence, but effects dissipated within a year. When cash followed therapy, however, crime and violence decreased by as much as 50 percent for at least a year. They hypothesize that cash reinforced therapy's lessons by prolonging practice and self-investment.Publication Impacts of Interventions during Early Childhood on Later Outcomes(World Bank, Washington, DC, 2015-03-31)In an effort to bridge the evidence gap, the Independent Evaluation Group (IEG) prepared a systematic review that gathers and analyzes the available impact evaluation evidence in developing countries from 1990 to 2013 on whether early childhood interventions shape future outcomes. Its purpose is not to supplant existing evidence but rather to help practitioners understand how evidence from impact evaluations supports or challenges beliefs about interventions and can be used to inform development policy. This review aims to answer two questions: (1) What is the evidence of attributable effects on outcomes in primary school and beyond from interventions in low- and middle-income countries that occur during the early childhood period? and (2) How do the post-early childhood effects of early childhood interventions vary by socioeconomic status, gender, age at intervention, and age at evaluation, particularly during the first 1,000 days from conception to the childs second birthday and from age three to primary school enrollment at age five to six? This report reviews all interventions from developing countries that occur during early childhood for which impact evaluation estimates exist for effects observed at primary school age and older. From an initial search of thousands of studies, the search process which included database searches, hand searches, and snowballing identified more than 500 relevant impact evaluations written from 1990 to 2015. This review covers six areas or domains of human development: physical development, cognitive development, language development, socio-emotional development, schooling outcomes, and employment and labor market outcomes. These domains are commonly included in evaluations of early interventions targeting poor children because they are negatively affected by early poverty, can benefit from early intervention, and are important for overall well-being or adult productivity. Some outcomes can be measured repeatedly starting from early childhood (i.e., height and weight) while others are only measurable later in life (i.e., cognition, schooling, and employment and labor market status).Publication A Metadata Schema for Data from Experiments in the Social Sciences(World Bank, Washington, DC, 2023-02)The use of randomized controlled trials (RCTs) in the social sciences has greatly expanded, resulting in newly abundant, high-quality data that can be reused to perform methods research in program evaluation, to systematize evidence for policymakers, and for replication and training purposes. However, potential users of RCT data often face significant barriers to discovery and reuse. This paper proposes a metadata schema that standardizes RCT data documentation and can serve as the basis for one—or many, interoperable —data catalogs that make such data easily findable, searchable, and comparable, and thus more readily reusable for secondary research. The schema is designed to document the unique properties of RCT data. Its set of fields and associated encoding schemes (acceptable formats and values) can be used to describe any dataset associated with a social science RCT. The paper also makes recommendations for implementing a catalog or database based on this metadata schema.Publication The Method of Randomization, Economic Policy, and Reasoned Intuition(World Bank, Washington, DC, 2013-12)The method of randomization has been a major driver in the recent rise to prominence of empirical development economics. It has helped uncover patterns and facts that had earlier escaped attention. But it has also given rise to heated debate and controversy. This paper evaluates the method of randomization and concludes that, while the method of randomization is the gold standard for description, it is not able to demonstrate causality. Nor does it, in itself, lead to policy conclusions, as is often claimed by its advocates. To get to policy conclusions requires combining the findings of randomized experiments with human intuition, which, being founded in evolution, has innate strengths. Moreover, even non-randomized empirical methods combined with reasoned intuition can help in crafting development policy.Publication Conducting Ethical Economic Research : Complications from the Field(World Bank, Washington, DC, 2013-05)This essay discusses practical issues confronted when conducting surveys as well as designing appropriate field trials. First, it looks at the challenge of ensuring transparency while maintaining confidentiality. Second, it explores the role of trust in light of asymmetric information held by the surveyor and by the respondents as well as the latter's expectations as to what their participation will set in motion. The authors present case studies relevant to both of these issues. Finally, they discuss the role of ethical review from the perspective of research conducted through the World Bank.
Users also downloaded
Showing related downloaded files
Publication El Salvador - Financial sector assessment(World Bank, 2010-11-01)Despite the global and domestic shocks of 2008-2009, the banking sector remains sound. Salvadoran banks were not directly exposed to the global financial crisis. However, the parent banks of several major Salvadoran banks were and directed subsidiaries to conserve risk capital. The higher risk aversion and recession in the United States, combined with uncertainty about the 2009 elections, led to a sharp economic downturn, and a decline in both credit demand and supply. Banks' nonperforming loans increased and profitability declined. Even so, capitalization remained high. Stress tests indicate that most banks would be able to withstand large deposit withdraws and severe deterioration in credit quality arising from large macroeconomic or sectoral shocks. However, credit concentration risks appear significant. Regulated non-bank financial institutions do not pose significant risks, but pension funds' poor profitability is a concern for the long-term. Regulated cooperative banks and insurance companies report healthy financial indicators. Brokerage houses have reduced drastically their fund management activities, which until recently posed systemic risks due to inadequate regulations and unsound commercial practices. Pension funds have grown considerably and now amount to 25 percent of total financial sector assets. However, investments are mostly in low-yielding public sector securities. To ensure a sound financial footing for the pension system, an in-depth actuarial analysis should evaluate pension reform costs and calculate replacement rates. The type of investments available to pension funds should be expanded progressively to increase diversification, improve returns and foster capital markets.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication Simulating Carbon Markets(World Bank, Washington, DC, 2020-04)Carbon market simulations are programs, models, virtual environments, and/or games that allow stakeholders to participate in a simulated process of designing or participating in an ETS. They are a low-cost and low-risk option of building capacity for both policymakers and regulated companies. The experiential learning processes these tools enable serves to increase ETS literacy, helps build support for ETS as a policy option, and illustrates how policy outcomes are a function of design. Importantly, ETS simulations can provide an opportunity for different stakeholdersto build relationships, mutual understanding and trust, all of which are key prerequisites for working together on policy design and implementation. Finally, these tools provide stakeholders with a safe and risk-free opportunity to try out new ideas, make mistakes, and to learn lessons which can serve to speed the adoption of effective ETSs.Publication Supervision of Primary and Secondary Education : A Five-Country Comparison(World Bank, Washington, DC, 2010-11)At the request of the Government of Poland which is reforming its educational system, the World Bank conducted a review of how five high performing countries in the education sector provide supervision and support to their schools. England, Finland, New Zealand, the Netherlands, and the Republic of Korea approach supervision and support to schools and teachers in a variety of ways; there is no single right way and their decisions take into account the overall organization of their education systems. A common theme to school supervision in all five countries is that schools are required to perform self assessments. The criteria for supervision extend beyond issues of regulatory compliance into questions about the quality of school processes, context and outcomes for students. All systems include elements of both accountability and support.Publication Breaking the Barriers to Higher Economic Growth : Better Governance and Deeper Reforms in the Middle East and North Africa(Washington, DC: World Bank, 2007)Contents of the report are as follows: Long-term economic development: challenges and prospects for the Arab countries by Mustapha K. Nabli. Reform complementarities and economic growth in the Middle East and North Africa by Mustapha Kamel Nabli, and Marie-Ange Veganzones-Varoudakis. After Argentina: was MENA right to be cautious? By Mustapha K. Nabli. Restarting Arab economic reform by Mustapha K. Nabli. Democracy for better governance and higher economic growth in the MENA region? By Mustapha K. Nabli, and Carlos Silva-Jauregui. The political economy of industrial policy in the Middle East and North Africa by Mustapha K. Nabli, Jennifer Keller, Claudia Nassif, and Carlos Silva-Jauregui. The macroeconomics of labor market outcomes in MENA by Jennifer Keller, and Mustapha K. Nabli. Challenges and opportunities for the 21st century by Mustapha Nabli. Labor market reforms, growth, and unemployment in labor-exporting countries in the Middle East and North Africa by Pierre-Richard Agenor, Mustapha K. Nabli, Tarik Yousef, and Henning Tarp Jensen. Economic reforms and people mobility for a more effective EU-MED partnership by Ishac Diwan, Mustapha Nabli, Adama Coulibaly, and Sara Johansson de Silva. Cruise control, shock absorbers, and traffic lights by Mustapha K. Nabli. Trade, foreign direct investment, and development in the Middle East and North Africa by Farrukh Iqbal, and Mustapha Kamel Nabli. Making trade work for jobs by Dipak Dasgupta, Mustapha Kamel Nabli, Christopher Pissarides, and Aristomene Varoudakis. Exchange rate management within the Middle East and North Africa region by Mustapha Nabli, Jennifer Keller, and Marie-Ange Véganzones. How does exchange rate policy affect manufactured exports in MENA countries? By Mustapha Kamel Nabli, and Marie-Ange Veganzones-Varoudakis. Public infrastructure and private investment in the Middle East and North Africa by Pierre-Richard Agenor, Mustapha K. Nabli, and Tarik M. Yousef. Governance, institutions, and private investment by Ahmet Faruk Aysan, Mustapha Kamel Nabli, and Marie-Ange Veganzones-Varoudakis.