Publication:
In Pursuit of Balance : Randomization in Practice in Development Field Experiments

dc.contributor.author Bruhn, Miriam
dc.contributor.author McKenzie, David
dc.date.accessioned 2012-06-01T19:07:20Z
dc.date.available 2012-06-01T19:07:20Z
dc.date.issued 2008-10
dc.description.abstract Randomized experiments are increasingly used in development economics, with researchers now facing the question of not just whether to randomize, but how to do so. Pure random assignment guarantees that the treatment and control groups will have identical characteristics on average, but in any particular random allocation, the two groups will differ along some dimensions. Methods used to pursue greater balance include stratification, pair-wise matching, and re-randomization. This paper presents new evidence on the randomization methods used in existing randomized experiments, and carries out simulations in order to provide guidance for researchers. Three main results emerge. First, many researchers are not controlling for the method of randomization in their analysis. The authors show this leads to tests with incorrect size, and can result in lower power than if a pure random draw was used. Second, they find that in samples of 300 or more, the different randomization methods perform similarly in terms of achieving balance on many future outcomes of interest. However, for very persistent outcome variables and in smaller sample sizes, pair-wise matching and stratification perform best. Third, the analysis suggests that on balance the re-randomization methods common in practice are less desirable than other methods, such as matching. en
dc.identifier http://documents.worldbank.org/curated/en/2008/10/9938284/pursuit-balance-randomization-practice-development-field-experiments
dc.identifier.uri http://hdl.handle.net/10986/6910
dc.language English
dc.publisher World Bank, Washington, DC
dc.relation.ispartofseries Policy Research Working Paper; No. 4752
dc.rights CC BY 3.0 IGO
dc.rights.holder World Bank
dc.rights.uri http://creativecommons.org/licenses/by/3.0/igo/
dc.subject ALTERNATIVE APPROACH
dc.subject BOOTSTRAP
dc.subject DEVELOPMENT ECONOMICS
dc.subject DEVELOPMENT RESEARCH
dc.subject ECONOMIC MODELS
dc.subject ECONOMIC THEORY
dc.subject ECONOMICS LITERATURE
dc.subject ESTIMATORS
dc.subject EXPERIMENTAL DESIGN
dc.subject EXTERNALITIES
dc.subject FIELD EXPERIMENTS
dc.subject INCOME
dc.subject LINEAR MODELS
dc.subject LINEAR REGRESSION
dc.subject LOTTERIES
dc.subject METHODOLOGY
dc.subject MINIMIZATION
dc.subject MISSING OBSERVATIONS
dc.subject NORMAL DISTRIBUTIONS
dc.subject POLITICAL ECONOMY
dc.subject PRECISION
dc.subject PROBABILITY
dc.subject PROGRAMS
dc.subject RANDOMIZATION
dc.subject RESEARCH PAPERS
dc.subject RESEARCH REPORT
dc.subject RESEARCH WORKING PAPERS
dc.subject RESEARCHERS
dc.subject RISK AVERSION
dc.subject SAMPLE SIZE
dc.subject SCENARIO
dc.subject SCENARIOS
dc.subject SCIENTISTS
dc.subject SIGNIFICANCE LEVEL
dc.subject SIMULATION
dc.subject SIMULATIONS
dc.subject STANDARD DEVIATIONS
dc.subject STANDARD ERRORS
dc.subject STATA
dc.subject STATA CODE
dc.subject STATISTICAL ANALYSIS
dc.subject STATISTICAL METHODS
dc.subject STATISTICAL SIGNIFICANCE
dc.subject STATISTICAL TESTS
dc.subject TECHNIQUES
dc.subject VALIDITY
dc.title In Pursuit of Balance : Randomization in Practice in Development Field Experiments en
dspace.entity.type Publication
okr.doctype Publications & Research :: Policy Research Working Paper
okr.doctype Publications & Research
okr.docurl http://documents.worldbank.org/curated/en/2008/10/9938284/pursuit-balance-randomization-practice-development-field-experiments
okr.globalpractice Macroeconomics and Fiscal Management
okr.globalpractice Education
okr.globalpractice Transport and ICT
okr.globalpractice Environment and Natural Resources
okr.identifier.doi 10.1596/1813-9450-4752
okr.identifier.externaldocumentum 000158349_20081015133501
okr.identifier.internaldocumentum 9938284
okr.identifier.report WPS4752
okr.language.supported en
okr.pdfurl http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2008/10/15/000158349_20081015133501/Rendered/PDF/WPS4752.pdf en
okr.sector Finance :: General finance sector
okr.theme Financial and private sector development :: Other financial and private sector development
okr.topic Economic Theory and Research
okr.topic Statistical and Mathematical Sciences
okr.topic Scientific Research and Science Parks
okr.topic Science Education
okr.topic Climate Change
okr.topic Environment
okr.topic Education
okr.topic Macroeconomics and Economic Growth
okr.topic Science and Technology Development
okr.unit Development Research Group (DECRG)
okr.volume 1 of 1
relation.isAuthorOfPublication 148d6d6d-76e5-5d6f-9af9-98313e30551f
relation.isSeriesOfPublication 26e071dc-b0bf-409c-b982-df2970295c87
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
English PDF
Size:
499.23 KB
Format:
Adobe Portable Document Format
Description:
No Thumbnail Available
Name:
English Text
Size:
172.37 KB
Format:
Plain Text
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description: