Publication:
In Pursuit of Balance : Randomization in Practice in Development Field Experiments

Simple item page
dc.contributor.authorMcKenzie, David
dc.contributor.authorBruhn, Miriam
dc.date.accessioned2012-06-01T19:07:20Z
dc.date.available2012-06-01T19:07:20Z
dc.date.issued2008-10
dc.description.abstractRandomized experiments are increasingly used in development economics, with researchers now facing the question of not just whether to randomize, but how to do so. Pure random assignment guarantees that the treatment and control groups will have identical characteristics on average, but in any particular random allocation, the two groups will differ along some dimensions. Methods used to pursue greater balance include stratification, pair-wise matching, and re-randomization. This paper presents new evidence on the randomization methods used in existing randomized experiments, and carries out simulations in order to provide guidance for researchers. Three main results emerge. First, many researchers are not controlling for the method of randomization in their analysis. The authors show this leads to tests with incorrect size, and can result in lower power than if a pure random draw was used. Second, they find that in samples of 300 or more, the different randomization methods perform similarly in terms of achieving balance on many future outcomes of interest. However, for very persistent outcome variables and in smaller sample sizes, pair-wise matching and stratification perform best. Third, the analysis suggests that on balance the re-randomization methods common in practice are less desirable than other methods, such as matching.en
dc.identifierhttp://documents.worldbank.org/curated/en/2008/10/9938284/pursuit-balance-randomization-practice-development-field-experiments
dc.identifier.doi10.1596/1813-9450-4752
dc.identifier.urihttps://hdl.handle.net/10986/6910
dc.languageEnglish
dc.publisherWorld Bank, Washington, DC
dc.relation.ispartofseriesPolicy Research Working Paper; No. 4752
dc.rightsCC BY 3.0 IGO
dc.rights.holderWorld Bank
dc.rights.urihttp://creativecommons.org/licenses/by/3.0/igo/
dc.subjectALTERNATIVE APPROACH
dc.subjectBOOTSTRAP
dc.subjectDEVELOPMENT ECONOMICS
dc.subjectDEVELOPMENT RESEARCH
dc.subjectECONOMIC MODELS
dc.subjectECONOMIC THEORY
dc.subjectECONOMICS LITERATURE
dc.subjectESTIMATORS
dc.subjectEXPERIMENTAL DESIGN
dc.subjectEXTERNALITIES
dc.subjectFIELD EXPERIMENTS
dc.subjectINCOME
dc.subjectLINEAR MODELS
dc.subjectLINEAR REGRESSION
dc.subjectLOTTERIES
dc.subjectMETHODOLOGY
dc.subjectMINIMIZATION
dc.subjectMISSING OBSERVATIONS
dc.subjectNORMAL DISTRIBUTIONS
dc.subjectPOLITICAL ECONOMY
dc.subjectPRECISION
dc.subjectPROBABILITY
dc.subjectPROGRAMS
dc.subjectRANDOMIZATION
dc.subjectRESEARCH PAPERS
dc.subjectRESEARCH REPORT
dc.subjectRESEARCH WORKING PAPERS
dc.subjectRESEARCHERS
dc.subjectRISK AVERSION
dc.subjectSAMPLE SIZE
dc.subjectSCENARIO
dc.subjectSCENARIOS
dc.subjectSCIENTISTS
dc.subjectSIGNIFICANCE LEVEL
dc.subjectSIMULATION
dc.subjectSIMULATIONS
dc.subjectSTANDARD DEVIATIONS
dc.subjectSTANDARD ERRORS
dc.subjectSTATA
dc.subjectSTATA CODE
dc.subjectSTATISTICAL ANALYSIS
dc.subjectSTATISTICAL METHODS
dc.subjectSTATISTICAL SIGNIFICANCE
dc.subjectSTATISTICAL TESTS
dc.subjectTECHNIQUES
dc.subjectVALIDITY
dc.titleIn Pursuit of Balance : Randomization in Practice in Development Field Experimentsen
dspace.entity.typePublication
okr.crossref.titleIn Pursuit Of Balance: Randomization In Practice In Development Field Experiments
okr.date.doiregistration2025-04-10T10:03:43.227607Z
okr.doctypePublications & Research::Policy Research Working Paper
okr.doctypePublications & Research
okr.docurlhttp://documents.worldbank.org/curated/en/2008/10/9938284/pursuit-balance-randomization-practice-development-field-experiments
okr.globalpracticeMacroeconomics and Fiscal Management
okr.globalpracticeEducation
okr.globalpracticeTransport and ICT
okr.globalpracticeEnvironment and Natural Resources
okr.guid372631468177851332
okr.identifier.doi10.1596/1813-9450-4752
okr.identifier.externaldocumentum000158349_20081015133501
okr.identifier.internaldocumentum9938284
okr.identifier.reportWPS4752
okr.language.supporteden
okr.pdfurlhttp://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2008/10/15/000158349_20081015133501/Rendered/PDF/WPS4752.pdfen
okr.sectorFinance :: General finance sector
okr.themeFinancial and private sector development :: Other financial and private sector development
okr.topicEconomic Theory and Research
okr.topicStatistical and Mathematical Sciences
okr.topicScientific Research and Science Parks
okr.topicScience Education
okr.topicClimate Change
okr.topicEnvironment
okr.topicEducation
okr.topicMacroeconomics and Economic Growth
okr.topicScience and Technology Development
okr.unitDevelopment Research Group (DECRG)
okr.volume1 of 1
relation.isAuthorOfPublication148d6d6d-76e5-5d6f-9af9-98313e30551f
relation.isAuthorOfPublication471c8982-45ac-42cd-87d0-3e505bd1a972
relation.isAuthorOfPublication.latestForDiscovery148d6d6d-76e5-5d6f-9af9-98313e30551f
relation.isSeriesOfPublication26e071dc-b0bf-409c-b982-df2970295c87
relation.isSeriesOfPublication.latestForDiscovery26e071dc-b0bf-409c-b982-df2970295c87
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
WPS4752.pdf
Size:
499.23 KB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
WPS4752.txt
Size:
172.37 KB
Format:
Plain Text
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Plain Text
Description:
Download
Collections
Policy Research Working Papers