Publication: Propensity Score Matching and Policy Impact Analysis : A Demonstration in EViews
Loading...
Date
2006-04
ISSN
Published
2006-04
Author(s)
Editor(s)
Abstract
Effective development policymaking creates a need for reliable methods of assessing effectiveness. There should be, therefore, an intimate relationship between effective policymaking and impact analysis. The goal of a development intervention defines the metric by which to assess its impact, while impact evaluation can produce reliable information on which policymakers may base decisions to modify or cancel ineffective programs and thus make the most of limited resources. This paper reviews the logic of propensity score matching (PSM) and, using data on the National Support Work Demonstration, compares that approach with other evaluation methods such as double difference, instrumental variable, and Heckman's method of selection bias correction. In addition, it demonstrates how to implement nearest-neighbor and kernel-based methods, and plot program incidence curves in E-Views. In the end, the plausibility of an evaluation method hinges critically on the correctness of the socioeconomic model underlying program design and implementation, and on the quality and quantity of available data. In any case, PSM can act as an effective adjuvant to other methods.
Link to Data Set
Citation
“Essama-Nssah, B.. 2006. Propensity Score Matching and Policy Impact Analysis : A Demonstration in EViews. Policy Research Working Paper; No. 3877. © World Bank. http://hdl.handle.net/10986/8730 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Intergenerational Income Mobility around the World(Washington, DC: World Bank, 2025-07-09)This paper introduces a new global database with estimates of intergenerational income mobility for 87 countries, covering 84 percent of the world’s population. This marks a notable expansion of the cross-country evidence base on income mobility, particularly among low- and middle-income countries. The estimates indicate that the negative association between income mobility and inequality (known as the Great Gatsby Curve) continues to hold across this wider range of countries. The database also reveals a positive association between income mobility and national income per capita, suggesting that countries achieve higher levels of intergenerational mobility as they grow richer.Publication The Impact of Trade Promotion Organizations on Exports(Washington, DC: World Bank, 2025-08-13)This paper examines the impact of trade promotion organizations on exports during the COVID-19 pandemic using a World Bank survey. The results suggest that increased trade promotion organization budgets significantly boosted exports during downturns but had no effect during the recovery phase. Interestingly, e-commerce programs adopted by trade promotion organizations negatively affected exports during downturns as they diverted resources away from productive support, especially for sectors not intensive in online trade. These findings suggest that countercyclical trade promotion organizations budgets may enhance trade resilience during similar global shocks.Publication The Future of Poverty(Washington, DC: World Bank, 2025-07-15)Climate change is increasingly acknowledged as a critical issue with far-reaching socioeconomic implications that extend well beyond environmental concerns. Among the most pressing challenges is its impact on global poverty. This paper projects the potential impacts of unmitigated climate change on global poverty rates between 2023 and 2050. Building on a study that provided a detailed analysis of how temperature changes affect economic productivity, this paper integrates those findings with binned data from 217 countries, sourced from the World Bank’s Poverty and Inequality Platform. By simulating poverty rates and the number of poor under two climate change scenarios, the paper uncovers some alarming trends. One of the primary findings is that the number of people living in extreme poverty worldwide could be nearly doubled due to climate change. In all scenarios, Sub-Saharan Africa is projected to bear the brunt, contributing the largest number of poor people, with estimates ranging between 40.5 million and 73.5 million by 2050. Another significant finding is the disproportionate impact of inequality on poverty. Even small increases in inequality can lead to substantial rises in poverty levels. For instance, if every country’s Gini coefficient increases by just 1 percent between 2022 and 2050, an additional 8.8 million people could be pushed below the international poverty line by 2050. In a more extreme scenario, where every country’s Gini coefficient increases by 10 percent between 2022 and 2050, the number of people falling into poverty could rise by an additional 148.8 million relative to the baseline scenario. These findings underscore the urgent need for comprehensive climate policies that not only mitigate environmental impacts but also address socioeconomic vulnerabilities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Climate Vulnerability and Job Accessibility(Washington, DC: World Bank, 2025-08-11)Many developing cities are facing rapid population growth and extreme climate events. This paper examines the link between job accessibility and climate vulnerability, using data from Antananarivo, Madagascar, which frequently experiences flooding. As in other countries, the analysis finds that men’s commutes are longer than women’s, who tend to walk to work or use public transport. Even after controlling for observables and the potential endogeneity bias associated with commute time, the findings show that climate vulnerability negatively impacts wages, as people avoid commuting long to work due to anticipated potential climate risks. Building climate resilience into urban transport is therefore essential. As predicted by theory, the evidence also shows that the value of commuting is positive, and walking is disadvantageous. Motorized commuting yields higher returns, which could lead to overuse of private cars and taxis, posing decarbonization challenges.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Reading Tealeaves on the Potential Impact of the Privatization of Tea Estates in Rwanda(World Bank, Washington, DC, 2008-03)The Poverty Reduction Strategy of the Government of Rwanda seeks to unlock the growth and poverty reduction potential of the tea sector through the privatization of tea estates. This paper uses the logic of causal inference and data from the 2004 Quantitative Baseline Survey of the tea sector to assess the potential impact of the privatization program. This entails a normalized comparison of productivity outcomes to account for household heterogeneity in terms of observable and non-observable determinants of these outcomes. The paper also compares living standards between tea and non-tea households. Three main findings emerge from the analysis. Productivity outcomes are generally better in the private sector than in the public sector. Male-headed households outperform female-headed households along all dimensions considered here. And tea households tend to be better off than non-tea households.Publication The Mystery of the Vanishing Benefits : An Introduction to Impact Evaluation(Washington, DC: World Bank, 2001-01)This article provides an introduction to the concepts and methods of impact evaluation. The author provides an intuitive explanation in the context of a concrete application. The article takes the form of a short story about a fictional character's on-the-job training in evaluation. Ms. Speedy analyst is an economist in the Ministry of Finance in the fictional country of Labas. In the process of figuring out how to evaluate a human resource program targeted to the poor, Ms. Analyst learns the strengths and weaknesses of the main methods of ex post impact evaluation.Publication Identification of Sources of Variation in Poverty Outcomes(2012-01-01)The international community has declared poverty reduction one of the fundamental objectives of development, and therefore a metric for assessing the effectiveness of development interventions. This creates the need for a sound understanding of the fundamental factors that account for observed variations in poverty outcomes either over time or across space. Consistent with the view that such an understanding entails deeper micro empirical work on growth and distributional change, this paper reviews existing decomposition methods that can be used to identify sources of variation in poverty. The maintained hypothesis is that the living standard of an individual is a pay-off from her participation in the life of society. In that sense, individual outcomes depend on endowments, behavior and the circumstances that determine the returns to those endowments in any social transaction. To identify the contribution of each of these factors to changes in poverty, the statistical and structural methods reviewed in this paper all rely on the notion of ceteris paribus variation. This entails the comparison of an observed outcome distribution to a counterfactual obtained by changing one factor at a time while holding all the other factors constant.Publication Pakistan's Investment Climate : Laying the Foundation for Renewed Growth, Volume 3. Background Paper on Econometric Methods(Washington, DC, 2009-12)Pakistan has faced a seismic shift in its global and domestic economic landscape which until recently limited policy options to address investment climate concerns. External shocks, internal policy inaction and political turmoil placed the country in a precarious economic condition, calling on the authorities to take a hard look at the policy choices ahead. Macroeconomic instability resulting in inflation, exchange rate depreciation, and a rapid depletion in foreign reserves became acute in 2007-08, with the adjustment accompanied by a reduction in investment, export and output growth. The recent slowdown in global demand for world trade along with supply shocks from the domestic economy has exacerbated an already monumental challenge for Pakistani firms to prosper and policy makers to respond. As external market conditions and Pakistan's own stabilization program temper economic expectations, opportunities abound to lay the foundation for expansion. Given Pakistan's geopolitical positioning, growing labor participation rates, and improvements in the standard of living, significant poverty outcomes can be achieved through sustained economic growth. Even, in the short run, during periods of slower growth, banking system weakness, and corporate distress, Pakistan can take the opportunity to position itself for the inevitable global rebound. Concerted efforts now can improve firm level productivity, fluidity of markets for labor, capital and land, as well as goods, and therefore, better resource use and global competitiveness.Publication Using Mixed Methods in Monitoring and Evaluation : Experiences from International Development(2010-03-01)This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining "process" in addition to "impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.
Users also downloaded
Showing related downloaded files
Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Lebanon Economic Monitor, Fall 2022(Washington, DC, 2022-11)The economy continues to contract, albeit at a somewhat slower pace. Public finances improved in 2021, but only because spending collapsed faster than revenue generation. Testament to the continued atrophy of Lebanon’s economy, the Lebanese Pound continues to depreciate sharply. The sharp deterioration in the currency continues to drive surging inflation, in triple digits since July 2020, impacting the poor and vulnerable the most. An unprecedented institutional vacuum will likely further delay any agreement on crisis resolution and much needed reforms; this includes prior actions as part of the April 2022 International Monetary Fund (IMF) staff-level agreement (SLA). Divergent views among key stakeholders on how to distribute the financial losses remains the main bottleneck for reaching an agreement on a comprehensive reform agenda. Lebanon needs to urgently adopt a domestic, equitable, and comprehensive solution that is predicated on: (i) addressing upfront the balance sheet impairments, (ii) restoring liquidity, and (iii) adhering to sound global practices of bail-in solutions based on a hierarchy of creditors (starting with banks’ shareholders) that protects small depositors.Publication Doing Business 2014 : Understanding Regulations for Small and Medium-Size Enterprises(Washington, DC: World Bank Group, 2013-10-28)Eleventh in a series of annual reports comparing business regulation in 185 economies, Doing Business 2014 measures regulations affecting 11 areas of everyday business activity: Starting a business, Dealing with construction permits, Getting electricity, Registering property, Getting credit, Protecting investors, Paying taxes, Trading across borders, Enforcing contracts, Closing a business, Employing workers. The report updates all indicators as of June 1, 2013, ranks economies on their overall “ease of doing business”, and analyzes reforms to business regulation – identifying which economies are strengthening their business environment the most. The Doing Business reports illustrate how reforms in business regulations are being used to analyze economic outcomes for domestic entrepreneurs and for the wider economy. Doing Business is a flagship product by the World Bank and IFC that garners worldwide attention on regulatory barriers to entrepreneurship. More than 60 economies use the Doing Business indicators to shape reform agendas and monitor improvements on the ground. In addition, the Doing Business data has generated over 870 articles in peer-reviewed academic journals since its inception.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.