Publication: A Practicioner's Guide to Evaluating the Impacts of Labor Market Programs
Loading...
Date
2009-12
ISSN
Published
2009-12
Author(s)
Editor(s)
Abstract
This note provides an introduction to the impact evaluation of labor market programs, with particular reference to developing countries. Its focus is on the main issues that need to be considered when planning an impact evaluation, including the importance of rigorous design for an evaluation, and on the statistical techniques used to estimate program impacts. To help the exposition, a prototype of a training program is referred to intermittently throughout the note. This hypothetical training program, which authors call get-to-work, provides training to the unemployed to help them find work. The note describes some general issues that are important for any impact evaluation of employment programs, both in the design and analysis stages, regardless of the specific evaluation techniques used. It then describes the main evaluation techniques, including the data requirements and the main assumptions invoked by each.
Link to Data Set
Citation
“Fitzsimons, Emla; Vera-Hernandez, Marcos. 2009. A Practicioner's Guide to Evaluating the Impacts of Labor Market Programs. World Bank Employment Policy Primer; No. 12. © World Bank. http://hdl.handle.net/10986/11713 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Minimum Wages in Developing Countries : Helping or Hurting Workers?(World Bank, Washington, DC, 2008-12)This policy note reviews the literature on the effects of minimum wages on labor markets in developing countries. The authors begin by elucidating the challenges to ascertaining these effects, especially in developing economies where a large segment of the workforce is not covered by minimum wage legislation (uncovered sector). After summarizing the theoretical models and their predictions, the authors review the empirical evidence of the impact of minimum wage legislation on wages, employment, and unemployment in the covered and uncovered sectors of the labor market. The evidence strongly suggests that an increase in the minimum wage tends to have a positive wage effect and a small negative employment effect among workers covered by minimum wage legislation and that the effects tend to be stronger among low-wage workers. The findings are quite limited and fairly inconclusive on the indirect effects of increases in minimum wages on workers in the uncovered sectors, where the legislation either does not apply or is not complied with.Publication Making Work Pay in Nicaragua : Employment, Growth, and Poverty Reduction(Washington, DC : World Bank, 2008)The objective of this report is to provide some policy guidelines for the fight against poverty. In particular, it hopes to be able to identify the growing sectors, as well as the constraints faced by the poor in benefiting from this growth. The report is part of a series of studies conducted within the Poverty Reduction Group (PRMPR) to foster understanding of the role of employment earnings and labor markets in shared growth. In addition, it is intended to function as a background document for the World Bank's Nicaragua Poverty Assessment 2007. The degree to which growth is able to translate into poverty reduction depends on how its benefits are distributed among different segments of society. There is little doubt that growth measured by changes in average income contributes significantly to poverty reduction. However, it is also clear that countries differ in the degree to which income growth spells have translated into poverty reduction. Although differences in the responsiveness of poverty to income growth account for a small fraction of the overall differences in poverty changes across countries, from the point of view of an individual country, these differences may have significant implications for poverty reduction, especially in the short term.Publication Are Skills Rewarded in Sub-Saharan Africa? Determinants of Wages and Productivity in the Manufacturing Sector(World Bank, Washington, DC, 2008-08)Using recent matched employer-employee data from the manufacturing sector in 20 Sub-Saharan African countries, the authors analyze how the supply of skills and legal origin of the country affect the wage setting process. The wage analysis yields three main findings. First, increasing returns to education, especially for older workers, suggest that the expansion of education in Africa has reduced returns to education for entrants in the labor market. Second, age effects matter not just for returns to education, but also for the wage setting process more generally. In particular, in civil-law countries, returns to seniority are rewarded only after a certain age. Third, workers exercise some power in the wage setting process but their influence varies by linguistic group. In common-law countries, union presence benefits all workers equally, not just members, whereas in civil-law countries, only older members enjoy higher wages. The authors also contrast wage premia with relative marginal productivities for different age, occupation, and education categories. The findings show that in general, older, highly educated, and highly ranked workers receive wage premia that do not reflect a higher relative marginal productivity.Publication Labor Market Policy in Developing Countries : A Selective Review of the Literature and Needs for the Future(World Bank, Washington, DC, 2007-09)This paper presents a selective overview of the literature on modeling labor market policies in developing countries. It considers welfare economics, theoretical models, and empirical evidence to highlight the three general features needed in future research on labor market policy in developing countries. The author identifies desirable research components (welfare economics, theoretical modeling, and empirical modeling) and pitfalls in the literature (inappropriate use of productivity, reliance on wrong kinds of empirical studies, lack of cost-benefit analysis, attention to only a subset of the goods and bads, and fallacy of composition). The paper concludes with suggested topics and methods for future research. The author states that sound labor market policy requires sound labor market models. The paper makes a case for developing policy based on explicit evaluation criteria, specific theoretical models, and comprehensive empirical evidence.Publication Wage Subsidy and Labor Market Flexibility in South Africa(2009-03-01)In this paper, the authors use a highly disaggregate general equilibrium model to analyze the feasibility of a wage subsidy to unskilled workers in South Africa, isolating and estimating its potential employment effects and fiscal cost. They capture the structural characteristics of the labor market with several labor categories and substitution possibilities, linking the economy-wide results on relative prices, wages, and employment to a micro-simulation model with occupational choice probabilities in order to investigate the poverty and distributional consequences of the policy. The impact of a wage subsidy on employment, poverty, and inequality in South Africa depends greatly on the elasticities of substitution of factors of production, being very minimal if unskilled and skilled labor are complements in production. The desired results are attainable only if there is sufficient flexibility in the labor market. Although the impact in a low case scenario can be improved by supporting policies that relax the skill constraint and increase the production capacity of the economy especially towards labor-intensive sectors, the gains from a wage subsidy are still modest if the labor market remains very rigid.
Users also downloaded
Showing related downloaded files
Publication Guide to the Debt Management Performance Assessment Tool(Washington, DC, 2008-02-05)The purpose of this document is to provide guidance and supplemental information to assist with country assessments of debt management performance, using the Debt Management Performance Assessment (DeMPA) tool. The DeMPA is a methodology used for assessing public debt management performance through a comprehensive set of 15 performance indicators spanning the full range of government Debt Management (DeM) functions. It is based on the principles set out in the International Monetary Fund (IMF) and World Bank guidelines for public debt management, initially published in 2001 and updated in 2003. It is modeled after the Public Expenditure and Financial Accountability (PEFA) framework for performance measurement of public financial management. The DeMPA has been designed to be a user-friendly tool to undertake an assessment of the strengths and weaknesses in government DeM practices. This guide provides additional background and supporting information so that a no specialist in the area of debt management may undertake a country assessment effectively. The guide can be used by assessors in preparing for and undertaking an assessment. It is particularly useful for understanding the rationale for the inclusion of the indicators, the scoring methodology, and the list of supporting documents or evidence required, and the questions that could be asked for the assessment.Publication Crime and Violence in Central America : A Development Challenge - Main Report(World Bank, 2011-01-01)Crime and violence are now a key development issue for Central American countries. In three nations El Salvador, Guatemala, and Honduras crime rates are among the top five in Latin America. This report argues that successful strategies require actions along multiple fronts, combining prevention and criminal justice reform, together with regional approaches in the areas of drug trafficking and firearms. It also argues that interventions should be evidence based, starting with a clear understanding of the risk factors involved and ending with a careful evaluation of how any planned action might affect future options. In addition, the design of national crime reduction plans and the establishment of national cross-sectoral crime commissions are important steps to coordinate the actions of different government branches, ease cross-sectoral collaboration and prioritize resource allocation. Of equal importance is the fact that national plans offer a vehicle for the involvement of civil society organizations, in which much of the expertise in violence prevention and rehabilitation resides. Prevention efforts need to be complemented by effective law enforcement. The required reforms are no longer primarily legislative in nature because all six countries have advanced toward more transparent adversarial criminal procedures. The second-generation reforms should instead help deliver on the promises of previous reforms by: (i) strengthening key institutions and improving the quality and timeliness of the services they provide to citizens; (ii) improving efficiency and effectiveness while respecting due process and human rights; (iii) ensuring accountability and addressing corruption; (iv) increasing inter-agency collaboration; and (v) improving access to justice, especially for poor and disenfranchised groups. Specific interventions reviewed in the report include: information systems and performance indicators as a prerequisite to improve inter-institutional coordination and information sharing mechanisms; an internal overhaul of court administration and case management to create rapid reaction, one-stop shops; the strengthening of entities that provide legal counseling to the poor and to women; and the promotion of alternative dispute-resolution mechanisms and the implementation of community policing programs.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Argentina Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Argentina Country Climate and Development Report (CCDR) explores opportunities and identifies trade-offs for aligning Argentina’s growth and poverty reduction policies with its commitments on, and its ability to withstand, climate change. It assesses how the country can: reduce its vulnerability to climate shocks through targeted public and private investments and adequation of social protection. The report also shows how Argentina can seize the benefits of a global decarbonization path to sustain a more robust economic growth through further development of Argentina’s potential for renewable energy, energy efficiency actions, the lithium value chain, as well as climate-smart agriculture (and land use) options. Given Argentina’s context, this CCDR focuses on win-win policies and investments, which have large co-benefits or can contribute to raising the country’s growth while helping to adapt the economy, also considering how human capital actions can accompany a just transition.Publication The Mexican Social Protection System in Health(World Bank, Washington DC, 2013-01)With a population of 113 million and a per-capita Gross Domestic Product, or GDP of US$10,064 (current U.S. dollars), Mexico is one of the largest and highest-income countries in Latin America and the Caribbean (LAC). The country has benefited from sustained economic growth during the last decade, which was temporarily interrupted by the financial and economic crisis. Real GDP is projected to grow 3.8 percent and 3.6 percent in 2012 and 2013, respectively (International Monetary Fund, or IMF 2012). Despite this growth, poverty in the country remains high; with half of the population living below the national poverty line. The country is also highly heterogeneous, with large socioeconomic differences across states and across urban and rural areas. In 2010, while the extreme poverty ratio in the Federal District and the states of Colima and Nuevo Leon was below 3 percent, in Chiapas, Guerrero, and Oaxaca it was 25 percent or higher. These large regional differences are also found in other indicators of well-being, such as years of schooling, housing conditions, and access to social services. This case study assesses key features and achievements of the Social Protection System in Health (Sistema de Proteccion Social en Salud) in Mexico, and particularly of its main pillar, Popular Health Insurance (Seguro Popular, PHI). It analyzes the contribution of this policy to the establishment and implementation of universal health coverage in Mexico. In 2003, with the reform of the General Health Law, the PHI was institutionalized as a subsidized health insurance scheme open to the population not covered by the social security schemes. Today, the PHI covers all of its intended affiliates, about 52 million people