Publication: A Practicioner's Guide to Evaluating the Impacts of Labor Market Programs
Loading...
Published
2009-12
ISSN
Date
2012-08-13
Author(s)
Editor(s)
Abstract
This note provides an introduction to the impact evaluation of labor market programs, with particular reference to developing countries. Its focus is on the main issues that need to be considered when planning an impact evaluation, including the importance of rigorous design for an evaluation, and on the statistical techniques used to estimate program impacts. To help the exposition, a prototype of a training program is referred to intermittently throughout the note. This hypothetical training program, which authors call get-to-work, provides training to the unemployed to help them find work. The note describes some general issues that are important for any impact evaluation of employment programs, both in the design and analysis stages, regardless of the specific evaluation techniques used. It then describes the main evaluation techniques, including the data requirements and the main assumptions invoked by each.
Link to Data Set
Citation
“Fitzsimons, Emla; Vera-Hernandez, Marcos. 2009. A Practicioner's Guide to Evaluating the Impacts of Labor Market Programs. World Bank Employment Policy Primer; No. 12. © World Bank. http://hdl.handle.net/10986/11713 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Minimum Wages in Developing Countries : Helping or Hurting Workers?(World Bank, Washington, DC, 2008-12)This policy note reviews the literature on the effects of minimum wages on labor markets in developing countries. The authors begin by elucidating the challenges to ascertaining these effects, especially in developing economies where a large segment of the workforce is not covered by minimum wage legislation (uncovered sector). After summarizing the theoretical models and their predictions, the authors review the empirical evidence of the impact of minimum wage legislation on wages, employment, and unemployment in the covered and uncovered sectors of the labor market. The evidence strongly suggests that an increase in the minimum wage tends to have a positive wage effect and a small negative employment effect among workers covered by minimum wage legislation and that the effects tend to be stronger among low-wage workers. The findings are quite limited and fairly inconclusive on the indirect effects of increases in minimum wages on workers in the uncovered sectors, where the legislation either does not apply or is not complied with.Publication Making Work Pay in Nicaragua : Employment, Growth, and Poverty Reduction(Washington, DC : World Bank, 2008)The objective of this report is to provide some policy guidelines for the fight against poverty. In particular, it hopes to be able to identify the growing sectors, as well as the constraints faced by the poor in benefiting from this growth. The report is part of a series of studies conducted within the Poverty Reduction Group (PRMPR) to foster understanding of the role of employment earnings and labor markets in shared growth. In addition, it is intended to function as a background document for the World Bank's Nicaragua Poverty Assessment 2007. The degree to which growth is able to translate into poverty reduction depends on how its benefits are distributed among different segments of society. There is little doubt that growth measured by changes in average income contributes significantly to poverty reduction. However, it is also clear that countries differ in the degree to which income growth spells have translated into poverty reduction. Although differences in the responsiveness of poverty to income growth account for a small fraction of the overall differences in poverty changes across countries, from the point of view of an individual country, these differences may have significant implications for poverty reduction, especially in the short term.Publication Are Skills Rewarded in Sub-Saharan Africa? Determinants of Wages and Productivity in the Manufacturing Sector(World Bank, Washington, DC, 2008-08)Using recent matched employer-employee data from the manufacturing sector in 20 Sub-Saharan African countries, the authors analyze how the supply of skills and legal origin of the country affect the wage setting process. The wage analysis yields three main findings. First, increasing returns to education, especially for older workers, suggest that the expansion of education in Africa has reduced returns to education for entrants in the labor market. Second, age effects matter not just for returns to education, but also for the wage setting process more generally. In particular, in civil-law countries, returns to seniority are rewarded only after a certain age. Third, workers exercise some power in the wage setting process but their influence varies by linguistic group. In common-law countries, union presence benefits all workers equally, not just members, whereas in civil-law countries, only older members enjoy higher wages. The authors also contrast wage premia with relative marginal productivities for different age, occupation, and education categories. The findings show that in general, older, highly educated, and highly ranked workers receive wage premia that do not reflect a higher relative marginal productivity.Publication Labor Market Policy in Developing Countries : A Selective Review of the Literature and Needs for the Future(World Bank, Washington, DC, 2007-09)This paper presents a selective overview of the literature on modeling labor market policies in developing countries. It considers welfare economics, theoretical models, and empirical evidence to highlight the three general features needed in future research on labor market policy in developing countries. The author identifies desirable research components (welfare economics, theoretical modeling, and empirical modeling) and pitfalls in the literature (inappropriate use of productivity, reliance on wrong kinds of empirical studies, lack of cost-benefit analysis, attention to only a subset of the goods and bads, and fallacy of composition). The paper concludes with suggested topics and methods for future research. The author states that sound labor market policy requires sound labor market models. The paper makes a case for developing policy based on explicit evaluation criteria, specific theoretical models, and comprehensive empirical evidence.Publication Wage Subsidy and Labor Market Flexibility in South Africa(2009-03-01)In this paper, the authors use a highly disaggregate general equilibrium model to analyze the feasibility of a wage subsidy to unskilled workers in South Africa, isolating and estimating its potential employment effects and fiscal cost. They capture the structural characteristics of the labor market with several labor categories and substitution possibilities, linking the economy-wide results on relative prices, wages, and employment to a micro-simulation model with occupational choice probabilities in order to investigate the poverty and distributional consequences of the policy. The impact of a wage subsidy on employment, poverty, and inequality in South Africa depends greatly on the elasticities of substitution of factors of production, being very minimal if unskilled and skilled labor are complements in production. The desired results are attainable only if there is sufficient flexibility in the labor market. Although the impact in a low case scenario can be improved by supporting policies that relax the skill constraint and increase the production capacity of the economy especially towards labor-intensive sectors, the gains from a wage subsidy are still modest if the labor market remains very rigid.
Users also downloaded
Showing related downloaded files
Publication Doing Business 2013 : Smarter Regulations for Small and Medium-Size Enterprises(Washington, DC: World Bank, 2013)Tenth in a series of annual reports comparing business regulation in 185 economies, Doing Business 2013 measures regulations affecting 11 areas of everyday business activity: Starting a business, Dealing with construction permits, Getting electricity, Registering property, Getting credit, Protecting investors, Paying taxes, Trading across borders, Enforcing contracts, Closing a business, Employing workers. The report updates all indicators as of June 1, 2012, ranks economies on their overall “ease of doing business”, and analyzes reforms to business regulation – identifying which economies are strengthening their business environment the most. The Doing Business reports illustrate how reforms in business regulations are being used to analyze economic outcomes for domestic entrepreneurs and for the wider economy. This year marks the tenth anniversary of the global Doing Business report. Doing Business is a flagship product by the World Bank and IFC that garners worldwide attention on regulatory barriers to entrepreneurship. More than 60 economies use the Doing Business indicators to shape reform agendas and monitor improvements on the ground. In addition, the Doing Business data has generated over 870 articles in peer-reviewed academic journals since its inception.Publication Minimum Wages in Developing Countries : Helping or Hurting Workers?(World Bank, Washington, DC, 2008-12)This policy note reviews the literature on the effects of minimum wages on labor markets in developing countries. The authors begin by elucidating the challenges to ascertaining these effects, especially in developing economies where a large segment of the workforce is not covered by minimum wage legislation (uncovered sector). After summarizing the theoretical models and their predictions, the authors review the empirical evidence of the impact of minimum wage legislation on wages, employment, and unemployment in the covered and uncovered sectors of the labor market. The evidence strongly suggests that an increase in the minimum wage tends to have a positive wage effect and a small negative employment effect among workers covered by minimum wage legislation and that the effects tend to be stronger among low-wage workers. The findings are quite limited and fairly inconclusive on the indirect effects of increases in minimum wages on workers in the uncovered sectors, where the legislation either does not apply or is not complied with.Publication Labor Supply and Retirement Policy in an Overlapping Generations Model with Stochastic Fertility(2010-07-01)Using a stochastic general equilibrium model with overlapping generations, this paper studies a policy rule for the retirement age aiming at offsetting the effects on the supply of labor following fertility changes. The authors find that the retirement age should increase more than proportionally to the direct fall in labor supply caused by a fall in fertility. The robustness of this result is checked against alternative model specifications and parameter values. The efficacy of the policy rule depends crucially on the link between the preference for leisure and the response of the intensive margin of labor supply to changes in the statutory retirement age. The model has subsequently been calibrated for Brazil by Jorgensen (2010), in the context of the Brazil Aging Study.Publication Taxes, Spending, and Equity: International Patterns and Lessons for Developing Countries(Washington, DC: World Bank, 2025-11-17)Taxes and public spending underpin the basic administration of government and finance the human capital and infrastructure investments needed for economic growth. They can also have a significant and immediate impact on poverty and inequality. The question of how public finance can support longer-term growth objectives while promoting equity has become even more important in recent years, given the high fiscal deficits and debt levels most countries emerged with in the aftermath of the COVID-19 pandemic. These included the increasing cost of debt and the need to restart environmentally sustainable growth while helping households address the learning losses and other social scars caused by the pandemic. This paper examines the global evidence on which households pay which taxes and who benefits from what spending, and critically, the net effect on different households across the income distribution. The aim is to identify the patterns and lessons that emerge for designing progressive fiscal policies. A global dataset of 96 countries is assembled, spanning all regions of the world and all national income levels, grounded in the Commitment to Equity (CEQ) approach to fiscal incidence.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.