Publication: Measuring Jobs Impacts: A Decision Framework and Available Methods
Loading...
Published
2023-12-21
ISSN
Date
2023-12-21
Author(s)
Editor(s)
Abstract
Economists and policy analysts have devised a wide variety of techniques to determine the impacts of various interventions on labor market outcomes. However, determining which evaluation technique should be implemented for a particular intervention requires a thorough understanding of the context and nature of the intervention, labor market structure and dynamics, and the universe of available impact measurement techniques. This report develops a standardized and transparent decision-making procedure for selecting feasible and appropriate techniques for evaluating the labor market impacts of an intervention. The decision-making procedure was developed by drawing on lessons from recent pilot studies undertaken by the World Bank.
Link to Data Set
Citation
“Lloyd-Ellis, Huw; Kashi, Bahman; Crowley, Brett. 2023. Measuring Jobs Impacts: A Decision Framework and Available Methods. Jobs Guide; Issue 8. © World Bank. http://hdl.handle.net/10986/40792 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Integrating Qualitative Methods into Investment Climate Impact Evaluations(World Bank Group, Washington, DC, 2014-12)Incorporating qualitative methods into the evaluation of development programs has become increasingly popular in recent years, both for the distinctive insights such approaches can bring in their own right and because of their capacity to complement the strengths -- and where necessary correct some of the weaknesses -- of quantitative approaches. Some initial work deploying mixed methods has been undertaken in the assessment of investment climate reforms, but considerable room for expansion exists. This paper summarizes some of the key principles and practices underpinning mixed methods evaluations in development, highlight some notable examples of how such work has been conducted (and the particular contributions it has made), and offers some guidelines for those seeking to increase the sophistication and utility of qualitative methods in the evaluation of investment climate reforms.Publication Analyzing the Effects of Policy Reforms on the Poor : An Evaluation of the Effectiveness of World Bank Support to Poverty and Social Impact Analyses(Washington, DC: World Bank, 2010)The current global financial and economic crises are likely to put enormous pressure on governments to respond with immediate measures and to undertake far-reaching reforms in the medium term, requiring a substantial increase in donor support. To protect the poor and enhance benefits to them, key policy reforms will need to be underpinned by systematic analysis of their expected poverty and social impacts. The World Bank's experience to date with the Poverty and Social Impact Analysis (PSIA) approach provides useful lessons for addressing these issues. Overall, implementation of the PSIA approach has had considerable limitations. There have been tensions between the various operational objectives assigned to PSIAs. The tensions concern inconsistencies between informing country and Bank policy decisions in a timely way and building country analytic capacity. PSIAs have had limited ownership by Bank staff and managers and have often not been effectively integrated into country assistance programs. Quality assurance, monitoring, and evaluation of the overall effectiveness of PSIAs have been weak. To improve PSIAs' effectiveness, this evaluation recommends that the Bank take measures to ensure that staff fully understands what the PSIA approach is and when to use it, clarify the operational objectives of each PSIA, and ensure that the approach and timeline adopted are aligned with those objectives. Quality assurance mechanisms should be strengthened to ensure that PSIAs are designed to achieve the intended effects.Publication Qualitative Research to Enhance the Evaluation of Results-Based Financing Programmes(World Bank, Washington, DC, 2016-02)This Discussion Paper presents the approach, findings, and recommendations from a desk review of the qualitative research conducted within Results-Based Financing programmes (RBF) under the Health Results Innovations Trust Fund (HRITF). The review included 17 studies conducted in Benin, Burundi, Cameroon, DRC, Ethiopia, Haiti, Kenya, Kyrgyzstan, Nigeria, Rwanda, Tajikistan, Tanzania, Zambia, and Zimbabwe. The studies reveal a body of high quality work that is consistent with the conceptual framework of RBF schemes, supported by political will, resources, and research capacity. Strengthening the added value of qualitative inquiry in on-going and future qualitative studies may be enabled by small shifts in thinking and practice, in line with a qualitative research paradigm. First, in order to better ground research in an existing country and system specific context, some interrogation of constructs and posited relationships in the existing conceptual framework for intervention/evaluation may be required. Second, to enable more in-depth and richer data that documents working practices and relations under RBF schemes, training of local researchers should place stronger emphasis on entry to the field, gaining trust, building rapport, and sustaining a dialogue with key informants. Third, smaller, more intensive and focused studies targeting fewer sites and smaller samples - but addressing a wider range of methods and informants within the health system - are likely to yield richer data that can support the understanding of how health workers and managers are responding to schemes, and what impact schemes have on service volumes and outputs.Publication Poverty and Social Impact Analysis (PSIA) : Reviewing the Link with In-Country Policy and Planning Processes - Synthesis Report(World Bank, 2009-05-01)The synthesis report concerns to go beyond a summary of the country studies to provide lessons and recommendations on how to further improve Poverty and Social Impact Analysis (PSIA) effectiveness. To do so, it draws on findings from country case studies, the literature and recent internal Bank reviews (World Bank 2006, 2008) on PSIA. The synthesis is structured in three parts. Section two reviews the role of PSIA in country work drawing on internal guidance from the Bank and the wider literature. It introduces the PSIA framework and the main elements of an effective PSIA. Section two ends with a presentation of the review framework and the approach to sampling and methodology for the country studies. Section three presents the bulk of the review findings and lessons learned with a focus on lessons for embedding PSIA into country processes. Section four addresses the future of PSIA with recommendations aimed at: (i) improving the influence that PSIA has on policy and planning processes in-country, and (ii) ensuring that it is applied more routinely by partner governments and Bank programs.Publication Reconstructing Baseline Data for Impact Evaluation and Results Measurement(World Bank, Washington, DC, 2010-11)Many international development agencies and some national governments base future budget planning and policy decisions on a systematic assessment of the projects and programs in which they have already invested. Results are assessed through Mid-Term Reviews (MTRs), Implementation Completion Reports (ICRs), or through more rigorous impact evaluations (IE), all of which require the collection of baseline data before the project or program begins. The baseline is compared with the MTR, ICR, or the posttest IE measurement to estimate changes in the indicators used to measure performance, outcomes, or impacts. However, it is often the case that a baseline study is not conducted, seriously limiting the possibility of producing a rigorous assessment of project outcomes and impacts. This note discusses the reasons why baseline studies are often not conducted, even when they are included in the project design and funds have been approved, and describe strategies that can be used to 'reconstruct' baseline data at a later stage in the project or program cycle.
Users also downloaded
Showing related downloaded files
Publication Egypt Country Environmental Analysis(Washington, DC: World Bank, 2024-07-03)Over the last two decades, the Government of Egypt (GOE) has pursued its sustainable and resilient development. The Ministry of Environment (MOE) has improved the governance framework and promoted new policy instruments to meet growing environmental challenges. The Ministry of Environment (MOE) has improved the governance framework and promoted new policy instruments to meet growing environmental challenges. The purpose of this CEA is to help Egypt address some of these environmental challenges by providing strategic guidance to the GOE to achieve green, resilient, and inclusive growth while creating new jobs. This CEA has been developed in consultation with the GOE and has identified short-to medium-term priority areas in: (i) circular economy (CE) for industrial pollution and waste management; (ii) blue economy (BE) with a focus on sustainable coastal zone management; (iii) environmental governance; and (iv) innovative green financing mechanisms targeting the CE and BE. It was conducted by reviewing existing analytical work on environmental management in Egypt, current environmental regulations, strategies, reports, and public data. In addition, consultation workshops, meetings (with government representatives, nongovernmental organizations [NGOs], research institutions, private sector, and key experts), and focus group discussions were carried out to further modify or validate the findings.Publication Measuring Ex Ante Jobs Outcome of the Bangladesh Livestock and Dairy Development Project(Washington, DC: World Bank, 2023-10-20)The livestock sector in Bangladesh plays a significant role in employment, contributing to 14.5 percent of overall employment and over one-third of the agricultural sector's total employment. The Livestock and Dairy Development Project (LDDP), a $579 million initiative funded by the World Bank, aims to create employment opportunities, promote climate-smart practices, and enhance productivity for smallholder farmers. This study's primary goal is to estimate the LDDP's job creation potential using two approaches. The first involved a sample survey of 2045 samples across dairy, cattle, and poultry value chains, while the second employed a social accounting matrix (SAM) multiplier model to estimate national-level job creation. The study used the full-time equivalent (FTE) jobs method to measure job creation, revealing that 100 workers in livestock production create 63 FTE jobs, with unpaid family labor accounting for 46.7 percent, self-employment for 39.2 percent, and wage employment for 14.1 percent. Based on the data collected, the LDDP is expected to create 99,300 additional direct FTE jobs among beneficiary farms. Additionally, the SAM multiplier model indicates that LDDP’s investment in the livestock sector is projected to generate 164,000 additional jobs, with livestock farming activities creating the largest share.Publication Aligning Climate Change Mitigation and Agricultural Policies in Eastern Europe and Central Asia(World Bank, Washington, DC, 2012-06)Greenhouse gas emissions are largely determined by how energy is created and used, and policies designed to encourage mitigation efforts reflect this reality. However, an unintended consequence of an energy-focused strategy is that the set of policy instruments needed to tap mitigation opportunities in agriculture is incomplete. In particular, market-linked incentives to achieve mitigation targets are disconnected from efforts to better manage carbon sequestered in agricultural land. This is especially important for many countries in Eastern Europe and Central Asia where once-productive land has been degraded through poor agricultural practices. Often good agricultural policies and prudent natural resource management can compensate for missing links to mitigation incentives, but only partially. At the same time, two international project-based programs, Joint Implementation and the Clean Development Mechanism, have been used to finance other types of agricultural mitigation efforts worldwide. Even so, a review of projects suggests that few countries in Eastern Europe and Central Asia take full advantage of these financing paths. This paper discusses mitigation opportunities in the region, the reach of current mitigation incentives, and missed mitigation opportunities in agriculture. The paper concludes with a discussion of alternative policies designed to jointly promote mitigation and co-benefits for agriculture and the environment.Publication Energy Subsidy Reform Assessment Framework(World Bank, Washington, DC, 2018-06-30)This note aims to provide an overview and guidance on the use of tools to assess the environmental and health effects of changes in the levels of fine particulate matter caused by higher consumption of energy due to subsidized prices at the country level. It also provides information to help practitioners develop reliable estimates even in the absence of data and with limited resources. The topic of the note is highly complex and involves multiple fields and disciplines. The note attempts to reduce such complexity by breaking the assessment down into several distinct steps, each with its own methodologies. The note is intended to serve as a source of resources and practical advice to guide practitioners along each of these steps. This note focuses the analysis of price subsidies on primary and secondary fine particulate matter (PM2.5, atmospheric particulate matter with a diameter of less than 2.5 microns), the pollutant with the largest health effects worldwide, and using intake fractions to estimate population exposure to PM2.5 from fossil fuels and solid biomass. This approach is like that of recent global studies of energy price subsidies and taxes. The intake fractions are combined with the relative-risk functions for major health outcomes of air pollution from the Global Burden of Disease study to estimate the health effects associated with energy price subsidies. The note proposes three geographic-demographic scales: urban areas with a population over 100,000, urban areas with a population less than 100,000, and rural areas. The note also discusses the availability of monitoring measurement data and alternative options for determining ambient PM2.5 concentrations at the proposed geographic-demographic scale, as well as approaches to deal with data scarcity. The method for estimating the economic value of mortality caused by air pollution follows a recent World Bank report, using a cross-country transfer method of the value of statistical life (VSL). In addition, the note proposes methods for incorporating valuation of increased illness, although morbidity is generally found to constitute a relatively minor share of the health costs of air pollution.Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.