Publication: Training Teachers on the Job: What Works and How to Measure It
Loading...
Published
2016-09
ISSN
Date
2016-10-13
Author(s)
Editor(s)
Abstract
A significant body of research demonstrates that teachers and the quality of their teaching are crucial components of student learning. Many teachers in resource-poor environments have limited knowledge, skills, or motivation. Some impact evaluations have shown promising results from interventions to improve the quality of teaching. This paper reviews the existing body of evidence on what kinds of in-service teacher training interventions are most effective, and highlights the knowledge gaps. It reveals the dearth of detail on the nature of teacher training interventions and proposes a standard set of indicators -- the In-Service Teacher Training Survey Instrument—for reporting on such programs as a prerequisite for understanding which interventions lead to improved student learning. Across a set of 26 programs with impact evaluations and student learning results, programs that provide complementary materials, focus on a specific subject, and include follow-up visits tend to show higher gains. Programs that use non-education professionals as trainers tend to have worse outcomes. Statistical power to identify these effects is limited, and use of these standard indicators in future impact evaluations will facilitate more precise inference.
Link to Data Set
Citation
“Popova, Anna; Evans, David K.; Arancibia, Violeta. 2016. Training Teachers on the Job: What Works and How to Measure It. Policy Research Working Paper;No. 7834. © World Bank. http://hdl.handle.net/10986/25150 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication The Evolution of Local Participatory Democracy in Nepal(Washington, DC: World Bank, 2025-11-05)Nepal is, according to its constitution, among the world’s most decentralized countries, with a long and complex tradition of local-level public participation. This paper traces the evolution of Nepal’s modern participatory institutions, examining the extent to which they are “induced” by external interventions versus being “organically” rooted in indigenous practices. The paper identifies three broad phases: an initial focus on participation in project implementation; a subsequent phase that expanded citizen engagement; and a third phase of citizen empowerment, culminating in the 2015 federal constitution, which granted unprecedented local autonomy. The analysis yields five key findings. First, over the past 50 years, successive reforms have progressively expanded opportunities for citizens to influence local decision-making. Second, these reforms have integrated traditional participatory mechanisms into formal institutions of local government. Third, although central-level initiatives exist, most participatory platforms continue to operate at the local level. Fourth, the federal constitution has created a new landscape of local democracy, embedding autonomy and accountability. Fifth, although they are still valued in many ethnic and territorial communities, traditional participatory practices are gradually disappearing. The paper concludes by offering policy recommendations to help donor agencies and governments strengthen Nepal’s democratic trajectory. It argues that effective interventions should build on Nepal’s deep participatory traditions while recognizing the constitutional reality of far-reaching local autonomy.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication Closing the Gender Gap in Entrepreneurship: Overcoming Challenges in Law and Practice for Female Entrepreneurs(Washington, DC: World Bank, 2026-01-07)Despite significant strides toward gender equality, women around the world continue to encounter systemic obstacles that hinder their entrepreneurial success. This paper systematically reviews the literature on the barriers female entrepreneurs face and the solutions proposed to overcome these challenges. It discusses institutional factors, financial factors, human capital factors, and social and cultural factors. The literature overview is complemented by a series of stylized facts that illustrate how overcoming some of these existing barriers is correlated with improved women’s entrepreneurship and female labor force participation, drawing on the World Bank’s Women, Business and the Law database as well as the World Bank’s Enterprise Surveys. The findings underscore the need for creating an enabling environment where women can thrive as entrepreneurs.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Teacher Professional Development around the World(World Bank, Washington, DC, 2018-08)Teachers, like all professionals, require ongoing professional development opportunities to improve their skills. This paper provides evidence on effective professional development characteristics and how at-scale programs incorporate those characteristics. The authors propose a standard set of 70 indicators—the In-Service Teacher Training Survey Instrument—for reporting on professional development programs as a prerequisite for understanding the characteristics of those programs that improve student learning. The authors apply the instrument to rigorously evaluated professional development programs in low- and middle-income countries. Across 33 programs, those programs that link participation to career incentives, have a specific subject focus, incorporate lesson enactment in the training, and include initial face-to-face training tend to show higher student learning gains. In qualitative interviews, program implementers also report follow-up visits as among the most effective characteristics of their professional development programs. The authors then apply the instruments to a sample of 139 government-funded, at-scale professional development programs across 14 countries. This analysis uncovers a sharp gap between the characteristics of teacher professional development programs that evidence suggests are effective and the global realities of most teacher professional development programs.Publication Teacher Professional Development around the World(Published by Oxford University Press on behalf of the World Bank, 2021-06-04)Many teachers in low- and middle-income countries lack the skills to teach effectively, and professional development (PD) programs are the principal tool that governments use to upgrade those skills. At the same time, few PD programs are evaluated, and those that are evaluated show highly varying results. This paper proposes a set of indicators—the In-Service Teacher Training Survey Instrument—to standardize reporting on teacher PD programs. An application of the instrument to 33 rigorously evaluated PD programs shows that programs that link participation to career incentives, have a specific subject focus, incorporate lesson enactment in the training, and include initial face-to-face training tend to show higher student learning gains. In qualitative interviews, program implementers also report follow-up visits as among the most effective characteristics of their professional development programs. This paper then uses the instrument to present novel data on a sample of 139 government-funded, at-scale professional development programs across 14 countries. The attributes of most at-scale teacher professional development programs differ sharply from those of programs that evidence suggests are effective, with fewer incentives to participate in PD, fewer opportunities to practice new skills, and less follow-up once teachers return to their classrooms.Publication Cost-Effectiveness Measurement in Development : Accounting for Local Costs and Noisy Impacts(World Bank Group, Washington, DC, 2014-09)As evidence from rigorous impact evaluations grows in development, there have been more calls to complement impact evaluation analysis with cost analysis, so that policy makers can make investment decisions based on costs as well as impacts. This paper discusses important considerations for implementing cost-effectiveness analysis in the policy making process. The analysis is applied in the context of education interventions, although the findings generalize to other areas. First, the paper demonstrates a systematic method for characterizing the sensitivity of impact estimates. Second, the concept of context-specificity is applied to cost measurement: program costs vary greatly across contexts -- both within and across countries -- and with program complexity. The paper shows how adapting a single cost ingredient across settings dramatically shifts cost-effectiveness measures. Third, the paper provides evidence that interventions with fewer beneficiaries tend to have higher per-beneficiary costs, resulting in potential cost overestimates when extrapolating to large-scale applications. At the same time, recall bias may result in cost underestimates. The paper also discusses other challenges in measuring and extrapolating cost-effectiveness measures. For cost-effectiveness analysis to be useful, policy makers will require detailed, comparable, and timely cost reporting, as well as significant effort to ensure costs are relevant to the local environment.Publication Orphans and Ebola : Estimating the Secondary Impact of a Public Health Crisis(World Bank Group, Washington, DC, 2015-02)The 2014 Ebola Virus Disease outbreak in West Africa is the largest to date by far. Ebola Virus Disease causes disproportionate mortality among the working-age population, resulting in far more mortality for parents of young children than other health crises. This paper combines data on the age distribution of current and projected mortality from Ebola with the fertility distribution of adults in Guinea, Liberia, and Sierra Leone, to estimate the likely impact of the epidemic on the number of orphans in these three countries. Using the latest mortality estimates (from February 11, 2015), it is estimated that more than 9,600 children have lost one or both parents to Ebola Virus Disease. The absolute numbers of orphans created by the Ebola epidemic are significant, but represent a small fraction (1.4 percent) of the existing orphan burden in the affected countries. Ebola is unlikely to increase the numbers of orphans beyond extended family networks' capacities to absorb them. Nonetheless, the pressures of caring for increased numbers of orphans may result in lower quality of care. These estimates should be used to guide policy to support family networks to improve the capacity to provide high quality care to orphans.Publication The Next Wave of Deaths from Ebola?(World Bank, Washington, DC, 2015-07)The ongoing Ebola outbreak in West Africa has put a huge strain on already weak health systems. Ebola deaths have been disproportionately concentrated among health care workers, exacerbating existing skill shortages in Guinea, Liberia, and Sierra Leone in a way that will negatively affect the health of the populations even after Ebola has been eliminated. This paper combines data on cumulative health care worker deaths from Ebola, the stock of health care workers and mortality rates pre-Ebola, and coefficients that summarize the relationship between health care workers in a given country and rates of maternal, infant, and under-five mortality. The paper estimates how the loss of health care workers to Ebola will likely affect non-Ebola mortality even after the disease is eliminated. It then estimates the size of the resource gap that needs to be filled to avoid these deaths, and to reach the minimum thresholds of health coverage described in the Millennium Development Goals. Maternal mortality could increase by 38 percent in Guinea, 74 percent in Sierra Leone, and 111 percent in Liberia due to the reduction in health personnel caused by the epidemic. This translates to an additional 4,022 women dying per year across the three most affected countries. To avoid these deaths, 240 doctors, nurses, and midwives would need to be immediately hired across the three countries. This is a small fraction of the 43,565 doctors, nurses, and midwives that would need to be hired to achieve the adequate health coverage implied by the Millennium Development Goals. Substantial investment in health systems is urgently required not only to improve future epidemic preparedness, but also to limit the secondary health effects of the current epidemic owing to the depletion of the health workforce.
Users also downloaded
Showing related downloaded files
Publication Digital Africa(Washington, DC: World Bank, 2023-03-13)All African countries need better and more jobs for their growing populations. "Digital Africa: Technological Transformation for Jobs" shows that broader use of productivity-enhancing, digital technologies by enterprises and households is imperative to generate such jobs, including for lower-skilled people. At the same time, it can support not only countries’ short-term objective of postpandemic economic recovery but also their vision of economic transformation with more inclusive growth. These outcomes are not automatic, however. Mobile internet availability has increased throughout the continent in recent years, but Africa’s uptake gap is the highest in the world. Areas with at least 3G mobile internet service now cover 84 percent of Africa’s population, but only 22 percent uses such services. And the average African business lags in the use of smartphones and computers as well as more sophisticated digital technologies that catalyze further productivity gains. Two issues explain the usage gap: affordability of these new technologies and willingness to use them. For the 40 percent of Africans below the extreme poverty line, mobile data plans alone would cost one-third of their incomes—in addition to the price of access devices, apps, and electricity. Data plans for small- and medium-size businesses are also more expensive than in other regions. Moreover, shortcomings in the quality of internet services—and in the supply of attractive, skills-appropriate apps that promote entrepreneurship and raise earnings—dampen people’s willingness to use them. For those countries already using these technologies, the development payoffs are significant. New empirical studies for this report add to the rapidly growing evidence that mobile internet availability directly raises enterprise productivity, increases jobs, and reduces poverty throughout Africa. To realize these and other benefits more widely, Africa’s countries must implement complementary and mutually reinforcing policies to strengthen both consumers’ ability to pay and willingness to use digital technologies. These interventions must prioritize productive use to generate large numbers of inclusive jobs in a region poised to benefit from a massive, youthful workforce—one projected to become the world’s largest by the end of this century.Publication What Matters Most for Education Management Information Systems : A Framework Paper(World Bank Group, Washington, DC, 2014-06)The main objective of this paper is to outline what matters most for an effective education management information system (EMIS). It presents the conceptual background and operational tools for the Systems Approach for Better Education Results (SABER)-EMIS domain. These tools are intended for use by government education policy makers to assess policy areas of relevance to a country s EMIS against international best practices. This paper begins with an introduction of the domain and the rationale for an EMIS benchmarking tool. Chapter 1 then provides an overview of current data-related demands to improve education, explains how an EMIS meets those data demands, and highlights examples of specific system s in action. Chapter 2 outlines what matters in an EMIS, starting with an explanation of what comprises the construct validity and theoretical underpinnings for benchmarking an EMIS. This chapter shows that the guiding principles behind an EMIS drive actionable policies. A detailed description of four policy areas specifically, the enabling environment, system soundness, data quality, and utilization for decision making then follows in chapter 3. The chapter describes the rubric for the SABER-EMIS Tool and gives a brief overview of an EMIS benchmarking pilot, which demonstrated the feasibility of the concept. The last chapter describes how an EMIS is benchmarked, scored, and subsequently leads to a situation analysis. This assessment sequence provides an understanding of the strength and weaknesses of an EMIS system for fuller, more comprehensive depiction of its status. Overall, this paper evaluates whether a management information system is set up to use the information it generates for improving operational efficiency and educational quality.Publication Economic Regulation of Urban Water and Sanitation Services : Some Practical Lessons(World Bank, Washington, DC, 2007-04)This paper discusses the regulation of water and sanitation services in urban areas. Specifically, it explores ways of thinking about regulatory design as part of a wider, country-specific program to reform the way in which water supply and sanitation services are provided and paid for. In the past, regulatory advisers often focused on the need to introduce international best practice- generally in the form of an independent regulatory organization-to solve a wide range of performance problems. However, this approach was seldom straightforward, nor was it always successful. There is no one-size-fits-all regulatory design that can be reliably applied to resolve performance problems. Rather, regulation is best developed on a country-by-country basis through answering questions such as the following: a) What are the real sector problems, and which of these can regulation solve? b) What specific objectives is regulation aiming to achieve? c) What combination of organizations and instruments is most suitable and would work best for achieving these regulatory objectives? This paper is not intended to be a detailed guide for regulatory design. Rather, it discusses how to approach regulatory design. This approach encourages decision makers and their advisors to apply sound principles within country-specific settings, rather than advocate best-practice models without a thorough analysis of whether these are suitable for the country's context. The best combination of rules and institutions for setting tariffs and service standards3,-and indeed, the best reform options in general-will vary from country to country. Regulatory designers should select this combination by first focusing on the principal sector objectives and working with institutions that may already be responsible for achieving them.Publication Global Economic Prospects, January 2024(Washington, DC: World Bank, 2024-01-09)Note: Chart 1.2.B has been updated on January 18, 2024. Chart 2.2.3 B has been updated on January 14, 2024. Global growth is expected to slow further this year, reflecting the lagged and ongoing effects of tight monetary policy to rein in inflation, restrictive credit conditions, and anemic global trade and investment. Downside risks include an escalation of the recent conflict in the Middle East, financial stress, persistent inflation, weaker-than-expected activity in China, trade fragmentation, and climate-related disasters. Against this backdrop, policy makers face enormous challenges. In emerging market and developing economies (EMDEs), commodity exporters face the enduring challenges posed by fiscal policy procyclicality and volatility, which highlight the need for robust fiscal frameworks. Across EMDEs, previous episodes of investment growth acceleration underscore the critical importance of macroeconomic and structural policies and an enabling institutional environment in bolstering investment and long-term growth. At the global level, cooperation needs to be strengthened to provide debt relief, facilitate trade integration, tackle climate change, and alleviate food insecurity.Publication World Development Report 1984(New York: Oxford University Press, 1984)Long-term needs and sustained effort are underlying themes in this year's report. As with most of its predecessors, it is divided into two parts. The first looks at economic performance, past and prospective. The second part is this year devoted to population - the causes and consequences of rapid population growth, its link to development, why it has slowed down in some developing countries. The two parts mirror each other: economic policy and performance in the next decade will matter for population growth in the developing countries for several decades beyond. Population policy and change in the rest of this century will set the terms for the whole of development strategy in the next. In both cases, policy changes will not yield immediate benefits, but delay will reduce the room for maneuver that policy makers will have in years to come.