Publication: When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country
Loading...
Published
2022-02
ISSN
Date
2022-02-10
Editor(s)
Abstract
Children in developing countries have deep deficits in math and language. Personalized coaching for teachers has been proposed as a way of raising teacher quality and child achievement. The authors designed a coaching program that focused on one aspect of teacher quality—teacher-child interactions—that researchers in education and psychology have argued is critical for child development and learning. The coaching program was implemented in Ecuador, with 100 1st grade teachers randomly assigned to treatment and 100 to control. Coaching improved the quality of teacher-child interactions but reduced child achievement. These results underline the importance of evaluating new forms of professional development for teachers, even those that follow best practice, before these interventions are taken to scale.
Link to Data Set
Citation
“Carneiro, Pedro; Cruz-Aguayo, Yyannu; Intriago, Ruthy; Ponce, Juan; Schady, Norbert; Schodt, Sarah. 2022. When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country. Policy Research Working Paper;No. 9926. © World Bank. http://hdl.handle.net/10986/36966 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication Climate and Social Sustainability in Fragility, Conflict, and Violence Contexts(Washington, DC: World Bank, 2026-01-07)Climate change is widely recognized as a driver of violent conflict, but its broader social effects remain less understood. Ignoring these dimensions risks a vicious cycle where climate policies might undermine socially just adaptation. Evidence is still limited on how climate shocks influence political participation, trust, or migration. This paper helps fill that gap by examining links between climate change, conflict, and social sustainability, with a focus on inclusion, resilience, cohesion, and legitimacy. Using secondary data from 2019–24, the study applies simple correlation-based methods to test three hypotheses on the nature, severity, and composition of these associations. The analysis combines multiple climate impact measures, new conflict classifications, recent social sustainability frameworks, and controls for population and geography. The results reveal strong correlations—not causation—between climate events and contexts of fragility, conflict, and violence. Climate impacts are most pronounced in both national and subnational conflict settings. The study also finds robust links between fragility, conflict, and violence and low levels of social sustainability, reflecting its role as both a driver and consequence of conflict. Some dimensions—such as violent events and insecurity—appear weaker in areas most affected by climate shocks. Two of the hypotheses are supported, and one remains inconclusive.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Institutional Capacity for Policy Implementation: An Analytical Framework(Washington, DC: World Bank, 2026-01-07)State capacity is an important prerequisite for policy implementation, yet at the country level it is difficult to measure, assess, and reform. This paper proposes a focus on institutional capacity: the ability of public institutions to implement the specific policy mandates for which they are responsible. Based on a review of existing literature, the paper defines the different dimensions that compose institutional capacity and groups them into two cross-cutting categories: organizational dimensions (personnel, financial resources, information systems, and management practices) and governance dimensions (transparency, independence, and accountability). The paper proposes measures for organizational and governance dimensions using existing data, shows intra-institutional variation of these measures within countries, and discusses how new data could be collected for better measurement of these concepts. Finally, the paper illustrates how the framework can be used to diagnose the sources of common problems related to weak policy implementation.Publication South Africa’s Fragmented Cities: The Unequal Burden of Labor Market Frictions(Washington, DC: World Bank, 2026-01-08)Using high-resolution administrative, census, and satellite data, this paper shows that South African cities are characterized by spatial mismatches between where people live and where jobs are located, relative to 20 global peers. Areas within 5 kilometers of commercial centers have 9,300 fewer residents per square kilometer than expected, which is 60 percent below the global median. Poor, dense neighborhoods are most affected. In Johannesburg, a 10-percentile increase in distance from the nearest business hub corresponds to a 3.7-percentile drop in asset wealth (a proxy of household wellbeing) and 4.9-percentile drop in employment. In Cape Town, the declines are 4.0 and 3.7 percentiles, respectively. Employment is 87 percent lower in the poorest decile than the richest in Johannesburg and 61 percent lower in Cape Town. These findings suggest that South Africa’s spatial organization of people and economic activity constrains agglomeration and reinforces inequality. This methodology provides a scalable and standardized data-driven framework to analyze spatial accessibility and agglomeration frictions in complex, data-constrained urban systems.Publication Investment in Emerging and Developing Economies(Washington, DC: World Bank, 2026-01-07)The world faces a pressing challenge to meet key development objectives amid slowing growth and rising macroeconomic and geopolitical risks. With the number of job seekers rising rapidly, infrastructure shortfalls continuing to be large, and climate costs mounting, the case for a significant investment push has never been stronger. Yet the capacity to respond in many emerging markets and developing economies has eroded. Since the global financial crisis, investment growth has slowed to about half its pace in the 2000s, with both public and private investment weakening. Foreign direct investment inflows—a critical source of capital, technology, and managerial know-how—have also fallen sharply and become increasingly concentrated, leaving low-income countries with only a marginal share. The risks of further retrenchment are significant, as trade tensions, policy uncertainty, and elevated debt levels continue to weigh on investment. Reigniting momentum will require ambitious domestic reforms to strengthen institutions, rebuild macro-fiscal stability, and deepen trade and investment integration—the foundations of a supportive business climate. At the same time, international cooperation is indispensable. A renewed commitment to a predictable system of cross-border trade and investment flows, combined with scaled-up financial support and sustained technical assistance, is essential to help emerging markets and developing economies—especially low-income countries and economies in fragile and conflict situations—bridge financing gaps and implement the domestic reforms needed to restore investment as an engine of growth, jobs, and development.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication The Impact of Cash Transfers on School Enrollment : Evidence from Ecuador(World Bank, Washington, DC, 2008-06)This paper presents evidence about the impact on school enrollment of a program in Ecuador that gives cash transfers to the 40 percent poorest families. The evaluation design consists of a randomized experiment for families around the first quintile of the poverty index and of a regression discontinuity design for families around the second quintile of this index, which is the program's eligibility threshold. This allows us to compare results from two different credible identification methods, and to investigate whether the impact varies with families' poverty level. Around the first quintile of the poverty index the impact is positive while it is equal to zero around the second quintile. This suggests that for the poorest families the program lifts a credit constraint while this is not the case for families close to the eligibility threshold.Publication School Grants and Education Quality(World Bank, Washington, DC, 2016-04)The effect of increasing school resources on educational outcomes is a central issue in the debate on improving school quality. This paper uses a randomized experiment to analyze the impact of a school grants program in Senegal, which allowed schools to apply for funding for improvements of their own choice. The analysis finds positive effects on test scores at lower grades that persist at least two years. These effects are concentrated among schools that focused funds on human resource improvements rather than school materials, suggesting that teachers and principals may be a central determinant of school quality.Publication Convexity and Sheepskin Effects in the Human Capital Earnings Function : Recent Evidence for Filipino Men(World Bank, Washington, DC, 2001-03)Much attention has been paid to the issue of possible nonlinearities in the relationship between log wages and schooling in the literature on both the United States and developing countries. The author uses data from a recent household survey for the Philippines, the 1998 Annual Poverty Indicator Survey, to test the fit of the log-linear specification for Filipino men. He presents results based on various estimation strategies, including spline regressions and semi-parametric regressions with a large number of dummy variables for years of schooling and experience. He concludes that: 1) There appear to be large differences between rates of return to education across different levels in the Philippines. The wage premia for both primary and secondary education are significantly smaller than those for tertiary education. 2) Within each level - primary, secondary, and university - the last year of schooling is disproportionately rewarded in higher wages. That is, there appear to be clear sheepskin effects associated with graduation.Publication Getting Girls into School : Evidence from a Scholarship Program in Cambodia(World Bank, Washington, DC, 2006-05)Increasing the schooling attainment of girls is a challenge in much of the developing world. The authors evaluate the impact of a program that gives scholarships to girls making the transition between the last year of primary school and the first year of secondary school in Cambodia. They show that the scholarship program had a large, positive effect on the school enrollment and attendance of girls. Their preferred set of estimates suggests program effects on enrollment and attendance at program schools of 30 to 43 percentage points. Scholarship recipients were also more likely to be enrolled at any scchool (not just program schools) by a margin of 22 to 33 percentage points. The impact of the Japan Fund for Poverty Reduction (JFPR) program appears to have been largest among girls with the lowest socioeconomic status at baseline. The results are robust to a variety of controls for observable differences between scholarship recipients and nonrecipients, to unobserved heterogeneity across girls, and to selective attrition out of the sample.Publication Conditional Cash Transfers : Reducing Present and Future Poverty(Washington, DC: World Bank, 2009)The report shows that there is good evidence that conditional cash transfers (CCTs) have improved the lives of poor people. Transfers generally have been well targeted to poor households, have raised consumption levels, and have reduced poverty, by a substantial amount in some countries. Offsetting adjustments that could have blunted the impact of transfers, such as reductions in the labor market participation of beneficiaries, have been relatively modest. Moreover, CCT programs often have provided an entry point to reforming badly targeted subsidies and upgrading the quality of safety nets. The report thus argues that CCTs have been an effective way to redistribute income to the poor, while recognizing that even the best-designed and best-managed program cannot fulfill all of the needs of a comprehensive social protection system. CCTs therefore need to be complemented with other interventions, such as workfare or employment programs and social pensions. The report also considers the rationale for conditioning the transfers on the use of specific health and education services by program beneficiaries. Conditions can be justified if households are under investing in the human capital of their children, for example, if they hold incorrect beliefs about the returns to these investments; if there is "incomplete altruism" between parents and their children; or if there are large externalities to investments in health and education. Political economy considerations also may favor conditional over unconditional transfers: taxpayers may be more likely to support transfers to the poor if they are linked to efforts to overcome poverty in the long term, particularly when the efforts involve actions to improve the welfare of children.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2022(Washington, DC: World Bank, 2022-02-15)World Development Report 2022: Finance for an Equitable Recovery examines the central role of finance in the economic recovery from COVID-19. Based on an in-depth look at the consequences of the crisis most likely to affect low- and middle-income economies, it advocates a set of policies and measures to mitigate the interconnected economic risks stemming from the pandemic—risks that may become more acute as stimulus measures are withdrawn at both the domestic and global levels. Those policies include the efficient and transparent management of nonperforming loans to mitigate threats to financial stability, insolvency reforms to allow for the orderly reduction of unsustainable debts, innovations in risk management and lending models to ensure continued access to credit for households and businesses, and improvements in sovereign debt management to preserve the ability of governments to support an equitable recovery.Publication World Development Report 2023: Migrants, Refugees, and Societies(Washington, DC : World Bank, 2023-04-25)Migration is a development challenge. About 184 million people—2.3 percent of the world’s population—live outside of their country of nationality. Almost half of them are in low- and middle-income countries. But what lies ahead? As the world struggles to cope with global economic imbalances, diverging demographic trends, and climate change, migration will become a necessity in the decades to come for countries at all levels of income. If managed well, migration can be a force for prosperity and can help achieve the United Nations’ Sustainable Development Goals. World Development Report 2023 proposes an innovative approach to maximize the development impacts of cross-border movements on both destination and origin countries and on migrants and refugees themselves. The framework it offers, drawn from labor economics and international law, rests on a “Match and Motive Matrix” that focuses on two factors: how closely migrants’ skills and attributes match the needs of destination countries and what motives underlie their movements. This approach enables policy makers to distinguish between different types of movements and to design migration policies for each. International cooperation will be critical to the effective management of migration.Publication World Development Report 2021(Washington, DC: World Bank, 2021-03-24)Today’s unprecedented growth of data and their ubiquity in our lives are signs that the data revolution is transforming the world. And yet much of the value of data remains untapped. Data collected for one purpose have the potential to generate economic and social value in applications far beyond those originally anticipated. But many barriers stand in the way, ranging from misaligned incentives and incompatible data systems to a fundamental lack of trust. World Development Report 2021: Data for Better Lives explores the tremendous potential of the changing data landscape to improve the lives of poor people, while also acknowledging its potential to open back doors that can harm individuals, businesses, and societies. To address this tension between the helpful and harmful potential of data, this Report calls for a new social contract that enables the use and reuse of data to create economic and social value, ensures equitable access to that value, and fosters trust that data will not be misused in harmful ways. This Report begins by assessing how better use and reuse of data can enhance the design of public policies, programs, and service delivery, as well as improve market efficiency and job creation through private sector growth. Because better data governance is key to realizing this value, the Report then looks at how infrastructure policy, data regulation, economic policies, and institutional capabilities enable the sharing of data for their economic and social benefits, while safeguarding against harmful outcomes. The Report concludes by pulling together the pieces and offering an aspirational vision of an integrated national data system that would deliver on the promise of producing high-quality data and making them accessible in a way that promotes their safe use and reuse. By examining these opportunities and challenges, the Report shows how data can benefit the lives of all people, but particularly poor people in low- and middle-income countries.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Western Balkans 6 Country Climate and Development Report(Washington, DC: World Bank Group, 2024-07-16)This Regional Western Balkans Countries Climate and Development Report (CCDR) stands out in several ways. In a region that often lacks cohesive regional alliances, this report emphasizes how the challenges faced across countries are often common and interconnected, and, importantly, that climate action requires coordination on multiple fronts. Simultaneously, it illustrates the differences across countries, places, and people that require targeted strategies and interventions. This report demonstrates how shocks and stressors re intensifying and how investments in adaptation could bring significant benefits in the form of avoided losses, accelerated economic potential, and amplified social and economic spillovers. Given the region’s high emission and energy intensity and the limitations of its current fossil fuel-based development model, the report articulates a path to greener and more resilient growth, a path that is more consistent with the aspiration of accession to the EU. The report finds that the net zero transition can be undertaken without compromising the economic potential of the Western Balkans and that it could lead to higher growth than under the Reference Scenario (RS) with appropriate structural reforms.