Publication: Through the Looking Glass: Can Classroom Observation and Coaching Improve Teacher Performance in Brazil?
Loading...
Published
2017-07
ISSN
Date
2017-08-24
Author(s)
Editor(s)
Abstract
This study conducted a randomized evaluation of a program in the Brazilian state of Ceara. The program was designed to improve teachers’ effectiveness by increasing their professional interaction and sharing of classroom practice. In 175 of 350 secondary schools, teachers were provided with benchmarked feedback from classroom observations and access to expert coaching. Schools’ uptake of the coaching program was high (85 percent). Over a single school year, the program increased teachers’ time on instruction and student engagement and produced statistically significant gains in student learning on the Ceara state assessment and the national secondary school exit exam. Controlling for individual students’ prior-year learning outcomes, schools exposed to the program had 0.05-0.09 standard deviation higher performance on the state test and 0.04-0.06 standard deviation higher scores on the national test. Implementation fidelity strongly boosted program impacts. In the 49 schools where the pedagogical coordinators achieved the highest certification at the end of the program, student scores were 0.13-0.23 standard deviation higher on the state test and 0.13-0.17 standard deviation higher on the national test. Coaching delivered by Skype kept the costs of the program low, $2.40 per student, and produced cost-effective impacts on learning in comparison with other rigorously evaluated teacher training interventions. The combination of classroom observation feedback and expert coaching appears to be a promising strategy for whole-school efforts to raise teacher effectiveness.
Link to Data Set
Citation
“Costa, Leandro; Bruns, Barbara; Cunha, Nina. 2017. Through the Looking Glass: Can Classroom Observation and Coaching Improve Teacher Performance in Brazil?. Policy Research Working Paper;No. 8156. © World Bank. http://hdl.handle.net/10986/27962 License: CC BY 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Labor Demand in the Age of Generative AI: Early Evidence from the U.S. Job Posting Data(Washington, DC: World Bank, 2025-11-18)This paper examines the causal impact of generative artificial intelligence on U.S. labor demand using online job posting data. Exploiting ChatGPT’s release in November 2022 as an exogenous shock, the paper applies difference-in-differences and event study designs to estimate the job displacement effects of generative artificial intelligence. The identification strategy compares labor demand for occupations with high versus low artificial intelligence substitution vulnerability following ChatGPT’s launch, conditioning on similar generative artificial intelligence exposure levels to isolate substitution effects from complementary uses. The analysis uses 285 million job postings collected by Lightcast from the first quarter of 2018 to the second quarter of 2025Q2. The findings show that the number of postings for occupations with above-median artificial intelligence substitution scores fell by an average of 12 percent relative to those with below-median scores. The effect increased from 6 percent in the first year after the launch to 18 percent by the third year. Losses were particularly acute for entry-level positions that require neither advanced degrees (18 percent) nor extensive experience (20 percent), as well as those in administrative support (40 percent) and professional services (30 percent). Although generative artificial intelligence generates new occupations and enhances productivity, which may increase labor demand, early evidence suggests that some occupations may be less likely to be complemented by generative artificial intelligence than others.Publication The Lasting Effects of Working while in School(Washington, DC: World Bank, 2025-08-18)This paper provides the first experimental evidence on the long-term effects of work-study programs, leveraging a randomized lottery design from a national program in Uruguay. Participation leads to a persistent 11 percent increase in formal labor earnings, observable seven years after the program. Effects are stronger for youth who participate during pivotal educational transitions and are larger for vulnerable youth and men, while remaining positive for women and non-vulnerable youth. The program is highly cost-effective, with average impacts exceeding those of job training programs and comparable to early childhood investments.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Great Teachers : How to Raise Student Learning in Latin America and the Caribbean(Washington, DC: World Bank, 2015)The seven million teachers of Latin America and the Caribbean (LAC) are the critical actors in the region's efforts to improve education quality and raise student learning levels, which lag far behind those of OECD countries and East Asian countries such as China. This book documents the high economic stakes around teacher quality, benchmarks the current performance of LAC's teachers, and delineates the key issues. These include low standards for entry into teacher training, poor quality training programs that are detached from the realities of the classroom, unattractive career incentives, and weak support for teachers once they are on the job. New research conducted for this report in close to 15,000 classrooms in seven different LAC countries - the largest cross-country study of this kind to date - provides a first-ever insight into how the region's teachers perform inside the classroom. It documents that the average teacher in LAC loses the equivalent of one day of instructional time per week because of inadequate preparation, excessive time on administration (taking attendance, passing out papers) and a surprisingly high share of time physically absent from the classrooms where they should be teaching. Teachers also make limited use of available learning materials, espcially those using information and communications technology (ICT), and are unable to keep the majority of their students engaged. The book sets out the three priority lines of reform needed to produce great teachers in LAC: policies to recruit better teachers; programs to groom teachers and improve their skills once they are in service; and stronger incentives to motivate teachers to perform their best throughout their career. In every area, the book distills the latest evidence from inside and outside the region to provide practical guidance to policymakers in the design of effective programs and sustainable reforms. A final chapter analyzes the politics of recent major teacher reforms in Chile, Peru, Ecuador and Mexico, chronicling the prominent role of teachers' unions and the political and communications strategies that have underpinned successful reforms.Publication Conducting Classroom Observations(Washington, DC, 2015)The ‘Stallings classroom snapshot’ instrument, technically called the ‘Stanford Research Institute classroom observation system’ was developed by Professor Jane Stallings for research on the efficiency and quality of basic education teachers in the United States in the 1970s. The Stallings instrument generates robust quantitative data on the interaction of teachers and students in the classroom, with a high degree of inter-rater reliability (0.8 or higher) among observers with relatively limited training, which makes it suitable for large scale samples in developing country settings. Key features of the Stallings instrument make it well-suited to large scale use in developing country contexts. However, several factors need to borne in mind when interpreting its results. First, there is clear potential for Hawthorne effects, as teachers are aware of the observer (and sometimes pair of observers) physically present in the classroom, unlike the latest observation methods being used in the United States, which place a video camera in the classroom for extended periods so as to minimize these effects. One operating assumption, therefore, is that Stallings observations capture teachers’ performing at their very best, or production possibility frontier, which is in fact useful to measure. A second issue is the potential noisiness of the variables being measured; if the same teacher were observed on different days or with different student sections on the same day or with a different cohort of students the following year, how consistent would the measured performance be? Initial studies in the US called for visits to each classroom on two different days. Third issue is the non-random assignment of teachers to classes in most of the school systems observed. Even when students are not explicitly ability-tracked, classroom assignment rules may de facto result in some teachers facing much more gifted or docile students than others. Finally, what makes the Stallings instrument versatile and robust across different grades, subjects, languages and countries is that it does not try to measure the content of what is being taught, either the depth or sophistication of the curriculum content itself or the teacher’s mastery of that content.Publication Learning in the Face of Adversity(Washington, DC, 2014-10)The goal of this study is to provide a better understanding of how a school system can operate efficiently under adversity. The results of this work will be useful in identifying relevant policies in the Middle East and North Africa region. Palestine refugees are achieving higher-than-average learning outcomes in spite of the adverse circumstances they live under. Their education system the United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) operates one of the largest non-governmental school systems in the Middle East. It manages nearly 700 schools, has hired 17,000 staff, educates more than 500,000 refugee students each year, and operates in five areas, including the West Bank, Gaza, Jordan, Lebanon, and Syria. This study examines three: West Bank, Gaza, and Jordan. Contrary to what might be expected from a resource-constrained administration serving refugee students who continually face a multitude of adversities, UNRWA students outperform public schools in the three regions the West Bank, Gaza, and Jordan by a year's worth of learning. This study was undertaken to better understand the reasons for success at UNRWA schools and their positive variation from comparable public schools. Econometric techniques were used to analyze international (TIMSS and Programme for International Student Assessment, or PISA) and national learning achievement data. Pedagogical practices and classroom time-on-task were observed using structured methods (Stallings model). Systems Approach for Better Education Results (SABER) tools were used to better understand the policies and implementation strategies for school and teacher management and for monitoring and evaluation. Additionally, qualitative data were collected and analyzed in line with an education resilience conceptual framework to better uncover factors that help students develop the skills to learn despite the adversities they face.Publication Inside Indonesia's Mathematics Classrooms : A TIMSS Video Study of Teaching Practices and Student Achievement(World Bank, 2010-10-01)The following report is the first of a two-stage video study to examine teaching practices and activities in Indonesian classrooms. The first stage is linked to results of the 2007 Trends in International Mathematics and Science Study (TIMSS) where 100 of the 150 classes that participated in the TIMSS examination also participated in this additional video study component. The second stage will also involve 100 classes that will participate in the 2011 exam. The second phase will follow the same methodology, allowing for comparison across years, but will also involve more in-depth analysis of the links between teaching practices and student outcomes and how teaching practices are influenced by teachers' belief systems and subject content knowledge. Indonesia has been a committed participant in the TIMSS, Program for International Student Assessment (PISA) and the Progress in International Reading Literacy Study (PIRLS) international standardized student examinations for many years and is one of the few non-OECD (Organization for Economic Cooperation and Development) countries to participate so fully. Indonesian student performance in these examinations has been relatively low, even when taking socio-economic levels into account. For example, for mathematics Indonesia ranked 36th out of 48 participating countries in TIMSS 2007, and its score of 397 was more than one standard deviation below the international average (Mullis et al, 2008). The results have been useful in providing an indication of Indonesia's relative standing in student achievement and its progress over time, but the real challenge is to take the next step and translate the results into an understanding of the factors leading to the test scores and what might be done to enhance student achievement in Indonesia.Publication Learning from Local Practices : Improving Student Performance in West Bank and Gaza(World Bank, Washington, DC, 2014-06-12)The motivation for this study is to contribute to the preparation of the new Palestinian Education Strategy by shedding light on the school and classroom level factors that influence student learning, and to identify good practices that can be generalized from high-performing classrooms to those that need improvement. While most Palestinian children are in school, performance on assessments indicates that many of them are not learning as much as they could. This represents not only inefficiency in the use of public resources, but also a lost opportunity for individual students and the society as a whole. The current study was carried out by the Assessment and Evaluation Department (AED) of the Palestinian Ministry of Education and Higher Education (MoEHE) with technical and financial support from the World Bank. The analysis presented in this paper was prepared by the World Bank team as a complement to a previous paper prepared by a team of experts from AED. For the purposes of this study, schools were classified by student performance in TIMSS 2011 and the 2012 Palestinian national exams. Classroom and school-based tools were then used to gather information from both high and low-performing schools. A total of 122 public, private and United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) schools were surveyed using four different instruments: (i) stalling's classroom observations; (ii) school leadership survey; (iii) teacher survey; and, (iv) school facilities survey, which are all provided in annex one.
Users also downloaded
Showing related downloaded files
Publication Global Economic Prospects, June 2025(Washington, DC: World Bank, 2025-06-10)The global economy is facing another substantial headwind, emanating largely from an increase in trade tensions and heightened global policy uncertainty. For emerging market and developing economies (EMDEs), the ability to boost job creation and reduce extreme poverty has declined. Key downside risks include a further escalation of trade barriers and continued policy uncertainty. These challenges are exacerbated by subdued foreign direct investment into EMDEs. Global cooperation is needed to restore a more stable international trade environment and scale up support for vulnerable countries grappling with conflict, debt burdens, and climate change. Domestic policy action is also critical to contain inflation risks and strengthen fiscal resilience. To accelerate job creation and long-term growth, structural reforms must focus on raising institutional quality, attracting private investment, and strengthening human capital and labor markets. Countries in fragile and conflict situations face daunting development challenges that will require tailored domestic policy reforms and well-coordinated multilateral support.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.Publication World Development Report 2018(Washington, DC: World Bank, 2018)Every year, the World Bank's World Development Report takes on a topic of central importance to global development. The 2018 Report, Learning to Realize Education's Promise, is the first ever devoted entirely to education. Now is an excellent time for it: education has long been critical for human welfare, but is even more so in a time of rapid economic change. The Report explores four main themes. First, education's promise: Education is a powerful instrument for eradicating poverty and promoting shared prosperity, but fulfilling its potential requires better policies - both within and outside the education system. Second, the learning crisis: Despite gains in education access, recent learning assessments show that many young people around the world, especially from poor families, are leaving school unequipped with even the most foundational skills they need for life. At the same time, internationally comparable learning assessments show that skills in many middle-income countries lag far behind what those countries aspire to. Third, promising interventions to improve learning: Research from areas such as brain science, pedagogical innovations, or school management have identified interventions that promote learning by ensuring that learners are prepared, that teachers are skilled as well as motivated, and that other inputs support the teacher-learner relationship. Fourth, learning at scale: Achieving learning throughout an education system will require more than just scaling up effective interventions. Change requires overcoming technical and political barriers by deploying salient metrics for mobilizing actors and tracking progress, building coalitions for learning, and being adaptive when implementing programs.Publication World Development Report 2024(Washington, DC: World Bank, 2024-08-01)Middle-income countries are in a race against time. Many of them have done well since the 1990s to escape low-income levels and eradicate extreme poverty, leading to the perception that the last three decades have been great for development. But the ambition of the more than 100 economies with incomes per capita between US$1,100 and US$14,000 is to reach high-income status within the next generation. When assessed against this goal, their record is discouraging. Since the 1970s, income per capita in the median middle-income country has stagnated at less than a tenth of the US level. With aging populations, growing protectionism, and escalating pressures to speed up the energy transition, today’s middle-income economies face ever more daunting odds. To become advanced economies despite the growing headwinds, they will have to make miracles. Drawing on the development experience and advances in economic analysis since the 1950s, World Development Report 2024 identifies pathways for developing economies to avoid the “middle-income trap.” It points to the need for not one but two transitions for those at the middle-income level: the first from investment to infusion and the second from infusion to innovation. Governments in lower-middle-income countries must drop the habit of repeating the same investment-driven strategies and work instead to infuse modern technologies and successful business processes from around the world into their economies. This requires reshaping large swaths of those economies into globally competitive suppliers of goods and services. Upper-middle-income countries that have mastered infusion can accelerate the shift to innovation—not just borrowing ideas from the global frontiers of technology but also beginning to push the frontiers outward. This requires restructuring enterprise, work, and energy use once again, with an even greater emphasis on economic freedom, social mobility, and political contestability. Neither transition is automatic. The handful of economies that made speedy transitions from middle- to high-income status have encouraged enterprise by disciplining powerful incumbents, developed talent by rewarding merit, and capitalized on crises to alter policies and institutions that no longer suit the purposes they were once designed to serve. Today’s middle-income countries will have to do the same.Publication Choosing Our Future(Washington, DC: World Bank, 2024-09-04)Education can propel faster and better climate action in two crucial ways. First, education can galvanize behavior change at scale - not just for tomorrow, but also for today. Second, education can unlock skills and innovation to shift economies onto greener trajectories for growth. At the same time, education needs to be protected from climate change. Extreme climate events and temperatures are already eroding hard-won progress on schooling and learning. Climate change is causing school closures, learning losses, and dropouts. These will turn into long-run inter-generational earnings losses putting into jeopardy education’s powerful potential for spurring poverty alleviation and economic growth. Governments can act now to adapt schools for climate change in cost-effective ways. This report outlines new data, evidence, and examples on how countries can harness education to propel climate action. It provides an actionable policy agenda to meet development, education, and climate goals together, recognizing that tackling climate change requires changes to individual beliefs, behaviors, and skills – changes that education is uniquely positioned to catalyze.