Publication: Through the Looking Glass: Can Classroom Observation and Coaching Improve Teacher Performance in Brazil?
Loading...
Date
2017-07
ISSN
Published
2017-07
Author(s)
Editor(s)
Abstract
This study conducted a randomized evaluation of a program in the Brazilian state of Ceara. The program was designed to improve teachers’ effectiveness by increasing their professional interaction and sharing of classroom practice. In 175 of 350 secondary schools, teachers were provided with benchmarked feedback from classroom observations and access to expert coaching. Schools’ uptake of the coaching program was high (85 percent). Over a single school year, the program increased teachers’ time on instruction and student engagement and produced statistically significant gains in student learning on the Ceara state assessment and the national secondary school exit exam. Controlling for individual students’ prior-year learning outcomes, schools exposed to the program had 0.05-0.09 standard deviation higher performance on the state test and 0.04-0.06 standard deviation higher scores on the national test. Implementation fidelity strongly boosted program impacts. In the 49 schools where the pedagogical coordinators achieved the highest certification at the end of the program, student scores were 0.13-0.23 standard deviation higher on the state test and 0.13-0.17 standard deviation higher on the national test. Coaching delivered by Skype kept the costs of the program low, $2.40 per student, and produced cost-effective impacts on learning in comparison with other rigorously evaluated teacher training interventions. The combination of classroom observation feedback and expert coaching appears to be a promising strategy for whole-school efforts to raise teacher effectiveness.
Link to Data Set
Citation
“Costa, Leandro; Bruns, Barbara; Cunha, Nina. 2017. Through the Looking Glass: Can Classroom Observation and Coaching Improve Teacher Performance in Brazil?. Policy Research Working Paper;No. 8156. © World Bank. http://hdl.handle.net/10986/27962 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Great Teachers : How to Raise Student Learning in Latin America and the Caribbean(Washington, DC: World Bank, 2015)The seven million teachers of Latin America and the Caribbean (LAC) are the critical actors in the region's efforts to improve education quality and raise student learning levels, which lag far behind those of OECD countries and East Asian countries such as China. This book documents the high economic stakes around teacher quality, benchmarks the current performance of LAC's teachers, and delineates the key issues. These include low standards for entry into teacher training, poor quality training programs that are detached from the realities of the classroom, unattractive career incentives, and weak support for teachers once they are on the job. New research conducted for this report in close to 15,000 classrooms in seven different LAC countries - the largest cross-country study of this kind to date - provides a first-ever insight into how the region's teachers perform inside the classroom. It documents that the average teacher in LAC loses the equivalent of one day of instructional time per week because of inadequate preparation, excessive time on administration (taking attendance, passing out papers) and a surprisingly high share of time physically absent from the classrooms where they should be teaching. Teachers also make limited use of available learning materials, espcially those using information and communications technology (ICT), and are unable to keep the majority of their students engaged. The book sets out the three priority lines of reform needed to produce great teachers in LAC: policies to recruit better teachers; programs to groom teachers and improve their skills once they are in service; and stronger incentives to motivate teachers to perform their best throughout their career. In every area, the book distills the latest evidence from inside and outside the region to provide practical guidance to policymakers in the design of effective programs and sustainable reforms. A final chapter analyzes the politics of recent major teacher reforms in Chile, Peru, Ecuador and Mexico, chronicling the prominent role of teachers' unions and the political and communications strategies that have underpinned successful reforms.Publication Conducting Classroom Observations(Washington, DC, 2015)The ‘Stallings classroom snapshot’ instrument, technically called the ‘Stanford Research Institute classroom observation system’ was developed by Professor Jane Stallings for research on the efficiency and quality of basic education teachers in the United States in the 1970s. The Stallings instrument generates robust quantitative data on the interaction of teachers and students in the classroom, with a high degree of inter-rater reliability (0.8 or higher) among observers with relatively limited training, which makes it suitable for large scale samples in developing country settings. Key features of the Stallings instrument make it well-suited to large scale use in developing country contexts. However, several factors need to borne in mind when interpreting its results. First, there is clear potential for Hawthorne effects, as teachers are aware of the observer (and sometimes pair of observers) physically present in the classroom, unlike the latest observation methods being used in the United States, which place a video camera in the classroom for extended periods so as to minimize these effects. One operating assumption, therefore, is that Stallings observations capture teachers’ performing at their very best, or production possibility frontier, which is in fact useful to measure. A second issue is the potential noisiness of the variables being measured; if the same teacher were observed on different days or with different student sections on the same day or with a different cohort of students the following year, how consistent would the measured performance be? Initial studies in the US called for visits to each classroom on two different days. Third issue is the non-random assignment of teachers to classes in most of the school systems observed. Even when students are not explicitly ability-tracked, classroom assignment rules may de facto result in some teachers facing much more gifted or docile students than others. Finally, what makes the Stallings instrument versatile and robust across different grades, subjects, languages and countries is that it does not try to measure the content of what is being taught, either the depth or sophistication of the curriculum content itself or the teacher’s mastery of that content.Publication Learning in the Face of Adversity(Washington, DC, 2014-10)The goal of this study is to provide a better understanding of how a school system can operate efficiently under adversity. The results of this work will be useful in identifying relevant policies in the Middle East and North Africa region. Palestine refugees are achieving higher-than-average learning outcomes in spite of the adverse circumstances they live under. Their education system the United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) operates one of the largest non-governmental school systems in the Middle East. It manages nearly 700 schools, has hired 17,000 staff, educates more than 500,000 refugee students each year, and operates in five areas, including the West Bank, Gaza, Jordan, Lebanon, and Syria. This study examines three: West Bank, Gaza, and Jordan. Contrary to what might be expected from a resource-constrained administration serving refugee students who continually face a multitude of adversities, UNRWA students outperform public schools in the three regions the West Bank, Gaza, and Jordan by a year's worth of learning. This study was undertaken to better understand the reasons for success at UNRWA schools and their positive variation from comparable public schools. Econometric techniques were used to analyze international (TIMSS and Programme for International Student Assessment, or PISA) and national learning achievement data. Pedagogical practices and classroom time-on-task were observed using structured methods (Stallings model). Systems Approach for Better Education Results (SABER) tools were used to better understand the policies and implementation strategies for school and teacher management and for monitoring and evaluation. Additionally, qualitative data were collected and analyzed in line with an education resilience conceptual framework to better uncover factors that help students develop the skills to learn despite the adversities they face.Publication Inside Indonesia's Mathematics Classrooms : A TIMSS Video Study of Teaching Practices and Student Achievement(World Bank, 2010-10-01)The following report is the first of a two-stage video study to examine teaching practices and activities in Indonesian classrooms. The first stage is linked to results of the 2007 Trends in International Mathematics and Science Study (TIMSS) where 100 of the 150 classes that participated in the TIMSS examination also participated in this additional video study component. The second stage will also involve 100 classes that will participate in the 2011 exam. The second phase will follow the same methodology, allowing for comparison across years, but will also involve more in-depth analysis of the links between teaching practices and student outcomes and how teaching practices are influenced by teachers' belief systems and subject content knowledge. Indonesia has been a committed participant in the TIMSS, Program for International Student Assessment (PISA) and the Progress in International Reading Literacy Study (PIRLS) international standardized student examinations for many years and is one of the few non-OECD (Organization for Economic Cooperation and Development) countries to participate so fully. Indonesian student performance in these examinations has been relatively low, even when taking socio-economic levels into account. For example, for mathematics Indonesia ranked 36th out of 48 participating countries in TIMSS 2007, and its score of 397 was more than one standard deviation below the international average (Mullis et al, 2008). The results have been useful in providing an indication of Indonesia's relative standing in student achievement and its progress over time, but the real challenge is to take the next step and translate the results into an understanding of the factors leading to the test scores and what might be done to enhance student achievement in Indonesia.Publication Learning from Local Practices : Improving Student Performance in West Bank and Gaza(World Bank, Washington, DC, 2014-06-12)The motivation for this study is to contribute to the preparation of the new Palestinian Education Strategy by shedding light on the school and classroom level factors that influence student learning, and to identify good practices that can be generalized from high-performing classrooms to those that need improvement. While most Palestinian children are in school, performance on assessments indicates that many of them are not learning as much as they could. This represents not only inefficiency in the use of public resources, but also a lost opportunity for individual students and the society as a whole. The current study was carried out by the Assessment and Evaluation Department (AED) of the Palestinian Ministry of Education and Higher Education (MoEHE) with technical and financial support from the World Bank. The analysis presented in this paper was prepared by the World Bank team as a complement to a previous paper prepared by a team of experts from AED. For the purposes of this study, schools were classified by student performance in TIMSS 2011 and the 2012 Palestinian national exams. Classroom and school-based tools were then used to gather information from both high and low-performing schools. A total of 122 public, private and United Nations Relief and Works Agency for Palestine Refugees in the Near East (UNRWA) schools were surveyed using four different instruments: (i) stalling's classroom observations; (ii) school leadership survey; (iii) teacher survey; and, (iv) school facilities survey, which are all provided in annex one.
Users also downloaded
Showing related downloaded files
Publication The Government Analytics Handbook(Washington, DC: World Bank, 2023-09-28)The Government Analytics Handbook presents frontier evidence and practitioner insights on how to leverage data to strengthen public administration. Covering a range of microdata sources—such as administrative data and public servant surveys—as well as tools and resources for undertaking the analytics, it transforms the ability of governments to take a data-informed approach to diagnose and improve how public organizations work. The "Handbook" is a must-have for practitioners, policy makers, academics, and government agencies. It is available as a single volume in print or digital formats, and as chapters for modular use. Additional tools, data and background information are available at worldbank.org/governmentanalytics. “Governments have long been assessed using aggregate governance indicators, giving us little insight into their diversity and how they can practically be improved. This pioneering handbook shows how microdata can be used to give scholars and practitioners granular and real insights into how states work, and practical guidance on the process of state-building.” —Francis Fukuyama, Stanford University, author of State-Building: Governance and World Order in the 21st Century - "The Government Analytics Handbook is the most comprehensive work on practically building government administration I have ever seen, helping practitioners to change public administration for the better.” —Francisco Gaetani, Special Secretary for State Transformation, Government of Brazil - “The machinery of the state is central to a country’s prosperity. This handbook provides insights and methodological tools for creating a better shared understanding of the realities of a state, to support the redesign of institutions, and improve the quality of public administration.” —James Robinson, University of Chicago, coauthor of Why Nations FailPublication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication World Development Report 2011(World Bank, 2011)The 2011 World development report looks across disciplines and experiences drawn from around the world to offer some ideas and practical recommendations on how to move beyond conflict and fragility and secure development. The key messages are important for all countries-low, middle, and high income-as well as for regional and global institutions: first, institutional legitimacy is the key to stability. When state institutions do not adequately protect citizens, guard against corruption, or provide access to justice; when markets do not provide job opportunities; or when communities have lost social cohesion-the likelihood of violent conflict increases. Second, investing in citizen security, justice, and jobs is essential to reducing violence. But there are major structural gaps in our collective capabilities to support these areas. Third, confronting this challenge effectively means that institutions need to change. International agencies and partners from other countries must adapt procedures so they can respond with agility and speed, a longer-term perspective, and greater staying power. Fourth, need to adopt a layered approach. Some problems can be addressed at the country level, but others need to be addressed at a regional level, such as developing markets that integrate insecure areas and pooling resources for building capacity Fifth, in adopting these approaches, need to be aware that the global landscape is changing. Regional institutions and middle income countries are playing a larger role. This means should pay more attention to south-south and south-north exchanges, and to the recent transition experiences of middle income countries.Publication World Development Report 2006(Washington, DC, 2005)This year’s Word Development Report (WDR), the twenty-eighth, looks at the role of equity in the development process. It defines equity in terms of two basic principles. The first is equal opportunities: that a person’s chances in life should be determined by his or her talents and efforts, rather than by pre-determined circumstances such as race, gender, social or family background. The second principle is the avoidance of extreme deprivation in outcomes, particularly in health, education and consumption levels. This principle thus includes the objective of poverty reduction. The report’s main message is that, in the long run, the pursuit of equity and the pursuit of economic prosperity are complementary. In addition to detailed chapters exploring these and related issues, the Report contains selected data from the World Development Indicators 2005‹an appendix of economic and social data for over 200 countries. This Report offers practical insights for policymakers, executives, scholars, and all those with an interest in economic development.Publication Doing Business 2014 : Understanding Regulations for Small and Medium-Size Enterprises(Washington, DC: World Bank Group, 2013-10-28)Eleventh in a series of annual reports comparing business regulation in 185 economies, Doing Business 2014 measures regulations affecting 11 areas of everyday business activity: Starting a business, Dealing with construction permits, Getting electricity, Registering property, Getting credit, Protecting investors, Paying taxes, Trading across borders, Enforcing contracts, Closing a business, Employing workers. The report updates all indicators as of June 1, 2013, ranks economies on their overall “ease of doing business”, and analyzes reforms to business regulation – identifying which economies are strengthening their business environment the most. The Doing Business reports illustrate how reforms in business regulations are being used to analyze economic outcomes for domestic entrepreneurs and for the wider economy. Doing Business is a flagship product by the World Bank and IFC that garners worldwide attention on regulatory barriers to entrepreneurship. More than 60 economies use the Doing Business indicators to shape reform agendas and monitor improvements on the ground. In addition, the Doing Business data has generated over 870 articles in peer-reviewed academic journals since its inception.