Publication: Measuring Teaching Practices at Scale: Results from the Development and Validation of the Teach Classroom Observation Tool
Loading...
Date
2018-11
ISSN
Published
2018-11
Editor(s)
Abstract
What goes on inside the classroom is central to student learning. Despite its importance, low- and middle-income countries rarely measure teaching practices, in part due to a lack of access to adequate classroom observation tools and the high transaction costs associated with administering them. Teach, a new, open-source classroom observation tool for primary classrooms, was developed to capture the quantity and quality of teaching practices in these settings with a simple, easy-to-administer tool. This paper validates the use of Teach scores for system diagnostics by providing four types of evidence. First, it provides evidence that the practices included in the tool have a clear conceptual underpinning. Second, almost 90 percent of local observers in Mozambique, Pakistan, the Philippines, and Uruguay were highly accurate using Teach after a four-day training. Third, using data from 845 classrooms in Pakistan, the paper shows that Teach scores are internally consistent, present moderate to high inter-rater reliability in the field (.75 intraclass correlation coefficient), and provide substantial information that allows to differentiate teachers, even those with similar but not equal scores. Finally, teachers who display effective practices, as measured by Teach, are associated with students who achieve higher learning outcomes.
Link to Data Set
Citation
“Molina, Ezequiel; Fatima, Syeda Farwa; Ho, Andrew; Melo Hurtado, Carolina; Wilichowksi, Tracy; Pushparatnam, Adelle. 2018. Measuring Teaching Practices at Scale: Results from the Development and Validation of the Teach Classroom Observation Tool. Policy Research Working Paper;No. 8653. © World Bank. http://hdl.handle.net/10986/30880 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication Geopolitics and the World Trading System(Washington, DC: World Bank, 2024-12-23)Until the beginning of this century, the GATT/WTO system worked. Economic research provided a compelling explanation. It showed that if governments maximize the well-being of their own countries broadly defined, GATT/WTO principles would facilitate mutually beneficial cooperation over their trade policy choices. Now heightened geopolitical rivalry seems to have undermined the WTO. A simple transposition of the previous rationalization suggests that geopolitics and trade cooperation are not compatible. The paper shows that this is only true if rivalry eclipses any consideration of own-country well-being. In all other circumstances, there are gains from trade cooperation even with geopolitics. Furthermore, the WTO’s relevance is in question only if it adheres too rigidly to its existing rules and norms. Through measured adaptation to the geopolitical imperative, the WTO can continue to thrive as a forum for multilateral trade cooperation in the age of geopolitics.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication Global Poverty Revisited Using 2021 PPPs and New Data on Consumption(Washington, DC: World Bank, 2025-06-05)Recent improvements in survey methodologies have increased measured consumption in many low- and lower-middle-income countries that now collect a more comprehensive measure of household consumption. Faced with such methodological changes, countries have frequently revised upward their national poverty lines to make them appropriate for the new measures of consumption. This in turn affects the World Bank’s global poverty lines when they are periodically revised. The international poverty line, which is based on the typical poverty line in low-income countries, increases by around 40 percent to $3.00 when the more recent national poverty lines as well as the 2021 purchasing power parities are incorporated. The net impact of the changes in international prices, the poverty line, and new survey data (including new data for India) is an increase in global extreme poverty by some 125 million people in 2022, and a significant shift of poverty away from South Asia and toward Sub-Saharan Africa. The changes at higher poverty lines, which are more relevant to middle-income countries, are mixed.Publication From Patriarchy to Policy(Washington, DC: World Bank, 2025-05-29)Legal institutions play an important role in shaping gender equality in economic domains, from inheritance to labor markets. But where do gender equal laws come from? Using cross-country data on social norms and legal equality, this paper investigates the socio-cultural roots of gender inequity in the legal system and its implications for female labor force participation. To identify the impact of social norms, the analysis uses an empirical strategy that exploits pre-modern differences in ancestral patriarchal culture as an instrument for present-day gender norms. The findings show that ancestral patriarchal culture is a strong predictor of contemporary norms, and conservative social norms are associated with more gender inequality in the de jure legal framework, the de facto implementation of laws, and the labor market. The paper presents evidence for a political selection mechanism linking norms to laws: countries with more conservative norms elect political leaders who are more hostile to gender equality, who then pass less progressive legislation. The results highlight the cultural roots and political drivers of legalized gender inequality.Publication Global Socio-economic Resilience to Natural Disasters(Washington, DC: World Bank, 2025-05-22)Most disaster risk assessments use damages to physical assets as their central metric, often neglecting distributional impacts and the coping and recovery capacity of affected people. To address this shortcoming, the concepts of well-being losses and socio-economic resilience—the ability to experience asset losses without a decline in well-being—have been proposed. This paper uses microsimulations to produce a global estimate of well-being losses from, and socio-economic resilience to, natural disasters, covering 132 countries. On average, each $1 in disaster-related asset losses results in well-being losses equivalent to a $2 uniform national drop in consumption, with significant variation within and across countries. The poorest income quintile within each country incurs only 9% of national asset losses but accounts for 33% of well-being losses. Compared to high-income countries, low-income countries experience 67% greater well-being losses per dollar of asset losses and require 56% more time to recover. Socio-economic resilience is uncorrelated with exposure or vulnerability to natural hazards. However, a 10 percent increase in GDP per capita is associated with a 0.9 percentage point gain in resilience, but this benefit arises indirectly—such as through higher rate of formal employment, better financial inclusion, and broader social protection coverage—rather than from higher income itself. This paper assess ten policy options and finds that socio-economic and financial interventions (such as insurance and social protection) can effectively complement asset-focused measures (e.g., construction standards) and that interventions targeting low-income populations usually have higher returns in terms of avoided well-being losses per dollar invested.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Evidence-Based Teaching(World Bank, Washington, DC, 2018-11)After spending five to six years sitting in a classroom almost every day for anywhere between 4 to 7 hours a significant share of students in low and middle-income countries are not able to read, write or do basic arithmetic. What is going on inside these classrooms? A growing body of evidence provide evidence of poor teaching practices and little to no learning going on inside the classroom. As such, the learning crisis is a reflection of a teaching crisis. What can teachers do inside the classroom to tackle this teaching and learning crisis? This paper systematizes the evidence on what are effective teaching practices in primary school classrooms, with special focus on evidence from low and middle-income countries. By doing so this paper provides the theoretical and empirical foundations for the content of Teach classroom observation tool. Implication for teacher education and evaluation are discussed.Publication Three Principles to Support Teacher Effectiveness During COVID-19(World Bank, Washington, DC, 2020-05)Effective teachers are irreplaceable in helping students succeed. They facilitate two-way teaching and learning processes, helping students learn content through real time responses to questions, making learning fun, shaping students' attitudes, exemplifying empathy, modeling teamwork and respect, and building student resilience in several ways. Successful teachers work with school management teams and parents to ensure consistent support for students as they transition through school. The sudden closure of schools during COVID-19 has left many teachers across several countries uncertain about their role, unable to use technology effectively to communicate and teach, and unprepared for classroom challenges when schools reopen. The pandemic has brought the need to bridge digital divides into sharp focus, with countries and schools adept at using such technologies facing fewer challenges in meeting learning goals. There can be little doubt that high-quality education is a social experience, requiring routine human interface. Successful teachers are irreplaceable in this task—and will remain so in the foreseeable future—but they need to be supported in multiple ways to be effective in unpredictable circumstances. Given the central role teachers play in student learning, this note outlines three key principles to help governments and their development partners in supporting teacher effectiveness during and in the aftermath of COVID-19. It discusses these principles in relation to the three phases of the World Bank’s COVID-19 education policy response: coping, managing continuity, and improvement and acceleration.1 The three principles are basic and apply regardless of country context.Publication How Do We Know Teacher Professional Development Is Working?(World Bank, Washington, DC, 2021-12-10)The teaching that students receive in the classroom is the most important school-based determinant of student learning. The objective of this note is to provide guidance on how to: (1) establish a numerical indicator to measure changes in teaching practices through the use of classroom observation tools for use in education projects, and (2) produce a benchmark to compare changes in teaching practices through this indicator. The way that teachers interact with their students in the classroom makes all the difference in ensuring students’ academic and socioemotional learning. For this reason, education projects that seek to improve student learning frequently include components focused on improving teaching practices through interventions such as modifying the curriculum, improving pre-service or in-service teacher training, and integrating additional instructional support to the classroom through the use of structured instructional material or technology. This note provides guidance on how to establish a numerical indicator to measure teaching practices through classroom observation tools, and how to benchmark this indicator to track changes in teaching practices over time for use in educational interventions. This guidance is structured through a three-step process: step 1, selecting an appropriate classroom observation tool; step 2, selecting an indicator to track teaching practices using that tool; and step 3, establishing a reasonable benchmarking target for the chosen indicator.Publication Inside Indonesia's Mathematics Classrooms : A TIMSS Video Study of Teaching Practices and Student Achievement(World Bank, 2010-10-01)The following report is the first of a two-stage video study to examine teaching practices and activities in Indonesian classrooms. The first stage is linked to results of the 2007 Trends in International Mathematics and Science Study (TIMSS) where 100 of the 150 classes that participated in the TIMSS examination also participated in this additional video study component. The second stage will also involve 100 classes that will participate in the 2011 exam. The second phase will follow the same methodology, allowing for comparison across years, but will also involve more in-depth analysis of the links between teaching practices and student outcomes and how teaching practices are influenced by teachers' belief systems and subject content knowledge. Indonesia has been a committed participant in the TIMSS, Program for International Student Assessment (PISA) and the Progress in International Reading Literacy Study (PIRLS) international standardized student examinations for many years and is one of the few non-OECD (Organization for Economic Cooperation and Development) countries to participate so fully. Indonesian student performance in these examinations has been relatively low, even when taking socio-economic levels into account. For example, for mathematics Indonesia ranked 36th out of 48 participating countries in TIMSS 2007, and its score of 397 was more than one standard deviation below the international average (Mullis et al, 2008). The results have been useful in providing an indication of Indonesia's relative standing in student achievement and its progress over time, but the real challenge is to take the next step and translate the results into an understanding of the factors leading to the test scores and what might be done to enhance student achievement in Indonesia.Publication The Lost Human Capital(World Bank, Washington, DC, 2019-05)In many low-income countries, teachers do not master the subject they are teaching, and children learn little while attending school. Using unique data from nationally representative surveys of schools in seven Sub-Saharan African countries, this paper proposes a methodology to assess the effect of teacher subject content knowledge on student learning when panel data on students are not available. The paper shows that data on test scores of the student's current and the previous year's teachers, and knowledge of the correlation structure of teacher knowledge across time and grades, allow estimating two structural parameters of interest: the contemporaneous effect of teacher content knowledge, and the extent of fade out of teacher impacts in earlier grades. The paper uses these structural estimates to understand the magnitude of teacher effects and simulate the impacts of various policy reforms. Shortfalls in teachers' content knowledge account for 30 percent of the shortfall in learning relative to the curriculum, and about 20 percent of the cross-country difference in learning in the sample. Assigning more students to better teachers would potentially lead to substantial cost-savings, even if there are negative class-size effects. Ensuring that all incoming teachers have the officially mandated effective years of education, along with increasing the time spent on teaching to the officially mandated schedule, could almost double student learning within the next 30 years.
Users also downloaded
Showing related downloaded files
Publication World Development Report 2018(Washington, DC: World Bank, 2018)Every year, the World Bank's World Development Report takes on a topic of central importance to global development. The 2018 Report, Learning to Realize Education's Promise, is the first ever devoted entirely to education. Now is an excellent time for it: education has long been critical for human welfare, but is even more so in a time of rapid economic change. The Report explores four main themes. First, education's promise: Education is a powerful instrument for eradicating poverty and promoting shared prosperity, but fulfilling its potential requires better policies - both within and outside the education system. Second, the learning crisis: Despite gains in education access, recent learning assessments show that many young people around the world, especially from poor families, are leaving school unequipped with even the most foundational skills they need for life. At the same time, internationally comparable learning assessments show that skills in many middle-income countries lag far behind what those countries aspire to. Third, promising interventions to improve learning: Research from areas such as brain science, pedagogical innovations, or school management have identified interventions that promote learning by ensuring that learners are prepared, that teachers are skilled as well as motivated, and that other inputs support the teacher-learner relationship. Fourth, learning at scale: Achieving learning throughout an education system will require more than just scaling up effective interventions. Change requires overcoming technical and political barriers by deploying salient metrics for mobilizing actors and tracking progress, building coalitions for learning, and being adaptive when implementing programs.Publication World Development Report 2011(World Bank, 2011)The 2011 World development report looks across disciplines and experiences drawn from around the world to offer some ideas and practical recommendations on how to move beyond conflict and fragility and secure development. The key messages are important for all countries-low, middle, and high income-as well as for regional and global institutions: first, institutional legitimacy is the key to stability. When state institutions do not adequately protect citizens, guard against corruption, or provide access to justice; when markets do not provide job opportunities; or when communities have lost social cohesion-the likelihood of violent conflict increases. Second, investing in citizen security, justice, and jobs is essential to reducing violence. But there are major structural gaps in our collective capabilities to support these areas. Third, confronting this challenge effectively means that institutions need to change. International agencies and partners from other countries must adapt procedures so they can respond with agility and speed, a longer-term perspective, and greater staying power. Fourth, need to adopt a layered approach. Some problems can be addressed at the country level, but others need to be addressed at a regional level, such as developing markets that integrate insecure areas and pooling resources for building capacity Fifth, in adopting these approaches, need to be aware that the global landscape is changing. Regional institutions and middle income countries are playing a larger role. This means should pay more attention to south-south and south-north exchanges, and to the recent transition experiences of middle income countries.Publication World Development Report 2021(Washington, DC: World Bank, 2021-03-24)Today’s unprecedented growth of data and their ubiquity in our lives are signs that the data revolution is transforming the world. And yet much of the value of data remains untapped. Data collected for one purpose have the potential to generate economic and social value in applications far beyond those originally anticipated. But many barriers stand in the way, ranging from misaligned incentives and incompatible data systems to a fundamental lack of trust. World Development Report 2021: Data for Better Lives explores the tremendous potential of the changing data landscape to improve the lives of poor people, while also acknowledging its potential to open back doors that can harm individuals, businesses, and societies. To address this tension between the helpful and harmful potential of data, this Report calls for a new social contract that enables the use and reuse of data to create economic and social value, ensures equitable access to that value, and fosters trust that data will not be misused in harmful ways. This Report begins by assessing how better use and reuse of data can enhance the design of public policies, programs, and service delivery, as well as improve market efficiency and job creation through private sector growth. Because better data governance is key to realizing this value, the Report then looks at how infrastructure policy, data regulation, economic policies, and institutional capabilities enable the sharing of data for their economic and social benefits, while safeguarding against harmful outcomes. The Report concludes by pulling together the pieces and offering an aspirational vision of an integrated national data system that would deliver on the promise of producing high-quality data and making them accessible in a way that promotes their safe use and reuse. By examining these opportunities and challenges, the Report shows how data can benefit the lives of all people, but particularly poor people in low- and middle-income countries.Publication World Development Report 2012(World Bank, 2012)The main message of this year's World development report: gender equality and development is that these patterns of progress and persistence in gender equality matter, both for development outcomes and policy making. They matter because gender equality is a core development objective in its own right. But greater gender equality is also smart economics, enhancing productivity and improving other development outcomes, including prospects for the next generation and for the quality of societal policies and institutions. Economic development is not enough to shrink all gender disparities-corrective policies that focus on persisting gender gaps are essential. This report points to four priority areas for policy going forward. First, reducing gender gaps in human capital-specifically those that address female mortality and education. Second, closing gender gaps in access to economic opportunities, earnings, and productivity. Third, shrinking gender differences in voice and agency within society. Fourth, limiting the reproduction of gender inequality across generations. These are all areas where higher incomes by themselves do little to reduce gender gaps, but focused policies can have a real impact. Gender equality is at the heart of development. It's the right development objective, and it's smart economic policy. The World development report 2012 can help both countries and international partners think through and integrate a focus on gender equality into development policy making and programming.Publication World Development Report 2020(Washington, DC: World Bank, 2020)Global value chains (GVCs) powered the surge of international trade after 1990 and now account for almost half of all trade. This shift enabled an unprecedented economic convergence: poor countries grew rapidly and began to catch up with richer countries. Since the 2008 global financial crisis, however, the growth of trade has been sluggish and the expansion of GVCs has stalled. Meanwhile, serious threats have emerged to the model of trade-led growth. New technologies could draw production closer to the consumer and reduce the demand for labor. And conflicts among large countries could lead to a retrenchment or a segmentation of GVCs. This book examines whether there is still a path to development through GVCs and trade. It concludes that technological change is, at this stage, more a boon than a curse. GVCs can continue to boost growth, create better jobs, and reduce poverty provided that developing countries implement deeper reforms to promote GVC participation; industrial countries pursue open, predictable policies; and all countries revive multilateral cooperation.