Publication: Validating Teaching Observation Tools: A Content-Based Approach for PLAY and Teach Primary
Loading...
Date
2025-03-24
ISSN
Published
2025-03-24
Author(s)
Editor(s)
Abstract
This study compares two tools used to observe and assess how teachers support student learning: the LEGO Foundation’s Engage tool, formerly PLAY, and the World Bank’s Teach Primary tool. The goal was to evaluate their similarities and overlaps in their measurement of teaching practices. Nine experts reviewed both tools in detail, carefully matching items from PLAY to those in Teach Primary. Results indicate that about one-third of the items are closely matched, showing that PLAY is built on a solid framework to capture engaging teaching practices. Another third of the items did not have a precise match, meaning each tool separately captures unique aspects of teaching that the other does not. The study also looked at how well the scores of the two tools aligned using accurate classroom data from Ethiopia, Peru, and Sierra Leone. The results showed a small positive relationship between the two tools, meaning they measure related but different aspects of teaching. The study also found that how PLAY is structured may need some adjustments to reflect better the skills it is designed to measure. By combining expert opinions with data analysis, this study provides strong evidence that both tools are valuable but serve different purposes. The findings highlight the importance of using multiple approaches to assess teaching quality. The study also offers recommendations for improving tool improvement and suggests the following steps on how classroom observation tools can help support improved teaching and learning worldwide.
Link to Data Set
Citation
“Bazaldua, Diego Luna; Carter, Emma. 2025. Validating Teaching Observation Tools: A Content-Based Approach for PLAY and Teach Primary. Education Working Paper; No. 10, February 2024. © World Bank. http://hdl.handle.net/10986/42984 License: CC BY-NC 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Rethinking Teaching Quality(Washington, DC: World Bank, 2025-03-24)Engaging teaching has emerged as a key approach to fostering children’s socio-emotional and cognitive skills. This policy note draws on findings of a recent comparative study on the LEGO Foundation’s Engage, formerly known as Playful Learning Across the Years (PLAY)1, classroom observation tool, and the World Bank’s Teach Primary instrument. The study highlights how these tools complement each other and underscore the importance of actionable strategies to integrate and monitor engaging teaching practices in primary schools, including across low- and middle-income countries (LMICs) where they tend to be less common. By leveraging these tools to monitor teaching practices, policymakers can signal the importance of compelling, engaging, and inclusive teaching approaches that enhance educational outcomes.Publication Guiding Questions for Choosing the Right Tools to Measure Early Childhood Outcomes(Washington, DC: World Bank, 2022-02-18)A growing understanding of the importance of children’s earliest years has led to an increasing desire to measure early childhood development (ECD) outcomes. There are now nearly 150 tools for measuring ECD outcomes internationally, which can make it challenging to choose an appropriate measurement tool for a given measurement effort. This document guides the user through the why, who, what, and how questions that must be considered prior to selecting tools for measuring ECD outcomes. Users should document their responses at each step to collate the information needed to identify and select an appropriate ECD measurement tool.Publication Guidance Note on Phone-based Formative Assessment(World Bank, Washington, DC, 2022)Phone-Based Formative Assessment refers to the use of mobile phone technology to engage students outside the classroom, assess their learning in real time, and provide timely, constructive feedback. Such assessment is particularly critical to promote learning continuity in the context of COVID-19-related school closures, which have led to the expansion and availability of remote teaching and learning resources.Publication Review and Guidance on ECD Assessment Tools in FCV Contexts(Washington, DC: World Bank, 2025-01-14)By 2030, an estimated two-thirds of the world's extremely poor could be concentrated in countries and contexts characterized by fragility, conflict, and violence (FCV) (World Bank Group, 2020). FCV contexts, affected by humanitarian crises, prolonged emergencies, and armed conflicts, are significant hindrances to poverty reduction and sustainable development. The cycle of instability and violence in these contexts often leads to the destruction of infrastructure and a strain on resources, making it difficult for communities to lift themselves out of poverty and achieve sustainable development goals. The list of FCV contexts includes the World Bank list of countries and territories affected by fragility and conflict situations (FCS), as well as countries suffering from violence and those with large-forcibly displaced populations that are not included in the FCS list. This review aims to describe which early childhood development (ECD) measurement tools have been used in FCV contexts and to serve as a guide for tool selection in these settings. This guidance is intended to assist country teams in identifying appropriate tools for ECD measurement activities, provided that such activities are already recognized as priorities. While parents and caregivers are essential to ECD, particularly in FCV environments, this review does not concern tools that measure adults' well-being or parenting-related outcomes. Instead, it measures children's developmental outcomes and other child-related constructs relevant to FCV contexts. The authors briefly describe the situation of children living in FCV contexts and how it can affect their development. We then make a case for the importance of ECD measurement, the lack of data on ECD in FCV contexts, and the data collection challenges. After that, we provide a deep dive into what was found in the desk review and provide a framework for tool selection. Finally, we present policy recommendations.Publication A Synthesis Report on Piloting of Remote Phone-Based Formative Assessment Solutions in Ghana, Nepal, and Pakistan(World Bank, Washington, DC, 2022)School closures related to Coronavirus disease 2019 (COVID-19) not only disrupted education but also impacted teachers’ ability to know whether and what their students were learning. This information gap was most challenging in contexts with limited internet connectivity and low access to smart digital devices. In such circumstances, conducting formative assessments remotely using basic phones was seen as a means to provide timely information to teachers, parents, and students and support learning continuity outside the classroom. As students return to school, the same solutions can be used to complement in-person instruction to accelerate learning recovery, expand the use of formative assessment in hard-to-reach schools, and improve the resilience of education systems when confronted by future shocks. This report describes the three pilot studies that aimed to test the logistical and technological feasibility of using short message service (SMS), interactive voice recording (IVR), and live phone calls (LPC) to conduct formative assessment of foundational math and literacy skills for primary-grade students. These pilot studies were conducted in Ghana, Nepal, and Pakistan between October 2020 and January 2022.
Users also downloaded
Showing related downloaded files
Publication Fixing the Foundation(Washington, DC: World Bank, 2023-09-20)Countries in middle-income East Asia and the Pacific were already experiencing serious learning deficits prior to the COVID-19 pandemic. COVID-related school disruptions have only made things worse. Learning poverty -- defined as the percentage of 10-year-olds who cannot read and understand an age-appropriate text -- is as high as 90 percent in several countries. Several large Southeast Asian countries consistently perform well below expectations on adolescent learning assessments. This report examines key factors affecting student learning in the region, with emphasis on the central role of teachers and teaching quality. It also analyzes the role education technologies, which came into widespread use during the pandemic, and examines the political economy of education reform. The report presents recommendations on how countries can strengthen teaching to improve learning and, in doing so, can enhance productivity, growth, and future development in the region.Publication Peru: Seizing Opportunities for Growth and Prosperity(World Bank, Washington, DC, 2025-03-11)Peru achieved remarkable economic success between 2002 and 2013 through structural reforms and prudent macroeconomic policies, nearly doubling the regional average with an annual growth rate of 6.1 percent and significantly reducing poverty from about 60 percent to 24 percent. However, progress has stalled since 2014, revealing structural challenges such as low productivity, persistent regional disparities, and declining institutional capacity exacerbated by political instability. Despite these obstacles, Peru retains substantial growth potential by strategically leveraging its comparative advantages, particularly as the world's second-largest copper exporter, and through sectors like agriculture and tourism. By adopting bold reforms to boost productivity, innovation, and women's economic empowerment, addressing spatial inequalities, and fundamentally strengthening institutional capacity and public investment management, Peru can accelerate its development trajectory and achieve high-income status by the early 2040s—three times faster than current trends suggest.Publication Classroom Assessment to Support Foundational Literacy(Washington, DC: World Bank, 2025-03-21)This document focuses primarily on how classroom assessment activities can measure students’ literacy skills as they progress along a learning trajectory towards reading fluently and with comprehension by the end of primary school grades. The document addresses considerations regarding the design and implementation of early grade reading classroom assessment, provides examples of assessment activities from a variety of countries and contexts, and discusses the importance of incorporating classroom assessment practices into teacher training and professional development opportunities for teachers. The structure of the document is as follows. The first section presents definitions and addresses basic questions on classroom assessment. Section 2 covers the intersection between assessment and early grade reading by discussing how learning assessment can measure early grade reading skills following the reading learning trajectory. Section 3 compares some of the most common early grade literacy assessment tools with respect to the early grade reading skills and developmental phases. Section 4 of the document addresses teacher training considerations in developing, scoring, and using early grade reading assessment. Additional issues in assessing reading skills in the classroom and using assessment results to improve teaching and learning are reviewed in section 5. Throughout the document, country cases are presented to demonstrate how assessment activities can be implemented in the classroom in different contexts.Publication Peru Country Climate and Development Report(World Bank, Washington, DC, 2022-11)The Peru Country Climate and Development Report (CCDR) provides analysis and recommendations on integrating the country’s efforts to achieve economic development with the pursuit of emission reduction and climate resilience. The CCDR explores opportunities and trade-offs for aligning Peru’s development path with its recent commitments on climate change. Peru is highly vulnerable to climate change and needs urgent adaptation action. Peru can benefit from decarbonization policies, thanks to its mining, forestry and agriculture, and renewable energy resources. Peru has many opportunities to develop and implement comprehensive climate policies that also increase productivity and reduce poverty. A low-carbon, resilient development for Peru would require substantial institutional reforms, in addition to public and private investments.Publication Business Ready 2024(Washington, DC: World Bank, 2024-10-03)Business Ready (B-READY) is a new World Bank Group corporate flagship report that evaluates the business and investment climate worldwide. It replaces and improves upon the Doing Business project. B-READY provides a comprehensive data set and description of the factors that strengthen the private sector, not only by advancing the interests of individual firms but also by elevating the interests of workers, consumers, potential new enterprises, and the natural environment. This 2024 report introduces a new analytical framework that benchmarks economies based on three pillars: Regulatory Framework, Public Services, and Operational Efficiency. The analysis centers on 10 topics essential for private sector development that correspond to various stages of the life cycle of a firm. The report also offers insights into three cross-cutting themes that are relevant for modern economies: digital adoption, environmental sustainability, and gender. B-READY draws on a robust data collection process that includes specially tailored expert questionnaires and firm-level surveys. The 2024 report, which covers 50 economies, serves as the first in a series that will expand in geographical coverage and refine its methodology over time, supporting reform advocacy, policy guidance, and further analysis and research.