Publication: Validating Teaching Observation Tools: A Content-Based Approach for PLAY and Teach Primary
Loading...
Published
2025-03-24
ISSN
Date
2025-03-24
Author(s)
Editor(s)
Abstract
This study compares two tools used to observe and assess how teachers support student learning: the LEGO Foundation’s Engage tool, formerly PLAY, and the World Bank’s Teach Primary tool. The goal was to evaluate their similarities and overlaps in their measurement of teaching practices. Nine experts reviewed both tools in detail, carefully matching items from PLAY to those in Teach Primary. Results indicate that about one-third of the items are closely matched, showing that PLAY is built on a solid framework to capture engaging teaching practices. Another third of the items did not have a precise match, meaning each tool separately captures unique aspects of teaching that the other does not. The study also looked at how well the scores of the two tools aligned using accurate classroom data from Ethiopia, Peru, and Sierra Leone. The results showed a small positive relationship between the two tools, meaning they measure related but different aspects of teaching. The study also found that how PLAY is structured may need some adjustments to reflect better the skills it is designed to measure. By combining expert opinions with data analysis, this study provides strong evidence that both tools are valuable but serve different purposes. The findings highlight the importance of using multiple approaches to assess teaching quality. The study also offers recommendations for improving tool improvement and suggests the following steps on how classroom observation tools can help support improved teaching and learning worldwide.
Link to Data Set
Citation
“Bazaldua, Diego Luna; Carter, Emma. 2025. Validating Teaching Observation Tools: A Content-Based Approach for PLAY and Teach Primary. Education Working Paper; No. 10, February 2024. © World Bank. http://hdl.handle.net/10986/42984 License: CC BY-NC 3.0 IGO.”
Digital Object Identifier
Associated URLs
Associated content
Other publications in this report series
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Rethinking Teaching Quality(Washington, DC: World Bank, 2025-03-24)Engaging teaching has emerged as a key approach to fostering children’s socio-emotional and cognitive skills. This policy note draws on findings of a recent comparative study on the LEGO Foundation’s Engage, formerly known as Playful Learning Across the Years (PLAY)1, classroom observation tool, and the World Bank’s Teach Primary instrument. The study highlights how these tools complement each other and underscore the importance of actionable strategies to integrate and monitor engaging teaching practices in primary schools, including across low- and middle-income countries (LMICs) where they tend to be less common. By leveraging these tools to monitor teaching practices, policymakers can signal the importance of compelling, engaging, and inclusive teaching approaches that enhance educational outcomes.Publication Guiding Questions for Choosing the Right Tools to Measure Early Childhood Outcomes(Washington, DC: World Bank, 2022-02-18)A growing understanding of the importance of children’s earliest years has led to an increasing desire to measure early childhood development (ECD) outcomes. There are now nearly 150 tools for measuring ECD outcomes internationally, which can make it challenging to choose an appropriate measurement tool for a given measurement effort. This document guides the user through the why, who, what, and how questions that must be considered prior to selecting tools for measuring ECD outcomes. Users should document their responses at each step to collate the information needed to identify and select an appropriate ECD measurement tool.Publication Guidance Note on Phone-based Formative Assessment(World Bank, Washington, DC, 2022)Phone-Based Formative Assessment refers to the use of mobile phone technology to engage students outside the classroom, assess their learning in real time, and provide timely, constructive feedback. Such assessment is particularly critical to promote learning continuity in the context of COVID-19-related school closures, which have led to the expansion and availability of remote teaching and learning resources.Publication Review and Guidance on ECD Assessment Tools in FCV Contexts(Washington, DC: World Bank, 2025-01-14)By 2030, an estimated two-thirds of the world's extremely poor could be concentrated in countries and contexts characterized by fragility, conflict, and violence (FCV) (World Bank Group, 2020). FCV contexts, affected by humanitarian crises, prolonged emergencies, and armed conflicts, are significant hindrances to poverty reduction and sustainable development. The cycle of instability and violence in these contexts often leads to the destruction of infrastructure and a strain on resources, making it difficult for communities to lift themselves out of poverty and achieve sustainable development goals. The list of FCV contexts includes the World Bank list of countries and territories affected by fragility and conflict situations (FCS), as well as countries suffering from violence and those with large-forcibly displaced populations that are not included in the FCS list. This review aims to describe which early childhood development (ECD) measurement tools have been used in FCV contexts and to serve as a guide for tool selection in these settings. This guidance is intended to assist country teams in identifying appropriate tools for ECD measurement activities, provided that such activities are already recognized as priorities. While parents and caregivers are essential to ECD, particularly in FCV environments, this review does not concern tools that measure adults' well-being or parenting-related outcomes. Instead, it measures children's developmental outcomes and other child-related constructs relevant to FCV contexts. The authors briefly describe the situation of children living in FCV contexts and how it can affect their development. We then make a case for the importance of ECD measurement, the lack of data on ECD in FCV contexts, and the data collection challenges. After that, we provide a deep dive into what was found in the desk review and provide a framework for tool selection. Finally, we present policy recommendations.Publication A Synthesis Report on Piloting of Remote Phone-Based Formative Assessment Solutions in Ghana, Nepal, and Pakistan(World Bank, Washington, DC, 2022)School closures related to Coronavirus disease 2019 (COVID-19) not only disrupted education but also impacted teachers’ ability to know whether and what their students were learning. This information gap was most challenging in contexts with limited internet connectivity and low access to smart digital devices. In such circumstances, conducting formative assessments remotely using basic phones was seen as a means to provide timely information to teachers, parents, and students and support learning continuity outside the classroom. As students return to school, the same solutions can be used to complement in-person instruction to accelerate learning recovery, expand the use of formative assessment in hard-to-reach schools, and improve the resilience of education systems when confronted by future shocks. This report describes the three pilot studies that aimed to test the logistical and technological feasibility of using short message service (SMS), interactive voice recording (IVR), and live phone calls (LPC) to conduct formative assessment of foundational math and literacy skills for primary-grade students. These pilot studies were conducted in Ghana, Nepal, and Pakistan between October 2020 and January 2022.
Users also downloaded
Showing related downloaded files
Publication Jobs in a Changing Climate: Insights from World Bank Group Country Climate and Development Reports Covering 93 Economies(Washington, DC: World Bank, 2025-11-05)The World Bank Group’s Country Climate and Development Reports (CCDRs) provide a crosscutting look at how countries’ development prospects, and the job opportunities they offer to their people, can be threatened by climate impacts and supported by climate policies. Climate change and policies affect jobs through impacts on productivity, energy and material efficiency, and physical, human, and natural capital. They can also transform employment opportunities, especially through complementary measures that help workers and firms adapt to and benefit from new technologies and production practices. Prepared by the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA), CCDRs integrate country perspectives, climate science and economic modeling, private sector information, and policy analysis to assess how countries can successfully grow and develop their economies and create jobs despite increasing climate risks and while achieving their climate objectives and commitments. Each CCDR starts from the country’s development priorities, opportunities, and challenges, and is developed in close consultation with governments, businesses, and civil society, ensuring the recommendations reflect national priorities. By combining evidence on adaptation, resilience, and emissions pathways, CCDRs highlight where climate action can reinforce development and job creation, and where targeted policies are needed to manage risks and smooth labor market transitions. Taken together, these elements can help create local jobs, ensure economic transitions are just and inclusive, and equip workers and firms to navigate the disruptions and opportunities of a changing climate and changing technologies.Publication Kyrgyz Republic Country Climate and Development Report(Washington, DC: World Bank, 2025-11-03)This Country Climate and Development Report (CCDR) on the Kyrgyz Republic aims to support the country’s development goals amid a changing climate. The CCDR considers two policy scenarios up to 2050: the business-as-usual (BAU) and high-growth scenarios. As it quantifies the likely impacts of climate change on the Kyrgyz economy between now and 2050, the report highlights key government actions to best prepare for and adapt to climate impacts (referred to as “with adaptation” measures), with a particular focus on the time horizon up to 2030. The CCDR also outlines a path to net zero emissions by 2050 (referred to as “with mitigation” measures, “decarbonization,” or, simply, “net zero 2050”), highlighting associated development co-benefits.Publication Comoros Country Climate and Development Report(Washington, DC: World Bank, 2025-06-18)The Union of the Comoros (The Comoros) has significant vulnerability to climate change-related risks but has considerable opportunities to strengthen preparedness and resilience against these challenges. According to the Notre Dame Global Adaptation Index, the Comoros is the 29th-most vulnerable country to climate change and the 163rd most ready to adapt (out of 191). The Comoros archipelago is exposed to many natural hazards that adversely affect the country’s natural capital, people, and physical infrastructure. In 2014, the economic cost of climate-related disasters was estimated at 5.7 million dollars annually, equivalent to 9.2 percent of Gross Domestic Product (GDP). Between 2018 and 2023, as many as 11 tropical depressions or cyclones impacted the country, with Cyclone Kenneth causing the greatest damage, equivalent to 14 percent of GDP, resulting in total economic growth falling from 3.6 percent in 2018 to 1.9 percent in 2019. More than 345,000 people (40 percent of the population) were affected by the cyclone, with 185,000 people experiencing severe impacts and 12,000 people displaced. However, there is an opportunity for the country to grow more robust and shock-responsive, and to establish pre-positioned funding mechanisms to enhance future crisis response efforts. For the Comoros, adaptation and climate-resilient development are the key climate change focus areas, with the country projected to face 836 million dollars 2050 in additional costs due to climate-related impacts. Current plans to adapt to the impacts of climate change in the Comoros include efforts to improve water management, strengthen coastal protection, and develop climate-smart agriculture practices. Given the country’s reliance on its natural resource base for economic growth and mobility, protection of these resources from climate change will be essential for promoting resilient growth and development. In addition to growing the adaptive capacity of the country’s natural resource sectors, strategic economic diversification will be important to help minimize future climate impacts, and development activities will need to be undertaken in such a way as to attract low-carbon co-benefits. The Union of the Comoros is committed to addressing climate change through its Nationally Determined Contribution (NDC) and national priorities. The country’s NDC (which was revised in 2021 for a ten-year horizon) sets ambitious targets, with a goal of reducing greenhouse gas emissions by 23 percent by 2030. The country also plans to significantly increase the share of renewable energy in its energy portfolio, reaching 33 MW by 2030. This will not only promote low-carbon development but also reduce the country’s dependency on imported oil and coal, which currently make up 95 percent of the energy mix. Additionally, the Comoros has declared its intention to increase CO2 removals by 47 percent by 2030, compared to BAU.Publication Guinea-Bissau Country Climate and Development Report(Washington, DC: World Bank, 2024-10-23)Guinea-Bissau is endowed with a wealth of natural resources, with the highest natural capital per capita in West Africa (US3,874 dollars per capita), which could be leveraged for sustainable and resilient growth. However, Guinea-Bissau faces significant development hurdles, such as high poverty rates, political instability, and economic challenges, including an over-reliance on cashew nuts. Rural poverty has increased, and the nation's infrastructure, education, and health care systems are underdeveloped. Climate change poses a severe threat, potentially impacting agriculture, fisheries, and infrastructure. Without adaptation, it could lead to a significant cut in real GDP per capita (minus 7.3 percent by 2050) and increase in poverty (with up to over 200,000 additional poor by 2050, that is, 5 percent of the expected population, in the worst scenario). The country's low greenhouse gas emissions are expected to rise, mainly due to agriculture and land-use changes, with deforestation being a major contributing factor. Although Guinea-Bissau is a low emitter, it has high mitigation ambitions, targeting a 30 percent reduction in greenhouse gas emissions by 2030. The Nationally Determined Contribution outlines significant climate actions, with initiatives focused on forest conservation, sustainable agriculture, and community development. However, the country's political instability, institutional weaknesses, and limited financial resources pose challenges to implementing these climate commitments, which depend heavily on external funding. The financial sector's underdevelopment and vulnerability to external shocks limit its ability to support green investments, though reforms could enhance resilience. Guinea-Bissau must consider its climate financing as development financing and vice-versa, engage the private sector, and integrate climate goals with national development plans to ensure a sustainable future. Concessional climate financing is vital due to the underdeveloped financial sector and the government’s limited borrowing capacity. Addressing Guinea-Bissau's vulnerability to climate change and its structural issues requires a cohesive approach that integrates development and climate strategies. This could involve improving governance, diversifying the economy, protecting natural capital, developing human capital, and investing in sustainable agriculture and infrastructure. The transition to a more sustainable and inclusive development pathway that supports economic growth is possible, but requires focusing on key strategic sectors, enhancing institutional capacity, and creating the conditions to mobilize finance. As a highly vulnerable country, there are myriad needs in the different sectors; however, to be more efficient and effective, Guinea-Bissau should prioritize actions in a few sectors, especially actions on biodiversity, agriculture, and social protection. Low carbon development, especially in energy and forestry sectors, could provide cost-efficient solutions and attract climate finance, including from the private sector, which will support the overall development agenda.Publication Mongolia Country Climate and Development Report(Washington, DC: World Bank, 2024-10-22)Mongolia’s development prospects are uniquely challenged by both the impacts of climate change and the global shift toward a low-carbon economy. The country’s efforts toward decarbonization pose significant challenges given the structurally high-emission intensity of its economy. While challenging, climate action also presents Mongolia with opportunities to achieve important development benefits. The effects of climate risks and the shift away from coal will have diverse impacts across different regions, communities, and socioeconomic levels. The report assesses the critical interconnections between Mongolia’s development ambitions and climate change action and identifies ways to transition to a more economically diversified, inclusive, and resilient development path. It highlights key climate and transition risks affecting Mongolia’s future development and presents a pathway to enhance climate mitigation and adaptation. The report also makes a case for strengthening policies to enhance resilience to climate change and ensure a just transition, particularly for the most vulnerable. The report is structured as follows: section 1 gives introduction. Section 2 delves into the linkages between development and climate in Mongolia and presents model-based findings on the economic and poverty impacts of climate change under different scenarios. Section 3 covers four in-depth sectoral analyses. The first two mainly focus on adaptation to climate change in the agriculture and water sectors. The third considers prospects for the extraction sector, while the fourth sectoral analysis focuses on decarbonizing power and heat generation. Section 4 shifts the focus to how the government can boost resilience for climate-vulnerable populations. Section 5 outlines options for mobilizing private and public financing and private investments to support the green transition. Section 6 examines the existing institutional and governance structure for climate action and presents recommendations to improve its effectiveness, and section 7 concludes with a framework for prioritizing the policy actions outlined in this report.