Publication: Effects of COVID-19 on Student Learning: Assessing Learning Losses Using Adaptive Technology
Loading...
Published
2025-06-13
ISSN
Date
2025-06-13
Editor(s)
Abstract
This paper quantifies learning losses between 2020 and 2022 in the Dominican Republic, an upper-middle-income country. The paper uses data from a sample of ninth-grade students who benefited from computer adaptive learning software during this period. This study is among a few to measure actual losses among secondary school students, and it is the first to use detailed data on students’ mastery of individual math topics to do so. The findings show no evidence of learning losses in our analysis sample. However, the paper documents concerningly low learning levels, with the average student mastering only 45 percent of pre-requisite topics for their grade. These results should be interpreted with caution, as they are based on a select sample of urban schools and may not fully reflect broader educational trends across the country.
Link to Data Set
Citation
“Baron, Juan; Mola, José; Pineda, Astrid Camille; Polanco Santos, Paola Patricia. 2025. Effects of COVID-19 on Student Learning: Assessing Learning Losses Using Adaptive Technology. Policy Research Working Paper; 11144. © World Bank. http://hdl.handle.net/10986/43334 License: CC BY 3.0 IGO.”
Associated URLs
Associated content
Other publications in this report series
Publication The Economic Value of Weather Forecasts: A Quantitative Systematic Literature Review(Washington, DC: World Bank, 2025-09-10)This study systematically reviews the literature that quantifies the economic benefits of weather observations and forecasts in four weather-dependent economic sectors: agriculture, energy, transport, and disaster-risk management. The review covers 175 peer-reviewed journal articles and 15 policy reports. Findings show that the literature is concentrated in high-income countries and most studies use theoretical models, followed by observational and then experimental research designs. Forecast horizons studied, meteorological variables and services, and monetization techniques vary markedly by sector. Estimated benefits even within specific subsectors span several orders of magnitude and broad uncertainty ranges. An econometric meta-analysis suggests that theoretical studies and studies in richer countries tend to report significantly larger values. Barriers that hinder value realization are identified on both the provider and user sides, with inadequate relevance, weak dissemination, and limited ability to act recurring across sectors. Policy reports rely heavily on back-of-the-envelope or recursive benefit-transfer estimates, rather than on the methods and results of the peer-reviewed literature, revealing a science-to-policy gap. These findings suggest substantial socioeconomic potential of hydrometeorological services around the world, but also knowledge gaps that require more valuation studies focusing on low- and middle-income countries, addressing provider- and user-side barriers and employing rigorous empirical valuation methods to complement and validate theoretical models.Publication It’s Not (Just) the Tariffs: Rethinking Non-Tariff Measures in a Fragmented Global Economy(Washington, DC: World Bank, 2025-10-22)As tariffs have declined, non-tariff measures (NTMs) have become central to trade policy, especially in high-income countries and regulated sectors like food and green technologies. Although NTMs may serve legitimate goals, they could also sort countries and firms into or out of markets based on compliance capacity and differences in product mix. Documenting recent advances in the estimation of ad valorem equivalents (AVEs), this paper uncovers new patterns of use and exposure of NTMs. High-income countries rely more heavily on NTMs relative to tariffs, while low- and middle-income countries face steeper AVEs on their exports. Firm-level evidence shows that NTMs disproportionately affect smaller firms, leading to market exit and concentration. Poorly designed NTMs can harm productivity and welfare, while coordinated, capacity-aware use can deliver inclusive outcomes. Policy design, transparency, and diagnostics must evolve to reflect the growing role—and risks—of NTMs in a fragmented global trade landscape.Publication Monitoring Global Aid Flows: A Novel Approach Using Large Language Models(Washington, DC: World Bank, 2025-11-04)Effective monitoring of development aid is the foundation for assessing the alignment of flows with their intended development objectives. Existing reporting systems, such as the Organisation for Economic Co-operation and Development’s Creditor Reporting System, provide standardized classification of aid activities but have limitations when it comes to capturing new areas like climate change, digitalization, and other cross-cutting themes. This paper proposes a bottom-up, unsupervised machine learning framework that leverages textual descriptions of aid projects to generate highly granular activity clusters. Using the 2021 Creditor Reporting System data set of nearly 400,000 records, the model produces 841 clusters, which are then grouped into 80 subsectors. These clusters reveal 36 emerging aid areas not tracked in the current Creditor Reporting System taxonomy, allow unpacking of “multi-sectoral” and “sector not specified” classifications, and enable estimation of flows to new themes, including World Bank Global Challenge Programs, International Development Association–20 Special Themes, and Cross-Cutting Issues. Validation against both Creditor Reporting System benchmarks and International Development Association commitment data demonstrates robustness. This approach illustrates how machine learning and the new advances in large language models can enhance the monitoring of global aid flows and inform future improvements in aid classification and reporting. It offers a useful tool that can support more responsive and evidence-based decision-making, helping to better align resources with evolving development priorities.Publication The Macroeconomic Implications of Climate Change Impacts and Adaptation Options(Washington, DC: World Bank, 2025-05-29)Estimating the macroeconomic implications of climate change impacts and adaptation options is a topic of intense research. This paper presents a framework in the World Bank's macrostructural model to assess climate-related damages. This approach has been used in many Country Climate and Development Reports, a World Bank diagnostic that identifies priorities to ensure continued development in spite of climate change and climate policy objectives. The methodology captures a set of impact channels through which climate change affects the economy by (1) connecting a set of biophysical models to the macroeconomic model and (2) exploring a set of development and climate scenarios. The paper summarizes the results for five countries, highlighting the sources and magnitudes of their vulnerability --- with estimated gross domestic product losses in 2050 exceeding 10 percent of gross domestic product in some countries and scenarios, although only a small set of impact channels is included. The paper also presents estimates of the macroeconomic gains from sector-level adaptation interventions, considering their upfront costs and avoided climate impacts and finding significant net gross domestic product gains from adaptation opportunities identified in the Country Climate and Development Reports. Finally, the paper discusses the limits of current modeling approaches, and their complementarity with empirical approaches based on historical data series. The integrated modeling approach proposed in this paper can inform policymakers as they make proactive decisions on climate change adaptation and resilience.Publication The State of Global Services Trade Policies: Evidence from Recent Data(Washington, DC: World Bank, 2025-10-28)The economic environment for services trade has changed dramatically over the past 15 years, driven by rapid technological progress that has expanded the possibilities for exchanging services. How has trade policy responded to these changes? How do policy stances in a wide range of service sectors compare across economies? With its unprecedented global coverage, the Services Trade Policy Database and the associated Services Trade Restrictions Index, developed jointly by the World Bank and the World Trade Organization, help address these questions. This paper makes three principal contributions. First, it offers an in-depth discussion of the current state of services trade policies and their differences across 134 economies and 34 services subsectors. Second, the paper reveals how recent (2016–22) changes in policy stances have seen progressive liberalization by lower-income economies but stabilization or even slight policy reversals in high-income economies. This dynamic differs fundamentally from the trend that unfolded after the Great Recession over 2008–16. Third, the paper shows the implications of policy changes over the past six years on services trade costs, and it showcases how the Services Trade Policy Database’s regulatory information can inform trade negotiations, regulatory analysis, and policy making. Alongside these contributions, the paper documents updates to the Services Trade Policy Database’s economy and sector coverage and explains the latest methodological improvements made to the World Bank–World Trade Organization Services Trade Restrictions Index.
Journal
Journal Volume
Journal Issue
Collections
Related items
Showing items related by metadata.
Publication Why Do Students Learn so Little?(World Bank, Washington, DC, 2015-05)The Haitian education system made substantial improvements in access over the last decade, such that today the majority of Haiti’s children are in school. Despite improvements, the primary education system is highly inefficient: children start primary school 2 years late on average, and fewer than 60 percent will reach the last grade of the cycle. At each school, classroom observations were conducted using the Stallings Classroom Snapshot instrument, and questions about the school calendar and daily schedule asked. The results provide a representative picture of class time and teacher classroom practice in the Nord and Nord Est departments, and while not representative of Haiti as a whole, do provide a starting point for better understanding the major constraint to achieving a high-quality education for all children: the quality of teacher instruction. Section two describes the sample of schools and the stallings instrument; sections three and four present the main results of the classroom observations on teacher time use and pedagogical practices; section five provides estimates of overall class time that students receive; and section six concludes.Publication Promotion with and without Learning : Effects on Student Enrollment and Dropout Behavior(World Bank, Washington, DC, 2008-09)Many educators and policymakers have argued for lenient grade promotion policy - even automatic promotion - in developing country settings where grade retention rates are high. The argument assumes that grade retention discourages persistence or continuation in school and that the promotion of children with lower achievement does not hamper their ability or their peers' ability to perform at the next level. Alternatively, promoting students into grades for which they are not prepared may lead to early dropout behavior. This study shows that in a sample of schools from the Northwest Frontier Province of Pakistan, students are promoted primarily on the basis of merit. An econometric decomposition of promotion decisions into a component that is based on merit indicators (attendance and achievement in mathematics and language) and another that is uncorrelated with those indicators allows a test of whether parental decisions to keep their child in school is influenced by merit-based or non-merit-based promotions. Results suggest that the enrollment decision is significantly influenced by whether learning has taken place, and that grade promotion that is uncorrelated with merit has a negligible impact on school continuation.Publication A Simulation of COVID-19 School Closure Impact on Student Learning in Bangladesh(World Bank, Washington, DC, 2021-01)This Note presents results from a series of simulations that aim to capture the impacts that school closures in Bangladesh might have on the learning levels, enrollment and future earnings of children and students using a methodological tool developed by the Education Global Practice of the World Bank . We find that overall loss in learning for every child enrolled in school even in the most optimistic scenario is expected to be substantial and the economic implications of the learning losses are huge. Available data also indicates that remote learning requires to be made more effective. It is hoped that the insights from this note will be useful for the government, non-government, private sector and civil society engaged in education service delivery as they are attempting to forge effective partnerships during and after the crisis. There is an urgent need to substantially reduce additional dropouts and absenteeism through stipends and safe school opening and communication campaigns.Publication Measuring Learning : How Effective Student Assessment Systems Can Help Achieve Learning for All(World Bank, Washington, DC, 2012-02)The importance of learning assessment is linked to growing evidence that learning drives prosperity. Research finds a one standard deviation increase in scores on international assessments of reading and mathematics is associated with a 2 percent point increase in annual growth rates of Gross Domestic Product (GDP) per capita (Hanushek and Woessmann, 2007). This brief includes the following headings: challenges to assessing student learning; what do assessment systems look like?; Effective assessment systems; and reference.Publication Infrastructure, Learning Complements, and Student Learning(World Bank, Washington, DC, 2020-11-23)The purpose of this mixed methods study was twofold: (i) to examine how school infrastructure and learning complements can be better utilized to promote student learning in Indonesian schools; and (ii) to help the relevant ministries make more informed decisions about investment in school infrastructure and learning complements. Three analyses were conducted in the quantitative component: descriptive and comparative analyses of madrasah infrastructure, and a multivariate analysis of madrasah infrastructure and student achievement. The qualitative component employed the intentional sampling and positive‐deviance approach consisting of semi‐structured phone interviews with principals, teachers, librarians, and parents from 20 madrasah and non‐madrasah schools (11 high‐performing secondary schools with science laboratories and nine primary schools with libraries of which eight were supported by the innovation for Indonesia’s school children program, which aims to improve students’ literacy and numeracy skills). The results of the descriptive and comparative analyses indicated that the madrasah sector as a whole is not adequately equipped with basic physical and learning resource infrastructure and that private madrasahs have significantly lower levels of infrastructure than their public counterparts. However, the multivariate analysis results did not conclusively show that infrastructure directly contributes to student learning outcomes. The qualitative analysis found some promising learning practices related to teachers’ professional development, literacy initiatives, and customized teaching and learning. Nevertheless, challenges remain for many schools in the disconnect between pedagogical and infrastructural quality assurance mechanisms, the failure to fully exploit libraries as resources for student learning, and learning spaces and assets that are not sufficiently conducive to science education. Based on the study results and findings, this report offers four key steps to address the main challenges related to school infrastructure and learning complements: (i) prioritize resource allocation to basic physical and digital infrastructure for the most underserved groups of students; (ii) leverage educators to maximize their potential as catalysts in facilitating improved teaching and learning processes through an innovative and effective utilization of learning spaces and complements; (iii) streamline and strengthen quality assurance mechanisms to document, monitor, and assess the quality, condition, and use of infrastructure and related assets, and to improve the links between school infrastructure management and learning quality management; and (iv) increase the overall resilience of the education system to future crises by strengthening its capacity to coordinate, monitor, and manage the continued delivery of equitable education services through distance and hybrid learning.
Users also downloaded
Showing related downloaded files
No results found.